Description

V. Serafeimidis and S. Smithson, “Information systems evaluation as an organisational institution experiences from a case study,” Information Systems Journal, Vol. 13, pp. 251–274, 2003.

**V. Serafeimidis and S. Smithson, “Information systems evaluation as an organisational institution experiences from a case study,” *Information Systems Journal*, Vol. 13, pp. 251–274, 2003.**

—

When the world of business turned digital in the early 2000s, scholars and practitioners alike scrambled to understand how **information systems (IS) evaluation** could become a stable, repeatable part of organizational life. The landmark article by **V. Serafeimidis and S. Smithson**—*Information systems evaluation as an organisational institution: experiences from a case study*—offers a deep dive into exactly that question. Published in the respected *Information Systems Journal* (Vol. 13, 2003), the paper still resonates today, providing timeless insights for managers, IT auditors, and researchers who want to turn ad‑hoc assessments into a genuine **institutional practice**.

### From Ad‑Hoc Checks to Institutionalised Evaluation

Serafeimidis and Smithson begin by describing the chaotic landscape they observed in a large multinational corporation. IS projects were evaluated sporadically, often only when a problem surfaced or a senior executive demanded a report. The authors argue that such **reactive evaluation** hampers strategic alignment, wastes resources, and creates blind spots in risk management. Their case study reveals how the organization shifted from this reactive mode to an **institutionalised evaluation framework**—a set of formalized processes, governance structures, and cultural norms that embed IS assessment into everyday decision‑making.

Key takeaways for modern readers include:

| Element | What the authors observed | Modern best‑practice equivalent |
|———|—————————|——————————–|
| **Governance** | Creation of an IS Evaluation Committee reporting to the CIO. | Enterprise Architecture Boards, IT Governance Committees |
| **Standardized Metrics** | Development of a balanced scorecard covering performance, cost, and user satisfaction. | KPI dashboards, OKR frameworks for IT |
| **Knowledge Management** | A centralized repository of past evaluation reports, lessons learned, and templates. | Knowledge bases, collaboration platforms (Confluence, SharePoint) |
| **Continuous Learning** | Quarterly workshops where project teams review evaluation outcomes. | Agile retrospectives, DevOps post‑mortems |

These pillars illustrate how an **organisational institution** emerges when evaluation is no longer a one‑off activity but a recurring, expected part of the corporate rhythm.

### Why Institutionalising IS Evaluation Matters Today

Fast‑forward to 2026, and the digital ecosystem has exploded: cloud‑native services, AI‑driven analytics, and edge computing have added layers of complexity. Yet the core challenge remains—**how do we ensure that information systems deliver value and remain secure?** The answer, according to Serafeimidis and Smithson, lies in institutionalisation:

1. **Strategic Alignment** – When evaluation is baked into governance, IT initiatives can be measured against corporate goals such as revenue growth, customer experience, and sustainability.
2. **Risk Mitigation** – Regular, standardized assessments surface vulnerabilities before they become breaches, a critical factor in today’s cyber‑threat landscape.
3. **Resource Optimisation** – Consistent metrics help finance teams allocate budgets more intelligently, avoiding costly overruns on under‑performing systems.
4. **Cultural Adoption** – By turning evaluation into a shared responsibility, organisations foster a culture of accountability and continuous improvement.

### Practical Steps to Replicate the Institutional Model

If you’re inspired by the case study and want to embed **information systems evaluation** into your own organization, start with these actionable steps:

1. **Define a Governance Charter** – Appoint an IS Evaluation Committee with clear roles, reporting lines, and decision‑making authority.
2. **Select Core Metrics** – Use a balanced scorecard approach: operational efficiency, cost‑effectiveness, user satisfaction, and security compliance.
3. **Build a Central Repository** – Store all evaluation reports, templates, and best‑practice guides in an accessible, searchable system.
4. **Schedule Regular Reviews** – Quarterly or bi‑annual review cycles keep the process fresh and allow teams to act on findings promptly.
5. **Invest in Training** – Equip project managers and analysts with evaluation skills through workshops, certifications, and peer‑learning sessions.

### The Enduring Legacy of the 2003 Study

What makes the Serafeimidis and Smithson article a **must‑read** for today’s IS professionals is its blend of theory and practice. By grounding their analysis in a real‑world case study, the authors demonstrate that institutionalising evaluation is not a lofty academic ideal—it is an achievable, measurable transformation. Their work also foreshadows modern concepts like **IT Service Management (ITSM)**, **Enterprise Risk Management (ERM)**, and **Digital Governance**, all of which rely on systematic evaluation as a cornerstone.

### Final Thoughts

Whether you’re a CIO looking to tighten oversight, a consultant guiding digital transformation, or a researcher exploring IS governance, the insights from *“Information systems evaluation as an organisational institution experiences from a case study”* remain highly relevant. The article reminds us that **institutional change** is a journey—one that begins with recognizing the gaps in ad‑hoc evaluation and ends with a mature, repeatable process that drives strategic value.

By adopting the institutional framework championed by Serafeimidis and Smithson, organisations can turn their information systems from a set of isolated tools into a **strategic asset** that continuously delivers measurable outcomes. In an era where data drives every decision, making evaluation an organisational institution isn’t just smart—it’s essential.

—

**Keywords:** information systems evaluation, organisational institution, case study, IS governance, IT risk management, balanced scorecard, digital transformation, enterprise architecture, IT governance, knowledge management, strategic alignment, cybersecurity, resource optimisation, continuous improvement.