Be Software Architecture Wise
Be Wise Apps

Leer en español · Lire en français · Auf Deutsch lesen

Chapter 11 of 12 · Advanced

Evaluation, Decision-Making and Governance

This chapter is about judging, governing and evolving architectures over time. It covers formal evaluation with the ATAM, lightweight reviews such as risk-storming and pre-mortems, fitness functions and evolutionary architecture, governance in agile organisations, Team Topologies and socio-technical design, legacy modernisation with the strangler fig, leadership and influence, and the business and ethical case for architecture work. It draws together every earlier chapter, uses the food-delivery platform as a running example, and is written for experienced developers, technical leads and architects who make or guide significant decisions.

Video introduction to Chapter 11

7 min · narrated, with captions
Listen only (audio)
Read the transcript

Welcome to Chapter 11, Evaluation, Decision-Making and Governance. The earlier chapters taught you how to describe what a system must achieve, how to structure it, and how to make it fast, reliable, secure and economical. This chapter is about the work that surrounds those decisions over a system's whole life: checking them before money is committed, keeping them true as hundreds of changes land every month, and justifying them in business and ethical terms.

The chapter is written for experienced developers, technical leads and architects who make or guide significant decisions. It is where the course comes together, so it builds on every earlier chapter. It links back most often to Chapters 1 to 4: trade-offs, technical debt, quality attribute scenarios, Conway's law and decision records. Chapters 5 to 10 help, but are not essential. The level is advanced, but every section begins with a short explanation for newcomers. And it leads to Chapter 12, which applies the whole discipline to systems built around artificial intelligence models.

The running example is the food delivery platform used since Chapter 2. You will see its architecture evaluated, risk-stormed, protected by fitness functions, governed, reorganised around teams, and partly modernised. Section eleven point one covers formal evaluation with the Architecture Tradeoff Analysis Method, or ATAM: its nine steps across two meetings, who takes part, and its outputs, such as risks, sensitivity points, trade-off points and risk themes. Section eleven point two explains why monthly review boards so often fail, and what works instead: risk-storming, the pre-mortem, architecture katas and written design reviews. Section eleven point three turns one-off evaluation into continuous protection. A fitness function is an objective check of an architectural characteristic, ideally automated, such as a dependency rule or a load test with percentile thresholds. Section eleven point four asks how an organisation of many autonomous teams keeps its architecture coherent, through principles, standards, guardrails and gates, the advice process and technology radars.

This diagram from Section eleven point four contrasts two ways of governing. In gate-based governance, a team designs, then waits in a review board's queue for weeks. If the design is rejected, it is redesigned and waits again. Only after approval can the team build and release. In guardrail-based governance, the team decides, and its change passes through a pipeline with guardrails: policy as code and fitness functions that check objective rules automatically. It can reach release in minutes. Underneath sit the supports: the advice process for significant decisions, principles and a technology radar for shared direction, and a paved road of templates and platform. Guardrails leave people free for the decisions that need judgement. And in the advice process, anyone may make an architectural decision, after seeking advice from those affected and from experts, and recording it.

Section eleven point five takes Conway's law seriously as a design tool. It presents Team Topologies: four team types, three ways for teams to interact, and the limits of a team's cognitive load. Section eleven point six deals with the systems that already exist: why big-bang rewrites so often fail, and the incremental techniques that work. Section eleven point seven covers the human side of the role: leading without formal authority, building trust, facilitating decisions, handling conflict, and communicating with executives. And Section eleven point eight closes the chapter with two arguments an architect must make well: the business case, with net present value and payback, and the ethical case, including foreseeable harms and sustainability.

This diagram from Section eleven point six shows one of those techniques, the strangler fig: replacing a legacy system piece by piece while it keeps running. First, intercept. Clients call a routing facade, which still sends all traffic to the legacy monolith. Nothing changes in behaviour yet. Next, the first slice. The facade sends one feature, order tracking, to a small new service, with temporary data synchronisation between old and new. Slice by slice, most of the traffic moves across, until only billing is left in the old system. Finally, all traffic goes to the new services, and the legacy system is switched off. The migration is finished only when the old system and the temporary code have both been removed.

Architecture is not finished when the diagram is drawn. Its decisions have to be tested, protected while the system changes, made by the right people, carried by teams whose structure fits them, and justified to sponsors and society. The most effective architects make this work light and continuous, rather than heavy and occasional. Short risk reviews, instead of annual audits. Automated guardrails, instead of approval queues. Advice, instead of permission. And incremental migration, instead of rewrites. The discipline that ties it together is the one this course began with: name the quality you need, make it measurable, decide deliberately, write down why, and keep checking.

By the end of the chapter, you will be able to explain when to evaluate an architecture, and run either the ATAM or a lightweight review such as risk-storming, with a risk register and owners. You will be able to design fitness functions that turn quality attribute scenarios into automated checks. You will be able to plan an incremental modernisation, using the strangler fig, branch by abstraction and parallel runs. And you will be able to calculate net present value and payback for a business case, and review an architecture for ethical and sustainability concerns.

You can read the chapter in order, or go straight to the section you need. If an idea from an earlier chapter is unfamiliar, follow the link back to it. Allow about three and a half hours to read the whole chapter. At the end of each section there are self-check questions. Answer them in your head before you look at the answers. When you are ready, there is an optional chapter test, which takes about forty five minutes. It has twenty multiple choice questions and two written answers. The pass mark is eighty per cent.

That is the shape of the chapter. Start with Section eleven point one, on architecture evaluation and the ATAM. See you there.

Download chapter (PDF)Read in the app

At a glance

You will learn to

  • Explain when and why to evaluate an architecture, and run the nine steps of the ATAM to produce risks, non-risks, sensitivity points, trade-off points and risk themes.
  • Facilitate lightweight reviews such as risk-storming and pre-mortems, and turn their results into a risk register with owners.
  • Design fitness functions that turn quality attribute scenarios into automated checks of structure, performance, security, resilience and data.
  • Write architecture principles and choose between guardrails, gates and the advice process to govern different kinds of decision.
  • Apply Team Topologies' team types, interaction modes and cognitive load to align teams with the intended architecture.
  • Plan an incremental legacy modernisation using the strangler fig, branch by abstraction and parallel runs.
  • Lead and influence architectural decisions without formal authority, including when communicating with executives.
  • Calculate net present value and payback for a business case, and review an architecture for ethical and sustainability concerns.

Before you start

Chapters 1 to 4, especially decisions and trade-offs (Section 1.6), technical debt (Section 1.7), quality attribute scenarios and utility trees (Sections 2.3 and 2.8), Conway's law (Section 3.7) and decision records (Section 4.5). Chapters 5 to 10 help but are not essential.

Time

About 3½ hours to read; 45 minutes for the test.

Key terms

ATAM · Utility tree · Sensitivity point · Trade-off point · Risk-storming · Pre-mortem · Fitness function · Evolutionary architecture · Advice process · Technology radar · Team Topologies · Strangler fig · Net present value · Software Carbon Intensity

Judging, governing and evolving architecture

The earlier chapters taught how to describe what a system must achieve, how to structure it, and how to make it fast, reliable, secure and economical. This chapter is about the work that surrounds those decisions over a system's whole life: checking that they are sound before money is committed, keeping them true as hundreds of changes land every month, deciding who may make which decisions in an organisation of many teams, reshaping teams and legacy systems, persuading people, and justifying the cost of architecture work in business and ethical terms. It is where the course comes together, so it links back often: to quality attribute scenarios and utility trees in Chapter 2, to principles and metrics in Chapter 3, to decision records in Chapter 4, to Conway's law in Section 3.7 and to technical debt in Section 1.7.

The level is advanced, but every section begins with a short explanation for newcomers, and the running example is the food-delivery platform used since Chapter 2: customers, restaurants and couriers, services for ordering, dispatch and notifications, an event broker and an external payment provider. You will see its architecture evaluated, risk-stormed, protected by fitness functions, governed through principles and a technology radar, reorganised around teams and partly modernised.

Evaluating and protecting decisions: Sections 11.1 to 11.3

Section 11.1 covers formal architecture evaluation and the SEI's ATAM: why and when to evaluate, its nine steps across two meetings, who takes part, and its distinctive outputs: risks, non-risks with their assumptions, sensitivity points, trade-off points and risk themes. The utility tree from Section 2.8 returns in its original setting, and the CBAM shows how to weigh the benefit of each fix against its cost. A condensed ATAM of the food-delivery platform shows the tables an evaluation actually produces.

Section 11.2 explains why monthly review boards so often fail and what works instead: Simon Brown's risk-storming, Gary Klein's pre-mortem, Ted Neward's architecture katas, Eoin Woods's TARA for existing systems, written design reviews and checklists. It ends with a step-by-step format for a 90-minute review and a guide to choosing between techniques.

Section 11.3 turns one-off evaluation into continuous protection. A fitness function is an objective check of an architectural characteristic, ideally automated: a dependency rule, a load test with percentile thresholds, a vulnerability scan, a chaos experiment or a schema compatibility check. Together with small, frequent, safe changes, fitness functions make an evolutionary architecture possible. Three scenarios from Chapter 2 become working checks, with code.

Governing, organising and modernising: Sections 11.4 to 11.6

Section 11.4 asks how an organisation of many autonomous teams keeps its architecture coherent. It distinguishes principles, standards, guardrails and gates; shows how to write principles with a name, statement, rationale and implications; and describes decentralised decision-making through Andrew Harmel-Law's advice process, architecture advisory forums and technology radars, with compliance automated through fitness functions and policy as code.

Section 11.5 takes Conway's law seriously as a design tool. It presents Matthew Skelton and Manuel Pais's Team Topologies: four team types, three interaction modes, team cognitive load, team APIs and fracture planes, and shows how to redesign the food-delivery teams around streams of change. Section 11.6 deals with the systems that already exist: why big-bang rewrites so often fail, the range of migration strategies, and the incremental techniques that work, including the strangler fig, branch by abstraction, parallel runs, change data capture and anti-corruption layers, worked through by strangling an order module out of a monolith.

Leading, justifying and acting responsibly: Sections 11.7 and 11.8

Section 11.7 covers the human side of the role: leading without formal authority, building trust, facilitating decisions by consent or consensus, handling conflict and organisational politics, communicating with executives, mentoring, staff-plus engineering paths and the decision traps that catch experienced people, with a contested event-bus decision navigated step by step.

Section 11.8 closes the chapter with the two arguments an architect most needs to make well. The business case: costs, benefits, risks and options, with net present value and payback calculated in a worked example, and technical debt expressed in money and time. And the ethical case: professional codes of conduct, foreseeable harms such as privacy loss, bias, inaccessibility and manipulative design, and sustainability measured with the Software Carbon Intensity specification.

The one idea to take away

Architecture is not finished when the diagram is drawn. Its decisions have to be tested against what the business needs, protected while the system changes, made by the right people with the right advice, carried by teams whose structure fits them, and justified in terms that sponsors and society can accept. The most effective architects make this work light and continuous rather than heavy and occasional: short risk reviews instead of annual audits, automated guardrails instead of approval queues, advice instead of permission, incremental migration instead of rewrites. The discipline that ties it together is the one this course began with: name the quality you need, make it measurable, decide deliberately, write down why, and keep checking.

The 8 sections

11.1 · Advanced · 28 minEvaluation with ATAMWhy and when to evaluate an architecture, how the SEI's ATAM works step by step, what risks, sensitivity points and trade-off points are, and how CBAM adds costs and benefits.Read →11.2 · Advanced · 26 minLightweight reviewsWhy review boards often fail, and the lightweight alternatives that work: risk-storming, pre-mortems, architecture katas, TARA, RFC reviews and checklists, with a 90-minute review format.Read →11.3 · Advanced · 27 minFitness functionsHow to protect architectural characteristics with automated checks: what fitness functions are, their categories, examples for structure, performance, security, resilience and data, and evolutionary architecture.Read →11.4 · Advanced · 28 minGovernanceWhat architecture governance is for and how to do it without slow gates: principles, standards, guardrails, the advice process, advisory forums, technology radars, policy as code and enterprise architecture.Read →11.5 · Advanced · 24 minTeam TopologiesHow to design teams and software together: the four team types, three interaction modes, cognitive load, team APIs and fracture planes, with a worked redesign of the food-delivery teams.Read →11.6 · Advanced · 25 minLegacy modernisationWhy big rewrites fail and how to modernise safely instead: the seven Rs, the strangler fig, branch by abstraction, parallel runs, change data capture, anti-corruption layers and careful data migration.Read →11.7 · Advanced · 24 minLeadershipHow architects lead without formal authority: building trust, facilitating decisions by consent or consensus, handling conflict and politics, talking to executives, riding the architect elevator and growing other architects.Read →11.8 · Advanced · 25 minEthics and businessHow to argue for architecture work in money, time and risk, with net present value and payback worked through; and how professional ethics, foreseeable harms and green software practice shape responsible design.Read →

Chapter test

Test your understanding of Chapter 11

Optional: 20 multiple-choice questions and 2 short written answers, drawn afresh from a bank of 72 questions. Pass mark 80%. Passing every chapter test, then the final assessment, earns the Be Wise Certificate of Completion.

Take the Chapter 11 test in the app

Further reading