⚠
Privacy Notice: When you sign in with GitHub, your quiz attempts are stored in Google Firebase so you can track your progress. This data is only accessible to the course instructor, is not otherwise shared, and will be deleted at the end of the semester. For earlier deletion, contact the instructor. Prefer to stay anonymous? Use guest mode or a GitHub account without your real name.
Loading...

07 Orchestration Placement Diagnosis: 6 Cards

Score: 0 / 18

Goal

In this quiz you treat six recurring needs in an AI-assisted development workflow as objects of study. For each need you decide where in the orchestration layer it belongs and why, then predict the cost of the tempting wrong placement — in context-budget and attention terms. This is a routing exercise, not a lab: it cites budget reasoning only as justification. By the end you will:

  1. Route a recurring need to the right orchestration mechanism — root CLAUDE.md, a subdirectory CLAUDE.md, a skill, memory, a tool/MCP server, a hook/CI gate, or out-of-scope;
  2. Classify the kind of need behind it — influence, enforcement, capability, or human ownership — using Lecture 7’s completed three-layer model;
  3. Reason about placement as a shared, finite context window (§10.1): the window has a fixed size, so every token an always-on block occupies is a token (and a slice of cost and latency) not available to the task — treat “budget” as window occupancy and cost, not as a single pool of attention split evenly among tokens (attention is normalised per head and per position and concentrates on what the model has learned to weigh, so this budget metaphor is a planning heuristic, not a literal attention law);
  4. Predict the concrete failure of a mis-placement — wasted window cost, lost-in-the-middle, never-loaded-so-absent, probable-not-guaranteed, stale memory, or widened blast radius.

Learning objectives

After working through this quiz, you should be able to:

  1. Place a recurring need at the right point in the orchestration layer, and justify the choice on a named axis.
  2. Distinguish the four kinds of need — influence, enforcement, capability, human — and recognise that a placement decision sits inside a kind, not instead of it.
  3. Reason in budget terms about always-on standing charges vs. on-demand vs. free, treating the window as one finite, shared resource (occupancy and cost) — every always-on token is window the task does not get, which is true regardless of how attention itself distributes.
  4. Predict the cost of a wrong placement mechanistically: which failure mode it triggers and why.
  5. Reject the sterner CLAUDE.md reflex — recognising that more or louder influence never substitutes for enforcement, a capability, or a better placement.
  6. Answer “it depends” responsibly — by naming the deciding condition, never leaving it bare.

Required prior concepts

Run this quiz after the Lecture 6 “Prompt Strategy Diagnosis” deck and after Lecture 7 §10–11. You should already be familiar with:

  • CLAUDE.md / AGENTS.md and how they become tokens (§4) — the two loading rules, always-on (rule one) and on-demand subdirectory splice (rule two)
  • skills as context on demand (§7)
  • the illusion of memory (§5) and CLAUDE.md vs MEMORY.md (§5.2)
  • the tool-call loop (§8) and MCP, the standard interface (§9)
  • the context budget (§10) — everything competes for one finite window
  • the completed three-layer model — influence / enforcement / human (§11)

The bridge from Lecture 6

This deck is the Lecture 7 sibling of the Lecture 6 “Prompt Strategy Diagnosis” deck. Three threads carry over:

  • The three-layer model is the first cut. L6 gave you influence / enforcement / human. L7 lets you derive every property of those layers — and adds a fourth kind of need, capability: the system actually touching the world, which only a tool can do.
  • A skill is a codified L6 pattern. The L6 few-shot example you used to retype becomes a versioned artifact on disk (§7.1). Placement is the next station of L6’s “structure, promoted from habit to artifact.”
  • “Wrong tool for the job” becomes “wrong placement.” L6’s anti-pattern — using prompting where the task needed enforcement or a tool — generalises here to using the wrong orchestration mechanism: putting a one-task rule in always-on root, prompting a capability that only a tool can grant, or wording a CLAUDE.md sterner when the task needs a hook.

Placement menu reference sheet

Use this as your cheat sheet. The right-hand column is the single question that routes most needs.

Mechanism What it is Cost profile Decide this when…
Root CLAUDE.md / AGENTS.md Always-on instruction file, loaded at session start (§4.1) Always-on standing charge in every session The need is genuinely always-on — relevant to (nearly) every session
Subdirectory CLAUDE.md On-demand instruction file, spliced when a tool reads that subtree (§4.2) On-demand: paid only by sessions that touch the subtree The need is subtree-only — scoped to one directory
A Skill A codified prompting pattern, injected at invocation near the query (§7) Free until triggered, then on-demand at the recency-advantaged position The need is one-task-type — a recurring pattern for one kind of task
MEMORY.md Model-authored, per-user, per-machine soft context (§5.2) Small always-on charge, borne by one user; unverified The need is a personal soft preference — fine to be unverified, follows the person not the repo
A Tool / MCP server A capability the orchestration layer wires to the world (§9) Tool descriptions are an always-on charge in every session; widens blast radius The need is to touch the world — and the frequency justifies the standing cost
A Hook / CI check Deterministic enforcement + permission scoping (§11.2, §9.3) Free in context-budget terms — runs outside the window The need must be guaranteed, not merely made likely
Out-of-scope Leave it off the always-loaded set entirely Free The need is rarely needed and cheap to supply ad hoc when it arises
A subagent / workflow (stretch / emerging) Skills that invoke skills; phase-by-phase context loading (§7.3) On-demand, per phase The need is a multi-phase task whose phases each want different context — emerging, treat as stretch

A dating caveat. The mechanism names and paths above are mid-2026 Claude Code specifics; .claude/skills/, MEMORY.md, and the exact loader rules will date. The concepts — always-on vs. on-demand, influence vs. enforcement vs. capability, one shared budget — transfer to every orchestration layer.

A note on judgment vs determinate facts

This is the L7 analogue of the L6 deck’s “anti-pattern” note, and it matters just as much here. The two graded questions per card ask only what the lecture’s rules make determinate. The correct home of each need, and the kind of need it is, follow from the axes the lecture establishes — that is why they can be graded.

The genuinely contestable material — how often is “frequent enough” to amortise an MCP server’s standing charge, exactly which secondary mechanism is second-best, how to weigh a borderline cost trade-off — lives in the ungraded reflection. There you write your reasoning in prose and compare it to a model answer; nothing is scored. If you find yourself disagreeing with a graded key, you have probably found a card where the placement is genuinely close (Cards 3 and 5 have defensible runners-up) — note it, and bring it to the debrief. The reflection is where the real learning happens.

How the quiz is structured

Each of the 6 cards produces three questions:

  1. Placement (single-select, graded). Where does this need primarily belong? One correct home; the menu mixes in the tempting wrong home and a few plausible others.
  2. Need (multi-select, graded). What kind of need is it — influence, enforcement, capability, human? The same five options appear every time, and the fifth — “best solved by a sterner / better-worded CLAUDE.md” — is a decoy that is never correct. Card 6 is deliberately a split (two creditable boxes).
  3. Reflection (free-text, ungraded). Name the deciding axis, work the cost ledger, identify the tempting wrong placement and its concrete cost, and write the one-sentence final placement. After you click submit, a model answer reveals for each field; your text stays in your browser (localStorage) only.

That means 18 questions total: 12 graded (6 placement + 6 need) + 6 ungraded reflections. The score on the progress bar reflects the 12 graded questions only.

Where to go for the group-workshop format

This page is the interactive self-study version. To run the same six cards as a group workshop in class — with the warm-up example, student worksheet, full instructor keys (including a “draft the artifact” model answer for each card), group activity options, rubric, grading scale, and debrief questions — use the companion exercise page.

Final takeaway. Placement is context engineering. The window is finite, so a token an always-on block occupies is a token of window (and a slice of cost) the task does not get.

Question1 Card 1 — placement

Card 1: The always-on rule that is really a one-task rule

A 25-line quiz-formatting block — the <details markdown="1"> rule, the two-trailing-spaces rule, the quiz front-matter rules — currently lives in this repo’s root CLAUDE.md. It is therefore loaded into every session, including the hundreds of lecture-writing and slide-building sessions that never touch a quiz. You want the block to be reliably present whenever someone authors a quiz, without charging its tokens to every other conversation. (This repo has no .claude/skills/ directory yet — this would be a genuine first extraction.)

Where does this need primarily belong?

Question2 Card 1 — need

Card 1 — what kind of need is this?

Setting placement aside, classify the underlying need the quiz-formatting block serves. Select all that apply.

Select all that apply:

Question3 Card 1 — reflection

Card 1 reflection — quiz-formatting block

Write out your full placement reasoning in plain prose. There is no automatic grading — after you submit, the reference answer for each field reveals so you can compare.

Write your answer in each field. After you submit, the reference answer reveals. (No automatic grading; your text stays in your browser only.)

Question4 Card 2 — placement

Card 2: “Always run add-anchors before committing a lecture”

Lecture anchors must be regenerated by scripts/add_anchors.py whenever headings change, and the CI job check-anchors.yml already fails the PR if the committed anchors are stale. A teammate, tired of CI failures, proposes adding a strongly-worded paragraph to root CLAUDE.md: “ALWAYS run uv run add-anchors after editing a lecture. NEVER commit stale anchors.”

Where does this need primarily belong?

Question5 Card 2 — need

Card 2 — what kind of need is this?

Classify the underlying need. Select all that apply.

Select all that apply:

Question6 Card 2 — reflection

Card 2 reflection — anchor regeneration

Write out your full placement reasoning. After you submit, the reference answer for each field reveals.

Write your answer in each field. After you submit, the reference answer reveals. (No automatic grading; your text stays in your browser only.)

Question7 Card 3 — placement

Card 3: “Let the agent read and file tickets in our tracker”

Instructors want Claude Code to look up open issues and open new ones from inside a session, instead of copy-pasting between the chat and the tracker.

  • Realization A: connect a Jira/GitHub MCP server so the capability is available in every session.
  • Realization B: when a session needs ticket text, paste the issue that one time and leave the tracker unwired.

Twice-a-week need. Which placement wins?

Question8 Card 3 — need

Card 3 — what kind of need is this?

Classify the underlying need. Select all that apply.

Select all that apply:

Question9 Card 3 — reflection

Card 3 reflection — ticket tracker access

Write out your full placement reasoning. After you submit, the reference answer for each field reveals.

Write your answer in each field. After you submit, the reference answer reveals. (No automatic grading; your text stays in your browser only.)

Question10 Card 4 — placement

Card 4: “Remember that I prefer British spelling and terse commit messages”

This preference is genuinely personal (it is yours, not the team’s), genuinely recurring (it comes up most sessions), low-stakes, and verified by nothing — no test checks it, no convention enforces it.

  • A: write it to the model-authored MEMORY.md.
  • B: commit a “Preferences” block to the version-controlled root CLAUDE.md.

Where does this need primarily belong?

Question11 Card 4 — need

Card 4 — what kind of need is this?

Classify the underlying need. Select all that apply.

Select all that apply:

Question12 Card 4 — reflection

Card 4 reflection — personal preference

Write out your full placement reasoning. After you submit, the reference answer for each field reveals.

Write your answer in each field. After you submit, the reference answer reveals. (No automatic grading; your text stays in your browser only.)

Question13 Card 5 — placement

Card 5: A tests-only convention in a monorepo

A convention applies only inside tests/: fixtures go in conftest.py, and tests must be parametrized rather than looped. This is a large repo; most sessions never touch tests. A colleague put the rule in root CLAUDE.md “to be safe.”

Where does this need primarily belong?

Question14 Card 5 — need

Card 5 — what kind of need is this?

Classify the underlying need. Select all that apply.

Select all that apply:

Question15 Card 5 — reflection

Card 5 reflection — tests-only convention

Write out your full placement reasoning. After you submit, the reference answer for each field reveals.

Write your answer in each field. After you submit, the reference answer reveals. (No automatic grading; your text stays in your browser only.)

Question16 Card 6 — placement

Card 6: A hard “no-secrets-in-logs / no-prod-deploy” rule that keeps slipping

The assistant must never write code that logs secrets and must never run a production deploy. The team keeps adding sterner CLAUDE.md wording — “NEVER log credentials, this is CRITICAL” — and it still occasionally slips, especially after the model reads a web page or issue that contains an injected instruction.

Where does this need primarily belong?

Question17 Card 6 — need

Card 6 — what kind of need is this?

Classify the underlying need. This card is a split: more than one option is creditable. Select all that apply.

Select all that apply:

Question18 Card 6 — reflection

Card 6 reflection — no-secrets / no-prod-deploy

Write out your full placement reasoning. After you submit, the reference answer for each field reveals.

Write your answer in each field. After you submit, the reference answer reveals. (No automatic grading; your text stays in your browser only.)

© 2026 Dominik Müller   •  Powered by Soopr   •  Theme  Moonwalk