Ship Better Code, Faster

Appearance

Workshop 6: Experimentation & Impact Handout ​

This is the format we work through together in the session. As we draft each part live, record this in your logbook as we go. Your logbook becomes the data backbone of your Session 8 proposal.

Part 1: Before/after table ​

We pull numbers from every prior session's deliverable together. Be honest. "Apples to apples" matters: note when you're comparing cold runs to warm, or local to CI.

For each metric below, record the before (Session 1 baseline), the after (current), the absolute change, the % change, and any notes in your logbook as we go:

  • Total pipeline duration (s)
  • npm install duration (s)
  • npm test duration (s)
  • Flaky test pass rate (%)
  • Onboarding time (min)

Part 2: Three hypotheses ​

For each major improvement, we write the three-sentence hypothesis together, using the format from the slides:

  • If we [the change]
  • we expect [the metric] to [improve by amount] within [time window]
  • because [the underlying reason we believe this will work]

Draft all three live and record this in your logbook as we go.

Part 3: DORA mapping ​

For each hypothesis, we identify together which DORA metric it most directly affects (Deployment frequency / Lead time / Change failure rate / MTTR) and the reasoning. Record this in your logbook as we go.

Part 4: Rollout plan ​

For each hypothesis, we write a phased rollout together, one paragraph each, covering:

  • Who runs the experiment first
  • What they'll measure
  • For how long
  • Ship threshold
  • Roll back if

Record this in your logbook as we go.

Part 5: Translation for leadership ​

For each hypothesis, we write a one-line version a non-engineering leader would care about: the engineering version and the leadership version side by side. Record this in your logbook as we go.

Keep your logbook ​

Everything we drafted today lives in your logbook. It's the spine of your final proposal. In Workshop 8 your proposal comes straight out of it.

Optional polish ​

If you want to go further after the session, you can refine the leadership translations or add a fourth hypothesis. This is optional, never required: the core work is what we drafted live together.