Workshop 6: Experimentation Design & Measuring Engineering Impact

Duration: 60 minutes You will leave with: an experiment plan with hypotheses, baseline/improved comparisons, success criteria, and a phased rollout strategy, all drafted live in session.

📊 Slides: (link coming)

📓 Logbook: record today's results in your course logbook as we go.

What we do

Together, in this session, we turn everything you've built in Sessions 1–5 into the kind of proposal an engineering leader would actually fund. I demonstrate the format, then we draft your version live.

1. We lay out your before/after numbers across CI improvements, DevEx fixes, and AI-assisted refactors.
2. We write three hypotheses together in the "if / then / because" format.
3. We map your work to the DORA metrics.
4. We design a phased rollout for introducing your changes to a broader team.

In this workshop

• Handout: the format we work through together for the before/after numbers, hypotheses, and rollout

Keep your logbook

• Everything we draft today lives in your course logbook: your three hypotheses with measured outcomes and your phased rollout plan.
• In Workshop 8 your proposal comes straight out of it.