Week 11 · Field delivery

Golden set before shipping

0:00 / 3:00

15 seconds

Shipped on vibes.

A prompt tweak fixed one demo and broke twelve ward questions.

ChangePrompt/modelGolden set~50 QsPromoteOnly if green
Lesson notesGolden set before shipping: the short version+

Week 11 · Observability & break-glass · about 3 minutes

What you will be able to do

Run ~50 real Helix questions on every change before promote.

The idea

Maintain a golden set of real questions with expected behaviors. Every change runs it.

No green golden set, no ship.

assert run_golden(suite).pass_rate >= floor

Fifty boring questions beat one glamorous demo.

Key takeaways

  • Real questions, versioned.
  • Run on every change.
  • Floor blocks ship.

Part of the Forward Deployed Engineer roadmap. New to the role? Start with what a Forward Deployed Engineer does.