FILE 07 / INCIDENT LAB
OPERATIONS / CASEBOOKPick one. Propose a fix.
The Lab is how we evaluate. You read the telemetry, critique Lena's reasoning, sketch the next move. Humans grade — for system framing, tradeoff awareness, and AI judgment.
FILE 07.01 / PROCEDURE
Three steps. About 25 minutes per scenario.
Pick a scenario
Each scenario aligns with one or more roles. The boardroom incident maps across every role; the others are specialty branches.
Read the telemetry, write your response
Three to four structured prompts per scenario. Inputs and short essays. Short and specific beats long and vague.
Continue to the application
Your scenario response is saved with the application and reviewed alongside your resume. No second take-home, no AI judging.
Every response is read by a human on the NetSpeek hiring team.
We do not use AI to score, rank, or filter applications. That is a policy choice tied to NYC LL 144 and the EU AI Act. We are happy to walk you through how we got there.
EVALUATION PRINCIPLESFILE 07.02 / SCENARIOS
Incidents from inside the platform.
All scenarios are sanitized. No customer references, no internal architecture leakage, no vendor names. The shape of the problem is faithful. The specifics are abstracted.
The Boardroom Incident
A multi-vendor outage during a high-stakes meeting. Read the telemetry, decide what Lena should do next.
Lena Was Wrong
A confident AI diagnosis that turned out to be wrong. Find the flaw in the reasoning, then propose how we'd catch it next time.
Improve the RAG
A retrieval prompt with imperfect groundedness. Improve it, then propose the metric that would catch a regression in your rewrite.
Stop the Regression
A bug that keeps coming back across releases. Design a CI gate and the telemetry that would have caught it earlier.
Operator UX
A workflow operators hate. Sketch a better one — and tell us where the backend API and the React surface change.
FILE 07.03 / FIELD NOTE PATH
Prefer one essay question instead?
Every role offers a Field Note path. One essay question instead of the structured scenario. Same hiring team, same review.