Copilot OpenTelemetry Metrics

Goal

Take the user from "I want Copilot telemetry" to telemetry they can query. Do the work for them where doing it is safe and reversible, and walk them through it where it is not.

Done means export is enabled in the settings file that actually resolves, a backend is receiving data, a dashboard exists for that backend, and the user has confirmed data landed by querying the store rather than by trusting an HTTP 200.

Modes

Modes are independent. A user may run one, several, or all. Local capture and organization capture are separate journeys, not stages of the same one.

references/verification.md is shared by every mode. Read it before telling anyone their telemetry works.

When the request names a goal rather than a mode, pick the mode that reaches the goal and say which one was picked. "Set up Copilot metrics" with no other context means local-setup followed by local-stack. Confirm before assuming the organization path, because it spends money and places a shared write credential on every workstation.

Flow

1. Pick the mode and state the pick. Ask only when local and organization scope are genuinely ambiguous.
2. Read that mode's reference before acting. The table above is routing only; the procedure, the failure modes, and the artifact contents live in the reference.
3. Offer rather than assume. Say what would change, where, and what cannot be undone. Every automated step has a manual equivalent, and a user who declines gets the exact block to paste or the exact command to run.
4. Write files; do not run them. The agent writes settings after an approved diff, writes generated artifacts to disk, and may run read-only queries against a local telemetry store. Every command that touches Docker, a cloud control plane, or an infrastructure-as-code toolchain belongs to the user: print it and stop.
5. Verify by querying the store, following the shared verification reference. Report what proved the data landed.
6. Offer the dashboard. Local capture gets a generated PromQL dashboard; the Azure path gets a generated KQL dashboard. They target different backends and are not interchangeable.

Content capture is not governed by the content-capture setting

Raise this before anyone enables export, in every mode.

github.copilot.chat.otel.captureContent defaults to false and is documented as controlling whether input and output messages, system instructions, and tool definitions reach span attributes. A false value does not mean the store holds no prompt text. With that setting disabled, this stack observed six attributes populated in plaintext on spans:

…