Skip to main content

Evaluation Diagnostics

Reference model for evaluation diagnostics emitted through observability surfaces and shadow-evaluation mismatch callbacks.

Diagnostic Core Fields

FieldMeaning
namespaceIdNamespace where evaluation occurred.
featureKeyEvaluated feature identifier.
configVersionActive configuration version metadata (if provided).
modeEvaluation mode (NORMAL, SHADOW, explain/diagnostic modes).
durationNanosEvaluation latency in nanoseconds.
valueTyped evaluated value returned by the engine.
decisionDecision category and associated match details.

Decision Categories

Decision categoryMeaning
Registry disabledNamespace kill-switch forced default return.
InactiveFeature-level inactive state forced default return.
RuleOne rule matched and produced value.
DefaultNo rule matched; declared default returned.

Shadow Mismatch Model

When using shadow evaluation, mismatch callbacks include:

  • featureKey
  • baseline diagnostics snapshot
  • candidate diagnostics snapshot
  • mismatch kinds (VALUE, DECISION)

Operational Use

  • Alert on mismatch rates during migrations.
  • Correlate decision classes with rollout incidents.
  • Track evaluation latency by namespace and feature.

Next Steps