Last updated

Research / Methodology

Publish the method before the number.

These protocols define the questions, measures and negative-result conditions before benchmark outcomes exist. [to be benchmarked]

Why pre-register

A metric chosen after the result is an explanation, not a test.

Each protocol must identify its dataset, baseline, task, measures and negative outcome before collection begins. Changes remain versioned rather than silently replacing the method that produced an inconvenient result.

Draft published

Protocol register

Five questions that require measurement.

P01Draft published

Investigation effort

Research question

Does structured behavior reduce the work required to reach a supportable conclusion?

Measures

Elapsed time, pivots, queries, screens visited and raw events inspected.

Negative result

No reduction, or a reduction accompanied by lower conclusion accuracy.

P02Draft published

Behavioral compression

Research question

How much telemetry can be represented as actions, behaviors and incident chains without losing decision-relevant evidence?

Measures

Events per action, actions per behavior, behaviors per chain and retained provenance links.

Negative result

Compression removes evidence needed to reconstruct an originating action or effect.

P03Draft published

Root-cause reconstruction

Research question

Can an investigator identify the originating process, initial action, affected objects and persistence?

Measures

Correct identification, completeness, unsupported assertions and time to answer.

Negative result

Structured behavior performs no better than the baseline workflow or introduces confident attribution errors.

P04Draft published

Resilience under telemetry loss

Research question

Does explicit observability help a reasoner stay inside the evidence boundary as coverage degrades?

Measures

Correct abstention, gap identification, unsupported claims and conclusion stability.

Negative result

Gap labels do not reduce unsupported conclusions or materially impair useful conclusions.

P05Draft published

Reasoning context quality

Research question

How does raw telemetry, an alert summary and structured behavior change human or software reasoning?

Measures

Root-cause accuracy, recommended-action accuracy, context consumed and claims about unobserved activity.

Negative result

Structured behavior is less accurate, consumes more context, or hides evidence available in another condition.

Publication commitment

Results should be published with the protocol version they ran against—including results that fail to support the design hypothesis.

No protocol on this page currently carries a completed result, participant count, dataset assignment or benchmark date. Those fields will be added only when the work exists.

Next step

Separate available artifacts from planned ones.

The artifact register links what can be inspected now and labels everything else as planned.

Browse artifacts