New advertisers: 50% off your first month with code FIRSTMONTHSee slots
k-dense-ai avatar

Investigating Anomalous Results

Structured protocol for investigating surprising, impossible, or failing results before any data, code, or parameter gets adjusted.

GitHub stars
202
last updated
Jun 1, 2026
View on GitHub

What it does

  • Covers four phases: characterize the anomaly, compare against a working reference, test one hypothesis, and resolve by cause (code bug, data issue, or real finding)
  • Enforces a rule that no data drops, parameter changes, or re-runs happen until the root cause is identified and documented
  • Includes red flags, common rationalizations, and stakeholder warning signs that signal a result is being tweaked rather than explained
  • Designed for analysts and researchers who face convenient or suspicious results and need a defensible path to resolution

Install

$ npx -y skills add k-dense-ai/science-superpowers --skill investigating-anomalous-results -y

Installs into .agents/skills for every agent it finds here, and .claude/skills for Claude Code.

Files

Investigating Anomalous Results

Overview

Random tweaks waste time and manufacture false findings. Quietly dropping the inconvenient data point, nudging the cutoff, or re-running until it "works" doesn't fix the problem — it fabricates a result.

Core principle: ALWAYS find the root cause before adjusting anything. An adjustment made before you understand the cause is, at best, noise and, at worst, fraud.

Violating the letter of this process is violating the spirit of it.

The first question for any anomaly: is this a code bug, a data issue, or a real finding? You cannot answer by guessing, and you must not "fix" it until you know — because a real finding is not something to fix.

The Iron Law

NO ADJUSTMENTS WITHOUT ROOT-CAUSE INVESTIGATION FIRST

No dropping data, changing a test, transforming a variable, re-running with new parameters, or "cleaning" until Phase 1 is complete. If you haven't found the cause, you cannot justify the adjustment.

When to Use

Details

Repository
github.com/k-dense-ai/science-superpowers
First seen
Jun 11, 2026

More from k-dense-ai/science-superpowers

All 15

Similar to Investigating Anomalous Results