ai-research-explore
π―SkillThis skill helps deep learning researchers test new ideas on top of an existing project, with fair comparisons against a fixed benchmark. It marks each result as a candidate to check and saves the reports in `explore_outputs/`.
Installation
npx skills add lllllllama/rigorpilot-skills --skill ai-research-exploreRun it in a terminal; it asks which AI coding tools to install it for (Claude Code, Codex, Cursor and more).
Uses skills.sh Β· Node.js 22.20+
After installing
Ask for related work and the agent uses it on its own, or call it yourself.
/ai-research-exploreInstall by hand
Copy the whole skill folder from GitHub to the place below. Copying only SKILL.md can leave out files the skill uses.
Open the skill folder β- This project
.claude/skills/ai-research-explore/ - All projects
~/.claude/skills/ai-research-explore/
These paths are for Claude Code. For other tools, the command above puts it in the right place.
What this skill does
Overview
ai-research-explore is the Rigor Explore skill for researchers who have already chosen the task, dataset, benchmark, evaluation method and SOTA reference (the best known result to compare against). It works on top of current_research, a fixed starting point such as a branch, commit or checkpoint, and runs only candidate work (trial changes kept apart from trusted results) that you have explicitly allowed. It treats any novelty as a hypothesis until literature, ablations (tests that remove one part to see its effect) and fair comparisons support it.
Key Features
- Freeze the task, dataset, benchmark, evaluation source, SOTA reference and compute budget before any candidate work starts.
- Keep your own ideas, add a few small one-change ideas, and rank them with clear pass or fail checks and scores.
- Try one bounded change or short run at a time, using
explore-codefor code changes andexplore-runfor short trials or sweeps (runs over several settings). - Look up sources with a quick, limited search that prefers your local library, such as Zotero, before the web.
- Get
SCIENTIFIC_CHANGELOG.mdandCOMPARABILITY_REPORT.md, which explain what each candidate changes and where the comparison stops being fair.
Who is this for?
It suits a researcher who has a trained baseline and wants an agent to test a few improvement ideas without breaking comparability. For README-first reproduction, open-ended direction finding or passive repo analysis, use a different skill.
Summarized by AI from this skill's SKILL.md. Suggest a better one
SKILL.md
View on GitHub βRigor Explore compatible skill slug for meaningful and potentially novel deep learning research candidates. Use when the researcher has chosen the task family, dataset, benchmark, evaluation method, provided SOTA references, and wants candidate-only exploration on top of `current_research` with auditable repo understanding, idea gating, fair comparison, and governed experiments written to `explore_outputs/`. Do not use for README-first trusted reproduction, open-ended direction finding, narrow code-only or run-only exploration, passive repo analysis, verified novelty claims, or implicit experimentation.
ai-research-explore
Purpose
Use this as the Rigor Explore compatible skill slug after the researcher
explicitly authorizes candidate-only work on top of a durable
current_research anchor. The installed slug remains ai-research-explore for
compatibility. Rigor Explore is for meaningful and potentially novel deep
learning research candidates while preserving scientific rigor, comparability,
reproducibility, and auditable collaboration. Novelty and significance remain
hypotheses before literature contrast, ablation evidence, and fair comparison.
The skill does not promise autonomous discovery, global benchmark completeness,
novelty proof, or trusted reproduction success.
Start from the shared operating principles in
../ai-research-reproduction/references/agent-operating-principles.md, then load
../ai-research-reproduction/references/research-rigor-principles.md for research claims and
../ai-research-reproduction/references/deep-learning-experiment-principles.md when experiment
details affect comparability or reproducibility.
Fit
Use this skill only when the request has both:
- Explicit exploration authorization such as candidate-only work, isolated branch or worktree, sweep, several variants, or exploratory ranking.
- A durable
current_researchcontext such as a branch, commit, checkpoint, run record, or already-trained local model state.
Keep narrow code-only requests on explore-code. Keep narrow run-only requests
on explore-run. Keep passive repository analysis on analyze-project. Keep
README-first reproduction on ai-research-reproduction.
Research Rhythm
Use a two-loop rhythm:
- Outer loop: understand the repository, freeze task/dataset/evaluation/budget, preserve user ideas, map sources, gate ideas, and decide whether the next experiment is worth running.
- Inner loop: make one bounded candidate change or run, smoke-check it, collect evidence, rank it against the current anchor, and either stop or return to the outer loop with the new evidence.
This rhythm is a guide, not a rigid autonomous loop. Stop at explicit blockers, unclear scientific meaning, exhausted budget, missing anchor/evaluation, or a human checkpoint.
Workflow
- Confirm
current_researchand explicit explore-lane authorization. - Accept either legacy
variant_specor higher-levelresearch_campaign. - In campaign mode, freeze the task, dataset, benchmark, evaluation source, SOTA reference, and budget before candidate work.
- Build only the repo-understanding artifacts needed for the current campaign,
usually through
analyze-project. - Run bounded, cache-first source lookup when source support matters; prefer local curated literature such as Zotero if available, then seed sources, repo-local locators, public locators, or optional web lookup. Treat lookup as source resolution, not an open-ended literature search.
- Preserve researcher-provided ideas, optionally add a small bounded set of single-variable seed ideas, and rank ideas with explicit gates and score breakdowns.
- Prefer one clear candidate at a time. Use
explore-codefor bounded code adaptation andexplore-runfor short-cycle trials or sweeps. - Use
minimal-run-and-auditorrun-trainonly when the exploratory plan requires real execution evidence. - Write candidate-only outputs to
analysis_outputs/,sources/, andexplore_outputs/as appropriate; never present exploratory gains as trusted reproduction success. IncludeSCIENTIFIC_CHANGELOG.mdandCOMPARABILITY_REPORT.mdfor candidate scientific meaning and comparison boundaries.
Ranking and Evidence
- Before execution, prioritize candidates by expected gain, cost, success likelihood, patch surface, dependency drag, evaluation risk, and rollback ease.
- After execution, rank by real evidence first: command status, observed metrics, artifacts, changed paths, smoke results, and reproducibility notes.
- Keep researcher-provided
evaluation_sourceandsota_referencefrozen for the campaign; do not claim they are globally complete. - If the top ideas are too close or the implementation cannot be decomposed into auditable units, stop for a checkpoint instead of silently choosing.
Campaign Inputs
research_campaign is preferred for Rigor Explore campaigns, but it should
stay minimal. The durable core is:
current_researchtask_familydatasetbenchmarkevaluation_sourcesota_referencecompute_budget
Use candidate_ideas, variant_spec, research_lookup, idea_policy,
idea_generation, source_constraints, feasibility_policy, baseline_gate,
and execution_policy as optional guidance, not as fields the agent must fill
for every campaign. See references/research-campaign-spec.md for the advanced
schema and artifact expectations.
Reference Loading
- Load
references/ai-research-explore-policy.mdfor lane safety and candidate semantics. - Load
references/research-campaign-spec.mdonly when a campaign file is present or the user asks for Rigor Explore campaign governance. - Load
../ai-research-reproduction/references/explore-variant-spec.mdfor run-level variant matrix details. - Load
../ai-research-reproduction/references/research-thinking-loop.mdbefore proposing or ranking candidate changes; it is the required greedy observe-ground-design-compare cycle. - Load
../ai-research-reproduction/references/research-rigor-principles.mdbefore making novelty, contribution, SOTA, or comparability statements. - Consult
~/.rigorpilot/PERSONAL_RIGOR.mdif present, under../ai-research-reproduction/references/continuous-learning-policy.md(advisory only; core wins). - Load
../ai-research-reproduction/references/deep-learning-experiment-principles.mdwhen training, evaluation, baseline, ablation, metric, checkpoint, or dataset details matter. - Use
scripts/orchestrate_explore.pyandscripts/write_outputs.pyfor the existing deterministic artifact workflow.
More from this repository10
A helper skill for rerunning a deep learning project from its README. When the README misses a key detail, it finds the answer in the original paper and notes where the two disagree.
A skill that reads a deep learning project's README and main files before you run anything and lists the commands they describe. It then suggests the smallest run you can trust to check the results.
A skill that plans the software setup and file locations you need before re-running a deep learning research project. It suggests install commands and where to put model and data files.
A skill that runs one short check command when you re-run a deep learning research project and saves the results as standard report files. It also records any edits made to the project's files.
A skill that reads a deep learning research project and explains how it is built, without changing any code. It also points out code that looks suspicious so you can check it.
A skill that helps your agent rerun a deep learning research project and check whether it works as its README describes. It starts with the smallest test and records every step and change.
A skill that finds the cause of errors in deep learning research code, such as running out of GPU memory, before changing anything. It suggests the smallest fix and waits for your approval.
A skill that helps you try small, low-risk code changes in a deep learning research project on a separate branch. It records why each change matters and how to undo it.
A skill that carefully runs a training command you already chose for a deep learning project. It saves the command, settings, logs, and results in one standard folder.
A skill that plans quick, small trial runs for deep learning research, such as testing on part of the data or trying many settings. It reports the results without claiming more than they show.