AI Agent Skill: Ensure ML Experiment Reproducibility

AI Agent Skill: Ensure ML Experiment Reproducibility

This AI agent skill provides tools to audit and repair the reproducibility of machine learning experiments. It evaluates code changes, checks for reproducibility blockers, ensures experiment consistency, and aids in creating reproducible experiment packages.

What this skill does

• Performs read-only audits to detect reproducibility blockers in machine learning experiments.
• Reviews both before-and-after states of experiments to ensure outputs remain consistent.
• Facilitates creation of reproducible experiment packages by preserving the project structure and configuration.
• Allows authorized edits and validation when fixing reproducibility issues without needing additional approvals.
• Collects evidence related to entry points, configuration settings, data identity, and output claims for analysis.
• Does not perform data publishing, uploading, or paid computing without explicit authorization.

Who it is for

This skill is designed for developers and teams utilizing AI coding agents like Claude Code, Cursor, and Codex. It is particularly beneficial for those seeking to improve the reproducibility of their machine learning experiments and streamline their research processes.

Use cases

• Identifying reproducibility blockers in complex machine learning projects before publication.
• Assessing the impact of code changes on the reproducibility of experiments in version-controlled environments.
• Preparing consistent and reproducible experiment packages for collaboration or academic submission.

Technical details

• Requires Python 3.11+ and the full Repro Lens checkout/plugin or installed package.
• Runs checks using scripts/run.py to inspect project layouts and conditions via JSON format outputs.
• Operates without importing target projects, preserving their framework, experiment design, and authorized scope.
• Automatically resolves the script path relative to the skill directory for execution.
• Mentions any coverage gaps, such as those in notebooks, wrappers, or external states.

Source & Licence

This package is built on open-source work published by 00200200 (00200200/repro-lens) and distributed under MIT. The original licence text and copyright notice are included in your download.

Personal and commercial use, modification and redistribution are permitted, provided the original copyright and licence notice are retained.

Your purchase covers curation, licence verification, packaging, documentation and instant delivery. It does not grant exclusive rights to the underlying open-source code, which remains available under its original licence.

Delivery & Support

• Delivery: instant — a secure download link is emailed to you as soon as payment is confirmed.
• Format: ZIP archive containing the skill files, documentation and the original licence.
• Support: support@mcpcart.com — we aim to reply within 2 business days.
• Updates: updates are included only where stated on this page.

Refunds

This is a digital product delivered immediately after purchase. By completing your order you request immediate delivery and acknowledge that, once the download has been accessed, the statutory right to cancel no longer applies to the extent permitted by law. Refund requests are handled in accordance with our published Refund Policy.

Claude, Codex, Gemini and Cursor are trademarks of their respective owners. MCP Cart is an independent marketplace and is not affiliated with, endorsed by, or sponsored by any of them. Compatibility references describe interoperability only.