Create AI Benchmarks from Git History with NASDE

Create AI Benchmarks from Git History with NASDE

This AI agent skill enables developers to generate benchmark tasks from the git history of a current or specified repository. By analyzing commit history, pull requests, and issues that have been resolved, this tool assists in creating evaluation tasks based on real problems that teams have already solved. It supports the capture of meaningful changes as NASDE benchmarks.

What this skill does

• Mines the git history of a specified repository to identify self-contained changes.
• Analyzes commits, diffs, and pull request descriptions to select suitable evaluation candidates.
• Generates task files for the NASDE benchmarking framework with user approval.
• Facilitates the creation of regression test suites from actual work performed by the team.

Who it is for

This skill is designed for developers and teams utilizing AI coding agents such as Claude Code, Cursor, and Codex. It is particularly beneficial for those looking to enhance their testing processes by leveraging prior work and simplifying the creation of benchmarks for AI evaluation.

Use cases

• Developer teams wanting to establish benchmarks from closed pull requests to improve new feature evaluations.
• Organizations aiming to turn historical commits into regression test suites for continuous integration workflows.
• Teams seeking to mine their resolved issues and past commits to form a database of evaluation tasks for AI agents.

Technical details

• Uses capabilities such as agent-benchmark, aiapplication, and nasde-benchmark-from-history.
• Requires a git repository with meaningful commit history, either locally specified or from the current working directory.
• Depends on having an existing NASDE benchmark project; initialization must be performed beforehand.
• On Windows hosts, ensure script files like tests/test.sh, solution/solve.sh, and environment/Dockerfile are written with LF line endings to avoid execution errors.

Source & Licence

This package is built on open-source work published by NoesisVision (NoesisVision/nasde-toolkit) and distributed under MIT. The original licence text and copyright notice are included in your download.

Personal and commercial use, modification and redistribution are permitted, provided the original copyright and licence notice are retained.

Your purchase covers curation, licence verification, packaging, documentation and instant delivery. It does not grant exclusive rights to the underlying open-source code, which remains available under its original licence.

Delivery & Support

• Delivery: instant — a secure download link is emailed to you as soon as payment is confirmed.
• Format: ZIP archive containing the skill files, documentation and the original licence.
• Support: support@mcpcart.com — we aim to reply within 2 business days.
• Updates: updates are included only where stated on this page.

Refunds

This is a digital product delivered immediately after purchase. By completing your order you request immediate delivery and acknowledge that, once the download has been accessed, the statutory right to cancel no longer applies to the extent permitted by law. Refund requests are handled in accordance with our published Refund Policy.

Claude, Codex, Gemini and Cursor are trademarks of their respective owners. MCP Cart is an independent marketplace and is not affiliated with, endorsed by, or sponsored by any of them. Compatibility references describe interoperability only.