evaluating-code-models

github:zechenzhangAGI/AI-research-SKILLs · first committed 2025-12-14 · source · badge

Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality. Industry standard from BigCode Project used by HuggingFace leaderboards.

Skill Health: not yet scored

Listed, not yet scored. This skill has no public model test yet. It is in the scoring queue; submitted skills go first, then the most-installed.

Version history

1 commit to this file on GitHub (newest first).

2025-12-14 · commit d9a48bb · Add BigCode Evaluation Harness skill for code model benchmarking

Archived snapshots