unit-mesh/unit-eval

UnitEval is a benchmarking and evaluation tools for AutoDev Coder.

Kotlin

17 commits

updated Jan 2, 2024

eval.unitmesh.cc

See the code

README

Unit Eval

note: Split from https://github.com/unit-mesh/unit-gen

Todo

Testing sets
HumanEval in Java style
AutoDev evaluate datasets

LICENSE

This code is distributed under the MPL 2.0 license. See LICENSE in this directory.

Contributors

phodal

17 commits

Similar repos

yangzhang33/eval_benchmark

bigcode-project/bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

1,062

bryanjangeesingh/EfficientCoder

This is a repo for better code generation models.

frontier-harness-eval/eval

Public results and task definitions for FrontierHarness Eval

273

HuggingFaceH4/self-instruct-eval

Dataset

franciszzj/VtonEval

facebookresearch/testgeneval

TestGenEval A Real World Unit Test Generation and Test Completion Benchmark

Viren-Patil/our-evalplus

Languages

Kotlin

100.0%

unit-mesh/unit-eval

UnitEval is a benchmarking and evaluation tools for AutoDev Coder.

Kotlin

17 commits

updated Jan 2, 2024

eval.unitmesh.cc

See the code

README

Unit Eval

note: Split from https://github.com/unit-mesh/unit-gen

Todo

Testing sets
HumanEval in Java style
AutoDev evaluate datasets

LICENSE

This code is distributed under the MPL 2.0 license. See LICENSE in this directory.

Similar repos

yangzhang33/eval_benchmark

bigcode-project/bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

1,062

bryanjangeesingh/EfficientCoder

This is a repo for better code generation models.

frontier-harness-eval/eval

Public results and task definitions for FrontierHarness Eval

273

HuggingFaceH4/self-instruct-eval

Dataset

franciszzj/VtonEval

facebookresearch/testgeneval

TestGenEval A Real World Unit Test Generation and Test Completion Benchmark

Viren-Patil/our-evalplus

Contributors

phodal

17 commits

Languages

Kotlin

100.0%