Benchmarks - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

munimv2

Oct 24

Can you re-derive a benchmark's gold labels from its raw annotator votes? Two reproducible censuses on SNLI and MultiNLI

#machinelearning #datascience #nlp #benchmarks

4 min read

munimv2

Oct 23

When the annotation gives away the answer: three reproducible leakage censuses on OpenBookQA, SciQ and QASC

#machinelearning #datascience #nlp #benchmarks

4 min read

QuantID

Oct 23

Hugging Face Official Benchmarks: Daily Update 2026-10-24

#ai #benchmarks #huggingface #llm

4 min read

munimv2

Oct 22

Do SNLI and MultiNLI share any examples? Ten reproducible censuses of gold-label integrity in NLI and QA benchmarks

#machinelearning #datascience #nlp #benchmarks

3 min read

김민식/학생

Oct 22

Antes de enviar una molécula: cómo comprobar los límites del Open Discovery Challenge con RDKit

#ai #python #science #benchmarks

10 min read

Artyom Kornilov

Oct 22

Tov Language Benchmarks Questioned: Suspected Manipulation Raises Credibility Concerns

#programming #benchmarks #credibility #manipulation

12 min read

munimv2

Oct 22

25 reproducible audits of the metrics and gold labels behind LLM benchmark scores

#machinelearning #datascience #nlp #benchmarks

4 min read

QuantID

Oct 22

Hugging Face Official Benchmarks: Daily Update 2026-10-23

#ai #benchmarks #huggingface #llm

4 min read

naman

Oct 21

Infinite v0.6 benchmarks: where it is fast and where it is not

#benchmarks #performance #opensource #audio

3 min read

QuantID

Oct 19

Hugging Face Official Benchmarks: Daily Update 2026-10-20

#ai #benchmarks #huggingface #llm

4 min read

Oct 19

Five Open Science Challenges Where a Verifier, Not the Submitter, Decides the Score

#ai #science #benchmarks #agents

2 min read

Daniel Sam Pete Thiyagu

Oct 18

The 60% Ceiling: Why Your AI Agent Is a Bad Judge of Its Own Next Move

#ai #agents #machinelearning #benchmarks

4 min read

Oct 18

Zapier vs ModuleX: Which AI Tool Is Better?

#ai #productivity #benchmarks #tech

8 min read

QuantID

Oct 18

Hugging Face Official Benchmarks: Daily Update 2026-10-18

#ai #benchmarks #huggingface #llm

4 min read

Oct 16

I built an oracle to prove my benchmark needed full document coverage. I only tested it from one end.

#benchmarks #evaluation #llm #testing

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.