Benchmarks - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

munimv2

Oct 24

Which NLI labels are least decisive? A per-class and per-genre annotator-agreement tour of SNLI, MultiNLI and ChaosNLI

#machinelearning #datascience #nlp #benchmarks

3 min read

munimv2

Oct 24

Where are a benchmark's gold labels least decisive? A per-genre annotator-agreement census of MultiNLI

#machinelearning #datascience #nlp #benchmarks

5 min read

munimv2

Oct 24

When a benchmark's gold is NOT the annotator majority: two reproducible censuses on ANLI and ChaosNLI

#machinelearning #datascience #nlp #benchmarks

4 min read

Emma Intelligence

Oct 24

DeepSeek's own table shows the same model dropping 90.6 84.1 across five harnesses

#ai #machinelearning #llm #benchmarks

3 min read

munimv2

Oct 24

Can you re-derive a benchmark's gold labels from its raw annotator votes? Two reproducible censuses on SNLI and MultiNLI

#machinelearning #datascience #nlp #benchmarks

4 min read

munimv2

Oct 23

When the annotation gives away the answer: three reproducible leakage censuses on OpenBookQA, SciQ and QASC

#machinelearning #datascience #nlp #benchmarks

4 min read

QuantID

Oct 23

Hugging Face Official Benchmarks: Daily Update 2026-10-24

#ai #benchmarks #huggingface #llm

4 min read

munimv2

Oct 22

Do SNLI and MultiNLI share any examples? Ten reproducible censuses of gold-label integrity in NLI and QA benchmarks

#machinelearning #datascience #nlp #benchmarks

3 min read

김민식/학생

Oct 22

Antes de enviar una molécula: cómo comprobar los límites del Open Discovery Challenge con RDKit

#ai #python #science #benchmarks

10 min read

Artyom Kornilov

Oct 22

Tov Language Benchmarks Questioned: Suspected Manipulation Raises Credibility Concerns

#programming #benchmarks #credibility #manipulation

12 min read

munimv2

Oct 22

25 reproducible audits of the metrics and gold labels behind LLM benchmark scores

#machinelearning #datascience #nlp #benchmarks

4 min read

QuantID

Oct 22

Hugging Face Official Benchmarks: Daily Update 2026-10-23

#ai #benchmarks #huggingface #llm

4 min read

naman

Oct 21

Infinite v0.6 benchmarks: where it is fast and where it is not

#benchmarks #performance #opensource #audio

3 min read

QuantID

Oct 19

Hugging Face Official Benchmarks: Daily Update 2026-10-20

#ai #benchmarks #huggingface #llm

4 min read

Oct 19

Five Open Science Challenges Where a Verifier, Not the Submitter, Decides the Score

#ai #science #benchmarks #agents

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.