DEV Community

#evaluation

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
A pre-flight checklist before domain continued pre-training

A pre-flight checklist before domain continued pre-training

Comments
5 min read
Part 5: The scorecard: 11 criteria, and why every score needs evidence

Part 5: The scorecard: 11 criteria, and why every score needs evidence

1
Comments
4 min read
Which Sport Is It? Recognising a Sport Only From How the Players Move

Which Sport Is It? Recognising a Sport Only From How the Players Move

Comments
9 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark

Comments
4 min read
Designing a Reliable 4-Layer LLM API for Moderation Review Chatbots

Designing a Reliable 4-Layer LLM API for Moderation Review Chatbots

Comments
5 min read
OpenAI Claude Gemini API Text Summarization for Hiring Rubrics — 3 Portability Checks

OpenAI Claude Gemini API Text Summarization for Hiring Rubrics — 3 Portability Checks

Comments
8 min read
Extra Retrieval Rounds Can Make RAG Worse at Saying "I Don't Know"

Extra Retrieval Rounds Can Make RAG Worse at Saying "I Don't Know"

Comments 1
5 min read
E-commerce Product Retrieval: Duplicate Tests and Source Tracing (and Why I Chose One)

E-commerce Product Retrieval: Duplicate Tests and Source Tracing (and Why I Chose One)

Comments
4 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Satellite Geo QCM Benchmark

Comments
4 min read
Flip One Field: A Fairness Test That Beats Aggregate Parity

Flip One Field: A Fairness Test That Beats Aggregate Parity

Comments
2 min read
It Was Never the Restriction

It Was Never the Restriction

Comments
11 min read
Re-reading Nov 2024 GenAI predictions as a builder playbook

Re-reading Nov 2024 GenAI predictions as a builder playbook

Comments
4 min read
AI Agent Evaluation End to End: How LFORLA Scores a LEGO Build From Brief to Render

AI Agent Evaluation End to End: How LFORLA Scores a LEGO Build From Brief to Render

Comments
5 min read
Edit the Weights, Retrieve the Fact, or Look It Up in a Graph?

Edit the Weights, Retrieve the Fact, or Look It Up in a Graph?

Comments 1
2 min read
How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the LFORLA Mechanism

How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the LFORLA Mechanism

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.