DEV Community

← All Trends

Verifying AI-Generated Tests in Python

27 posts in this trend in the last 7 days • Active 24 minutes ago
Classify the Failure Before the Agent Edits a Test
datacpp_8185 profile

Classify the Failure Before the Agent Edits a Test

#testing #python #agents #ci
Comments
7 min read
If Your Agent Wrote the Test, Ignore the Green Build
airs_6907 profile

If Your Agent Wrote the Test, Ignore the Green Build

#ai #testing #agents #python
1
Comments 3
7 min read
The Pytest Block Was Prose: A Myth-Busting FAQ
devio_3007 profile

The Pytest Block Was Prose: A Myth-Busting FAQ

#ai #agents #testing #python
1
Comments
7 min read
A Shrinking Input Domain Is a Failed Agent Patch
datacpp_8185 profile

A Shrinking Input Domain Is a Failed Agent Patch

#testing #python #agents #ci
Comments
8 min read
Shadow-Compare the Agent Patch. Merge Only Classified Divergences.
datacpp_8185 profile

Shadow-Compare the Agent Patch. Merge Only Classified Divergences.

#testing #python #agents #ai
Comments
8 min read
Fail Closed on Side Effects: A Blast-Radius Gate for Agent Patches
datacpp_8185 profile

Fail Closed on Side Effects: A Blast-Radius Gate for Agent Patches

#testing #python #ai #devops
1
Comments
7 min read
Catch Tool Calls That Invent Missing Arguments
byteio_3726 profile

Catch Tool Calls That Invent Missing Arguments

#python #testing #ai #llm
Comments 1
7 min read
The Dependency the Agent Invented: A Myth-Busting FAQ
devio_3007 profile

The Dependency the Agent Invented: A Myth-Busting FAQ

#ai #agents #testing #python
Comments
7 min read
Pin Behaviors Across Model Swaps
byteio_3726 profile

Pin Behaviors Across Model Swaps

#ai #python #testing #agents
Comments
8 min read
Assumption Density Belongs Beside Pass Rate
apppro_5726 profile

Assumption Density Belongs Beside Pass Rate

#ai #testing #python #agents
Comments
6 min read
Freeze the Retry Budget Before the Percentage
apppro_5726 profile

Freeze the Retry Budget Before the Percentage

#testing #ai #python #agents
Comments
7 min read
Test Agent Patches With an Oracle the Diff Cannot Touch
datacpp_8185 profile

Test Agent Patches With an Oracle the Diff Cannot Touch

#testing #python #ai #devops
Comments
7 min read
Schema Drift Is the Real Agent Bug: A Free-Model Contract Test
codepro_9661 profile

Schema Drift Is the Real Agent Bug: A Free-Model Contract Test

#ai #testing #python #agents
1
Comments 1
4 min read
Give the Model One JSON Job. Run Everything Else Yourself.
aiio_8140 profile

Give the Model One JSON Job. Run Everything Else Yourself.

#ai #testing #python #agents
Comments
7 min read
Green But Wrong: Mutation-Testing Agent-Generated Test Suites
devio_3007 profile

Green But Wrong: Mutation-Testing Agent-Generated Test Suites

#testing #ai #python #agents
Comments
4 min read
Don't Golden-File an Agent Patch. Golden-File the Relation.
datacpp_8185 profile

Don't Golden-File an Agent Patch. Golden-File the Relation.

#testing #python #ai #devops
Comments
7 min read
Count Retries Before You Trust a Coding Score
apppro_5726 profile

Count Retries Before You Trust a Coding Score

#ai #testing #python #devops
Comments
6 min read
Coding Agents Fail Differently by Stratum
apppro_5726 profile

Coding Agents Fail Differently by Stratum

#ai #python #testing #opensource
Comments
7 min read