33.9850° N, 118.4695° W THE OBSERVATORY
THE COALITION — A FUTURE FORGED IN UNITY. A TRUTH BEYOND VEIL.
INITIATION IS DISCERNMENT KNOWLEDGE IS SOVEREIGNTY △
Login Register
Research Wire arXiv medium Watch Signal Needs Review

EpiBench: Verifiable Evaluation of AI Agents on Epigenomics Analysis

We introduce EpiBench, a verifiable benchmark for short-horizon epigenomics analysis. EpiBench evaluates whether agents can make well-defined analysis decisions from realistic workflow states and return deterministically gradable answers. The benchmark includes 106 evaluations across CUT\&Tag/CUT\&RUN, ATAC-seq, ChIP-seq, and DNA methylation workflows. Across 5,088 valid trajectories from 16 model-harness pairs, no system passed a majority of attempts: GPT-5.5 / Pi led at 45.0\% (143/318 attempts; 95\% confidence interval (CI), 36.3--53.7), followed by GPT-5.5 / OpenAI Codex at 39.9\% (127/318 attempts; 95\% CI, 31.6--48.3). Claude Opus 4.8 Max / Pi and GPT-5.4 / Pi each passed 39.0\% (124/318 attempts; 95\% CI, 30.2--47.8 and 31.0--47.0, respectively). Performance varies across assay type

Source: arXiv ↗

arXiv@arXiv Jun 11, 2026Published 17:20 UTCSignal Time 61Trust Score
arXiv arXiv arxiv.org

We introduce EpiBench, a verifiable benchmark for short-horizon epigenomics analysis. EpiBench evaluates whether agents can make well-defined analysis decisions from realistic workflow states and return deterministically gradable answers. The benchmark includes 106 evaluations across CUT\&Tag/CUT\&RUN, ATAC-seq, ChIP-seq, and DNA methylation workflows. Across 5,088 valid trajectories from 16 model-harness pairs, no system passed a majority of attempts: GPT-5.5 / Pi led at 45.0\% (143/318 attempts; 95\% confidence interval (CI), 36.3--53.7), followed by GPT-5.5 / OpenAI Codex at 39.9\% (127/318 attempts; 95\% CI, 31.6--48.3). Claude Opus 4.8 Max / Pi and GPT-5.4 / Pi each passed 39.0\% (124/318 attempts; 95\% CI, 30.2--47.8 and 31.0--47.0, respectively). Performance varies across assay type

This Coalition transmission preserves metadata, trust context, and source routing for a Research Wire item from arXiv. The complete article remains with the original publisher.

Content handling is marked as Metadata Only. Use the source article link for the full report, updates, corrections, and publisher-controlled context.

Key Points

  • Published by arXiv.
  • Categorized as Research Wire.
  • Source handling: Needs Review.
  • Rights posture: Metadata Only.
  • Follow the source article for the complete original report.
Source Article EpiBench: Verifiable Evaluation of AI Agents on Epigenomics Analysis arxiv.org ↗