Snorkel AI vs Wan 3.0 AI Video Generator

Snorkel AI's feed is research and benchmark posts about how agents are evaluated. The newest compares Fable 5.2 with Fable 5.1 on 26 frontier coding tasks: pass@1 rises from 53% to 71%, and the mid-run terminal failures seen in 5.1 nearly disappear. It follows Terminal-Bench 4.1, which hardened verifiers against reward hacking, and a run of early-November posts on reward peeking and energy efficiency.

Snorkel is positioning itself as the outside scorer of frontier models: it funds open benchmarks, publishes the methods that keep them honest, and now runs head-to-head model comparisons on its own task sets. The posts sell its evaluation data business by example rather than through product releases.

Expect more model-versus-model results on Snorkel task sets as new frontier releases land. The entries show no product or pricing change, so whether this becomes a public leaderboard is unclear.