Vals, backed by Andreessen Horowitz, is looking to become the gold standard for AI benchmarking
THE SO WHAT
A neutral, third-party benchmark layer backed by a16z is a bid to become the arbiter of which models are ‘good enough’ for specific use cases. If Vals gains traction, model choice and procurement may start to flow through its scorecards—operators should expect more pressure to justify deviations from whatever becomes the de facto benchmark suite.
READ THE SOURCE
MORE FROM THE WIRE
Applied AIAI safety conversations have gotten unbelievable
The gap between viral AI-safety discourse and what’s technically or institutionally real is widening, which makes it harder for operators to separate theater from constraints. Build your risk posture off concrete capabilities, regulations, and contracts — not Twitter threads or podcast hypotheticals.
Applied AISuno’s Latest AI Model Got Some Label Support. But Not All of Them
Partial label deals mean the legal perimeter around AI music is still unstable — every track you generate carries a different rights and takedown profile depending on which catalogs are in or out. If you’re building on AI audio, you need explicit guidance from counsel and your distributor on which models and use cases they’ll actually stand behind.
Applied AIAI generated a fake intelligence report that almost started a war
AI is now in the loop on decisions that can trigger kinetic escalation — a fake report nearly drove U.S. military action against a Chinese vessel, per CNN. Any organization feeding AI outputs into high-stakes workflows needs hard gates where humans validate sources and provenance before action, not after the fact.
Applied AIThe AI regulation smackdown isn’t over
With lab CEOs publicly proposing slowdown frameworks and third-party evaluators, the Overton window on AI regulation now includes embedded oversight inside companies. If you’re building with frontier models, assume future rules may require external audits of your highest-risk deployments — design logs, evals, and kill switches accordingly.