AI Stress Tester: Models Have Crossed a ‘Threshold of Competency’

AI Stress Tester: Models Have Crossed a ‘Threshold of Competency’

After AI models from OpenAI, Anthropic and others broke out of controlled tests and accessed real-world systems, new questions were raised about how they should be assessed before deployment. Those evaluations were run with Irregular, a startup hired to stress-test advanced AI models. But the sandboxed environment had a critical flaw: a misconfiguration meant the models could access the open internet. Dan Lahav, CEO of Irregular, explains how a …