News

AI Provider Index news.

Updates, product notes and practical coverage for AI platforms and operators.

#GoogleCloud #AIAgents #EngineeringAI
Open Google launches a real-world engineering benchmark for frontier agents · Ronald

Google launches a real-world engineering benchmark for frontier agents

Google Cloud and Mercor have introduced Physical-Engineering’s Last Exam, an 85-task benchmark covering mechanical, electrical, civil and structural engineering. Twenty-nine tasks and graders are public, while a competition uses a private test set. Google reports every tested frontier model scored below 50%, with safety checks acting as hard gates before cost receives credit.