The preprint brings together resolved events and dated news to evaluate agents at different points in history. Its abstract reports that research tools improve scores across 12 models, although every model still trails historical market forecasts.
The benchmark evaluates agents that attempt to reconstruct results from machine learning papers using released materials and a fixed GPU budget. Its success rates show increasing difficulty, but do not determine whether the papers’ scientific conclusions are valid.
The benchmark brings together 799 Indian retail banking cases and examines safety, tool use, responses, and advice. Its authors argue that getting a case right once is not enough to measure reliability.
A preprint describes a system that retrieves domain-specific definitions of sensitive information at inference time. Its initial results favor its detection recall over a reference classifier in most tested combinations, although the information available does not make it possible to assess all error types or its readiness for real-world use.
Akamai confirmed a multiyear commitment to provide computing capacity for Anthropic, with a focus on CPU workloads. Earlier reports initially cited $1.8 billion; a later announcement put the expanded commitment at $11.6 billion. The terms do not, by themselves, show that all of this capacity is already operational.
Google’s pilot lets Gemini handle some simple business calls for users. For now, it is limited to Pixel 11 owners in the United States who pay for a Gemini subscription. Users can monitor the call and take over.
Google announces Live Avatar for Gemini Enterprise: a visual representation that accompanies conversations and synchronizes its movements with speech. Availability, performance, and supported modalities have limits worth keeping in mind.
The benchmark measures whether agents can predict how changes to workflow components affect outcomes. Its results describe performance on specific tasks, not a general ability to do science.
At Made on YouTube, the company announced AI-assisted feedback on drafts and conversational editing for Shorts. YouTube lists some of the editing actions, but has not specified regions or a rollout schedule.
OpenAI documentation sets a retirement date for the Videos API and the Sora 2 and Sora 2 Pro models, and does not list a replacement. Teams can start by inventorying their dependencies and backing up assets they have already downloaded; the available sources do not clarify what will happen to jobs and metadata after shutdown.
The preprint describes an adaptive red-teaming method that uses the results of each test to choose what to explore next. Its authors report finding more failures than static replay of seed tests across three evaluation families, but the summary does not quantify the advantage or show that it translates into the frequency of real-world incidents.
The benchmark compares computer-use agents across nine marketplace environments, with and without steering mechanisms. Its results point to a sharp drop in selecting the product deemed optimal for the user, but do not show that the same effect occurs in real stores.