Infrastructure, chips, inference and models that run on your own devices.
28 articles
The benchmark evaluates agents that attempt to reconstruct results from machine learning papers using released materials and a fixed GPU budget. Its success rates show increasing difficulty, but do not determine whether the papers’ scientific conclusions are valid.
A preprint describes a system that retrieves domain-specific definitions of sensitive information at inference time. Its initial results favor its detection recall over a reference classifier in most tested combinations, although the information available does not make it possible to assess all error types or its readiness for real-world use.
The approach aims to give robots access to more demanding models without placing all of the computation onboard. The sources describe potential benefits, but do not provide enough metrics or detail here to quantify the results.
OpenAI announces diagnostics and explicit breakpoints for GPT‑6 prompt caching. Their effect on latency and cost will depend on request patterns and should be verified with your own measurements.