Artifact Arena: frontier models design sumo robots, and the physics engine keeps score
Artifact Arena is a new benchmark out of MIT CSAIL, the MIT Media Lab, NYU and UCSF that grades language models on what they build instead of what they say. Each model has to design a complete robot (body as MuJoCo XML, controller as Python) and then the robots fight sumo-style in a physics simulator. Nobody judges style points. A robot either stays on the platform or it doesn't.