A benchmark of brushwork for code agents
The studioA robot arm, one brush, sixteen paints.
Ground · strokes 1–178First the ground, in broad strokes.
Forms · strokes 179–358Then the forms: the hills, the cypress, the sky.
Details · strokes 359–1,678Then the details, finer and finer: 1,678 strokes in all.
RoboPaint
Can your code agent hold a brush?
43 works of calligraphy, lettering and painting. A code agent plans every stroke; a simulated robot arm makes it; the sheet and the hand are judged.
Scroll to paint
From a single brush stroke to a van Gogh. Each work is a picture to copy with a robot's brush or pen, stroke by stroke, the way a person would.
In the studio
The reference robot at work, ray traced. Each film replays a graded run, and its last sheet is that run's, pixel for pixel.
The collection
Six disciplines, each with its own brush or pen. Hover a work for the reference robot's copy; open it to compare and to watch it made.
Written, not coloured in
A fine tip can trace round and round a character until it is filled, and the picture alone would pass. RoboPaint also judges the hand: brush strokes, made as a calligrapher or a painter makes them.
How a work is judged
Aligned first, then compared. Writing is judged by its ink, painting by its colour; both by their strokes.
Open book, closed book
Every work is set twice. In the studio the agent may look at the exact sheet, ask for its score and start over; on stage it sees only what a camera sees, and paint is permanent.
Results
Two code agents, every work, both modes. A point is a work solved: the picture matches and the hand passes.
At the easel
Every copy the two agents handed in, hung beside its exemplar. A red seal marks a work solved; a note says what failed, the picture or the hand. Open one to compare it with the exemplar.
PreviewFull benchmark coming soon