You only choose where it goes. Its simulated steering neurons decide how to turn: watch them in the brain panel.
356 of 360 strokes landed. 24 palette visits.
A simulated adult fruit fly paints a picture. Its turning decisions come from a computer model of its brain, built from the FlyWire wiring diagram: 138,639 neurons and about 15 million connections, mapped from electron-microscope images of one real fly's brain.
Every 10 milliseconds of simulated time:
The Mona Lisa and The Starry Night play back runs where all 138,639 neurons were simulated alongside a physics-simulated body. Those runs reached 357 of 360 and 356 of 357 strokes.
Every other picture, including ones you upload, runs live in your browser. The live brain is the 2,117 neurons that actually fire during this task, with their 77,500 real connections and the 10,582 photoreceptors that feed them. In side-by-side tests it gave the same turn-command firing rates as the whole brain. Your picture stays on your device.
Each eye has 721 facets. The colour each facet sees drives the photoreceptors behind it: R1–6 respond to light and motion, R7 and R8 to colour. You can watch them glow in the brain view in the colours the fly is looking at.
Behind the eyes runs a second model: the fly's motion-vision system, 45,669 neurons of 65 cell types across all 721 eye columns, with 1.5 million connections laid out from the mapped wiring. It is the trained network published by Lappalainen and colleagues (Nature, 2024). Its wiring comes from the connectome; the strength of each connection type was tuned by training it to detect motion, so it is part mapped, part learned.
Each frame of what the fly sees goes through it in your browser. Its neurons light up in the brain view at the positions of the matching FlyWire cell types, and switching the eye view to Motion shows what its T4 and T5 motion detectors pick up: the colour is the direction, the brightness is the strength. Like the colour signal, this vision doesn't decide where the fly walks.
The test that shows the brain is doing the steering: with the steering neurons cut, the fly reached 0 of 4 targets; intact it reached 12 of 12. In live mode you can cut them yourself and watch it lose its way.
In Steer mode you take the place of the stroke plan. Where you point becomes the input to the same steering neurons, and the brain's turn-command neurons still decide every turn, so it can overshoot, circle and correct like it does on its own. Loading paint and mixing are done for you when you tap a pot, as flights to the palette.
The canvas is 36 mm wide, smaller than a postage stamp. The fly is about 2.5 mm long. The brush and paint tube next to it are full size.
Wiring: FlyWire Consortium (Dorkenwald et al. 2024; Schlegel et al. 2024, Nature), CC BY-NC 4.0. Brain model parameters: Shiu et al. 2024, Nature. Visual system: Lappalainen et al. 2024, Nature (trained model flow/0000/000). Fly body and walking: NeuroMechFly (Wang-Chen et al. 2024). Paintings are in the public domain. Original score, played on VSCO 2 Community Edition orchestral samples (Versilian Studios, CC0). Non-commercial project.
A Max Lin project · Follow my paintings @maxlin.art
Cutting a neuron removes its output from the simulated brain, the same way as the lesion test. Tick one and watch what the fly does next.
Films the painting from start to finish: a real-time opening, a time-lapse with camera cuts, the reveal, and an end card that sends people to @maxlin.art.
Rendering…