INSTRUMENT · The Arcade

LightEater

A slime mold that eats the light. A million agents follow one rule, sense ahead, turn toward the brightest trail, step, deposit, and the veins they leave are the picture. Point a camera at yourself and the mold finds you. Or switch to Dither and the same camera comes back printed live, in two to sixteen tones of one palette. Or to Circuit Bender, where every frame is saved as a JPEG, broken on purpose, and shown as it decodes.

NEW GAME · Camera

This page can use your camera. The feed goes straight from the camera into your graphics card, inside this tab. Nothing is recorded, nothing is uploaded, and there is no analytics or tracking anywhere on this page. You can check: the page makes no network requests once loaded (the optional person matte fetches its model from this site, and only when you pick it).

Without a camera it runs on a synthetic light field instead. Your browser will ask permission first; on phones the page must be served over https for the camera to be offered at all.

Camera off until you say so.

Keys

Esc
menu: pick Physarum, Dither, Circuit Bender or Auto (1 to 4, or O, D, J, A while the menu is up). The menu button on the deck does the same, and in fullscreen it is the way in, since the browser keeps Esc for leaving fullscreen.
O D J
switch straight to Physarum, Dither or Circuit Bender
A
sound react: the picture moves with the room. In Physarum bass swells the light, treble quickens the veins, and a sharp hit bursts agents onto the subject; in Dither the bass pushes the contrast; in Circuit Bender the bass bends harder and a sharp hit makes a new cut. This asks for the microphone, a separate permission from the camera, only when you turn it on; the audio never leaves the tab.
S
sound sensitivity: x0.5, x1, x1.5, x2, x3
R
auto: let the running tool play itself. Physarum re-casts every 45 to 75 seconds, a new look, colour and physics, sometimes a burst or a wave. Dither re-casts every 25 to 55 seconds, a new look, palette, pattern, bit depth and grain, and half the time an echo. Circuit Bender re-casts on the same clock, a new bend at a new amount, sometimes with a sort, copies, a split or a long exposure, and in between the amount sways slowly. The first re-cast lands within a few seconds. Any scene key hands it back to you; burst, wave, matte, depth, background, blackout and sound do not. It rests while the menu is open. The screen stays awake while it plays.
Space
blackout. An amber tick in the corner says it is on.
I
hide or show the status line
F
fullscreen
camera
the deck button turns the camera off and on again, in either tool. Turning it back on may ask for permission again; it never asks for the microphone.
?
jump to this list. A key the running tool does not know says so.

Physarum

1 to 6
looks: veinwork, amoeba, ghost, lightning, breath, inkblot (black ink on paper folded four ways over your camera's grey print, a blot that moves with you; it starts in the ink, and auto can land on it too, the paper fading in)
[ ]
body point (the physics under whatever is in frame)
, .
field point (the physics of the room)
X
swap body and field
B
burst: a third of the organism teleports onto the subject in a bloom of light. A tap on the picture bursts where you touched.
W
wave: a shockwave. Every agent races outward from the subject behind an expanding ring of light.
C
colour: arctic, fire, aurora, violet, toxic, rose, mono, video
M
matte: auto, motion, saliency, person, edges, luma. The person matte fetches its model from this site (about 10 MB, once) the first time you pick it; the camera feed still never leaves the tab.
H
depth, in three steps: flat glow, then the veins lit as raised tubes, then the tubes grown into fractal veins, where trunks branch into finer veins and those into hair-fine threads set further back. The page opens on that third step, drawn as molten ink over violet. Every look starts in depth, lit, with the fractal veins off; H adds them, and the press after that goes flat. Each look has its own depth, from 0.5 on the soft blob looks to 0.9 on veinwork and lightning, and its own amount of fractal detail for when H adds it, the same as on the desktop. An auto re-cast keeps the new look's own depth and starts it without the fractal veins.
V
background: off, veil (the feed's light through the palette), full (the feed itself). The mold stays on top; without a camera the synthetic field shows instead.
K
ink on paper: black ink on white, with one accent colour from the palette. It shows on the ink, the third H step. The deck's paper button does the same on a phone.
Y
mirror the ink: off, two ways, four ways, six ways. The half it mirrors from follows you, so you stay in the picture; it changes sides at most every two seconds. The deck's mirror button does the same.
0
reset to veinwork in the molten ink (paper and mirror off)

Dither

1 to 3
looks: menu (blue noise, one bit, fine), phosphor (Bayer, two bits, green), stream-safe (blue noise, one bit, coarse)
N
pattern: Bayer, a 4x4 crosshatch, or blue noise, an even 64x64 grain
B
bits: 1, 2, 4. One bit is ink and paper, two bits give four tones, four bits run the palette's whole ramp.
G
grain: steps through 72, 144, 240 and 360 rows (the stream-safe look starts coarser, at 56). Fewer rows, bigger dots.
C
colour: sixteen palettes, mono first, amber and green phosphor to cga
X
swap ink and paper
E
echo: off, short, long. Whatever moves leaves ghost copies that break into dots as they fade: on the beat with sound on, five times a second without it. A still scene shows nothing new. Only this page has it; the desktop app does not yet.
- =
fine tune the contrast
0
reset to the menu look, blackout off

Circuit Bender

1 to 9
looks: bent cam (where it starts: a broken camera at a glance), thermal (rainbow heat rings), prism (move and you paint with rainbow light), zigzag perm, dqt erosion, dht remap, scan swap, chroma amp, stack (all five at once, each a little lighter). E steps on to the sensor bends h clock, v clock and adc bits.
E
effect: the next bend, keeping the amount and everything else
G
amount: 25, 50, 75 or 100 percent. How hard each frame is bent.
- =
fine tune the amount, five percent at a time
L
long exposure: off, 3, 5 or 10 seconds. Frames stack into a running average, so what holds still stays sharp and what moves smears.
P
pixel sort: off, rows, columns. Every run of mid tones is sorted dark to light; shadows and highlights hold the shape.
C
copy: off, some, lots. Blocks repeat to their right and bands echo the rows above, the look of a decoder that lost its place.
X
split: off, 4 or 10 pixels. Red slides right and blue slides left.
0
reset to bent cam, blackout off

What it is

The Jones transport-network model (Jeff Jones, Artificial Life 16(2), 2010). Each agent reads the trail map at three points ahead of it, turns toward the strongest reading, steps forward, and lays trail; the map is blurred and decayed every frame. Vein networks grow, merge, and re-route out of nothing but that loop.

Two things make it an instrument rather than a screensaver. The matte is the pen: every parameter has a field value and a body value, and each agent runs on the blend of the two under the silhouette, so you and the room literally run different physics. And light is food: the camera's brightness is added to what the sensors read, so the mold chases whatever is lit. Move a lamp and it follows.

The veins are lit like raised tubes. A light circles the picture once every 48 seconds and dips lower on the beat when sound is on, so each vein gets a bright edge and a dark crease, and the thin ones read as running under the trunks. Every look starts there, lit, with the fractal veins off. H adds fractal veins: every trunk branches into veins half its size and those into hair-fine threads, three scales of the same organism. Press it again for flat glow, and again to come back to lit. The page itself opens with them on, drawn as molten ink over violet with the camera's picture hidden. The finer ones hug the flanks of the coarser, sit further back in darker light, and pass under the trunks with a clean edge. They grow densest over the person or bright thing in frame; the room keeps mostly trunks. The threads are drawn as hairlines at the screen's resolution, up to about four megapixels (past that they are drawn a little coarser and scaled up), and the lace is never quite still: every half minute or so one patch slowly blooms into finer lace and then relaxes, while the trunks hold. The fractal veins are shared with the desktop now: the same shaders and the same numbers run in both.

On the web the fractal step is also alive. Movement in the frame is food, so the finest threads hunt toward whatever moves, their tips glowing as they explore; a light runs along a vein when two threads join, threads nobody uses wither, the veins bend along the shape of what is in front of the camera, and a slow pulse travels out along them about every half minute. It is drawn as molten ink: wide strokes like a broad pen held at one angle, sharp chrome thorns spinning off them, and fine lace in the glow underneath. The desktop does not have this part yet.

Dither is the second tool. It prints the camera in a few inks: every dot is checked against a threshold pattern, either a 4x4 Bayer grid (the crosshatch of old newspapers and handheld game screens) or a 64x64 blue-noise field (an even grain with no visible grid), and lands on the nearest of two to sixteen tones. It runs the desktop's own dither shader, vendored file for file, and it checks itself: the status line at the bottom reads parity 48/48 when your graphics card matches the desktop in all 48 checks (I hides or shows it). The desktop's error diffusion (Floyd-Steinberg and friends) and its ASCII mode are not here yet.

Circuit Bender is the third tool, and only this page has it. Every frame from the camera is saved as a real JPEG inside the tab, at about one pixel per pixel of the screen and up to the 1024 by 768 the inspiring camera shoots, so its 8 by 8 blocks are the size they are in that camera's photos. Then the file is edited before it is opened again. Zigzag perm folds the quantisation table back on itself along its zigzag, so a coarse step lands on a fine frequency: edges emboss and colours posterise. DQT erosion sets the table's finest steps to 1 and blows up its coarsest, so the picture softens into its 8 by 8 blocks. DHT remap trades Huffman symbols of the same size, so every coefficient keeps its value and lands at the wrong frequency. Scan swap moves runs of the picture's blocks to other places in the compressed data, cut exactly where a block begins, so the decoder never loses its place. But each block's colour is stored as a step from the one before, so every block after a cut inherits the wrong step, and colour bands run to the edge of the frame. Chroma amp raises the colour table alone, so the colour is multiplied out and the sharpness stays. When a bent file will not open, the last good frame stays up, the bend eases off, and the next frame tries again. The camera never goes dark. The code and its numbers are this page's own, worked out from the JPEG standard (ITU-T T.81). The last three bend the sensor instead, before there is a file, the way a wire across a real camera's circuit board does: each frame is split into the one colour per pixel a sensor reads, broken, and put back together. H clock slips the line timing, so bands of lines slide sideways and read on into the next line. V clock misses the frame timing: lines repeat, the picture rolls past a dark bar, and highlights smear down. ADC bits shorts the wires that carry each reading, so the brightness folds into a few flat bands, on and off as the contact makes and breaks. Their pink and green casts are not painted on: they are what the camera's colour grid does when a reading lands one place over. Bent cam, where the tool starts, is all three at once, the way a wire across a real board rarely breaks one thing: the whole frame tips pink or green, bands slip sideways, some in the other colour, and bursts fold into flat neon levels that keep the outlines. Thermal takes one fault all the way, tuned against footage from real bent cameras: it shorts the bits that carry brightness, so it wraps round through a few colours again and again: every light comes back ringed in thin rainbow contours like a heat camera's, the shadows stay black, coloured grain boils in between, and outlines keep a bright rim. Prism answers you: wherever the picture moves, its edges shoot thin rainbow threads sideways that trail off, so a waving hand paints with light. Hold still and the trails die back to the clean picture; a beat lights every bright edge, and the bass makes the threads wider. It is built not to flash: each thread changes slowly and on its own beat, and a light switching on is not taken for movement. Pixel sort, copy, split and long exposure are the page's own takes on the gallery edits of the camera that inspired it.

Inspired by CyberShot Cam by @lixofuturista / @cebolander, a pocket camera that bends its own JPEGs. The effect names are theirs, apart from thermal, which is this page's own.

Auto, the fourth card on the menu, is the desktop's autopilot, running on the desktop's own timing. Every 25 to 55 seconds it re-casts the tool on screen, and every four to seven re-casts it walks to another tool, boot card and all, so an evening left running has movements. Dither has only three looks here, so each of its re-casts also draws a palette, a pattern, a bit depth, a grain and, half the time, an echo. On blue noise, auto also boils the grain: the dots re-roll every few frames, faster with the treble and at once on a beat, so one bit reads as more greys. Echo and boil are this page's own; the desktop app has neither yet. It is a guest, not a driver: the first scene key you press hands the picture back to you.

This page is the basic browser version of LightEater, the full desktop instrument (AGPL), and it runs the desktop's own simulation shaders, vendored file for file. The full app adds projector output, a signal rack, and 4K quality tiers; this page runs the agents and the trail on your graphics card and scales the agent count to what your machine can hold at speed, so the count in the status line is yours, not a fixed number.

source: github.com/cyborg-garden/lighteater

Privacy

The camera feed is uploaded frame by frame into a texture on your GPU and read only by the shaders on this page. It is never drawn to anything that is saved, never sent anywhere, and this page loads no analytics, no fonts from the video path, and makes no requests after it has loaded. Close the tab or press camera off and the stream stops; camera on brings it back. The source is in the open, so you do not have to take our word for it.

One exception, and it is opt-in: the person matte runs a segmentation model (MediaPipe selfie segmentation, Apache-2.0) in your browser. Picking it fetches the model and its runtime, about 10 MB, from this site's own origin, once. No third-party server is contacted, the model runs entirely in the tab, and the camera feed still goes nowhere. Until you pick it, nothing of it is even downloaded.

Circuit Bender encodes each frame as a JPEG and decodes it again, both in the tab's memory. The file is never saved, never given an address, and never sent anywhere; the bends are a few byte edits on it in between.

Sound react is its own, second opt-in. The microphone is never requested together with the camera: the page asks for it only when you press A or the sound button, as a separate permission you can decline on its own. The audio is reduced to a few loudness numbers by an analyser inside this tab, drives the picture, and is discarded; it is never recorded, never sent anywhere, and turning sound react on or off makes no network request of any kind. Press A again, or close the tab, and the microphone stops. If you decline, sound react simply stays off and everything else keeps working.

« arcadeabout + privacy ↗