/pb29

The xArm above the completed Quiet Attractor pen drawing

physical result / 10 july 2026

Quiet Attractor

PB29 is a robotic painting-arm project built around a UFactory xArm 7. The immediate job is deceptively simple: see a sheet of paper, locate the current pen tip, find safe contact, and make a mark where the system expected it to land.

The long-term aim is a physical painting system whose internal state stays visible. Plans, uncertainty, selected primitives, camera evidence, and observed results should remain inspectable instead of disappearing inside an autonomous model.

It sits inside my wider painting practice, but this project is about the machine: the calibration stack, mark-making grammar, and feedback loop required before an AI can direct a brush in the physical world.

pb29.txt ↗one-file robotic-arm context packet for AI agents

01 / the hard part

The physical truth layer

Generating a beautiful path is easy. Knowing where paper, tool, surface, and robot actually are is the hard part. A few millimetres of stale geometry can turn a drawing command into a broken nib or a collision.

PB29 keeps these truths separate because they go stale for different reasons. Moving a camera, changing a pen, retaping paper, or changing the mount each invalidates a different part of the chain.

paper

Where may it draw?

A visual mask becomes a separate, inset executable region.

tool

Where is the nib?

The current tip is calibrated relative to the robot flange.

surface

Where is contact?

Plane geometry guides planning; fresh visual evidence proves contact.

motion

Is the path safe?

Saved joint paths are validated, branch-locked, and replayed exactly.

Overhead robot view with the detected paper boundary highlighted
Paper evidence — the visual sheet mask is not the same thing as the inset executable region.
Overhead camera image with the current pen tip and search regions overlaid
Tool evidence — predicted search geometry constrains the visible nib measurement.

02 / architecture

A glass-box painting system

Deterministic, testable primitives do the physical work. A language or vision model may eventually choose an operation—add a hatch, cool a region, try a glaze—but it does not improvise motor commands.

The observability layer is not only debugging. Showing what the arm sees, trusts, plans, and learns is part of the artistic premise.

01perceptionFixed and wrist cameras produce calibrated evidence.
02statePaper, tool, surface, wetness, and uncertainty stay explicit.
03primitivesNamed routines make strokes, hatches, glazes, dips, and wipes.
04groundingIntent becomes coordinates, tool paths, speed, attitude, and contact.
05directionA model may choose the next operation, never raw joint motion.
Overhead view of the xArm, paper workspace, markers, and operator controls
Current rig — xArm 7, fixed overhead vision, wrist camera, A4 workspace, fiducials, compliant pen mount, and supervised controls.

03 / evidence

From rough tests to a registered drawing

Early hatch pages were messy but useful: they exposed stale contact assumptions, branch changes, dry nibs, and paths that looked valid in software but were wrong in the room.

Quiet Attractor is the first complete study carried through the current workflow: generated path, paper registration, validated motion, physical drawing, and an after-image with the system's coordinate evidence preserved.

The xArm above an early page of hatching and contact tests
Earlier hatch/contact page — not a finished work; a record of what the system still misunderstood.
Quiet Attractor with paper boundary and registered coordinate axes overlaid
Quiet Attractor as evidence — detected paper boundary, registered axes, and nib clearance beside the physical result.

04 / now

Working, open, later

working

Registered A4 pen drawing, fixed and wrist vision, current tool calibration, guarded paths, and a read-only operator console.

open

Automatic first contact for arbitrary tools and paper, a stronger surface model, and a useful catalogue of mark primitives.

later

Brush and acrylic handling, dip/wipe/rinse choreography, tool changing, force sensing, and high-level model direction.

context + traces