FIELD
V0.1.15 · DESKTOP · LOCAL-FIRST
Physical–digital prototyping toolkit

Wire the real world
to a living canvas.

Connect phones, sensors and boards to visuals and sound — no code required. Free, open, and it runs entirely on your machine.

ActorStart with what's real. A plant is an Actor — a thing in your world that can act.
RoleGive it a Role. This plant can sense touch — that's its Input Role.
CueBring in a second Actor — a speaker. Decide when they should react to each other. That's a Cue.
MechanismThen choose how it plays out. The Mechanism is the exact manner touch becomes sound.
ScenePick your Actors, give them Roles, connect them with a Cue, choose a Mechanism. FIELD handles the rest.
Scroll ↓
Live demo

Connect your phone

Scan with your phone camera. No typing.

······
or typeplant.html
Waiting for a phone…
Detecting your system…

Download FIELD

Choose the build for your machine below.
See all downloads →

Downloads

4 builds
macOS
Universal binary
Apple Silicon & Intel · macOS 11+
Windows
64-bit
Windows 10 / 11
Linux
Debian · Ubuntu · Fedora
Packaged build in progress.
Run from source for now.

First launch. The app is not code-signed yet, so your OS asks once. On macOS: right-click FIELD → Open → Open. On Windows: More info → Run anyway.

Install & first run

≈ 3 min
01

Open FIELD. It starts a small server on your computer.

02

Put your phone and computer on the same Wi-Fi.

03

Open the Sensors panel. Scan the QR code with your phone.

04

Draw a Cue from a sensor to an output. Tilt your phone — the canvas responds.

Learn & build

5 guides
01 No code
In the app

First FIELD

Make one working connection: your phone's tilt or touch moves something on the canvas.

Use it when
You just installed FIELD and want a first prototype fast.
How to start
Open it, get phone + computer on one Wi-Fi, follow each step.
Open guide →
02 No code
In the app

Connect Two Things

Two phones, two boards, or a phone and a board — talking to each other or to one canvas.

Use it when
One sensor works and you're ready to combine more than one.
How to start
Finish "First FIELD" first, then open this guide.
Open guide →
★ Try it now
No install

Live Pairing Demo

Open this page on your phone and your computer. Enter a 6-digit code to pair them, then shake or swipe your phone and watch a shape react live — right in the browser.

Use it when
You want to feel what FIELD does before installing anything.
How to start
Open it on two devices — no FIELD app required.
Try the demo →
03 No code
In the app

Add a Custom Sensor

Step-by-step: write, install, and test a plugin for a sensor chip FIELD doesn't know yet.

Use it when
Your chip isn't built in and you want a guided walkthrough, not just a spec.
How to start
Open it — no download, reads right in your browser.
Open guide →
04 Code
p5.js & web

Build with JavaScript

Read live FIELD values in your own sketch or web page via field-bridge.js — for when you'd rather write code than use the canvas.

Use it when
You want custom visuals, sound, or a page that reacts in real time.
How to start
Open it — no download, one worked example, then the spec.
Open guide →
05 Hardware
Plugin spec

Plugin file spec (for AI)

The same .field-plugin.json format as guide 03, written for an AI coding assistant to read.

Use it when
You'd rather describe your chip to an AI agent than hand-write the file.
How to start
Open it — no download, one worked example, then the spec.
Open guide →

> guides 04 & 05 lead to one page. It walks through a worked ESP32 + p5.js example, then links both machine-readable specs — read them yourself, or paste them into an AI coding tool (Claude, Cursor, …) and let it generate correct FIELD code for you.

Four words

Everything else is built from these
Actor
A plant, used as an example Actor
An Actor is anything in your physical surroundings that acts or performs an action. For example: a plant, a speaker, or a phone.
Role
A Role is the job an Actor plays. It can sense something, like touch or tilt. Or it can react to something, like glow or sound.
Cue
A Cue is the rule for when and how two Actors act together. It is the line you draw between them.
Mechanism
A Mechanism is the exact way the action plays out. You pick it inside a Cue.

Follow the full tutorial →