Skip to content

Live depth from any camera

A neural network works out how far away every pixel is, live on a Mac inside TouchDesigner. The agent took a working prototype to a finished .tox in two sittings: model inside, nothing to install, about 11 depth maps a second on an M5 Max while TouchDesigner keeps rendering at 60 fps.

  • Price: PRO
  • MCP
  • 3D

You need

  • TouchDesigner 2025.33230
  • Twozero plugin
  • Mac with Apple silicon

Try this prompt

Find a monocular depth model that runs locally on my Apple-silicon Mac, benchmark the ways to run it, and build a self-contained TouchDesigner component around the fastest one: live depth map from any TOP, model embedded in the .tox, no pip installs, inference off the main thread, presets for slower Macs.

Our suggestion. The real run started from a June prototype, so its first message only makes sense next to it.

Model
Claude Opus 5,1M-token context
Time
~4 hours of agent time,two sittings, 938 model turns
Attention
16 short messages, 4 choices
Tokens
309M in · 733K out,99% re-read from cache

Or take the finished one

Depth AI

in Rudiments · vankrav/depth-ai · v4 · 87.4 MBin Rudiments · v4 · 87.4 MB

Price: PRO
Open in Rudiments

PRO opens every rudiment in the library, not just this one.

Next step

More runs

  • Audio-reactive fractal

    Four 3D fractals, mandelbulb, mandelbox, sierpinski and menger, raymarched in one GLSL shader with bass, mid and high inputs

    • Price: Free
    • MCP
    • Generative art
    Time
    first pass 12 min 31 s
    Attention
    two build prompts, permission clicks
  • Glass poured from your hands

    Your hands pour glass over the live camera, and inside the glass the picture runs behind like a time machine

    • Price: PRO
    • Interactive