About this project
A robot finger for phone screens
ArduPlot3D is our own robot: a finger on a moving frame that taps and drags on a phone or tablet screen, built to play mobile games automatically. The current robot is the Mark 4, running on an Arduino Mega 2560 with C++ firmware, with a body designed in Blender and 3D printed. It drives X and Y stepper motors and SG90 servos for the fingers, homes itself with limit switches, reads from an SD card and has a 20 by 4 LCD menu with four buttons.
Designing moves on a phone-sized canvas
This website is where the moves are written. The canvas is sized to a real phone, with presets for the Samsung S20 Ultra, iPhone 12 Pro, iPhone 15 and Pixel 7, and a video of the game can play underneath to plot against. Each point is a tap, move and tap, drag, move or timeout, with settings for speed, the number of fingers and the wait. Points are grouped into loops and simulations that can be played back and downloaded.
TPGL, a language for the robot
The site turns each simulation into TPGL, Tom's Plotter Graphic Language, which we modelled on the GPGL language that cutting plotters use. It has commands to move, lower and lift a finger, set speeds, choose how many fingers and pause. Two fingers are fitted today, and the code is ready for a third.
Highlights
- Plotting canvas sized to real phones, including the iPhone 15 and Pixel 7
- Five plot types: tap, move and tap, drag, move and timeout
- Game video playback under the canvas to plot against
- Translates plots into TPGL, our own robot command language
- Simulation playback, plus a library for saving and sharing loops
Tech Stack
- React JS Vite 19
- Node JS
- Tailwind CSS
- Advanced Algorithms
- Interactive Tutorial
- Plotting Canvas UI
- Bluetooth/WiFi Connectivity
- Custom Graphical Language
- Robot Movement Design
What we built
- The Mark 4 robot: Arduino Mega firmware and a 3D-printed body
- A phone-sized plotting canvas with five plot types
- TPGL, a custom command language for the robot
- Simulation playback, download and a sharing library
- An Express and Prisma back end for users and saved simulations
Gallery
Love this site? We’ll build yours Free.
Conversion-focused design, fast hosting, and map-first discovery — powered by Byte Toast Studio.
Click here to view our FREE site offer Terms & Conditions