Scaper

Screen Capture And Program Execution Robot

Overview

Scaper is an automated screen interaction tool designed to streamline repetitive computer tasks through screen analysis and programmatic user input simulation. By capturing screenshots, analyzing visual elements, and executing predefined actions, Scaper enables automation of complex workflows.

Features

• Host-to-browser screen streaming via WebRTC
• Browser based remote input to host
• Lua scripting with hot reload support
• Rust API allowing embedding in programs

Layout

• crates/recorder Manages gstreamer setup to push data to scaper and the webrtc stream
• crates/scaper API providing remote input support and image processing
• crates/scaper-osrs Consumers of Scaper API for specific use case
• web/server Go code for the webrtc and file server
• web/ui Browser UI code.

Running

# Run scaper and the recorder
make run

# Start up the webrtc and static file server
# By default it runs on localhost:8080
make run-web

Platform Support

OS	Supported
Linux X11	Yes
Linux Wayland	No
MacOS	No
Windows	No

Support for more platforms is possible, but not implemented yet.

Inspiration

https://github.com/Villavu/Simba