How It Works
AgentOS operates in two control modes:- Host Mode — AgentOS runs directly on the target machine as software. It controls the desktop via OS-level APIs with full access to screenshots, input, windows, and processes.
- Companion Mode — AgentOS runs on an external device (e.g. Raspberry Pi) and controls the target machine through hardware interfaces (USB, Bluetooth, HDMI capture). No software installation on the target required.
Why AgentOS?
vs. Open Source (PyAutoGUI, xdotool, etc.)
Open-source desktop automation libraries run in the user’s session only. That works for simple scripting but breaks down for real-world agent deployments:- No service mode — when the user logs off or the RDP session disconnects, automation stops.
- No logon screen control — you can’t automate Windows logon, lock screens, or UAC prompts.
- No CTRL+ALT+DEL — Secure Attention Sequence requires a kernel-level driver. User-space tools cannot send it.
- No session resilience — if an RDP session drops, the desktop locks and screenshots go black.
- User-level privileges only — no access to SYSTEM-level operations.
vs. Building It Yourself
You can build OS-level control from scratch. Here’s what that involves:- Windows service with session management — running as SYSTEM, attaching to interactive sessions, handling session 0 isolation.
- Secure Attention Sequence driver — a signed kernel driver to send CTRL+ALT+DEL.
- RDP session transfer — detecting disconnects and keeping the desktop alive for screenshot capture.
- Logon screen interaction — injecting input on the secure desktop.
- Cross-version compatibility — handling differences across Windows 10, 11, Server 2019, 2022.
Comparison
| Capability | AgentOS | Open Source | DIY |
|---|---|---|---|
| OS service mode | Yes | No | Months of work |
| RDP resilience | Yes | No | Kernel-level effort |
| Logon screen control | Yes | No | Requires SAS driver |
| Send CTRL+ALT+DEL | Yes | No | Requires signed kernel driver |
| CI/CD headless | Yes | No | Custom service wrapper |
| SYSTEM privileges | Yes | No | Manual service setup |
| External device control | Yes | No | Custom hardware integration |
| Industry protocols | Planned | No | Custom integration per protocol |
| Maintained and versioned | Yes | Varies | On you |
| Time to first automation | Minutes | Hours | Months |
What’s Next?
Quickstart
Get AgentOS running in under 5 minutes.
Control Modes
Host Mode vs Companion Mode — how AgentOS connects to targets.
Deployment Scenarios
Find the right setup for your target.