Capabilities
A unified overview of all AgentOS capabilities across control modes and runtime modes.
AgentOS provides a set of capabilities for controlling machines. What's available depends on the control mode and runtime mode you use.
| Capability | Host Mode | Companion Mode | Description |
|---|
| Screenshots | Available | Available (via HDMI capture) | Capture the current screen state. |
| GPU-accelerated screenshots | Available | , | Take screenshots on GPU for better performance. |
| Keyboard input | Available | Available (via USB / Bluetooth HID) | Simulate key presses and combinations. |
| Real Unicode typing | Available | , | Native Unicode input (not clipboard-based). |
| Mouse input | Available | Available (via USB / Bluetooth HID) | Click, move, drag, and scroll. |
| Multi-display support | Available | , | Interact with multiple monitors. |
| Window management | Available | , | Select, resize, move, and focus windows. |
| Process management | Available | , | Start, stop, and monitor OS processes. |
| Automation recovery | Available | , | Recover automatically from display changes. |
| CLI | Available | , | Enhanced command-line interface. |
These capabilities require AgentOS to be installed as a Windows service.
| Capability | Status | Description |
|---|
| SYSTEM-level service | Available | Run as a Windows service with SYSTEM privileges. |
| RDP disconnect recovery | Available | Keep automation running when RDP sessions disconnect. |
| Login screen automation | Available | Interact with the Windows logon screen. |
| Secure Attention Sequence | Available | Send CTRL+ALT+DEL programmatically. |
| Background session automation | Available | Automate sessions that are not in the foreground. |
| Multi-user session control | Planned | Control multiple user sessions on the same machine. |
| Virtual display | Planned | Create virtual displays for headless environments. |
| Capability | Status | Description |
|---|
| ADB (Android) | Available | Control Android devices via USB. |
| IDB (iOS) | Experimental | Control iOS Simulators (macOS only). |
| Capability | Status | Description |
|---|
| HID over USB | Available | Simulate keyboard and mouse via USB connection. |
| HID over Bluetooth | Available | Simulate keyboard and mouse via Bluetooth. |
| Screenshot via media stream | Available | Capture screen output via HDMI-to-USB dongle or webcam. |
| Raspberry Pi support | Planned | Use a Raspberry Pi as the companion device. |
| Platform | Host Mode | Companion Mode |
|---|
| Windows 10 22H2+ | Available | , |
| Windows 11 | Available | , |
| Windows Server 2019+ | Available | , |
| Windows 10 < 22H2 | Available | , |
| macOS | Available | , |
| Linux | Available | , |
| Android | , | Available (ADB) |
| iOS | , | Experimental (IDB, Simulators only) |
| Capability | Status | Description |
|---|
| C# API | Planned | Native C# interface for .NET integrations. |
| Future automation APIs | Planned | Integration with emerging OS automation frameworks. |
