Available interaction methods vary depending on the agent type you’re using. Desktop agents support different interactions than mobile agents.
Basic Actions
The most common actions for interacting with elements usingclick()
, type()
, and mouse_move()
:
Keyboard Operations
Control keyboard input for complex interactions usingkeyboard()
:
Built-in Tools
AskUI provides several built-in tools for different types of interactions:Web Browser Tools
Control web browser operations:Clipboard Tools
Manage clipboard operations:Next Steps
- Learn about extracting data from UI elements
- Explore working with forms
- Review best practices for interactions