Skip to main content
Once you’ve selected an element, you can interact with it using AskUI’s comprehensive set of actions and tools. This guide covers the different ways to interact with elements, from basic clicks to complex keyboard operations.
Available interaction methods vary depending on the agent type you’re using. Desktop agents support different interactions than mobile agents.

Basic Actions

The most common actions for interacting with elements using click(), type(), and mouse_move():

Keyboard Operations

Control keyboard input for complex interactions using keyboard():

Built-in Tools

AskUI provides several built-in tools for different types of interactions:

Web Browser Tools

Control web browser operations:

Clipboard Tools

Manage clipboard operations:

Next Steps