2024.07.01 | Relational Selector - Intersecting Option

Introduction

This release adds a new parameter intersection_area to the relational selectors above(), below(), rightOf() and leftOf(). It allows you to specify more granular which elements get detected.

---

New Features

Optional parameter intersection_area for relational selectors above(), below(), rightOf() and leftOf() in AskUI TypeScript SDK:

• above() API docs
• below() API docs
• leftOf() API docs
• rightOf() API docs

---

Fixes

• Drag & Drop (Mouse down, mouse move, mouse up) crashes controller.
• TypeScript ADK retries requests to AskUI Inference that need fixing by a user. Resulted in long execution times because of unsuccessful retries.
• AskUI Controller crashes when trying to implement Drag & Drop behavior with mouseToggleDown() and mouseToggleUp().