testdriver:locating-elements

To locate UI elements with natural language, you provide a plain text description of the target control. The skill identifies the matching element on web and desktop interfaces and returns its coordinates and properties for automation.

Yes, you can find multiple UI elements simultaneously using a single natural language description. The skill supports both single and multiple element discovery across web and desktop interfaces while returning rich debugging metadata for troubleshooting.

Yes, natural language element locating works for both web and desktop interfaces. The skill identifies on-screen controls across different environments by applying plain language descriptions to satisfy clear element identification requirements.

Using natural language to locate UI elements instead of static selectors prevents brittle automation scripts. Plain language descriptions adapt to UI changes more reliably, providing robust element identification and returning properties for deterministic matching.

You get debugging data for UI elements located with natural language by requesting the element's properties and coordinates. The skill returns rich debugging metadata for troubleshooting and supports caching found elements for faster subsequent lookups.