Glossary
Computer use
Also: computer use
A tool through which the model sees the screen via screenshots and controls the mouse and keyboard, working with interfaces that have no API.
Example
The agent fills out a form in an internal system with no API: takes a screenshot, finds the field, types the value.
Where it shows up
- An AI assistant with a fully connected stack — Post 7 of 8