AI agent instructions
AI agent instructions
Fields
string
required
string
required
SnapshotMetadata
required
Metadata of the current page, i.e url, page title, snapshot timestamp.
Screenshot
required
Base64 encoded screenshot of the current page
ActionSpace
required
Available actions in the current state
{ [key: string]: ElementState; } | null | undefined
Live state of the interactive elements that have one (current value, checked state, select options, aria state), by action id. Not rendered into the action descriptions.
string | null | undefined
Hash of the page URL and of the id, label and live state of every interactive element: it changes when the page offers other actions or a field value changes.