Click, type and press keys
Performs the actions on a gui sandbox’s screen, in order, and answers once the Mac has performed all of them. Coordinates are pixels in a screenshot of the sandbox (getScreenshot), origin top left, and screen is that screenshot’s width and height; the Mac scales them to its display. screen is required when any action has coordinates. The slot’s own session daemon posts the events to that sandbox’s session only. The call does not wait for the app to react: take another screenshot to see what happened. At most 100 actions, 4,096 typed characters and 10 s of wait per call. A list with one bad action performs nothing. A recording lists each action, with a type action’s length only, never its text.
Authorizations
Body
1 - 100 elementsOne input action. Key, modifier and button names: key is one key after any modifiers, joined with +, like return, cmd+s or cmd+shift+t. Keys are US-layout and case-insensitive: a to z, 0 to 9, - = [ ] \ ; ' , . / `, return (or enter), tab, space, backspace (or delete), forwarddelete, escape (or esc), left, right, up, down, home, end, pageup, pagedown and f1 to f12. Modifiers are cmd (or command), shift, ctrl (or control), alt (or opt, option) and fn.
- move
- click
- drag
- scroll
- type
- key
- wait