Hand & Eye Gesture Control
AGI Gestures
Control your Mac with hands and eyes.
One camera turns gestures into shortcuts.
Gesture × action mapping
Assign the action you want to the gesture that feels natural. Example mappings:
Advance presentation slides
Take a screenshot
Play or pause video
Undo the last action
Move through a web page
Close the current tab
Switch to dictation
Two-hand combinations
Combine left and right hands to unlock more actions. Example mappings:
Save all files
Example: run Cmd+Shift+SQuit the current app
Example: run Cmd+QTake a screenshot
Example: run Cmd+Shift+4Eye gestures
Use blinks and winks as commands without moving your hands. Example mappings:
Start transcription
Example: run Cmd+Shift+9Undo
Example: run Cmd+ZRedo
Example: run Cmd+Shift+ZHow it works
Camera capture
The built-in Mac camera tracks hands and eyes.
Local AI recognition
The model classifies the gesture locally on your device.
Action execution
The mapped shortcut, mouse action, or text snippet fires instantly.
Fully local processing. Camera input stays on your device.
Gesture recognition runs entirely on your Mac. Camera frames and gesture signals are not sent to external servers. The model is bundled with the app, so the core experience works offline as well.
Features
Map one-hand and two-hand gestures to keyboard, mouse, and text actions.
10 gesture types
Seven hand gestures plus three eye gestures, including both eyes closed and left/right wink.
Shortcut execution
Assign any keyboard shortcut, including modifier-heavy combinations.
Mouse and scroll control
Control cursor movement, clicking, and scrolling with acceleration.
Two-hand gestures
Use combinations of left and right hands to unlock more actions.
Continuous execution
Keep firing while a gesture is held, ideal for smooth scrolling behavior.
Live overlay
See the recognized gesture and progress overlay live in the center of the screen.
Text input
Insert text snippets or fixed phrases with a single gesture.
Left/right distinction
Map the same gesture differently depending on whether it is the left or right hand.
AGI Labo login
Sign in with AGI Labo to unlock the full gesture configuration set and all features.
Use cases
Make Mac interaction more fluid with gesture-driven control.
Version history
Recent releases and changes.
