domains / families / software-engineering / pyautogui

pyautogui

separate

Cross-platform mouse/keyboard automation skill. Supports mouse control (move/click/drag/scroll), keyboard control (key press/hotkeys/type text), screen operations (screenshots/mouse position/screen size), image utilities (metadata/crop), screen overlay markers, drawing markers on images, image locating (template matching + OCR), and file cleanup to free disk space. Activate when the user needs UI automation, screenshots, coordinate verification, image analysis/annotation, on-screen element locating, or cleanup.

When to use

• UI automation
• screenshots
• coordinate verification
• image analysis/annotation
• on-screen element locating
• cleanup
• mouse control
• keyboard control

Skill page

Source