Control your computer with gestures. No keyboard. No mouse. Just motion.
GCMD is a gesture-based UI navigation system that turns your webcam into a powerful spatial interface.
Think Raycast, but for your hands.
Navigate, control, and command your desktop environment using nothing but natural hand movements — in the air, in real-time, with depth-aware precision.
Our latest release introduces revolutionary hand tracking capabilities:
- 🎮 3D Laser Pointer System: Infinite laser beam that extends from your hand to a distant wall
- 🎯 Aim & Background Control: Precise cursor control with magnetic snapping to center
- 🔫 Point & Shoot Gaming: Gun mechanics with realistic aiming and shooting
- 🚗 Car Driving Simulation: Vehicle control using hand gestures
- ⚙️ Calibration System: Adjustable sensitivity and hand range for perfect control
- 🖱️ Real Mouse Control: Actual mouse events sent to browser for game integration
- ✨ Zero Jitter Movement: Ultra-smooth cursor with 0.99 smoothing factor
-
🎯 Aim & Background:
- Hand stays centered horizontally
- Vertical movement controls aiming
- Calibrated Y-axis sensitivity
- Strong magnetic snapping to center
- Infinite yellow laser pointer
-
🔫 Point & Shoot:
- Gun barrel from wrist to knuckle
- Laser follows actual pointing direction
- Full fist = Shoot
- Realistic 3D physics simulation
- Target hit detection and explosions
-
🚗 Car Driving:
- Hand gestures control vehicle
- Steering, acceleration, braking
- Real-time physics simulation
- Immersive driving experience
-
🖱️ Mouse Test:
- Real mouse cursor control
- Works with any web app/game
- Browser integration ready
We built GCMD to challenge the status quo of human-computer interaction.
While most systems today rely on clicks, taps, or voice — GCMD introduces a new layer: spatial interaction.
This isn’t just a tool for accessibility.
This is a productivity upgrade — for creators, developers, artists, power users, and visionaries who want to:
- Navigate faster
- Trigger commands with gestures
- Move objects across 3D space
- Control apps, windows, media, and more — with air-touch
- Uses your built-in camera (e.g., MacBook's FaceTime)
- Tracks hand gestures using MediaPipe + Tensorflow.js
- Projects your hand into a 3D interactive field on your screen
- Interprets gestures as UI commands: scroll, click, swipe, zoom, etc.
- Includes a depth-based z-axis using motion parallax for realistic 3D control
- NEW: 3D laser pointer system with infinite beam projection
- NEW: Calibrated aiming with magnetic snapping and zero jitter
- NEW: Real mouse event simulation for browser game integration
- Infinite Laser Pointer: 10-meter laser beam from hand to distant wall
- Precise Aiming: Calibrated Y-axis sensitivity with adjustable hand range
- Magnetic Snapping: Automatic center attraction with smooth return
- Zero Jitter: Ultra-smooth cursor movement with 0.99 smoothing factor
- Real Mouse Control: Actual
mousemove,mousedown,mouseupevents - 3D Physics: Realistic intersection calculations and depth perception
- Gesture Recognition: Pointing, shooting, dragging, and driving gestures
The closer you move your hand to the camera, the deeper you reach into your screen.
NEW: Point your hand to aim, make a fist to shoot, extend fingers to drag.
GCMD is more than a tool — it’s a new standard.
We are building toward a future where:
- Your hands appear inside your screen with spatial awareness
- You can pinch windows to close, swipe to switch apps, and grab 3D objects
- You interact with your computer like it's an extension of your body
- Every movement, from the twitch of a finger to a sweeping gesture, is fluid, intuitive, and productive
We're leveraging the best of 3D web tech (Three.js) and gesture AI (MediaPipe, TensorFlow.js) to craft a natural, immersive interface.
- 3D Laser Pointer System: Infinite beam projection with realistic physics
- Aim & Background Control: Precise cursor control with calibration
- Point & Shoot Gaming: Gun mechanics with target hit detection
- Car Driving Simulation: Vehicle control with hand gestures
- Real Mouse Integration: Browser game compatibility
- Zero Jitter Movement: Ultra-smooth cursor control
- Object manipulation in 3D space
- Depth-aware UI layers & motion parallax
- Seamless voice+gesture hybrid commands
- Plug-and-play macOS integration (native
.dmginstaller) - Full gesture-to-shortcut mapping for power users
- Multi-hand support for complex interactions
- Custom gesture training and recognition
- VR/AR headset integration
- Designers & Developers
- Creatives & Streamers
- Productivity Hackers
- Accessibility Advocates
- Curious Humans & Tech Enthusiasts
GCMD is for everyone who wants to do more, with less.
GCMD is a closed-source product.
We are not accepting contributions at this time.
All rights reserved by the creator.
We are packaging GCMD as a downloadable desktop app for macOS (with Windows coming soon).
To get notified on the launch or early beta:
- TensorFlow.js
- MediaPipe
- Three.js
- Next.js
- Electron (for native packaging)
Crafted with obsession, tested with motion, and built to redefine how we touch the web.
