Skip to content

Gesture-Controlled Motion Design. Browsing the web should be as fluid as moving your hands through air. GCMD turns your FaceTime camera into a real-time gesture interface, allowing you to navigate, select, scroll, and interact with digital interfaces through natural, depth-aware hand movements.

Notifications You must be signed in to change notification settings

blessedux/GCMND

Repository files navigation

GCMD — The Future of Human-Computer Interaction

Control your computer with gestures. No keyboard. No mouse. Just motion.

GCMD Hand Tracking Demo


What Is GCMD?

GCMD is a gesture-based UI navigation system that turns your webcam into a powerful spatial interface.
Think Raycast, but for your hands.

Navigate, control, and command your desktop environment using nothing but natural hand movements — in the air, in real-time, with depth-aware precision.

🎯 NEW: Enhanced 3D Hand Tracking System

Our latest release introduces revolutionary hand tracking capabilities:

  • 🎮 3D Laser Pointer System: Infinite laser beam that extends from your hand to a distant wall
  • 🎯 Aim & Background Control: Precise cursor control with magnetic snapping to center
  • 🔫 Point & Shoot Gaming: Gun mechanics with realistic aiming and shooting
  • 🚗 Car Driving Simulation: Vehicle control using hand gestures
  • ⚙️ Calibration System: Adjustable sensitivity and hand range for perfect control
  • 🖱️ Real Mouse Control: Actual mouse events sent to browser for game integration
  • ✨ Zero Jitter Movement: Ultra-smooth cursor with 0.99 smoothing factor

🎮 Interactive Modes

  1. 🎯 Aim & Background:

    • Hand stays centered horizontally
    • Vertical movement controls aiming
    • Calibrated Y-axis sensitivity
    • Strong magnetic snapping to center
    • Infinite yellow laser pointer
  2. 🔫 Point & Shoot:

    • Gun barrel from wrist to knuckle
    • Laser follows actual pointing direction
    • Full fist = Shoot
    • Realistic 3D physics simulation
    • Target hit detection and explosions
  3. 🚗 Car Driving:

    • Hand gestures control vehicle
    • Steering, acceleration, braking
    • Real-time physics simulation
    • Immersive driving experience
  4. 🖱️ Mouse Test:

    • Real mouse cursor control
    • Works with any web app/game
    • Browser integration ready

Why GCMD?

We built GCMD to challenge the status quo of human-computer interaction.

While most systems today rely on clicks, taps, or voice — GCMD introduces a new layer: spatial interaction.

This isn’t just a tool for accessibility.
This is a productivity upgrade — for creators, developers, artists, power users, and visionaries who want to:

  • Navigate faster
  • Trigger commands with gestures
  • Move objects across 3D space
  • Control apps, windows, media, and more — with air-touch

How It Works

  • Uses your built-in camera (e.g., MacBook's FaceTime)
  • Tracks hand gestures using MediaPipe + Tensorflow.js
  • Projects your hand into a 3D interactive field on your screen
  • Interprets gestures as UI commands: scroll, click, swipe, zoom, etc.
  • Includes a depth-based z-axis using motion parallax for realistic 3D control
  • NEW: 3D laser pointer system with infinite beam projection
  • NEW: Calibrated aiming with magnetic snapping and zero jitter
  • NEW: Real mouse event simulation for browser game integration

🎯 Advanced Hand Tracking Features

  • Infinite Laser Pointer: 10-meter laser beam from hand to distant wall
  • Precise Aiming: Calibrated Y-axis sensitivity with adjustable hand range
  • Magnetic Snapping: Automatic center attraction with smooth return
  • Zero Jitter: Ultra-smooth cursor movement with 0.99 smoothing factor
  • Real Mouse Control: Actual mousemove, mousedown, mouseup events
  • 3D Physics: Realistic intersection calculations and depth perception
  • Gesture Recognition: Pointing, shooting, dragging, and driving gestures

The closer you move your hand to the camera, the deeper you reach into your screen.
NEW: Point your hand to aim, make a fist to shoot, extend fingers to drag.


The Vision

GCMD is more than a tool — it’s a new standard.

We are building toward a future where:

  • Your hands appear inside your screen with spatial awareness
  • You can pinch windows to close, swipe to switch apps, and grab 3D objects
  • You interact with your computer like it's an extension of your body
  • Every movement, from the twitch of a finger to a sweeping gesture, is fluid, intuitive, and productive

We're leveraging the best of 3D web tech (Three.js) and gesture AI (MediaPipe, TensorFlow.js) to craft a natural, immersive interface.


What's Next

Recently Completed

  • 3D Laser Pointer System: Infinite beam projection with realistic physics
  • Aim & Background Control: Precise cursor control with calibration
  • Point & Shoot Gaming: Gun mechanics with target hit detection
  • Car Driving Simulation: Vehicle control with hand gestures
  • Real Mouse Integration: Browser game compatibility
  • Zero Jitter Movement: Ultra-smooth cursor control

🚀 Upcoming Features

  • Object manipulation in 3D space
  • Depth-aware UI layers & motion parallax
  • Seamless voice+gesture hybrid commands
  • Plug-and-play macOS integration (native .dmg installer)
  • Full gesture-to-shortcut mapping for power users
  • Multi-hand support for complex interactions
  • Custom gesture training and recognition
  • VR/AR headset integration

🧍 Who Is It For?

  • Designers & Developers
  • Creatives & Streamers
  • Productivity Hackers
  • Accessibility Advocates
  • Curious Humans & Tech Enthusiasts

GCMD is for everyone who wants to do more, with less.


Closed Source

GCMD is a closed-source product.
We are not accepting contributions at this time.
All rights reserved by the creator.


📦 Coming Soon

We are packaging GCMD as a downloadable desktop app for macOS (with Windows coming soon).

To get notified on the launch or early beta:

Sign up here
Learn more


Built With


👋 Created by Blessedux

Crafted with obsession, tested with motion, and built to redefine how we touch the web.

About

Gesture-Controlled Motion Design. Browsing the web should be as fluid as moving your hands through air. GCMD turns your FaceTime camera into a real-time gesture interface, allowing you to navigate, select, scroll, and interact with digital interfaces through natural, depth-aware hand movements.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published