Skip to content

Gesture-controlled mouse using OpenVINO, oneDNN, Intel IPP, and TBB for fast, real-time hand tracking and air drawing.

Notifications You must be signed in to change notification settings

devznsh/AirCursor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

3 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Gesture-Controlled Mouse with Intel oneAPI

A real-time hand gesture recognition system that controls your mouse cursor, optimized with Intel oneAPI for cross-architecture acceleration.

πŸ”§ Key Features

  • πŸ‘† Index finger tracking for cursor movement
  • 🀏 Pinch gesture for mouse clicks
  • ⚑ Intel-optimized performance via:
    • OpenVINO toolkit for AI inference
    • oneDNN acceleration for MediaPipe
    • Intel IPP in OpenCV
  • πŸ–ΌοΈ Air drawing mode with gesture-based color switching

πŸš€ Intel oneAPI Integration

This project leverages multiple Intel technologies:

Component Intel Tech Used Benefit
AI Inference OpenVINO Toolkit 3-5x faster inference on Intel CPUs/GPUs
Math Operations oneDNN Accelerated landmark calculations
Image Processing Intel IPP (via OpenCV) Optimized frame processing
Thread Management Intel TBB Efficient multi-threading

πŸ“¦ Installation

Prerequisites

  • Intel CPU (6th Gen+) or GPU (Iris Xe/Arc)
  • Python 3.9+
  • Windows/Linux
# Clone the repository
git clone https://github.com/devznsh/AirCursor.git
cd AirCursor

# Create and activate virtual environment
python -m venv venv
source venv/bin/activate  # Linux/Mac
.\venv\Scripts\activate   # Windows

# Install dependencies (Intel-optimized versions)
pip install -r requirements.txt

πŸ—οΈ Project Structure


gesture-mouse-oneapi/
β”œβ”€β”€ models/                   # OpenVINO IR models
β”œβ”€β”€ gesture_mouse.py          # Main control script
β”œβ”€β”€ air_drawing.py           # Drawing mode
β”œβ”€β”€ openvino_utils.py        # Intel acceleration helpers
└── requirements.txt         # Intel-optimized packages

About

Gesture-controlled mouse using OpenVINO, oneDNN, Intel IPP, and TBB for fast, real-time hand tracking and air drawing.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages