Skip to content

PrabalJay/asl-detection-29-classes

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

47 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ–οΈ ASL Detection System (29 Classes)

A real-time deep learning-based American Sign Language (ASL) recognition system.
Detects and classifies 29 ASL alphabet signs (A-Z, SPACE, DEL, NOTHING) from images or webcam input.


πŸš€ Overview

ASL Detection System is a robust, easy-to-use tool for recognizing all 26 ASL alphabets plus SPACE, DEL, and NOTHING gestures. Featuring real-time detection, high accuracy, and a user-friendly interface.


πŸ“‘ Table of Contents

  1. Features
  2. Demo
  3. Installation
  4. Requirements
  5. Quick Start
  6. Usage
  7. Project Structure
  8. Training the Model
  9. Evaluation
  10. Dataset
  11. Contributing
  12. Acknowledgements
  13. Live Demo
  14. License
  15. Troubleshooting
  16. Credits
  17. Contact / Support

✨ Features

  • πŸ”€ Recognizes all ASL alphabets (A-Z) plus SPACE, DEL, and NOTHING
  • πŸŽ₯ Real-time webcam and image input support
  • πŸ’― State-of-the-art test accuracy
  • πŸ–ΌοΈ Confusion matrix visualization
  • πŸ› οΈ Easy-to-use scripts for training, detection, and evaluation

πŸŽ₯ Demo

ASL Detection Demo Confusion Matrix

🎬 Live Demo β€” Try it in your browser!


βš™οΈ Installation

Prerequisites:

  • Python 3.8+
  • NVIDIA GPU (recommended for training)

Install dependencies:

pip install -r requirements.txt

βš™οΈ Requirements

  • Python 3.8+
  • TensorFlow 2.x
  • OpenCV
  • NumPy
  • Matplotlib
  • scikit-learn

🏁 Quick Start

# 1. Clone the repository
git clone https://github.com/PrabalJay/asl-detection-29-classes.git
cd asl-detection-29-classes

# 2. Install dependencies
pip install -r requirements.txt

# 3. Train the model
python train.py

# 4. Evaluate the model
python evaluate.py

# 5. Run real-time detection
python detect.py

πŸ’‘ Usage

  • Train the Model:
    python train.py
    Trains the ASL recognition model using the dataset in data/train/

  • Evaluate the Model:
    python evaluate.py
    Evaluates the trained model and generates a confusion matrix

  • Real-Time Detection:
    python detect.py
    Launches webcam-based or image-based ASL detection

  • Check Dataset Images:
    python check_images.py
    Verifies and cleans dataset images

  • Configuration:
    python config.py
    Adjusts configuration settings for training and detection

Examples

Detect ASL in an Image

python detect.py
# Example output:
# Predicted: Sign Y (1.00)

Real-time Webcam Detection

python detect.py --webcam
# (Press 'Q' to quit)

Webcam Demo

Webcam Demo


πŸ“ Project Structure

asl-detection-29-classes/
β”œβ”€β”€ data/
β”‚   β”œβ”€β”€ train/              # Training images
β”‚   └── test/               # Test images
β”œβ”€β”€ docs/                   # GitHub Pages folder
β”‚   β”œβ”€β”€ index.html          # Your HTML file
β”‚   β”œβ”€β”€ asl_demo.mp4        # Video (compressed)
β”‚   β”œβ”€β”€ sample_1.png        # Demo images
β”‚   β”œβ”€β”€ sample_2.png
β”‚   └── sample_3.png
β”œβ”€β”€ models/
β”‚   └── model.keras         # Trained model
β”œβ”€β”€ check_images.py         # Dataset verification utility
β”œβ”€β”€ config.py               # Configuration script
β”œβ”€β”€ detect.py               # Real-time/image detection script
β”œβ”€β”€ evaluate.py             # Model evaluation script
β”œβ”€β”€ train.py                # Model training script
β”œβ”€β”€ requirements.txt        # Python dependencies
β”œβ”€β”€ confusion_matrix.png    # Model performance visualization
└── README.md

🎯 Training the Model

Organize your dataset as follows:

data/train/
  β”œβ”€β”€ A/     # Images for 'A'
  β”œβ”€β”€ B/
  └── ... (all 29 classes)

Train:

python train.py
  • Saves best model to models/model.keras
  • Generates confusion_matrix.png

πŸ“Š Evaluation

Evaluate the model:

python evaluate.py

Sample output:

Test Accuracy: 96.3%
Class-wise Precision:
A: 0.98 | B: 0.95 | ...

πŸ“‚ Dataset


🀝 Contributing

Contributions, issues, and feature requests are welcome!
Feel free to fork the repo and submit a pull request.


πŸ™ Acknowledgements

Special thanks to the open-source community and contributors for their resources and support.


🟒 Live Demo

Try it here

Features Demonstrated:

  • βœ… Webcam hand tracking
  • βœ… 29-class prediction (A-Z + SPACE/DELETE/NOTHING)
  • βœ… Confidence score display

πŸ“œ License

MIT License β€” See LICENSE for details.


πŸ› οΈ Troubleshooting

Issue Solution
CUDA errors Install correct TensorFlow-GPU
Missing dependencies Run pip install -r requirements.txt
Low accuracy Increase epochs or add more training data

πŸ™Œ Credits

Built with TensorFlow/Keras


πŸ“¬ Contact / Support

For questions, open an issue.


About

Real-time American Sign Language (ASL) detection system using Deep Learning (29 classes). Built with TensorFlow/Keras and OpenCV.

Topics

Resources

License

Stars

0 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages