AI-Powered Medical Robot

An intelligent medical robot that combines dual deep learning models for face identification and mask detection with Arduino-based temperature sensing and automated mask dispensing for healthcare environments.

4/6/2020
Featured Project
AI-Powered Medical Robot
📷
AI-Powered Medical Robot
About This Project

This sophisticated medical robot integrates advanced computer vision and robotics to provide comprehensive health monitoring solutions for hospitals and clinics. The robot combines machine learning with embedded hardware to deliver real-time face recognition, mask detection, temperature monitoring, and automated attendance logging. Using dual neural networks - a VGGFace2-based model for face identification and a MobileNetV2 model for mask detection - the robot can accurately identify registered patients and staff while ensuring mask compliance. The Arduino-integrated hardware enables contactless temperature measurement using infrared sensors and automated mask dispensing through stepper motor control. With features like real-time video processing, intelligent face tracking, automated attendance logging, and a comprehensive registration system, this medical robot demonstrates expertise in computer vision, deep learning, embedded systems, and healthcare robotics integration.

Key Features
  • Dual neural network architecture with VGGFace2 for face recognition and MobileNetV2 for mask detection integrated into medical robot
  • Real-time face detection and tracking using Haarcascade classifiers and dlib correlation tracker for robotic vision
  • Intelligent face registration system with automated feature extraction and model retraining for robot user management
  • Arduino-integrated contactless temperature monitoring using MLX90614 infrared thermometer for robotic health screening
  • Automated mask dispensing system with stepper motor control and proximity sensor activation built into medical robot
  • Advanced mask detection using facial landmark detection and HSV color analysis for robotic compliance monitoring
  • Comprehensive attendance logging with Excel integration and timestamp tracking for medical robot operations
  • Multi-threaded architecture for concurrent video processing and hardware communication in robotic systems
  • Transfer learning implementation optimized for Asian facial features using Vietnamese celebrity dataset for medical robot
  • Intuitive Tkinter GUI with registration, monitoring, and control interfaces for medical robot operation
  • Real-time performance monitoring with face tracking confidence scores and blur detection for robotic vision systems
  • Configurable detection thresholds and automatic model updates for new user registration in medical robot database
Technologies
Python
TensorFlow
Keras
OpenCV
dlib
VGGFace2
MobileNetV2
Tkinter
Arduino
NumPy
scikit-learn
xlsxwriter