Developed under the initiative: "Creating Awareness in the Field of Artificial Intelligence through Hands-on Activities for Secondary School Children in Selected Districts of Karnataka, Kerala and Tamil Nadu."
Meet Whisper-bot
An offline, autonomous robotic system combining local Speech-to-Text (STT), Semantic Intent Classification, Local RAG Q&A using a Small Language Model (SLM), Computer Vision, an interactive LeNet-5 CNN visualizer, and smart Bluetooth Audio connectivity.
Core Capabilities
Whisper-bot combines computer vision and natural language processing for intelligent interaction
Face Detection
Advanced facial recognition with real-time detection and identification of multiple faces simultaneously
Instant Face Learning
Rapidly learns and remembers new faces with minimal training samples for personalized recognition
Natural Language Understanding and Instant Learning
Intelligent voice command processing with contextual understanding and semantic analysis. Learns new sentences instantly and applies it in real-time.
Object Detection & Tracking
Real-time identification and precise tracking of objects with continuous spatial awareness
LeNet-5 CNN Digit Visualizer
Interactive character recognition exposing intermediate layer topology (Input [28x28], Conv1 activations [8x24x24], Pool1 [8x12x12], Conv2 [16x8x8], Pool2 [16x4x4]) and 16x16 Fully Connected weight mapping (256 dense inputs to 10 logits).
Technical Specifications
Powered by advanced AI processors and precision sensors for real-time vision and voice processing
Processor
- •Raspberry Pi 4B
- •BCM2711B0 64-bit 4 cores
- •4GB RAM
Controller
- •ESP32 DOWDQ6-v3
- •RT9166A-12/28PXL power chip
- •INA219 voltage monitor IC
Sensors
- •5MP wide angle camera
- •ICM20948 9-axis sensor
- •Gyroscope & Accelerometer
Materials
- •Aluminium alloy body
- •PA12 nylon side panel
- •Durable construction
AI Capabilities
- •Face detection & recognition
- •Colour detection & tracking
- •Voice command processing
- •NLP Processing and Semantic Vector search
Power & Connectivity
- •USB-C charging
- •WiFi enabled
- •Bluetooth support
- •IPEX Antenna
- •18650 Li-ion Supply
Preview Pics

Product Visual Looks

Motor Connection with ESP32-DOWDQ6

weight visualization of conv layer

neural network and neuron firing visulization with digit recognition

Robot in Action

Web Interface

Interactive chat interface

System Architecture

Control Dashboard
Hardware Versions
Whisper-bot hardware platforms for different use cases and deployment scenarios

v1.0
Open Source WaveGo Bionic Dog
- ▸ESP32-based microcontroller
- ▸Bionic dog-like body structure
- ▸Motion control and servos
- ▸Open source hardware design

v1.2
Raspberry Pi 4B Edge AI System
- ▸Raspberry Pi 4B processor
- ▸Real-time AI inference
- ▸Advanced computer vision
- ▸Edge computing capabilities