NIT-K Internship Project 2026

Developed under the initiative: "Creating Awareness in the Field of Artificial Intelligence through Hands-on Activities for Secondary School Children in Selected Districts of Karnataka, Kerala and Tamil Nadu."

Meet Whisper-bot

An offline, autonomous robotic system combining local Speech-to-Text (STT), Semantic Intent Classification, Local RAG Q&A using a Small Language Model (SLM), Computer Vision, an interactive LeNet-5 CNN visualizer, and smart Bluetooth Audio connectivity.

Core Capabilities

Whisper-bot combines computer vision and natural language processing for intelligent interaction

Face Detection

Advanced facial recognition with real-time detection and identification of multiple faces simultaneously

Instant Face Learning

Rapidly learns and remembers new faces with minimal training samples for personalized recognition

Natural Language Understanding and Instant Learning

Intelligent voice command processing with contextual understanding and semantic analysis. Learns new sentences instantly and applies it in real-time.

Object Detection & Tracking

Real-time identification and precise tracking of objects with continuous spatial awareness

LeNet-5 CNN Digit Visualizer

Interactive character recognition exposing intermediate layer topology (Input [28x28], Conv1 activations [8x24x24], Pool1 [8x12x12], Conv2 [16x8x8], Pool2 [16x4x4]) and 16x16 Fully Connected weight mapping (256 dense inputs to 10 logits).

Technical Specifications

Powered by advanced AI processors and precision sensors for real-time vision and voice processing

Processor

  • Raspberry Pi 4B
  • BCM2711B0 64-bit 4 cores
  • 4GB RAM

Controller

  • ESP32 DOWDQ6-v3
  • RT9166A-12/28PXL power chip
  • INA219 voltage monitor IC

Sensors

  • 5MP wide angle camera
  • ICM20948 9-axis sensor
  • Gyroscope & Accelerometer

Materials

  • Aluminium alloy body
  • PA12 nylon side panel
  • Durable construction

AI Capabilities

  • Face detection & recognition
  • Colour detection & tracking
  • Voice command processing
  • NLP Processing and Semantic Vector search

Power & Connectivity

  • USB-C charging
  • WiFi enabled
  • Bluetooth support
  • IPEX Antenna
  • 18650 Li-ion Supply

Preview Pics

Product Visual Looks

Product Visual Looks

Motor Connection with ESP32-DOWDQ6

Motor Connection with ESP32-DOWDQ6

weight visualization of conv layer

weight visualization of conv layer

neural network and neuron firing visulization with digit recognition

neural network and neuron firing visulization with digit recognition

Robot in Action

Robot in Action

Web Interface

Web Interface

Interactive chat interface

Interactive chat interface

System Architecture

System Architecture

Control Dashboard

Control Dashboard

Hardware Versions

Whisper-bot hardware platforms for different use cases and deployment scenarios

Open Source WaveGo Bionic Dog
Pre-designed & Assembled

v1.0

Open Source WaveGo Bionic Dog

  • ESP32-based microcontroller
  • Bionic dog-like body structure
  • Motion control and servos
  • Open source hardware design
Raspberry Pi 4B Edge AI System
Custom Built Software & Architecture

v1.2

Raspberry Pi 4B Edge AI System

  • Raspberry Pi 4B processor
  • Real-time AI inference
  • Advanced computer vision
  • Edge computing capabilities