MHacks 2025
Snap-Shot
Voice-guided campus navigation on Snap Spectacles for blind and visually impaired students, with real-time directions and obstacle detection.
The video loads from YouTube when you press play.
What we built
Team of 4. I owned testing, logistics, and the presentation.
- Turns Snap Spectacles into an audio guide: the user says a destination and the glasses give continuous step-by-step directions.
- Pulls campus map and GPS data from the Google Places API, while computer vision on the glasses detects obstacles and the heading to follow.
- Designed for minimal speech input, so guidance is proactive instead of waiting for the user to ask.
- Built a working demo that guided users between campus buildings, though sending image data to Gemini was unreliable in testing.
