Personalized Learning AI Goggles For Old Age People

Trinetra is a personalized learning AI headgear for old age people, More commonly we see old age people forget to take medicines on time due to forgetfulness, Struggle to memorize things.

Comment

Inspiration

Personalized Assistant for Old Age People: Old age person often need helps for day to day life activities, one challenge I seen with them is medicine reminders, they often missed it due to forgetfulness, so AI assistance help to create notification like Audio alarms for reminders.

Personalized Learning Device for Slow Learners: Personalized learning is innovative way to learn educational stuff, more often students with low confidence levels do not dare to ask questions, so our device could help to snap and record the sessions and recall those task at comfortable place with help to do homework's or understanding the concept in more details.

What it does

We named our AI goggles as Trinetra means Third Eye. Trinetra has capability to snap photos , record videos session wise. This session gets stored in databases. User can interact with stored information using multimodal RAG and Audio chatbot system which use for Question Answer session. User can recall the sessions and add more information to it.

How we built it

Trinetra is based on ARM Cortex A53 processor with low power requirements along with following features

  1. 16 Megapixel autofocus stereo camera
  2. HD microphone for Audio Chatbot
  3. Capacitive touch sensor for capturing the snapshot and record the videos
  4. 5000mah power battery to run device for long time
  5. 128GB storage for saving abundance amount of data
  6. Google cloud services like Cloud Functions, AlloyDB, Vertex AI (Multimodal RAG)

Challenges we ran into

  1. Hardware development is bit challenging due to lots of electrical constraints.
  2. Software architecture and Cloud services choosing was challenging at the beginning of project.
  3. Ergonomic design that easy to wear for long time.

Accomplishments that we're proud of

  • Trio of Hardware, Software & Cloud is great. We have accomplished our goal effectively because of Google Cloud Services.
  • Because of cloud based LLM & Multimodal RAG our computational power saved tremendously.
  • Results in great battery life for the device.

What we learned

  • Low code programs with same effectives like full fledge application.

What's next for Personalized Learning AI Goggles

  • We wants Trinetra would be part each individual for daily tasks. Especially for Old age individual which usually struggles to read, take medicines, follow the Road paths etc.
  • Slow learners is no more slow they also improve productivity and learning capabilities.
  • Famers is now empowered with AI vision friends which helps him to understand whatever info he want.
  • In future Trinetra also able to search Web with just voice commands and give relevant information to the Users.
  • Moreover the Android/IOS App will help them to see the Trinetra interactions and Live sessions.
  • Results will be Images and Videos along with embedding Text.

Built With

Share this project:

Updates