Dunkin

Decode provides realtime translation of foreign languages, plus transcription for the hearing impaired. You can overcome language barriers and be present in any situation.

Comment

Inspiration

We all have had the experience of being surrounded by a language that we did not understand and felt disconnected from our environment. We wanted to create an application that allows us to be present in foreign situations.

What it does

Our application captures ambient audio, translates it into the desired language, and displays the translation as visible text in the HoloLens. It can also be used as the transcriber only to help accessible experience for the hearing impairment group.

How we built it

We used the HoloLens, Unity, and Azure Cognitive Services - Speech. We used iterative development to try out new features, new UI components, and UX flow.

Challenges we ran into

Connectivity. Ambient noise. Lack of hardware. Overly ambitious goals. Unity errors.

Accomplishments that we're proud of

Language translation functionality works as expected.

What we learned

How to work cooperatively with a diverse, international team. How to reduce scope. How to prioritize tasks.

What's next for dunkin

Build the native application to HoloLens. Add more accessible functions like Text-to-Speech to help more groups. Refine our product.

Share this project:

Updates