Inspiration
Interruption of blood flow caused by stroke results in vision loss in an estimated 80% of patients worldwide. Stroke patients suffer from visual field issues, eye movement abnormalities, visual processing disorders that often result in mobility issues and a reduced quality of life. Standard approaches for vision rehabilitation in stroke patients depend on the use of paper-based tests (e.g. Visual Scanning and Search Tasks) and self-reported outcomes which are generic and subject to confirmation bias when performed in clinics. Stroke Sii is a system which uses augmented reality to generate virtual vision rehabilitation therapy that can be performed remotely, with improved accuracy and reduced risk of confirmation bias - with the added benefit of collecting large volumes of data in real time. Leveraging this feature, it is possible that analytics be performed to extract parameters not conventionally assessed thus illuminating other, unforeseen visual deficits which could be addressed using patient-specific training exercises (e.g. using Machine Learning) and promote improved patient outcomes. Overall, we believe Stroke Sii is a promising alternative to standard post-stroke vision rehabilitation. Recent studies suggest digital health systems improve accessibility and patient compliance. With this in mind, we wish to implement Stroke Sii with the goal of helping patients overcome the devastating impacts of stroke in their lives in ways existing approaches cannot.
What it Does
Stroke Sii presents rendered objects on Hololens and prompts the user to engage with the objects. In the future, we would like to collect vision performance metrics and perform analytics to merge with the clinic and inform patient rehabilitation .
How we Built it and Challenges
We started with ideas related to healthcare and started looking at Stereokit API and Hololens SDK. We encountered a range of problems including the limited API documentation in Stereokit, unfamiliarity with new APIs and SDKs.
Accomplishments that we're proud of
We were excited to implement HoloLens into our hack and explore the applicability of this device for a clinical-type problem. Our team was pretty diverse - a CS major and a medical scientist, so not surprisingly; we learned from each other and developed an idea that we were both passionate about. The medical scientist learned about HoloLens for the first time (and was totally excited about it!) and the CS major got a taste of cardiovascular disease (e.g. stroke) terms and medical literature. We had an amazing experience at CalHacks 9 and hope to return next year !
What's next for Stroke Sii
We would like to refine our code, debug, and add an algorithm(s) that incorporates AI/ML to generate patient-specific vision rehabilitation exercises. Ideally this could be supervised by a physician; which would require implementation of a strong data display and UI. We could also add voice prompts into Stroke Sii to reinforce user engagement. To validate Stroke Sii, we would like to compare its efficacy compared to standard vision rehabilitation in a clinical trial. If successful, Stroke Sii would then require endorsement from industry/clinical partners. We could also apply Stroke Sii to other brain/vision disorders such as those arising from traumatic brain injury (TBI). This is just the start for Stroke Sii.
Built With
- c#
- figma
- microsoft-hololens
- openai
- stereokit
Log in or sign up for Devpost to join the conversation.