AutoCurious - Bosch MR Copilot

AutoCurious MR co-pilot from Bosch is an intuitive & intelligent solution that enables service technician to have all contextual information they need during vehicle diagnosis & repair on one device.

Comment 2

Inspiration

Automotive Industry is going through a transition with respect to electrification and autonomous driving, this is making the vehicle service complex and knowledge intensive. To re skill the traditional workforce and easily onboard new work force in vehicle service domain, XR (AR/VR/MR) can play a major role.

Bosch has been a major player in vehicle service industry for more than 50 years with a ocean of knowledge in Auto service documentation. We want to bring this documentation/knowledge using MR for service technicians to easily apply this in there day to day work.

What it does

To Transfer the complex technician information from traditional 2D static documents to Immersive and Interactive 3D documentation: We have built AutoCurious platform. The MR version of AutoCurious Contains 3 Main Modules that helps an Auto Technician to learn skills and work productively using Mixed Reality combined with strong domain knowledge.

Workshop Manual: 3D visual guidance of step-by-step instructions of how to remove and refit automotive system in the vehicle.

Explosion view: 3D interactive solution to disassemble and assemble (combine) sub parts inside a System. Any important knowledge base while training and understanding different sub parts of the system and their locations.

3D Wiring diagrams: Traditional documentation of Auto wiring diagrams are very difficult to comprehend. It demands a scientific mindset to understand and map to real world location of components and wiring routes. Our 3D solutions transform the usability by directly showing the locations and there wiring routes directly in 3D. The user can directly select the components/wiring routes and get them highlighted in the vehicle 3D. From our empirical tests with real users - this Module provides at least 80%+ productivity improvements compared to traditional 2D wiring diagrams.

The Solution listens to the audio commands by the service technician, if the users want to view the wiring diagrams of a particular system (he just asks with voice command). The intelligent voice recognition (using meta presense voice sdk) module understands the intent and loads the 3D wiring diagram of the vehicle in MR mode.

How we built it

We have a production grade solution 3D Solution built in Unity3D running on Tablet for Automotive service technicians. We ported it using Meta presense SDK to Quest-3 as a part of this Hackathon.

Challenges we ran into

We need to optimize the CAD models (100x times lower) to ensure we run smoothly in XR devices.

Accomplishments that we're proud of

We ported in the entire solution to MR in just 1 week, we are proud of our Design in Unity application (that helped us to port easily from Tablet to MR devices)

What we learned

Meta presense platform

What's next for AutoCurious - Bosch MR Copilot

Integration with our secured back end, User management, Pilot with real customer

Built With

Share this project:

Updates