EducationalXR

Inspiration

Since more and more learning resources are going online these days, like the MIT openLearning, Coursera, etc. They all provide a solid static content. which means the persons watching the videos live stream cannot interact with the class or the teacher we want to bring back the interactive experience of this classrooms to that of the online teaching. So the major flaw in the online teaching is it misses the interactive experience between the student and the teacher.

What it does

It's an AR based education platform for educators and students with real time Multiplayer networking and interactive sessions between them. The teacher can record the lectures and the students can access them later. A new feature is that AR Live Streaming where the 3D holographic of the teacher can be seen from anywhere in the world by people connected to that server.

How we built it

We built it using the unity, normcore, and nreal's sdk. We had used the Microsoft's Kinect for the body tracking and recording. We had used the ipi soft to capture the kinect's image and to map it to an avatar.

Challenges we ran into

Accomplishments that we're proud of

we able to make the multiplayer thing workout, so by this multiple students can be instructed simultaneously by the teacher with her laptop, and the students can visualize the experience in the nreal headsets. We are able to extract the body movement, tracking feature for the Microsoft kinect and successfully be able to map it to an avatar, which can be given an audio to explain about the scenarios. We had created three sample scenes namely, solar system, anatomy of brain, and art to illustrate the working of our project.

What we learned

We learnt about the NReal's sdk and how to integrate the functionalities we need. The major difficulty came when we were trying to network two of these headsets and make them operate in the same state as in sync. So these are going to be our students.