Artverse: The Santoor

Artverse: A Playable Santoor in Mixed Reality Inspiration

A team brainstorming session sparked the idea for Artverse. We were intrigued by mixed reality's (MR) potential to bridge the physical and digital worlds. We aimed for a project showcasing this technology while celebrating a rich cultural aspect – music. The captivating Indian string instrument, the santoor, emerged as the perfect subject.

What it Does

Artverse utilizes the Meta MR development toolkit within the Unity engine to create an interactive, playable santoor model. This meticulously crafted 3D model, built in Blender, can be placed virtually anywhere in the real world through a compatible MR headset. Users can then interact with the virtual santoor, plucking its strings to produce realistic sounds. This allows anyone, regardless of musical background, to explore the beauty and complexity of the instrument in an immersive way.

How We Built It

Initial development involved extensive research on the santoor's design and playing techniques. We then meticulously constructed a detailed 3D model in Blender, focusing on both visual and structural accuracy. Integrating the model with the Unity engine and the Meta MR toolkit presented a unique challenge, requiring us to bridge the gap between the virtual instrument and the user's physical interaction in the real world. Scripting and programming were crucial in translating hand movements into sound production, creating a functional playing experience.

Challenges Presented

Optimizing the 3D model for real-time rendering within the MR environment was a significant hurdle. Balancing visual fidelity with performance was a delicate task. Additionally, ensuring accurate sound generation based on user interaction – particularly replicating the nuanced plucking techniques of the santoor – demanded meticulous programming and testing.

Learning Curve

Artverse proved to be a valuable learning experience. We honed our skills in 3D modeling, game development with Unity, and the intricacies of MR technology. Importantly, we explored the potential of technology to create accessible musical experiences that connect people across cultures.

Future of Artverse

Artverse lays the groundwork for future development. We envision expanding the project to include other instruments from various cultures, potentially fostering a virtual orchestra within the mixed reality realm. While the initial focus was on user interaction, future iterations may incorporate educational elements, allowing users to delve deeper into the history, playing techniques, and cultural significance of each instrument. Ultimately, Artverse aspires to be a gateway to a world of music appreciation and exploration, accessible to all.