KINGS CRAFT

webapp landing page
webapp 3d library
mobile landing page
integrated image capture
mobile 3d library

Inspiration

Our inspiration stemmed from the vast potential of AI language models, which have been extremely popular. We wanted to venture into less-charted territory, specifically photogrammetry, to create something innovative and impactful. The idea of transforming simple photographs into 3D models came to mind and we aimed to bridge the gap between AI-driven image processing and practical applications in 3D printing.

What it does

KINGS CRAFT converts a simple image into a .obj file, which can be viewed in 3D and 3D printed. The process involves removing the background from the image and using AI to reconstruct and complete the object from the available visual data. This allows users to take a picture of an object and transform it into a detailed 3D model ready for printing.

How we built it

We built KINGS CRAFT using React JS with Vite for the web app frontend and React Native for the mobile app frontend. The backend is developed with Flask, utilizing a series of AI models. The first model processes the raw image to remove the background. The second model generates images of the object from different angles. The third model uses these multi-view images to form a 3D object, correcting discrepancies and converting it into a .obj file. For cloud storage, we integrated AWS S3, and for authentication, we used Firebase with Google sign-in.

Challenges we ran into

We initially started developing the mobile app in Swift but switched to React Native for better compatibility with our backend and APIs. Implementing Firebase Google authentication posed several bugs, especially in the mobile app. Displaying the 3D view of objects on the web app was challenging due to deprecated libraries and incompatibility with some npm packages. Integrating camera functionality into the mobile app was difficult due to numerous deprecations and dependency issues. Additionally, creating a seamless data structure for the web app's carousel was complex. We also faced firewall restrictions that prevented loading user data on mobile devices.

Accomplishments that we're proud of

We successfully implemented camera functionality, providing a smooth experience for users to take photos and convert them into .obj files. Both the mobile and web UIs are aesthetically pleasing and user-friendly. We resolved the firewall issue, allowing seamless use of mobile devices for data loading. Overall, we created a cohesive system where users can easily capture, transform, and 3D print objects.

What we learned

Jayden learned Swift, although he eventually created a scrumptious React Native app alongside Jerry, who mastered React Native and overcame the firewall problem. David created an attractive and functional website, enhancing the user experience. Kohen and David cooked together on the AI models, achieving high-quality 3D object reconstruction from a single image.

What's next for KINGS CRAFT

Our future plans include fully implementing authentication in the mobile app and developing an enhanced 3D object viewer for both the web and mobile apps. We aim to improve the overall user experience and explore additional features to make the process even more intuitive and powerful.