HackEyes

The camera and printed 3D arm!
Pau using Leap motion and Google Cardboard to controll the robot!
The robot car!
The streaming viewer that we have developed for android!

Inspiration

As it was a long 36 hours hackathon, we wanted to develop a product where we can learn and have fun using different technologies. But a point we have it clear from the begining, is that we also wanted to make a prototype that it's idea could be useful.

What it does

HackEyes is a robot car controlled by air gestures. The user can also see throw Google Cardboard a first person view that it is connected into a camera that the car has.

When the user rotates his head it moves the camera that it is installed on the car, so it gives the illusion to be driving in real person the car.

How I built it

First of all, we decided the technology to use, plan how we were going to work and printed the robot arm.

Then we started building a custom Google Cardboard viewer so we could reproduce video simultaneously in both parts of the screen.

The following step was to transmit video from the Raspberry Pi into that player, adapting it to accept livestream connection.

Next thing to do was programming the movement of the camera attached to the device building a rest api with flask, so the servos move together with the camera.

To finish, we connected Leap Motion to the Raspberry via a rest service and constructed the robot.

Challenges I ran into

First of all, we thought about building the prototype with a phone attatched to the robot, but the robotic arm printed as not strong enough to support it. In that case, we decided to run to buy a smaller camera that we could program.

Our second problem came with the connection via streaming. We spend almost 10 consecutive hours trying to fix this bug.

The third challenge we had is that we didn't sleep so much.