Connected devices, IOT are the main concepts behind this demo.
Using the camera from an IOS device, the user can point either to a smart lamp, or to the Hexa robot to invoke an action.
The smart lamp would simply turn on, but the robot is going to start writing IT DAYS
I have used ARCore for image and object detection.
These manually drawn patterns are used for image detection:
In order to control it, an API server is running on the robot, listening to a certain trigger (that comes from the tablet) to start writing a sentence. As an addition, there are also written a bunch of endpoints for manually controlling the robot (from a web interface)
The animations were made with a helper program called Hexa Simulator, and then imported as strings into the program
- Apple vision API
The Project was realised for the conference ITDAYS.