Even though our aim was not to include the hand gesture into the prototype but I would like to attempt to get the basic knowledge and understanding of how this would work.
So after a number of research done, I decided to use processing application to operate this. The basic structure of how this would work is;
1.Kinect is a sensor input for Processing.
2.Kinect track the movement of skeleton structure and send in signal to Processing.
3.Processing draw out the line and present the line as an output.
4.Processing capture the point position of hand and send it as an input to Arduino.
5.Arduino receive an input from processing and send out the output to servo and motor.
After a lot of attempt to set up Kinect to work with my laptop I now can track the skeleton movement in Processing. With the limitation knowledge of coding skill, I still cannot send the point position as and input for Arduino. But this made me understand the process of how the coding and Kinect as a sensor would work.
How to code work is it capture the position of human joint as a point and draw up the line between point to pint resulting in the human skeleton. Each joint point can be identified the position on the screen. This position can be send as an output to Arduino. The image below is the processing capture the person who is sitting down and draw out the skeleton movement.
Image above show an error of the Kinect sensor that picked up the random structure and draw out the line as an skeleton structure.
Video from: http://www.youtube.com/watch?v=kfhkwBzzaHo
This is the video show the working skeletons tracking.
No comments:
Post a Comment