David Knight
Title
Background
Introduction
The most recent generation of video game consoles have brought with them new user input devices that read a user's body posture and motion. One such device is the Microsoft Kinect, which is equipped with both a color camera and an infrared depth sensing system. The depth data sensed by the Kinect aids computer vision tasks such as segmentation or skeletal fitting and pose estimation. However, the spatial coarseness of the depth data makes it difficult to extract detailed information about extremities like the hands when the user is not inconveniently close to the sensor. This project aims to use the color data returned from the Kinect in conjunction with the depth data to segment skin regions out of hand images. Extracting accurate skin regions around the hands from Kinect data would be a step towards building a system that uses the Kinect to recognize hand gestures.
Data
The image data set was output from a skeletal fitting and cropping pipeline previously created by Hendrik Dahlkamp and Christian Plagemann. The Kinect produces 640 x 480 pixel images before the skeletal fitting and cropping stage. An image sequence of 561 frames was gathered indoors with the test subject standing three meters away from the Kinect. Hands are roughly centered in all the images, and the images are 64 x 64 pixels in size with four 8-bit channels comprised of red, green, blue, and depth data. The depth channel is calebrated such that the hand depth is centered about level 127 out of 255, and each level represents 3mm.
Methods
content
Results
content
Conclusions
content
References
- C. Tomasi, R. Manduchi. "Bilateral Filtering for Gray and Color Images." In Proceedings of the IEEE International Conference on Computer Vision, 1998, pp. 839.
- D. Lanman. "Bilateral Filtering." Internet: http://www.mathworks.com/matlabcentral/fileexchange/12191, 6 September 2006 [19 February 2011].
- "Graphic Technology - Standard object colour spectra database for colour reproduction evaluation." International Standards Organization, Geneva, Switzerland, ISO/TR 16066:2003(E), 2003.
- M. J. Jones, J. M. Rehg. "Statistical Color Models with Application to Skin Detection." International Journal of Computer Vision, vol. 46, pp. 81-96, 2002.
- N. Otsu. "A threshold selection method from gray-level histograms." IEEE Transactions on Systems, Man and Cybernetics, vol. 9, pp. 62-66, January 1979.
Appendix I
content
Acknowledgements
content