1 MATLAB Based Interactive Music Player using XBOX Kinect EN.600.461 Final Project MATLAB Based Interactive Music Player using XBOX Kinect Gowtham G. Piyush R. Ashish K. (ggarime1, proutra1, akumar34)@jhu.edu Johns Hopkins University, Baltimore, USA 1. Abstract The launch of XBOX Kinect opened exciting new avenues for 3D perception due to its easy to use, out-of-the-box depth and color video. Applications spectra seem to be widening over a series of software and hardware. We have all come across Music Players in our day to day life. Various methods of accessing these music interfaces exist but again, easier methods to access the same are always desirable. In this project, we create a gesture based 3D user interface for playing audio from a MATLAB based graphic user interface. Multiple object based background is assumed as the environment and hand detection over them activates processing of data. On detecting a gesture over a particular area in the foreground, corresponding functionality in the GUI is activated. As per the gesture of the user, for which the system was already trained, the music player responds promptly. The setup was tested over a set of saved images as well as in real-time from a Kinect Sensor images. The results varied over different operating systems as discussed later, but were satisfying and as desired. 2. Aims of the Project The aims we could see before the start of the project were: 2.1 Choice of environment for camera view. We assumed the camera view to be top down so as to emphasize on capabilities of Kinect sensor over other general cameras that provide us with only 2D image of the objects. However, Kinect has its own limitations and doesn’t give desired images within a very close range of its view. To be properly detected, an object has to be present at least 0.5metres away from the camera sensors [1]. 2.2 Identification of marker objects in real world. It was thought to be preferable to have some objects which correspond to buttons in the music player. Having predefined marker objects makes it easier for users other than the programmer to access the music player. Detection of these objects while start of the setup is desirable. 2.3 Background subtraction and filtering of noise. One of the aims of the project is to be able to identify dynamic objects and remove background or static objects. This would allow us to reduce the clutter in the image and focus on the objects of interest such as hand gestures which are dynamic. 2.4 Gesture recognition. Detecting and differentiating between gestures would reduce the need for more marker objects. Also it would be further efficient use of the Kinect sensor. 2.5 Music Player development. We feel a music player which is not as complex as the commercially available ones should be better for testing purpose of our project as it is more inclined towards the computer vision part. However, we desired to develop a music player
10
Embed
MATLAB Based Interactive Music Player using XBOX Kinectrpiyush/documents/piyush_Fall2012.pdf · EN.600.461 Final Project MATLAB Based Interactive Music Player using XBOX Kinect Gowtham
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1 MATLAB Based Interactive Music Player using XBOX Kinect EN.600.461 Final Project
MATLAB Based Interactive Music Player using XBOX Kinect
Gowtham G. Piyush R. Ashish K.
(ggarime1, proutra1, akumar34)@jhu.edu
Johns Hopkins University, Baltimore, USA
1. Abstract The launch of XBOX Kinect opened exciting new avenues for 3D perception due to its easy to
use, out-of-the-box depth and color video. Applications spectra seem to be widening over a
series of software and hardware. We have all come across Music Players in our day to day life.
Various methods of accessing these music interfaces exist but again, easier methods to access the
same are always desirable. In this project, we create a gesture based 3D user interface for playing
audio from a MATLAB based graphic user interface. Multiple object based background is
assumed as the environment and hand detection over them activates processing of data. On
detecting a gesture over a particular area in the foreground, corresponding functionality in the
GUI is activated. As per the gesture of the user, for which the system was already trained, the
music player responds promptly. The setup was tested over a set of saved images as well as in
real-time from a Kinect Sensor images. The results varied over different operating systems as
discussed later, but were satisfying and as desired.
2. Aims of the Project The aims we could see before the start of the project were:
2.1 Choice of environment for camera view. We assumed the camera view to be top down so
as to emphasize on capabilities of Kinect sensor over other general cameras that provide us with
only 2D image of the objects. However, Kinect has its own limitations and doesn’t give desired
images within a very close range of its view. To be properly detected, an object has to be present
at least 0.5metres away from the camera sensors [1].
2.2 Identification of marker objects in real world. It was thought to be preferable to have
some objects which correspond to buttons in the music player. Having predefined marker objects
makes it easier for users other than the programmer to access the music player. Detection of
these objects while start of the setup is desirable.
2.3 Background subtraction and filtering of noise. One of the aims of the project is to be able
to identify dynamic objects and remove background or static objects. This would allow us to
reduce the clutter in the image and focus on the objects of interest such as hand gestures which
are dynamic.
2.4 Gesture recognition. Detecting and differentiating between gestures would reduce the
need for more marker objects. Also it would be further efficient use of the Kinect sensor.
2.5 Music Player development. We feel a music player which is not as complex as the
commercially available ones should be better for testing purpose of our project as it is more
inclined towards the computer vision part. However, we desired to develop a music player