Home

Welcome to the MGT wiki!

1. BASICS

Matlab Environment

Musical Gestures Toolbox(MGT) requires Matlab 2015a environment or more recent. Matlab software is available on the website(www.mathworks.com). To install MGT is quite simple. Just add MGT in the Matlab path:

• In Matlab 2015a or more recent,on the Home tab, in the Environment section, click Set Path.

• In the new Set Path window,click on the second button Add with Subfolders.

• In the file browser,select the folder you downloaded and unzipped and click Open.Then click Save button. The addresses of the folder are added.

Introduction

Musical Gestures Toolbox is a Matlab toolbox which contains functions for the analysis and visualization of video, mocap, and audio data. Musical Gestures Toolbox integrates Mocap tool box and Mirtoolbox which aim for the analysis the motion capture data and audio or music input data respectively. So before using Musical Gestures Toolbox, make sure Mocap tool box and MIRtoolbox are correctly installed. Mocap tool box is available on the website(www.jyu.fi/music/coe/materials/mocaptoolbox). The URL of MIRtoolbox website is (www.jyu.fi/music/coe/materials/mirtoolbox). The steps of installation are the same as MGT above. To use all the functions in the MGT, Signal Processing Toolbox and Image Processing Toolbox are needed as well. The Musical Gestures Toolbox comes with no warranty. It is free software.

GENERAL

Functions

The Musical Gestures Toolbox contains a set of functions for the analysis and visualization of video, audio, and mocap data. There are four categories of functions:

• Data input and edit functions
• Data preprocessing functions
• Visualization functions
• Middle and higher level feature extraction functions

Data Structures

The Musical Gestures Toolbox uses only one struct data structure. This struct contains three fields,video,audio,mocap, which corresponds three types input data. A Musical Gestures data structure is created by the function mginitstruct. For instance:

mg=mginitstruct;

Then a struct mg is created with three fields. Here video field contains data and general parameters of video. Since this is a core part of Musical Gestures Toolbox, it will be introduced in detail. As for other two fields, audio and mocap,please refer to reference documentation respectively. Normally, the field video is a struct as well containing several fields. Data field stores each frame of the video. Gram field stores the information of horizontal and vertical motion gram. Motion field contains the motion information be- tween two successive frames. Qom field contains quantity of motion of each frame. Com field contains centroid of motion of each frame. Nframe field contains the number of the frames of the video. The framerate of video is stored in the field framerate. Usually, it is 30 frames per second. Duration field is for length of the video. Musical Gestures Toolbox uses two general methods to estimate the motion, one is motion gram, another is optical flow. The method field is used for the option of these two methods. Other two fields filename and path are for the name of video and path.