Using the Kinect & LeapMotion
To use a sensor such as the Kinect, you just have to plug it, then launch Millumin. If it is the first time that you use a Kinect with Millumin, it will ask you to download dependency files.
If you have a LeapMotion, you have to install its driver first from here.
As an experimental feature, Millumin also supports the Kinect V2 (for Xbox One) : to test it, be sure to activate it from
Addons. This model requires an USB 3 port to work.
- The library for the Kinect and LeapMotion are not available for Apple M1/M2 machines. To use it on these machines, please run Millumin via Rosetta (Intel emulation).
- Because of a technical limitation on the USB ports, the Kinect V1 (for Xbox 360) cannot work on the MacPro 2013 (black cylinder). The Kinect V2 (for Xbox One) is however working.
- Sometimes, the Kinect could be a little capricious, and the device not be recognized by the computer. To handle this problem, just let the Kinect USB port plugged, then unplug/plug its electric outlet. It will reset the Kinect, and it should solve the problem.
Creating an interaction for a Kinect or a LeapMotion works the same way in Millumin. Open the interaction panel (
Like any other interactive device, select the green-highlighted property you want to control.
Then, go in front of your device. If your are detected by the Kinect or the Leapmotion, Millumin will list all the received inputs. So, if your hand is detected by a LeapMotion, you could choose the part of your hand that will control the selected property :
In the interaction panel, you can configure your input.
For example, if it is a LeapMotion, you can choose to track the left or right hand, and which part of this hand, or its orientation.
You also can select the tracked axis :
y (vertical) or
Note that, in the skeleton view, the tracked bone is colored in red :
Don't forget to calibrate your interaction if needed. More info in this article : Interactions
If you are using a Kinect, you also can use it as a mask. Indeed, you can find a media called
KinectMask in your library. Just drag and drop it in your dashboard to play it as a camera :
With the media
KinectMask, you can switch between different mode :
- Image : display the Kinect's color channel
- Depth : display the Kinect's depth channel
- Mask : to create a mask based on the depth channel
Of course, you can use blending mode
alpha matte to create a mask for the layer below :
Lastly, you can use the
user mode to automatically create a mask on the detected user :