Using the Kinect & LeapMotion

To use a sensor such as the Kinect, you just have to plug it, then launch Millumin. If it is the first time that you use a Kinect with Millumin, it will ask you to download dependency files.
 If you have a LeapMotion, you have to install its driver first from here.

As an experimental feature, Millumin also supports the Kinect V2 (for Xbox One) : to test it, be sure to activate it from Preferences/Addons. This model requires an USB 3 port to work.

Important :

• The library for the Kinect are not available for Apple Silicon machines. To use it on these machines, please run Millumin via Rosetta (Intel emulation).
   The LeapMotion is supported on both Intel and Apple Silicon machines.
• Because of a technical limitation on the USB ports, the Kinect V1 (for Xbox 360) cannot work on the MacPro 2013 (black cylinder). The Kinect V2 (for Xbox One) is however working.
• Sometimes, the Kinect could be a little capricious, and the device not be recognized by the computer. To handle this problem, just let the Kinect USB port plugged, then unplug/plug its electric outlet. It will reset the Kinect, and it should solve the problem.

Skeleton Interactions

Creating an interaction for a Kinect or a LeapMotion works the same way in Millumin. Open the interaction panel (CMD+M) :

Like any other interactive device, select the green-highlighted property you want to control.
 Then, go in front of your device. If your are detected by the Kinect or the Leapmotion, Millumin will list all the received inputs. So, if your hand is detected by a LeapMotion, you could choose the part of your hand that will control the selected property :

In the interaction panel, you can configure your input.
 For example, if it is a LeapMotion, you can choose to track the left or right hand, and which part of this hand, or its orientation.
 You also can select the tracked axis : x (horizontal), y (vertical) or z (depth).
 Note that, in the skeleton view, the tracked bone is colored in red :

Don't forget to calibrate your interaction if needed. More info in this article : Interactions

Kinect Mask

If you are using a Kinect, you also can use it as a mask. Indeed, you can find a media called KinectMask in your library. Just drag and drop it in your dashboard to play it as a camera :

With the media KinectMask, you can switch between different mode :
 - Image : display the Kinect's color channel
 - Depth : display the Kinect's depth channel
 - Mask : to create a mask based on the depth channel

Of course, you can use blending mode alpha matte to create a mask for the layer below :

Lastly, you can use the user mode to automatically create a mask on the detected user :