Using the Kinect & LeapMotion

To use a sensor such as the Kinect, you just have to plug it and activate the Kinect addon from Preferences/Addons, then relaunch Millumin. If it is the first time that you use a Kinect with Millumin, it will ask you to download dependency files. Kinect 1 and 2 are supported. Be aware that Kinect 2 requires a USB 3.0 to work properly.
If you have a LeapMotion, you have to install its driver first from here.

Important :

• The LeapMotion is supported on both Intel and Apple Silicon machines.
  Kinect devices are also supported on both Intel and Apple Silicon machines but the Rosetta translator has to be installed : if this is not the case, Millumin will offer to do so.
• Because of a technical limitation on the USB ports, the Kinect V1 (for Xbox 360) cannot work on the MacPro 2013 (black cylinder). The Kinect V2 (for Xbox One) is however working.
• Sometimes, the Kinect could be a little capricious, and the device not be recognized by the computer. To handle this problem, just let the Kinect USB port plugged, then unplug/plug its electric outlet. It will reset the Kinect, and it should solve the problem.

Skeleton Interactions

Creating an interaction for a Kinect or a LeapMotion works the same way in Millumin. Open the interaction panel (CMD+M) :

Like any other interactive device, select the green-highlighted property you want to control.
Then, go in front of your device. If your are detected by the Kinect or the Leapmotion, Millumin will list all the received inputs. So, if your hand is detected by a LeapMotion, you could choose the part of your hand that will control the selected property :

In the interaction panel, you can configure your input.
For example, if it is a LeapMotion, you can choose to track the left or right hand, and which part of this hand, or its orientation.
You also can select the tracked axis : x (horizontal), y (vertical) or z (depth).
Note that, in the skeleton view, the tracked bone is colored in red :

Don't forget to calibrate your interaction if needed. More info in this article : Interactions

Kinect Mask

If you are using a Kinect, you also can use it as a mask. Indeed, you can find a media called KinectMask in your library. Just drag and drop it in your dashboard to play it as a camera :

With the media KinectMask, you can switch between different mode :
- Image : display the Kinect's color channel
- Depth : display the Kinect's depth channel
- Mask : to create a mask based on the depth channel

Of course, you can use blending mode alpha matte to create a mask for the layer below :

Lastly, you can use the user mode to automatically create a mask on the detected user :