KinectExtras with MsSDK is an extension of the Kinect with MS-SDK package. It provides additional examples and demos, based on Kinect SDK that are not directly related to transferring human motion onto digital characters. The package consists of Kinect Interaction demo presenting hand cursor control as well as hand grips and releases, Speech recognition example, Face-tracking example and Background-removal demo. It is possible to integrate all Kinect-related features in one project, i.e. to make KinectExtras and KinectManager (from ‘Kinect with MS-SDK’-package) work together.
This package is for Kinect v1 only. It supports 32-bit and 64-bit builds and can work in both Unity Pro and Unity Free editors.
Free for Education:
This package is free for academic use (i.e. for schools, universities, students and teachers). If you match this criterion, please contact me by e-mail to get the KinectExtras asset directly from me.
Unity 5.0 and later introduced an issue, which causes in many cases Kinect tracking to stop after 1-2 minutes with DeviceNotGenuine error. As a result you will see that the Kinect-enabled game freezes. There is no definite workaround yet. My advice is: If you encounter this issue, please install Unity 4.6 along with Unity 5 (just in another folder) and use the K1-assets in Unity 4 environment. See the updates here.
How to Run the Examples:
1. Download and install Kinect SDK 1.8 or Kinect Runtime 1.8 from here.
2. Download and import the KinectExtras-package.
3. Open and run the scene of your choice, as described in the corresponding Readme pdf-file, located in the Assets-folder.
How to integrate KinectExtras with KinectManager:
To integrate the KinectExtras with the KinectManager (from ‘Kinect with MS-SDK’-asset), do the following:
1. Open KinectScripts/KinectWrapper.cs and near its start uncomment: #define USE_KINECT_INTERACTION_OR_FACETRACKING.
2. To integrate Kinect speech recognition with the KinectManager as well, uncomment also: #define USE_SPEECH_RECOGNITION.
3. Open KinectScripts/InteractionWrapper.cs and near its start uncomment: #define USE_KINECT_MANAGER.
4. Open KinectScripts/FacetrackingWrapper.cs and near its start uncomment: #define USE_KINECT_MANAGER. If you plan to use face-tracking in the scene, don’t forget to enable the ‘Compute color map’-setting of KinectManager-component. It is needed for the face-tracking to work.
5. If you have uncommented ‘USE_SPEECH_RECOGNITION’, open KinectScripts/SpeechWrapper.cs and near its start uncomment: #define USE_KINECT_MANAGER.
6. Make sure that both KinectManager and the Extras’ managers, like the InteractionManager, FacetrackingManager or SpeechManager are components of the MainCamera (or other persistent game object).
7. Open KinectScripts/KinectManager.cs and at the start of its Awake()-method add this line: ‘WrapperTools.EnsureKinectWrapperPresence();’, in order to ensure the presence of the needed native libraries. Also, make sure that the Assets/Resources-folder from KinectExtras-package exists in your project.
8. If you use only the KinectManager-component (but not any of the KinectExtras-managers) in the scene, Open KinectScripts/KinectManager.cs and at the start of its Update()-method add this line: ‘KinectWrapper.UpdateKinectSensor();’. Normally, the KinectExtras-managers do that for you.
9. Run the scene to check if the integration works properly and without errors.
The official release of ‘KinectExtras with MsSDK’-package is available at Unity Asset Store.
The project’s Git-repository is located here. This repository is private and its access is limited to contributors only.
* If you get DllNotFoundException or other initialization errors, make sure you have installed the Kinect SDK 1.8 or Kinect Runtime 1.8.
* Kinect SDK 1.8 and tools (Windows-only) can be found here.
* The examples were tested with Kinect SDK 1.7 and 1.8.
* Here is a link to the project’s Unity forum: http://forum.unity3d.com/threads/222517-KinectExtras-with-MsSDK
What’s New in Version 1.8:
1. Added support for x32/x64 architecture at runtime.
2. Improved face tracking – fixed native routine responsible for skeleton selection.
3. Updated mouse cursor control to match the game window.
4. Updated speech error handling to display messages instead of error codes.
5. Renamed Extras-folder to Samples to match the respective folder of “Kinect with MS-SDK”
Playmaker Actions for ‘Kinect with MS-SDK’ and ‘KinectExtras with MsSDK’:
And here is “one more thing”: A great Unity-package for designers and developers using Playmaker, created by my good friend Jonathan O’Duffy from HitLab-Australia and his team of talented students. It contains many ready-to-use Playmaker actions for Kinect v1 and a lot of example scenes. The package integrates seamlessly with ‘Kinect with MS-SDK’ and ‘KinectExtras with MsSDK’-assets. I can only recommend it!