The avatar-demo scenes show how to utilize user-controlled avatars in your scenes, gesture demo – how to use discrete and continuous gestures in your projects, fitting room demos – how to overlay or blend the user’s body with virtual models, background removal demo – how to display user silhouettes on virtual background, etc. Short descriptions of all demo-scenes are available in the online documentation.
This package works with plain web cameras and video clips that can be played with Unity video player. It can be used in all versions of Unity – Free, Plus & Pro.
How to run the demo scenes:
1. Create a new Unity project (Unity 6.0 or later, as required by the ‘Sentis’ package).
2. Open ‘Window / Package Manager’ in Unity editor, go to ‘Unity Registry’ and install the ‘Sentis’-package. This is the Unity package for AI model inference.
3. Open ‘File / Build settings’ and make sure that Windows, macOS or Linux is the currently active platform.
4. Open and run a demo scene of your choice from a subfolder of the ‘ComputerVisionExamples/DemoScenes’-folder. Short descriptions of all demo-scenes are available in the online documentation.
Current limitations:
1. Because of the intensive GPU utilization, please avoid using the CVE-package on mobile platforms. The performance is not good enough, and the device may overheat.
2. Please don’t use the CVE-package on WebGL platform.
Downloads:
* Computer Vision Examples (Lite) can be downloaded from Unity Asset store.
One request:
Please don’t share this package or its demo scenes in source form with others, or as part of public repositories, without my explicit consent.
Documentation:
* The basic documentation is in the Readme-pdf file, in the package.
* The online documentation is available here
Troubleshooting:
* Don’t expect everything to be perfect. If you get any issues or errors, please contact me to report the issues.
* If you get errors in console, like ‘Texture2D’ does not contain a definition for ‘LoadImage’ or ‘Texture2D’ does not contain a definition for ‘EncodeToJPG’, please open the Package Manager, select ‘Built-in packages’ and enable ‘Image conversion’ and ‘Physics 2D’ packages.
What’s New in Version 1.7.x:
1. Upgraded CVE-package to Unity 6.0; Upgraded Sentis to InferenceEngine.
2. Upgraded core stream providers to v1.7. Fixed issues in various sync modes.
3. Updated background removal demo scenes to detect multiple users.
4. (1.7.1) Fixed bugs that appeared in the latest revisions of Unity 6.x.
Videos worth more than 1000 words:
User motion tracking in a video and its retargeting on 3d avatar(s), with the help of ‘Computer Vision Examples for Unity’. The same can be applied to live webcam capture.
User segmentation (background removal) in a video, with the help of ‘Computer vision examples for Unity’. The same can be applied to live webcam capture.
Point cloud (scene mesh) of a video recording. The camera moves slightly left and right, to increase spatial perception. The same can be applied to live webcam capture.
