We are excited to announce our latest Body Tracking SDK update with you! Here’s what’s new in version 5.5.
1) Dynamic smoothing
Providing smooth and reliable data has been a significant challenge for Computer Vision apps. Traditional smoothing methods only calculate the average value of a set of frames, making it hard to adapt to fast movements. Also, the higher the smoothing factor, the slower the apps become. To solve these problems, we developed a new smoothing approach called Dynamic Smoothing.
Dynamic smoothing works in real time and excels in super-fast and super-slow movements. Moreover, it uses 90% less memory compared to legacy smoothing.
To enable Dynamic Smoothing, set the SmoothingType property of your Sensor instance to Dynamic:
sensor.SmoothingType = SmoothingType.Dynamic;
In Unity, you can also toggle SmoothingType directly in the Editor:
Legacy smoothing is still the default option, so you can safely experiment with Dynamic smoothing and see if it fits your use case well.
2) Privacy: hide faces
We take privacy seriously. Sometimes, when recording videos, companies should not store people’s faces. So, we’ve made it easier for you to comply with US and international laws by hiding people’s faces programmatically.
There are two discrete components:
1) A user-interface element that overlays a rectangle on top of the users’ faces. This feature leaves the color data unchanged.
To activate it, go to the Skeleton Manager and check Hide Faces.
2) A video recording setting that entirely removes faces from the stored video files. This feature modifies the color data and replaces human faces with black pixels.
To enable it, go to the video recording settings and check Hide Faces.
3) Multicamera support
Our software now has the ability to process data from multiple cameras and input streams simultaneously, generating accurate skeleton data from all of them. Our focus on performance has truly paid off, and we are excited to see how this new feature will help developers achieve even greater things.
Mixing different sensor types is also possible — for example, you can use a RealSense and an OAK-D camera simultaneously to compare their results!
Multicamera support works on macOS, Linux, and Windows. Check the new SDK samples to see this feature in action.
4) New depth cameras
OAK-D support for Mac and Linux
We strongly believe that depth perception is crucial for AI applications. As part of our ongoing commitment to stereo depth cameras, we are pleased to announce that we now support the OAK-D family on all major desktop operating systems, including macOS and Ubuntu Linux.
RealSense D457, D455f, D435f, D435if
Intel has released four new RealSense models over the past few months, so the LightBuzz SDK now supports D457, D455f, D435f, and D435if cameras.
- D457 is a waterproof version of D455, which also works with 15-meter (50 feet) long cables.
- D455f, D435f, and D435if have a new IR pass filter. This filter enhances the quality of depth in scenes with repetitive patterns and reduces the appearance of reflections.
It’s highly recommended to update the firmware of your devices to its latest version using the official RealSense Viewer app or RealSense FW Update tool.
5) Android boost
Our team continues to prioritize both accuracy and performance. In version 5.5, we rewrote many internal components using fast parallelized C++ code. That allowed us to support older Android versions, starting from Android 8.0 Oreo (API Level 26). Furthermore, the Enterprise 2D-to-3D feature now operates in just 1 millisecond on most flagship devices, ensuring efficient use of your technology.
