Skip to main content

We are excited to announce our latest Body Tracking SDK update with you! Here’s what’s new in version 5.5.

1) Dynamic smoothing

Providing smooth and reliable data has been a significant challenge for Computer Vision apps. Traditional smoothing methods only calculate the average value of a set of frames, making it hard to adapt to fast movements. Also, the higher the smoothing factor, the slower the apps become. To solve these problems, we developed a new smoothing approach called Dynamic Smoothing.

Dynamic smoothing works in real time and excels in super-fast and super-slow movements. Moreover, it uses 90% less memory compared to legacy smoothing.

LightBuzz Body Tracking - Dynamic Smoothing vs Legacy Smoothing

To enable Dynamic Smoothing, set the SmoothingType property of your Sensor instance to Dynamic:

sensor.SmoothingType = SmoothingType.Dynamic;

In Unity, you can also toggle SmoothingType directly in the Editor:

LightBuzz Unity Smoothing Type selection

Legacy smoothing is still the default option, so you can safely experiment with Dynamic smoothing and see if it fits your use case well.

2) Privacy: hide faces

We take privacy seriously. Sometimes, when recording videos, companies should not store people’s faces. So, we’ve made it easier for you to comply with US and international laws by hiding people’s faces programmatically.

LightBuzz Body Tracking - Hide Faces

There are two discrete components:

1) A user-interface element that overlays a rectangle on top of the users’ faces. This feature leaves the color data unchanged.

To activate it, go to the Skeleton Manager and check Hide Faces.

LightBuzz Unity Hide Faces (Skeleton)

2) A video recording setting that entirely removes faces from the stored video files. This feature modifies the color data and replaces human faces with black pixels.

To enable it, go to the video recording settings and check Hide Faces.

LightBuzz Unity Hide Faces (Video Recording)

3) Multicamera support

Our software now has the ability to process data from multiple cameras and input streams simultaneously, generating accurate skeleton data from all of them. Our focus on performance has truly paid off, and we are excited to see how this new feature will help developers achieve even greater things.

LightBuzz Body Tracking Multicamera

Mixing different sensor types is also possible — for example, you can use a RealSense and an OAK-D camera simultaneously to compare their results!

Multicamera support works on macOS, Linux, and Windows. Check the new SDK samples to see this feature in action.

4) New depth cameras

OAK-D support for Mac and Linux

We strongly believe that depth perception is crucial for AI applications. As part of our ongoing commitment to stereo depth cameras, we are pleased to announce that we now support the OAK-D family on all major desktop operating systems, including macOS and Ubuntu Linux.

RealSense D457, D455f, D435f, D435if

Intel has released four new RealSense models over the past few months, so the LightBuzz SDK now supports D457, D455f, D435f, and D435if cameras.

  • D457 is a waterproof version of D455, which also works with 15-meter (50 feet) long cables.
  • D455f, D435f, and D435if have a new IR pass filter. This filter enhances the quality of depth in scenes with repetitive patterns and reduces the appearance of reflections.

It’s highly recommended to update the firmware of your devices to its latest version using the official RealSense Viewer app or RealSense FW Update tool.

RealSense Firmware Update

5) Android boost

Our team continues to prioritize both accuracy and performance. In version 5.5, we rewrote many internal components using fast parallelized C++ code. That allowed us to support older Android versions, starting from Android 8.0 Oreo (API Level 26). Furthermore, the Enterprise 2D-to-3D feature now operates in just 1 millisecond on most flagship devices, ensuring efficient use of your technology.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.