powered by BConnect
Gesture & body tracking algorithm
Design a user experience that promotes better health with AI-powered gesture and body tracking.
Unlocking user engagement with real-time feedback
Our body tracking algorithm offers a unique opportunity to support users in their health and wellness routines by leveraging real-time data. When a user executes a gesture or exercise, it tracks their movements, evaluates their performance, and provides suggestions for improvement. This algorithm is available as a Python library and is ready for integration into mobile applications.
Technical foundation
➤ Baracoda AI framework
We developed an algorithm that calculates the topology of the body landmarks in real time and compares it to a reference model. We offer customization options on body landmarks and reference content to meet your specific needs.
➤ Open-source components
We leveraged an open-source model as a foundation for hand and body landmarks detection in real time.
➤ Python implementation
The algorithm was prototyped and evaluated in Python before being ported and optimized in C++, guaranteeing high performance and rapid time-to-market.
Integrated real-time coaching
Our algorithm uses real-time body tracking to monitor users' movements and provide advice when needed to help them correct their technique. At the end of each exercise, users receive a score based on their overall performance, as well as detailed feedback to help them improve their performance in the future. Exercises can include hand gestures, leg movements, or general body posture. Additionally, we have developed a unique Deep Learning model that detects different levels of facial pressure as it is a crucial feature in face-hand interaction.
A variety of use cases
Skincare
Applying creams, doing face yoga exercises, or giving yourself a face massage at home becomes easier when you follow the movements suggested by the gesture tracking algorithm and adjust them according to your target areas.
Consumer health
Daily health practices like tooth brushing are rarely done correctly and with enjoyment. Real-time coaching makes it easy to keep track of brushed areas through a fun and engaging experience.
Beauty
Technique is key when it comes to applying makeup or blow-drying your hair. Real-time feedback helps you get it right from the first time and improve your technique in the long run.
Sports
Most sport exercises and movements performed at home without the guidance of a coach are incorrect or even dangerous. Body tracking allows you to correct them immediately and learn to do them correctly over time.
Pharmaceuticals
Some medications require precise gestures for effective application, but it can be challenging to perform them correctly without guidance. Gesture tracking enables you to monitor and correct your gestures for optimal results.
Medical devices
As part of treatment plan, some medical devices involve specific training. It can be difficult to follow these instructions over time, especially for the elderly. Body tracking provides real-time feedback throughout the treatment, making it easier to follow the instructions correctly.
Integration & Support
Operating system
Extensive compatibility with MacOS, Linux and portable on Android, iOS, ensuring broad applicability across various devices.
RGB camera requirements
Conventional RGB cameras already equipped in any desktop or mobile devices.
Local processing
All facial recognition and gesture analysis are processed on-device, prioritizing user privacy and data security.
Request a demo
Baracoda end-to-end support
We provide detailed documentation, API references, and example applications to ensure a smooth development experience. We also offer customization services and technical consulting to adapt the algorithm to specific requirements or use cases.
Explore our ready-to-use algorithms
Browse our library of algorithms, from voice recognition and gesture detection to motion and object tracking. We use the most advanced tech to take your products to the next level.