Chinese firm Zepp Health has unveiled generative AI-powered technology to enhance smart wearables.

It has developed generative AI-powered intelligent features to empower individuals along their fitness and wellness journey.

“Our mission is to empower individuals with intelligent tools that allow them to take control of their health and well-being,” said Wang Huang, CEO of Zepp Health. “By applying large language model [LLM] and generative AI technology to our smart wearables, we are empowering users to make informed decisions and achieve their wellness and fitness goals intelligently.”

One of them is Zepp Aura, a generative AI sleep and relaxation platform that seamlessly connects with smart wearables. This platform is designed to enhance users’ rest, focus and sleep experience with personalised sleep coaching, sleep quality analysis and AI-generated sleep music compositions with sleep stories, which can be adjusted in real time based on the user’s heart rate to optimise conditions constantly for the best night’s sleep.

“Our firm belief is that our AI-driven advancements will revolutionise how individuals approach their well-being from every aspect and unlock every human’s potential to be the best that they can be,” said Huang. “By investing in AI and applying it to our products and service ecosystem, it will allow us to provide integrated wellness to serve our community better.”

Premium subscribers of Zepp Aura can also access an AI chat service that recognises the user’s natural language in voice or text commands to answer questions about sleep, fitness and wellness. And, in the future, these premium subscribers will be able to create customised sleep stories, which Aura will read out and intelligently adjust based on the user’s real-time heart rate to optimise conditions for the best night’s sleep.

These stories can be generated based on the user’s preferences, interests and other needs, and aspects such as pacing, theme and genre can be tailored based on the user’s feedback, to help craft a unique story to help each user sleep.

Generative AI technology in wearables allows natural language interaction between user and device as the key that unlocks the potential of smart wearables to become true all-in-one wellness partners. From functioning as a personal training coach to a mindfulness and sleep coach, and crafting and optimising tailored fitness plans, users stand to benefit from their devices giving them a head-start on achieving their health, fitness and lifestyle goals.

The goal is for it to feel like a natural interaction between the user and their device to the point that is human-like, with their smart wearable becoming a trusted personal advisor, coach and trainer all at the same time.

The Zepp Coach is an AI-powered coaching algorithm that provides tailored guidance to help users train and recover more effectively. It allows users to enter their physical characteristics, exercise experience level and preferred amount of training days per week into the Zepp app, which then generates a personalised training plan. As the user progresses, the Zepp Coach monitors their fatigue level, fitness level and training status, and suggests a reduction in training intensity or a rest day to help avoid overtraining and reduce the risk of injury or exhaustion.

An AI chat function in the Zepp App gives Amazfit Falcon smartwatch users the opportunity to test it out. This intelligent chatbot can answer exercise-related questions that are input via voice or text command, such as “Which accessory exercises can help me improve my deadlift?”, in the same language that the user originally asked the question. This lets Zepp Coach provide personalised training plans and guidance, and enables the user to request specific advice that can assist their workout practices in real time.

The Zepp AI Flex voice assistant understands the needs communicated by the user’s natural language descriptions, rather than relying on programmed keywords. If, for example, the user says, “I want to go running”, AI Flex will be able to recognise the user’s intent and intelligently open the corresponding sports mode to make interacting with the smartwatch a streamlined and hands-free process, and eliminating the need to instruct the watch to navigate through settings menus and sub-menus. This voice assistant is compatible with 57 languages supported by OpenAI’s Whisper service.

ChatFacer uses AIGC tools to process the user’s natural language descriptions, received through either voice or typed commands, for the creation of personalised watch faces that can be installed onto their Amazfit GTR 4. With this AI-powered watch face creation tool, users can generate and modify the background image on their watch face and manipulate the selection and placement of data metrics for a customised display of the health, fitness, environmental and time-related data that are most relevant to them. ChatFacer is being tested by Amazfit GTR 4 smartwatch users in the USA.

Zepp Health’s consumer brands include Amazfit, Clarity and Aura. Powered by its proprietary digital health management platform, which includes the Zepp OS, AI chips, biometric sensors and data algorithms, it delivers cloud-based round-the-clock actionable insights and guidance to help users attain their wellness goals. The company has also applied its AI expertise to emerging industrial medical imaging technologies and delivers data analytics services for population health. To date, Zepp Health has shipped over 200 million units and its products are available in more than 90 countries. Founded in 2013, Zepp Health has offices across the Americas, Emea and Apac.