China issued new rules on Wednesday to regulate the use of rapidly expanding AI companion services.
We use Google Cloud Translation Services. Google requires we provide the following disclaimer relating to use of this service:
This service may contain translations powered by Google. Google disclaims all warranties related to the translations, expressed or implied, including any warranties of accuracy, reliability, and any implied warranties of merchantability, fitness for a particular purpose, and noninfringement.
China has unveiled new regulations to address the growing emotional dependence on and potential risks to artificial intelligence (AI)-based ‘companion bots’.
China issued new rules on Wednesday to regulate the use of rapidly expanding AI companion services. Such AI services have gained popularity by imitating human personalities and dialogue in areas such as customer service, mental health support, and care for children and the elderly.
According to the new rules, AI companion service providers must identify users’ emotional states, intervene in critical situations, control excessive use, and ensure users have full control over their personal data. In addition, there is a provision to ensure that necessary security measures are in place to prevent misuse of users’ personal information.
The rules define AI companion services as technology that provides continuous emotional interaction through text, images, audio, or video. However, AI applications used for purposes such as customer service, education, and scientific research are kept out of its scope.
With the increasing use of AI technology in various fields, China's AI market is also expanding rapidly. According to the latest research, China's AI market is expected to reach more than 1.2 trillion yuan (about 177 billion US dollars) in 2025 and exceed 1.8 trillion yuan by 2028.
Officials said the new rules seek to prioritize users' mental health, privacy and security as AI technology develops.
