Instagram is set to implement features designed to blur messages that contain nudity, a move aimed at enhancing protections for teenage users and curbing the potential influence of scammers. This initiative was announced by its parent company, Meta, on Thursday amid growing scrutiny regarding the safety of its platforms.
The company faces increasing pressure from both U.S. and European regulators, who have raised concerns about the addictive nature of its apps and their potential negative impact on the mental health of younger users.
According to Meta, the new feature for Instagram direct messages will utilize on-device machine learning technology to determine if an image sent through the application contains nudity.
This feature will be activated by default for users under the age of 18, and the company plans to inform adults about the capability to encourage wider adoption.
“The analysis occurs on the user’s device, meaning that nudity protection will also apply to end-to-end encrypted chats, where Meta does not have access to images unless they are reported,” the company explained.
While Instagram’s direct messaging system is not currently encrypted like its Messenger and WhatsApp platforms, Meta has indicated intentions to introduce encryption for Instagram’s messaging service in the future.
Additionally, Meta announced that it is working on technology aimed at identifying accounts that may be involved in sextortion scams. The company is also testing popup notifications for users who may have engaged with such accounts.
Earlier this year, Meta revealed plans to limit access to sensitive content for teenagers on both Facebook and Instagram, aiming to make it less likely for these users to encounter distressing topics such as suicide, self-harm, and eating disorders.
A lawsuit filed in October by attorneys general from 33 U.S. states, including California and New York, accused Meta of consistently misleading the public regarding the risks associated with its platforms.
Furthermore, the European Commission has requested details on how Meta safeguards children against illegal and harmful content online.
© Thomson Reuters 2024
