Generative artificial intelligence (AI) is making a splash across all industries, with companies large and small racing to bring the power of AI to new and useful applications and optimizations. But, with this rapid advancement, new and hidden dangers can be overlooked. That is why some experts, including the author of this article, have recently signed the controversial “Pause Letter” – to draw attention to the risks associated with large-scale AI and help the public be aware of these dangers.
One specific example of a generative AI technology that has generated much attention is Meta’s segment anything model (SAM). It is a highly advanced AI that can almost immediately process any image or video frame, and identify each of its distinct objects. This capability is truly remarkable, and is a powerful breakthrough for “mixed reality” systems, enabling magical interfaces in augmented and virtual environment. With SAM, computing applications can perform segmentations that the human brain can never match.
However, the same powerful generative AI technology can also be used by companies to target consumers with personalized advertising imagery. The advertisements generated by AI can be highly personalized and tailored to individual audiences, drawing from data that has been gathered over time about the user. This can be especially dangerous as AI systems may also use data to determine which color, style and layout of advertisement will draw the user’s attention in the most effective way. In addition, AI may be used to manipulate facial features and gestures to increase the persuasive impact of the advertisements.
As an expert whose been working in mixed reality for decades, the author believes in the potential benefits of artificial intelligence, but also stresses the importance of regulating AI to prevent it from being used in manipulative ways that challenge human agency. To that end, the author recommends advocating for policymakers to protect consumers from the hidden dangers of generative AI.
Meta is a technology company that provides a range of AI-based solutions, including the segment anything model (SAM), which can identify each of the distinct objects in any image or video frame. Founded in 2016, the company has seen immense growth and has been recognized as a leader in the artificial intelligence tech space.
The author of this article is a researcher and former professor who began working on mixed reality systems back in 1991 before that phrase had even been coined. His work and research has been featured in well known media outlets like the San Francisco Examiner and has earned him rave reviews from fans of the artificial intelligence space. He is a strong supporter of the potential benefits of AI, however, he is also a firm believer in the need to draw attention to the risks of generative AI and take steps to protect users from deceptive tactics.
