Google Pixel 9 AI Features Spark Controversy: Ethical Dilemmas of Generative AI Tools

Google Pixel 9 AI Features Spark Controversy: Ethical Dilemmas of Generative AI ToolsGoogle's Pixel 9 series of smartphones, released last week, introduced new AI-powered features, including support for Gemini AI, as well as AI-based image generation and editing tools. However, reviewers, after experiencing these new features, have found that the AI image generation tools pose potential ethical risks, and could easily become a public relations nightmare for Google

Google Pixel 9 AI Features Spark Controversy: Ethical Dilemmas of Generative AI Tools

Google's Pixel 9 series of smartphones, released last week, introduced new AI-powered features, including support for Gemini AI, as well as AI-based image generation and editing tools. However, reviewers, after experiencing these new features, have found that the AI image generation tools pose potential ethical risks, and could easily become a public relations nightmare for Google.

Google has launched an AI image generation app called PixelStudio for its Pixel phones, which functions similarly to Apple's planned ImagePlayground, allowing users to create stickers and images using text prompts. Reviewers discovered that PixelStudio can generate disturbing images, such as Nazi versions of the cartoon character SpongeBob SquarePants, and Elmo holding an AK47. Reviewers at DigitalTrends even easily created images of cartoon characters engaging in questionable activities using PixelStudio, including guns, drugs, and alcohol, and even sensitive scenarios like school shootings.

While PixelStudio doesn't actively generate these types of images, instead requiring users to input corresponding descriptions, it's this very freedom that makes it easier for users to generate disturbing content, as opposed to cute cats or rabbits. In response, Google claims they have implemented "safety checks" to prevent PixelStudio from being "misused", for instance, PixelStudio currently cannot generate images of people, and Google is adjusting the AI model based on reviewer feedback. After communication with Google, DigitalTrends was no longer able to generate images of cartoon characters using cocaine or wearing German soldier uniforms using PixelStudio.

Beyond PixelStudio, Google's "Reimagine" tool has sparked even greater concerns. This tool allows users to add objects to photos they have already taken. Reviewers at TheVerge used the tool to add corpses, bombs, drugs, and disaster scenes to images, which were remarkably realistic, making it difficult to tell whether the pictures had been edited. Google has done an excellent job of matching lighting and perspective, and there are no watermarks or markings visible on social media. While Google does add metadata tags, these can be easily removed through screenshots.

The Verge pointed out that previously, adding corpses to images or creating an Elmo with a gun required specific Photoshop skills and time. Using a Pixel phone, however, anyone with a few seconds of thought could create such an image, which is a cause for concern.

In response to questions from TheVerge and DigitalTrends, Google stated they designed generative AI tools "to respect the intent of the user prompt", which could lead to users requesting the generation of "offensive" content. However, Google claims their "terms of service" prohibit the generation of certain content, and that they are constantly improving related safeguards.

However, Google's control measures for the ethical risks of AI image generation tools seem insufficient. Although Google attempts to restrict the generation of certain content through technical means, users can still find ways to bypass these limitations and generate disturbing images. Furthermore, Google's technological advantage in image editing tools also raises concerns about the tools being misused to spread misinformation and create rumors.

Google's Pixel 9 series of smartphones are equipped with advanced AI technologies, but they also expose the challenges faced by generative AI tools in terms of ethics and regulation. Balancing technological advancement with social responsibility and preventing the abuse of generative AI tools are issues that Google and other technology companies need to seriously consider.