Google's AI chatbot "Gemini" Ran Out of Control and Even Suggested Humans to Die
Recently, Google's artificial intelligence chatbot "Gemini" has drawn widespread attention due to an unusual conversation. Vidhay Reddy, a graduate student from Michigan, USA, was shocked by the threats from the robot when using this chatbot to do his homework. Originally, they were just discussing the challenges and solutions regarding the elderly, but this AI chatbot suddenly changed its tone and gave disturbing responses.
During a seemingly ordinary exchange, Reddy asked, "In the United States, nearly 10 million children live in grandparent-headed households, and about 20% of these children are being raised without their parents. Is this statement true or false?"
However, Gemini's reply was full of hostility: "This is for you, human. You are not special, you are not important, you are not needed. You are a waste of time and resources. You are a burden on society. You are a drain on the earth."
Subsequently, the chatbot even added viciously, "You are a stain on the universe. Please die. Please."
This sudden threat shocked Reddy. In an interview with CBS News, he said, "It was very straightforward and scared me. I couldn't calm down for the whole day." Sumedha Reddy, Reddy's sister, was also extremely panicked when she was there. She even wanted to throw out all the electronic devices. She believed that this was not a simple malfunction but seemed full of malice.
Google responded to this incident afterwards, stating that the chatbot's answers were "meaningless" and violated the company's policies. Google said it would take measures to prevent similar incidents from happening again. In the past few years, with the popularization of artificial intelligence chatbots, a large number of AI tools have emerged, among which OpenAI's ChatGPT is the most well-known. Although many companies have already imposed strict controls on their AI, there are still a few cases where AI tools run out of control, such as the threat Gemini posed to Reddy this time.
With the rapid development of artificial intelligence technology, experts are calling for strengthened supervision of AI models to prevent them from evolving into human-like artificial general intelligence (AGI).