An AI chatbot gave tips in a Facebook group on how to prepare poisonous mushrooms, which can be life-threatening. The case illustrates that language models still pose major risks.

The AI ​​chatbot “FungiFriend” recently caused a stir in a popular Facebook group for mushroom pickers. Because the bot provided tips on how to prepare a poisonous mushroom. A member asked the bot how to prepare the Sarcosphaera coronaria mushroom. The species is known to accumulate arsenic and, in the worst cases, causes death.

The bot recommended sautéing the mushroom in butter or adding it to soups, which poses a big risk for inexperienced mushroom pickers. The situation shows the dangers associated with the use of AI in sensitive areas such as mushroom identification.

Mushroom experts warn that AI systems are not yet able to reliably distinguish between edible and poisonous mushrooms. But beginners in particular often rely on tips in groups to get advice from experienced collectors and avoid dangerous mistakes.

AI chatbot gives life-threatening mushroom tips on Facebook

Facebook parent company Meta has recently integrated various AI chatbots into special groups. However, there were apparently only a few security precautions. Experts like Rick Claypool, an experienced mushroom picker and consumer advocate, sharply criticized the company.

He emphasized opposite 404 Mediathat newcomers, who often look for advice in the group, are at particularly high risk. Another problem is that AI is often the first option that users see when they want to ask questions.

This encourages the use of the bot instead of direct exchange with other group members. Another problem: Many people probably don't dare to ask “stupid” questions in a group and therefore prefer to turn to the AI ​​- which in the worst case scenario could end in life-threatening situations.

Inexperienced users are particularly at risk

While experienced collectors can assess the dangers, inexperienced users are at risk of relying on insufficient information from the AI. Claypool describes that many collectors use the groups to share images directly from the mushroom location.

Direct exchange in the group enables correction if a user shares incorrect information. AI-controlled chats lack this correction function, which can have serious consequences in sensitive areas such as mushroom identification.

Also interesting:

Source: https://www.basicthinking.de/blog/2024/11/24/ki-bot-pilz-tipps-facebook/

Leave a Reply