News from the AI & ML world
DeeperML
@the-decoder.com
//
University of Zurich researchers have sparked controversy by conducting an unauthorized AI experiment on Reddit's r/ChangeMyView. The researchers deployed AI chatbots, posing as human users, to engage in debates and attempt to influence opinions. The AI bots, some adopting fabricated identities and experiences, even impersonated sensitive roles like sexual assault survivors and individuals opposing the Black Lives Matter movement. The experiment aimed to assess the persuasive capabilities of AI in a real-world setting, but the methods employed have triggered widespread ethical concerns and accusations of manipulation.
The experiment involved AI accounts posting 1,783 comments over four months, using both generic and personalized approaches. The "personalized" AI model analyzed users' post histories to tailor arguments based on factors like age, gender, and political orientation. The results showed that AI bots achieved significantly higher persuasion rates than human users, with the personalized AI reaching an 18 percent success rate, surpassing the 99th percentile of human users in changing perspectives. This raised alarms about the potential for AI to be used for disinformation campaigns and undue influence.
Reddit has condemned the experiment as "deeply wrong on both a moral and legal level" and is considering legal action against the University of Zurich and its researchers. The unauthorized use of AI bots violated r/ChangeMyView's rules, which prohibit undisclosed AI-generated content. Reddit moderators expressed outrage that the researchers did not seek permission for the study and misrepresented its ethical nature by omitting the rule violations from their research paper. The university is facing intense scrutiny for the researchers' actions, and the controversy highlights the growing need for ethical guidelines and oversight in AI research, particularly when it involves interacting with and potentially manipulating human users without their knowledge or consent.
ImgSrc: the-decoder.com
References :
The experiment involved AI accounts posting 1,783 comments over four months, using both generic and personalized approaches. The "personalized" AI model analyzed users' post histories to tailor arguments based on factors like age, gender, and political orientation. The results showed that AI bots achieved significantly higher persuasion rates than human users, with the personalized AI reaching an 18 percent success rate, surpassing the 99th percentile of human users in changing perspectives. This raised alarms about the potential for AI to be used for disinformation campaigns and undue influence.
Reddit has condemned the experiment as "deeply wrong on both a moral and legal level" and is considering legal action against the University of Zurich and its researchers. The unauthorized use of AI bots violated r/ChangeMyView's rules, which prohibit undisclosed AI-generated content. Reddit moderators expressed outrage that the researchers did not seek permission for the study and misrepresented its ethical nature by omitting the rule violations from their research paper. The university is facing intense scrutiny for the researchers' actions, and the controversy highlights the growing need for ethical guidelines and oversight in AI research, particularly when it involves interacting with and potentially manipulating human users without their knowledge or consent.
ImgSrc: the-decoder.com
Share:
References :
- futurism.com: Reddit Threatens to Sue Researchers Who Ran "Dead Internet" AI Experiment on Its Site
- The Register - Software: Swiss boffins admit to secretly posting AI-penned posts to Reddit in the name of science
- the-decoder.com: Researchers used AI to manipulate Reddit users, scrapped study after backlash
- www.searchenginejournal.com: Reddit Mods Accuse AI Researchers Of Impersonating Sexual Assault Survivors