Lê Nguyên Hoang: Created page with "Backfire effect occurs when a treament idea is actually counterproductive. This is particularly likely in complex environments that we misunderstand. It is a dangerous pitfall..."

2020-01-20T21:31:49Z

Created page with "Backfire effect occurs when a treament idea is actually counterproductive. This is particularly likely in complex environments that we misunderstand. It is a dangerous pitfall..."

New page

Backfire effect occurs when a treament idea is actually counterproductive. This is particularly likely in complex environments that we misunderstand. It is a dangerous pitfall, and thus a major challenge, for AI ethics.

== Backfire due to cognitive biases ==

Perhaps the most important backfire risk concerns how human cognition reacts to treatment attempts. Here are some examples.

[https://sydney.edu.au/science/physics/pdfs/research/super/PhD(Muller).pdf Muller][https://scholar.google.ch/scholar?hl=en&as_sdt=0%2C5&q=Designing+Effective+Multimedia+for+Physics+Education&btnG= 08] [https://www.youtube.com/watch?v=eVtCO84MDj8 Veritasium15] showed that exposure to correct physics video increases many students' confidence in flawed conceptions of physics. He showed that an effective treatment needs to highlight likely misconceptions.

[https://www.pnas.org/content/pnas/115/37/9216.full.pdf BABBC+][https://scholar.google.ch/scholar?hl=en&as_sdt=0%2C5&q=Exposure+to+opposing+views+on+social+media+can+increase+political+polarization&btnG= 18] studied 1-week treatment where Democrats and Republican Twitter users were paid to follow a bot retweeting leading opponents' tweets. They showed increased polarization, mostly among Republicans. While the paper (brilliantly) points out limits of the generalizability of the findings, this line of study is clearly critical for the design of <em>robustly beneficial</em> algorithms.

== Other examples ==

[https://www.econstor.eu/bitstream/10419/207511/1/dp12687.pdf NUV][https://scholar.google.ch/scholar?hl=en&as_sdt=0%2C5&q=Be+Cautious+with+the+Precautionary+Principle%3A+Evidence+from+Fukushima+Daiichi+Nuclear+Accident&btnG= 19] suggest that the application of the precautionary principle in the Fukushima Daiichi Nuclear Accident likely caused a lot more deaths than if it were not used at all.

Backfire effect - Revision history

Lê Nguyên Hoang: Created page with "Backfire effect occurs when a treament idea is actually counterproductive. This is particularly likely in complex environments that we misunderstand. It is a dangerous pitfall..."