Fallible ethics for (un) fallible machines
DOI:
https://doi.org/10.3989/arbor.2021.800003Keywords:
ethics, artificial intelligence (AI), moral, bias, fallibilityAbstract
Human ethical codes are not consistent in their design, nor are they universally distributed. Therefore, the impossible universality or completeness of ethical systems for artificial intelligence (AI) is something evident that was only briefly pointed out by the recent MIT (Moral Machine) study. As all ethics have an unequivocal cultural nuance and include degrees of interpretation in its principles (such as the universal right to housing, evident although no institution ensures compliance, something that a machine would not understand). At the same time there is a formal problem: an AI system does not always have enough data or optimal time to process a situation, so a factor of ethical chance must be considered in the design of such systems.
Downloads
References
Allinson, Robert E. (1992). The golden rule as the core value in confucianism & christianity: Ethical similarities and differences. Asian Philosophy, 2 (2): 173-185. https://doi.org/10.1080/09552369208575363
Awad, Edmond, Dsouza, Sohan, Kim, Richard, Schulz, Jonathan, Henrich, Joseph, Shariff, Azim, Bonnefon, Jean-François, & Rahwan, Iyad (2018). The Moral Machine experiment. Nature, 563: 59-64. https://doi.org/10.1038/s41586-018-0637-6 PMid:30356211
Awad, Edmond, Dsouza, Sohan, Shariff, Azim, Rahwan, Iyad, & Bonnefon, Jean-François (2020). Universals and variations in moral decisions made in 42 countries by 70,000 participants. Proceedings of the National Academy of Sciences of the United States of America, 117 (5): 2332-2337. https://doi.org/10.1073/pnas.1911517117 PMid:31964849 PMCid:PMC7007553
Axelrod, Robert & Hamilton, William D. (1981). The evolution of cooperation. Science, 211(4489): 1390-1396. https://doi.org/10.1126/science.7466396 PMid:7466396
Axelrod, Robert. (1986). An evolutionary approach to norms. American Political Science Review, 80 (4): 1095-1111. https://doi.org/10.1017/S0003055400185016
Bix, Amy Sue (2020). 'Remember the Sabbath': a history of technological decisions and innovation in Orthodox Jewish communities. History and Technology, 36 (2): 205-239. https://doi.org/10.1080/07341512.2020.1816339
Botero, Carlos A., Gardner, Beth, Kirby, Kathryn R., Bulbulia, Joseph, Gavin, Michael C., & Gray, Russell D. (2014). The ecology of religious beliefs. Proceedings of the National Academy of Sciences of the United States of America, 111 (47): 16784-16789. https://doi.org/10.1073/pnas.1408701111 PMid:25385605 PMCid:PMC4250141
Boyd, Robert, & Richerson, Peter J. (2009). Culture and the evolution of human cooperation. In Philosophical Transactions of the Royal Society B: Biological Sciences, 364: 3281-3288. https://doi.org/10.1098/rstb.2009.0134 PMid:19805434 PMCid:PMC2781880
Brown, Donald E. (2004). Human universals, human nature & human culture. Daedalus, 133 (4): 47-54. https://doi.org/10.1162/0011526042365645
Brown, Donald E. (2017). Our Common Denominator: Human Universals Revisited. Evolutionary Studies in Imaginative Culture, 1 (1): 213-216. https://doi.org/10.26613/esic.1.1.28
Buchtel, Emma E., & Norenzayan, Ara (2008). Which should you use, intuition or logic? Cultural differences in injunctive norms about reasoning. Asian Journal of Social Psychology, 11(4): 264-273. https://doi.org/10.1111/j.1467-839X.2008.00266.x
Bues, Micha-Manuel, & Matthaei, Emilio (2017). LegalTech on the Rise: Technology Changes Legal Work Behaviours, But Does Not Replace Its Profession. En: Jacob K., Schindler D., Strathausen R. (eds) Liquid Legal. Management for Professionals, pp. 89-110. Springer, Cham. https://doi.org/10.1007/978-3-319-45868-7_7
Caviola, Lucius, Mannino, Adriano, Savulescu, Julian, & Faulmüller, Nadira (2014). Cognitive biases can affect moral intuitions about cognitive enhancement. Frontiers in Systems Neuroscience, 8. https://doi.org/10.3389/fnsys.2014.00195 PMid:25360088 PMCid:PMC4197737
Challet, Damien, & Zhang, Y. C. (1997). Emergence of cooperation and organization in an evolutionary game. Physica A: Statistical Mechanics and Its Applications, 246 (3-4): 407-418. https://doi.org/10.1016/S0378-4371(97)00419-6
Clausen, Jens, & Levy, Neil (2015). Handbook of neuroethics. In Handbook of Neuroethics. Springer. https://doi.org/10.1007/978-94-007-4707-4
Cortina Orts, Adela (1986). Ética Mínima. Tecnos.
Costa, Albert, Foucart, Alice, Hayakawa, Sayuri, Aparici, Melina, Apesteguia, Jose, Heafner, Joy, & Keysar, Boaz (2014). Your morals depend on language. PLoS ONE, 9 (4). https://doi.org/10.1371/journal.pone.0094842 PMid:24760073
Curry, Oliver S., Mullins, Daniel A., & Whitehouse, Harvey (2019). Is it good to cooperate?: Testing the theory of morality-as-cooperation in 60 societies. Current Anthropology, 60 (1). https://doi.org/10.1086/701478
Debes, Remy (2017). Empathy and mirror neurons. In The Routledge Handbook of Philosophy of Empathy, pp. 54-63. https://doi.org/10.4324/9781315282015-6
Enke, Benjamin (2019). Kinship, cooperation, and the evolution of moral systems. Quarterly Journal of Economics, 134 (2): 953-1019. https://doi.org/10.1093/qje/qjz001
Flores, Anthony W., Bechtel, Kristin, & Lowenkamp, Christopher T. (2016). False positives, false negatives, and false analyses: A rejoinder to "machine bias: There's software used across the country to predict future criminals. And it's biased against blacks." Federal Probation Journal, 80 (2): 38-46.
Hel, Virginia (2018). The ethics of care. In The Oxford Handbook of Distributive Justice. https://doi.org/10.1093/oxfordhb/9780199645121.013.12
Huang, Minyao, & Jaszczolt, Kasia M. (eds) (2018). Expressing the self: cultural diversity and cognitive universals. Oxford University Press.
Iacoboni, Marco (2009). Imitation, Empathy, and Mirror Neurons. Annual Review of Psychology, 60 (1): 653-670. https://doi.org/10.1146/annurev.psych.60.110707.163604 PMid:18793090
Jakubecki, Natalia G. (2012). Los inicios del pensamiento escolástico: el "Sic et Non" de Pedro Abelardo. Revista Española de Filosofía Medieval, 19: 31-38. https://doi.org/10.21071/refime.v19i.6059
Jonauskaite, Domicele, et al. (2020). Universal Patterns in Color-Emotion Associations Are Further Shaped by Linguistic and Geographic Proximity. Psychological Science, 31 (10): 1245-1260. https://doi.org/10.1177/0956797620948810 PMid:32900287
Kahneman, Daniel (2011). Thinking fast, thinking slow. London: Penguin Books.
Klenk, Michael (2019). Moral Philosophy and the 'Ethical Turn' in Anthropology. Zeitschrift Für Ethik Und Moralphilosophie, 2 (2): 331-353. https://doi.org/10.1007/s42048-019-00040-9
Kümmerli, Rolf (2011). A test of evolutionary policing theory with data from human societies. PLoS ONE. https://doi.org/10.1371/journal.pone.0024350 PMid:21909429 PMCid:PMC3164724
Laland, Kevin N., Odling-Smee, John, & Myles, Sean (2010). How culture shaped the human genome: Bringing genetics and the human sciences together. Nature Reviews Genetics, 11: 137-148. https://doi.org/10.1038/nrg2734 PMid:20084086
Lang, Martin, Purzycki, Benjamin G., Apicella, Coren L., Atkinson, Quentin D., Bolyanatz, Alexander, et al. (2019). Moralizing gods, impartiality and religious parochialism across 15 societies. Proceedings of the Royal Society B: Biological Sciences, 286 (1898). https://doi.org/10.1098/rspb.2019.0202
Larson, Jeff, Mattu, Surya, Kirchner, Lauren, & Angwin, Julia (2016). How We Analyzed the COMPAS Recidivism Algorithm. ProPublica 5, 9 (1). [23 May 2016, https://www.propublica.org/article/how-we-analyzed-the-compas-recidivism-algorithm]
Li, Annie S., Kelley, Elisabeth A., Evans, Angela D., & Lee, Kang (2011). Exploring the ability to deceive in children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 41: 185-195. https://doi.org/10.1007/s10803-010-1045-4 PMid:20556501 PMCid:PMC3482107
Lukas, Dieter, & Clutton-Brock, Tim (2012). Cooperative breeding and monogamy in mammalian societies. Proceedings of the Royal Society B: Biological Sciences, 279 (1736). https://doi.org/10.1098/rspb.2011.2468
Marshall, James A. R., Trimmer, Pete C., Houston, Alasdair I., & McNamara, John M. (2013). On evolutionary explanations of cognitive biases. Trends in Ecology and Evolution, 28 (8): 469-473. https://doi.org/10.1016/j.tree.2013.05.013 PMid:23790393
Maruyama, Magoroh (1976). Design principles for extraterrestrial communities. Futures, 8 (2): 104-121. https://doi.org/10.1016/0016-3287(76)90061-6
Mori, Masahiro (1989). The Buddha in the Robot. Kosei Publishing Company.
Mou, Bo (2004). A reexamination of the structure and content of Confucius' version of The Golden Rule. In Philosophy East and West, 54 (2): 218-248. https://doi.org/10.1353/pew.2004.0007
Narvaez, Darcia (2010). The emotional foundations of high moral intelligence. New Directions for Child and Adolescent Development, 129: 77-94. https://doi.org/10.1002/cd.276 PMid:20872605
Navarrete, C. David, McDonald, Melissa M., Mott, Michael L., & Asher, Benjamin (2012). Virtual morality: emotion and action in a simulated three-dimensional "trolley problem". Emotion, 12 (2): 364-370. https://doi.org/10.1037/a0025561 PMid:22103331
Nisbett, Richard E. (2003). The geography of thought: how Asians and westerners think differently... and why. New York: The Free Press.
Norenzayan, Ara, & Nisbett, Richard E. (2000). Culture and causal cognition. Current Directions in Psychological Science, 9 (4): 132-135. https://doi.org/10.1111/1467-8721.00077
Nowak, Martin A., Page, Karen M., & Sigmund, Karl (2000). Fairness versus reason in the Ultimatum Game. Science, 289 (5485): 1773-1775. https://doi.org/10.1126/science.289.5485.1773 PMid:10976075
Pagallo, Ugo (2018). Vital, Sophia, and Co.-The Quest for the Legal Personhood of Robots. Information, 9 (9): 230. https://doi.org/10.3390/info9090230
Pauly, Mark V. (1968). The economics of moral hazard: comment. The American Economic Review, 58 (3): 531-537.
Rembert, Ron B. (1983). The Golden Rule: Two Versions and two Views. Journal of Moral Education. https://doi.org/10.1080/0305724830120205
Riehl, Christina, & Frederickson, Megan E. (2016). Cheating and punishment in cooperative animal societies. In Philosophical Transactions of the Royal Society B: Biological Sciences, 371 (1687). https://doi.org/10.1098/rstb.2015.0090 PMid:26729930 PMCid:PMC4760192
Rowell, David, & Connelly, Luke B. (2012). A History of the Term "Moral Hazard." Journal of Risk and Insurance 77 (4): 1051-1075. https://doi.org/10.1111/j.1539-6975.2011.01448.x
Sanfey, Alan G., Rilling, James K., Aronson, Jessica A., Nystrom, Leigh E., & Cohen, Jonathan D. (2003). The neural basis of economic decision-making in the Ultimatum Game. Science, 300 (5626): 1755-1758. https://doi.org/10.1126/science.1082976 PMid:12805551
Slote, Michael (2007). The Ethics of Care and Empathy. Routledge. https://doi.org/10.4324/9780203945735
Stevens, Douglas E., & Thevaranjan, Alex (2010). A moral solution to the moral hazard problem. Accounting, Organizations and Society, 35 (1): 125-139. https://doi.org/10.1016/j.aos.2009.01.008
Thaler, Richard H. (1988). Anomalies: The Ultimatum Game. Journal of Economic Perspectives 2(4): 195-206. https://doi.org/10.1257/jep.2.4.195
Thaler, Richard H., & Sunstein, Cass R. (2009). Nudge: Improving Decisions about Health, Wealth, and Happiness: Amazon.es: Thaler, Richard H., Sunstein, Cass R.: Libros en idiomas extranjeros. Penguin LCC US.
Ushimura, Kei (2003). Beyond the "Judgement of Civilization". The Intellectual Legacy of the Japanese War Crimes Trials, 1946-1949. (1st ed.). The International House of Japan.
Vallverdú, Jordi (2007a). Las raíces de lo ético: tras Rabossi. Cuadernos de Ética, 22(35): 89-118.
Vallverdú, Jordi (2007b). Una ética de las emociones. Barcelona: Anthropos.
Vallverdú, Jordi (2009). Bioética computacional. e-Biotecnología: simbiosis de valores. Fondo de Cultura Económica.
Vallverdú, Jordi (2019). ¿Nazis kantianos? El homo politicus desde la racionalidad limitada o La banalidad de la Ética. In A. Estany & M. Gensollen (Eds.), Democracia y conocimiento (1st ed., pp. 245-260). Barcelona: Servei de Publicacions de la Universitat Autònoma de Barcelona.
Vallverdú, Jordi, & Müller, Vincent C. (2019). Blended cognition: the robotic challenge. Springer. https://doi.org/10.1007/978-3-030-03104-6
Wagner, Cosima (2009). "The Japanese way of robotics": Interacting "naturally" with robots as a national character? Proceedings - IEEE International Workshop on Robot and Human Interactive Communication, 510-515.
Wong, Pak-Hang. (2019). Rituals and Machines: A Confucian Response to Technology-Driven Moral Deskilling. Philosophies, 4 (4): 59. https://doi.org/10.3390/philosophies4040059 PMCid:PMC7929705
Woodruff, Allison, Augustin, Sally, & Foucault, Brooke (2007). Sabbath day home automation: "it's like mixing technology and religion." Conference on Human Factors in Computing Systems - Proceedings, 527-536. https://doi.org/10.1145/1240624.1240710
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Consejo Superior de Investigaciones Científicas (CSIC)
This work is licensed under a Creative Commons Attribution 4.0 International License.
© CSIC. Manuscripts published in both the printed and online versions of this Journal are the property of Consejo Superior de Investigaciones Científicas, and quoting this source is a requirement for any partial or full reproduction.All contents of this electronic edition, except where otherwise noted, are distributed under a “Creative Commons Attribution 4.0 International” (CC BY 4.0) License. You may read here the basic information and the legal text of the license. The indication of the CC BY 4.0 License must be expressly stated in this way when necessary.
Self-archiving in repositories, personal webpages or similar, of any version other than the published by the Editor, is not allowed.
Funding data
Ministerio de Ciencia e Innovación
Grant numbers FFI2017-85711-P