Aastha Pant
Burak Turhan
Skip Abstract Section
Abstract
Ethics in AI has become a debated topic of public and expert discourse in recent years. But what do people who build AI—AI practitioners—have to say about their understanding of AI ethics and the challenges associated with incorporating it into the AI-based systems they develop? Understanding AI practitioners’ views on AI ethics is important as they are the ones closest to the AI systems and can bring about changes and improvements. We conducted a survey aimed at understanding AI practitioners’ awareness of AI ethics and their challenges in incorporating ethics. Based on 100 AI practitioners’ responses, our findings indicate that the majority of AI practitioners had a reasonable familiarity with the concept of AI ethics, primarily due to workplace rules and policies. Privacy protection and security was the ethical principle that the majority of them were aware of. Formal education/training was considered somewhat helpful in preparing practitioners to incorporate AI ethics. The challenges that AI practitioners faced in the development of ethical AI-based systems included (i) general challenges, (ii) technology-related challenges, and (iii) human-related challenges. We also identified areas needing further investigation and provided recommendations to assist AI practitioners and companies in incorporating ethics into AI development.
- [1] . 2022. Sampling in software engineering research: A critical review and guidelines. Empirical Software Engineering 27, 4 (2022), 94.
DOI: Google Scholar
Digital Library
- [2] . 2021. Educating software and AI stakeholders about algorithmic fairness, accountability, transparency, and ethics. International Journal of Artificial Intelligence in Education 32 (2021), 808–833.
DOI: Google ScholarCross Ref
- [3] . 2021. Emerging challenges in AI and the need for AI ethics education. AI and Ethics 1, 1 (2021), 61–65.
DOI: Google ScholarCross Ref - [4] . 2018. The ethics of artificial intelligence. In Artificial Intelligence Safety and Security, Roman V. Yampolskiy (Ed.). Chapman and Hall/CRC, 57–69.Google Scholar
- [5] . 2022. Understanding implementation challenges in machine learning documentation. In Proceedings of the ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization. Number 16, ACM, New York, NY, 1–8.
DOI: Google ScholarDigital Library - [6] . 2021. Identity claims that underlie ethical awareness and action. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.
DOI: Google ScholarDigital Library - [7] . 2020. Dimensions of UX practice that shape ethical awareness. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
DOI: Google ScholarDigital Library - [8] . 2021. Democracy under attack: Challenges of addressing ethical issues of AI and big data for more democratic digital media and societies. Frontiers in Political Science 3 (2021), 682945.
DOI: Google ScholarCross Ref - [9] . 2020. Biased programmers? Or biased data? A field experiment in operationalizing AI ethics. In Proceedings of the 21st ACM Conference on Economics and Computation. New York, NY, 679–681.
DOI: Google ScholarDigital Library - [10] . 2022. Picture a data scientist: A call to action for increasing diversity, equity, and inclusion in the age of AI. Journal of the American Medical Informatics Association 29, 12 (2022), 2178–2181.
DOI: Google ScholarCross Ref - [11] . 2022. Assessing demographic bias transfer from dataset to model: A case study in facial expression recognition. arXiv:2205.10049. Retrieved from https://arxiv.org/abs/2205.10049Google Scholar
- [12] . 2017. Incorporating ethics into artificial intelligence. The Journal of Ethics 21 (2017), 403–418.
DOI: Google ScholarCross Ref - [13] . 2020. Principled artificial intelligence: Mapping consensus in ethical and rights-based approaches to principles for AI. Berkman Klein Center Research Publication2020-1 (2020).
DOI: Google ScholarCross Ref - [14] . 2022. Google AI. Retrieved April 10, 2023 from https://ai.google/principles/Google Scholar
- [15] . 2020. Coproduction, ethics and artificial intelligence: A perspective from cultural anthropology. Journal of Digital Social Research 2, 3 (2020), 42–64.
DOI: Google ScholarCross Ref - [16] . 2019. Ethics Guidelines for Trustworthy AI. Retrieved September 6, 2023 from https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-aiGoogle Scholar
- [17] . 2020. The ethics of AI ethics: An evaluation of guidelines. Minds and Machines 30, 1 (2020), 99–120.
DOI: Google ScholarDigital Library - [18] . 2021. Socio-technical grounded theory for software engineering. IEEE Transactions on Software Engineering 48, 10 (2021), 3808–3832.
DOI: Google ScholarDigital Library - [19] . 2019. Improving fairness in machine learning systems: What do industry practitioners need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–16.
DOI: Google ScholarDigital Library - [20] . 2002. Ethical principles and information professionals: Theory, practice and education. Australian Academic & Research Libraries 33, 2 (2002), 57–74.
DOI: Google ScholarCross Ref - [21] . 2022. Operationalising AI ethics: How are companies bridging the gap between practice and principles? An exploratory study. AI & SOCIETY 37, 4 (2022), 1663–1687.
DOI: Google ScholarDigital Library - [22] . 2022. AI Ethics. Retrieved April 8, 2023 from https://www.ibm.com/artificial-intelligence/ethicsGoogle Scholar
- [23] . 2021. Practitioners’ perceptions of the goals and visual explanations of defect prediction models. In Proceedings of the 2021 IEEE/ACM 18th International Conference on Mining Software Repositories. IEEE, 432–443.
DOI: Google ScholarCross Ref - [24] . 2019. The global landscape of AI ethics guidelines. Nature Machine Intelligence 1, 9 (2019), 389–399.
DOI: Google ScholarCross Ref - [25] . 2005. Designing an Effective Survey.
Technical Report . Carnegie Mellon University, Software Engineering Institute Pittsburgh, PA.Google Scholar - [26] . 2021. A high-level overview of AI ethics. Patterns 2, 9 (2021).
DOI: Google ScholarCross Ref - [27] Arif Ali Khan, Muhammad Azeem Akbar, Muhammad Waseem, Mahdi Fahmideh, Aakash Ahmad, Peng Liang, Mahmood Niazi, and Pekka Abrahamsson. 2022. AI ethics: Software practitioners and lawmakers points of view. IEEE Transactions on Computational Social Systems 10, 6 (2023), 2971–2984.
DOI: Google ScholarCross Ref - [28] . 2008. Personal opinion surveys. In Guide to Advanced Empirical Software Engineering, Forrest Shull, Janice Singer, and Dag I. K. Sjøberg (Eds.). Springer, 63–92.Google ScholarCross Ref
- [29] . 2023. Scammers used ChatGPT to Unleash a Crypto Botnet on X. Retrieved September 6, 2023 from https://www.wired.com/story/chat-gpt-crypto-botnet-scam/Google Scholar
- [30] . 2015. Guidelines for conducting surveys in software engineering v. 1.1. Vol. 50. Lund University.Google Scholar
- [31] . 2022. Assessing the fairness of AI systems: AI practitioners’ processes, challenges, and needs for support. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022), 1–26.
DOI: Google ScholarDigital Library - [32] . 2019. Ethics of using smart city AI and big data: The case of four large European cities. The ORBIT Journal 2, 2 (2019), 1–36.
DOI: Google ScholarCross Ref - [33] . 2018. Are AI Hiring Programs Eliminating Bias or Making it Worse?Retrieved August 2, 2022 from https://www.forbes.com/sites/nicolemartin1/2018/12/13/are-ai-hiring-programs-eliminating-bias-or-making-it-worse/?sh=552bb0cc22b8Google Scholar
- [34] . 2018. Does ACM’s code of ethics change ethical decision-making in software development?. In Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 729–733.
DOI: Google ScholarDigital Library - [35] . 2022. Microsoft Responsible AI Standard. Retrieved April 20, 2023 from https://www.microsoft.com/en-us/ai/responsible-ai?activetab=pivot1%3aprimaryr6Google Scholar
- [36] . 2019. Principles alone cannot guarantee ethical AI. Nature Machine Intelligence 1, 11 (2019), 501–507.
DOI: Google ScholarCross Ref - [37] . 2021. Ethics as a service: A pragmatic operationalisation of AI ethics. Minds and Machines 31, 2 (2021), 239–256.
DOI: Google ScholarCross Ref - [38] . 2020. The Hitchhiker’s Guide to AI Ethics. Retrieved July 15, 2022 from https://towardsdatascience.com/ethics-of-ai-a-comprehensive-primerGoogle Scholar
- [39] . 2022. The AI life cycle: A holistic approach to creating ethical AI for health decisions. Nature Medicine 28, 11 (2022), 2247–2249.Google ScholarCross Ref
- [40] . 2021. Abandoning GitHub. Retrieved August 9, 2022 from https://twitter.com/youyuxi/status/1411824059780849675Google Scholar
- [41] . 2020. Attributions of ethical responsibility by Artificial Intelligence practitioners. Information, Communication & Society 23, 5 (2020), 719–735.
DOI: Google ScholarCross Ref - [42] . 2023. Ethics in AI through the developer’s view: A grounded theory literature review. arXiv:4916508. Retrieved from https://arxiv.org/abs/4916508Google Scholar
- [43] . 2006. Successful US entrepreneurs: Identifying ethical decision-making and social responsibility behaviors. Journal of Business Ethics 65 (2006), 203–217.
DOI: Google ScholarCross Ref - [44] . 2020. The Ethics of the Ethics of AI. Oxford University Press, Oxford.Google Scholar
- [45] . 2020. Assessing gender bias in machine translation: A case study with Google translate. Neural Computing and Applications 32 (2020), 6363–6381.
DOI: Google ScholarDigital Library - [46] . 2021. Where responsible AI meets reality: Practitioner perspectives on enablers for shifting organizational practices. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–23.
DOI: Google ScholarDigital Library - [47] . 2019. Relevance of ethical guidelines for artificial intelligence- A survey and evaluation. In Proceedings of the 27th European Conference on Information Systems.Google Scholar
- [48] . 2021. Research and practice of AI ethics: A case study approach juxtaposing academic discourse with organisational reality. Science and Engineering Ethics 27, 16 (2021), 1–29.
DOI: Google ScholarCross Ref - [49] . 2023. AI ethics principles in practice: Perspectives of designers and developers. IEEE Transactions on Technology and Society 4, 2 (2023), 171–187.
DOI: Google ScholarCross Ref - [50] . 2020. Artificial intelligence ethics: Ethics of AI and ethical AI. Journal of Database Management 31, 2 (2020), 74–87.
DOI: Google ScholarCross Ref - [51] . 2021. Cognitive biases in developing biased Artificial Intelligence recruitment system. Hawaii International Conference on System Sciences 54 (2021), 5091–5099.Google Scholar
- [52] . 2022. Organisational responses to the ethical issues of artificial intelligence. AI & SOCIETY 37, 1 (2022), 23–37.
DOI: Google ScholarDigital Library - [53] . 2019. Mapping the challenges of artificial intelligence in the public sector: Evidence from public healthcare. Government Information Quarterly 36, 2 (2019), 368–383.
DOI: Google ScholarCross Ref - [54] . 2022. Inclusion on Purpose: An Intersectional Approach to Creating a Culture of Belonging at Work. MIT Press.
DOI: Google ScholarCross Ref - [55] . 2018. The key concepts of ethics of artificial intelligence. In Proceedings of the 2018 IEEE International Conference on Engineering, Technology and Innovation. IEEE, 1–6.
DOI: Google ScholarCross Ref - [56] . 2021. Time for AI (ethics) maturity model is now. arXiv:2101.12701. Retrieved from https://arxiv.org/abs2101.12701Google Scholar
- [57] . 2019. Ethically aligned design: An empirical evaluation of the resolvedd-strategy in software and systems development context. In Proceedings of the 2019 45th Euromicro Conference on Software Engineering and Advanced Applications. IEEE, 46–50.
DOI: Google ScholarCross Ref - [58] . 2019. Implementing ethics in AI: Initial results of an industrial multiple case study. In Product-Focused Software Process Improvement. PROFES, Xavier Franch, Tomi Männistö, and Silverio Martínez-Fernández (Eds.). Lecture Notes in Computer Science, Springer, 331–338.
DOI: Google ScholarCross Ref - [59] . 2020. ECCOLA- A method for implementing ethically aligned AI systems. In Proceedings of the 2020 46th Euromicro Conference on Software Engineering and Advanced Applications. IEEE, 195–204.
DOI: Google ScholarCross Ref - [60] . 2020. “This is just a prototype”: How ethics are ignored in software startup-like environments. In Proceedings of the 21st International Conference on Agile Software Development. Springer International Publishing, 195–210.
DOI: Google ScholarCross Ref - [61] . 2020. The current state of industrial practice in artificial intelligence ethics. IEEE Software 37, 4 (2020), 50–57.
DOI: Google ScholarDigital Library - [62] Ville Vakkuri, Kai-Kristian Kemell, Joni Kultanen, Mikko Siponen, and Pekka Abrahamsson. 2019. Ethically aligned design of autonomous systems: Industry viewpoint and an empirical study. Electronic Journal of Business Ethics and Organization Studies 27, 1 (2022), 4–15.Google Scholar
- [63] . 2018. Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making. In Proceedings of the 2018 CHI conference on Human Factors in Computing Systems. 1–14.
DOI: Google ScholarDigital Library - [64] . 2019. Ethical and societal implications of algorithms, data, and artificial intelligence: A roadmap for research. Nuffield Foundation, London.Google Scholar
- [65] . 2012. Experimentation in Software Engineering. Springer Science & Business Media, Doedrecht.Google ScholarCross Ref
- [66] . 2023. Diversity and inclusion in artificial intelligence. arXiv:2305.12728. Retrieved from https://arxiv.org/abs/2305.12728Google Scholar
Index Terms
- Ethics in the Age of AI: An Analysis of AI Practitioners’ Awareness and Challenges
Recommendations
Ethics of AI: A Systematic Literature Review of Principles and Challenges
EASE '22: Proceedings of the 26th International Conference on Evaluation and Assessment in Software EngineeringEthics in AI becomes a global topic of interest for both policymakers and academic researchers. In the last few years, various research organizations, lawyers, think tankers, and regulatory bodies get involved in developing AI ethics guidelines and ...
What Would You Do? An Ethical AI Quiz
ICSE '23: Proceedings of the 45th International Conference on Software Engineering: Companion ProceedingsThe resurgence of Artificial Intelligence (AI) has been accompanied by a rise in ethical issues. AI practitioners either face challenges in making ethical choices when designing AI-based systems or are not aware of such challenges in the first place. ...
AI ethics: from principles to practice
AbstractMuch of the current work on AI ethics has lost its connection to the real-world impact by making AI ethics operable. There exist significant limitations of hyper-focusing on the identification of abstract ethical principles, lacking effective ...
Comments