Skip to main content
SpringerLink
Log in

End-User Development for Artificial Intelligence: A Systematic Literature Review

  • Conference paper
  • First Online:
End-User Development (IS-EUD 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13917))

Included in the following conference series:

Abstract

In recent years, Artificial Intelligence has become more and more relevant in our society. Creating AI systems is almost always the prerogative of IT and AI experts. However, users may need to create intelligent solutions tailored to their specific needs. In this way, AI systems can be enhanced if new approaches are devised to allow non-technical users to be directly involved in the definition and personalization of AI technologies. End-User Development (EUD) can provide a solution to these problems, allowing people to create, customize, or adapt AI-based systems to their own needs. This paper presents a systematic literature review that aims to shed the light on the current landscape of EUD for AI systems, i.e., how users, even without skills in AI and/or programming, can customize the AI behavior to their needs. This study also discusses the current challenges of EUD for AI, the potential benefits, and the future implications of integrating EUD into the overall AI development process.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    The publication also presents an approach based on text: for the goal of this study, only the component-based approach is considered interesting.

References

  1. Chui, M., Hall, B., Mayhew, H., Singla, A., Sukharevsky, A.: The state of AI in 2022—and a half decade in review. Survey, McKinsey Global Institute (2022)

    Google Scholar 

  2. Google Trends: AI, chat GPT - Explore - Google Trends. https://trends.google.com/trends/explore?date=2022-11-01%202023-03-14&q=ai,chat%20gpt&hl=en-US. Accessed 14 Mar 2023

  3. Gresse von Wangenheim, C., Hauck, J.C.R., Pacheco, F.S., Bertonceli Bueno, M.F.: Visual tools for teaching machine learning in K-12: a ten-year systematic mapping. Educ. Inf. Technol. 26(5), 5733–5778 (2021). https://doi.org/10.1007/s10639-021-10570-8

    Article  Google Scholar 

  4. Hauck, M., Machhamer, R., Czenkusch, L., Gollmer, K.-U., Dartmann, G.: Node and block-based development tools for distributed systems with AI applications. IEEE Access 7, 143109–143119 (2019). https://doi.org/10.1109/ACCESS.2019.2940113

    Article  Google Scholar 

  5. Lacerda Queiroz, R., Ferrentini Sampaio, F., Lima, C., Machado Vieira Lima, P.: AI from concrete to abstract. AI Soc. 36(3), 877–893 (2021). https://doi.org/10.1007/s00146-021-01151-x

    Article  Google Scholar 

  6. Kitchenham, B.A.: Procedures for Performing Systematic Reviews. Joint Technical Report, Department of Computer Science, Keele University and National ICT, Australia Ltd (2004)

    Google Scholar 

  7. Forbes: The most disruptive Trend of 2021: No Code/Low Code. Accessed 15 Mar 2023

    Google Scholar 

  8. Bock, A.C., Frank, U.: Low-code platform. Bus. Inf. Syst. Eng. 63(6), 733–740 (2021). https://doi.org/10.1007/s12599-021-00726-8

    Article  Google Scholar 

  9. Sufi, F.: Algorithms in low-code-no-code for research applications: a practical review. Algorithms 16, 108 (2023). https://doi.org/10.3390/a16020108

  10. Wohlin, C.: Guidelines for snowballing in systematic literature studies and a replication in software engineering. In: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering (EASE 2014). Association for Computing Machinery (2014). https://doi.org/10.1145/2601248.2601268

  11. Sanctorum, A., et al.: End-user engineering of ontology-based knowledge bases. Behav. Inform. Technol. 41, 1811–1829 (2022). https://doi.org/10.1080/0144929X.2022.2092032

    Article  Google Scholar 

  12. Paternò, F.: teaching end-user development in the time of IoT and AI. In: Ardito, C., et al. (eds.) INTERACT 2021. LNCS, vol. 13198, pp. 257–269. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-98388-8_23

    Chapter  Google Scholar 

  13. Iyer, C.V.K., et al.: Trinity: a no-code AI platform for complex spatial datasets. In: Proceedings of the 4th ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery, pp. 33–42. Association for Computing Machinery, Beijing, China (2021). https://doi.org/10.1145/3486635.3491072

  14. Rough, D., Cowan, B.: Poster: APIs for IPAs? Towards end-user tailoring of intelligent personal assistants. In: 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 1–2 (2020). https://doi.org/10.1109/VL/HCC50065.2020.9127267

  15. Piro, L., Desolda, G., Matera, M., Lanzilotti, R., Mosca, S., Pucci, E.: An interactive paradigm for the end-user development of chatbots for data exploration. In: Ardito, C., et al. (eds.) INTERACT 2021. LNCS, vol. 12935, pp. 177–186. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85610-6_11

    Chapter  Google Scholar 

  16. Mishra, S., Arunkumar, A.: How robust are model rankings: a leaderboard customization approach for equitable evaluation. Proc. AAAI Conf. Artif. Intell. 35, 13561–13569 (2021). https://doi.org/10.1609/aaai.v35i15.17599

    Article  Google Scholar 

  17. Bunt, A., Conati, C., McGrenere, J.: Mixed-Initiative interface personalization as a case study in usable AI. AI Mag. 30, 58 (2010). https://doi.org/10.1609/aimag.v30i4.2264

    Article  Google Scholar 

  18. Redchuk, A., Walas Mateo, F.: New business models on artificial intelligence—the case of the optimization of a blast furnace in the steel industry by a machine learning solution. Appl. Syst. Innov, 5, 6 (2022). https://doi.org/10.3390/asi5010006

  19. Sunil Kumar, J., Shashank Mayurkumar, J., Sachin, S.K., Saurabh, P., Amine, B., Shivam, G.: How to use no-code artificial intelligence to predict and minimize the inventory distortions for resilient supply chains. Int. J. Prod. Res.. 1–25 (2023). https://doi.org/10.1080/00207543.2023.2166139

  20. Agassi, A., Erel, H., Wald, I.Y., Zuckerman, O.: Scratch Nodes ML: A playful system for children to create gesture recognition classifiers. In: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1--6. Association for Computing Machinery (2019). https://doi.org/10.1145/3290607.3312894

  21. Alturayeif, N., Alturaief, N., Alhathloul, Z.: DeepScratch: Scratch programming language extension for deep learning education. Int. J. Adv. Comput. Sci. Appl. 11 (2020). https://doi.org/10.14569/IJACSA.2020.0110777

  22. Carney, M., et al.: Teachable machine: approachable web-based tool for exploring machine learning classification. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1--8. Association for Computing Machinery (2020). https://doi.org/10.1145/3334480.3382839

  23. Godec, P., et al.: Democratized image analytics by visual programming through integration of deep models and small-scale machine learning. Nat. Commun. 10, 4551 (2019). https://doi.org/10.1038/s41467-019-12397-x

    Article  Google Scholar 

  24. Kahn, K., Megasari, R., Piantari, E., Junaeti, E.: AI programming by children using Snap! block programming in a developing country. In: Practitioner Proceedings of the 13th European Conference On Technology Enhanced Learning, vol. 2193. CEUR-WS, Leeds, UK (2018)

    Google Scholar 

  25. Moin, A., Mituca, A., Challenger, M., Badii, A., Gunnemann, S.: ML-Quadrat & DriotData: a model-driven engineering tool and a low-code platform for smart IoT services. In: Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings, pp. 144--148. Association for Computing Machinery (2022). https://doi.org/10.1145/3510454.3516841

  26. Rao, A., Bihani, A., Nair, M.: Milo: A visual programming environment for data science education. In: 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 211–215 (2018). https://doi.org/10.1109/VLHCC.2018.8506504

  27. Rodríguez García, J.D., Moreno-León, J., Román-González, M., Robles, G.: LearningML: a tool to foster computational thinking skills through practical artificial intelligence projects. Revista de Educación a Distancia (RED) 20 (2020). https://doi.org/10.6018/red.410121

  28. Shaikh, K.: AI with Low Code. Demystifying Azure AI: Implementing the Right AI Features for Your Business, pp. 151--182. Apress (2020). https://doi.org/10.1007/978-1-4842-6219-1_5

  29. Tamilselvam, S.G., Panwar, N., Khare, S., Aralikatte, R., Sankaran, A., Mani, S.: A visual programming paradigm for abstract deep learning model development. In: Proceedings of the 10th Indian Conference on Human-Computer Interaction. Association for Computing Machinery (2019). https://doi.org/10.1145/3364183.3364202

  30. Xie, C., Qi, H., Ma, L., Zhao, J.: DeepVisual: a visual programming tool for deep learning systems. In: Proceedings of the 27th International Conference on Program Comprehension, pp. 130--134. IEEE Press (2019). https://doi.org/10.1109/ICPC.2019.00028

  31. Zimmermann-Niefield, A., Turner, M., Murphy, B., Kane, S.K., Shapiro, R.B.: Youth learning machine learning through building models of athletic moves. In: Proceedings of the 18th ACM International Conference on Interaction Design and Children, pp. 121--132. Association for Computing Machinery (2019). https://doi.org/10.1145/3311927.3323139

  32. Zimmermann-Niefield, A., Polson, S., Moreno, C., Shapiro, R.B.: Youth making machine learning models for gesture-controlled interactive media. In: Proceedings of the Interaction Design and Children Conference, pp. 63--74. Association for Computing Machinery (2020). https://doi.org/10.1145/3392063.3394438

  33. Barricelli, B.R., Cassano, F., Fogli, D., Piccinno, A.: End-user development, end-user programming and end-user software engineering: a systematic mapping study. J. Syst. Softw. 149, 101–137 (2019). https://doi.org/10.1016/j.jss.2018.11.041

    Article  Google Scholar 

  34. Madakam, S., Ramaswamy, R., Tripathi, S.: Internet of Things (IoT): a literature review. J. Comput. Commun. 3, 164–173 (2015). https://doi.org/10.4236/jcc.2015.35021

    Article  Google Scholar 

  35. Sharp, H., Rogers, Y., Preece, J.: Interaction Design: Beyond Human-Computer Interaction. John Wiley & Sons (2019)

    Google Scholar 

  36. Jauhar, S.K., Jani, S.M., Kamble, S.S., Pratap, S., Belhadi, A., Gupta, S.: How to use no-code artificial intelligence to predict and minimize the inventory distortions for resilient supply chains. Int. J. Prod. Res. 1–25 (2023). https://doi.org/10.1080/00207543.2023.2166139

  37. Shneiderman, B.: Human-Centered AI. Oxford University Press, Oxford (2022)

    Google Scholar 

  38. Schmidt, A., Herrmann, T.: Intervention user interfaces: a new interaction paradigm for automated systems. Interactions 24, 40–45 (2017). https://doi.org/10.1145/3121357

    Article  Google Scholar 

  39. Kreuzberger, D., Kühl, N., Hirschl, S.: Machine Learning Operations (MLOps): Overview, definition, and architecture. arXiv:2205.02302 (2022)

    Google Scholar 

  40. Berthold, M.R., et al.: KNIME: the Konstanz Information Miner. In: Proceedings of the 31st Annual Conference of the Gesellschaft für Klassifikation e.V. (GfKI 2007), pp. 319–326. Springer Berlin Heidelberg, (2007). https://doi.org/10.1007/978-3-540-78246-9_38

  41. Desolda, G., Ardito, C., Matera, M.: Empowering end users to customize their smart environments: model, composition paradigms, and domain-specific tools. ACM Trans. Comput.-Hum. Interact. 24, 12 (2017). https://doi.org/10.1145/3057859

  42. Ghiani, G., Manca, M., Paternò, F., Santoro, C.: Personalization of Context-dependent applications through trigger-action rules. ACM Trans. Comput.-Hum. Interact. 24, 14 (2017). https://doi.org/10.1145/3057861

Download references

Acknowledgment

The research of Andrea Esposito is funded by a Ph.D. fellowship within the framework of the Italian “D.M. n. 352, April 9, 2022” - under the National Recovery and Resilience Plan, Mission 4, Component 2, Investment 3.3 - Ph.D. Project “Human-Centered Artificial Intelligence (HCAI) techniques for supporting end users interacting with AI systems”, co-supported by “Eusoft S.r.l.” (CUP H91I22000410007).

The research of Rosa Lanzilotti is partially supported by the co-funding of the European union - Next Generation EU: NRRP Initiative, Mission 4, Component 2, Investment 1.3 – Partnerships extended to universities, research centers, companies, and research D.D. MUR n. 341 del 15.03.2022 – Next Generation EU (PE0000013 – “Future Artificial Intelligence Research – FAIR” - CUP: H97G22000210007).

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Bari Aldo Moro, Bari, Italy

    Andrea Esposito, Miriana Calvano, Antonio Curci, Giuseppe Desolda, Rosa Lanzilotti, Claudia Lorusso & Antonio Piccinno

Authors
  1. Andrea Esposito
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Miriana Calvano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Antonio Curci
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Giuseppe Desolda
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rosa Lanzilotti
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Claudia Lorusso
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Antonio Piccinno
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Esposito .

Editor information

Editors and Affiliations

  1. University of Cagliari, Cagliari, Italy

    Lucio Davide Spano

  2. LMU Munich, Munich, Germany

    Albrecht Schmidt

  3. ISTI-CNR, Pisa, Italy

    Carmen Santoro

  4. University of Glasgow, Glasgow, UK

    Simone Stumpf

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Esposito, A. et al. (2023). End-User Development for Artificial Intelligence: A Systematic Literature Review. In: Spano, L.D., Schmidt, A., Santoro, C., Stumpf, S. (eds) End-User Development. IS-EUD 2023. Lecture Notes in Computer Science, vol 13917. Springer, Cham. https://doi.org/10.1007/978-3-031-34433-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34433-6_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34432-9

  • Online ISBN: 978-3-031-34433-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation