skip to main content
10.1145/3428502.3428552acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicegovConference Proceedingsconference-collections
research-article
Open Access

Technology readiness revisited: a proposal for extending the scope of impact assessment of European public services

Published:29 October 2020Publication History

ABSTRACT

The Technology Readiness Level (TRL) scale has been widely adopted at EU, national and regional levels in the current (2014-2020) programming period as a tool for decision making when financing Research, Development and Innovation investments with public grants. We propose the extension and generalisation of this scale in three further directions, namely the Legal, Organisational and Societal Readiness Levels. With the only, partial, exception of the Legal, the three proposed scales closely track the expected progress of Technology Readiness and, in a normative perspective, should be enhanced and supported in any technology take-up pilot aiming to be successful. The resulting, 4-axis framework has been used to assess the potential of new and existing digital technologies to promote innovation in European public services while ensuring cross-border and cross-domain interoperability. We propose the adoption of this framework as a public sector innovation policy tool to evaluate the performance of EU funded Research, Development and Innovation projects in the next programming period 2021--2027.

References

  1. Mihály Héder. 2017. From NASA to EU: the evolution of the TRL scale in Public Sector Innovation. The Innovation Journal: The Public Sector Innovation Journal 22, 2 (2017), 1--23. ISSN: 1715-3816Google ScholarGoogle Scholar
  2. European Commission. 2014 ff. Horizon 2020 Work Programme(s) General Annex G "Technology readiness levels (TRL)".Google ScholarGoogle Scholar
  3. European Commission, New European Interoperability Framework Promoting seamless services and data flows for European public administrations, EIF brochure, ISBN 978-92-79-63756-8.Google ScholarGoogle Scholar
  4. User-centricity principles for design and delivery of digital public services. Annex to the Tallinn Declaration on eGovernment at the ministerial meeting during Estonian Presidency of the Council of the EU on 6 October 2017. Retrieved September 2019 from https://ec.europa.eu/newsroom/document.cfm?doc_id=47559Google ScholarGoogle Scholar
  5. João Batista Sarmento dos Santos-Neto and Ana Paula Cabral Seixas Costa. 2019. Enterprise Maturity Models: A Systematic Literature Review. Enterprise Information Systems 13, 5 (2019), 719--769, DOI:10.1080/17517575.2019.1575986Google ScholarGoogle ScholarCross RefCross Ref
  6. Diogo Proença and José Borbinha. 2016. Maturity Models for Information Systems - A State of the Art. Procedia Computer Science 100 (2016), 1042--1049. DOI: 10.1016/j.procs.2016.09.279.Google ScholarGoogle ScholarCross RefCross Ref
  7. Hamad Al-Muftah, Vishanth Weerakkody and Uthayasankar Sivarajah. 2016. Comparing and Contrasting e-Government Maturity Models: A Qualitative -Meta Synthesis. In Electronic Government and Electronic Participation, H.J. Scholl et al. (Eds.), IOS Press, 69--79. DOI:10.3233/978-1-61499-670-5-69Google ScholarGoogle Scholar
  8. Pedro Torrinha and Ricardo José Machado. 2017. Assessment of Maturity Models for Smart Cities Supported by Maturity Model Design Principles. In IEEE International Conference on Smart Grid and Smart Cities (ICSGSC), Singapore, 252--256. DOI: 10.1109/ICSGSC.2017.8038586Google ScholarGoogle ScholarCross RefCross Ref
  9. John C. Mankins. 2009. Technology Readiness Assessments: A Retrospective. Acta Astronautica 65, 1216--1223. DOI: 10.1016/j.actaastro.2009.03.058Google ScholarGoogle ScholarCross RefCross Ref
  10. United States Department of Energy. 2009. Technology Readiness Assessment Guide, Washington, DC 20585. Retrieved September 2019 from https://www.directives.doe.gov/directives-documents/400-series/0413.3-EGuide-04@@images/fileGoogle ScholarGoogle Scholar
  11. Pieter Bjørn Larsen, Els Van de Velde, Eveline Durinck, Henrik Noes Piester, Leif Jakobsen and Hanne Shapiro. 2011. Cross-sectoral Analysis of the Impact of International Industrial Policy on Key Enabling Technologies. A Study for the European Commission, DG Enterprise and Industry. Danish Technological Institute and Idea Consult. Retrieved September 2019 from https://publications.europa.eu/en/publication-detail/-/publication/713f63c6-9d8a-4680-99f3-de63d489e79e/language-enGoogle ScholarGoogle Scholar
  12. The Technology Readiness Index primer, 2014. Retrieved December 2019 from https://rockresearch.com/technology-readiness-index-primer/Google ScholarGoogle Scholar
  13. Innovation Fund Denmark. 2018. Societal Readiness Levels (SRL) defined. Retrieved February 2019 from https://innovationsfonden.dk/sites/default/files/2018-08/societal_readiness_levels_-_srl.pdfGoogle ScholarGoogle Scholar
  14. Eleanor D. Glor. 2014. Studying the Impact of Innovation on Organizations, Organizational Populations and Organizational Communities: A Framework for Research. The Innovation Journal: The Public Sector Innovation Journal 19(3), 2014, article 1. Retrieved April 2019 from: https://www.innovation.cc/scholarly-style/2014_19_3_1_glor_framework-inovate491-c.pdfGoogle ScholarGoogle Scholar
  15. JRC (Joint Research Centre) and EIT (European Institute of Technology). 2018. Legal and Regulatory Implications of Artificial Intelligence (AI): The Case of Autonomous Vehicles, E-health and Data Mining. Workshop held on 23 November 2018 in Brussels, European Commission. Retrieved April 2019 from: https://ec.europa.eu/jrc/en/event/workshop/legal-and-regulatory-implications-artificial-intelligence-aiGoogle ScholarGoogle Scholar
  16. Christopher Bauer. 2004. An Ethics Self-Exam: Ethical Compliance is not just an Issue for External Review; Auditors must look inward to ensure their own Integrity is not compromised". CNET website (archived). Retrieved April 2019 from: http://findarticles.com/p/articles/mi_m4153/is_3_61/ai_n6153200Google ScholarGoogle Scholar

Index Terms

  1. Technology readiness revisited: a proposal for extending the scope of impact assessment of European public services

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        ICEGOV '20: Proceedings of the 13th International Conference on Theory and Practice of Electronic Governance
        September 2020
        880 pages
        ISBN:9781450376747
        DOI:10.1145/3428502

        Copyright © 2020 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 October 2020

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        ICEGOV '20 Paper Acceptance Rate79of209submissions,38%Overall Acceptance Rate350of865submissions,40%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader