Abstract
The article reviews the state of institutionalisation of evaluation in Chile not only from the perspective of the state but also from the role of civil society and other related actors. This is what it develops: Institutional Structures and Processes (political system); Dissemination in society and acceptance (social system), and the Professionalization System. The methodology of the study was based on a review of the available literature and interviews with experts and key actors in the field of evaluation in Chile.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The Management Control System working with Strategic Definitions, the Management Improvement Programme, Performance Indicators, Integral Management Balance and Competitive Funds, among others, illustrate this.
- 2.
The mission of ODEPLAN was to promote and organise the planning system at national, sectoral and regional levels. See: https://www.casamuseoeduardofrei.cl/objeto-del-mes-nacimiento-de-la-oficina-de-planificacion-nacional/. Accessed on 03 November 2020.
- 3.
See: Integrated Project Bank: https://bip.ministeriodesarrollosocial.gob.cl, accessed on 10 August 2019.
- 4.
This Committee aims to ensure that the carrying-out of evaluations is consistent with government policies; that conclusions arising from this process are known by the institutions that comprise it and; that the necessary technical support and coordination are available for its proper development, especially in the process of program selection and selection of consultants.
- 5.
It is especially up to it to carry out the process of selection of the programmes to be evaluated; definition of methodological and operational designs; provision of resources for its operation; management of the operation; analysis and approval of the progress and final reports indicating the observations that it deems appropriate; reception and submission of evaluation reports to the National Congress and public institutions; integration of evaluation results into the budget cycle and; establishment of institutional commitments to improve the programmes evaluated.
- 6.
This line evaluates the consistency of the objectives and design of the programme, aspects of its organisation and management and results at the product level (coverage, targeting, among others).
- 7.
Its goal is to evaluate design and institutional management, as well as the results and use of resources regarding the supply of strategic products of the institution.
- 8.
The focus is on evaluating intermediate and final results. Experimental or quasi-experimental methodologies are used, and information is collected through surveys, focus groups and interviews, among others.
- 9.
Through this line, evaluations focus on specific areas of programme performance: (i) strategy design, (ii) costs and (iii) implementation. Due to the fact that evaluations are narrower and shorter, results are more appropriately delivered.
- 10.
Each of these areas is defined as follows:
• Design: verifies the validity of the problem identified and the intervention strategy of each programme.
• Implementation: refers to the analysis of the focus of the programme, as well as the identification of gaps between the theoretical design and its execution.
• Efficiency: refers to an evaluative analysis of the cost of producing the goods or services.
• Results: verifies results at purpose level, in relation to changes in the situation of beneficiaries as an effect of the delivery of the goods or services of the programme (DIPRES 2019, p. 6).
- 11.
On each relevant area, the DIPRES prepares an evaluative judgment (Sufficient, Insufficient, Not Concluding). Based on these judgments, programmes are classified into four performance categories that also consider seniority as a proxy for the level of maturity of the programme: Good Performance, Medium Performance, Low Performance and Bad Performance (DIPRES 2019, p. 6).
- 12.
Regarding the coverage by ministry (1999–2017), the only ministry having carried out annual evaluations during the entire period analysed is the Ministry of Education. On average, the annual coverage reaches 2.7%, with a maximum of 9.9% in 2011. The average coverage of the Ministry of Health is 8.4%, with a maximum of 88.9% in 2011 for the evaluation of the National Health Fund. In the Ministry of Labor and Social Security, the average coverage is 6.1%, with a maximum of 88.7% in 2007, concerning the evaluation of the National Welfare Institution. Other ministries that have had evaluations in almost every year of the period analysed are the Ministry of Interior and Public Security and the Ministry of Social and Family Development. In the first case, in 17 of the 19 years analysed, evaluations are observed and the annual average coverage is 3.8%. In the second case, evaluations are observed in 18 years and the average annual coverage is 13.8%. (Darville et al., 2017, pp. 30f.).
Abbreviations
- BIP:
-
Integrated Bank of Projects
- BIPS:
-
Integrated Bank of Social Programmes
- CLAD:
-
Latin American Centre for Development Administration
- DIPRES:
-
Budget Office
- EFA:
-
Focalized Scope Evaluation
- EGI:
-
Evaluation of Institutional Expenditure
- EI:
-
Impact Evaluation
- EPG:
-
Evaluation of Government Programmes
- EvalChile:
-
Chilean Evaluation Network
- MDSF:
-
Ministry of Social Development and Family
- M&E:
-
Monitoring and Evaluation
- ODEPLAN:
-
National Planning Office
- SEIA:
-
Environmental Impact Assessment System
- VOPE:
-
Voluntary Organisation for Professional Evaluators
References
BIPS. (2018). Budget of social programmes BIPS. https://programassociales.ministeriodesarrollosocial.gob.cl/programas. Accessed on 2 August 2020.
CLEAR. (2017). Semana de la evaluación en América Latina y el Caribe 2017, Proceedings. Centro de Investigación y Docencia Económica, Centro para el Aprendizaje en Evaluación y Resultados para América Latina y el Caribe. https://clear-lac.org/wp-content/uploads/2019/09/18.-Memorias-EVAL2017.pdf. Accessed on 11 August 2019.
CLEAR. (2018). Semana de la evaluación en América Latina y el Caribe 2018, Proceedings. Centro de Investigación y Docencia Económica, Centro para el Aprendizaje en Evaluación y Resultados para América Latina y el Caribe. https://clear-lac.org/wp-content/uploads/2019/09/19.-Memorias-EVAL2018_web.pdf. Accessed 10 August 2019.
Darville, P., Díaz, R., & Leiva, J. (2017). Cobertura evaluación de programas e instituciones públicas. Departamento de Evaluación. División de Control de Gestión Pública. Ministerio de Hacienda. Gobierno de Chile.
Decreto Ley Número 1.263 Orgánico de la administración financiera del Estado. https://www.bcn.cl/leychile/navegar?idNorma=6536&idVersion=2020-04-02&idParte=8746724. Accessed on 15 August 2019.
DIPRES. (2019). Evaluation results. Second Quarter 2019. Ministerio de Hacienda. Gobierno de Chile.
Dussange, M. (2011). Chile's monitoring and evaluation system, 1994–2010 (English). PREM notes; no. 14. Special series on the nuts and bolts of m&e systems. World Bank. http://documents.worldbank.org/curated/en/740771468225872299/Chiles-monitoring-and-evaluation-system-1994-2010. Accessed on 5 August 2019.
EvalChile. (2018). Informe de rendición de cuentas 2017–2018. Internal document. Santiago de Chile.
Irarrazaval, I., & De los Rios, B. (2015). Una construcción dinámica: El sistema de monitoreo y evaluación de Chile. In G. Pérez Yarahuán & C. Maldonado Trujillo (Eds.), Panorama de los sistemas nacionales de monitoreo y evaluación en América Latina (pp. 113–148). Centro de Investigación y Docencia Económicas-Centro CLEAR para América Latina. México.
Ley 20,285. 11-August 2008. Ministerio Secretaría General de la Presidencia—Ley Chile—Biblioteca del Congreso Nacional. https://www.bcn.cl/leychile/navegar?idNorma=276363
Ley N° 20530. 13-October 2011. Ministerio de Planificación—Ley Chile—Biblioteca del Congreso Nacional. https://www.bcn.cl/leychile/navegar?idNorma=1030861&idParte=9193568&idVersion=2019-04-16. Accessed on 10 August 2019.
Ministerio de Desarrollo Social y Familia. (2019). www.programassociales.cl/2019. Accessed on 14 August 2019.
MDSF. (2019). Consejo de la Sociedad Civil. http://participacionciudadana.ministeriodesarrollosocial.gob.cl/consejo-de-la-sociedad-civil/consejo-de-la-sociedad-civil. Accessed on 11 October 2019.
OECD. (2012). La evaluación de leyes y regulaciones. El caso de la cámara de diputados de Chile. https://www.oecd-ilibrary.org/governance/la-evaluacion-de-leyes-y-regulaciones_9789264176362-es. OECD Publishing. Accessed on 7 August 2019.
Olavarria, C., & Peroni, A. (2012). La evaluación en el Estado Chileno, Avances y Desafíos. Revista Políticas Públicas, 4(2), 5–20, Universidad de Santiago de Chile.
Ríos Hess, S. (2007). Fortalecimiento de los sistemas de monitoreo y evaluación en América Latina, diagnostico de los sistemas de monitoreo y evaluación en Chile. CLAD-BID.
Rodríguez Billela, P. (2018). Más de cuarenta posgrados en evaluación en América Latina y el Caribe. Al borde del caos. https://albordedelcaos.com/2018/05/17/mas-de-cuarenta-posgrados-en-evaluacion-en-america-latina-y-el-caribe/. Accessed on 15 August 2019.
Rodríguez-Bilella, P., Valencia, S. M., Alvarez, L. S., Klier, S. D., Hernández, A. L. G., & Tapella, E. (2016). Estándares de evaluación para América Latina y el Caribe. Ciudad Autónoma de Buenos Aires.
Sánchez, C., & Miranda, D. (2019). Experiencias de evaluación participativa en intervenciones del programa Servicio País (Chile). Incorporando a la comunidad en la evaluación de programas sociales. https://evalparticipativa.files.wordpress.com/2019/05/piloto-evaluaciones-participativas-en-servicio-pac3ads-tapa.pdf. Accessed on 12 August 2019.
Servicio de Evaluación Ambiental. (2019). ¿Qué es SEIA? https://www.sea.gob.cl/sea/que-es-seia. Accessed on 7 August 2019.
TECHO. (2019). Informe de evaluación de la mesa de trabajo del campamento Santa Teresa. https://evalparticipativa.files.wordpress.com/2019/05/informe-de-evaluacic3b3n-de-la-mesa-de-trabajo-del-campamento-de-santa-teresa.pdf. Accessed on 8 August 2019.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Olavarría Manríquez, C., Peroni Fiscarelli, A. (2022). Evaluation in Chile. In: Stockmann, R., Meyer, W., Szentmarjay, L. (eds) The Institutionalisation of Evaluation in the Americas. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-81139-6_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-81139-6_6
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-030-81138-9
Online ISBN: 978-3-030-81139-6
eBook Packages: Political Science and International StudiesPolitical Science and International Studies (R0)