Counterfactual evaluation of a public programme for youth-led projects

Journal title RIV Rassegna Italiana di Valutazione
Author/s Vittoria Jacobone, Giuseppe Moro, Caterina Balenzano
Publishing Year 2021 Issue 2019/75
Language Italian Pages 29 P. 87-115 File size 530 KB
DOI 10.3280/RIV2019-075006
DOI is like a bar code for intellectual property: to have more infomation click here

Below, you can see the article first page

If you want to buy this article in PDF format, you can do it, following the instructions to buy download credits

Article preview

FrancoAngeli is member of Publishers International Linking Association, Inc (PILA), a not-for-profit association which run the CrossRef service enabling links to and from online scholarly content.

The article presents an evaluative study of the effects that the youth programme Principi Attivi (PA), implemented in the Apulian Region of Italy, produced in 2010. Specifically, the study focused on 885 project leaders who applied to PA that year, with the aim of evaluating the programme’s impact four years after the completion of the funded projects. A counterfactual research method has been adopted to provide evidence of the net effect on employment, personal and professional empowerment, innovation, planning, and networking skills. Our regression discontinuity design included a comparison group consisting of those who submitted a project but were not granted funding. The study considered only the marginal participants that were positioned around the cut-off point dividing funded and non-funded projects. The results of the study suggest that PA worked mainly as an educational experience on both the personal and professional levels. Even if the programme did not create long-term employment, there was an increase in a range of employability resources for those who participated.

Keywords: Youth Initiative, Innovation, Employability, Cultural Capital, Counterfactual Evaluation, Regression Discontinuity Design

  1. Bagozzi R.P. and Baumgartner H.R. (1994). The Evaluation of Structural Equation Models and Hypothesis Testing. In Bagozzi R.P. , editor, Principles of marketing research (386-422). London: Blackwell.
  2. In Jones S., editor, Doing Internet Research. London: Sage.
  3. Bazzanella A. (2010). Investire nelle nuove generazioni: modelli di politiche giovanili in Italia e in Europa. Trento: Editore Provincia Autonoma di Trento. Bazzanella A., Campagnoli G. (2014). Giovani e politiche giovanili in Italia. Autonomie locali e servizi sociali, 3: 379-402.
  4. Calonico S., Cattaneo M.D., Farrell M.H., Titiunik R. (2016).Regression Discontinuity Designs using covariates, working paper, University of Michigan.
  5. Cameron C. and Moss P. (2011). Social Pedagogy and working with children and young people. Where care and education meet. London: Jessica Kinglsey Publishers.
  6. Connel J.P. and Kubisch A. (1998). Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems. In: Fulbright-Anderson K., Kubisch A.C., Connel J.P., editor, New Approach to Evaluating Community Initiatives: theory, measurement and analysis. Vol.2.Washington: The Anspen Institute
  7. Council of Europe (2003) Revised European Charter on the Participation of Young People in Local and Regional Life. 21 May 2003.
  8. Donati P. (2003). Famiglia e capitale sociale nella società italiana. Cinisello Balsamo: Edizioni San Paolo.
  9. Dubet F. (1994). Sociologie de l'expérience. Paris: Éditions du Seuil.
  10. Dworkin J., Larson R., Hansen D. (2003). Adolescents accounts of growth experiences in youth activities. Journal of Youth and Adolescence, 32 (1): 17-26.
  11. European Commission (2009) An EU Strategy for Youth – Investing and Empowering. A renewed open method of coordination to address youth challenges and opportunities. COM, 2009, 200.
  12. Funnell S.C. and Rogers P.J. (2011). Purposeful program theory. Effective use of theories of change and logic models. San Francisco, CA: Jossey-Bass.
  13. Gallino L. (1988). Dizionario di Sociologia. Milano: Utet.
  14. Gleason, P., Resch, A., & Berk, J. (2018). RD or not RD: Using experimental studies to assess the performance of the regression discontinuity approach. Evaluation review, 42(1), 3-33.
  15. Gliem, J. A., & Gliem, R. R. (2003). Calculating, interpreting, and reporting Cronbach’s alpha reliability coefficient for Likert-type scales. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education.
  16. Hahn, J., Todd, P., & Van der Klaauw, W. (2001). Identification and estimation of treatment effects with a regression‐discontinuity design. Econometrica, 69(1), 201-209.
  17. Hitlin S., Elder G.H.Jr. (2007). Agency: an empirical model of an abstract concept. Advances in Life Course Research, 11: 33-67.
  18. Imbens, G. W., & Lemieux, T. (2008). Regression discontinuity designs: A guide to practice. Journal of econometrics, 142(2), 615-635.
  19. Imbens, G., & Lemieux, T. (2008a). The regression discontinuity design—theory and applications. Journal of Econometrics, , 142(2), 611-614.
  20. Kirton M. (1976). Adaptors and innovators: A description and measure. Journal of Applied Psychology, 61(5): 622-629.
  21. Lavanco G. (2001). Oltre la politica: psicologia di comunità, giovani e partecipazione. Milano: Franco Angeli.
  22. Lee, M. J. (2005). Micro-econometrics for policy, programme, and treatment effects. Oxford: Oxford University Press. Lerner J.V., Phelps E., Forman Y. and Bowers E.P. (2009). Positive Youth Development. In: Lerner R.M. and Steinberg L.D., editor, Handbook of Adolescent Psychology, Individual Bases of Adolescent Development. Hoboken New Jersey: John Wiley & Sons Inc.
  23. Lin N. (2001). Social capital. A theory of social structure and action. Cambridge: Cambridge University Press.
  24. Martini A., Garibaldi P. (1993). L’informazione statistica per il monitoraggio e la valutazione degli interventi di politica del lavoro. Economia e lavoro, 1: 3-22.
  25. Martini, A. and Sisti M. (2009). Valutare il successo delle politiche pubbliche. Bologna: Il Mulino.
  26. Morciano D. (2015). Evaluating outcomes and mechanisms of non-formal education in youth centres. Italian Journal of Sociology of Education, 7(1): 67-96.
  27. Moro G. (2005). La valutazione delle politiche pubbliche. Roma: Carocci.
  28. Moss, B. G., Yeaton, W. H., & LIoyd, J. E. (2014). Evaluating the effectiveness of developmental mathematics by embedding a randomized experiment within a regression discontinuity design. Educational Evaluation and Policy Analysis, 36, 170–185.
  29. Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of educational Psychology, 66(5), 688.
  30. Scardigno F. and Manuti A. (2011). Giovani che partecipano, Una ricerca sulle politiche giovanili della regione Puglia. Roma: Aracne.
  31. Shadish,W.R., Cook, T.D. and Campbel, D.T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston Houghton Mifflin.
  32. Siurala L. (2004). A European framework for youth policy. Council of Europe Publishing.
  33. Trochim W. (1984). Research Design for Program Evaluation: The Regression Discontinuity Approach. Beverly Hills, CA. Sage.
  34. Van Der Klaauw W. (2002). Estimating the effect of financial aid offers on college enrolment: a regression–discontinuity approach. International Economic Review, 43 (4): 1249-1287.
  35. Watts C.E., Caldwell L.L. (2008). Self-Determination and Free Time Activity Participation as Predictors of Initiative. Journal of Leisure, 40(1): 136-181.
  36. Witmer D.F., Colman R.W. and Katzman S.L. (1999). Paper and pencil to screen and keyboard. In Jones S., editor, Doing Internet Research. London: Sage.

  • L'efficacia delle azioni di contrasto alla povertà educativa: dal mito del controfattuale alla tailoring evaluation Caterina Balenzano, in RIV Rassegna Italiana di Valutazione 79/2022 pp.95
    DOI: 10.3280/RIV2021-079006

Vittoria Jacobone, Giuseppe Moro, Caterina Balenzano, Counterfactual evaluation of a public programme for youth-led projects in "RIV Rassegna Italiana di Valutazione" 75/2019, pp 87-115, DOI: 10.3280/RIV2019-075006