21801908 - QUANTITATIVE EVALUATION METHODS FOR PUBLIC POLICIES

The course aims to provide students with the knowledge and understanding of the quantitative and statistical tools through which the evaluation of the public services and policies is normally carried out. The relevance of this course is directly correlated with the increasing importance at the national (Evaluation Board) and European level (Structural Funds).

Curriculum

teacher profile | teaching materials

Programme

Part One

Section 1
The key concepts of public policy evaluation. The relationships between input, output and outcome. The indicators and statistical techniques at the various stages of evaluation: ex-ante, on-going and ex-post.
Section 2
Statistical references for the analysis of the evaluation of effects.
Evaluation of the effects of investment aid policies: experimental and non-experimental methods. the counterfactual approach and models used in the non-experimental methods. Case studies and examples.
Section 3
The European Union's regional policies and Structural Funds. The evaluation of structural policies.

Part Two

Section 4
The concepts of efficiency, productivity, economy, effectiveness, quality and sustainability. A brief overview of production or cost functions in the PA and DEA. Case studies and examples.
Section 5
The ex-ante evaluation of public investment projects. Feasibility studies. Swot Analysis. Cost-benefit analysis. Multicriteria analysis. Example methods and cases.
Regulatory impact assessment in Italy: technical instrumentation and experience gained.

Core Documentation

Learning Material
Part One
Section 1
Texts 1 (A):

A1. A. Martini, M. Sisti, "A ciascuno il suo. Cinque modi di intendere la valutazione in ambito pubblico", Informaires, n.33, Dicembre 2007, pp. 1-9.
https://dokodoc.com/queue/a-ciascuno-il-suo-cinque-modi-di-intendere-la-valutazione-in.html

A3. M. De Castris, Le fonti statistiche per l’analisi e la valutazione delle politiche, Dispense didattiche, Roma, 2015.
A5. European Commission (2013) EVALSED GUIDE: The resource for the evaluation of Socio-Economic Development. cap. 4 Choosing methods and techniques par. Acquiring and using data in evaluation; Creating Indicators and indicator systems pp. 81-88. http://ec.europa.eu/regional_policy/sources/docgener/evaluation/guide/guide_evalsed.pdf

Section 2
Texts 2 E

E1. A. Martini, M. Sisti (2009), Valutare il successo delle politiche pubbliche, Il Mulino, capp. VI, VII, IX, X, XI, XII.
Lettura integrativa:
E2. Formez (2006) Valutare gli effetti delle politiche pubbliche. Metodi e applicazioni al caso italiano. Collana Materiali, Roma. Parte prima. (http://costopa.formez.it/sites/all/files/Valutare%20gli%20effetti%20dellle%20politiche%20pubbliche.pdf)
Un manuale di statistica per rivedere concetti di base modello di regressione.
Per esempio: Borra Di Ciaccio “Statistica: Metodologie per le scienze economiche e sociali”, McGraw-Hill Education, 2015. Gary Koop “Logica statistica dei dati economici”, Utet, 2001.

Section 3
Texts 3 C:
C1 V. Pupo (2003) La valutazione delle politiche strutturali, Rubbettino.cap.3 (pp. 53-78).
C2. F. Busillo, T. Muccigrosso, G. Pellegrini, O. Tarola, F. Terribile (2010) L’impatto della politica regionale sulla crescita delle regioni europee: un approccio basato sul regression discontinuity design. Collana UVAL-DPS, Analisi e studi, N.20. http://www.agenziacoesione.gov.it/opencms/export/sites/dps/it/documentazione/servizi/materiali_uval/analisi_e_studi/MUVAL_20_Politica_regionale_europea.pdf)
Part Two
Section 4
Texts 4 (B):
B2. F. Vidoli, Metodi di stima dell’efficienza produttiva e di costo. Rassegna delle principali tecniche di stima ed applicazioni in ambito pubblico. Dispense ad uso didattico, febbraio 2015.

Section 5
Texts 5 D:
D1. Commissione Europea (2003) Guida all’analisi costi-benefici dei progetti di investimento, Bruxelles. capp. 1, 2. (http://ec.europa.eu/regional_policy/sources/docgener/guides/cost/guide02_it.pdf).
D3. C. Mazziotta(2011), “La strumentazione quantitativa per l’analisi di impatto della regolazione. Questioni di metodo e applicazioni”, in M. De Benedetto (a cura di), Spiagge in cerca di regole, Collana Arel, Il Mulino, Bologna.
D4. European Commission (2013) Evalsed Sourcebook: Method and Techniques cap.11 Multi-criteria Analysis 129-136; cap. 15 Swot Analysis pp.161-164. http://ec.europa.eu/regional_policy/sources/docgener/evaluation/guide/guide_evalsed.pdf
D5. C. Mazziotta (2011), Cenni introduttivi sull’analisi multicriteri, Dispense ad uso didattico, Roma.
Integrazione per il programma da 9 CFU, a scelta:
M. Sisti (2006) Gli effetti della legge 27/93 della Regione Toscana sull’imprenditoria giovanile, di pp.199-226 in Formez (2006) Valutare gli effetti delle politiche pubbliche. Metodi e applicazioni al caso italiano. Collana Materiali, Roma. ((http://costopa.formez.it/sites/all/files/Valutare%20gli%20effetti%20dellle%20politiche%20pubbliche.pdf)

N.B. Supplementary materials are available at the copy shop: 4Appunti , via Chiabrera, 174, tel. 06.59605579.


Reference Bibliography

Ugo Trivellato La valutazione degli effetti di politiche pubbliche: paradigma e pratiche IRVAPP Working Paper No. 2009-01. (https://irvapp.fbk.eu/wp-content/uploads/2017/09/FBK-IRVAPP-Working-Paper-No.-2009_01-2.pdf)

Type of delivery of the course

Class lectures and seminars on the main topics.

Attendance

The student who chooses to attend the lessons will have the opportunity to acquire quantitative tools in the classroom to facilitate the understanding of the course topics.

Type of evaluation

SUMMER SESSION 2019/20 June-July 2020- HEALTH EMERGENCY COVID-19 WEB-BASED EXAMINATION In the period, June-July 2020, due to the emergency measures imposed by the Covid-19 pandemic, a 1-hour exam (written test) will be administered through the Moodle platform of the course. Students who pass the test can participate in the oral examination. The examination consists of a written test on the first part of the programme and an oral test on the whole programme. The written test, together with the oral test, will help determine the final grade. The passed written test will be valid only for the summer session a.y. 2019/20. The written test consists of exercises and open questions. The duration of the written test is 1 hour. Only students with a grade equal to or higher than 18/30 on the written test will be admitted to the oral exam. The written test will be uploaded to the Moodle platform in the quiz section. The oral test consists of questions on the scheduled topics aimed at verifying knowledge of concepts. The final grade takes the written and oral results into account. Students who have taken and passed the written test in previous session examinations will only take the oral test. NORMAL CONDITIONS The student takes a written test of the first part of the program. The results of the writings remain valid for the following sessions. After passing the first part, the second part can be supported either orally or in writing. The student may take a written examination for the second part as well, but in an appeal subsequent to that in which the first part sustains. Only for students attending the current academic year, a partial trial on the first part is planned. The written tests, together with an oral test, will help determine the final mark. The oral examination will be taken during one of the appeals of the examination sessions. Students who take part in the partial exam and fail it will not be able to take the exam in the first two appeals of the summer session. The student has the faculty not to give the exam to maintain the right to take the exam in two of the three appeals of the summer session. The passed tests are valid for two academic years.

teacher profile | teaching materials

Mutuazione: 21801908 METODI QUANTITATIVI DI VALUTAZIONE DELLE POLITICHE PUBBLICHE in Scienze delle pubbliche amministrazioni LM-63 N0 DE CASTRIS MARUSCA

Programme

Part One

Section 1
The key concepts of public policy evaluation. The relationships between input, output and outcome. The indicators and statistical techniques at the various stages of evaluation: ex-ante, on-going and ex-post.
Section 2
Statistical references for the analysis of the evaluation of effects.
Evaluation of the effects of investment aid policies: experimental and non-experimental methods. the counterfactual approach and models used in the non-experimental methods. Case studies and examples.
Section 3
The European Union's regional policies and Structural Funds. The evaluation of structural policies.

Part Two

Section 4
The concepts of efficiency, productivity, economy, effectiveness, quality and sustainability. A brief overview of production or cost functions in the PA and DEA. Case studies and examples.
Section 5
The ex-ante evaluation of public investment projects. Feasibility studies. Swot Analysis. Cost-benefit analysis. Multicriteria analysis. Example methods and cases.
Regulatory impact assessment in Italy: technical instrumentation and experience gained.

Core Documentation

Learning Material
Part One
Section 1
Texts 1 (A):

A1. A. Martini, M. Sisti, "A ciascuno il suo. Cinque modi di intendere la valutazione in ambito pubblico", Informaires, n.33, Dicembre 2007, pp. 1-9.
https://dokodoc.com/queue/a-ciascuno-il-suo-cinque-modi-di-intendere-la-valutazione-in.html

A3. M. De Castris, Le fonti statistiche per l’analisi e la valutazione delle politiche, Dispense didattiche, Roma, 2015.
A5. European Commission (2013) EVALSED GUIDE: The resource for the evaluation of Socio-Economic Development. cap. 4 Choosing methods and techniques par. Acquiring and using data in evaluation; Creating Indicators and indicator systems pp. 81-88. http://ec.europa.eu/regional_policy/sources/docgener/evaluation/guide/guide_evalsed.pdf

Section 2
Texts 2 E

E1. A. Martini, M. Sisti (2009), Valutare il successo delle politiche pubbliche, Il Mulino, capp. VI, VII, IX, X, XI, XII.
Lettura integrativa:
E2. Formez (2006) Valutare gli effetti delle politiche pubbliche. Metodi e applicazioni al caso italiano. Collana Materiali, Roma. Parte prima. (http://costopa.formez.it/sites/all/files/Valutare%20gli%20effetti%20dellle%20politiche%20pubbliche.pdf)
Un manuale di statistica per rivedere concetti di base modello di regressione.
Per esempio: Borra Di Ciaccio “Statistica: Metodologie per le scienze economiche e sociali”, McGraw-Hill Education, 2015. Gary Koop “Logica statistica dei dati economici”, Utet, 2001.

Section 3
Texts 3 C:
C1 V. Pupo (2003) La valutazione delle politiche strutturali, Rubbettino.cap.3 (pp. 53-78).
C2. F. Busillo, T. Muccigrosso, G. Pellegrini, O. Tarola, F. Terribile (2010) L’impatto della politica regionale sulla crescita delle regioni europee: un approccio basato sul regression discontinuity design. Collana UVAL-DPS, Analisi e studi, N.20. http://www.agenziacoesione.gov.it/opencms/export/sites/dps/it/documentazione/servizi/materiali_uval/analisi_e_studi/MUVAL_20_Politica_regionale_europea.pdf)
Part Two
Section 4
Texts 4 (B):
B2. F. Vidoli, Metodi di stima dell’efficienza produttiva e di costo. Rassegna delle principali tecniche di stima ed applicazioni in ambito pubblico. Dispense ad uso didattico, febbraio 2015.

Section 5
Texts 5 D:
D1. Commissione Europea (2003) Guida all’analisi costi-benefici dei progetti di investimento, Bruxelles. capp. 1, 2. (http://ec.europa.eu/regional_policy/sources/docgener/guides/cost/guide02_it.pdf).
D3. C. Mazziotta(2011), “La strumentazione quantitativa per l’analisi di impatto della regolazione. Questioni di metodo e applicazioni”, in M. De Benedetto (a cura di), Spiagge in cerca di regole, Collana Arel, Il Mulino, Bologna.
D4. European Commission (2013) Evalsed Sourcebook: Method and Techniques cap.11 Multi-criteria Analysis 129-136; cap. 15 Swot Analysis pp.161-164. http://ec.europa.eu/regional_policy/sources/docgener/evaluation/guide/guide_evalsed.pdf
D5. C. Mazziotta (2011), Cenni introduttivi sull’analisi multicriteri, Dispense ad uso didattico, Roma.
Integrazione per il programma da 9 CFU, a scelta:
M. Sisti (2006) Gli effetti della legge 27/93 della Regione Toscana sull’imprenditoria giovanile, di pp.199-226 in Formez (2006) Valutare gli effetti delle politiche pubbliche. Metodi e applicazioni al caso italiano. Collana Materiali, Roma. ((http://costopa.formez.it/sites/all/files/Valutare%20gli%20effetti%20dellle%20politiche%20pubbliche.pdf)

N.B. Supplementary materials are available at the copy shop: 4Appunti , via Chiabrera, 174, tel. 06.59605579.


Reference Bibliography

Ugo Trivellato La valutazione degli effetti di politiche pubbliche: paradigma e pratiche IRVAPP Working Paper No. 2009-01. (https://irvapp.fbk.eu/wp-content/uploads/2017/09/FBK-IRVAPP-Working-Paper-No.-2009_01-2.pdf)

Type of delivery of the course

Class lectures and seminars on the main topics.

Attendance

The student who chooses to attend the lessons will have the opportunity to acquire quantitative tools in the classroom to facilitate the understanding of the course topics.

Type of evaluation

SUMMER SESSION 2019/20 June-July 2020- HEALTH EMERGENCY COVID-19 WEB-BASED EXAMINATION In the period, June-July 2020, due to the emergency measures imposed by the Covid-19 pandemic, a 1-hour exam (written test) will be administered through the Moodle platform of the course. Students who pass the test can participate in the oral examination. The examination consists of a written test on the first part of the programme and an oral test on the whole programme. The written test, together with the oral test, will help determine the final grade. The passed written test will be valid only for the summer session a.y. 2019/20. The written test consists of exercises and open questions. The duration of the written test is 1 hour. Only students with a grade equal to or higher than 18/30 on the written test will be admitted to the oral exam. The written test will be uploaded to the Moodle platform in the quiz section. The oral test consists of questions on the scheduled topics aimed at verifying knowledge of concepts. The final grade takes the written and oral results into account. Students who have taken and passed the written test in previous session examinations will only take the oral test. NORMAL CONDITIONS The student takes a written test of the first part of the program. The results of the writings remain valid for the following sessions. After passing the first part, the second part can be supported either orally or in writing. The student may take a written examination for the second part as well, but in an appeal subsequent to that in which the first part sustains. Only for students attending the current academic year, a partial trial on the first part is planned. The written tests, together with an oral test, will help determine the final mark. The oral examination will be taken during one of the appeals of the examination sessions. Students who take part in the partial exam and fail it will not be able to take the exam in the first two appeals of the summer session. The student has the faculty not to give the exam to maintain the right to take the exam in two of the three appeals of the summer session. The passed tests are valid for two academic years.