inee curso uimp 2016 - evaluación educativa: maciej jakubowski

43
Education Reforms in Poland: what lessons for other countries? Maciej Jakubowski Evidence Institute Santander, July 2016

Upload: instituto-nacional-de-evaluacion-educativa

Post on 14-Jan-2017

106 views

Category:

Education


0 download

TRANSCRIPT

Page 1: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Education Reforms in Poland: what lessons for other countries?

Maciej JakubowskiEvidence Institute

Santander, July 2016

Page 2: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Outline

• Main policies and outcomes of the reforms

• The 1999 reform

• 2007/2008 Curriculum reform

• 2009 School evaluation reform

• Early education reform

• Further challenges

Page 3: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

PISA cycles and the Polish reforms

PISA2012PISA2009PISA2006PISA2003PISA2000

Page 4: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

PISA cycles and the Polish reforms

PISA2012PISA2009PISA2006PISA2003PISA2000

1999

• Change of the school structure• Longer comprehensive education• School autonomy

REFORM

• External examination system• Decentralisation• New scheme for teachers promotion and remuneration

Page 5: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

PISA cycles and the Polish reforms

PISA2012PISA2009PISA2006PISA2003PISA2000

1999

REFORM

2008

• New core curriculum

• New exams

REFORM

• Learning outcomes

• Problem-solving

Page 6: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

The 1999 school reform goals

• to improve teaching quality

• to increase educational opportunities

• to improve efficiency

Page 7: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

The 1999 reform major components

• Change of the school structure• Further decentralization• New financing scheme• School and teacher autonomy• National exams• New professional scheme for teachers

Page 8: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

change of the school structure• The eight-year basic primary education was replaced by

six years primary school and three years comprehensive lower secondary school.

• Students were offered the opportunity to follow the same curriculum for nine instead of eight years.

• The selection of students into academic and vocational tracks was therefore postponed by one year until the age of 16.

• Upper secondary education was shortened by one year and education remained obligatory until the age of 18.

Page 9: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Decentralization

• School ownership and governance given to local governments.

• Most of the financing still comes from the central budget, but the local governments distribute them among schools in their area.

• Local governments employ school principals and accept teaching plans, but school principals employ teachers and run schools independently.

Page 10: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

School Financing• The new financing scheme based on a per pupil formula replaced the old

system of financing schools based on historical costs.• It improved overall efficiency and began a large transition of school

network. • These changes were necessary as due to demographic decline funding of

smaller schools became truly problematic. • Poland has now one of the most efficient school systems • Administered at the local level with important regulatory powers left to the

central government. • For example, although most of the financing still comes from the central

budget, the local governments distribute them among schools in their area. • Teacher salaries are still centrally regulated, however, local governments

have some margin to differentiate them according to locally set criteria.

Carolyn Trager Kliman
Is it possible to clarify this point?
Carolyn Trager Kliman
Is it possible to clarify this point? Were the changes needed because the number of students declined?
Page 11: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

School and Teacher Autonomy

• Textbook market was freed and the right to chose learning materials was given to teachers.

• Teachers independently decide what materials and what methods to use in their classrooms.

• Teachers are evaluated independently from local governments.

Page 12: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

External Exams• With increased decentralization and school autonomy, it

was necessary to introduce a new accountability system to monitor student outcomes.

• The new standardized national exams were launched in 2002 with all students in the final grades of the primary and the lower secondary school taking obligatory exams in core subjects.

• Later, standardized exams were introduced at the upper secondary level (serving also as entrance exams to tertiary education) and in vocational schools (now providing a final exam to obtain professional qualifications).

Page 13: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

new professional scheme for teachers

• To motivate teachers professional development a new professional scheme was introduced.

• Four professional levels are now linked to different salary levels. • Currently, nearly all Polish teachers have masters degrees in

relevant subjects with around 50% at the highest professional level.

• The system is criticized for not measuring real teacher effort it motivated teachers to improve their qualifications.

• Today, teachers are among the most active professional groups when it comes to post-graduate studies and professional training.

Page 14: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

PISA 2000: country average and between school differences

14

01000200030004000500060007000400

420

440

460

480

500

520

540

560

Between-school variance

Coun

try

aver

age

in re

adin

g

Low scoresHigh differences

High scoresLow DifferencesHigh scores

Large differences

Low scoresLow differences

Page 15: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Poland in PISA 2000

15

01000200030004000500060007000400

420

440

460

480

500

520

540

560

Between-school variance

Coun

try

aver

age

in re

adin

g

Low scoresLarge differences

Page 16: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Poland in PISA 2009

16

01000200030004000500060007000400

420

440

460

480

500

520

540

560

Between-school variance

Coun

try

aver

age

in re

adin

gHigh scores

Low differences

Page 17: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Poland in PISA 2009

Page 18: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

2007/2008 Curriculum Reform• The old curriculum focused on what teachers should teach

rather than what knowledge and skills students should acquire.

• Rapid changes in Polish education, economy and society called for a modernization of the curriculum.

• The reform began in 2007 with a consultation process that included all major stakeholders. After a year of discussions, a new curriculum was passed as law in 2008.

• The new curriculum was introduced gradually, with the last changes only recently implemented in upper secondary schools.

Page 19: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

2007/2008 Curriculum Reform

The new curriculum was developed under these principles:• Describe the expected learning outcomes for each

stage of education• Indicate the main objectives of teaching each

school subject• Define the requirements of central assessments• Constitute a coherent part of the Polish

Qualifications Framework

Page 20: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Major Effects of the New Curriculum

• The new curriculum had two major effects:– It strengthened teachers’ autonomy — and responsibility– It further shifted the emphasis from knowledge acquisition to critical

and analytical thinking• Polish students’ improvement between the PISA 2009 and

2012 was mostly the result of better responses to items measuring more complex, analytical thinking.

• The reform also included group projects and emphasized cross-curricular skills.

• The reform was also introduced in vocational schools• National exams were aligned with the new curriculum.

Page 21: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

School Evaluation Reform

• Evaluating the education activity of schools and educational establishments;

• Auditing compliance with the law with respect to teaching and care activities and other statutory activities of schools and educational establishments; and

• Supporting the operation of schools and educational establishments and supporting teachers in carrying out their tasks in the area of teaching, care and other statutory activities.

Page 22: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

School evaluation system in Poland

External evaluation

Internal evaluation

RequirementsReports

Page 23: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

School reforms and PISA outcomes in Poland

1999

REFORM

2008

REFORM

2000 2003 2006 2009 2012470

480

490

500

510

520

530

reading mathematics science

OECDaverage

Page 24: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Re-analysis with 3PL IRT model and Polish data only(Dolata, Jakubowski, Pokropek, 2015)

Page 25: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Trends in performance across subjects and groups of students

0

5

10

15

20

25

30

low achievers high achievers

Page 26: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski
Page 27: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Early Education Reform• The reform made preschool education compulsory at the age of

five beginning in the school year 2011/12. • Since 2015, primary education has become compulsory for all 6-

year-olds. • In 2013, the government introduced a new law that secured

places for all 3- and 4-year-olds in preschool education. • In addition, preschool education became much more affordable

thanks to new regulations that offer the first five hours per day free of charge and allow local governments to charge no more than PLN 1 (less than EUR 0.25) for each additional hour.

• The goal is to reach 90% enrollment rate for 3-5-year-olds

Page 28: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski
Page 29: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

15 years of reforms

• It is a continuum of changes despite all usual politics: big jumps, two steps backwards, three steps forward

• Main characteristic: expansion of comprehensive education

• But also: school autonomy, soft accountability, teacher professionalization, student-centered and outcomes oriented curriculum and practice

Page 30: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Extending comprehensive education for all

3-5 6 7 8 9 10 11 12 13 14 15 16 17 18 19

before 1999

Pre--school "0" primary

general secondary higher education secondary vocational

basic vocational

Page 31: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Extending comprehensive education for all

3-5 6 7 8 9 10 11 12 13 14 15 16 17 18 19

before 1999

Pre--school "0" primary

general secondary

higher education

secondary vocational

basic vocational

after 1999

Pre--school "0" primary lower

secondary

general secondary

secondary vocational

general/vocational

basic vocational

Page 32: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Extending comprehensive education for all

3-5 6 7 8 9 10 11 12 13 14 15 16 17 18 19

before 1999

Pre--school "0" primary

general secondary

higher education

secondary vocational

basic vocational

after 1999

Pre--school "0" primary lower

secondary

general secondary

secondary vocational

general/vocational

basic vocational

after2014

Pre--school primary lower

secondary

General secondary

secondary vocational

basic vocational

Page 33: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Further Challenges• Young adults in Poland have strong foundation skills,

but older generations lack such skills (PIAAC results)

• Students in Poland lack ICT skills and need to improve their ability to master foreign languages

• Tertiary education graduation rate is above 50%

• Levels of unemployment among young people are comparatively high and they are higher still among youngsters without a tertiary education degree

Page 34: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Learning to learn:What competencies will be needed in 20 years?

Forecasting vs. help students learn how to learn

Balancing different skills: a holistic approach to educationBusinesses in Poland rarely complain about lack of skills in

mathematics or reading among prospective employees. Companies often complain about lack of social skills,

language proficiency and ICT. Change in focus?

34

What next?

Page 35: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Key goals:

I. SOCIAL SKILLS: Identify what practices enable to develop social skills and develop instruments to assess such skills

II. ICT: Ensure that all students leave school with solid ICT skills and that students are as proficient on computers as they are when solving problems on paper.

III. VET: Develop and promote a more flexible vocational training system

IV. Equity: Ensure equal opportunities to master key competences

V. Creating space for innovations for the best educated generation of Poles!!!

35

What next?

Page 36: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Effective use of research

Page 37: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Effective structures are necessary

• Two main challenges:– Massive amount of information– Limited capacity to transform that into policy advice and

useful hints for practitioners• Two typical structural problems:

– Centralized institutions– Research-oriented with weak links to policy and practice

• Two typical research-related problems:– Lack of capacity to conduct „policy-friendly” research– Focus on data gathering rather than effective use of existing

data in secondary analysis

Page 38: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Effective use of research1. Knowledge brokers/research managers are necessary

• Specialized institutions to prepare policy-friendly products• Special units within then ministries to manage

knowledge-brokers/research and to use evidence effectively within the government

• Disseminate findings among practitioners• Work on research targets with policy makers and practitioners

2. Contract research through grants and shift funding to secondary analysis

3. Add impact and financial analysis to all government documents

Page 39: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Evidence and policy… and politics Research evidence was used to motivate reforms to

face existing challenges Research was used to defend reforms by showing their

outcomes (existing and potential) or by describing with data what issues need to be addressed• School structure• Early education reform• Curriculum reform

Current government actions are mainly political and often against the evidence:– Abandon support for early education reform– Plans to transform lower-secondary schools– Back to knowledge-oriented curriculum

Page 40: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

How to support evidence-based policy making in EU?

Require evaluation for all EU-funded projectsSupport research comparing policies and

outcomes across European countries Good examples: Eurydice, PIAAC Not that good examples: ESLC Very limited use of secondary analysis

Support policy-relevant research but also promote independent knowledge-brokers

Page 41: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Bermuda triangle of education reforms

Centralized + limited

autonomy

No accountabilityLack of Focus on learning outcomes

Low quality

Teachers as bureaucrats

Limited professional

support

Page 42: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

Key components of successful

school systems

Decentralized + school

autonomy

Soft accountability

focusing on learning

outcomes

High qualitylearning

Teacher as professionals

Page 43: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski

www.evidenceinstitute.eu [email protected]

@MaciejEvidence