Rankings Shanghai Oct07 s

Recent developments in rankings: implications for developing countries?: 

Recent developments in rankings: implications for developing countries? Jamil Salmi The World Bank IREG-3 Shanghai, 29-30 October 2007

Slide2: 

The rankings business A ranking of league tables September 10, 2005

Slide4: 

Rankers, Beware League tables under scrutiny Gordon’s Brown’s disastrous retreat How do super-jumbo changes air travel Meet Fred Thompson Has commercial property peaked? Liu Nian Cai , the man and the myth

outline of the presentation: 

outline of the presentation status of rankings new directions in accountability prospects for ranking

who prepares the rankings?: 

who prepares the rankings? A = government agency (Ministry of Higher Education, Higher Education Commission, University Grants Council, etc.) B = independent organization / professional association / university C = newspaper / magazine / media D = accreditation agency I = International ranking (IA, IB, IC and ID linking the international dimension to the type of institution conducting the ranking)

Slide7: 

ranking systems in 2006

Slide8: 

ranking systems in 2007

trends: 

trends more rankings except Africa and Middle East who does the rankings? less from the press more from independent think tanks or governments accepted in growing number of countries voluntary participation Austrians, Swiss, Flemish

outline of the presentation: 

outline of the presentation status of rankings new directions in accountability

what does accountability mean?: 

what does accountability mean? information achievement of results sanctions

trends in accountability: 

trends in accountability multiple stakeholders multiple themes multiple instruments

multiple stakeholders: 

multiple stakeholders government(s) employers society at large professors students

multiple themes: 

multiple themes access equity quality relevance efficiency sustainability nation-building / values

multiple instruments: 

multiple instruments licensing evaluation / accreditation performance-based funding rankings assessment of learning outcomes

measurement of outcomes: 

measurement of outcomes From inputs to competencies Bologna process ABET Spellings Commission ”no graduates left behind” OECD / PISA for tertiary education World Bank benchmarking tool

country experiences: 

country experiences Australia Brazil Canada Colombia Jordan Korea Mexico UK USA

outline of the presentation: 

outline of the presentation status of rankings new directions in accountability prospects for ranking

usefulness of rankings?: 

usefulness of rankings? for the public? for the institutions? for the Government?

usefulness of rankings: for individuals: 

usefulness of rankings: for individuals choice based on information

usefulness of rankings: for institutions: 

usefulness of rankings: for institutions benchmarking and self-evaluation counter-rankings (Paris) voluntary accountability framework (USA)

from the viewpoint of institutions: 

from the viewpoint of institutions sensitive to factors that affect their rankings (benchmarking) goal setting for strategic planning purposes forming strategic partnerships mergers

usefulness of rankings: for governments: 

usefulness of rankings: for governments rapid QA assessment in lieu of accreditation international benchmarking national benchmarking culture of competition

government use of rankings: 

government use of rankings Pakistan case promoting a culture of accurate and transparent information promoting a culture of quality

new challenges: 

new challenges multiplicity of institutions (and joint programs) multiplicity of missions blurring of boundaries between disciplines emerging disciplines new delivery modes

conclusion: divisive or helpful?: 

conclusion: divisive or helpful?

For sale: charming and peaceful residence away from neighbors, with a wonderful view of the sea, a grand period staircase, and lots and lots of light…”: 

For sale: charming and peaceful residence away from neighbors, with a wonderful view of the sea, a grand period staircase, and lots and lots of light…”

Slide29: 

For sale: charming and peaceful residence away from neighbors, with a wonderful view of the sea, a grand period staircase, and lots and lots of light…”

Bordeauxthe wine producers suing the wine rankers: 

Bordeaux the wine producers suing the wine rankers

divisive or helpful?: 

divisive or helpful? rankings are here to stay useful for prospective students useful in the absence of an established evaluation and/or accreditation system useful for benchmarking, goal-setting and self-improvement purposes useful to conduct a healthy debate on issues and challenges useful to promote a culture of accountability

linking rankings and funding?: 

linking rankings and funding? Arizona State RAE (UK, Hong Kong, NZ, Australia) Nigeria (based on ranking done by Accreditation Commission) performance premium for academics publishing in journals included in Shanghai ranking (Norway, Australia) donors and home ministries making scholarship decisions corporate donors strengthening the strong and weakening the weak

principles of appropriate ranking instruments: 

principles of appropriate ranking instruments compare similar institutions focus on program rather than on entire institution rank by indicator rather than wholesale outcomes/outputs/results rather than inputs better if used for self-improvement purposes make results publicly available