Recent developments in rankings: implications for developing countries?: Recent developments in rankings: implications for developing countries? Jamil Salmi The World Bank IREG-3 Shanghai, 29-30 October 2007


Slide2: The rankings business A ranking of league tables September 10, 2005


Slide4: Rankers, Beware League tables under scrutiny Gordon’s Brown’s disastrous retreat How do super-jumbo changes air travel Meet Fred Thompson Has commercial property peaked? Liu Nian Cai , the man and the myth


outline of the presentation: outline of the presentation status of rankings new directions in accountability prospects for ranking


who prepares the rankings?: who prepares the rankings? A = government agency (Ministry of Higher Education, Higher Education Commission, University Grants Council, etc.) B = independent organization / professional association / university C = newspaper / magazine / media D = accreditation agency I = International ranking (IA, IB, IC and ID linking the international dimension to the type of institution conducting the ranking)


Slide7: ranking systems in 2006


Slide8: ranking systems in 2007


trends: trends more rankings except Africa and Middle East who does the rankings? less from the press more from independent think tanks or governments accepted in growing number of countries voluntary participation Austrians, Swiss, Flemish


outline of the presentation: outline of the presentation status of rankings new directions in accountability


what does accountability mean?: what does accountability mean? information achievement of results sanctions


trends in accountability: trends in accountability multiple stakeholders multiple themes multiple instruments


multiple stakeholders: multiple stakeholders government(s) employers society at large professors students


multiple themes: multiple themes access equity quality relevance efficiency sustainability nation-building / values


multiple instruments: multiple instruments licensing evaluation / accreditation performance-based funding rankings assessment of learning outcomes


measurement of outcomes: measurement of outcomes From inputs to competencies Bologna process ABET Spellings Commission ”no graduates left behind” OECD / PISA for tertiary education World Bank benchmarking tool


country experiences: country experiences Australia Brazil Canada Colombia Jordan Korea Mexico UK USA


outline of the presentation: outline of the presentation status of rankings new directions in accountability prospects for ranking


usefulness of rankings?: usefulness of rankings? for the public? for the institutions? for the Government?


usefulness of rankings: for individuals: usefulness of rankings: for individuals choice based on information


usefulness of rankings: for institutions: usefulness of rankings: for institutions benchmarking and self-evaluation counter-rankings (Paris) voluntary accountability framework (USA)


from the viewpoint of institutions: from the viewpoint of institutions sensitive to factors that affect their rankings (benchmarking) goal setting for strategic planning purposes forming strategic partnerships mergers


usefulness of rankings: for governments: usefulness of rankings: for governments rapid QA assessment in lieu of accreditation international benchmarking national benchmarking culture of competition


government use of rankings: government use of rankings Pakistan case promoting a culture of accurate and transparent information promoting a culture of quality


new challenges: new challenges multiplicity of institutions (and joint programs) multiplicity of missions blurring of boundaries between disciplines emerging disciplines new delivery modes


conclusion: divisive or helpful?: conclusion: divisive or helpful?


For sale: charming and peaceful residence away from neighbors, with a wonderful view of the sea, a grand period staircase, and lots and lots of light…”: For sale: charming and peaceful residence away from neighbors, with a wonderful view of the sea, a grand period staircase, and lots and lots of light…”


Slide29: For sale: charming and peaceful residence away from neighbors, with a wonderful view of the sea, a grand period staircase, and lots and lots of light…”


Bordeauxthe wine producers suing the wine rankers: Bordeaux the wine producers suing the wine rankers


divisive or helpful?: divisive or helpful? rankings are here to stay useful for prospective students useful in the absence of an established evaluation and/or accreditation system useful for benchmarking, goal-setting and self-improvement purposes useful to conduct a healthy debate on issues and challenges useful to promote a culture of accountability


linking rankings and funding?: linking rankings and funding? Arizona State RAE (UK, Hong Kong, NZ, Australia) Nigeria (based on ranking done by Accreditation Commission) performance premium for academics publishing in journals included in Shanghai ranking (Norway, Australia) donors and home ministries making scholarship decisions corporate donors strengthening the strong and weakening the weak


principles of appropriate ranking instruments: principles of appropriate ranking instruments compare similar institutions focus on program rather than on entire institution rank by indicator rather than wholesale outcomes/outputs/results rather than inputs better if used for self-improvement purposes make results publicly available