Study Raises Questions Over Reliability of Fraser Institute Mining Rankings

The Fraser Institute’s widely cited mining investment rankings may not provide as complete or reliable a picture of mining investment conditions as their prominence suggests, according to a critical study published in Mineral Economics.

The study, titled “The perils of ranking mining countries and regions: a critical look at the annual survey of the Fraser Institute,” examines the methodology behind the annual survey and raises concerns about its low response rate, the measurement of complex concepts and the way its findings are used by governments, investors and the media.

The Fraser Institute survey seeks the views of mining executives on the attractiveness of jurisdictions for mineral exploration and investment, taking into account factors including mineral potential, taxation, regulations, infrastructure and political conditions. Its findings have become an important reference point in discussions about the competitiveness of mining countries and regions.

However, researchers Patrik Söderholm, Magnus Ericsson and Frida Hellman argue that the survey's results should be treated with greater caution. One of their main concerns is the declining number of responses. They note that the response rate has fallen significantly over time, with some jurisdictions in recent editions receiving fewer than ten responses. Such a small number, they argue, makes it difficult to establish whether the results genuinely represent the wider mining industry's views.

The problem becomes more significant when rankings change sharply from one year to another. The researchers point to substantial fluctuations in some jurisdictions' scores, including changes in assessments of geological potential. Because geological conditions do not normally change dramatically within a year, such movements raise questions about how much of the change reflects actual developments and how much may result from differences in the respondents participating in the survey.

Another major issue identified by the study is the distinction between perception and reality. Investor perceptions matter because they can influence where companies decide to invest. However, a perception of a country's investment environment does not necessarily correspond with measurable conditions on the ground.

Taxation provides one example. The study points to evidence that perceptions of mining taxation in some countries did not always correspond with the actual fiscal burden faced by mining companies. This suggests that a poor survey assessment does not necessarily identify the precise underlying problem with a country's tax regime.

Political stability presents a similar challenge. The researchers argue that the Fraser survey does not clearly define the concept, leaving respondents to determine what political stability means when answering the questions. Their comparison with World Bank political-stability indicators found broad similarities for some countries, including Ghana, but significant differences for others. The researchers say these differences illustrate the difficulty of comparing perceptions when the underlying concept is not clearly defined.

For Ghana and other mineral-producing countries, the findings are particularly relevant. International rankings can provide useful information about how investors perceive a jurisdiction, but they should not be treated as a complete diagnosis of the country's mining investment environment. Policymakers need to consider other evidence, including taxation, permitting processes, infrastructure, exploration expenditure, geological information and the availability of mining-related skills.

The researchers do not argue that expert surveys are inherently useless. They acknowledge that perceptions can provide valuable information, particularly for factors that are difficult to measure directly. Instead, they call for improvements to the Fraser survey, including a higher response rate, better targeting of companies active in particular jurisdictions, clearer definitions of concepts such as political stability and improved response categories.

They also recommend complementing perception-based assessments with measurable indicators. Information such as permitting times, tax burdens, mining education, exploration expenditure and government research and development spending could provide a more comprehensive picture of the investment environment.

The study further warns that mining rankings can take on a life of their own. Governments, companies and other interest groups may use favourable or unfavourable rankings to support their respective positions in policy debates. The researchers describe this as a political “rankings game”, in which the rankings can influence perceptions and put pressure on governments to respond.

Ultimately, the researchers conclude that the Fraser Institute's mining ranking should not be treated as a definitive scorecard for assessing or reforming mining policy. Its low response rate, unclear definitions and significant fluctuations from year to year create questions about the reliability and validity of the results.

The message for mining stakeholders is therefore straightforward: a ranking can show how a country is perceived, but it does not necessarily tell the full story of its actual investment environment. For countries such as Ghana, a more credible assessment of mining competitiveness will require investor perceptions to be considered alongside objective evidence on regulation, taxation, geology, infrastructure and investment performance.