Title: Science knowledge and attitudes across cultures: a meta-analysis

Authors: Nick Allum*, Patrick Sturgis**, Dimitra Tabourazi***, Ian Brunton-Smith***

Institution: * University of Essex, ** University of Southampton, *** University of Surrey

Date: 2005 (published as Allum, N., Sturgis, P., Tabourazi, D., Brunton-Smith, I. (2008) Science knowledge and attitudes across cultures: a meta-analysis. Public Understanding of Science. 17(1). 35-54)

Subject area(s): Sociology, Social Statistics.

Relavance to other area(s): Political Science, Social Psychology

Project type: Research project/journal article

Summary

Photo by: Abraxas3d, Creative Commons, Flickr The correlation between knowledge and attitudes has been the source of controversy in research on the public understanding of science (PUS). Although many studies, both quantitative and qualitative, have examined this issue, the results are at best diverse and at worst contradictory. In this study, we review the evidence on the relationship between public attitudes and public knowledge about science across 40 countries using a meta-analytic approach. We fit multilevel models to data from 193 nationally representative surveys on PUS carried out since 1989. We find a small positive correlation between general attitudes towards science and general knowledge of scientific facts and processes, after controlling for a range of possible confounding variables. This general relationship varies little across cultures but more substantially between different domains of science and technology. Our results suggest that PUS research needs to focus on understanding the mechanisms that underlie the clear association that exists between knowledge and attitudes about science.

Datasets used

National Science Foundation Surveys of Public Attitudes Toward and Understanding of Science and Technology, 1979-2001.

British Social Attitudes (BSA) 1993, 1996, 2000,2003

International Social Survey Programme (ISSP) 1993, 2000

Northern Ireland Life and Times 1993, 1998, 2000

OST/Wellcome Trust Attitudes to Biomedical Science Survey 2000

Eurobarometers: 31, 38.1, 46, 52.1, 55.2, 58a, 58b

General Social Survey 1993, 1994, 2000

Aims and objectives

One of the key insights from programmes of research on public understanding of science that were set in train in the 1980s is that both European and American publics possess low levels of basic ‘textbook’ knowledge about science. For some, findings of this nature are taken as strong empirical confirmations of the existence of a ‘scientifically illiterate’ public and provide the first pillar in the construction of the pervasive ‘deficit model’ of public understanding of science (Irwin and Wynne, 1996; Sturgis and Allum, 2001). The deficit model sees public resistance to science and technology as underpinned by ignorance, superstition and fear. Public scepticism about technological innovations such as nuclear energy, microwave cooking and genetic science would be markedly reduced if citizens were better able to grasp the science upon which they are based. That is, a judgement when informed by scientific fact would tend to be more favourable and consistent with expert opinion than one expressed without recourse to such ‘objective’ knowledge. Since the late 1980s, much academic debate has focused on examining and understanding the link between knowledge and attitudes about science. Numerous surveys have been carried out to measure public attitudes, knowledge, beliefs and behaviour in relation to science and technology. Up until the present study, no systematic review had been carried out of this burgeoning database.

In the study, we review the evidence on the relationship between public attitudes and public knowledge about science and technology from the multitude of national surveys that have been carried out across the world during the past fifteen years in Europe, North America and beyond. To do this we use a formal, meta-analytic model. We go beyond a simple summary to present a model that helps systematise the apparent diversity of findings in the PUS literature. More specifically, we firstly evaluate the associations between particular forms of scientific knowledge and particular attitude domains; secondly, we control for a range of possible confounding variables across all our analysis; thirdly, we estimate disparities between countries in the knowledge-attitude relationship and employ macro-level predictors that might explain these disparities.

Methodology

Our data collection and analytic methods took the following form.  First we made a comprehensive search for data sources and assembled a large number of raw survey datasets.  Second, we derived a number of comparable knowledge and attitude scales in each survey (hereafter we refer to each national survey as a ‘sample’).  Third, we ran ordinary least square regressions of knowledge on attitudes, with additional control variables, for each sample.  This yielded effect size estimates in the form of standardized partial regression coefficients of knowledge on attitude. Fourth, we compiled a new dataset that included these effect sizes, their standard errors and a range of other higher level variables relating to the year of the study, country, length of attitude scale and some aggregate country-level variables such as GDP per capita and proportion of 18-24 yr olds in tertiary education. Finally, this composite dataset was analysed using MLwiN 2.0 (Rasbash et al 2004), running a number of multilevel regression models with ‘effect size’ as the dependent variable.

Note on the meta-analysis:

Meta-analytic techniques see effect sizes estimated from single studies as units drawn from a hypothetical population of possible studies. As such, relying on single studies for effect size estimates relies on the unlikely event that the single study is representative of all possible studies that could have been sampled from this population (Rosenthal, 1991). Thus the basic objective of meta-analysis is to provide pooled estimates of effect sizes through a weighted average of the effect sizes of the individual studies, with sampling variances calculated as a function of the sample size of each individual study. The meta-analysis that we present here can be viewed as a special case of a multilevel model, as we have a hierarchical dataset with effect sizes nested within samples, nested within countries. By using a multilevel model, one can incorporate multiple effect sizes from the same sample into the same analysis (Hox, 2002). The multilevel model is also a more flexible meta-analytic model, allowing characteristics at each level to be included in the model to explain heterogeneity in effect sizes across and within samples. In the standard approach, effect sizes from each study are assumed to be fixed effects - estimates of an overall unknown population effect. However, when there is substantial heterogeneity between these estimates, a random effects model may be more appropriate. This model assumes that all studies estimate their own unique, unknown ‘study effects’ which are themselves distributed around an unknown population effect (Lambert and Abrams, 1995). In the present investigation, by using a multilevel model, we estimate parameters for a random effects model but with the addition of fixed effects to explain between sample and between country heterogeneity.

Results/Outcome

Our findings suggest that, if one examines all measured knowledge and attitude domains, there is a small but positive relationship.

Of equal, or perhaps greater, interest is the discovery of systematic differences in this relationship according to the degree of consonance between knowledge and attitude domains. The correlation between general ‘textbook’ knowledge and attitudes towards science as a whole is almost twice as high as the overall estimate whereas, for example, the correlation between general knowledge and attitudes to GM food is practically zero. However, when knowledge relates to biology and genetics, it becomes a considerably stronger predictor of a person’s attitudes towards GM food.

Previous work has suggested that there is a great deal of variation in the association between science literacy and attitudes to science between countries and that some of this variation is related to the degree of local economic development. Our results suggest that much of what has been interpreted as cultural variation can be accounted for mainly by variation in the relative proportion of individuals with particular attributes within countries rather than ‘culture’ per se. Our analysis shows that only 10 percent of the variation in the knowledge-attitude correlation can be explained by country level processes or mechanisms – much less than would be indicated by considering aggregate measures, as has previously been the rule. Neither GDP per capita nor Internet diffusion were significantly associated with cultural variation. However, the percentage of young people enrolled in tertiary education in a country is linked to stronger knowledge-attitude correlations and can account for all of the cross-country variation in our initial variance components analysis.

Additional information:

Figure 1: Multilevel structure of meta-analytic data

Figure 2: Country residuals (posterior means) with 95% confidence intervals

References and/or acknowledgements

Allum, N C, Boy, D and Bauer, M W. (2002). "European regions and the knowledge deficit model." in Biotechnology: the making of a global controversy. Bauer, M and Gaskell, G (eds). Cambridge, Cambridge University Press.

Bauer, M W., Durant, J. and Evans, G. (1994). "European public perceptions of science." International Journal of Public Opinion Research 6(2), 163-186

Bishop, G. (2005). The illusion of public opinion: fact and artifact in American public opinion polls. Oxford, Rowman and Littlefield

Bryk, A and Raudenbusch, S. (1992). Hierarchical linear models: applications and data analysis methods. London, Sage

Cohen, J. (1992). "A power primer." Psychological Bulletin 112, 155-159

Davis, R.C. (1958). "The Public Impact of Science in the Mass Media. A report on a nation-wide survey for the National Association of Science Writers." Ann Arbor, University of Michigan, Institute for Social Research, Survey Research Center.

Durant, J, Evans, G and Thomas, P. (1989). "The public understanding of science." Nature 340(6228), 11-14

Durant, J., Bauer, M W, Gaskell, G., Midden, C., Liakopoulos, M. and Scholten, E. (2000). "Two cultures of public understanding of science and technology in Europe." in Between understanding and trust. The public, science and technology. Dierkes and Grote, von (eds). Amsterdam, Harwood Academic Publishers. 131-156

Einsiedel, E. (2000). "Understanding "publics" in the public understanding of science." in Between understanding and trust: the public, science and technology. Dierkes, M and von Grote, C (eds). Amsterdam, Harwood.

European Commission. (2001). "Europeans, science and technology." Brussels.

Evans, G and Durant, J. (1995). "The relationship between knowledge and attitudes in the public understanding of science in Britain." Public Understanding of Science 4(1), 57-74

Gaskell, G, Allum, N C, Wagner, W, Hviid Nielsen, T, Jelsoe, E, Kohring, M and Bauer, M W. (2001). "In the public eye: representations of biotechnology in Europe." in Biotechnology 1996-2000: the years of controversy. Gaskell, G and Bauer, M (eds). London, Science Museum Publications.

Gaskell, George, Allum, N C, Bauer, Martin W. and Durant, John. (1999). "Worlds apart? the reception of genetically modified foods in Europe and the US." Science July 16 1999, 384-387

Grimston, M C. (1994). "Public opinion surveys in the UK." Nuclear Europe Worldscan 14(7-8), 98

Grove-White, R, Macnaghten, P and Wynne, B. (2000). "Wising up: the public and new technologies." Lancaster, CSEC, Lancaster University.

Hayes, B C and Tariq, V N. (2000). "Gender differences in scientific knowledge and attitudes toward science: a comparative study of four Anglo-American nations."  9(4), 433-447

Hayes, B C and Tariq, V N. (2001). "Gender differences in scientific knowledge and attitudes toward science: a reply to a reply." Public Understanding of Science 10(4), 431-433

Hox, J. J. (2002). Multilevel Analysis. Techniques and Applications. Mahwah, NJ, Lawrence Erlbaum

Inglehart, R. (1990). Culture shift in advanced societies. Princetown, Princetown University Press

INRA. (1993). "Europeans, science and technology: public understanding and attitudes." Brussels.

International Labour Organisation. (2001). "World Employment Report."

Irwin, A and Michael, M. (2003). Science, social theory and public knowledge. Maidenhead, Open University Press

Irwin, A and Wynne, B. (1996). Misunderstanding science? The public reconstruction of sciene and technology. Cambridge, Cambridge University Press

Lambert, P and Abrams, K. (1995). "Meta-analysis using multilevel models." Multilevel Modelling Newsletter 7(2),

Martin, S. and Tait, J. (1992). "Attitudes of selected public groups in the U.K. to biotechnology." in Biotechnology in public: a review of recent research. Durant, J. (ed). London, Science Museum.

McBeth, M K and Oakes, A S. (1996). "Citizens's perceptions of risks associated with moving radiological waste." Risk Analysis 16, 421-427

Michael, M. (1996). "Ignoring science: discourses of ignorance in the public understanding of science." in Misunderstanding science? the public reconstruction of science and technology. Irwin, A and Wynne, B (eds). Cambridge, Cambridge University Press.

Michael, M. (2002). "Comprehension, apprehension, prehension: heterogeneity and the public understanding of science." Science, Technology & Human Values 27(3), 357-358

Miller, J D. (1983). "Scientific literacy: a conceptual and empirical review." Daedalus 11, 29-48

Miller, J D. (1998). "The measurement of scientific literacy." Public Understanding of Science 7, 203-223

Miller, Jon D. (2004). "Public Understanding of, and Attitudes toward, Scientific Research: What We Know and What We Need to Know." Public Understanding of Science 13(3), 273-294

Miller, Jon D., Pardo, R and Niwa, F. (1997). Public perceptions of science and technology: a comparative study of the European Union, the United States, Japan and Canada. Bilbao, Fundacion BBV

Pardo, R and Calvo, F. (2002). "Attitudes toward science among the European public: a methodological analysis." Public Understanding of Science 11, 155-195

Pardo, R and Calvo, F. (2004). "The cognitive dimensions of public perceptions of science: methodological issues." Public Understanding of Science 13, 203-227

Peters, Hans Peter. (2000). "From information to attitudes? Thoughts on the relationship between knowledge about science and and technology and attitudes toward technology." in Between understanding and trust: the public, science and technology. Dierkes, M and von Grote, C (eds). Amsterdam, Harwood.

Priest, S H. (2001). "Misplaced faith: communication variables as predictors of encouragement for biotechnology development." Science Communication 23(2), 97-110

Rasbash, J, Steele, F, Browne, W and Prosser, B. (2004). A user's guide to MLwiN version 2.0. London, Institute of Education

Rosenthal, R. (1991). Meta-analysis Procedures for Social Research. Newbury Park, Sage

Sterling, T D, Rosenbaum, W L and Weinkam, J J. (1995). " Publication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa." American Statistician 49(1), 108-112

Sturgis, P.J. and Allum, N C. (2001). "Gender differences in scientific knowledge and attitudes toward science: reply to Hayes and Tariq." Public Understanding of Science 10(4), 427-430

Sturgis, P.J. and Allum, N C. (2004). "Science in society: re-evaluating the deficit model of public attitudes." Public Understanding of Science 13(1), 55-74

Sturgis, PJ and Allum, N.C. (2000). "The impact of knowledge on attitudes toward biotechnology: using regression models to simulate a better-informed public." in British Psychological Society (Social Psychology Section). Nottingham.

Thornton, Alison and Lee, Peter. (2000). "Publication bias in meta-analysis: its causes and consequences." Journal of Clinical Epidemiology 53(2), 207

Withey, S.B. (1959). "Public opinion about science and scientists." Public Opinion Quarterly 23, 382-388

Wolf, F M. (1986). Meta-analysis: quantitative methods for research synthesis. Thousand Oaks, CA, Sage Publications

Wynne, B. (1996). "May the sheep safely graze? A reflexive view of the expert-lay knowledge divide." in Risk, environment and modernity: towards a new ecology. Lash, S, Szerszynski, B and Wynne, B (eds). London, Sage.

Wynne, Brian. (2001). "Expert discourses of risk and ethics on genetically manipulated organisms: the weaving of public alienation." Politeia 17(62), 51-76