The Cult of Statistical Significance – What Economists Should and Should Not Do to Make their Data Talk
JOURNAL ARTICLE
Cite JOURNAL ARTICLE
Style
Format
The Cult of Statistical Significance – What Economists Should and Should Not Do to Make their Data Talk
Journal of Contextual Economics – Schmollers Jahrbuch, Vol. 131 (2011), Iss. 3 : pp. 455–468
23 Citations (CrossRef)
Additional Information
Article Details
Author Details
Walter Krämer, TU Dortmund, Fakultät Statistik, 44221 Dortmund.
Cited By
-
Gründe für von der Fraktionsdisziplin abweichendes Abstimmungsverhalten bei Bundestagsabgeordneten
Neuhäuser, Alice | Mischler, Maike | Ruxton, Graeme D. | Neuhäuser, MarkusAStA Wirtschafts- und Sozialstatistisches Archiv, Vol. 7 (2013), Iss. 1-2 P.91
https://doi.org/10.1007/s11943-013-0130-5 [Citations: 2] -
Can $p$-values be meaningfully interpreted without random sampling?
Hirschauer, Norbert | Grüner, Sven | Mußhoff, Oliver | Becker, Claudia | Jantsch, AntjeStatistics Surveys, Vol. 14 (2020), Iss. none
https://doi.org/10.1214/20-SS129 [Citations: 22] -
Mostly Harmless Econometrics? Statistical Modeling Paradigms in the ‘Top Five’ From 2000 to 2018
Engler, John-Oliver | Beeck, Julius | von Wehrden, HenrikSSRN Electronic Journal, Vol. (2022), Iss.
https://doi.org/10.2139/ssrn.4112212 [Citations: 0] -
Fundamentals of Statistical Inference
The p-Value and Statistical Significance Testing
Hirschauer, Norbert | Grüner, Sven | Mußhoff, Oliver2022
https://doi.org/10.1007/978-3-030-99091-6_6 [Citations: 0] -
Interview mit Volker Mammitzsch
Krämer, W.
AStA Wirtschafts- und Sozialstatistisches Archiv, Vol. 12 (2018), Iss. 2 P.179
https://doi.org/10.1007/s11943-018-0225-0 [Citations: 3] -
Varianzquotiententests und Random Walk Verhalten internationaler Aktienmärkte
Auer, Benjamin R. | Schuster, MartinManagement Review Quarterly, Vol. 64 (2014), Iss. 2 P.73
https://doi.org/10.1007/s11301-013-0097-x [Citations: 0] -
Dubious versus trustworthy faces: what difference does it make for tax compliance?
Lohse, Tim | Qari, SalmaiApplied Economics Letters, Vol. (2015), Iss. P.1
https://doi.org/10.1080/13504851.2015.1076150 [Citations: 0] -
Twenty Steps Towards an Adequate Inferential Interpretation of p-Values in Econometrics
Hirschauer, Norbert | Grüner, Sven | Mußhoff, Oliver | Becker, ClaudiaJahrbücher für Nationalökonomie und Statistik, Vol. 239 (2019), Iss. 4 P.703
https://doi.org/10.1515/jbnst-2018-0069 [Citations: 6] -
The Employment Effect of Industry- Specific, Collectively Bargained Minimum Wages
Frings, Hanna
German Economic Review, Vol. 14 (2013), Iss. 3 P.258
https://doi.org/10.1111/geer.12009 [Citations: 20] -
Interview mit Günter Bamberg
Krämer, Walter
AStA Wirtschafts- und Sozialstatistisches Archiv, Vol. 12 (2018), Iss. 3-4 P.299
https://doi.org/10.1007/s11943-018-0232-1 [Citations: 1] -
Ceremonial science: The state of Russian economics seen through the lens of the work of ‘Doctor of Science’ candidates
Libman, Alexander | Zweynert, JoachimEconomic Systems, Vol. 38 (2014), Iss. 3 P.360
https://doi.org/10.1016/j.ecosys.2013.11.001 [Citations: 7] -
Reject inference in consumer credit scoring with nonignorable missing data
Bücker, Michael | van Kampen, Maarten | Krämer, WalterJournal of Banking & Finance, Vol. 37 (2013), Iss. 3 P.1040
https://doi.org/10.1016/j.jbankfin.2012.11.002 [Citations: 30] -
Die Interpretation des p-Wertes – Grundsätzliche Missverständnisse
Hirschauer, Norbert | Mußhoff, Oliver | Grüner, Sven | Frey, Ulrich | Theesfeld, Insa | Wagner, PeterJahrbücher für Nationalökonomie und Statistik, Vol. 236 (2016), Iss. 5 P.557
https://doi.org/10.1515/jbnst-2015-1030 [Citations: 7] -
Is There a Cult of Statistical Significance in Agricultural Economics?
Rommel, Jens | Weltin, MeikeApplied Economic Perspectives and Policy, Vol. 43 (2021), Iss. 3 P.1176
https://doi.org/10.1002/aepp.13050 [Citations: 7] -
I can see clearly now: Reinterpreting statistical significance
Dushoff, Jonathan | Kain, Morgan P. | Bolker, Benjamin M. | O’Hara, Robert B.Methods in Ecology and Evolution, Vol. 10 (2019), Iss. 6 P.756
https://doi.org/10.1111/2041-210X.13159 [Citations: 125] -
Detecting Problems in Military Expenditure Data Using Digital Analysis
Rauch, Bernhard | Göttsche, Max | Langenegger, StephanDefence and Peace Economics, Vol. 25 (2014), Iss. 2 P.97
https://doi.org/10.1080/10242694.2013.763438 [Citations: 9] -
Das Signifikanztest-Ritual und andere Sackgassen des Fortschritts in der Statistik
Krämer, Walter
AStA Wirtschafts- und Sozialstatistisches Archiv, Vol. 5 (2012), Iss. 4 P.299
https://doi.org/10.1007/s11943-012-0110-1 [Citations: 12] -
Statistik hautnah
Volker Mammitzsch
Krämer, Walter
2024
https://doi.org/10.1007/978-3-662-69596-8_10 [Citations: 0] -
Pitfalls of significance testing and $p$-value variability: An econometrics perspective
Hirschauer, Norbert | Grüner, Sven | Mußhoff, Oliver | Becker, ClaudiaStatistics Surveys, Vol. 12 (2018), Iss. none
https://doi.org/10.1214/18-SS122 [Citations: 12] -
Empirical Methods in Competition Analysis Applying Benford's Law to the Western Australian Petroleum Market
Rauch, Bernhard | Goettsche, Max | El Mouaaouy, Florian | Geidel, FelixSSRN Electronic Journal, Vol. (2013), Iss.
https://doi.org/10.2139/ssrn.2364384 [Citations: 0] -
Is Crowdfunding Different? Evidence on the Relation between Gender and Funding Success from a German Peer-to-Peer Lending Platform
Barasinska, Nataliya | Schäfer, DorotheaGerman Economic Review, Vol. 15 (2014), Iss. 4 P.436
https://doi.org/10.1111/geer.12052 [Citations: 135] -
Statistik klipp & klar
Schließende Statistik
Christensen, Björn | Christensen, Sören | Missong, Martin2019
https://doi.org/10.1007/978-3-658-27218-0_4 [Citations: 0] -
LIBOR Manipulation Empirical Analysis of Financial Market Benchmarks Using Benford's Law
Rauch, Bernhard | Goettsche, Max | El Mouaaouy, FlorianSSRN Electronic Journal, Vol. (2013), Iss.
https://doi.org/10.2139/ssrn.2363895 [Citations: 6]
Abstract
This article takes issue with a rather devastating critique of statistical significance testing propagated in a recent book by Ziliak/McCloskey (2008) of the same title. Ziliak/McCloskey argue that statistical significance testing is a barrier rather than a booster for empirical research in economics and should therefore be abandoned altogether. The present article argues that this is good advice in some research areas but not in others, with the aim of making practitioners aware of various fallacies connected with the concept of statistical significance, and at the same time showing where significance testing is most fruitfully employed. Taking all issues which have appeared so far of the German Economic Review and a recent epidemiological meta-analysis as examples, the present paper shows that there has indeed been a lot of misleading work where confirmatory significance testing has played a major role, and that at the same time many promising avenues, best summarized under the heading „specification tests", have not been used.