Selected Indicators of Effect Size in Psychological Research
Abstract
Reflecting the changing statistical practice in psychological research, dominated by null hypothesis testing using a decision about the level of significance of the results, the recommendations are indicated for reporting effect sizes in papers. The study presents the concept of the effect size and indicates its place in data analysis regarding to outcome’s significance. The purpose of the work is to describe selected effect size indicators and to point the need of use and their proper presentation and interpretation in social sciences empirical work data analysis reports. Considering statistical analysis approach limits based on significance level only, the study presents the possibility of including in the data analysis an indicator of a more practical use which is the size of the effect. By using the most popular analysis methods, such as, Student t-test, univariate analyses of variance in between- and within-group schemes as well as Wilcoxon test, Mann-Whitney’s U, Kruskal-Wallis H, Friedman’s test and considering analysis for qualitative data, matched to research plans indicators of the effect size were presented. The paper presents the use, calculation and interpretation of the size effect such as: Cohen’s d, Hedges g, delta, Glass’s rg, matched pairs correlation rc, eta-square, omega-square and epsilon-square, Kendall’s W and fi, Cramer’s V as well as odds ratio and relative risk. The presentation of the effect size indicators was contrasted with the corresponding research plans and the type of data collected.
Keywords
Full Text:
PDF (Język Polski)References
LITERATURA
American Psychology Association (APA). (1994). Publication Manual of the American Psychology Association (4th ed.). Washington: Author.
American Psychology Association (APA). (2020). Publication Manual of the American Psychology Association (7th ed.). Washington: Author.
Baguley, T. (2009). Standardized or Simple Effect Size: What Should Be Reported? British Journal of Psychology, 100(3), 603–617. DOI: 10.1348/000712608X377117
Bosco, F.A., Aguinis, H., Singh, K., Pierce, C.A. (2015). Correlational Effect Size Benchmarks. Journal of Applied Psychology, 100(2), 431–439. DOI: 10.1037/a0038047
Brzeziński, J.M. (2021). Testy istotności różnic i wskaźniki wielkości efektu ES – wybrane zagadnienia. W: Metodologia badań psychologicznych (s. 205–234). Warszawa: Wydawnictwo Naukowe PWN.
Cohen, J. (1988). Statistical Power: Analysis for the Behavioral Sciences. Hillsdale: Lawrence Erlbaum Associates.
Cypryańska, M., Bedyńska, S. (2013). Testy t-Studenta i ich nieparametryczne odpowiedniki. W: S. Bedyńska, M. Cypryańska (red.), Statystyczny drogowskaz 1. Praktyczne wprowadzenie do wnioskowania statystycznego (s. 159–193). Warszawa: Wydawnictwo Akademickie Sedno.
Ferguson, C.J. (2009). An Effect Size: A Guide for Clinicians and Researchers. Professional Psychology: Research and Practice, 40(5), 532–538. DOI: 10.1037/a0015808
Field, A. (2013). Discovering Statistics Using IBM SPSS. Thousand Oaks: Sage.
Fritz, C.O., Morris, P.E., Richler, J.J. (2012). Effect Size Estimates: Current Use, Calculations and Interpretation. Journal of Experimental Psychology: General, 141(1), 2–18. DOI: 10.1037/a0024338
Grissom, R.J., Kim, J.J. (2011). Effect Sizes for Research: Univariate and Multivariate Applications. New York: Routledge, Taylor and Francis Group. DOI: 10.4324/9780203803233
Henson, K. (2016). Effect-Size Measures and Meta-Analytics Thinking in Counseling Psychology Research. Counseling Psychology, 34(5), 601–629. DOI: 10.1177/00110005283558
King, B.M., Minium, E.W. (2020). Statystyka dla psychologów i pedagogów. Warszawa: Wydawnictwo Naukowe PWN.
Kirk, R.E. (2001). Promoting Good Statistical Practices: Some Suggestions. Educational and Psychological Measurement, 61(2), 213–218. DOI: 10.1177/00131640121971185
Kühberger, A., Fritz, A., Scherndl, T. (2014). Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size. PLoS ONE, 9(9), 1–8. DOI: 10.1371/journal.pone.0105825
Lourel, M., Gueguen, N., Pascaul, A., Mouda, F. (2011). The Effect-Size: A Simple Methodology for Determining and Evaluating the “Effect-Size”. Psychology, 2(6), 631–632. DOI: 10.4236/psych.2011.26096
Olejnik, S., Algina, J. (2000). Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations. Contemporary Educational Psychology, 25(3), 241–286. DOI: 10.1006/ceps.2000.1040
Olejnik, S., Algina, J. (2003). Generalized Eta and Omega Squared Statistics: Measures of Effect Size for Some Common Research Designs. Psychological Methods, 8(4), 434–447. DOI: 10.1037/1082-989X.8.4.434
Pek, J., Flora, D.B. (2018). Reporting Effect Size in Original Psychological Research: A Discussion and Tutorial. Psychological Methods, 23(2), 208–225. DOI: 10.1037/met0000126
Rosenthal, R., Rosnow, R.L., Rubin, D.B. (2000). Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach. Cambridge: Cambridge University Press. DOI: 10.1017/CBO9780511804403
Rosnow, R.L., Rosenhtal, R. (2003). Effect Size for Experimenting Psychologists. Canadian journal of Experimental Psychology, 57(3), 221–237. DOI: 10.1037/h0087427
Sawilowsky, S.S. (2009). New Effect Size Rules of Thumb. Journal of Modern Applied Statistical Methods, 8(2), 597–599. DOI: 10.22237/jmasm/1257035100
Sullivan, G.M., Feinn, R. (2012). Using Effect Size – or Why the p Value Is Not Enough. Journal of Graduate Medical Education, 4(3), 279–282. DOI: 10.4300/JGME-D-12-00156.1
Sun, S., Pan, W., Wang, L.L. (2010). A Comprehensive Review of Effect Size Reporting and Interpreting Practice in Academic Journals in Education and Psychology. Journal of Educational Psychology, 102(4), 989–1004. DOI: 10.1037/a0019507
Vacha-Haase, T., Thompson, B. (2004). How to Estimate and Interpret Various Effect Sizes. Journal of Counseling Psychology, 51(4), 473–481. DOI: 10.1037/0022-0167.51.4.473
NETOGRAFIA
Coe, R. (12–14.09.2002). It’s the Effect Size, Stupid. British Educational Research Association Annual Conference, Exeter, Great Britain. Pobrane z: https://f.hubspotusercontent30.net/hubfs/5191137/attachments/ebe/ESguide.pdf
DOI: http://dx.doi.org/10.17951/j.2022.35.4.139-157
Date of publication: 2023-02-27 15:39:08
Date of submission: 2022-02-19 19:01:52
Statistics
Indicators
Refbacks
- There are currently no refbacks.
Copyright (c) 2023 Arkadiusz Prajzner
This work is licensed under a Creative Commons Attribution 4.0 International License.