International Electronic Journal of Mathematics Education

Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model
AMA 10th edition
In-text citation: (1), (2), (3), etc.
Reference: Saidi SS, Siew NM. Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model. INT ELECT J MATH ED. 2019;14(3), 535-546. https://doi.org/10.29333/iejme/5755
APA 6th edition
In-text citation: (Saidi & Siew, 2019)
Reference: Saidi, S. S., & Siew, N. M. (2019). Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model. International Electronic Journal of Mathematics Education, 14(3), 535-546. https://doi.org/10.29333/iejme/5755
Chicago
In-text citation: (Saidi and Siew, 2019)
Reference: Saidi, Siti Shahirah, and Nyet Moi Siew. "Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model". International Electronic Journal of Mathematics Education 2019 14 no. 3 (2019): 535-546. https://doi.org/10.29333/iejme/5755
Harvard
In-text citation: (Saidi and Siew, 2019)
Reference: Saidi, S. S., and Siew, N. M. (2019). Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model. International Electronic Journal of Mathematics Education, 14(3), pp. 535-546. https://doi.org/10.29333/iejme/5755
MLA
In-text citation: (Saidi and Siew, 2019)
Reference: Saidi, Siti Shahirah et al. "Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model". International Electronic Journal of Mathematics Education, vol. 14, no. 3, 2019, pp. 535-546. https://doi.org/10.29333/iejme/5755
Vancouver
In-text citation: (1), (2), (3), etc.
Reference: Saidi SS, Siew NM. Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model. INT ELECT J MATH ED. 2019;14(3):535-46. https://doi.org/10.29333/iejme/5755

Abstract

This study is an assessment of the reliability and validity analysis of Statistical Reasoning Test Survey (SRTS) instrument using the Rasch Measurement Model. The SRTS instrument was developed by the researchers to assess students’ statistical reasoning in descriptive statistics among Tenth Grade science- stream students in rural schools. SRTS was a combination of a subjective test and an open-ended format questionnaire which contained of 12 items. The respondents’ statistical reasoning was assessed based on these four constructs: Describing Data, Organizing Data, Representing Data and Analyzing and Interpreting Data. The sample comprised of 115 (76%) girls and 36 (24%) boys aged 15-16 years old from a rural district in Sabah, Malaysia. Overall, the SRTS instrument was found to have a high reliability with a Cronbach’s alpha value (KR-20) of 0.81. Results also showed that SRTS has an excellent item reliability and high item separation value of 0.99 and 9.57 respectively. SRTS also has a good person reliability and person separation value of 0.81 and 2.04 respectively. Meanwhile, the validity of the SRTS instrument was appropriately established through the item fit, person fit, variable map, and unidimensionality. In conclusion, this study indicates that the SRTS is a reliable and valid instrument for measuring the statistical reasoning of science-stream students from rural secondary schools.

References

  • Abdul Aziz, A., Jusoh, M.S., Omar, A.R., Amlus, M.H., & Awang Salleh, T.S. (2014). Construct Validity: A Rasch Measurement Model Approaches. J. Appl. Sci. & Agric., 9(12), 7-12.
  • Ariffin, S. R., Omara, B., Isaa, A., & Sharif, S. (2010). Validity and Reliability Multiple Intelligent Item Using Rasch Measurement Model. Procedia Social and Behavioral Sciences, 9, 729-733. https://doi.org/10.1016/j.sbspro.2010.12.225
  • Bond, T. G., & Fox, C. M. (2007). Applying The Rasch Model: Fundamental Measurement in the Human Science (2nd Ed). New Jersey: Lawrence Erlbaum.
  • Bond, T. G., & Fox, C. M. (2015). Applying The Rasch Model: Fundamental Measurement in the Human Science (3nd Ed). New Jersey: Lawrence Erlbaum. https://doi.org/10.4324/9781315814698
  • Boone, W. J. (2016). Rasch Analysis for Instrument Development: Why, When, and How? CBE Life Sciences Education, 15(4), rm4. https://doi.org/10.1187/cbe.16-04-0148
  • Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Dordrecht, Netherlands: Springer. https://doi.org/10.1007/978-94-007-6857-4
  • Chan, S. W, & Ismail, Z. (2014). A Technology-Based Statistical Reasoning Assessment Tool in Descriptive Statistics for Secondary School Students. The Turkish Online Journal of Educational Technology, 13(1), 29-46. https://doi.org/10.1016/j.sbspro.2013.10.067
  • Chan, S. W. & Ismail, Z. (2013). Assessing misconceptions in reasoning about variability among high school students. Procedia - Social and Behavioral Sciences, 93, 1478-1483. https://doi.org/10.1016/j.sbspro.2014.03.658
  • Chan, S. W., Ismail, Z., & Sumintono, B. (2014). A Rasch Model Analysis on Secondary Students’ Statistical Reasoning Ability in Descriptive Statistics. Procedia - Social and Behavioral Sciences 129, 133-139.
  • Deane, T., Nomme, K., Jeffery, E., Pollock, C., & Birol, G. (2016). Development of the Statistical Reasoning in Biology Concept Inventory (SRBCI). CBE— Life Sciences Education, 15, ar5. https://doi.org/10.1187/cbe.15-06-0131
  • Edwards, A., & Alcock, L. (2010). Using Rasch analysis to identify uncharacteristic responses to undergraduate assessments. Teaching Mathematics and its Applications, 29(4), 165-175. https://doi.org/10.1093/teamat/hrq008
  • Foo, K. K., Idris, N., Mohamed, I., & Foo, S. L. (2014). A multiple regression model of statistical reasoning: A Malaysian context. OIDA International Journal of Sustainable Development, 9(10), 59-70.
  • Garfield, J. B. (1998). The Statistical Reasoning Assessment: Development and Validation of a Research Tool. In: L. Pereira-Mendoza, L. Seu Kea, T. Wee Kee, & W.K. Wong (eds.), Proceedings of the Fifth International Conference on Teaching Statistics, 781- 786. Singapore: International Statistical Institute.
  • Garfield, J., & Chance, B. (2000). Assessment in Statistics Education: Issues and Challenges. Mathematics Thinking and Learning, 2(1&2), 99-125. https://doi.org/10.1207/S15327833MTL0202_5
  • Iramaneerat, C., Smith, Jr. E. V., & Smith, R.M. (2008). An introduction to Rasch measurement. In J.W. Osborn (Ed.). Best practices in quantitative methods (pp. 50-70). Thousand Qaks, California: Sage Publications, Inc. https://doi.org/10.4135/9781412995627.d6
  • Ismail, Z. & Chan, S. W. (2015). Malaysian Students’ Misconceptions about Measures of Central Tendency: An Error Analysis. AIP Conference Proceedings, 1643, 93. https://doi.org/10.1063/1.4907430
  • Jones, G. A., Thornton, C. A., Langrall, C.W., Mooney, E. S., Perry, B., & Putt, I. A. (2000). A framework for characterizing children’s statistical thinking. Mathematical Thinking and Learning, 2, 269–307. https://doi.org/10.1207/S15327833MTL0204_3
  • Jones, G.A., Langrall, C.W., Mooney, E.S. & Thornton, C.A. (2004). Models of development in statistical reasoning. In D. Ben-Zvi and J. Garfield (Eds). The Challenge of Developing Statistical Literacy, Reasoning, and Thinking, pp. 97–117, Dordrecht: Kluwer Academic. https://doi.org/10.1007/1-4020-2278-6_5
  • Karatoprak, R. Karagöz, G. & Börkan, B. (2015). Prospective elementary and secondary school mathematics teachers’ statistical reasoning. International Electronic Journal of Elementary Education, 7(2), 107-124.
  • Klooster, P. M., Taal, E., & Laar, M. A. F. J. (2008). Rasch Analysis of the Dutch Health Assessment Questionnaire Disability Index and the Health Assessment Questionnaire II in Patients with Rheumatoid Arthritis. Arthritis & Rheumatism (Arthritis Care & Research), 59(12), 1721-1728. https://doi.org/10.1002/art.24065
  • Krishnan, S. & Idris, N. (2014). Investigating Reliability and Validity for the Construct of Inferential Statistics. International Journal of Learning, Teaching and Educational Research, 4(1), 51-60.
  • Linacre, J. M. (2002). Understanding Rasch Measurement: Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85-106.
  • Linacre, J. M. (2003). Dimensionality: Contrasts & variances. Help for Winsteps Rasch Measurement Software. Retrieved from http://www.winsteps.com/winman/principalcomponents.htm
  • Mahmud, Z., & Potter, A. L. (2015). Using Rasch analysis to explore what students learn about probability concept. Indonesian Mathematical Society Journal on Mathematics Education, 6(1), 1-11.
  • Martin, N. (2013). Gender Differences in Statistical Reasoning: A Multipronged Approach (Unpublished PhD Thesis), University of Waterloo.
  • Marwan, A., Sumintono, B., & Mislan, N. (2012). Revitalizing Rural Schools: A Challenge for Malaysia. In: Educational Issues, Research and Policies (172-188). RMC-UTM Press: Skudai, Johor Bahru,
  • “Misconceptions in Inferential Statistics.” (2018). Malaysian College Students Misconceptions in Inferential Statistics. International Journal of Pure and Applied Mathematics, 118(24), 1-14. Retrieved on 10 November 2018 from https://acadpubl.eu/hub/2018-118-24/1/22.pdf
  • Mooney, E. S. (2002). A framework for characterizing middle school students’ statistical thinking. Mathematical Thinking and Learning, 4(1), 23-63. https://doi.org/10.1207/S15327833MTL0401_2
  • Nevin, E., Behan, A., Duffy, G., Farrel, S., Harding, R., Howard, R., Raighne, A., & Bowe, B. (2015). Assessing the validity and reliability of dichotomous test results using Item Response Theory on a group of first year engineering students. The 6th Research in Engineering Education Symposium (REES 2015), Dublin, Ireland, July 13-15.
  • Olsen, L. W. (2003). Essays on George Rasch and his Contributions to Statistics. Unpublished PhD Thesis, University of Copenhagen.
  • Runnels, J. (2012). Using the Rasch model to validate a multiple choice English achievement test. International Journal of Language Studies (IJLS), 6(4), 141-153
  • Saidi, S. S., & Siew, N. M. (2019). Assessing Students’ Understanding of Measures of Central Tendency and Attitude towards Statistics in Rural Secondary Schools. International of Electronic Journal of Mathematics Education, 14(1), 73-86. https://doi.org/10.12973/iejme/3968
  • Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch Pada Assessment Pendidikan. Cimahi: Trim Komunikata Publishing House.
  • Tempelaar, D. (2004). Statistical Reasoning Assessment: An Analysis of the SRA Instrument. Proceedings of the ARTIST Roundtable Conference on Assessment in Statistics, Lawrence University.
  • Ulusoy, A., & Altay, K. (2017). Analyzing the statistical reasoning levels of pre-service elementary school teachers in the context of a model eliciting activity. International Journal of Research in Education and Science (IJRES), 3(1), 20-30. https://doi.org/10.21890/ijres.267363
  • Wang, W., Wang, X., & Chen, G. (2009). Survey and Analysis of the Statistical Reasoning among High School Students in China and Dutch. Journal of Mathematics Education, 2(1), 15-26.
  • Zaidan, A., Ismail, Z., Mohamad Yusof, Y., & Kashefi, H. (2012). Misconceptions in descriptive statistics among postgraduates in social sciences, Procedia-Social and Behavioral Sciences, 46, 3535–3540. https://doi.org/10.1016/j.sbspro.2012.06.100

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.