Designing and Validating a Rubric for Writing in the Upper Elementary Education

Nazari, Heshmatollah; Talaee, Ebrahim; Hatami, Javad; Timas, Abdolzahra

doi:10.22055/edus.2023.43493.3449

Document Type : Research Paper

Authors

¹ Associate Professor, PhD in Educational Technology, Department of Education, Faculty of Humanities, Tarbiat Modares University, Tehran, Iran.

² Associate Professor, Curriculum Studies, Department of Educational Sciences, Tarbiat Modares University, Tehran, Iran.

³ Professor of Curriculum Planning, Department of Educational Sciences, Tarbiat Modares University, Tehran, Iran

⁴ Ph.D. student in Educational Management, Department of Educational Sciences, Tarbiat Modares University, Tehran, Iran.

10.22055/edus.2023.43493.3449

Abstract

Introduction
A writing rubric is a guideline that outlines the criteria and levels of performance for a writing-specific task. The research discussed in the passage focused on designing and validating a rubric specifically for writing in the upper elementary education.

Method
The study was generally a type of measurement research, specifically scaling research. The study explains the methods and main stages of designing and implementing a scale in detail.

Results
After reviewing the rubrics used in primary education and determining custom rubrics for different types of writing (descriptive, narrative, explanatory, and argumentative), the researcher extracted the objectives of the Persian language curriculum in the field of writing. Then, among the components of each type of writing, they selected general components and finally designed a 9-component rubric. After designing the rubric, its validity was examined.
Discussion
The lack of a standard rubric for writing is one of the reasons for the unclear situation of elementary school students' writing skills in Iran. The presence of a rubric not only provides a clear view of the student's writing skills but also makes them aware of the expectations and goals of the writing curriculum. This awareness leads to an improvement in their writing skills.

Keywords

References

Andrade, H. G. (2001). The Effects of Instructional Rubrics on Learning to Write. Current issues in education. 4(4), 1-9

Andrade, H. G. (2005). Teaching with rubrics: The good, the bad, and the ugly. College teaching, 53(1), 27-31. https://doi.org/10.3200/CTCH.53.1.27-31

Andrade, H. G. (2020). Using rubrics for assessment. Education Sciences, 10(1), 16. https://doi.org/10.1186/s40468-023-00224-6

Andrade, H. L., Du, Y., & Wang, X. (2008). Putting rubrics to the test: The effect of a model, criteria generation, and rubric‐referenced self‐assessment on elementary school students' writing. Educational Measurement: Issues and Practice, 27(2), 3-13. https://doi.org/10.1111/j.1745-3992.2008.00118.x

Andrade, H. L., Wang, X., Du, Y., & Akawi, R. L. (2009). Rubric-referenced self-assessment and self-efficacy for writing. The Journal of Educational Research, 102(4), 287-302. https://doi.org/10.3200/JOER.102.4.287-302

Bradford, K. L., Newland, A. C., Rule, A. C., & Montgomery, S. E. (2016). Rubrics as a tool in writing instruction: Effects on the opinion essays of first and second graders. Early Childhood Education Journal, 44, 463-472. DOI:10.1007/s10643-015-0727-0

Breland, H. M. (1983). The direct assessment of writing skill: A measurement review. New York: College Entrance Examination Board.

Briggs, D. (1970). The influence of handwriting on assessment. Educational Research, 13, 50–55. https://doi.org/10.1080/0013188700130107

Bull, R., & Stevens, J. (1979). The effects of attractiveness of writer and penmanship on essay grades. Journal of Occupational Psychology, 52, 53–59. DOI:10.1111/j.2044-8325.1979.tb00440.x

Chase, C. I. (1968). The Impact of some obvious variables on essay test scores. Journal of Educational Measurement, 5, 315–318. https://doi.org/10.1111/j.1745-3984.1968.tb00644.x

Fang, Z., & Wang, Z. (2011). Beyond rubrics: Using functional language analysis to evaluate student writing. The Australian Journal of Language and Literacy, 34(2), 147-165. https://doi.org/10.1007/BF03651853

Finson, K. D. (1998). Rubrics and their use in inclusive science. Intervention in School and Clinic, 34(2), 79–88. https://doi.org/10.1177/105345129803400203

Graham, S., & Hebert, M. (2011). Writing to read: A meta-analysis of the impact of writing and writing instruction on reading. Harvard educational review, 81(4), 710-744. https://doi.org/10.17763/haer.81.4.t2k0m13756113566

Hamp-Lyons, L. (2002). The scope of writing assessment. Assessing Writing, 8(1), 5–16. DOI:10.1016/S1075-2935(02)00029-6

Hang, N. T. T., & Lien, T. T. B. (2023). Using rubric to assess primary school students’ competence in teaching science in Vietnam. European Journal of Education Studies, 10(2), 232-243. http://dx.doi.org/10.46827/ejes.v10i2.4679

James, H. (1927). The effect of handwriting on grading. English Journal, 16, 180–205

Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130-144. https://doi.org/10.1016/j.edurev.2007.05.002

Joyce, B. R., & Showers, B. (2002). Student achievement through staff development (Vol. 3). Alexandria, VA: Association for Supervision and Curriculum Development.

Knoch, U. (2009). Diagnostic assessment of writing: A comparison of two rating scales. Language Testing, 26(20), 275–304. https://doi.org/10.1177/0265532208101008

Knoch, U., Read, J., & Von Randow, J. (2007). Re-training writing raters online: How does it compare with face-to-face training? Assessing Writing, 12, 26–43. https://doi.org/10.1016/j.asw.2007.04.001

Malouff, J. (2008). Bias in grading. College Teaching, 56(3), 191–192. https://doi.org/10.3200/CTCH.56.3.191-192

Markham, L. R. (1976). Influences of handwriting quality on teacher evaluation of written work. American Educational Research Journal, 13, 277–283. https://doi.org/10.2307/1162390

Marshall, J. C., & Powers, J. M. (1969). Writing neatness, composition errors, and essay grades. Journal of Educational Measurement, 6(2), 97-101. https://doi.org/10.1111/j.1745-3984.1969.tb00665.x

National Center for Education Statistics. (2012). The nation’s report card: Writing 2011 (No. NCES 2012- 470). Washington, DC: Institute of Education Sciences, U.S. Department of Education. Retrieved from: http://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2012470

Nazari, H., Talaee, E., Hatami, J., Imani, M., & Timas, A. (2023). An investigation on the writing quality of elementary school students: an evaluating study. Journal of Educational Scinces, 30(1), 1-20. https://doi.org/10.22055/edus.2022.38746.3282 [Persian]

Namdari, P., Kiamanesh, A., & Karimi, A. (2011). The role of attitude variables, self-concept and primary literacy activities in predicting Iranian students' reading literacy based on Perls' 2006 Journal of Educational Sciences, 2 (18), 131-154. [Persian]

Pitan, O.S. (2017). Graduate employees’ generic skills and training needs. Higher Education, Skills and Work-Based Learning, 7 (3): 290-303. DOI:10.1108/HESWBL-04-2017-0026

Popp, S. E. O., Ryan, J. M., Thompson, M. S., & Behrens, J. T. (2003). Operationalizing the Rubric: The Effect of Benchmark Selection on the Assessed Quality of Writing. Paper presented at the Annual Meeting of the American Educational Research Association (Chicago, IL, April 21-25, 2003).

Read, B., Francis, B., & Robson, J. (2005). Gender, bias, assessment and feedback: Analyzing the written assessment of undergraduate history essays. Assessment and Evaluation in Higher Education, 30 (3), 241–260. https://doi.org/10.1080/02602930500063827

Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & evaluation in higher education, 35(4), 435-448. https://doi.org/10.1080/02602930902862859

Research and educational planning organization. (2012). Farsi textbook - third grade - 304. Tehran: Offset Company

Rezaei, A. R., & Lovorn, M. (2010). Reliability and validity of rubrics for assessment through writing. Assessing writing, 15(1), 18-39. https://doi.org/10.1016/j.asw.2010.01.003

Ross-Fisher, R. L. (2005). Developing effective success rubrics. Kappa Delta Pi, 41(3), 131–135. https://doi.org/10.1080/00228958.2005.10518823

Latifi, S., Noroozi, O., Hatami, J., & Fardanesh. H. (2019). The effects of argumentation training in online peer feedback environment on process and outcomes of learning, Journal of Educational Sciences, 26(2), 71-88. https://doi.org/10.22055/edus.2019.28694.2763

Scannell, D. P., & Marshall, J. C. (1966). The effect of selected composition errors on grades assigned to essay examinations. American Educational Research Journal, 3, 125–130. https://doi.org/10.3102/000283120030021

Sheppard, E. M. (1929). The effects of quality of penmanship on grades. Journal of Educational Research, 19, 102–105. https://doi.org/10.1080/00220671.1929.10879922

Silvestri, L., & Oescher, J. (2006). Using rubrics to increase the reliability of assessment in health classes. International Electronic Journal of Health Education, 9, 25–30

Spandel, V. (2006). In defense of rubrics. English Journal, 96(1), 19–22.

Tankersley, K. (2005). Literacy strategies for grades 4-12: Reinforcing the threads of reading. ASCD.

Tomkins, M. (2003). Trouble comes in threes. Times Educational Supplement, 4547, 23

Tucker, C. R. (2012). Blended learning in grades 4–12: Leveraging the power of technology to create student-centered classrooms. Corwin Press.

Turley, E. D., & Gallagher, C. G. (2008). On the uses of rubrics: Reframing the great rubric debate. English Journal, 79(4), 87–92

Weigle, S. C. (2002). Assessing writing. Cambridge: Cambridge University Press.

Wild, M. D., Mayeaux, A. S., & Edmonds, K. P. (2008). Teamwork: Setting the Standard for Collaborative Teaching, Grades 5-9. Stenhouse Publishers.

Designing and Validating a Rubric for Writing in the Upper Elementary Education

References

References

Volume 31, Issue 2December 2024Pages 1-22

Volume 31, Issue 2
December 2024
Pages 1-22