نوع مقاله : علمی- پژوهشی

نویسندگان

1 دانشجوی دکتری سنجش و اندازه‌گیری، دانشگاه تهران، تهران، ایران

2 استادیار، دانشگاه تهران، تهران، ایران

چکیده

تحریف نتایج ارزشیابی از مخرب‌ترین آسیب‌هایی است که پویایی و نشاط هر نظامی را با چالش‌های جدی همراه می‌سازد. هدف اصلی این پژوهش ساخت پرسشنامه ارزشیابی کاذب برای مدارس ابتدایی است. بدین‌ منظور مبتنی بر روش پژوهش آمیخته اکتشافی‌ دو مطالعه به انجام رسید که در مطالعه اول از طریق نمونه‌گیری هدفمند از نوع ملاکی، 30 نفر و در مطالعه دوم، از میان معلمان مدارس ابتدایی شهر تهران تعداد 714 نفر از طریق نمونه‌گیری خوشه‌ای سه‌مرحله‌ای انتخاب شدند. داده‌های کیفی با استفاده از راهبرد هفت مرحله‌ای کُلایزی به شناسایی 4 عامل اصلی منجر گردید. در مطالعه دوم، به تدوین ابزار بر مبنای یافته های مطالعه اول و بررسی ویژگی های آن با استفاده از تحلیل عاملی اکتشافی و تاییدی پرداخته شد؛ همچنین از مدل پاسخ مدرج سیم جیما برای بررسی ویژگی گویه ها، گزینه ها و برازندگی داده ها استفاده شد. در نهایت، پس از اعمال اصلاحات و حذف موارد نامناسب ابزار تدوین‌شده، نهایی گردید.

کلیدواژه‌ها

عنوان مقاله [English]

Construction of a Standardized Questionnaire to Detect the Pseudo Evaluation in Elementary Schools

نویسندگان [English]

  • Mahdi Ghorbankhani 1
  • Keyvan Salehi 2
  • Ali Moghaddam Zadeh 2

1 Ph.D. Student, University of Tehran, Tehran, Iran.

2 Assistant Professor, University of Tehran, Tehran, Iran.

چکیده [English]

Introduction :
Distorting evaluation results is one of the most devastating damage that it threatens the dynamism of any system. The main purpose of this study is to design a Pseudo Evaluation Questionnaire (PEQ) for elementary schools. Identifying and measuring the factors that lead to Pseudo evaluations in school is very important. We conduct two studies for the structure of the PEQ. In the first study, we demonstrate the possible causes of pseudo evaluation in elementary school. In the second study, we use exploratory and confirmatory factor analysis methodologies to examine the factor structure of the PEQ.
Method :
In order to achieve research goals, we use exploratory mixed method. In the first study, 30 individuals were selected through Purposeful Sampling and in the second study, 714 teachers were selected through cluster sampling from elementary school teachers in Tehran. We also check its reliability and validity in different ways. For reliability, omega, alpha and marginal coefficients were estimated.
Results :
Qualitative data led to the identification of 4 main factors using the Colaizzi method. These main factors are: Teacher professional agency, management and planning, evaluation tools and techniques, interpersonal relationships. In the second study, results of exploratory and confirmatory factor analysis confirmed the structure of Study 1, in addition to providing evidence for the PEQ’s predictability. In the next section Graded Response Model (GRM) used to examine the characteristics of items and data fit. The result of this section was that 2 items were removed due to inappropriateness. After a thorough examination of the items, 35 items remained .
Discussion :
Overall, the results indicate that the PEQ measures the factors of pseudo evaluation which can help to identify possible causes of pseudo evaluation in elementary schools. By identifying these factors, its consequences can be prevented as much as possible.

کلیدواژه‌ها [English]

  • Pseudo Evaluation
  • Test Construction
  • Standardized Questionnaire
  • Pseudo Evaluation Questionnaire (PEQ)
  • Graded Response Model
Abedi, A. (2011). Challenges and Strategies for Effective Evaluation of Social Programs, Journal of Research, 3(2), 139-155. [Persian]
Bazargan, A. (2012). Educational Evaluation, Samt, Tehran. [Persian]
Desautels, G., & Jacob, S. (2012). The ethical sensitivity of evaluators: Aqualitativestudy using a vignette design. Evaluation, 18(4), 437-450.
Dewhirst, C. (2019). Evaluation of learning and teaching. Queens University Belfast. Northern Ireland.
Ghaemipour, M., Karami, M., & Khandaghi, M. (2015). Dissemination of Evaluation Standards in Educational Evaluation Research Report: Exploring Master's Theses; 5(9), 101-128. [Persian]
Ghorbankhani, M., & Salehi, K., (2017). Representation the characteristics of the successful professors in the virtual education in Iran’s higher education system from the viewpoint of students and professors: a phenomenological study. Journal of Technology of Education, 11(4), 327-347. [Persian]
Ghorbankhani, M., & Salehi, K. (2017). Representation Challenges of Virtual Training in Iran's Higher Education System: A Study of Phenomenological Approach. Information and Communication Technology in Educational Sciences, 7(2), 26, 123-148. [Persian]
Ghorbankhani, M., Salehi, K., & Moghadamzadeh, A. (2019). Identifying effective factors in shaping the culture of Psude evaluation in primary schools. Educational Measurement and Evaluation Studies, 9(26), 29-69. [Persian]
Habibi, H., Pardakhtchi, M., Abolghasemi, M., & Ghahremani, M. (2013). Investigating the school-centered learning atmosphere and its relationship with school effectiveness. Teaching and Learning Researches, 20(3), 101-118. [Persian]
Khosrojerdi, N., & Mahmoudi, M. (2014). School is a safe place to live and learn, National Conference on Architecture, Urban Planning and Sustainable Development with a focus on reading Iranian identity. https:// civilica.com/doc/346932 [Persian]
Lai Fong Cheng, A., & Keung Yau, H. (2011). Principals' and teachers' perceptions of quality management in Hong Kong primary schools. Quality Assurance in Education, 19(2), 170-186.
Lee, C., Oh, P. S., Ang, A., & Lee, G. (2014). Holistic assessment implementation in Singapore primary schools–part I: Using assessment to support the learning and development of students. In International Association of Educational Assessment Conference, Singapore.
Mahdiyon, R., Pahang, N., & Yarigholi, B. (2017). Identifying the factors affecting the quality of schools and examining its current status: Mixed Method, School Management, 5(1), 173-193. [Persian]
Mohammadzadeh, Z., & Salehi, K. (2017). The process of evaluating academic achievement from the perspective of the Holy Quran. Journal of Research in Islamic Education. 25(37), 100-79. [Persian]
Nxumalo, Z. F. (2007). The role of continuous assessment in primary school. Thesis of Master of education (Doctoral dissertation). University of Zululand, Faculty of Education, Department of Foundations of Education.
Porzahir, A. (2016). Introduction to Educational Planning, Agah, Tehran. [Persian]
Rabbani Parsa, E., Mesrabadi, J., & Yarmohammadzade, P. (2019). Build and Standardization of Critical Thinking, Educational Measurement, 9(34), 91-114. [Persian]
Salehi, K., & Golafshani, N. (2010). Commentary: Using Mixed Methods in Research Studies-an Opportunity with Its Challenges. International Journal of Multiple Research Approaches, 4(3), 186-191. https://doi. org/10.5172/mra.2010.4.3.186 [Persian]
Salehi, K., Bazargan, A., Sadeghi, N., & Shokoohi-Yekta, M. (2015). Representing the Teacher's Perceptions and Lived Experiences of the Possible Damages for Implementing the Descriptive Evaluation Scheme in Primary Schools, Journal of Measuring and Educational Evaluation Studies, 5(9), 59-99.  [Persian]
Samuel, K. H. (2008). Continuous assessment and lower attaining pupils in primary and junior secondary schools in Ghana (Doctoral dissertation). University of Birmingham.
Sarmad, Gh. (2010). Teaching methods and teacher art. Avaye noor, Tehran. [Persian]
Seif. A. (2012). Educational measurement, assessment and evaluation. Doran, Tehran. [Persian]
Shabani, H. (2017). Educational skills, Samt. Tehran. [Persian]
Shahdosti, L. (2011). The role of variables in home environment, student background, school atmosphere and teaching process in the mathematical development of third grade middle school students based on clean studies (2007). Master Thesis, Shahid Madani University of Azerbaijan, Tabriz, Iran. [Persian]
Shoarinejad, A. (2015). Psychology of Education and Teaching, Second Edition, Etelaat. Tehran. [Persian]
Sonpal-Valias, N. (2009). MODULE 1 Outcome Evaluation: Definition and Overview, the Vocational and Rehabilitation Research Institute.
Stufflebeam, D. L. (2001). The metaevaluation imperative. The American Journal of Evaluation, 22(2), 183-209.
Stufflebeam, D. L., & Shinkfield, A. (2012). Evaluation, Theory, Models and Application. Jossey-Bass Willy.
Tavakoli, A., Ghanbaripanah, A., Ghorbankhani, M., & Zivari, M. (2019). Psychometric properties of the scale of study habits in female students. Psychometry, 8(29), 83-105. [Persian]
Valovirta, V. (2002). Evaluation utilization as argumentation. Evaluation, 8 (1), 60-80.