Writing Assessment Model: Demands of Indonesian Teachers in the 21st Century

Authors

  • Suhud Aryana Universitas Negeri Semarang
  • Ida Zulaeha Universitas Negeri Semarang
  • Rahayu Pristiwati Universitas Negeri Semarang
  • Haryadi Universitas Negeri Semarang

DOI:

https://doi.org/10.17507/jltr.1503.09

Keywords:

the 21st century, Indonesian teachers, writing assessment model

Abstract

This research explores Indonesian teachers' perceptions of writing assessment models based on their needs from school. This research also collected input from the teachers regarding important elements in an ideal writing assessment model with 21st century. The development research model used is the Borg and Gall model adapted by Sugiyono, but development research was only at the design planning stage. This research data was collected through surveys and group discussion forums. Data analysis used the Miles and Huberman model. In short, the results showed the demands of teachers to develop a writing skills assessment model that is oriented towards the 4C and HOTS aspects and that focuses on the characteristics of reliability, sustainability, construct validity, collaboration, assessment criteria, competency standards, question construction, objectivity, and communication. Additionally, the procedural framework for the required writing skills assessment model consists of three parts: 1) identifying assessment standards, 2) writing assignment development, 3) implementation and follow-up. Therefore, this research can make a positive contribution to Indonesian teachers' efforts to measure student achievement in writing skills.

References

Abdel Latif, M. M. M. (2021). Remodeling Writers’ Composing Processes: Implications for Writing Assessment. Assessing Writing, 50(May), 100547. https://doi.org/10.1016/j.asw.2021.100547.

Agus, M. (2022). Penilaian Acuan Norma dengan Penilaian Acuan Patokan pada Cabang Atletik Nomor Lompat Jauh Sebagai Studi Komperatif. Jurnal Fakultas Keguruan & Ilmu Pendidikan, 3(1), 6–15. [Normal Reference Assessment with Benchmark Assessment in Long Jump Athletics as a Comparative Study. Journal of the Faculty of Teacher Training & Education, 3(1), 6–15].

Ahmad, A. K. (2022). Pendidikan Life Skill di Madrasah Aliyah: Studi Kasus MA Keterampilan Al Irsyad Gajah, Demak. EDUKASI: Jurnal Penelitian Pendidikan Agama Dan Keagamaan, 20(2), 150-167. [Life Skills Education in Madrasah Aliyah: Case Study of MA Skills Al Irsyad Gajah, Demak. EDUCATION: Journal of Religion and Religious Education Research, 20(2), 150-167].

Al-Kuwari, M. M., Du, X., & Koç, M. (2022). Performance Assessment in Education for Sustainable Development: A Case Study of the Qatar Education System. Prospects, 52(3–4), 513–527. https://doi.org/10.1007/s11125-021-09570-w.

Anggraena, Y., Ginanto, D., Felicia, N., Andiarti, A., Herutami Indriyanti, H., Alhapip, L., & Setiyowati, D. (2022). Panduan Pembelajaran dan Asesmen Pendidikan Anak Usia Dini, Pendidikan Dasar, dan Menengah. Jakarta: Badan Standar, Kurikulum, Dan Asesmen Pendidikan Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi Republik Indonesia. [Learning and Assessment Guide for Early Childhood Education, Primary and Secondary Education. Jakarta: Educational Standards, Curriculum and Assessment Agency, Ministry of Education, Culture, Research and Technology, Republic of Indonesia].

Annetta, L. A., Cheng, M. T., & Holmes, S. (2010). Assessing Twenty-First Century Skills through a Teacher Created Video Game for High School Biology Students. Research in Science and Technological Education, 28(2), 101–114. https://doi.org/10.1080/02635141003748358.

Arsanti, M., Zulaeha, I., & Subiyantoro, S. (2021, December). Tuntutan Kompetensi 4C Abad 21 dalam Pendidikan di Perguruan Tinggi untuk Menghadapi Era Society 5.0. In Prosiding Seminar Nasional Pascasarjana (PROSNAMPAS) (Vol. 4, No. 1, pp. 319-324). [21st Century 4C Competency Demands in Higher Education to Face the Era of Society 5.0. In Proceedings of the Postgraduate National Seminar (PROSNAMPAS) (Vol. 4, No. 1, pp. 319-324)].

Aryana, S. (2021, December). Studi Literatur: Analisis Penerapan dan Pengembangan Penilaian Autentik Kurikulum 2013 pada Jurnal Nasional dan Internasional. In Prosiding Seminar Nasional Pascasarjana (PROSNAMPAS) (Vol. 4, No. 1, pp. 368-374). [Literature Study: Analysis of the Implementation and Development of Authentic Assessment of the 2013 Curriculum in National and International Journals. In Proceedings of the Postgraduate National Seminar (PROSNAMPAS) (Vol. 4, No. 1, pp. 368-374)].

Asrul, Ananda, R., & Rosinta. (2014). Evaluasi Pembajalaran. Bandung: Citapustaka Media. [Learning Evaluation. Bandung: Citapustaka Media].

Berge, K. L., Evensen, L. S., & Thygesen, R. (2016). The Wheel of Writing: a Model of the Writing Domain for The Teaching and Assessing of Writing as a Key Competency. Curriculum Journal, 27(2), 172–189. https://doi.org/10.1080/09585176.2015.1129980.

Bond, A., & Dusík, J. (2020). Impact Assessment for the Twenty-First Century–Rising to the Challenge. Impact Assessment and Project Appraisal, 38(2), 94–99. https://doi.org/10.1080/14615517.2019.1677083.

Carroll, D. (2020). Observations of Student Accuracy in Criteria-Based Self-Assessment. Assessment and Evaluation in Higher Education, 45(8), 1088–1105. https://doi.org/10.1080/02602938.2020.1727411.

Claro, M., Preiss, D. D., San Martín, E., Jara, I., Hinostroza, J. E., Valenzuela, S., Cortes, F., & Nussbaum, M. (2012). Assessment of 21st Century ICT Skills in Chile: Test Design and Results from High School Level Students. Computers and Education, 59(3), 1042–1053. https://doi.org/10.1016/j.compedu.2012.04.004.

Correnti, R., Matsumura, L. C., Wang, E. L., Litman, D., & Zhang, H. (2022). Building a Validity Argument for an Automated Writing Evaluation System (eRevise) as a Formative Assessment. Computers and Education Open, 3(March), 100084. https://doi.org/10.1016/j.caeo.2022.100084.

Damayanti, R. S., Suyatna, A., Warsono, W., & Rosidin, U. (2017). Development of Authentic Assessment Instruments for Critical Thinking skills in Global Warming with a Scientific Approach. In International Journal of Science and Applied Science: Conference Series (Vol. 2, No. 1, pp. 289-299). UNS.

Devi, M. Y., Hidayanthi, R., & Fitria, Y. (2022). Model-Model Evaluasi Pendidikan dan Model Sepuluh Langkah dalam Penilaian. Jurnal Basicedu, 6(1), 675–683. https://doi.org/10.31004/basicedu.v6i1.1934. [Educational Evaluation Models and the Ten Step Model in Assessment. Basicedu Journal, 6(1), 675–683. https://doi.org/10.31004/basicedu.v6i1.1934].

Ebadi, S., & Bashir, S. (2021). An exploration into EFL learners’ Writing Skills Via Mobile-Based Dynamic Assessment. Education and Information Technologies, 26(2), 1995–2016. https://doi.org/10.1007/s10639-020-10348-4.

Elbow, P. (2017). Writing Assessment in the 21st Century: A Utopian View. Composition in the Twenty-First Century : Crisis and Change, March, 83–100.

Elosua, P. (2022). Validity Evidences for Scoring Procedures of a Writing Assessment Task. A Case Study on Consistency, Reliability, Unidimensionality and Prediction Accuracy. Assessing Writing, 54(October), 100669. https://doi.org/10.1016/j.asw.2022.100669

Erdoğan, V. (2019). Integrating 4C Skills of 21st Century Into 4 Language Skills in EFL Classes. International Journal of Education and Research , 7(11), 113–124.

Fernando, W. (2020). Moodle Quizzes and Their Usability for Formative Assessment of Academic Writing. Assessing Writing, 46(September), 100485. https://doi.org/10.1016/j.asw.2020.100485.

Gallardo, K. (2020). Competency-Based Assessment and the use of Performance-Based Evaluation Rubrics in Higher Education: Challenges Towards the Next Decade. Problems of Education in the 21st Century, 78(1), 61–79. https://doi.org/10.33225/pec/20.78.61

Ghaffar, M. A., Khairallah, M., & Salloum, S. (2020). Co-constructed Rubrics and Assessment for Learning: The Impact on Middle School Students’ Attitudes and Writing Skills. Assessing Writing, 45(October 2019). https://doi.org/10.1016/j.asw.2020.100468.

Ghanizadeh, A., Al-Hoorie, A. H., & Jahedizadeh, S. (2020). Higher Order Thinking Skills. in Second Language Learning and Teaching. https://doi.org/10.1007/978-3-030-56711-8_1.

Ginting E. and Permana. Y. (2018). PEDAGOGI: Penilaian Evaluasi Proses dan Hasil Belajar. In Modul (pp. 1–77). Jakarta:Kemendikbud. [PEDAGOGY: Evaluation Assessment of Learning Processes and Outcomes. In Module (pp. 1–77). Jakarta: Ministry of Education and Culture].

Griffin, P., & Care, E. (2015). Assessment and Teaching of 21st Century Skills: Method and Approach. In Educational Assessment in an Information Age. Dodrecht:Springer Business Media.

Gündüzalp, S. (2021). 21 st Century Skills for Sustainable Education: Prediction Level of Teachers’ Information Literacy Skills on Their Digital Literacy Skills. Discourse and Communication for Sustainable Education, 12(1), 85–101. https://doi.org/10.2478/dcse-2021-0007.

Hawamdeh, A., Testing, L., Okleh, B., Al, S., Hussen, N., Said, N., & Abdelrasheed, G. (2023). Portfolio vs Summative Assessment : Impacts on EFL Learners’ Writing Complexity, Accuracy, and Fluency (CAF); Self ‑ Efficacy ; Learning Anxiety ; and Autonomy. Language Testing in Asia, 5. https://doi.org/10.1186/s40468-023-00225-5.

Khairallah, M., & Adra, O. (2022). The Multifaceted Function of Rubrics as Formative Assessment Tools: A Classroom-Based Action Research in an L2 Writing Context. Language Teaching Research. https://doi.org/10.1177/13621688221104210.

Li, Z. (2021). Teachers in Automated Writing Evaluation (AWE) System-Supported ESL Writing Classes: Perception, Implementation, and Influence. System, 99, 102505. https://doi.org/10.1016/j.system.2021.102505.

Marjokorpi, J. (2023). The Relationship between Grammatical Understanding and Writing Skills in Finnish Secondary L1 Education. Reading and Writing, 0123456789. https://doi.org/10.1007/s11145-022-10405-z.

Mendikbudristek. (2021). No 07 Tahun 2022 ttg Standar Isi PAUD, SD, SMP. Kementerian Pendidikan, Kebudayaan, Riset, Dan Teknologi, 1–10.

Mislikhah, S. (2020). Implementasi Higher Order Thinking Skils dalam Pembelajaran Bahasa Indonesia di Madrasah Ibtidaiyah. UNEJ e-Proceeding, 582-593. [Implementation of Higher Order Thinking Skills in Indonesian Language Learning at Madrasah Ibtidaiyah. UNEJ e-Proceedings, 582-593].

Motallebzadeh, K., Ahmadi, F., & Hosseinnia, M. (2018). Relationship between 21st Century Skills, Speaking and Writing Skills: A Structural Equation Modelling Approach. International Journal of Instruction, 11(3), 265–276. https://doi.org/10.12973/iji.2018.11319a.

Navarro, F., Orlando, J., Vega-Retter, C., & Roth, A. D. (2022). “Science Writing in Higher Education: Effects of Teaching Self-Assessment of Scientific Poster Construction on Writing Quality and Academic Achievement”. International Journal of Science and Mathematics Education, 20(1), 89–110. https://doi.org/10.1007/s10763-020-10137-y.

Nishizuka, K. (2022). Significance and Challenges of Formative Ipsative Assessment in Inquiry Learning: A Case Study of Writing Activities in a “Contemporary Society” Course in a Japanese High School. SAGE Open, 12(2). https://doi.org/10.1177/21582440221094599.

Nurgianotoro, B. (2016). Penilaian Pembelajaran Bahasa Berbasis Kompetensi. Yogyakarta: BPFE-Yogyakarta. [Competency-Based Language Learning Assessment. Yogyakarta: BPFE-Yogyakarta].

O’Connell, J. (2022). Using a Logic Model to Evaluate Rater Training for EAP Writing Assessment. Journal of English for Academic Purposes, 60(August), 101160. https://doi.org/10.1016/j.jeap.2022.101160.

Pearson, W. S. (2022). The Mediating Effects of Student Beliefs on Engagement with Written Feedback in Preparation or High-Stakes English Writing Assessment. Assessing Writing, 52(January), 100611. https://doi.org/10.1016/j.asw.2022.100611.

Popham, J. W. (2017). Classroom Assessment: What Teachers Need to Know (Eighth edi). Unites States of America: Pearson Education, Inc.

Prayogi, R. D., & Estetika, R. (2019). Kecakapan Abad 21: Kompetensi Digital Pendidik Masa Depan. Jurnal Manajemen Pendidikan, 14(2), 144–151. www.p21.org. [21st Century Skills: Digital Competencies of Future Educators. Journal of Educational Management, 14(2), 144–151. www.p21.org].

Quaicoe, J. S., & Pata, K. (2020). Teachers’ Digital Literacy and Digital Activity as Digital Divide Components Among Basic Schools in Ghana. Education and Information Technologies. https://doi.org/10.1007/s10639-020-10158-8.

Ramadhanty, C. P., Hasani, M. F., Prawati, M. T., Horas, R., Alqadry, M. I., & Chandra, W. (2023). Contextualizing Automated Writing Evaluation: A Case of English for Specific Purposes Writings. Procedia Computer Science, 216, 580–586. https://doi.org/10.1016/j.procs.2022.12.172.

Rezaei, A. R., & Lovorn, M. (2010). Reliability and Validity of Rubrics for Assessment through Writing. Assessing Writing, 15(1), 18–39. https://doi.org/10.1016/j.asw.2010.01.003

Ridho, M. A., Yaqin, M. A., Ibad, M. N., Alqoroni, S., & Fauzan, A. C. (2021). Implementasi Standar Nasional Pendidikan Menggunakan Projects in Controlled Environments (PRINCE2) pada Organisasi Sekolah. ILKOMNIKA: Journal of Computer Science and Applied Informatics, 3(1), 111–127. https://doi.org/10.28926/ilkomnika.v3i1.129. [Implementation of National Education Standards Using Projects in Controlled Environments (PRINCE2) in School Organizations. ILKOMNIKA: Journal of Computer Science and Applied Informatics, 3(1), 111–127. https://doi.org/10.28926/ilkomnika.v3i1.129].

Rizqoh, A. N. A., & Wagiran, W. (2020). Rekonstruksi Instrumen Penilaian Tengah Semester Kelas VIII Mata Pelajaran Bahasa Indonesia Bermuatan Hots dan Adiwiyata. Face Threatening Act of Different Ethnic Speakers in Communicative Events of School Context, 8(1), 104–115. https://journal.unnes.ac.id/sju/index.php/jpbsi/article/view/24018. [Reconstruction of Class VIII Mid-Semester Assessment Instruments for Indonesian Language Subjects Containing Hots and Adiwiyata. Face Threatening Acts of Different Ethnic Speakers in Communicative Events of School Context, 8(1), 104–115. https://journal.unnes.ac.id/sju/index.php/jpbsi/article/view/24018].

Rosdiana, R., & Mukhtar, H. (2016). Penerapan Pedagogi Genre dalam Bahan Ajar Bahasa Indonesia Berbasis Technological Pedagogical Content Knowledge. Konferensi Linguistik Tahunan Atma Jaya, 334–339. [Application of Genre Pedagogy in Indonesian Language Teaching Materials Based on Technological Pedagogical Content Knowledge. Atma Jaya Annual Linguistic Conference, 334–339].

Seyatiningrum et al. (2018). Muatan HOTS pada Pembelajaran Kurikulum 2013 Pendidikan Dasar. Jakarta: Pusat Penelitian Kebijakan Pendidikan dan Kebudayaan, Badan Penelitian dan Pengembangan, Kementerian Pendidikan dan Kebudayaan. [HOTS Content in the 2013 Basic Education Curriculum Learning. Jakarta: Education and Culture Policy Research Center, Research and Development Agency, Ministry of Education and Culture].

Shrestha, P. N. (2022). Examining Evaluative Language used in Assessment Feedback on Business Students’ Academic Writing. Assessing Writing, 54(August), 100664. https://doi.org/10.1016/j.asw.2022.100664.

Stiawati, D. (2020). Penilaian Berorientasi Higer Order thinking Skills (Vol. 10, Issue 2). Jakarta: Direktorat Jenderal Guru dan Tenaga Kependidikan Kementerian Pendidikan dan Kebudayaan. https://doi.org/10.37411/pedagogika.v10i2.60. [Higher Order Oriented Assessment thinking Skills (Vol. 10, Issue 2). Jakarta: Directorate General of Teachers and Education Personnel, Ministry of Education and Culture. https://doi.org/10.37411/pedagogika.v10i2.60].

Sufyadi, D. (2021). Panduan Pembelajaran dan Asesmen (Jenjang Pendidikan Dasar dan Menengah). Jakarta: Pusat Asesmen dan Pembelajaran Badan Penelitian dan Pengembangan dan Perbukuan Kementerian Pendidikan Kebudayaan, Riset, dan Teknolog. [Learning and Assessment Guide (Primary and Secondary Education Levels). Jakarta: Center for Assessment and Learning, Research and Development and Bookkeeping Agency, Ministry of Education, Culture, Research and Technology].

Sugiyono. (2019). Metode Penelitian Kuantitaif, Kualitatif dan R&B. Bandung: ALFABETA. CV. [Quantitative, Qualitative and R&D Research Methods. Bandung: ALFABETA. CV].

Syaifuddin, M. (2020). Implementation of Authentic Assessment on Mathematics Teaching: Study on Junior High School Teachers. European Journal of Educational Research, 9(4), 1491–1502. https://doi.org/10.12973/eu-jer.9.4.149.

Wan, G., & Gut, D. M. (2011). Twenty-First Century Students Need 21st Century Skills. In Bringing schools into the 21st century (Vol. 13). http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:No+Title#0%5Cnhttp://link.springer.com/chapter/10.1007/978-94-007-0268-4_3.

Widihastuti. (2015). Model Penilaian untuk Pembelajaran Abd 21 (Sebuah Kajian untuk Mempersiapkan SDM Kritis dan Kreatif). " Prosiding Pendidikan Teknik Boga Busana., 10(1), https://news.ge/anakliis-porti-aris-qveynis-momava. [Assessment Model for Abd 21 Learning (A Study for Preparing Critical and Creative Human Resources). " Proceedings of Fashion Engineering Education., 10(1), https://news.ge/anakliis-porti-aris-qveynis-momava].

Winaryati, E. (2018). Penilaian Kompetensi Siswa Abad 21. Seminar Nasional Edusainstek FMIPA UNISMUS 2018, 6(1), 6–19. https://jurnal.unimus.ac.id/index.php/psn12012010/article/viewFile/4070/3782. [21st Century Student Competency Assessment. National Seminar on Edusainstek FMIPA UNISMUS 2018, 6(1), 6–19. https://jurnal.unimus.ac.id/index.php/psn12012010/article/viewFile/4070/3782].

Yao, Y., Wang, W., & Yang, X. (2021). Perceptions of the Inclusion of Automatic Writing Evaluation in Peer Assessment on EFL Writers’ Language Mindsets and Motivation: A Short-Term Longitudinal Study. Assessing Writing, 50(April), 100568. https://doi.org/10.1016/j.asw.2021.100568.

Zhang, Y. (2022). Assessing Literacy in a Digital World. Assessing Literacy in a Digital World. https://doi.org/10.1007/978-981-19-5715-4.

Zheng, Y., & Yu, S. (2019). What Has Been Assessed in Writing and How? Empirical Evidence from Assessing Writing (2000–2018). Assessing Writing, 42(January), 100421. https://doi.org/10.1016/j.asw.2019.100421.

Downloads

Published

2024-05-08

Issue

Section

Articles