The Research Competence, Critical Thinking Skills and Digital Literacy of Indonesian EFL Students


  • Rohmani Nur Indah Universitas Islam Negeri Maulana Malik Ibrahim
  • Toyyibah Institute Agama Islam Negeri Kediri
  • Ary Setya Budhiningrum Institute Agama Islam Negeri Kediri
  • Nur Afifi Macquarie University



research competence, critical thinking, digital literacy, English as Foreign Language


This project aims to investigate the relationship between English as Foreign Language (EFL) students’ research skills, critical thinking skills, and engagement with technology or their digital literacy. EFL students' research competence is expected to support their academic performance on writing papers and assignments. It also demands the development of their critical thinking skills. Their engagement in technology involves the use of social media, online networks, and the use of several applications. This study takes the sample of EFL students from two institutions, namely UIN Malang and IAIN Kediri, Indonesia, to see whether there is a similar performance in both Islamic higher education institutions in terms of students’ online research competence, critical thinking skills, and similar trend on the engagement with technology. The data collection method covers questionnaire and quiz. This result demonstrates a significant correlation between research competence and digital literacy. Concerning the insignificant relation between digital literacy and critical thinking, it proves that the digital literacy does not always automatically support the enhancement of critical thinking skills. Understanding the relationship between online research competence, critical thinking, and digital literacy is a crucial step in developing Indonesian EFL teaching syllabi and material supporting students' academic success in higher education context.

Author Biographies

Rohmani Nur Indah, Universitas Islam Negeri Maulana Malik Ibrahim

English Literature Department

Toyyibah, Institute Agama Islam Negeri Kediri

English Language Teaching Department

Ary Setya Budhiningrum, Institute Agama Islam Negeri Kediri

English Language Teaching Department

Nur Afifi, Macquarie University

Linguistics Department


Aizikovitsh-Udi, E., & Cheng, D. (2015). Developing critical thinking skills from dispositions to abilities: Mathematics education from early childhood to high school. Creative Education, 6(04), 455-462.

Akarasriworn, C., and Ku, H-Y. (2013). Graduate students' knowledge construction and attitudes toward online synchronous video conferencing collaborative learning environments. Quarterly Review of Distance Education, 14, 35–48.

Alivi, J. S., & Mardiana, W. (2020). Interrelation of technology and ideology in informal second language acquisition: A transdisciplinary framework. Paradigm, 3(1), 11-24.

Allison, B., Hilton, A., O'Sullivan, T., Owen, A., & Rothwell, A. (2016). Research skills for students. Routledge.

Al-Qallaf, C. L., & Al-Mutairi, A. S. (2016). Digital literacy and digital content supports learning. The Electronic Library, 34 (3), 522-547.

Amgott, N. (2018). Critical literacy in #DigitalActivism: Collaborative choice and action. The International Journal of Information and Learning Technology, 35 (5), 329-341.

Apino, E., & Retnawati, H. (2017). Developing instructional design to improve mathematical higher-order thinking skills of students. Journal of Physics: Conference Series, 812(1), 012100. IOP Publishing.

Asraf, R. M., Ahmed, S., & Eng, T. K. (2018). Using focused freewriting to stimulate ideas and foster critical thinking during prewriting. TESOL International Journal, 13(4), 67-81.

Asyari, M., Al Muhdhar, M. H. I., & Susilo, H. (2016). Improving critical thinking skills through the integration of problem based learning and group investigation. International Journal for Lesson and Learning Studies 46(4), 628-734.

Ayale-Pérez, T., and Joo-Nagata, J. (2019). The digital culture of students of pedagogy specializing in the humanities in Santiago de Chile. Computers and Education, 133, 1-12.

Azizi-Fini, I., Hajibagheri, A., & Adib-Hajbaghery, M. (2015). Critical thinking skills in nursing students: A comparison between freshmen and senior students. Nursing and midwifery studies, 4(1), e25721.

Beckmann, J., & Weber, P. (2015). Cognitive presence in virtual collaborative learning: Assessing and improving critical thinking in online discussion forums. International Association for Development of the Information Society, 13(1), 51-58.

Beckmann, J., & Weber, P. (2016). Cognitive presence in virtual collaborative learning. Interactive Technology and Smart Education 13(1), 52-70.

Bernhardt, P. E., & Richmond, A. S. (2019). Promoting critical thinking through the use of student-generated case studies. In Handbook of Research on Critical Thinking Strategies in Pre-Service Learning Environments (pp. 438-447). IGI Global.

Bőttcher, F., and Thiel, F. (2018). Evaluating research-oriented teaching: A new instrument to assess university students' research competence. High Education, 75(1), 91-110.

Bullen, M., Morgan, K., and Qayyum, A. (2008, October 20-22). The digital learner at BCIT and implications for an e-strategy. Research workshop of the European distance education network (EDEN), France.

Chan, W. M., Chai, Y. Y., & Abdullah, A. A. (2016). The use of information and communication technology among undergraduate students in dental training. Journal of Education and Ethics in Dentistry 6(1), 27-33.

Chang, H. P., Chen, C. C., Guo, G. J., Cheng, Y. J., Lin, C. Y., & Jen, T. H. (2011). The development of a competence scale for learning science: Inquiry and communication. International Journal of Science and Mathematics Education, 9(5), 1213-1233.

Cottrell, S. (2017). Critical thinking skills: Effective analysis, argument, and reflection. Macmillan International Higher Education.

Defianty, M., & Wilson, K. (2019). Fostering critical thinking through questioning in EFL. In Thinking Skills and Creativity in Second Language Education: Case Studies from International Perspectives (pp. 74-94). Routledge.

Dwyer, C. P., & Walsh, A. (2019). An exploratory quantitative case study of critical thinking development through adult distance learning. Educational Technology Research and Development, 68(1), 17-35.

Elmas, E., & Aydın, S. (2017). Pre-service foreign language teachers' perceptions of research skills: A qualitative study. The Qualitative Report 22(12), 3088-3101.

Firdaus, F., Kailani, I., Bakar, M. N. B., & Bakry, B. (2015). Developing critical thinking skills of students in mathematics learning. Journal of Education and Learning, 9(3), 226-236.

Francescucci, A., & Foster, M. (2013). The VIRI (virtual, interactive, real-time, instructor-led) classroom: The impact of blended synchronous online courses on student performance, engagement, and satisfaction. Canadian Journal of Higher Education, 43(3), 78–91.

Frisch, J. K., Jackson, P. C., & Murray, M. C. (2013). WikiED: Using web 2.0 tools to teach content and critical thinking. Journal of College Science Teaching, 43(1), 70–80

Frisch, J. K.; Jackson, P. C., & Murray, M. C (2018). Transforming undergraduate biology learning with inquiry-based instruction. Journal of Computing in Higher Education, 30, 211–236.

Fuad, N. M., Zubaidah, S., Mahanal, S., & Suarsini, E. (2017). Improving junior high schools' critical thinking skills based on test three different models of learning. International Journal of Instruction, 10(1), 101-116.

Gholami, M., Moghadam, P. K., Mohammadipoor, F., Tarahi, M. J., Sak, M., Toulabi, T., & Pour, A. H. H. (2016). Comparing the effects of problem-based learning and the traditional lecture method on critical thinking skills and metacognitive awareness in nursing students in a critical care nursing course. Nurse education today, 45(1), 16-21.

Hakim, A., Liliasari, L., Kadarohman, A., & Syah, Y. M. (2016). Improvement of student critical thinking skills with the natural product mini-project laboratory learning. Indonesian Journal of Chemistry, 16(3), 322-328.

Hodges, T. S., Scott, C. E., Washburn, E. K., Matthews, S. D., & Gould, C. (2019). Developing pre-service teachers' critical thinking and assessment skills with reflective writing. In Handbook of Research on Critical Thinking Strategies in Pre-Service Learning Environments (pp. 146-173). IGI Global.

Hosman, L., & Comisso, M. A. P. (2020). How do we understand “meaningful use” of the internet? Of divides, skills and socio-technical awareness. Journal of Information, Communication and Ethics in Society, 18(3), 461-479.

Howard, L. W., Tang, T. L. P., & Austin, M. J. (2015). Teaching critical thinking skills: Ability, motivation, intervention, and the Pygmalion effect. Journal of Business Ethics, 128(1), 133-147.

Indah, R. N., & Kusuma, A. W. (2016) Factors affecting the development of critical thinking of Indonesian learners of English language. Journal of Humanities and Social Science, 21(6), 86-94.

Indah, R. N. (2017) Critical thinking, writing performance, and topic familiarity of Indonesian EFL learners. Journal of Language Teaching and Research, 8(2), 229-236.

Juhaňák, L., Zounek, J., Záleská, K., Bárta, O., & Vlčková, K. (2019). The relationship between the age at first computer use and students' perceived competence and autonomy in ICT usage: A mediation analysis. Computers and Education, 141(1), 103614.

Kelly, S. L. (2019). Faculty perceptions of librarian value: The moderating relationship between librarian contact, course goals, and students' research skills. The Journal of Academic Librarianship, 45(3), 228-233.

Kennedy, G., Krause, K.-L., Judd, T., Churchward, A., and Gray, K. (2008). First-year students' experiences with technology: Are they really digital natives? Australasian Journal of Educational Technology, 24(1), 108-122.

Khoiriyah, U., Roberts, C., Jorm, C., & Van der Vleuten, C. P. M. (2015). Enhancing students' learning in problem-based learning: validation of a self-assessment scale for active learning and critical thinking. BMC medical education, 15(1), 1-8.

Kvavik, R. (2005). Convenience, communications, and control: How students use technology. In D. G. Oblinger and J. L. Oblinger (Eds.). Educating the net-generation (Chap. 7). Boulder, Co: Educause.

Leach, M. J., Hofmeyer, A., & Bobridge, A. (2016). The impact of research education on student nurse attitude, skill, and uptake of evidence‐based practice: a descriptive longitudinal survey. Journal of Clinical Nursing, 25(1-2), 194-203.

Lim, H. J., & Jung, H. (2019). Factors related to digital reading achievement: A multi-level analysis using international large scale data. Computers and Education, 133(1), 82-93.

Livingstone, S., & Bober, M. (2004). Taking up online opportunities? Children's use of the Internet for education, communications, and participation. E-learning, 1(3), 395-419.

Lu, P. Y. (2013). Critical thinking in a university EFL classroom: An intercultural syllabus. Asian EFL Journal, 71(1), 4-30.

Mahanal, S., Zubaidah, S., Bahri, A., & Maratusy, D. S. (2016). Empowering students' critical thinking skills through Remap NHT in biology classroom. In Asia-Pacific Forum on Science Learning and Teaching, 17(2), 1-13.

McNamara, J., Sweetman, S., Connors, P., Lofgren, I., & Greene, G. (2020). Using interactive nutrition modules to increase critical thinking skills in college courses. Journal of nutrition education and behavior, 52(4), 343-350.

Murawski, M., & Bick, M. (2017). Digital competences of the workforce – a research topic? Business Process Management Journal, 23(3), 721–734

Na-Nan, K., Roopleam, T., & Wongsuwan, N. (2019). Validation of a digital intelligence quotient questionnaire for employee of small and medium-sized Thai enterprises using exploratory and confirmatory factor analysis. Kybernetes, 49(5), 1465-1483.

Nasah, A., DaCosta, B., Kinsell, C., & Seok, S. (2010). The digital literacy debate: an investigation of digital propensity and information and communication technology. Educational Technology Research & Development, 58(1), 531-555.

Nedungadi, P. P., Menon, R., Gutjahr, G., Erickson, L., & Raman, R. (2018). Towards an inclusive digital literacy framework for digital India. Education + Training, 60 (6), 1-7.

Nicol, D. (2014). Guiding principles for peer review: unlocking learners' evaluative skills. In C. Kreber, C. Anderson, N. Entwistle, & J. McArthur (Eds.), Advances and innovations in university assessment and feedback (pp. 197–224). Edinburgh University Press

O'Keeffe, N., Cullinane, A. M., Greensmith, L., Bracken, S., O'Shaughnessy, N., Dennehy, C., & Lambert, V. (2019). GP132 Developing research capacity: Baseline survey identifying research activity, skills, and supports for nurses in children's hospitals in Ireland. Archives of Disease in Childhood, 104(Suppl 3), A1–A428

Olt, P. A. (2018). Virtually there: Distant freshmen blended in classes through synchronous online education. Innovative Higher Education, 43(5), 381-395.

Paul, R., & Elder, L. (2019). The miniature guide to critical thinking concepts & tools. Rowman & Littlefield.

Persky, A. M., Medina, M. S., & Castleberry, A. N. (2019). Developing critical thinking skills in pharmacy students. American journal of pharmaceutical education, 83(2), 7033-7042.

Prasojo, L. D., Wijayanti, W., Yuliana, L., Agus, N., Habibi, A., & Yaakob, M. F. M. (2020). Instruments’ validation of access to motivation, skills, and use of digital technology: EFL context in Indonesia. Studies in English Language and Education, 7(2), 308-322.

Pratiwi, Y. N., Rahayu, S., & Fajaroh, F. (2016). Socio-scientific issues (SSI) in reaction rates topic and its effect on the critical thinking skills of high school students. Jurnal Pendidikan IPA Indonesia, 5(2), 164-170.

Rafi, M., JianMing, Z., & Ahmad, K. (2019). Technology integration for students’ information and digital literacy education in academic libraries. Information Discovery and Delivery, 47(4), 203-217.

Schmid, R., & Petko, D. (2019). Does the use of educational technology in personalized learning environments correlate with self-reported digital skills and beliefs of secondary-school students? Computers and Education, 136(1), 75-86.

Song, C. (2008), Educational games with blogs: Collaborating to motivate second language undergraduate critical thinking. Online Information Review, 32(5), 557-573.

Steyaert, J. (2002) Inequality, and the digital divide: Myths and realities. In S. H. J. McNutt (Ed.), Advocacy, activism, and the internet (pp. 199-211). Lyceum Press.

Suardana, I. N., Redhana, I. W., Sudiatmika, A. A., & Selamat, I. N. (2018). Students' critical thinking skills in chemistry learning using local culture-based 7E learning cycle model. International Journal of Instruction, 11(2), 399-412.

Tai, J; Ajjawi, R; Boud, D; Dawson, P., & Panadero, E. (2018) Developing evaluative judgment: Enabling students to make decisions about the quality of work. Higher Education, 76(1), 467–481.

Tuamsuk, K., & Subramaniam, M. (2017). The current state and influential factors in the development of digital literacy in Thailand’s higher education. Information and Learning Science, 118(5), 235-251.

Ukwoma, S. C., Iwundu, N. E., & Iwundu, I. E. (2016). Digital literacy skills possessed by students of UNN, implications for effective learning and performance. New Library World, 177(11), 702-720.

Valter, K., & Akerlind, G. (2010). Introducing students to ways of thinking and acting like a researcher: A case study of research-led education in the sciences. International Journal of Teaching and Learning in Higher Education, 22(1), 89-97.

Valyukevych, T. V., Zinchenko, O.Z., Ishchenko, Y. O., Artemov, V., & Nechaiuk, L. G. (2021) Research-oriented framework of training philology students’ research skills based on corpus analytical software. European Journal of Educational Research 10(2), 671-680.

Van Deursen, A. J. A. M., & van Dijk, J. A. (2010). Measuring internet skills. International Journal of Human-Computer Interaction, 26(10), 891-916.

Visser, R., & Flynn, A. B. (2018). What are students' learning and experiences in an online learning tool designed for cognitive and metacognitive skill development? Collected Essays on Learning and Teaching, 11(1), 129-140.

Wernersson, I., & Orwehag, M. H. (2016). Scholarly skills as everyday practice–implications for education. Higher Education, Skills and Work-Based Learning 6(3), 224-236.

Willison, J., & O'Regan, K. (2007). Commonly known, commonly not known, totally unknown: A framework for students becoming researchers. Higher Education Research and Development, 26(4), 393-409.

Yildirim, J. G., Calt, A. C., & Ardaha, M. (2019). Problem-solving skills of University nursing students and factors affecting them: A Cross-sectional study. Journal of Pakistan Medical Association, 69(2), 1717-1720.

Youssef, A. B., Dahmani, M., & Omrani, N. (2015). Information technologies, students' e-skills, and diversity of learning process. Educational Information Technology, 20(1), 141-159.

Zin, Z. M., & Eng, W. B. (2014). Relationship between critical thinking dispositions and critical reading skills of Malaysian ESL learners. The Asian EFL Journal Quarterly, 16(3), 41-68.