Peningkatan Keterampilan Menulis Artikel Ilmiah Mahasiswa Berbasis Artificial Intelligence melalui Modifikasi Prompt

Anhar Anhar; Haryadi Jaka Susila; Raihan Raihan; Sasi Septiani; Muthia Nadaul Riskiyah

doi:10.29255/aksara.v37i2.4905.354-368

Peningkatan Keterampilan Menulis Artikel Ilmiah Mahasiswa Berbasis Artificial Intelligence melalui Modifikasi Prompt

Anhar Anhar, Haryadi Jaka Susila, Raihan Raihan, Sasi Septiani, Muthia Nadaul Riskiyah

Abstract

This research aimed to enhance students' academic article writing skills through a metacognitive-based prompt modification framework to address the significant gap between AI technology adoption and the accuracy of AI responses in academic writing instruction. Specific research objectives included: (1) analyzing the effectiveness of each stage of prompt modification in improving the quality and relevance of AI responses, (2) developing an integrated systematic framework grounded in metacognitive knowledge that is adaptable to various learning contexts, and (3) evaluating the comprehensive impact of human-AI interaction on enhancing academic article writing skills and fostering critical cognitive awareness among students. The study employed qualitative methodology with an exploratory case study design involving all first-semester students at the School of Economics Balikpapan, Academic Year 2025/2026. Primary data were collected through comprehensive digital documentation of prompt modification responses and structured recording systems during implementation of a six-stage framework: pre-writing, draft development, prompt evaluation, modification with metadata synthesis, multi-stage implementation with metacognitive student intervention. Data analysis utilized a staged approach encompassing article categorization, contextual evaluation of content substance, and iterative processes to ensure publication-quality articles. The research findings demonstrate that prompt modification proved effective in transforming learning from spontaneous approaches toward structured guided discovery with significant improvements in coherent argumentation skills and systematic idea organization. Findings confirm the synergistic effect of integrating prompt engineering with metacognitive principles that optimize AI-based academic writing skills. The research contributes theoretically to developing culturally responsive pedagogy through contextual frameworks addressing the linguistic, cognitive, and cultural characteristics of Indonesian students, while providing evidence-based practical guidelines for implementing responsible AI integration in academic writing curricula within higher education institutions.

Abstrak

Penelitian ini bertujuan untuk meningkatkan keterampilan framework modifikasi prompt berbasis metakognitif untuk mengatasi gap signifikan antara penggunaan teknologi AI dengan tingkat akurasi jawaban AI dalam pembelajaran menulis artikel ilmiah mahasiswa. Tujuan spesifik penelitian meliputi: (1) menganalisis efektivitas setiap tahapan modifikasi prompt dalam meningkatkan kualitas dan relevansi jawaban AI, (2) mengembangkan framework sistematis terintegrasi pengatahuan metakognitif yang dapat diadaptasi berbagai konteks pembelajaran, dan (3) mengevaluasi dampak interaksi manusia dengan pemanfaat AI terhadap peningkatan keterampilan menulis artikel ilmiah dan peningkatan kesadaran kognitif yang harus ditingkatkan oleh mahasiswa. Penelitian menerapkan metodologi kualitatif dengan desain studi kasus eksploratif yang melibatkan seluruh mahasiswa semester I Sekolah Tinggi Ilmu Ekonomi Balikpapan tahun akademik 2025/2026. Data primer dikumpulkan melalui dokumentasi digital jawaban dari modifikasi prompt secara komprehensif dan sistem pencatatan terstruktur selama implementasi framework enam tahap: pra-penulisan, pengembangan draft, evaluasi prompt, modifikasi dengan sintesis metadata, implementasi multi-tahap dengan interfensi meta kofnitif mahasiswa. Analisis data menggunakan pendekatan bertahap dengan kategorisasi artikel, evaluasi kontekstual substansi konten, dan proses iteratif untuk artikel berkualitas yang telah dipublikasikan publikasi. Penelitian menunjukkan modifikasi prompt terbukti efektif mentransformasi pembelajaran dari pendekatan spontan menuju guided discovery yang terstruktur dengan peningkatan signifikan dalam keterampilan argumentasi koheren dan organisasi ide secara sistematis. Temuan mengkonfirmasi synergistic effect integrasi prompt engineering dengan metacognitive principles yang mengoptimalkan keterampilan menulis artikel ilmiah berbasi AI. Penelitian berkontribusi teoritis pada pengembangan culturally responsive pedagogy melalui contextual framework untuk karakteristik aspek linguistik kognitif mahasiswa Indonesia, serta menyediakan evidence based guidelines praktis bagi implementasi responsible AI integration dalam kurikulum penulisan akademik perguruan tinggi.

Keywords

Artificial Intelligence; Keterampilan; Menulis; Mahasiswa; Prompt

Full Text:

PDF

References

Ahmad, S. F., Alam, M. M., Rahmat, M. K., Mubarik, M. S., & Hyder, S. I. (2022). Academic and administrative role of artificial intelligence in education. Sustainability, 14(3), 1101. https://doi.org/10.3390/su14031101

Ahmad, S., Batool, S., & Malik, M. I. (2022). Impact of generative artificial intelligence on education: A systematic review. International Journal of Educational Research, 180, 102–125.

Aljuaid, H. (2024). The impact of artificial intelligence tools on academic writing instruction in higher education: A systematic review. Arab World English Journal (AWEJ) Special Issue on ChatGPT, April 2024, 26-55. https://dx.doi.org/10.24093/awej/ChatGPT.2

Association of College & Research Libraries. (2016). Framework for information literacy for higher education. American Library Association. http://www.ala.org/acrl/standards/ilframework

Barrot, J. S. (2022). Using automated writing evaluation for formative assessment in EFL writing: Effects on student writing quality and motivation. Journal of Educational Computing Research, 60(5), 1201-1225. https://doi.org/10.1177/07356331211062543

Chan, C. K. Y., & Hu, W. (2023). Students' voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20(1), 43. https://doi.org/10.1186/s41239-023-00411-8

Chan, C. K. Y., & Lee, K. K. W. (2023). The AI generation gap: Are Gen Z students more interested in adopting generative AI such as ChatGPT in teaching and learning than their Gen X and millennial generation teachers? Smart Learning Environments, 10(1), 60. https://doi.org/10.1186/s40561-023-00269-3

Chan, L., & Hu, Y. (2023). Generic prompting versus structured instruction in AI-assisted academic writing. Computers & Education, 198, 104756.

Chang, D. H., Lin, M. P. C., Hajian, S., & Wang, Q. Q. (2023). Educational design principles of using AI chatbot that supports self-regulated learning in education: Goal setting, feedback, and personalization. Sustainability, 15(20), 15078.

Chen, B., Zhang, Z., Wang, Y., et al. (2024). Unleashing the potential of prompt engineering for large language models. Patterns, 6(6), 101260. https://doi.org/10.1016/j.patter.2025.101260

Chen, Y., Liu, X., & Zhang, W. (2024). Does generative artificial intelligence improve the academic achievement of college students? A meta-analysis. Journal of Educational Computing Research, 62(7), 1896-1933.

CHI Conference on Human Factors in Computing Systems. (2024). Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. https://doi.org/10.1145/3613904

Computers & Education. (2024). Special issue on AI-generated feedback and educational technology. Computers & Education, 198, 104756. https://doi.org/10.1016/j.compedu.2024.104756

Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). Sage Publications.

Daniel, B. (2025). Can generative AI revolutionise academic skills development in higher education? A systematic literature review. European Journal of Education, 60(1), 123-145.

Darwin, R., Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki. (2024). Critical thinking in the AI era: An exploration of EFL students' perceptions, benefits, and limitations. Cogent Education, 11(1), 2290342.

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., ... & Wright, R. (2023). Opinion paper: "So what if ChatGPT wrote it?" Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642

Education Sciences. (2025). Prompt engineering patterns for culturally responsive pedagogy in AI-enhanced education. Education Sciences, 15(3), 245-267.

European Journal of Education. (2025). Methodological considerations for evaluating generative AI tools in higher education: A systematic approach. European Journal of Education, 60(2), 198-215.

Fan, Y., Wang, L., & Chen, M. (2025). Beware of metacognitive laziness: Effects of generative artificial intelligence on learning motivation, processes, and performance. British Journal of Educational Technology, 56(2), 234-252.

Federiakin, D., Molerov, D., Zlatkin-Troitschanskaia, O., & Maur, A. (2024). Prompt engineering as a new 21st century skill. Frontiers in Education, 9, 1366434. https://doi.org/10.3389/feduc.2024.1366434

Gao, L., Zhang, H., Chen, W., & Liu, J. (2024). Digital scaffolding in pre-writing activities: A meta-analysis of technology-enhanced writing instruction. Computers & Education, 201, 104823. https://doi.org/10.1016/j.compedu.2024.104823

Gay, G. (2018). Culturally responsive teaching: Theory, research, and practice (3rd ed.). Teachers College Press.

Giray, L. (2023). Prompt engineering with ChatGPT: A guide for academic writers. Annals of Biomedical Engineering, 51(12), 2629-2633. https://doi.org/10.1007/s10439-023-03272-4

Graham, S., & Perin, D. (2023). Writing instruction for students in higher education: A systematic review of effective practices. Educational Psychology Review, 35(4), 1089-1125.

Haidar, M. (2025). Impact of the integration of metacognitive prompts by generative artificial intelligence (GenAI) in collaborative and individual learning in improving writing skills and metacognitive awareness. International Journal of Learning, Teaching and Educational Research, 24(1), 15-32.

Huang, L. (2024). Improve English learning through artificial intelligence for online and offline mixed teaching path. Scalable Computing, 25(1), 481-494.

Ilieva, G., Yankova, T., Klisarova-Belcheva, S., & Dimitrov, A. (2023). Effects of generative chatbots in higher education. Information, 14(9), 492. https://doi.org/10.3390/info14090492

Imran, A. S., & Almusharraf, N. M. (2023). Adopting ChatGPT for effective English language learning: Benefits and challenges. Languages, 8(4), 253–267.

Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant in higher education: Benefits, concerns and implications for the future. Computers and Education: Artificial Intelligence, 5, 100162. https://doi.org/10.1016/j.caeai.2023.100162

Khalifa, M., & Albadawy, M. (2024). Using artificial intelligence in academic writing and research: An essential productivity tool. Computer Methods and Programs in Biomedicine Update, 100145. https://doi.org/10.1016/j.cmpbup.2024.100145

Ipek, Z. H., Gozum, A. I. C., Papatga, E., & Samur, Y. (2023). Exploring the potential of generative artificial intelligence in education: Applications, challenges, and future research directions. International Journal of Educational Technology in Higher Education, 20(1), 54. https://doi.org/10.1186/s41239-023-00421-6

Ivanov, S., Soliman, M., & Tuomi, A. (2024). The use of ChatGPT in higher education: The advantages and disadvantages. Information Technology & Tourism, 26(2), 123-145.

Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi. (2023). Statistik pendidikan tinggi Indonesia tahun 2023. Kemendikbudristek.

Khotimah, K., & Mariono, A. (2024). Enhancing metacognitive and creativity skills through AI-driven meta-learning strategies. International Journal of Interactive Mobile Technologies, 18(5), 18-31.

Kingchang, U., Thongsri, N., Santipuri, T., & Vongjaturapat, N. (2024). Factors influencing the adoption of AI chatbot platforms for educational recommendations in higher education context. Education and Information Technologies, 29(8), 9847-9871.

Knoth, N., Tolzin, A., Janson, A., & Leimeister, J. M. (2024). AI literacy and its implications for prompt engineering strategies. Computers & Education: Artificial Intelligence, 6, 100225. https://doi.org/10.1016/j.caeai.2024.100225

Koedinger, K. R., Goel, A., McLaughlin, E., & Mulholland, M. (2024). Metacognitive support in generative AI: Enhancing perceived usefulness and academic outcomes through structured assistance. Journal of Learning Sciences, 33(2), 245-278.

Language Testing in Asia. (2025). AI-generated feedback adapted to institutional and local cultural contexts for EFL writing development.

Language Testing in Asia, 15(1), 112-134.

Lee, S., & Wan, Z. H. (2023). Rubric-based task design for reducing academic anxiety in novice learners. Assessment & Evaluation in Higher Education, 48(7), 982-998.

Li, H., & Wang, Y. (2024). Metacognition-based feedback literacy in AI-assisted academic writing: A framework for higher education. Educational Technology Research and Development, 72(4), 1567-1589.

Martinez, C., & Lee, K. (2024). Extending the technology acceptance model: Understanding ChatGPT adoption for metacognitive self-regulated learning in higher education. Computers & Education, 208, 104945.

Marzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023). The integration of ChatGPT in English language education: Challenges and opportunities for Indonesian universities. Journal of English Language Teaching and Learning, 6(2), 78–95.

Marzuki, A., Sari, L., & Pratama, R. (2023). Structural guidance for Indonesian students in AI writing tools utilization. Indonesian Journal of Educational Technology, 15(2), 78-95.

Marzuki, M., Widiati, U., Rusdin, D., Darwin, D., & Indrawati, I. (2023). The impact of AI writing tools on the content and organization of students' writing: EFL teachers' perspective. Cogent Arts & Humanities, 10(1), 2236469. https://doi.org/10.1080/2331186X.2023.2236469

Maxwell, J. A. (2013). Qualitative research design: An interactive approach (3rd ed.). Sage Publications.

Memarian, B., & Doleck, T. (2024). Interaksi manusia dengan AI in artificial intelligence in education: A review and entity-relationship (ER) analysis. Computers in Human Behavior: Artificial Humans, 2, 100053. https://doi.org/10.1016/j.chbah.2024.100053

Memarian, B., & Doleck, T. (2024). Investigating students' cognitive processes in generative AI-assisted digital multimodal composing and traditional writing. Computers & Education, 210, 105031.

Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R., & Gerardou, F. S. (2023). Challenges and opportunities of generative AI for higher education as explained by ChatGPT. Education Sciences, 13(9), 856. https://doi.org/10.3390/educsci13090856

Miles, M. B., Huberman, A. M., & Saldaña, J. (2020). Qualitative data analysis: A methods sourcebook (4th ed.). Sage Publications.

Neshaei, S. P., Wambsganss, T., & Rietsche, R. (2024). Metacognition meets AI: Empowering reflective writing with large language models. British Journal of Educational Technology, 55(3), 567-585.

Papalas, A., & Kakouris, A. (2024). Adaptive human-AI collaboration patterns in academic writing: A longitudinal study of performance improvement. Interactive Learning Environments, 32(6), 2134-2151.

Park, J., & Choo, S. (2024). Generative AI prompt engineering for educators: Practical strategies. Teaching and Teacher Education, 139, 104-112.

Rosdiana, Damaianti, V. S., Mulyati, Y., et al. (2023). The role of metacognitive strategies in academic writing skills in higher education. International Journal of Learning, Teaching and Educational Research, 22(5), 156–174.

Sahoo, P., Singh, A. K., Saha, S., et al. (2024). A systematic survey of prompt engineering in large language models: Techniques and applications. Computers & Education: Artificial Intelligence, 5, 100186. https://doi.org/10.1016/j.caeai.2024.100186

Schulhoff, S. (2025). Prompt engineering as a core 21st-century competency for strategic generative AI utilization. Educational Technology & Society, 28(1), 89-104.

Teng, F., & Ma, M. (2024). Assessing metacognition-based student feedback literacy for academic writing. Assessing Writing, 59, 100810. https://doi.org/10.1016/j.asw.2024.100810

Teng, F. (2025). Metacognitive components in self-regulated learning: Implications for academic writing development. Metacognition and Learning, 20(1), 145-168.

Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), 15. https://doi.org/10.1186/s40561-023-00237-x

Urban, M., Chalup, S., & Otte, S. (2024). ChatGPT as a creativity catalyst: Experimental evidence for enhanced creative problem-solving performance in university students. Thinking Skills and Creativity, 51, 101456.

Walter, S. (2024). Prompt engineering for developing critical thinking and AI literacy: A pedagogical framework for higher education. British Journal of Educational Technology, 55(4), 1567-1584.

Wang, H., Chen, L., Zhang, Y., & Liu, M. (2024). Hybrid intelligence in education: Combining human capabilities with machine intelligence for effective lifelong learning collaboration. Computers & Education, 209, 104987.

Warschauer, M., Zheng, B., Niiya, M., Cotten, S., & Farkas, R. (2023). Affordances and contradictions of AI-generated text for multilingual learners of English. Journal of Second Language Writing, 59, 100927.

Xu, W., Ouyang, F., & Chu, S. K. W. (2024). Structured metacognitive support for enhancing self-regulated learning and reducing cognitive load in AI-assisted education. Educational Psychology, 44(3), 278-295.

Yan, D. (2023). Impact of ChatGPT on learners in L2 writing: An exploratory investigation. Education and Information Technologies, 28, 13943–13967. https://doi.org/10.1007/s10639-023-11742-4

Yan, Z. (2023). The effectiveness of ChatGPT-assisted language learning for Chinese EFL learners' writing skills: An experimental study. Applied Sciences, 13(18), 10340. https://doi.org/10.3390/app131810340

Yin, R. K. (2018). Case study research and applications: Design and methods (6th ed.). Sage Publications.

Zaghir, J., Naguib, M., Bjelogrlic, M., Névéol, A., Tannier, X., & Lovis, C. (2024). Prompt engineering paradigms for medical applications: Scoping review. Journal of Medical Internet Research, 26, e60501. https://doi.org/10.2196/60501

Zheng, B., Lin, C. H., & Kwon, J. B. (2023). The impact of AI-based scaffolding on writing education: A systematic review of recent developments. Review of Educational Research, 93(6), 892-925.

DOI: http://dx.doi.org/10.29255/aksara.v37i2.4905.354-368