Scientific Text Detection Tools: Accuracy, Bias, and Academic Integrity Challenges in Multilingual Educational Environments
DOI:
https://doi.org/10.37375/foej.v5i2.4265Abstract
The widespread use of artificial intelligence (AI) has significantly influenced academic writing and raised increasing concerns about research integrity. As AI writing tools have become more common, universities and academic institutions have adopted AI text detection systems to distinguish human-written text from AI-generated content. However, questions remain regarding the accuracy, fairness, and reliability of these tools, particularly when evaluating texts written by non-native English speakers. This study aims to examine the accuracy, limitations, and potential bias of current AI text detection systems through an analytical literature review. Peer-reviewed articles, preprints, and institutional reports published between 2023 and 2025 were systematically reviewed. The analysis focused on detection accuracy, false-positive and false-negative rates, linguistic bias, and the main limitations of existing detection methods. The findings indicate that current AI detection tools still suffer from inconsistent accuracy and are prone to errors, particularly when assessing writing produced by non-native English speakers. The review also highlights the vulnerability of many detection systems to paraphrasing and other text modification techniques. It is concluded that AI detection tools should not be used as the sole basis for academic judgment. Instead, their use should be supported by human evaluation, clear institutional guidelines, and continuous improvement to ensure greater fairness, accuracy, and reliability.
References
• Brown, A., & Davis, J. (2024). Keystroke dynamics and AI-assisted writing detection: A pilot study. Computers & Education, 190, Article 104635.
• Chen, L., & Huang, W. (2024). AI text detection in multilingual academic settings: Challenges and recommendations. Journal of Learning Analytics, 11(1), 55–70.
• Huang, Y., & Chen, R. (2024). Bias in AI-generated text detection against non-native English writers. IEEE Access, 12, 10855–10866.
• International Journal for Educational Integrity. (2023). Review of AI text detection vulnerabilities under paraphrasing and translation. International Journal for Educational Integrity, 19, Article 26. https://edintegrity.biomedcentral.com/articles/10.1007/s40979-023-00146-z
• International Journal of Speech Technology. (2024). Neural text detectors and language bias: Non-native English evaluation. International Journal of Speech Technology, 27(2), 145–158.
• Koponen, T., & Latvala, T. (2023). Automated detection of AI-generated text: Accuracy and limitations. Computers & Education, 188, Article 104604.
• Li, P., Zhou, H., & Sun, Y. (2023). Evaluating the robustness of AI writing detection tools. Education and Information Technologies, 28, 5437–5454.
• Nguyen, T., & Tran, M. (2024). False positives in AI-generated text detection: A systematic review. Computers & Education, 189, Article 104622.
• Perkins, M., Roe, J., Vu, B. H., Postma, D., Hickerson, D., & McGaughran, J. (2024). GenAI detection tools, adversarial techniques and implications for inclusivity in higher education (arXiv Preprint arXiv:2403.19148).
• Roberts, K., & Patel, S. (2024). Ethical considerations in AI text detection for higher education. Journal of Academic Ethics, 21, 145–160.
• Singh, R., & Kumar, P. (2024). Robustness and fairness of AI writing detection systems: A comparative analysis. Journal of Educational Computing Research, 62(5), 1200–1222.
• Smith, J., Kumar, R., & Lee, H. (2024). Behavioral detection of AI-assisted writing via keystroke dynamics. Computers & Education, 185, Article 104583.
• Tufts, L., Zhao, Y., & Li, Q. (2024). Evaluation of AI detection tools under adversarial conditions: Sensitivity and robustness. International Journal of Educational Technology in Higher Education, 21, Article 53.
• https://educationaltechnologyjournal.springeropen.com/counter/pdf/10.1186/s41239-024-00487-w.pdf
• Turnitin. (2023). Internal evaluation report: AI writing detection across academic documents. Turnitin Resources. ttps://www.turnitin.com/resources
• Turnitin Blog. (2023). Understanding AI writing detection bias in non-native English submissions. Turnitin. https://www.turnitin.com/blog/ai-detection-bias
• Turner, M., & Green, J. (2023). Limitations of AI-generated text detectors in higher education. Educational Technology Research and Development, 71, 1121–1135.
• Wang, S., & Liu, Y. (2023). Paraphrasing and translation attacks on AI text detection tools. International Journal of Computer Assisted Radiology and Surgery, 18, 1523–1533.
• Xie, H., Chen, T., Ren, L., & Su, Z. (2025). Conformal watermarking for AI text detection in educational contexts. IEEE Transactions on Learning Technologies, 18(1), 12–25.
• Zhang, Y., Li, J., & Wang, R. (2024). Adversarial attacks on AI text detectors and
• countermeasures. International Journal of Artificial Intelligence in Education, 34(3), 451–470.
• Zhao, L., & Li, H. (2024). Detecting AI-generated academic writing: Methods, challenges, and future directions. Frontiers in Education, 9, Article 1032147.





