The Need for Research-Informed Pedagogical Knowledge
Literacy researchers are beginning to build actionable knowledge to guide teachers through the AI revolution in writing classrooms1. Teacher noticing—the art of seeing beyond the obvious—shapes every instructional decision, and vision is sharpened through scientific research. Van Es and Sherin (2024) capture this perfectly: "noticing is at the crux of developing responsive interactions focused on students' ideas.” Teachers who notice effectively can use research findings to distinguish when AI tools amplify student thinking from when they replace it.
Recent Studies on AI in Writing Instruction
The landscape of research is shifting rapidly, good news for those of us who are ready to roll up our sleeves. Four landmark studies illuminate our path:
Steiss and colleagues (2024) pitted 200 human-generated feedback samples against an equal number of AI responses. Human feedback excelled in four of five quality measures, yet AI performed with surprising competence without specialized training—like a novice teacher showing unexpected promise.
Tate et al. (2024) discovered that ChatGPT's holistic essay scoring mirrors human judgment with statistical significance. Their analysis across three diverse student corpora revealed AI's potential as a reliable formative assessment tool—quick, consistent, and increasingly accurate.
Beck and Levine (2024) wove together speculative fiction and empirical observation to craft a framework emphasizing human centrality in AI collaboration. Their work stands as both warning and guide, mapping the territory between enhancement and dependency.
Ng and Graham (2025) unearthed how teachers' goals dramatically shape their writing instruction, the ground floor of AI integration. Teachers driven by mastery goals cultivated advanced writing skills in students; those seeking to increase their efficiency taught basic techniques and forms. Their findings, though not explicitly addressing AI, provide bedrock principles for technology integration.
Research-Supported AI-Integrated Writing Practices
Strategic Integration of AI Feedback
"AI's value can be realized by understanding both its strengths and limitations" (Steiss et al., 2024). AI feedback tools resemble specialized instruments—powerful within their range but requiring a skilled user. Teachers must leverage AI's consistency and immediacy while compensating for its contextual blindspots. Know the instrument. Master its capabilities. Recognize its limits.
Human-AI Feedback Sequence
"Instructors combine AI-based feedback on earlier drafts with human feedback on a later or final draft" (Steiss et al., 2024). This creates a feedback ecosystem where AI handles the initial basic lifting, freeing teachers to provide nuanced guidance later. Different writing stages demand different feedback types—AI excels at foundational review; humans excel at nuance. Let each play to its strengths.
Developing Critical AI Literacy
When students evaluate AI feedback—questioning its relevance and accuracy—they develop metacognitive agility. Steiss et al. (2024) note students "should evaluate feedback for accuracy and usefulness before integrating it." This habit transforms passive consumption into active dialogue. Students must interrogate the machine as they would any critic. They must learn to disagree with authority—even algorithmic authority.
Formative Assessment Applications
"Substantial agreement with humans is achievable and may be sufficient for low-stakes, formative assessment" (Tate et al., 2024). AI tools achieved weighted Kappas of 0.52 with human raters—adequate for drafting processes where speed outweighs perfect accuracy. AI feedback arrives instantly. Human feedback arrives eventually. In early drafting, immediacy matters more than perfection.
Fostering Mastery Orientation
"Mastery goals predicted positively the frequency of teaching advanced writing skills" (Ng & Graham, 2025). Teachers who approach AI as learning partners rather than efficiency tools create environments where technology enhances rather than shortcuts writing. Mindset determines everything. Teachers focused on craft cultivate craftsmanship; those seeking shortcuts teach shortcutting.
Adapting Practices Across Writing Genres
Modern LLMs break free from the constraints that shackled previous automated writing tools. Steiss et al. (2024) found ChatGPT "did not require a training set" yet provided genre-specific feedback. This versatility unlocks cross-curricular applications. Unlike its predecessors, today's AI speaks the language of every discipline, from history to mathematics.
Maintaining Student Agency in Goal Setting
"Centering human writers in collaboration with GAI" ensures students maintain authorial control (Beck & Levine, 2024). When students set writing goals before engaging AI, they remain captains of their creative vessels. The machine serves the writer—never the reverse. Students must command the AI, not follow it.
Incorporating Reflective Practice
Beck and Levine (2024) urge teachers to help students "investigate ways that GAI can be a harmful/biased collaborator." By documenting which AI suggestions they accept or reject—and why—students develop metacognitive awareness. This reflection transforms AI from black box to transparent partner. Make the invisible visible. Question every suggestion. Document every choice.
Accelerating Feedback Cycles
"Formative feedback from AI could motivate more revision than the current vacuum of formative feedback" (Steiss et al., 2024). AI collapses the feedback timeline from days to seconds, enabling rapid revision cycles. This addresses writing instruction's persistent challenge: feedback delayed is feedback denied. Immediate response fuels immediate revision—a virtuous cycle previously impossible at scale.
Reimagining Writing Assignments
When AI masters conventional forms, teachers must reimagine writing tasks to emphasize uniquely human dimensions. Beck and Levine (2024) call for "shifting the focus away from canonical, standardized forms" toward authentic expression. As machines perfect formula, humans must cultivate voice. When algorithms master the predictable, assignments must celebrate the unpredictable.
Significance and Local Action Research
These emerging studies mark a watershed moment in writing pedagogy. Initial findings illuminate possibilities while underscoring how much remains unexplored. Like early maps of a new continent, they sketch coastlines but leave interiors blank. Local action research must fill these gaps.
Kennedy and Shiel (2024) remind us: "Real change takes time... professional development [must be] seen as a complex system rather than as an event." AI integration demands sustained exploration, not one-day workshops. Teachers need time to experiment, reflect, and refine. They need permission to fail, space to learn, and resources to persist.
Two-way accountability—where teachers and students jointly develop AI practices—cultivates the critical agency Beck and Levine (2024) deem essential for "literacy with GAI." When students help shape technology integration, they transform from passive consumers into active architects. They learn by building the system that teaches them.
The path to AI expertise mirrors literacy development itself: intention, practice, reflection, application. Repeat. AI tools represent neither salvation nor threat but simply the newest instruments in our pedagogical orchestra. When wielded with skill, they can help students compose works of remarkable depth and clarity—works impossible without the tool yet unmistakably human in their essence.
References
Beck, S. W., & Levine, S. (2024). The Next Word: A Framework for Imagining the Benefits and Harms of Generative AI as a Resource for Learning to Write. *Reading Research Quarterly*. https://doi.org/10.1002/rrq.567
Kennedy, E., & Shiel, G. (2024). The implementation of writing pedagogies in the Write to Read intervention in low-SES primary schools in Ireland. *Reading and Writing*, 37, 1575-1603. https://doi.org/10.1007/s11145-023-10510-7
Ng, C., & Graham, S. (2025). Teachers' goals for teaching writing to economically disadvantaged students: relations with beliefs and writing instruction. *Reading and Writing*. https://doi.org/10.1007/s11145-025-10631-1
Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., Moon, Y., Tseng, W., Warschauer, M., & Olson, C. B. (2024). Comparing the quality of human and ChatGPT feedback of students' writing. *Learning and Instruction*, 91, 101894. https://doi.org/10.1016/j.learninstruc.2024.101894
Tate, T. P., Steiss, J., Bailey, D., Graham, S., Moon, Y., Ritchie, D., Tseng, W., & Warschauer, M. (2024). Can AI provide useful holistic essay scoring? *Computers and Education: Artificial Intelligence*, 7, 100255. https://doi.org/10.1016/j.caeai.2024.100255
van Es, E. A., & Sherin, M. G. (2024). Expanding on prior conceptualizations of teacher noticing. *ZDM - Mathematics Education*, 53, 17-27. https://doi.org/10.1007/s11858-020-01211-4
Warschauer, M., Tseng, W., Yim, S., Webster, T., Jacob, S., Du, Q., & Tate, T. (2023). The affordances and contradictions of AI-generated text for writers of English as a second or foreign language. *Journal of Second Language Writing*, 62, 101071. https://doi.org/10.1016/j.jslw.2023.101071
Wilson, J., & MacArthur, C. (2024). Exploring the role of automated writing evaluation as a formative assessment tool supporting self-regulated learning and writing. In M. Shermis & J. Wilson (Eds.), *Routledge international handbook of automated essay evaluation*. Routledge.
The intent of this blog is not to address the broader, systemic issues surrounding AI in education—such as equity, ethics, or long-term societal implications—but rather to spotlight the emergence of research that is beginning to shape actionable practices for writing instruction. By drawing attention to recent studies and their findings, the blog seeks to illustrate how scholarship in this area is progressing and to provide educators with practical insights they can think about applying in their classrooms. While it does not aim to resolve larger debates, it highlights the growing body of evidence that can guide thoughtful experimentation and adaptation as AI continues to influence educational practices.
Great, useful overview. Thanks.
Thanks, as always, for updating us on relevant research. There is great study on first-year writing and AI tutors that just dropped:https://open.substack.com/pub/jeannebealaw/p/empowering-students-through-ai-what?r=3oprqt&utm_medium=ios