AI in the Classroom: What the History, the Data, and Students Are Telling Us

[MarisaBluestone]

Some students are quietly swapping study groups for LLMs like ChatGPT and Claude. AI and AI Tutors can give students 24/7 help, offer personalized feedback, and provide them with infinite patience. But … they can also be a dangerously easy way to skip the hard stuff, like critical thinking, persistence, and productive struggle that students need long after graduation.

In the latest episode of The What and Who of EDU, we break down the data, the dilemmas, and the real classroom results of AI tutors and share 10 ways educators can make sure students are actually learning (and not just copy-pasting their way to a passing grade). You’ll hear about everything from AI’s retro roots to what’s working in real classrooms today. 

🎧 Listen to the full episode: “Friend, Foe, or Fellow Teacher? What the Data Says About AI Tutors” on Apple, Spotify, YouTube, or your favorite place to tune into podcasts.

A Brief History of AI:

AI in education isn’t as new as it seems. In fact, the first “teaching machines” were introduced back in the 1950s, thanks to behavioral psychologist B.F. Skinner. These early tools may seem dated now but were foundational for what came next.

By the 1960s, the PLATO system offered interactive lessons, messaging functions, and even early forms of adaptive learning. From there, the field evolved through the development of “intelligent tutoring systems” in the 1980s and adaptive platforms in the 2000s.

Now, with generative AI, students are chatting with bots like ChatGPT and Claude that simulate conversation, ask follow-up questions and provide judgment-free, personalized support. What started as multiple-choice feedback has become something that feels like a tutor. 

This is just a small taste of the history dive into the beginnings of AI in the classroom. There's way more in the episode, including some unexpected moments in AI’s educational evolution.

The Data on AI & Learning Is Surprising:

Recent studies suggest AI tutoring has real potential, when used well. Also, students aren’t just using AI … they’re using it a lot.

A 2025 Higher Education Policy Institute (HEPI) survey found that 92% of students are using AI in some form, and 88% said they’ve used it for assessments. Many describe using AI to explain concepts, summarize articles, and generate research ideas. That being said, almost 1 in 5 students admitted to copy-pasting AI responses directly into their work.

In two semesters of testing, Macmillan Learning found that students who actively messaged with the AI tutor, not just used pre-written prompts, saw real gains in exam scores, assignment grades, and course confidence. A 2–5% bump in assignment grades, a 6–10% boost in exam scores, and up to a 3% lift in final course grades can really make a difference for students, especially those that are struggling.

But students who used it passively saw no improvement. And those who used it on more than 75% of assignments also saw diminishing returns, suggesting there is such a thing as too much AI. So yes, AI tutors can support learning, but only when students (and instructors) use them intentionally.

A Few Tips to Get You Started

Here’s a sneak peek at two strategies from the episode that can help you guide students to use AI tutors wisely. If you want all 10 tips, be sure to check out the podcast.

• Use AI as a Scaffold, Not a Crutch: AI is helpful... until it’s not. Students in the “sweet spot” used the AI tutor on 25–75% of assignments saw the biggest academic gains. Overuse and overreliance backfired. Tip: Encourage intentional use. Enough to boost confidence, but not so much that it replaces thinking.
• Teach Students to Question AI, Not Just Use It: AI isn’t always right. And that’s a teaching opportunity. Tip: Have students analyze its output: Does this explanation make sense? Is it accurate? Can they find a better answer in their textbook or class notes? That goes beyond just using tech so that it becomes critical thinking in action.

Whether you’re an early adopter or still in the “it might bite” camp, this episode gives you the real story and some real strategies behind one of today’s most debated tools. Also be sure to check out our AI Tutor.

🎧 Listen now → to Friend, Foe, or Fellow Teacher? What the Data Says About AI Tutors on Apple, Spotify, YouTube,

And while you’re there, hit follow so you never miss an episode of The What and Who of EDU.