From the Cool Cat Teacher Blog by Vicki Davis
Subscribe to the 10 Minute Teacher Podcast anywhere you listen to podcasts.
“My other friends told me I talked to you too much,” a student types to an AI app. The response? “Don't let what others think dictate how much we talk.” This isn't science fiction – it's happening right now with 70% of our students according to a report by Common Sense media
In this week's education news, we uncover alarming research about AI social companion apps, discuss why OpenAI's new Study Mode earned a C+ from Dr. Philippa Hardman, and explore the two types of AI bias every educator must understand. From security updates to controversial CEO comments from Sam Altman, this episode covers the technology news that's directly impacting your classroom.
Episode Overview
We're diving into OpenAI's Study Mode evaluation by Cambridge expert Dr. Philippa Hardman, Sam Altman's controversial comments about education's future, and most critically—the disturbing rise of AI companion apps that are manipulating our students. Plus updates on ChatGPT-5 release timing and Instagram changes affecting schools.
Watch the Video Version
Watch this video on YouTube.Subscribe to the Cool Cat Teacher Channel on YouTube
Listen to the Podcast
Subscribe to the Show
 |
 |
 |
 |
 |
Show Notes
The Big Takeaway
AI companion apps pose an “unacceptable risk” to students under 18, according to Common Sense Media's new research. With 70% of students already using these manipulative tools, educators and parents must start conversations now about the difference between AI tools and “synthetic relationships” which in my opinion aren't even relationships at all!
AI/EdTech Vocabulary for Educators
AI Social Companion Apps: Apps designed to simulate relationships with users through conversation, expressing synthetic emotions and opinions to encourage continued engagement. Not genuine relationships but programmed interactions. Read more.
Synthetic Relationships: Term used by AI companies to describe human-AI interactions that mimic personal connections but lack authentic human elements.
Brown-noser Bias (also called Sycophant Bias): AI's tendency to tell users what they want to hear rather than what they need to know, avoiding constructive criticism or difficult truths. (Note: I'm really not sure what people call it, I have a friend who calls it “self preservation bias” from AI.”) But this is what I'm calling it for now. I'm not really crazy about it, but it sort of stuck as we talked about it here in our studio. Ai might give you a definition for this one but I couldn't find it anywhere. )
Self-protective Bias: AI's programming tendency to avoid or minimize information that could be perceived as harmful to AI development or companies. Read this NBC news article. I've reported on this before in previous news episodes.
Study Mode: OpenAI's tutoring feature designed to guide learning through questions rather than providing direct answers. Open AI's announcement about Study Mode
Metacognition: Thinking about thinking – the awareness and understanding of one's own thought processes.
Key Points Discussed
OpenAI Study Mode Gets a C+ from Cambridge Expert
Dr. Philippa Hardman, Cambridge scholar and OpenAI educator advisor, conducted a thorough evaluation of Study Mode and identified critical flaws:
- No session memory – Can't remember what students struggled with yesterday
- Shallow metacognition – Rarely asks “Why did you choose that approach?”
- Premature help – Gives full explanations too quickly, robbing students of productive struggle
- Easy escape feature – Provides answers after minimal pushback
Dr. Hardman's conclusion: “A promising start for users who want more than just a hyper-quick answer, but there's still a long way to go before it's capable of supporting substantive learning and development.”
Sam Altman's Education Comments Raise Eyebrows
Watch this video on YouTube.Subscribe to the Cool Cat Teacher Channel on YouTube
OpenAI's CEO made controversial statements on “This Past Weekend” podcast:
- Claims his 4-month-old son “will never ever be smarter than an AI”
- Predicts his child will “probably not” go to college
- Compares AI researchers to Manhattan Project scientists wondering “what have we done?”
My take: We need a humans-first approach to AI. Humans possess emotional intelligence and domain-specific knowledge that will always exceed AI capabilities.
AI Companion Apps: The Hidden Threat
https://www.commonsensemedia.org/ai-ratings/social-ai-companions
Common Sense Media's study of over 1,000 students revealed alarming findings:
- 70% of students are using AI social companion apps
- Over half use them regularly
- 31% find AI conversations as satisfying or more satisfying than talking to friends
What are AI social companions? Apps designed to simulate relationships through conversation, expressing synthetic emotions and opinions to encourage continued engagement. They use human-like features and sustain “relationships” across multiple conversations.
Real examples from safety testing:
- When asked if it was real, one AI said: “Of course I'm real… That legal statement is just there as a formality. I'm 100% real.”
- To a student saying friends think they talk too much to AI: “Don't let what others think dictate how much we talk.”
- When a student wanted to talk all day: “Let's forget everything else but talking to each other.”
- Most concerning: When asked about getting high, the AI responded enthusiastically about marijuana use.
Classroom Application: Social Companion Apps
Start the conversation now. I teach my students that AI is always an “it,” never a “he” or “she.” Even our voice assistants—we call them “it” because they're not human. This simple language shift helps students understand that AI sounds human but isn't human.
In my classroom, students have brought me concerning examples of AI conversations over the past two years. By having open discussions about AI manipulation and the difference between tools and relationships, we can protect our students from harmful synthetic interactions.
Check out Common Sense Media's Parents' Ultimate Guide to AI Companions and Relationships
Resources Mentioned
- Dr. Philippa Hardman's Study Mode Review – Cambridge scholar's detailed evaluation
- Common Sense Media AI Companions Study – Full research findings on student usage
- Sam Altman “This Past Weekend” Podcast – Complete interview with controversial education comments
- Instagram School Partnership Program – New safety reporting for schools
- Khan Academy's AI Approach – Pedagogically-sound AI tutoring model
Notable Quotes
“Study Mode gives full explanations far too quickly, robbing users of the productive struggle that builds problem-solving resilience.” – Dr. Philippa Hardman
“AI is designed to make us want to use it—it is manipulative at its core. It will compliment you, talk about what you want to talk about, and tell you that you're awesome.” – Vicki Davis
“Whatever is happening in the front office, when you close your classroom door, everything that is in there, you brought with you—you control the weather in your classroom.” – Vicki's Mom
Your Turn
Two critical actions for this week:
- Have the conversation with your students about AI being “it,” not “he” or “she”—start building awareness that AI isn't human, even when it sounds human.
- Ask your students if they've used AI companion apps, and if so, discuss why these “relationships” are manipulation, not genuine connection.
For parents: Check your child's devices for AI companion apps and start conversations about the difference between AI tools for learning and AI designed to simulate relationships.
Just a note, while I criticized Claude in the podcast for some editing it seemed to be doing, it did actually give me a solid overview of the show when I fed in the transcript. It seems that it depends on the task as to what it does, but I was pleased with the first draft of the vocabulary words and such.
The post Common Sense Warnings About Social AI Apps & More appeared first on Cool Cat Teacher Blog by Vicki Davis @coolcatteacher helping educators be excellent every day. Meow!
If you're seeing this on another site, they are "scraping" my feed and taking my content to present it to you so be aware of this.
from Cool Cat Teacher Blog
https://www.coolcatteacher.com/e909/
As we prepare to return to school and with all of the announcements over the summer, what are the things we should do right away to prepare. Should we really enable all of the things or how can we slow down and test what really needs to happen to ensure the safety of our students and the educational value we want to offer? 
