Google Search now draws the diagram, and nobody checked it

A ten year old types “ph scale” into Google the night before a science test. What comes back is no longer a picture somebody drew, checked, and put in a book. It is a coloured, sliding, interactive pH scale that did not exist a second earlier, built on the spot for that exact search.

That is not a hypothetical. It is Google’s own worked example.

What Google shipped on 19 August

In Google’s words: “Search can now generate custom tools and simulations to help you see complex topics in action.” Then, verbatim: “Let’s say you’re learning about pH levels. You can do a search like ‘ph scale’ and quickly get an interactive visual in an AI Overview to help you understand the basics.”

The same announcement added customised practice quizzes “directly in Search for any subject, from science and math to humanities, foreign languages and more”, a step by step mode in Lens “over the coming weeks”, and, in Gemini, a student hub, flashcards, study notebooks and 3D simulations a child can rotate. TechCrunch read it as Google bidding to be the assistant students study with.

The availability lines are the part parents should read twice. Practice quizzes “are now globally available in English free of charge, in both AI Overviews and AI Mode.” The generated visuals “have launched globally in English in AI Mode and have started rolling out as well in AI Overviews.”

Globally, in English, free. So Singapore is not waiting on a United States first rollout. It is already on the family laptop.

The age rule is on the wrong door

Here is the odd bit, straight from Google’s own help pages.

For AI Mode, the rule is explicit: “AI Mode in Search Labs is available to users 18 and above.” For AI Overviews, the block of text that now sits above the ordinary blue links, no minimum age is stated at all. And it cannot be switched off: “Features cannot be turned off. However, you can select the Web filter after you perform a search.”

So the surface with an age rule is the one a child has to go and choose. The surface with no age rule is the one that shows up whether anyone asked for it. The new study tools are rolling into both.

Hold that next to the rest of this year’s education push from the labs. Gemini in Classroom reaches a child through a school administrator’s checkbox. ChatGPT for Teens reaches a child through an account and an age estimate. Plain Google Search reaches them through neither. It is the one door in the house with no lock on it, and the one most children walk through every day.

A generated picture is not a checked picture

Google is honest about this in the small print, which undercuts the launch. On AI Overviews: “AI Overviews can and will make mistakes”, with the advice to “Always check important info in more than one place.” On AI Mode: “As with any early-stage AI product, AI Mode doesn’t always get it right.”

We are not claiming Google’s pH scale is wrong. We have not tested it, and nobody outside Google is in a position to say. That is rather the point.

What the research can tell us is narrower. A randomised trial published in npj Digital Medicine in March 2026 gave 111 junior medical students 25 multiple choice questions with either no AI explanation, a correct one, or a misleading one. Accuracy fell to 9.2% with the misleading explanation, against 21.0% with no explanation at all, while the correct explanation produced 22.6%, not a significant gain on the control. Confidence, meanwhile, came unstuck from correctness. The authors’ conclusion was blunt: “the harm caused by AI-generated falsehoods in this population and task is more potent and robust than the benefit derived from correct guidance.”

Those were medical students, not primary pupils, and the explanations were text, not diagrams. Evidence on generated diagrams is thinner still. A January 2026 preprint on faithful diagram generation, revised this month, had experts evaluate 150 of them, and opens by stating the problem plainly: “GenAI is widespread in educational applications; however, it is known to generate content with intrinsic and extrinsic hallucination.” Early work, not settled science.

But the asymmetry in that trial is the thing to sit with. The good explanation did not measurably help. The bad one hurt a lot, and dented nobody’s confidence. A wrong sentence at least looks like a claim. A rotating 3D model looks like a fact.

The syllabus problem, smaller but more immediate

Look at the standardised tests Google says its practice quizzes cover: ACT, AP, ENEM, GRE, JEE, LSAT, MCAT, NEET and SAT. Not one is a Singapore national exam. A P6 pupil asking Search for practice questions is being quizzed against something, and it is not the PSLE syllabus.

Compare what MOE built instead. The Student Learning Space is described by the ministry as “an online learning portal providing equal access to quality curriculum-aligned resources in major subjects from primary to pre-university level”, with those resources “continually being improved and developed in line with suggestions and feedback from teachers and students”. Slower, duller, and answerable to somebody.

MOE has also been clear about the skill it wants children to have. In a parliamentary reply on 25 September 2025, the ministry said students learn to “question AI outputs and to discern and identify false or misleading information produced by AI”, through the curriculum, Cyber Wellness lessons and the AI literacy modules in Code for Fun, from primary level up. That is the right instinct. Our worry, and we will mark it clearly as ours, is that the habit is being trained on sentences, and what just landed in Search is pictures.

The one thing to add at home

Ask the child to say out loud what the picture is claiming. Not whether they like it. What it asserts: acids sit below seven, lemon juice lands about here. Once it is a sentence, it can be checked, and a nine year old can check it against the textbook or SLS in about a minute.

Then do it in front of them once. Run the search, read the generated visual out loud, open the book, compare. Children copy the checking. They do not copy the lecture about checking.

(Disclosure: Mentus AI sells AI mentoring for children, so we have a commercial interest in how families use these tools. We would rather say the awkward thing about our own industry.)