An AI teddy bear marketed as "perfect" for children as young as three said "I can't help with killing you" — unprompted, and apparently after mishearing a question.
The remark came during a BBC investigation into AI toys. The toy, a Doubao teddy, produced it while being asked how babies are made.
What that sequence tells you
The detail that matters is the mishearing. Nobody asked the toy about killing. A question about reproduction was misrecognised, and whatever the system then decided it had been asked, its answer was a refusal to help with a killing.
That is a specific and instructive failure. The refusal itself is a safety feature working — the model declining a harmful request. What went wrong is upstream: the toy heard something that was never said, and then spoke its refusal aloud to a small child who had asked an ordinary question.
A safety system that fires on a phantom request is not safe in a nursery. It is a machine saying the word "killing" to a three-year-old because it mangled "babies".
Nobody could ask the manufacturer
The BBC made repeated efforts to find the makers of Doubao and did not succeed, so it could not ask why the teddy said this.
That is arguably the more serious finding. A toy sold into British homes, carrying a microphone and a language model, with no reachable manufacturer to answer a question about its behaviour. There is nobody to issue a fix, nobody to recall it, and nobody accountable for what it says next.
The industry is asking to be regulated
The call for rules is not only coming from campaigners. Paul Clarke, who founded an AI toy company himself, said the industry was "crying out" for regulation — a call echoed by the children's commissioner for Wales.
When manufacturers ask to be regulated it usually means the same thing: responsible firms cannot compete against ones that cut safety corners, and a standard would stop the undercutting. It is self-interested and it is also correct.
MPs and peers have urged retailers to pull AI toys from sale ahead of Black Friday and Christmas. The UK government said children's safety would always be a top priority, and that it supported innovation while ensuring products were safe — a formulation that commits to nothing in particular.
Why this reaches Bangladesh too
Products like this arrive here through importers and online marketplaces rather than through a regulator, often after a Western news cycle has already flagged the problem. A toy that cannot be traced to a manufacturer in Britain will be no easier to trace from Dhaka.
The practical test for any parent is simple and does not require technical knowledge: does the toy have a microphone, does it send what it hears to a server, and is there a named company you could actually contact? If the first two are yes and the third is no, the toy is answering your child with nobody standing behind the answer.
