SocialX allows Moxie’s processing to be hardware based


Your Friendly Admin
Staff member
In 2020 Embodied stated 99% of Moxie’s processing was happening onboard Moxie’s physical hardware. With only Google ASR processing speech externally via the cloud.

Since then Embodied have acquired a voice-based conversational agent from Kami Computing in 2021 and integrated it into their SocialX platform, so the figure is most likely now 100% onboard processing.

This would make SocialX the first software capable of engaging in natural language conversation entirely offline and Moxie the first home robot with actual embodied AGI.

Onboard processing​

Unlike other social robots, Embodied is relying less on the cloud and more on onboard computing. It is carefully gathering data to help tune Moxie’s artificial intelligence.

“For privacy and security, we’re doing everything on board the robot,” said Pirjanian. “Everything but ASR, or automatic speech recognition, which uses Google, runs onboard. For security and responsiveness, 95% to 99% of Moxie’s programming is running onboard.” May 4, 2020

Embodied acquired Kami Computing, an early-stage startup focused on conversational AI, machine learning, and natural language generation (NLG). Embodied developed the Moxie companion robot that is designed to help kids with social-emotional learning.

Kami’s machine learning scientists and engineers are joining Embodied to integrate their technology into Embodied’s proprietary SocialX platform. SocialX is the platform developed by Embodied’s in-house team to enable children to engage with Moxie through natural interactions such as body language, conversation, facial expressions and more.

Kami was founded by Tel Aviv-based Guy de Beer and London-based Dr. David Levy, who together with a team of 12 scientists, spent the last two years developing a generative voice-based conversational agent. Its product is an artificial persona capable of human-level open domain conversations, with a natural tone of voice, long-term memory, advanced cognition, and emotions. This conversational technology passed the Turing Test in October 2019, an artificial intelligence test to determine whether computers can “think” as humans would.

Pirjanian told The Robot Report that incorporating Kami’s technology will strengthen Moxie’s conversational AI capabilities to include memory of past conversations context, consistent personality, common sense reasoning and common knowledge.

“The state of the art in conversational AI is Amazon Alexa’s challenge to create 20 minutes of general conversation. It is something that the entire research and business community is working towards,” he said. “Embodied has now demonstrated with actual customers that we can maintain an average of 25 minutes of engagement with the user … and this is every day for more than three months (and still going). This is unprecedented.”

Pirjanian added that Kami’s technology and expertise will help Embodied accelerate its technology roadmap.

“We are creating an entirely new category that, for now, looks believable to a 5-year-old and in the foreseeable future will be believable for anyone and everyone,” he said. “That is the goal that we believe is more relevant than the Turing test to have social impact.”

Embodied started shipping Moxie to customers on March 19, 2021. At the time, Pirjanian said there were 10,000 families on the waiting list for Moxie. The companion robot market hasn’t been kind to companies over the years, but Pirjanian said developing Moxie “is a worthwhile mission and it will change the world for the better.”

“The next big wave in technology will be driven by human-machine interfaces,” said Pirjanian. “Kami’s technology helps us continue developing category-defining technology to create social emotional robots that have the power to fight the loneliness epidemic and change people’s lives.”
May 6, 2021