I just discovered a robot called Moxie that already had an embedded or ‘embodied’ LLM from back in 2020!
Moxie’s LLM is able to intake visual, audio and other data from the environment and it’s own body and can learn in real time. It’s practically running a future version of ChatGPT, but I think the software is a heck of a lot more sophisticated than anything anyone else has produced.
I feel like such a fool reading back through this post, this has already been done!
Check out this incredible video of how Moxie reacts when it’s speaker stops working due to a glitch to see how fascinating an embodied LLM that can learn in real time and adjust its behaviour accordingly is in a robot!
Moxie’s LLM is able to intake visual, audio and other data from the environment and it’s own body and can learn in real time. It’s practically running a future version of ChatGPT, but I think the software is a heck of a lot more sophisticated than anything anyone else has produced.
I feel like such a fool reading back through this post, this has already been done!
Check out this incredible video of how Moxie reacts when it’s speaker stops working due to a glitch to see how fascinating an embodied LLM that can learn in real time and adjust its behaviour accordingly is in a robot!
