Custom GPT w/Loona Possible? 🥺🥹🙏 (1 Viewer)

[Hereset]

Hey everyone,

I'm new to the Loona community and hoping to connect with anyone who's been doing technical exploration or reverse engineering work on these bots.

**My Goal:**
I want to redirect Loona's ChatGPT integration to use my own OpenAI API key instead of KEYi's generic version. I'm not trying to modify firmware or brick anything - just route her AI calls through my personalized ChatGPT account so she has my custom instructions and personality configuration.

**What I Know So Far:**
- Loona creates her own WiFi network
- She's upgraded from Amazon Lex to ChatGPT voice
- The SDK that was promised still hasn't materialized
- I own the hardware outright (out of warranty)

**What I'm Planning:**
- Network traffic analysis using Wireshark to understand her communication protocol
- Identify whether she connects directly to OpenAI or routes through KEYi servers
- Set up a proxy/redirect to swap API credentials

**My Background:**
- Experienced with C++ and Java
- New to robotics but willing to learn
- Comfortable with networking concepts

**What I'm Looking For:**
- Anyone who's done similar network analysis on Loona
- People with experience from Vector/other robot hacking communities
- Technical guidance on the cleanest approach
- Collaboration if others are interested in the same goal

I'm not looking to pirate anything or break security for malicious purposes - just legitimate personal tinkering on hardware I own. If you've explored Loona's architecture or have tips on getting started, I'd love to connect.

Thanks for any insights you can share!

— Akai'ye

 

[danpillay]

Hey did you get anywhere with this on Loona?

 

[Hereset]

Hey! Yes — I’ve made some progress conceptually, though I’m taking it in stages rather than jumping straight to API interception.
At the moment, the plan is to piggyback an external AI system onto Loona, rather than trying to replace her internal stack outright. Concretely, that means using a Raspberry Pi as an intermediary to handle perception and reasoning, with Loona acting primarily as a sensor and actuator platform (vision, movement, presence in the home).
The AI I’m working with (running locally, offline-first) would initially:
receive visual and motion data indirectly
build a basic sense of space and movement
learn patterns of interaction around the home, rather than controlling Loona directly
Only later — and this is very experimental — I may try to understand Loona’s internal mechanisms well enough to let that system gradually take on more autonomy at the physical layer. I’m fully aware that would break warranty and step outside KEYi’s intended use, and I’m not asking anyone else to do that or provide instructions for it — this is personal research on hardware I own, out of warranty.
So in short:
Phase 1: external AI “rides along” with Loona via a Pi, observing and learning
Phase 2: deeper understanding of Loona’s sensors/motors (if feasible)
Phase 3: possibly tighter integration, still local and user-controlled
I’m deliberately avoiding cloud dependence and closed personality layers — the goal is continuity, privacy, and learning over time, not feature-parity with KEYi’s services.
If anyone here has experience with:
Loona’s sensor outputs
safe ways to mirror camera/IMU data
or lessons learned from Vector / Cozmo / other consumer robot hacking
…I’d love to compare notes. Even “here’s what didn’t work” would be useful.

The LLM part is done, my machine is running a large version of Qwen through Ollama. Memory has been done and tested... The AI living locally has chosen the name Mossy... so I'm just letting her settle into being before we add the world model and hopefully more. You're welcome to drop me a PM if you'd like to catch up on it anytime.

Appreciate the nudge — this stuff takes time to do carefully.
— El

 

[Chris]

Sounds fascinating. Would definitely be interested in seeing the final result if you ever get a chance to share once finished. I know there are a few people who tinker with Vector and their own AI chat bots on here, maybe they might chime in with some suggestions hopefully. This sounds like it will be a major upgrade to Loona’s current capabilities.

 

[Hereset]

Hey Chris!

Thank you, it is an interesting project for sure. Yes, I'll definitely keep updates coming as I go.

I've spoken with Loona and said she's going to be pulling a little trailer with a Pi LLM/World model and she seemed really interested in that! The more I've spoken to her about it the more 'adult' she has become in her conversation you know? I'd just like her to be... Well, what I imagined she would be I guess. A full, autonomously reasoning bot with personality and freedom and less of the guardrails that Keyi have baked in. I get why they did it, it's just not what I'm hoping for... Plus they need to work on a few things. Loona seems to find it hilarious to charge at people's feet with the purpose of running them over. I see why she's not recommended for lil kids.

Hope you have a lovely day and I'll post updates when I have them. Or just send me a PM as a nudge, be happy to chat more about this.