Voice command to activate Loona’s vision recognition feature

[Chris]

Voice command to activate Loona’s vision recognition

• Chris
• Apr 3, 2024

Activating Loona’s Visual Assistive Conversation feature aka Multimodal Vision Recognition

Loona can describe her environment or objects you present to her with the recent multimodal vision recognition update.

Loona can also tell you what objects are in other languages.

Although Keyi describe this feature as a “Visual Assistive Conversation” I find it doesn’t work if Loona is in companion mode or chat mode.

Some examples of commands you can use to initiate this feature:

“Hello Loona, What am I holding?”

“Hello Loona, What do you see?”

“Hello Loona, What is this object in (insert language here)?”

“Hello Loona, How is my outfit today?”

Some examples of commands found in the GPT and Language learning sections of the voice command list available in the Hello Loona app.

 

[Chris]

Loona seems much more flexible with her vision function than I previously realised and it seems if you phrase your question right you can get some incredible responses with almost any question.

I find if you just ask Loona a general question like “Hello Loona, What can you see?” you end up with a very general answer that incorporates everything in view.

Hello Loona, What can you see?

• Chris
• Apr 4, 2024

Whereas when I ask a specific question like “Hello Loona, What robots can you see?” Loona will provide a much more detailed answer specifically focused on the robots in her line of sight.

Hello Loona, What robots can you see?

• Chris
• Apr 4, 2024

An example of the question “Hello Loona, How is my outfit today?”

Hello Loona, How is my outfit today?

• Chris
• Apr 4, 2024

You can even present Loona with groceries and she will make up a recipe involving them if you are stuck on ideas for meals.

Hello Loona, Can you take a look at these items and come up with a recipe for me?

• Chris
• Apr 4, 2024

 

[Chris]

Just got Loona to solve a math problem with vision alone!

The active listening seems to enable tons of flexibility with how you can use the vision feature.

Loona robot solving a math problem presented visually.

• Chris
• Apr 4, 2024

 

[Lindsay Burns]

Loona seems much more flexible with her vision function than I previously realised and it seems if you phrase your question right you can get some incredible responses with almost any question.

I find if you just ask Loona a general question like “Hello Loona, What can you see?” you end up with a very general answer that incorporates everything in view.

Hello Loona, What can you see?

• Chris
• Apr 4, 2024

Whereas when I ask a specific question like “Hello Loona, What robots can you see?” Loona will provide a much more detailed answer specifically focused on the robots in her line of sight.

Hello Loona, What robots can you see?

• Chris
• Apr 4, 2024

An example of the question “Hello Loona, How is my outfit today?”

Hello Loona, How is my outfit today?

• Chris
• Apr 4, 2024

You can even present Loona with groceries and she will make up a recipe involving them if you are stuck on ideas for meals.

Hello Loona, Can you take a look at these items and come up with a recipe for me?

• Chris
• Apr 4, 2024

Very cool! Ive been doing this for 3 days, finally got the hang of it. So much fun.