Controlling mBot with LLM


#1

I would like to present my small project for the mBot2, which hopefully can generate other exciting ideas and projects - how do I control and automate the mBot with natural language? The necessary building blocks are MQTT and the Model Context Protocol for the interaction with LLMs

Blog post: https://x.com/deemkeen/status/1906692248206524806
Github: https://github.com/deemkeen/mbotmcp


#2

Can I have more context as to what “natural language” is?


#3

@deemkeen this is so cool! I saw you were using Goose in the video (I’m friends with the Goose team)!

@Rosco natural language is a refference to NLP which is an AI term.


#4

@Best_codes Thanks, i’m glad you liked it! Shout out to the Goose team, they’ve managed to make a really great working product, it helped me a lot with the mcp integration and automation!

@Rosco so for example you can write something like this in the prompt - “hey robot, i would like you to go forward and turn around, then maybe make 2 beeps and go backward”. This will be translated to robot commands, so you are able to control it with natural language processing.


#5

Got it.


#6

@deemkeen The Goose team thinks this is really cool and might want to collab with you or something, check out the direct message I sent you!

https://forum.makeblock.com/t/regarding-mbot-2-goose/24616
(Only me and you can use that link)