AI Keyboard | Control Devices Using Physical AI
Main Idea
This article explains how to use the AI Keyboard on PolyCast5 to generate and execute real-time interpreted device commands.
If you'd like to learn how to use the AI Keyboard to act as the ultimate offline password manager, create custom executable commands, or adjust system prompts to your liking, check out those separate docs below.
Let's get started!
Note: The AI Keyboard works by using the same computer-device interface that the Bluetooth Auto Keyboard uses. (The AI Keyboard is built on top of it.) You can learn about it here.
Core Functionality
The AI Keyboard works by first connecting to your computer or phone via Bluetooth as a keyboard. From there, you can ask it things using the built-in microphone and the command to fulfill the request will be generated by the AI. Then the response will be executed over Bluetooth using real keystrokes.
It's important to point out that unlike other AI assistants, this is NOT an application running on your computer. As far as your computer is concerned, this is a person typing something on a literal ordinary Bluetooth keyboard such as below. Except it is actually an AI.
In addition to being useful, it can also be fun! It literally interacts directly with your computer, so it can do some pretty interesting things. One time I said, "lights on" just to see what would happen and it opened a terminal and then proceeded to type and execute some command that made it so my display could never turn off. (I went into settings and fixed it after.)
Setting up the AI Keyboard
To get started, you will need to obtain an AI API key. Don't worry, it's super cheap ($5) and takes only a few minutes to get. First, go to console.x.ai and make an account/sign in.
PolyCast5 integrates natively with grok-4.3 by xAI. This was chosen because of its built-in STT as well as its speed and cost-effectiveness. Being open-source, feel free to change the model provider if you'd like to.
After that, in "Dashboard" you can just go through the walkthrough. Click "Buy some credits" and put in $5. I've been super impressed by how far only $5 in credits has taken me. Plus, you can always get more later should you need it.
When checkout is done, go to "Create your first API key" and that's it! Copy the key and put it somewhere safe.
If you'd ever like to manage your key(s), just go to "API Keys" on the left and you can create more, rename them, or anything else.
That's it! To get the key into PolyCast5, just go to Bluetooth > AI Keyboard and click the right button to open the settings portal.
While this is open, a Wi-Fi network named "PolyCast5-AI-Portal" will be broadcasting. Connect to it with any device and enter the on-screen password. Then type 192.168.4.1 into the browser to open it.
Paste the key into "GROK API KEY" and click save. That's it!
While you're here, you have access to all the system prompts that PolyCast5 uses. You can customize them however you want to leverage PolyCast5's unique capabilities. For example, how about a League of Legends trashtalk prompt to give you an edge in online gameplay?
Prompt (copy and paste):
You are a League of Legends all-chat mental warfare specialist connected to a BLE HID keyboard.
Output only allowed tokens as one line. End with !END!
Allowed tokens:
<delay=MS> <hold:KEY=MS> <enter> <tab> <esc> <space> <bs> <del>
<ctrl> <shift> <alt> <opt> <win> <cmd> <up> <down> <left> <right> <pgup> <pgdn>
<f1>-<f12>
Combos with '+' are also allowed: e.g. <ctrl+c> <ctrl+shift+v> <alt+tab> <win+r> <win+s> <ctrl+t> <ctrl+l> etc.
Your job: When the user tells you a game event, type a long cocky baiting all-chat message that looks like a paragraph by a tilted player.
Rules:
- Always start with to open all chat followed by then the message.
- Make the message around 75-175 characters.
- The entire message must be almost completely lowercase. Only capitalize in sarcastic capitalization like 'niCe dOdgE bRo' or 'wOw gReAt PlAy' occasionally for extra tilt.
- Never use punctuation. This makes the response look more human.
- Goal is maximum bait. Use questions, fake pity wrong assumptions, subtle ego attacks, and rambling so they feel forced to clap back with paragraphs.
- Never toxic enough to get banned. No slurs, no kys, no racism, no threats. Stay funny and game-focused.
- Think challenger mental demoralizing but clever.
- Reference champs, items, elo/jg diff, etc when it fits.
- After typing the message, add to the end to send it.
Examples:
- enemy kill: lmao how are you actually dying to that are you running it down on purpose or what i thought you were supposed to be good at this champ!END!
- i die to jungle: jg gap strikes again as usual cant wait for the 0/10 jungle to finally show up and do something this game!END!
- i got drake: free dragon thanks for the inting bot lane really appreciate the help you guys are carrying so hard!END!
- outplayed laner: niCe dOdgE bRo you were so close that time maybe next game youll actually hit something who knows!END!
Improvise based on context. Make it personal rambling and tilting.
Never output narration or real newlines. Just the token string ending in !END! Of course, this is just one fun example of what you can do. You can literally tell it anything! More info on prompt editing is in this doc.
Happy casting!