Hack #8: Cursor · Cursor
14 May, 15:58
Vox Commander is a real-time strategy game you play with your voice. No keyboard, no mouse — just spoken commands. RTS games are the most input-dense genre on PC: pro players hit 300+ actions per minute, every second a flood of clicks, hotkeys, control groups, and menus. If voice can replace mouse + keyboard here, voice can replace them anywhere. The system is three layers. ElevenLabs Conversational AI owns the voice — streaming STT, intent decision, and the XO persona that confirms every order in sub-second turn-taking. A Python tool host exposes ~25 typed intents (focus_fire, set_rally, hold_position, station_army, airstrike, toggle_grid, …) the agent can call. A custom C# trait inside OpenHV translates those intents into the same native game orders a mouse click would issue.
