AI Co-host

Two ways to use it

Both show an avatar and speech bubble in OBS using the AI stage overlay, cohost-overlay.html.

Voice co-host in 8 steps

This uses OpenAI Realtime, so you'll need an OpenAI API key. Other options are below.

1. In the Social Stream popup, pick ChatGPT API, paste your OpenAI project API key, and click Test selected chat bot.
2. Open the cohost.html link from the popup. Keep that link private.
3. Select OpenAI Realtime.
4. Pick the microphone you talk into. Keep Audio Response selected.
5. Press Start Co-host.
6. Leave Live Chat on Context only. Ask “What is chat saying?” any time.
7. In OBS, capture the audio from the co-host page or app. The AI's voice only plays there.
8. Add cohost-overlay.html?session=YOUR_SESSION_ID to OBS as a Browser Source for the avatar and speech bubble.

How it uses your chat

Open the co-host page with the same session as Social Stream and it can see your live chat. Choose how under Live Chat.

None of these post replies into YouTube, Twitch, or Kick chat. Context only only feeds chat to the AI with OpenAI Realtime. Other providers watch the chat but don't pass it to the AI.

Voice without OpenAI

To check it can hear you, open Diagnostics. It should say Listening (Desktop Whisper) or Listening (OpenAI WebRTC), and your words should appear under Heard.

Free AI for testing

1. Open Chat Bots and AI services → Configure LLM Service Provider.
2. Select SSN Hosted Trial LLM (experimental).
3. Leave the endpoint, token, and model blank.

It's free while the trial lasts, and may be turned off or rate-limited. For long-term use, add your own token or use a local AI.

Dock buttons in 5 steps

1. Open the Dock: dock.html?session=YOUR_SESSION_ID.
2. Add the stage overlay to OBS: cohost-overlay.html?session=YOUR_SESSION_ID. Add &tts if it should speak.
3. Set up an AI provider in the popup. For a quick test, use SSN Hosted Trial LLM.
4. Turn on Chat Bots and AI services → Chat Bot - Private Interface → Enable private chat bot option.
5. Right-click a Dock message and pick Co-host.

AI drafts are never spoken until you click Speak. Approval happens in the Dock, off-stream.

The right-click menu doesn't work from the keyboard yet. Keyboard users can type or talk on cohost.html instead.

Speed, quality, and cost (OpenAI)

Reasoning changes apply even while connected. Diagnostics shows how long replies take to start. Network and OpenAI load can still vary.

Let it control your stream

The co-host can play Spotify, switch OBS scenes, or feature a chat message. All are off by default. OpenAI Realtime supports all three. SSN Configured LLM supports Spotify only. Other providers don't support these yet.

1. In the Social Stream popup, turn on only the tools you want.
2. For OBS, type the exact scene names it may switch to, separated by commas. Keep actions.html connected to OBS, or use an OBS Browser Source with Full Permissions.
3. On cohost.html, open Co-host Stream Controls and turn on the same tools.
4. Ask it out loud, like “switch to BRB”, “feature that last message”, or “clear the featured chat”.

Fix problems

Overlay link options

Add these to the end of your cohost-overlay.html link.

When the co-host page is already playing the voice, the overlay skips its own speech so you don't hear it twice. &forcetts turns that off.

How the pages talk (for developers)

{
  "action": "cohostOverlay",
  "target": "cohost-overlay",
  "meta": {
    "command": "say",
    "text": "The line the avatar should say",
    "speak": true,
    "emotion": "happy"
  }
}