A demo React app that connects to a Node.js server, that integrates Stream's Video SDK with OpenAI's Realtime API.
This project showcases how to build AI-powered video applications with voice interactions.
Here's a screenshot of the end result:
The sample code demonstrates how to use Stream's Video SDK to create video calls and connect them with OpenAI's Realtime API for AI-powered voice interactions.
This repo provides a sample app that showcases the following functionalities:
- connect to the Node.js server and fetch credentials to join a call
- add an AI agent to the call
- show beautiful visualizations of the AI audio levels
- You have followed the steps in the
Node.js server and you
have the server running locally on
http://localhost:3000
. - Stream account with API key and secret
- OpenAI API key with access to the Realtime API
- Node.js 22 or later
After you have the
Node.js server on
http://localhost:3000
, run the app:
npm run dev