Integration Guide: OpenAI Real Time Voice Bots with Dify.ai Workflow

Integration Capabilities:

Setting up a Workflow in Dify.ai:

Publishing and API Key:

Connecting OpenAI Real Time bot on exten.bot:

Example function description for get_time:

{
    "name": "get_time", 
    "type": "function", 
    "parameters": {
        "type": "object", 
        "required": [], 
        "properties": {}
        }, 
    "description": "If the user wants to know the current time"
}

Or a slightly more advanced function “two_numbers” (operation with numbers):

{
    "name": "two_numbers",
    "type": "function",
    "parameters": {
      "type": "object",
      "required": ["number1", "number2"],
      "properties": {
        "number1": {
          "type": "number",
          "description": "First number"
        },
        "number2": {
          "type": "number",
          "description": "Second number"
        }
      }
    },
    "description": "If the user wants to provide two numbers, ask for and process two numbers."
  }

Done: now user voice commands are processed via Dify.ai automated workflow.