Pipelines¶

What is a Pipeline?¶

A pipeline is a visual workflow in Open Chat Studio that defines how a chatbot processes messages and generates responses. Think of it like a recipe or assembly line — each step in the pipeline does one specific job, and the steps are connected together to create a complete conversation flow.

What is a Node?¶

Each step in the pipeline is called a node. A node performs one specific task, such as:

• Calling an AI model to generate a response (LLM node)
• Running custom logic or code (Python node)
• Making decisions about which way the conversation should go (Router nodes)
• Sending emails or extracting data (specialty nodes)

Pipelines are visual — you build them by dragging nodes onto a canvas and connecting them with lines, making chatbot logic easier to understand and maintain without writing complex code.

A Simple Example¶

Here's the simplest possible chatbot pipeline — it has just one node:

In this simple pipeline:

1. A user sends a message
2. The LLM node receives the message and uses AI to generate a response
3. The response is sent back to the user

This is the complete conversation flow for a single-node chatbot.

Complex Pipelines¶

Most real-world chatbots are more complex than a single node. Pipelines become powerful when you combine multiple types of nodes to handle different tasks.

Breaking work into separate nodes lets you:

• Keep logic focused and easy to understand
• Reuse nodes across different parts of your pipeline
• Test and modify individual steps without affecting the whole pipeline
• Scale complex workflows without overwhelming a single AI prompt

Node Types for Complex Pipelines¶

Common node types include:

• LLM Node — Processes messages using an AI model. Handles natural conversations, answering questions, and generating responses.

• Routing Nodes — Makes decisions about which path the conversation should take based on the message content. Useful for directing different types of questions to different handling logic, or routing based on user intent.

• Python Node — Runs custom code to handle complex logic, fetch data from external systems, process attachments, or manipulate participant data.

• Render Template Node — Formats responses using templates, allowing you to customize messages with dynamic data.

• Send Email Node — Sends emails as part of your pipeline, useful for notifications or confirmations.

• Extract Structured Data Node — Pulls specific information from conversations and structures it for downstream processing.

• Update Participant Data Node — Saves information about the user for later use in the conversation.

How a Pipeline Runs¶

Open Chat Studio (OCS) executes your pipeline in organized steps, running nodes in parallel when possible.

When a user sends a message, OCS processes the pipeline in repeating passes:

Plan → Execute → Update → Repeat

1. Plan: Identify which nodes are ready to run. On the first pass, this is the node(s) directly connected to the user's input. On later passes, any node whose dependencies have been satisfied is ready.

2. Execute: Run all ready nodes in parallel. Each node processes independently — it cannot see the results of other nodes running in the same pass.

3. Update: Share the results from all nodes so they're available for the next step.

This repeats until all nodes have completed or a maximum step limit is reached.

Because multiple nodes can execute in the same pass, pipelines naturally support parallel processing. See Parallel Pipelines for details.

Asking the Assistant About a Pipeline¶