AI Solution Explorer

A cutting-edge platform designed to help organizations discover, evaluate, and implement artificial intelligence (AI) solutions tailored to their specific business needs. This intuitive tool enables users to navigate the vast landscape of AI technologies, identify potential applications, and unlock new opportunities for innovation and growth.

Home / 06: Routing
Solution Image
06: Routing
A workflow where user input is classified and directs to a specific task (can be a specific LLM, specific prompt, etc...). This allows you to optimize for many inputs in isolation.
Use Cases:
  • Routing easy/common questions to smaller models like Llama 3.1 8B and hard/unusual questions to more capable models like Deepseek v3 and Llama 3.3 70B to optimize cost and speed.
  • Directing different types of customer service queries (general questions, refund requests, technical support) into different downstream processes, prompts, and tools.
  • Different LLMs or model configurations excel at different tasks (e.g., writing summaries vs. generating code). Using a router, you can automatically detect the user's intent and send the input to the best-fit model.
  • Evaluating whether a request meets certain guidelines or triggers specific filters (e.g., checking if content is disallowed). Based on the classification, forward it to the appropriate next LLM call or step.
  • If one model's output doesn't meet a certain confidence threshold or fails for some reason, route automatically to a fallback model.
Workflow
Advanced