Orion is a desktop app for testing and iterating on LLM prompts, built by Rebellion Software. Think of it as Postman for language models — a place to organize your prompts, run them against any provider, and track what works. This guide covers the three things you'll do first: create a collection, write and run a prompt, and export your work.
This guide explains how providers work in Orion, how to add and configure them, and how to set up common local and third-party services. It's aimed at anyone who wants to go beyond the built-in OpenAI and Anthropic integrations.
This guide explains how to use `{{variable}}` placeholders in your prompts, how to fill them in using the Variable Test Panel, and how to manage shared values with environments. It assumes you've already written at least one prompt.
Batch testing lets you run a prompt against every row in a CSV file automatically, with results collected in a live-updating table. This guide covers how to set up and run a batch, how variable mapping works, how to export results, and how to use comparison mode to test the same CSV across multiple models at once.
Assertions are checks you define on a prompt that run automatically every time you send it. Instead of eyeballing each response to decide if it met your criteria, Orion evaluates your rules and shows pass/fail results inline. This guide covers all assertion types and how to use them effectively.
Orion has two ways to run model comparisons: a head-to-head mode for testing a single prompt against multiple models side by side, and a batch comparison mode for running a full CSV across multiple models at once. This guide covers both — how to set them up, what to expect, and when to use each.