Overview

CAT Harness provides the infrastructure needed to:

  • Run and track CAT tests against LLM outputs
  • Store and analyze test results over time
  • Monitor changes in LLM behavior as prompts/models/data evolve
  • Integrate validation into CI/CD pipelines

Getting Started