README

Evals, Red Teaming and Test Generation for Agentic Systems
Modular, Lightweight, Dynamic and Async-first 












   Docs •
  Website •
  Community
 


 [!IMPORTANT]
 Giskard v3 is a fresh rewrite designed for dynamic, multi-turn testing of AI agents. This release drops heavy dependencies for better efficiency while introducing a more powerful AI vulnerability scanner and enhanced RAG evaluation — both now shipping natively in giskard-scan, with no dependency on v2. Only the legacy scan for tabular/ML models remains v2-only.
 Giskard v2 remains available but is no longer actively maintained.
 Follow progress → Read the v3 Announcement · Roadmap

 Install

sh
pip install giskard            checks (+ agents, llm, core)
pip install "giskard[scan]"    + vulnerability / quality scan
pip install "giskard[openai]"  provider SDK for LLM judges / generators


Requires Python 3.12+.

| Extra | Adds |
| --- | --- |
| (none) | giskard-checks and dependencies |
| scan | giskard-scan |
| openai / anthropic / … | provider SDKs (see pyproject.toml optional deps) |

Telemetry: optional aggregated analytics via giskard-core. No prompts or outputs are sent.
Opt out with export DO_NOT_TRACK=1 or export GISKARD_TELEMETRY_DISABLED=1 (or the same keys in a .env file in the working directory). Set them before import to skip creating ~/.giskard/id; setting them later still stops further sends.
Details: giskard-core README.

---

Giskard is an open-source Python library for testing and evaluating agentic systems. The v3 architecture is a modular set of focused packages — each carrying only the dependencies it needs — built from scratch to wrap anything: an LLM, a black-box agent, or a multi-step pipeline.

| Status         | Package          | Description                                                                                                                                                              |
| -------------- | ---------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| ✅ Stable      | giskard-checks | Testing & evaluation — scenario API, built-in checks, LLM-as-judge                                                                                                       |
| ✅ Stable      | giskard-scan   | Agent vulnerability scanner + RAG/quality evaluation — red teaming, prompt injection, jailbreaks & harmful content (vulnerability_scan, successor of v2 Scan), plus knowledge-base quality eval (quality_scan, successor of v2 RAGET) |

These build on three foundational libraries — giskard-core (shared utilities & telemetry), giskard-llm (provider-agnostic LLM routing), and giskard-agents (agent & workflow orchestration) — which are pulled in automatically and rarely used directly.

 Giskard Checks — create and apply evals for testing agents

sh
pip install giskard-checks


Giskard Checks is a lightweight library