Giskard Review (2026): Features, Pricing & Verdict
Review basis and primary sources
This is a documentation-based assessment, checked on 8 October 2026. No authenticated product trial or production benchmark is presented for this review. Vendor examples are attributed to the vendor.
Giskard provides an open-source Python library for testing AI agents and an enterprise Hub for collaborative evaluation. This review distinguishes the current library from older v2 capabilities. The documented APIs have changed: use the version-specific guidance rather than assuming older examples still apply. Current library documentation.
Documentation assessment
- Best for
- AI teams building repeatable behavioral checks
- Platform
- Local Python testing library and separate enterprise Hub
- Key differentiator
- Version-specific quality and vulnerability scans
- Pricing
- Library plus provider usage costs; Hub quoted separately
- Vendor
- Giskard
What Is Giskard?
Giskard separates a local testing library from its enterprise Hub. The Hub adds shared datasets, access control and scheduled evaluations; its SDK uses the giskard-hub package. Hub SDK documentation.
Core Features
RAG quality checks and version-specific APIs
Older v2 documentation called its RAG evaluation toolkit RAGET. Current v3 documentation uses quality_scan, which generates questions from a supplied knowledge base and evaluates the replies. Select a version and build checks around your own failure cases. Current library and migration notes.
Vulnerability scanning
Current v3 exposes vulnerability_scan for hostile inputs. Scans require the optional scan extra, such as pip install "giskard[scan]". A passing scan is not a safety or compliance guarantee. Official scan overview.
Version coverage and enterprise Hub
The v3 library is pytest-native and async-first. Tabular classification and regression have no v3 equivalent in the current migration notes; retain v2 for those use cases. Do not treat an older giskard.scan example as a current API guarantee. Version-specific documentation.
Evidence and assessment limits
The previous numeric category scores have been withdrawn because the review did not provide a reproducible scoring protocol. Documented features and limited functional checks should not be read as comparative benchmark results.
Pricing
| Option | Cost basis |
|---|---|
| Local library | Open-source library; model and judge calls may add provider charges |
| Giskard Hub | Contact the vendor for the required scope and current quote |
Strengths
- Knowledge-base-driven quality checks; confirm APIs against your installed version
- Auto-generates RAG test sets from your knowledge base — no hand-authoring
- Fully open-source (Apache 2.0) and free — run locally, full data ownership
- Automated LLM Scan: hallucinations, prompt injection, PII leakage, bias, robustness
- Scan findings convert into reusable CI/CD test suites — testing, not one-off audits
- Autonomous multi-turn red teaming (40+ adaptive probes) catches conversational flaws
- Tests traditional ML (classification/regression/ranking) and LLMs in one framework
- Black-box — needs only an API endpoint; works with OpenAI, Anthropic, Ollama, LiteLLM
- Strong regulated-sector story: EU AI Act & OWASP compliance packs, Policy-as-Code
- Research-grade credibility — EU/Bpifrance funding, DeepMind collabs; powers Databricks red-teaming
- Enterprise Hub adds collaboration, continuous red teaming, RBAC, dataset versioning
Weaknesses
- Version migration changes APIs and feature coverage; legacy tabular testing remains on v2
- A testing/red-teaming tool, not a full observability/monitoring platform
- Often complementary to (not a replacement for) trace/observe platforms
- Scan is a first-pass signal — less deep than garak’s probe library or PyRIT’s campaigns
- Enterprise Hub pricing not public — requires a sales conversation
- Confirm supported Python versions and dependencies before deployment
- Red-teaming depth for a full adversarial campaign needs a dedicated specialist alongside
- Primarily developer/Python-centric — less turnkey for non-technical users (outside the Hub)
Assessment and practical fit
Consider Giskard when you need repeatable checks against an AI agent. Confirm the installed version, the scan extra and judge-provider costs first. Teams depending on legacy tabular tests need the v2 documentation; current v3 is not a drop-in replacement for that workflow. No security guarantee or numerical product rating is established here.
Frequently Asked Questions
How do older RAGET examples relate to current quality scans?
RAGET is the name used in the older v2 workflow. In the current v3 migration notes, its successor is quality_scan. Pin the package version and follow matching documentation. Migration notes.
Is Giskard free, and what’s the difference between the open source and the Hub?
The local library is distinct from the enterprise Hub. Library code can be run locally, but model or judge-provider calls may still incur charges. Confirm your package license, provider budget and required Hub features before deployment.
Should I worry about the Giskard v2-to-v3 transition?
Migration requires checking version-specific APIs and feature coverage. In particular, current v3 has no equivalent for v2 tabular classification or regression testing. Test your existing suite before switching versions. Current migration guidance.