AI Tool Review · 2026

Giskard Review (2026): Features, Pricing & Verdict

Review basis and primary sources

This is a documentation-based assessment, checked on 8 October 2026. No authenticated product trial or production benchmark is presented for this review. Vendor examples are attributed to the vendor.

Giskard provides an open-source Python library for testing AI agents and an enterprise Hub for collaborative evaluation. This review distinguishes the current library from older v2 capabilities. The documented APIs have changed: use the version-specific guidance rather than assuming older examples still apply. Current library documentation.

Documentation assessment

No numerical rating assigned
Documented features and evidence limits are separated below.
Best for
AI teams building repeatable behavioral checks
Platform
Local Python testing library and separate enterprise Hub
Key differentiator
Version-specific quality and vulnerability scans
Pricing
Library plus provider usage costs; Hub quoted separately
Vendor
Giskard
Version note: Giskard is mid-transition to a major v3 rewrite (a modular, dependency-light architecture built for multi-turn agent testing), which is currently in beta/pre-release. As of this review, the flagship LLM Scan and RAGET features still run on the v2 engine and are being migrated to v3; v2 remains available but is no longer actively maintained. This is a genuine “which version do I adopt?” consideration for new users, and it’s reflected in the score below.

What Is Giskard?

Giskard separates a local testing library from its enterprise Hub. The Hub adds shared datasets, access control and scheduled evaluations; its SDK uses the giskard-hub package. Hub SDK documentation.

Core Features

RAG quality checks and version-specific APIs

Older v2 documentation called its RAG evaluation toolkit RAGET. Current v3 documentation uses quality_scan, which generates questions from a supplied knowledge base and evaluates the replies. Select a version and build checks around your own failure cases. Current library and migration notes.

Vulnerability scanning

Current v3 exposes vulnerability_scan for hostile inputs. Scans require the optional scan extra, such as pip install "giskard[scan]". A passing scan is not a safety or compliance guarantee. Official scan overview.

Version coverage and enterprise Hub

The v3 library is pytest-native and async-first. Tabular classification and regression have no v3 equivalent in the current migration notes; retain v2 for those use cases. Do not treat an older giskard.scan example as a current API guarantee. Version-specific documentation.

Evidence and assessment limits

The previous numeric category scores have been withdrawn because the review did not provide a reproducible scoring protocol. Documented features and limited functional checks should not be read as comparative benchmark results.

Pricing

Option Cost basis
Local library Open-source library; model and judge calls may add provider charges
Giskard Hub Contact the vendor for the required scope and current quote
Giskard’s pricing follows the familiar open-core pattern, and its open end is genuinely generous. The open-source library — which includes the substance of the product: the LLM Scan, RAGET, the red-teaming scanner and the traditional-ML testing module — is completely free under the permissive Apache 2.0 licence. You install it with pip and run it locally against any model, with no usage fees and full data ownership, which makes it a real, self-contained testing solution for individual developers and teams, not a stripped-back teaser for a paid product. That’s the right place to start, and for many teams it’s all they’ll ever need. The enterprise Giskard Hub is where paid pricing comes in, and it’s positioned for organisations — particularly in regulated sectors like banking and insurance — that need the collaboration and governance layer: shared workspaces, role-based access control, versioned test-case management, custom failure categories, and, most importantly, continuous and scheduled red teaming that monitors production for new vulnerabilities automatically, along with the EU AI Act and OWASP compliance packs. Hub pricing is not published — it’s a contact-sales arrangement — so budgeting for it requires a conversation with Giskard, and the lack of a public number is a planning consideration if you have fixed budgets or long procurement cycles. Giskard also offers a professional LLM red-teaming service in which its own ML researchers conduct hands-on engagements to identify and mitigate vulnerabilities, useful for teams that want expert-led testing rather than only self-serve tooling. The practical guidance: start with the free open-source library to run scans and RAG evaluations locally and validate that Giskard fits your workflow (this costs nothing and reveals most of the value); adopt the Hub when you need team collaboration, continuous production red teaming, and compliance governance at organisational scale; and engage the red-teaming service for expert-led adversarial testing. As always, confirm current Hub pricing and terms directly with Giskard, and factor in the v2/v3 transition when planning which version to build on.

Strengths

  • Knowledge-base-driven quality checks; confirm APIs against your installed version
  • Auto-generates RAG test sets from your knowledge base — no hand-authoring
  • Fully open-source (Apache 2.0) and free — run locally, full data ownership
  • Automated LLM Scan: hallucinations, prompt injection, PII leakage, bias, robustness
  • Scan findings convert into reusable CI/CD test suites — testing, not one-off audits
  • Autonomous multi-turn red teaming (40+ adaptive probes) catches conversational flaws
  • Tests traditional ML (classification/regression/ranking) and LLMs in one framework
  • Black-box — needs only an API endpoint; works with OpenAI, Anthropic, Ollama, LiteLLM
  • Strong regulated-sector story: EU AI Act & OWASP compliance packs, Policy-as-Code
  • Research-grade credibility — EU/Bpifrance funding, DeepMind collabs; powers Databricks red-teaming
  • Enterprise Hub adds collaboration, continuous red teaming, RBAC, dataset versioning

Weaknesses

  • Version migration changes APIs and feature coverage; legacy tabular testing remains on v2
  • A testing/red-teaming tool, not a full observability/monitoring platform
  • Often complementary to (not a replacement for) trace/observe platforms
  • Scan is a first-pass signal — less deep than garak’s probe library or PyRIT’s campaigns
  • Enterprise Hub pricing not public — requires a sales conversation
  • Confirm supported Python versions and dependencies before deployment
  • Red-teaming depth for a full adversarial campaign needs a dedicated specialist alongside
  • Primarily developer/Python-centric — less turnkey for non-technical users (outside the Hub)

Assessment and practical fit

Consider Giskard when you need repeatable checks against an AI agent. Confirm the installed version, the scan extra and judge-provider costs first. Teams depending on legacy tabular tests need the v2 documentation; current v3 is not a drop-in replacement for that workflow. No security guarantee or numerical product rating is established here.

Frequently Asked Questions

How do older RAGET examples relate to current quality scans?

RAGET is the name used in the older v2 workflow. In the current v3 migration notes, its successor is quality_scan. Pin the package version and follow matching documentation. Migration notes.

Is Giskard free, and what’s the difference between the open source and the Hub?

The local library is distinct from the enterprise Hub. Library code can be run locally, but model or judge-provider calls may still incur charges. Confirm your package license, provider budget and required Hub features before deployment.

Should I worry about the Giskard v2-to-v3 transition?

Migration requires checking version-specific APIs and feature coverage. In particular, current v3 has no equivalent for v2 tabular classification or regression testing. Test your existing suite before switching versions. Current migration guidance.