All Knowledge

Articles, tutorials & news on AI Quality, Security & Compliance

Giskard leads GenAI Evaluation in France 2030's ArGiMi Consortium

The ArGiMi consortium, including Giskard, Artefact and Mistral AI, has won a France 2030 project to develop next-generation French LLMs for businesses. Giskard will lead efforts in AI safety, ensuring model quality, conformity, and security. The project will be open-source ensuring collaboration, and aiming to make AI more reliable, ethical, and accessible across industries.

Blanca Rivera Campos

News

Recent content

Increasing trust in foundation language models through multi-lingual security, safety and robustness testing

News

Giskard announces Phare, a new open & multi-lingual LLM Benchmark

During the Paris AI Summit, Giskard launches Phare, a new open & independent LLM benchmark to evaluate key AI security dimensions including hallucination, factual accuracy, bias, and potential for harm across several languages, with Google DeepMind as research partner. This initiative is meant to provide open measurements to assess trustworthiness of Generative AI models in real applications.

Matteo Dora

View post

News

DeepSeek R1: Complete analysis of capabilities and limitations

In this article, we provide a detailed analysis of DeepSeek R1, comparing its performance against leading AI models like GPT-4o and O1. Our testing reveals both impressive knowledge capabilities and significant concerns, particularly regarding the model's tendency to generate hallucinations. Through concrete examples, we examine how R1 handles politically sensitive topics.

Matteo Dora

View post

Giskard integrates with LiteLLM to simplify LLM agent testing

News

[Release notes] Giskard integrates with LiteLLM: Simplifying LLM agent testing across foundation models

Giskard's integration with LiteLLM enables developers to test their LLM agents across multiple foundation models. The integration enhances Giskard's core features - LLM Scan for vulnerability assessment and RAGET for RAG evaluation - by allowing them to work with any supported LLM provider: whether you're using major cloud providers like OpenAI and Anthropic, local deployments through Ollama, or open-source models like Mistral.

Blanca Rivera Campos

View post

Knowledge to be shared

Articles, tutorials and latest news on AI Quality, Security & Compliance

See all

News

AI Liability in the EU: Business guide to Product (PLD) and AI Liability Directives (AILD)

The EU is establishing an AI liability framework through two key regulations: the Product Liability Directive (PLD), taking effect in 2024, and the proposed AI Liability Directive (AILD). The PLD introduces strict liability for defective AI systems and software, while the AILD addresses negligent use, though its final form remains under debate. Learn in this article the key points of these regulations and how they will impact businesses.

Stanislas Renondin

View post

Giskard Vision: Enhance Computer Vision models for image classification, object an landmark detection

Benoît Malézieux

News

Evaluating LLM applications: Giskard Integration with NVIDIA NeMo Guardrails

Blanca Rivera Campos

News

Global AI Treaty: EU, UK, US, and Israel sign landmark AI regulation

Stanislas Renondin

News

L'Oréal leverages Giskard for advanced Facial Landmark Detection

Rabah Abdul Khalek

Tutorials