This interview of Jean-Marie John-Mathews, co-founder of Giskard, discusses the ethical & security concerns of AI. While AI is not a new thing, recent developments like chatGPT bring a leap in performance that require rethinking how AI has been built. We discuss all the fear and fantasy about AI, how it can pose biases and create industrial incidents. Jean-Marie suggests that protection of AI resides in tests and safeguards to ensure responsible AI.
Metamorphic testing are adapted to Machine Learning. This tutorial describes the theory, examples and code to implement it.
Testing the drift of numerical feature distribution is essential in AI. Here are the key metrics you can use to detect it.
Testing drift of categorical feature distribution is essential in AI / ML, requiring specific metrics
What you need to know before getting started with ML Testing in 3 points
We explain presentation bias, a negative effect present in almost all ML systems with User Interfaces (UI)
Emergent biases result from the use of AI / ML across unanticipated contexts. It introduces risk when the context shifts.
Social, political, economic, and post-colonial asymmetries introduce risk to AI / ML development
Selection bias happens when your data is not representative of the situation to analyze, introducing risk to AI / ML systems
Machine Learning systems are particularly sensitive to measurement bias. Calibrate your AI / ML models to avoid that risk.
What happens when your AI / ML model is missing important variables? The risks of endogenous and exogenous exclusion bias.
Research Literature review: A Survey on Bias and Fairness in Machine Learning
We look into the latest research to understand what is the future of AI / ML Testing