G
Blog
September 17, 2021
1 min read

How did the idea of Giskard emerge? #2 🐑 User Interfaces

It is difficult to create interfaces to AI models Even AIs made by tech giants have bugs. With Giskard AI, we want to make it easy to create interfaces for humans to inspect AI models. 🕵️ Do you think interfaces are valuable? If so, what kinds of interfaces do you like?

User interfaces - counting sheeps
Alex Combessie
User interfaces - counting sheeps
User interfaces - counting sheeps

It is also about User Interfaces (UI). 📱

Last year, I worked on Open-Source integrations with AI-as-a-Service APIs. The goal was to let Dataiku users leverage NLP and Computer Vision models from Amazon, Google & Microsoft with no-code.

A daunting task

20+ APIs, with different input types, architectures, and output formats. I spent months creating a robust framework to send data to the APIs and standardize the results. 🧑‍💻

Only at the end of the project did I start creating user interfaces. For fun, I downloaded random images and fed them to the APIs.

Some unexpected results came out…
- My Little Pony posters were deemed as sexually explicit. 🎠🔞
- In group photos, not everyone was recognized as a person. 🙈🤪
- AIs were strangely unable to count sheep… 🐑🤯

Takeaways

I kept 2 takeaways from this project:
1. It is difficult to create interfaces to AI models.
2. Even AIs made by tech giants have bugs.

With Giskard, we want to make it easy to create interfaces for humans to inspect AI models. 🕵️

Integrate | Scan | Test | Automate

Giskard: Testing & evaluation framework for LLMs and AI models

Automatic LLM testing
Protect agaisnt AI risks
Evaluate RAG applications
Ensure compliance

How did the idea of Giskard emerge? #2 🐑 User Interfaces

It is difficult to create interfaces to AI models Even AIs made by tech giants have bugs. With Giskard AI, we want to make it easy to create interfaces for humans to inspect AI models. 🕵️ Do you think interfaces are valuable? If so, what kinds of interfaces do you like?

It is also about User Interfaces (UI). 📱

Last year, I worked on Open-Source integrations with AI-as-a-Service APIs. The goal was to let Dataiku users leverage NLP and Computer Vision models from Amazon, Google & Microsoft with no-code.

A daunting task

20+ APIs, with different input types, architectures, and output formats. I spent months creating a robust framework to send data to the APIs and standardize the results. 🧑‍💻

Only at the end of the project did I start creating user interfaces. For fun, I downloaded random images and fed them to the APIs.

Some unexpected results came out…
- My Little Pony posters were deemed as sexually explicit. 🎠🔞
- In group photos, not everyone was recognized as a person. 🙈🤪
- AIs were strangely unable to count sheep… 🐑🤯

Takeaways

I kept 2 takeaways from this project:
1. It is difficult to create interfaces to AI models.
2. Even AIs made by tech giants have bugs.

With Giskard, we want to make it easy to create interfaces for humans to inspect AI models. 🕵️

Get Free Content

Download our guide and learn What the EU AI Act means for Generative AI Systems Providers.