Setup Confident AI
Follow this 5 min quickstart guide to start evaluating away.
Create an account
If you don’t already have a Confident AI account, visit app.confident-ai.com and create one. You can create an account using your email address or through Google authentication for a faster process.
If you wish to sign in using SSO, checkout our enterprise offering.
After creating your account, you’ll be guided through the onboarding process. You’ll find your API key at the last step of the onboarding. allows you to copy your project API key. Keep this key secure, as it provides access to your project data on Confident AI through DeepEval.
How are my data separated on Confident AI?
During onboarding, Confident AI automatically creates:
- An organization to group all your projects and team members
- Your first project within that organization
As your team grows, you can:
- Create multiple projects to organize different LLM use cases
- Add team members to specific projects they need access to - Keep data separate between projects for better organization and security
For more information, on how data is separated and organization is structured, visit the data handling page.
Install DeepEval
Create virtual enviornment
Go to the root directory of your project and create a virtual environment (if you don’t already have one). In the CLI, run:
python3 -m venv venv
source venv/bin/activateRun pip install deepeval
In your newly created virtual environment, run:
pip install -U deepevalProvide API key
To log in with your API key, run the following command in the CLI:
deepeval login --confident-api-key YOUR_API_KEYReplace YOUR_API_KEY with the API key you copied from the Confident AI dashboard.
You can also login by using the login_with_confident_api_key method without going through the CLI if you’re in a notebook environment:
deepeval.login_with_confident_api_key("YOUR_API_KEY")Once logged in, you’re ready to start using Confident AI with DeepEval for your LLM evaluations.
How to switch my data region to EU?
Confident AI’s data lives in the US by default, but if you’re a customer with a data residency in the EU, you’ll need to run this command to point deepeval to use Confdient AI’s API endpoints on our EU servers and databases instead:
deepeval confident-set-url EUThis step is only required if you’ve created an account in the EU data region. For more information on data residency, click here.
What’s Next?
By the end of this Getting Started tutorial, you will get a nice looking testing report of your LLM app performance on Confident AI:
Unit-testing (powered by DeepEval) on Confident AI
