Have an idea for an LLM experiment?

Here are some reasons to run it at Expected Parrot, and easy ways to get started.

There are a bunch of reasons to run your LLM-based experiments at Expected Parrot! These include:

1. Open source features. Our platform is built on EDSL, our open source package for conducting research with AI agents and language models.

2. Designed for researchers. Our tools are designed for social science and market researchers who want to conduct complex tasks and experiments with LLMs—and not spend lots of time on software development.

3. Easy access to models. Our tools work with many LLMs from popular service providers that you can connect to with your own API keys or a single key managed by Expected Parrot. You can check current performance and token prices of available models here.

4. Reproducibility. Your LLM prompts and responses are stored automatically, and always available to you. Anyone else can also retrieve them for free whenever you share your experiments and results.

5. Transparency. Our tools allow you to precisely specify and control all components of your experiments. Results are generated as readily usable, formatted datasets.

6. Built-in tools for analysis. Our tools come with built-in methods for analyzing, visualizing and exporting your results.

7. Free storage. Your account comes with free storage for your projects so you can access them from anywhere.

8. Free sharing. You can choose whether to share projects and results privately, or post them publicly.

9. Free credits for API calls. Your account comes with $25 in credits for API calls to language models for getting started. We also have lots of free credits for students and research projects!

How it works

Expected Parrot tools are designed to make it easy to run complex experiments with LLMs, and to share and replicate research. A typical workflow consists of the following steps:

• Design an experiment in EDSL, our open source Python package.

• Run your EDSL code in a notebook (e.g., Jupyter, VS Code or Colab).

• View your results at your account (Coop is our free platform for storing and sharing content you create in EDSL).

• Iterate on your work using built-in methods for analysis.

• Publish your work to allow others to replicate your research at no cost.

Technical setup

Technical setup is quick!

1. Create an account with an email address.

2. Install the EDSL package on your computer. See instructions.

Explore demo notebooks

If your experiment idea is nascent, take a look at our many demo notebooks of example code for a variety of use cases. These are designed to help you get familiar with how EDSL works and also provide a modifiable template as your starting point.

If you have a use case that you don’t see in our demo notebooks, please send us a message and we’ll create one for you!

Try our GPT

Not sure how your idea would work in EDSL? Try describing it to our GPT for generating EDSL code. Here’s a quick example:

Copy the code to a notebook and run it:

You can view the results at Coop:

Please get in touch if you have any questions or feature requests!

Post a message at our Discord or send us an email at info@expectedparrot.com.