Edit

Share via


Upgrade from GitHub Models to Microsoft Foundry Models

Note

This document refers to the Microsoft Foundry (classic) portal.

🔄 Switch to the Microsoft Foundry (new) documentation if you're using the new portal.

Note

This document refers to the Microsoft Foundry (new) portal.

In this article, you learn to develop a generative AI application by starting from GitHub Models and then upgrade your experience by deploying a Foundry Tools resource with Microsoft Foundry Models.

GitHub Models are useful when you want to find and experiment with AI models for free as you develop a generative AI application. When you're ready to bring your application to production, upgrade your experience by deploying a Foundry Tools resource in an Azure subscription and start using Foundry Models. You don't need to change anything else in your code.

The playground and free API usage for GitHub Models are rate limited by requests per minute, requests per day, tokens per request, and concurrent requests. If you get rate limited, you need to wait for the rate limit that you hit to reset before you can make more requests.

Prerequisites

To complete this tutorial, you need:

Upgrade to Foundry Models

The rate limits for the playground and free API usage help you experiment with models and develop your AI application. When you're ready to bring your application to production, use a key and endpoint from a paid Azure account. You don't need to change anything else in your code.

To get the key and endpoint:

  1. Go to GitHub Models and select a model to land on its playground. This article uses Mistral Medium 3 (25.05).

  2. Type in some prompts or use some of the suggested prompts to interact with the model in the playground.

  3. Select Use this model from the playground. This action opens up a window to "Get started with Models in your codebase".

  4. In the "Configure authentication" step, select Get Microsoft Foundry key from the "Azure AI" section.

    A screenshot showing how to get the Azure AI production key from the playground of a GitHub Model.

  5. If you're already signed in to your Azure account, skip this step. However, if you don't have an Azure account or you're not signed in to your account, follow these steps:

    1. If you don't have an Azure account, select Create my account and follow the steps to create one.

    2. Alternatively, if you have an Azure account, select Sign back in. If your existing account is a free account, you first have to upgrade to a standard plan.

    3. Return to the model's playground and select Get Microsoft Foundry key again.

    4. Sign in to your Azure account.

  6. You're taken to Foundry > GitHub and land on the home page in a Foundry project. The Foundry experience that opens up depends on the one you last used, either:

    1. You might land in the Foundry (new) experience. Notice the New Foundry toggle is on in the upper-right navigation.

    2. Alternatively, you might land in the Foundry (classic) experience. Notice the New Foundry toggle is off in the upper-right navigation.

  7. Toggle the New Foundry switcher if you prefer to switch to a different Foundry experience.

  8. Follow the steps in Deploy a model to deploy the model of your choice, test it in the Playground, and inference the deployed model with code.

Important

Unlike GitHub Models where all the models are already configured, the Foundry Tools resource allows you to control which models are available in your endpoint and under which configuration. Add as many models as you plan to use before indicating them in the model parameter. Learn how to add more models to your resource.

Explore additional features

Foundry Models supports extra features that aren't available in GitHub Models, including:

Next Step