Connect to Ollama from Excel and Word

On Microsoft Excel and Word, GPT for Work can connect to an Ollama server to use locally running open-source models. Ollama is an open-source platform that allows you to easily install, run, and serve models from a local machine, keeping your prompting entirely offline. You can use any model from the Ollama library.

Prerequisites

You have an Ollama server running with one or more models. For instructions on how to set up the server, see:

• Set up Ollama on macOS

• Set up Ollama on Windows

note

You cannot currently use Ollama models with the Agent.

note

Depending on the model you use, the model settings defined in GPT for Work (temperature (creativity), top-p, frequency penalty, and presence penalty) may not work as expected. If you get bad results, try tweaking the settings.

To use models from an Ollama server:

1. Set up the API endpoint for the Ollama server.

2. Select a model available on the Ollama server.

Set up the API endpoint for an Ollama server

1. Sign in to the GPT for Work dashboard with your Microsoft account.

2. In the sidebar, select API endpoints.

3. Click OpenAI-compatible endpoints.

   tip

   If you already have OpenAI-compatible API endpoints set up, click Add another OpenAI compatible endpoint.

4. Define the endpoint settings:

   • Endpoint URL: Enter the URL of the Ollama server.

   • Display name (optional): Enter a short name that is prefixed to the model names in the model switcher. By default, the model names are prefixed with "custom/".

   • API key (optional): Leave this field empty. The Ollama server does not require an API key for access.

   

5. Click Check to validate the settings and click Save.

   

   tip

   If you get an error saying that the URL is invalid, make sure that the Ollama server supports:

   • Cross-origin resource sharing (CORS). See the Ollama server setup instructions for macOS or Windows.

   • HTTPS (needed with Safari and with Microsoft Office for Mac). See the Ollama server setup instructions for macOS.

You have set up the Ollama server API endpoint. You can now use all models available through the endpoint in GPT for Excel and GPT for Word.

Select a model from the Ollama server

MS Excel

1. Open a Microsoft Excel workbook.

2. In the Home tab, click GPT for Excel Word.

   

   info

   You can also select Home > Add-ins > My Add-ins > GPT for Excel Word.

3. In the sidebar menu, select Bulk AI tools or GPT functions.

4. Expand the model switcher. You can find the Ollama models under Use your API key or endpoint.

   

   note

   The available models depend on the models available on the Ollama server.

5. Select a model.

GPT for Excel now uses the selected model to generate responses for bulk AI tools and GPT functions.

MS Word

1. Open a Microsoft Word document.

2. In the Home tab, click GPT for Excel Word.

   

   info

   You can also select Home > Add-ins > My Add-ins > GPT for Excel Word.

3. Expand the model switcher. You can find the Ollama models under Use your API key or endpoint.

   

   note

   The available models depend on the models available on the Ollama server.

4. Select a model.

GPT for Word now uses the selected model to generate responses.

What's next

• Set up an Ollama server on macOS or Windows.