Skip to content
English
Contact us
  • There are no suggestions because the search field is empty.

Setup Guide Azure OpenAI

Detailed guide for setting up Azure OpenAI

General Information

The Microsoft Azure OpenAI Service enables secure and scalable access to advanced language models through REST API endpoints within your organization's own Azure tenant. Access to these endpoints is managed via an API key. Data sent to the service is not used for model training and remains inaccessible to third parties. 

Privacy & Data Handling

Your prompts (inputs) and completions (outputs), your embeddings, and your training data:

  • are NOT available to other customers.

  • are NOT available to OpenAI or other Azure Direct Model providers.

  • are NOT used by Azure Direct Model providers to improve their models or services.
  • are NOT used to train any generative AI foundation models without your permission or instruction.
  • Customer Data, Prompts, and Completions are NOT used to improve Microsoft or third-party products or services without your explicit permission or instruction.

Data, privacy, and security for Azure OpenAI Service - Azure AI services for more details. 

Separation from Data Extraction

Azure OpenAI is used only for AI-supported processing of already extracted and prepared data stored in a project database. The AI has no SAP or RFC access and cannot initiate, modify, or expand SAP data extraction.

Please see SAP Governance Data Extraction with zapliance for more details.

 
 

Choosing the Appropriate Model

zapliance solutions support two recommended models: GPT-5.4 and GPT-5.6.

The appropriate model depends on your specific use case and requirements. zapliance can provide guidance for your decision-making based on your specific use case.

GPT-5.4 is recommended as the standard model for most use cases, providing a suitable balance between performance and cost.

GPT-5.6 provides stronger capabilities for use cases that require more advanced reasoning but typically results in higher usage costs.

 
 

Setting Up Azure OpenAI

Choose an EU-based Microsoft Azure region for GDPR compliance and set up the service in accordance with company policies and compliance guidelines. Follow our detailed setup instructions for implementation.

 

Optional: Web Search for zapHome OnPrem AI Search

Azure OpenAI web search enables your LLM to retrieve and ground responses with real-time information from the selected web sources. When enabled, the model can return up-to-date answers with inline citations. Web search is available via the web_search tool in the Responses API.

This tool needs to be enabled in your Azure OpenAI model if you deploy zapHome OnPrem AI Search.

Please refer to the official Microsoft documentation for detailed setup instructions.