AI Gateway

The AI Gateway provides Duke developers and researchers (students, faculty and staff) access to LiteLLM API keys, enabling them to integrate AI capabilities into their own applications. It empowers users to build and deploy unique AI-driven tools, chatbots, and services, leveraging both on-prem and cloud-based models (via cost recovery) according to their needs.

Note for the Duke Health Community:

Currently, AI Gateway is not approved for use within the Duke Health environment. Microsoft Copilot is still available for use by the Duke Health community. For policy questions, please reach out to your departmental leadership or compliance@dm.duke.edu.