AI Dashboard Quick Start Guide

ote: AI Dashboard is available to the Duke University community. It cannot be used for Protected Health Information (PHI) and there is no Business Associate Agreement (BAA) in support of compliance with the Health Insurance Portability and Accountability Act (HIPAA).

Access the AI Dashboard

The AI Dashboard site is home to two tools: MyGPT Builder to request your own Workspace, and AI Gateway which provides API keys for more advanced developers.

• Navigate to the URL: https://dashboard.ai.duke.edu.
• Click either “Log in” or “Access AI Dashboard” button to enter your Duke NetID.

 

AI Dashboard User Interface

The AI Dashboard site houses two tools, and the UI consists of three tabs: 

• “MyGPT Builder” (workspace creation and administration), 
• “AI Gateway” (API key creation), 
• FAQ about the service

 
Once logged in the site will redirect to the “MyGPT Builder” workspaces landing page. 
To return to the home page, click on the “AI Dashboard” text in the top logo.

 

Creating a Workspace

Click the “Create Workspace” button. A modal will pop up asking you to create a nickname for your workspace which will be used to identify it in the future.

 

Add a nickname so you can identify the Workspace, and hit the “Next” button.

 

Read the Terms and Conditions and hit “I Agree” (or “Cancel” if you don’t agree).

The new workspace will show in a list with a status of “pending”.
It takes a few minutes to create/provision the workspace, so please be patient.

• Your workspace may take up to 10 minutes to become active
•  Refresh the page to check the status.

Refresh the page in your browser and it will show a status of “active” when ready.

Note: At this time users can only create a single workspace.  If you have reason to need more than one, please submit a Help Ticket to the Service Desk with additional information as to why you need another Workspace. The request will be reviewed. 

“Actions” dropdown shows 

• Manage - basic workspace information - can be helpful for troubleshooting
• Restart - restart the workspace - a good option if you’re having problems or it’s not responding
• Delete - this will delete the instance and all the data (this is irreversible)

Note: At this time users can only create a single workspace.  If you have reason to need more than one, please submit a Help Ticket to the Service Desk with additional information as to why you need another Workspace. The request will be reviewed.  

Access and Manage a Workspace

Access your workspace by clicking the linked alias name in the table.

• Sign in to Open Web UI: Click “Continue with Duke University OpenID Connect” button which will take you to a Duke NetID login page.
•  
• Review the information you are providing to Open WebUI Production Instance, make any changes to the “Remember this decision” box, and click “Authorize”
• You may see Release Notes. Read and click the “Ok, Let’s Go!” button.

• You may see a notification alerting you a new version is available with a link to update. End users cannot update the instance, updates will be scheduled and run by service administrators. You can ignore or click the “x’ to remove the notification.

Manage Your Workspace

Where the Magic is: “Workspace” Area Options

Navigate to the “Workspaces” area in the far left vertical menu on the page. You will see the Workspaces menu horizontally along the top of the page. There are four menu options showing what can be custom created: 

• Model - create a custom model 
• Knowledge - text file uploads for document sources
• Prompt - create shortcut for prompts
• Tool - (advanced) write custom code in python to create custom model functionality.

More Settings

To manage administrative settings in your workspace, navigate to the round person icon in the far upper right and click.  A dropdown menu will appear. Click the fourth option, “Admin Panel”.

 

The admin panel starts on the “Users” tab:

 

If you have a new user, you will see them listed here as pending. 

 

Click on “Pending” to approve them and provide a role. 

To join a workspace, enter the URL in your browser. A modal indicating “Status Pending” will show until granted a role.

Create Groups:

Click on “Users”, then “Groups”. Create user groups as needed.  Groups can be used to limit or control access to certain models, tools, etc.

 

Add/remove people and set their role in the workspace

Go to the “Settings” option on the Admin panel page. The General page under Settings will open:

 

Under the Authentication section on the Settings > “General” page:
The default new user role is “Pending” and needs to be manually approved. Administrators have the ability to:

Enable or disable new sign ups, and automatically assign roles by clicking “pending” dropdown and automatically approving new users as “user” or “admin”.

 

Default User Role dropdown open

 

To Add/Edit Model Sources:

We have pre-set the OpenWebUI interface to have our standard offering of models, but you are welcome to connect other sources if you want to run different models via API.  

• Navigate to the Settings > “Connections” page in the left side bar under the Admin Panel. 
  
  
• 

 

• To add a new model source, hit the “+” and an “Add Connection” modal window opens for you to use.

View Synced Models and Model Authorizations:

Navigate to the Settings > “Models” page in the left side bar. 

• View and edit all synced models and model authorizations.

Edit Model Authorizations 

• To edit - click the pencil icon to the right of each model.
• *For security reasons, by default all models are set to private and new users will not see them. Permission must be granted manually for each model.

• Change visibility from “private” to “public”, or add groups of users here.
  • 
    
    

Edit Text Embeds

Navigate to the Settings > “Documents” page in the left side bar and edit the RAG template. 

Allow Web Search by Choosing an Engine 

Navigate to the Settings > “Web Search” page.

• Enable Web Search by turning slider option to green. Hit SAVE button at page bottom
• Under the dropdown Web Search Engine > “Select an engine” you can pick what you’d like to use. (Note: some engines may require a paid key)
• After making edits, hit SAVE button on lower right of page.

 

AI Gateway: API Keys

From the AI Dashboard Landing page dashboard, hit the second navigation item: “AI Gateway”. If you have created a workspace in the MyGPT Builder tab, you should see the key associated with that workplace here.

Create a New API key

To create an API key to use in your own development projects or applications, click “Create API key”

• A modal will pop up asking for some information about the key generation process
  • Key Nickname: Used to identify this key - helpful to associate each key with a specific project 
  • Fund Code: Here you can enter a Duke Fund Code to pay for the inference cost of the use of this key. 
  • Without a fund code:
    • You’ll have a daily request limit, which varies by model. You’ll also be restricted by:
      • Requests per minute
      • Tokens per minute
      • Concurrent requests
  • These limits are designed to keep usage fair across all users.
  • Users can only request one API key without a fund code.
• With a fund code:
  • You can make unlimited requests (subject to fair usage) and are billed directly at cost to the fund code. While we still enforce rate limits (requests, tokens, and concurrency), these thresholds are significantly higher for fund-backed projects.

Hit the "Create API Key" button and fill in a memorable Nickname for your key.

• If you add a fund code, you can now set a budget to manage the spend associated with this key.
  • Budget Amount: Maximum amount of spend
  • Budget Duration: Number of days before the budget is reset
    • For example: If you select Budget Amount: $20 and Budget Duration: 30 days, your key will be disabled when it hits $20 of spend within a 30 day period, and will reset after 30 days.
  • Billing is handled on a monthly basis

Click Next, read and review the terms of use, and click “I Agree” to proceed.  

• Your API key is provisioned and provided for you to copy and paste and use in your application. 
  NOTE: For security reasons, this is the only time you will be able to see or copy your API key, so if you close this modal, you will have to delete the key and start the process again. 

Under the “Actions” dropdown you will see four options to manage your key: 

• Manage - Displays budget and token information
• Extend - Extends expiration date
• Regenerate Key - Provides a new key if you lose it or it’s compromised
• Archive/Revoke - Deletes a key and revokes it

• The “Manage” page displays
  • Budget and token information for free key
  • Ability to view the key data.
  • Ability to add a Fund Code if you did not include one when setting it up

• If you click the “View” button after Key Data a modal will show key information, which can be helpful for debugging,
  but it will not display the full key.

Adding a Fund Code

• Click “Edit” button next to the page title “Edit API Key Settings”.

• Click “Edit” next to the fund code to add one. 
• The link “Do I need a fund code?” brings you to the FAQ page to find out more information.
• When Adding a fund code you can set your budget amount, duration, etc.

 

• When you hit "Next" you will see another API key in your table

Have Fun!

For technical assistance, contact the Service Desk

For service-specific inquiries, email aisuitesupport@duke.edu