NVIDIA NIM Connection

Authenticate to NVIDIA NIM AI and configure any necessary connection properties in the NVIDIA NIM connection.

Each connection property available in the NVIDIA NIM connection configuration is explained below.

Connection Name

The name of the connection to be created should be provided. This is the name that will display on the list of available connections.

Scope

Define the connection scope to customize their accessibility.

Organization

Accessible to organization users across all Gathr projects for usage in applications.

Project

Accessible to organization users limited to projects that are specified by the connection owner for usage in applications.

Private

Accessible only to the connection owner for usage in applications.

Authentication Method

Select the method to authenticate NIM.

API Key

The API key to authenticate NIM.

Allow Model Deployment

If enabled, models for this connection can be deployed on an orchestration platform like Kubernetes, from the Models listing page.

Select Cluster

Choose the cluster for deploying models.

Cluster Authentication Type

Select the authentication method for accessing the cluster. Options are:

  • Token: Provide Cluster Server URL, Kubernetes Username, and Auth Token.

  • File Upload: Upload the cluster config key file.

Cluster Server URL

Enter the API server URL of the cluster.

Kubernetes Username

Enter the username of the cluster.

Auth Token

Enter the authentication token for the cluster.

Cluster Config Key File

Upload the configuration file for cluster authentication.

Add Configuration

Additional properties can be added using this option as key-value pairs.

After entering all the details, click on the TEST button.

If the connection service identification and authentication details are provided correctly, a success message stating “connection available” is generated.

Click on the CREATE button to save the changes.

If the details are incorrect or the server is down, you will get a message “Connection unavailable”.

If you have any feedback on Gathr documentation, please email us!

← NVIDIA Models Listing Page
NVIDIA NIM Processor →