Bulk Operations

Bulk operations allow you to perform start, stop, and delete actions on multiple applications at once.

Scope of Bulk Operations

Bulk operations are supported on the following applications:

  • Data Ingestion (Apps accessible to the user in the project are available for bulk operations)

  • Advanced ETL (Apps accessible to the user in the project are available for bulk operations)

  • Template Instances (Instances accessible to the user in the project are available for bulk operations)

  • Data Assets (Data Assets accessible to the user across projects are available for bulk operations)

  • Data Validations (Validations accessible to the user in the project are available for bulk operations)

Create Bulk Operation

Steps to create a bulk operation:

  1. Navigate to Bulk Operations from Applications > Data Engineering > Bulk Operations.

  2. Click on Create Bulk Operation.

  3. Fill in the bulk operation configuration details.

  4. Select the applications to be included in the bulk operation.

  5. Click APPLY to activate the bulk operation.

Configure Bulk Operation Details

Provide the configuration details for the bulk operation:

  • Bulk Operation On: Select the application type out: Data Ingestion, Advanced ETL, Template Instances, Data Assets, Data Validations.

  • Operation Name: Enter a name for the bulk operation.

  • Action: Action to be performed on the selected applications out of Start, Stop, or Delete.

  • Description: Enter a description for the bulk operation.

Select Applications

Based on the application type selected in the bulk operation configuration, the available options will be displayed.

Select the applications to be included in the bulk operation.

Additional options available:

  • Search: Search for the applications to be included in the bulk operation.

  • Filter by Status: Filter the applications based on their status.

  • View: Filter to view all or selected applications.

  • Select Applications: Select the applications to be included in the bulk operation.

Apply Changes: Click APPLY to activate the bulk operation.

Bulk Operations Listing Page

Options available on the bulk operations listing page:

  • Create Bulk Operation: Click to create a new bulk operation.

  • Application Type Tags: Filter based on the application type.

  • Search: Search for the bulk operations by bulk operation name.

  • Filter: Filter the bulk operations by Action and Action Status.

  • Sort: Sort the bulk operations by Date Created, Status, Name, and Operation Type.

  • Refresh: Click to refresh the bulk operations listing page.

Details shown on listing page for each bulk operation:

  • Bulk Operation Name: Name of the bulk operation. A copy icon is also available to copy the bulk operation name.

  • Bulk Action Status: Status of the bulk action (Start, Stop, Delete). To know more about different type of status, click here.

  • Created on: Date and time when the bulk operation was created.

  • Created by: User who created the bulk operation.

  • Application Completion Status: Shows the nature of action performed on applications, total applications count, and hover over the colored line to view the status of applications in detail including Total Count, Queued, Submitted, Success, and Failed.

  • Description: Description of the bulk operation.

  • View Bulk Operation Details: Click the eye icon to view the bulk operation details.

Bulk Action Status

Bulk action status is the status of the bulk action (Start, Stop, Delete).

Based on the progress of the bulk action, the following statuses are shown:

  • Queued: Indicates that all applications are currently queued. When in QUEUED status, the Bulk Operation view icon is disabled.

  • Partially Submitted: Indicates that at least one application is running, while others remain queued.

  • In Progress: Indicates that all the applications are currently in progress.

  • Partially Failed: Indicates that at least one application has failed, with none in progress, queued, or submitted.

  • Failed: The bulk action has failed.

  • Partial Success: When at least one application is successful, while others are still in progress, errored, queued, or submitted.

  • Success: The bulk action has succeeded.

View Bulk Operation Details

Click on any bulk operation from the Bulk Operations Listing Page to view its details.

  • Bulk Operation Name: Name of the bulk operation. A copy icon is also available to copy the bulk operation name.

  • Refresh: Click to refresh the bulk operation details.

  • Search Applications: Search for the applications to be included in the bulk operation.

  • Filter by Status: Filter the applications based on their status (Queued, Failed, or, Success).

Information shown for each application:

  • Action Status: Status of the action (Start, Stop, Delete). The status shown are: Queued, Failed, or, Success.

  • Application Status: Status of the application. Example: STOPPED, ERROR, ACTIVE, and so on.

  • Application Name: Name of the application. Click on the application name to navigate to the application details.

    For deleted applications, the application name will be shown as NA.

  • Event Start Time: Start time of the event.

  • Error: Error message if any.

If you have any feedback on Gathr documentation, please email us!

← EMR Cluster Configuration
Python Virtual Environments →