RabbitMQ ETL Source

RabbitMQ Data Source reads messages from the RabbitMQ cluster using its exchanges and queues.

Schema Type #

See the topic Provide Schema for ETL Source → to know how schema details can be provided for data sources.

After providing schema type details, the next step is to configure the data source.

Data Source Configuration #

Configure the data source parameters as explained below.

Connection Name #

Connections are the service identifiers. A connection name can be selected from the list if you have created and saved connection details for RabbitMQ earlier. Or create one as explained in the topic - RabbitMQ Connection →

Use the Test Connection option to ensure that the connection with the RabbitMQ channel is established successfully.

A success message states that the connection is available. In case of any error in test connection, edit the connection to resolve the issue before proceeding further.

Exchange Name #

RabbitMQ producers can only send messages to an exchange. The exchange pushes messages to queues from where consumers can read the message.

Exchange Type #

Defines the functionality of the exchange i.e., how messages are routed through it.

Exchange types: DIRECT, TOPIC and FANOUT.

Exchange Durable #

Durable exchanges remain active when a server restarts. Non-durable exchanges (transient exchanges) are purged when a server restarts.

Exchange Auto Delete #

If you set this to True, the exchange is deleted when all queues finish using it.

Routing Key #

Identifies a key for redirecting messages to a specific topic.

Queue Name #

Name of the queue where data will be published.

Queue Durable #

Durable queues remain active when a server restarts. Non-durable queues (transient queues) are purged if/when a server restarts.

Queue Auto Delete #

If set, the queue is deleted when all the consumers finish using it.

Add Configuration: Additional properties can be added using this option as key-value pairs to configure additional custom RabbitMQ properties.

Detect Schema #

Check the populated schema details. For more details, see Schema Preview →

Notes #

Optionally, enter notes in the Notes → tab and save the configuration.