https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/components/deltalake/Recent content in Delta Lake onHugo -- gohugo.ioSun, 11 Dec 2022 19:37:55 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/components/deltalake/deltalake-batch-channel-etl-source/Mon, 12 Dec 2022 19:50:16 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/components/deltalake/deltalake-batch-channel-etl-source/Delta Lake allows you to read data from Delta tables stored on S3, DBFS, ADLS, and GCS. It provides a structured and transactional approach to reading and processing data. In batch ETL, it’s common to extract and process historical data stored on these platforms. Schema Type # See the topic Provide Schema for ETL Source → to know how schema details can be provided for data sources. After providing schema type details, the next step is to configure the data source.https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/components/deltalake/deltalake-streaming-channel-etl-source/Mon, 12 Dec 2022 19:50:16 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/components/deltalake/deltalake-streaming-channel-etl-source/Delta Lake allows you to read data from Delta tables stored on S3, DBFS, ADLS, and GCS. It provides a structured and transactional approach to reading and processing data. In streaming ETL, real-time data can be ingested and processed, making it valuable for near real-time analytics and event-driven applications. Schema Type # See the topic Provide Schema for ETL Source → to know how schema details can be provided for data sources.https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/components/deltalake/deltalake-emitter-etl-target/Mon, 12 Dec 2022 19:50:16 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/components/deltalake/deltalake-emitter-etl-target/The Delta emitter for S3 is particularly useful when you want to write and store data processed by your ETL application into S3. It leverages Delta Lake’s transactional capabilities to ensure data consistency and reliability when storing data in S3. Target Configuration # Configure the target parameters that are explained below. Emitter Type # Select a target for writing the delta files. Options are S3, DBFS, ADLS, or GCS. Connection Name # Provide connection details for S3, DBFS, ADLS, or GCS based on the chosen source.