https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/Recent content in Gen AI Powered Processors onHugo -- gohugo.ioSun, 11 Dec 2022 19:37:55 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/cuml-processor/Sun, 11 Dec 2022 21:01:49 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/cuml-processor/cuML is a suite of GPU-accelerated machine learning algorithms built on NVIDIA’s RAPIDS AI framework. It provides familiar scikit-learn-style APIs while leveraging the power of CUDA to achieve significant speedups for large datasets. cuML includes a wide range of algorithms like linear regression, k-means clustering, PCA, t-SNE, and more, all optimized for execution on NVIDIA GPUs. It is designed for data scientists and developers allowing them to scale machine learning workflows efficiently using GPUs.https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/expressionevaluator/Sun, 11 Dec 2022 21:01:49 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/expressionevaluator/Perform transformation operations on incoming dataset, e.g., replace, format, trim, uppercase, lowercase, etc. Expression Evaluator uses spark expression language for preparing transformation queries. Processor Configuration # Configure the processor by providing configuration values as detailed below. Column Name # Select the column name to be evaluated from the source data. Expression # Provide SQL expression using SparkSQL functions, that evaluates to a column. Evaluated value can be updated to an existing column or assigned to a new column.https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/expressionfilter/Sun, 11 Dec 2022 21:01:49 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/expressionfilter/Perform filtering operations on incoming dataset, e.g., equals, contains, not-null, ranges, matches, starts-with, ends-with, etc. Expression Filter uses spark expression language for constructing filter criteria. Processor Configuration # Configure the processor by providing configuration values as detailed below. Expression # Provide SQL expression using SparkSQL functions, that evaluates to true/false, e.g., sqrt(ceil(TXN_ID))>2.0 will return either true or false. Rows which satisfy the criteria, e.g. return true, will remain in stream and rest will be filtered out.https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/python-processor/Sun, 11 Dec 2022 21:01:49 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/python-processor/The Python processor allows you to perform following operations: Write custom Python Spark code for defining transformations on Spark DataFrames. Write custom Python code for processing input records at runtime. Please email to Gathr Support to enable the Python Processor. There are several Code Snippets that are available in the application and the same are explained in this topic to get you started with the Python processor. Processor Configuration # Utilize Python Virtual Environment # Enable it to use a Python virtual environment for the Python Processor.https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/scala-processor/Sun, 11 Dec 2022 21:01:49 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/scala-processor/Scala is a general-purpose programming language built on the Java virtual machine. It can interact with data that is stored in a distributed manner. Also, it can be used to process and analyze big data. The Scala processor can be used for writing custom code in Scala language. Please email to Gathr Support to enable the Scala Processor. There are several Code Snippets that are available in the application and the same are explained in this topic to get you started with the Scala processor.https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/sql/Sun, 11 Dec 2022 21:01:49 +0530https://docs.gathr.ai/gathr-unlimited/7.6.0/docs/gen-ai-in-gathr/ai-powered-processors/sql/SQL Processor allows you to run SQL queries over streaming data and registered tables. It provides a common way for accessing different data sources. For example, if you want to analyze weather data stream continuously and find the average temperature which is recorded every minute, you can use the SQL query. The output would be stream of new records showing average temperature recordings. Processor Configuration # Configure the processor parameters as explained below.