Skip to content
Awesomelist
Type at least 2 letters

Search entries, descriptions and list names. Press Esc to close.

Arrow keys move, Enter opensFull search page

Entry

Apache NiFi

Appears in 5 awesome lists

Apache NiFi is an integrated data logistics platform for automating the movement of data between disparate systems.

Open nifi.apache.org

Found in these lists

Awesome Big Data

Section: Data Ingestion · Apache NiFi is an integrated data logistics platform for automating the movement of data between disparate systems.

ActiveScore 84

Awesome Data Engineering

Section: Stream Processing · An easy to use, powerful, and reliable system to process and distribute data.

FreshScore 87

Awesome ETL

Section: ETL Tools (GUI) · "a rich, web-based interface for designing, controlling, and monitoring a dataflow."

ActiveScore 72

Awesome Node-Based UIs

Section: Data Processing · Data routing, transformation, and system mediation logic

SlowScore 59

Awesome Pipeline

Section: Other projects · Powerful and scalable directed graphs of data routing, transformation, and system mediation logic.

FreshScore 86

Pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. Features 350+ connectors with always-in-sync data from SharePoint, Google Drive, S3, Kafka, PostgreSQL and more. BSL 1.1 license (becomes Apache 2.0 after 4 years).

In 8 listsDetails

n8n

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

In 9 listsDetails

Logstash

Ship logs from any source, parse them, get the right timestamp, index them, and search them. Logstash is a tool for managing events and logs. You can use it to collect logs, parse them, and store them for later use (like, for searching). Speaking of searching, Logstash comes with a web interface…

In 8 listsDetails

GitHub

ETL framework to build fresh context for AI agents, with incremental processing

In 6 listsDetails

Apache Pulsar

a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.

In 6 listsDetails

Apache Flink

A streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.

In 6 listsDetails

Apache Beam

Unified data processing engine supporting both batch and streaming applications. Apache Spark is one of the supported execution environments.

In 6 listsDetails

ingestr

CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including Postgres, MongoDB, Salesforce, Shopify.

In 6 listsDetails