Awesome Big Data
Section: Applications · Substation is a cloud native data pipeline and transformation toolkit written in Go.
ActiveScore 84
Entry
Substation
Appears in 5 awesome lists
Substation is a cloud native data pipeline and transformation toolkit written in Go.
Open github.combrexhq/substation
Found in these lists
Awesome Data Engineering
Section: Batch Processing · A cloud native data pipeline and transformation toolkit written in Go.
FreshScore 87
Awesome Pipeline
Section: Extract, transform, load (ETL) · Substation is a cloud native data pipeline and transformation toolkit written in Go.
FreshScore 86
Awesome Security
Section: Monitoring / Logging · Substation is a cloud native data pipeline and transformation toolkit written in Go.
SlowScore 70
Awesome Threat Detection and Hunting
Section: Detection, Alerting and Automation Platforms · A cloud native data pipeline and transformation toolkit for security teams.
SlowScore 61
Often listed next to it
Pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. Features 350+ connectors with always-in-sync data from SharePoint, Google Drive, S3, Kafka, PostgreSQL and more. BSL 1.1 license (becomes Apache 2.0 after 4 years).
In 8 listsDetails
Apache Spark
"a fast and general-purpose cluster computing system. It provides high-level APIs in Scala, Java, and Python that make parallel jobs easy to write, and an optimized engine that supports general computation graphs. It also supports a rich set of higher-level tools including Shark (Hive on Spark),…
In 7 listsDetails
dna-claude-analysis
Interactive personal genome analysis toolkit using Claude Code and Python. Parses raw genotyping data from consumer DNA services and analyzes SNPs across 17 categories including health risks, pharmacogenomics, ancestry, and nutrition, with a terminal-style HTML dashboard.
In 7 listsDetails
Opik
Open source engineering platform to debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. (Source Code)
In 6 listsDetails
Countly
Open source mobile & web analytics, push notifications and crash reporting platform, based on Node.js, MongoDB and Linux.
In 6 listsDetails
Bruin
Run and schedule dbt-style SQL transformations without Airflow. Adds data ingestion (50+ sources) and built-in data quality to the transformation layer. Open-source CLI or managed Bruin Cloud for teams who want dbt Cloud-like experience with ingestion included.
In 6 listsDetails
Jupyter Notebook
is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Jupyter is used widely in industries that do data cleaning and transformation, numerical simulation, statistical modeling, data visualization, data…
In 6 listsDetails