Awesome Big Data
Section: Data Ingestion · a tool for managing events and logs.
Entry
Appears in 8 awesome lists
Ship logs from any source, parse them, get the right timestamp, index them, and search them. Logstash is a tool for managing events and logs. You can use it to collect logs, parse them, and store them for later use (like, for searching). Speaking of searching, Logstash comes with a web interface…
Section: Data Ingestion · a tool for managing events and logs.
Section: Elastic Stack · is a data pipeline that helps you process logs and other event data from a variety of systems
Section: Continuous Monitoring
Section: Databases · is a tool for managing events and logs. When used generically, the term encompasses a larger system of log collection, processing, storage and searching activities.
Section: Log Monitoring · Ship logs from any source, parse them, get the right timestamp, index them, and search them. Logstash is a tool for managing events and logs. You can use it to collect logs, parse them, and store them for later use (like, for searching). Speaking of searching, Logstash comes with a web interface…
Section: SQL/NoSQL Tools and Databases · is a tool for managing events and logs. When used generically, the term encompasses a larger system of log collection, processing, storage and searching activities.
Section: 6. Useful libraries · Tool for managing log files. License: Apache 2.
Section: Observability & Monitoring · Collect, parse, transform logs.
is a free software application used for event monitoring and alerting. It records real-time metrics in a time series database (allowing for high dimensionality) built using a HTTP pull model, with flexible queries and real-time alerting.
is an analytics platform that enables you to query and visualize data, then create and share dashboards based on your visualizations. Easily visualize metrics, logs, and traces from multiple sources such as Prometheus, Loki, Elasticsearch, InfluxDB, Postgres, Fluentd, Fluentbit, Logstash and many…
fast, resource-effective and scalable open source time series database. May be used as long-term remote storage for Prometheus. Supports PromQL.
is a search engine based on the Lucene library. It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents. Elasticsearch is developed in Java.
Datadog is a monitoring service for IT, Operations and Development teams who write and run applications at scale, and want to turn the massive amounts of data produced by their apps, tools and services into actionable insight.
Listen for pings and sends alerts when pings are late. (Source Code) BSD-3-Clause Python/Docker
a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.