Coinbase Market Data
Coinbase websocket to market data including level 2 orderbook data.
Coinbase websocket to market data including level 2 orderbook data.
Awesome Public Real-Time Datasets and Sources
A list of publicly available datasets with real-time data maintained by the team at bytewax.io
This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.
Free >Finance/Crypto
Blockchain transactions
Provides real-time notifications about new transactions and blocks.
Yahoo Finance
wss://streamer.finance.yahoo.com/ - This is not advertised in developer documentation, but discoverable as the websocket is used to update their website.
Finnhub
Limited free usage with a premium data sources also available.
CoinCheck
a cryptocurrency API that has a WebSocket interface (in beta)
Alpaca Markets
Real-Time and historical market data via HTTP and Websocket.
SEC EDGAR
The SEC offers real-time streaming access to regulatory filings (like 10-K, 10-Q, 8-K) as well as real-time XBRL financial data via RESTful APIs and RSS feeds.
FilingFirehose
Real-time parsed SEC EDGAR filings via REST. Body-text-classified 8-Ks (catches buried cyber and officer-departure events), activist-tagged Schedule 13D/G, ATM-offering detection in S-3 / 424B5. Free public tier covers last 72h, no API key.
In 2 lists
Binance
WebSocket API that delivers real-time cryptocurrency trading data and order book updates
OANDA
HTTP based FOREX rates stream through the OANDA API.
CoinCap
Provides real-time pricing and market activity for over 1,000 cryptocurrencies
In 2 lists
Polygon.io
Provides real‑time stock market and cryptocurrency data from all US exchanges via REST and WebSocket endpoints.
FinancialData.Net
Stock market data, financial statements, insider and institutional trading data, sustainability data, earnings releases, and much more.
In 2 lists
CoinPaprika
Free cryptocurrency market data API with real-time prices, OHLCV, and tickers for 7,000+ coins. No API key required.
In 6 listsDetails
DexPaprika
Free DEX data API with real-time pool data, token prices, OHLCV, and trade history across all chains. No signup, no limits.
In 6 listsDetails
Pyth Network
Delivers financial market data across every asset class through one API.
Sharpe
Real-time crypto market data API covering funding, derivatives, arbitrage, narratives, listings, and news.
In 3 lists
Agent Gateway
Free REST API for real-time prices of 500+ crypto tokens via Hyperliquid. No API key required. Poll GET /prices for live market data.
OpenChainBench
Open benchmarks of crypto infrastructure (RPC providers, bridges, oracles, L1 finality, prediction-market data, Hyperliquid builders) refreshed every minute via a JSON feed, with daily Parquet snapshots on Hugging Face (CC-BY-4.0) archived on Zenodo. [DOI]
In 6 listsDetails
Free >Transportation
Open Rail Data
A collection of APIs that provide data relating to the UK rail network, including reference data, train timetables, and live service updates. The live data is streamed using the STOMP protocol.
GBFS New York
GBFS is the standard for bike share data with many locations around the world. Find more information here
Open Sky Flight
Data from Open Sky Api via HTTP endpoint. Supports real-time, but not streaming. Need to continually poll.
Open Glider Network
The OGN provides real-time traffic for gliders and other light aircraft. You can use an OGN client like python-ogn-client to connect to OGN servers, parse the APRS messages and push them to a broker like Kafka for streaming processing.
MTA GTFS Feed
Transit data in GTFS format for transit systems like NYC subway and Caltrain.
NY 511 live camera data
This live camera data requires some scraping to use. From this list of cameras you can then source the individual camera id and then request the timestamped image or most recent image by building the url like - https://511ny.org/map/Cctv/<image-id-goes-here>
Transport for London (TfL)
live data about the tube, buses, and more
Norwegian Coastal Administration
AIS data from vessels within the Norwegian economic zone and the protection zones off Svalbard and Jan Mayen. (https://www.kystverket.no/en/sea-transport-and-ports/ais/access-to-ais-data/)
German Traffic Data
German real-time traffic information
Swiss Traffic & Public Transport Data
Various real-time transport data from Switzerland such road traffic, status of EV charging stations, shared mobility services and live arrivals/departures of public transport
Transport for NSW API
Real‑time public transport data (buses, trains, ferries) available for New South Wales, Australia
Ireland National Transport Authority
Real-time update stream for services provided by Dublin Bus, Bus Éireann, and Go-Ahead Ireland.
Free >Information
Wikimedia SSE
Event Stream of recent changes to the wikimedia foundation pages.
Seismic Data
Seismic Portal provides a websocket interface to real-time seismic events.
Open Weather API
Current weather data available free at rate of 1 request per ~90 seconds (only first 1000 API calls per day are free).
In 2 lists
Clima Cell
Real-time weather data in a free or paid API.
NOAA Buoy Data
Real-time buoy data from NOAA
NOAA Weather Data
Live Weather Data API from NOAA
Redfin Realestate
pull up to date data from redfin unofficial API.
EPA Airnow data
Air quality data hosted by the EPA.
UK Flood Data
UK government real-time API for flood data.
ZipCheckup
Free REST API for ZIP-level environmental safety data across the US: water quality, air quality, PFAS contamination, radon, lead, flood risk, and 11 more verticals. Covers 42,000+ ZIP codes. No API key required. CC BY 4.0.
US Energy Grid Data
Real-time grid information for the US energy grid
USGS Earthquake Real-time Feed
Live seismological data feed to know about earthquakes as they happen
In 3 lists
News API
Aggregator that pulls headlines and articles from dozens of news outlets worldwide in near real time via API. It offers a free tier (with rate limits)
New York Times Newswire API
The Times Newswire API provides an up-to-the-minute stream of articles published on NYTimes.com.
GDELT 2.0 Event Database
Collection of all events happening everywhere in the world, with emotional valence estimation, realtime translations.
Free >Health
Longevity World Cup
Live public biological-age competition dataset with athlete profiles, biomarker records, proof links, placements, and crowd-age fields. Free JSON over HTTP; no API key required.
Free >IoT
ThingSpeak IoT Public Channels
Crowdsourced IoT channels of users publishing various IoT sensor data in real-time. Accessible via REST API or MQTT API.
Sensor.Community
15,000+ air quality sensors worldwide, REST API.
Free >Cybersecurity
Certstream
Certstream provides a publicly accessible real‐time feed of certificate transparency logs, delivering live updates on SSL/TLS certificate issuance as it occurs.
URLhaus
Community-driven repository for real-time malicious URL data, offering actionable threat intelligence to block phishing and malware.
In 2 lists
CISA Automated Indicator Sharing (AIS)
US government-led service that enables public and private organizations to exchange machine-readable threat indicators in real time.
Open Threat Exchange (OTX)
Community-driven threat intelligence platform that streams real-time data on malicious IPs, domains, and URL through the OTX DirectConnect API.
Shodan Streaming API
Real-time feed of devices/banners discovered on the internet. Free tier available.
GreyNoise Community API
Free IP intelligence lookups for identifying mass scanners and background noise on the internet.
Free >Development & Testing
Lenses Datagen
Open-source (Apache 2.0) synthetic streaming data generator by Lenses.io. Publishes to Kafka, Pulsar, or any target system. Ships with rich built-in datasets including sea vessel position reports (AIS), NYC taxi trips, telecom Italia network data, IoT device temperature readings, and more.
Mockingbird by Tinybird
Open-source mock streaming data generator. Pairs well with EventSim which is already listed.
SSE.dev
Public SSE test endpoint with configurable intervals. Useful for streaming pipeline testing.; https://sse.dev/test?interval=5000
Free >AI/ML
AI Detector Arena
Live leaderboard and benchmark dataset for evaluating AI-generated image detectors. Real-time rankings updated as new detectors are evaluated against 2,038 images across 17 AI generators. Data accessible via HTTP API. [DOI]
Free >Sports
World Cup 2026 Tour
Free HTTP API for current 2026 World Cup match-day fixtures, next-match polling, RSS, and calendar feeds. No API key required.
Free >Other
GitHub Events
Use the GitHub API to consume public events happening on GitHub.
EventSim
Tool to simulate event data
Formula 1 Stats & Telemetry
Python package that provides an easy-to-use API into live and historical F1 data.
In 2 lists
International Space Station Live Data
More about the project on GitHub https://github.com/ISS-Mimic/Mimic
Live Satellite Positions
N2YO.COM allows tracking of satellites through REST API with the NORAD catalog number assigned by the United States Space Command.
Hacker News
Near real-time news feed from Hacker News for tech and startup-related topics.
In 2 lists
Bluesky
Firehose is an authenticated stream of events on the protocol that underlies Bluesky, enabling efficient syncing of user updates via a WebSocket connection.
SpaceX API
Open-source REST API for SpaceX launches, rockets, capsules, landing pads.
In 2 lists
OpenF1
Free and open-source API for real-time and historical Formula 1 data, including telemetry, lap timings, race control messages, weather, pit stops, team radio, and standings
Paid >Finance/Crypto
Data Bento
Data Bento provides low-latency market data from many exchanges in several schemas. Access over Raw API, which uses a binary protocol over TCP, and our HTTP API. They also provide client libraries for Rust, Python, and C++.
IEX Trading
IEX was created in response to questionable trading practices that had become widely used across traditional exhcanges! Their API provides streaming Stock market data.
NYSE Cloud Streaming
Provides real-time access to high-quality NYSE exchange data feeds, streaming directly in the cloud using Kafka format.
Alpha Vantage Market News & Sentiment
Live market news & sentiment data from selected news outlets covering stocks, cryptocurrencies, forex, and a wide range of topics such as fiscal policy, mergers & acquisitions, IPOs, etc.
Bloomberg
The Bloomberg Market Data Feed (B-PIPE) provides consolidated, normalized market data in real time.
Paid >Cybersecurity
Kaspersky Threat Data Feeds
Kaspersky Threat Data Feeds deliver continuously updated, real‐time threat intelligence by aggregating data from diverse sources.
Bitdefender Threat Intelligence Feeds
A comprehensive suite of real-time, curated threat data streams that deliver actionable insights on malicious domains, IP addresses, URLs, file hashes, and vulnerabilities.
ANY.RUN Threat Intelligence Feeds
Near real-time feeds generated from interactive malware sandbox sessions, providing deep insights into malware behaviors and associated indicators of compromise (IoCs).
Deepinfo Data Feeds
Real-time updates on domain registrations, subdomain discoveries, and DNS changes accesible via REST-based web services.
Paid >Transportation
AIS Data
Maritime, Aviation and weather data available via Spire.
FlightAware Firehose
Real-time data feed of global aircraft ADS-B positions and flight status.
Spire Data Services
Global maritime vessel tracking, combining Satellite automatic identification systems (AIS), Terrestrial AIS, and Dynamic AIS.
Paid >Information
PurpleAir Air Quality Data
Developer API for accessing purple air sensor data.
NewsAPI
NewsAPI tracks headlines in 7 categories across over 50 countries, and at over a hundred top publications and blogs, in near real time. Free developer version with 24 delays available.
X (Twitter)
X provides a streaming interface for research or enterprise.
Xquik
REST and MCP access for X/Twitter search, profiles, followers, monitors, webhooks, and bulk extraction workflows.
In 4 listsDetails
Bing News Search API
Bing News Search API returns fresh news results from various sources in near real time
Reuters News API
Low latency news feed from Reuters
webz.io
webz.io provides API with real-time information from thousnads of news sites, blogs, and discussion forums.
Mediastack
JSON API delivering worldwide news, headlines and blog articles in real-time
Paid >Sports
Sports Livescores
Developer API of TheSportsDB that gives you access to livescores
Sportradar Sports Data
Global live data of 80 sports, 500 sport leagues and 750k events a year (free 30 day trial available)
Related lists in Big Data
See category87
Awesome Data Engineering
igorbarinov/awesome-data-engineering
A curated list of data engineering tools for software developers
84
Awesome Big Data
oxnr/awesome-bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
84
Awesome Public Datasets
awesomedata/awesome-public-datasets
A topic-centric list of HQ open datasets.
83
Awesome Ada
ohenley/awesome-ada
A curated list of awesome resources related to the Ada and SPARK programming language
80
Awesome Network Analysis
briatte/awesome-network-analysis
A curated list of awesome network analysis resources.
74
Awesome Streaming
manuzhang/awesome-streaming
a curated list of awesome streaming frameworks, applications, etc