Skip to content
71

Awesome Python Data Science

Probably the best curated list of data science software in Python.

3.6k stars463 forks378 entriesLast push Apr 13, 2026 (5 months ago)License CC-BY-4.0

This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.

Machine Learning >General Purpose Machine Learning

SciPy

Fundamental algorithms for scientific computing in Python

In 7 listsDetails

scikit-learn

Machine learning in Python.

In 5 listsDetails

PyCaret

An open-source, low-code machine learning library in Python.

In 5 listsDetails

Shogun

Machine learning toolbox.

In 4 listsDetails

xLearn

High Performance, Easy-to-use, and Scalable Machine Learning Package.

In 3 lists

cuML

RAPIDS Machine Learning Library.

In 7 listsDetails

modAL

Modular active learning framework for Python3.

Sparkit-learn

PySpark + scikit-learn = Sparkit-learn.

In 2 lists

mlpack

A scalable C++ machine learning library (Python bindings).

In 6 listsDetails

dlib

Toolkit for making real-world machine learning and data analysis applications in C++ (Python bindings).

In 7 listsDetails

MLxtend

Extension and helper modules for Python's data analysis and machine learning libraries.

In 4 listsDetails

hyperlearn

50%+ Faster, 50%+ less RAM usage, GPU support re-written Sklearn, Statsmodels.

In 2 lists

Reproducible Experiment Platform (REP)

Machine Learning toolbox for Humans.

In 2 lists

scikit-multilearn

Multi-label classification for python.

In 3 lists

seqlearn

Sequence classification toolkit for Python.

In 2 lists

pystruct

Simple structured learning framework for Python.

In 2 lists

sklearn-expertsys

Highly interpretable classifiers for scikit learn.

In 2 lists

RuleFit

Implementation of the rulefit.

In 2 lists

metric-learn

Metric learning algorithms in Python.

pyGAM

Generalized Additive Models in Python.

In 3 lists

causalml

Uplift modeling and causal inference with machine learning algorithms.

In 2 lists

Machine Learning >Gradient Boosting

XGBoost

Scalable, Portable, and Distributed Gradient Boosting.

In 11 listsDetails

LightGBM

A fast, distributed, high-performance gradient boosting.

In 8 listsDetails

CatBoost

An open-source gradient boosting on decision trees library.

In 10 listsDetails

ThunderGBM

Fast GBDTs and Random Forests on GPUs.

In 2 lists

NGBoost

Natural Gradient Boosting for Probabilistic Prediction.

TensorFlow Decision Forests

A collection of state-of-the-art algorithms for the training, serving and interpretation of Decision Forest models in Keras.

Machine Learning >Ensemble Methods

ML-Ensemble

High performance ensemble learning.

Stacking

Simple and useful stacking library written in Python.

stacked_generalization

Library for machine learning stacking generalization.

In 2 lists

vecstack

Python package for stacking (machine learning technique).

Machine Learning >Imbalanced Datasets

imbalanced-learn

Module to perform under-sampling and over-sampling with various techniques.

In 4 lists

imbalanced-algorithms

Python-based implementations of algorithms for learning on imbalanced data.

In 2 lists

Machine Learning >Kernel Methods

pyFM

Factorization machines in python.

fastFM

A library for Factorization Machines.

tffm

TensorFlow implementation of an arbitrary order Factorization Machine.

liquidSVM

An implementation of SVMs.

scikit-rvm

Relevance Vector Machine implementation using the scikit-learn API.

ThunderSVM

A fast SVM Library on GPUs and CPUs.

In 2 lists

Deep Learning >PyTorch

PyTorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration.

In 16 listsDetails

pytorch-lightning

PyTorch Lightning is just organized PyTorch.

In 3 lists

ignite

High-level library to help with training neural networks in PyTorch.

In 7 listsDetails

skorch

A scikit-learn compatible neural network library that wraps PyTorch.

In 2 lists

Catalyst

High-level utils for PyTorch DL & RL research.

In 6 listsDetails

ChemicalX

A PyTorch-based deep learning library for drug pair scoring.

In 3 lists

Deep Learning >TensorFlow

TensorFlow

Computation using data flow graphs for scalable machine learning by Google.

In 23 listsDetails

TensorLayer

Deep Learning and Reinforcement Learning Library for Researcher and Engineer.

In 3 lists

TFLearn

Deep learning library featuring a higher-level API for TensorFlow.

In 5 listsDetails

Sonnet

TensorFlow-based neural network library.

In 6 listsDetails

tensorpack

A Neural Net Training Interface on TensorFlow.

In 4 lists

tfdeploy

Deploy TensorFlow graphs for fast evaluation and export to TensorFlow-less environments running numpy.

In 2 lists

tensorflow-upstream

TensorFlow ROCm port.

In 2 lists

TensorFlow Fold

Deep learning with dynamic computation graphs in TensorFlow.

In 2 lists

TensorLight

A high-level framework for TensorFlow.

In 2 lists

Mesh TensorFlow

Model Parallelism Made Easier.

In 2 lists

Ludwig

A toolbox that allows one to train and test deep learning models without the need to write code.

In 3 lists

Deep Learning >JAX

JAX

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more.

In 6 listsDetails

FLAX

A neural network library for JAX that is designed for flexibility.

In 5 listsDetails

Optax

A gradient processing and optimization library for JAX.

Deep Learning >Keras

Keras

A high-level neural networks API running on top of TensorFlow.

In 8 listsDetails

keras-contrib

Keras community contributions.

In 2 lists

Hyperas

Keras + Hyperopt: A straightforward wrapper for a convenient hyperparameter.

In 4 listsDetails

Elephas

Distributed Deep learning with Keras & Spark.

In 3 lists

qkeras

A quantization deep learning library.

In 2 lists

Deep Learning >Others

transformers

State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

In 14 listsDetails

Tangent

Source-to-Source Debuggable Derivatives in Pure Python.

In 2 lists

autograd

Efficiently computes derivatives of numpy code.

In 2 lists

Caffe

A fast open framework for deep learning.

In 10 listsDetails

nnabla

Neural Network Libraries by Sony.

Automated Machine Learning

auto-sklearn

An AutoML toolkit and a drop-in replacement for a scikit-learn estimator.

In 4 listsDetails

Auto-PyTorch

Automatic architecture search and hyperparameter optimization for PyTorch.

In 4 lists

AutoKeras

AutoML library for deep learning.

In 5 listsDetails

AutoGluon

AutoML for Image, Text, Tabular, Time-Series, and MultiModal Data.

In 5 listsDetails

TPOT

AutoML tool that optimizes machine learning pipelines using genetic programming.

MLBox

A powerful Automated Machine Learning python library.

In 2 lists

Natural Language Processing

torchtext

Data loaders and abstractions for text and NLP.

In 4 listsDetails

KerasNLP

Modular Natural Language Processing workflows with Keras.

spaCy

Industrial-Strength Natural Language Processing.

In 6 listsDetails

NLTK

Modules, data sets, and tutorials supporting research and development in Natural Language Processing.

In 3 lists

CLTK

The Classical Language Toolkik.

In 2 lists

gensim

Topic Modelling for Humans.

In 3 lists

pyMorfologik

Python binding for Morfologik.

skift

Scikit-learn wrappers for Python fastText.

Phonemizer

Simple text-to-phonemes converter for multiple languages.

flair

Very simple framework for state-of-the-art NLP.

In 4 listsDetails

Computer Audition

torchaudio

An audio library for PyTorch.

In 6 listsDetails

librosa

Python library for audio and music analysis.

In 5 listsDetails

Yaafe

Audio features extraction.

In 2 lists

aubio

A library for audio and music analysis.

In 6 listsDetails

Essentia

Library for audio and music analysis, description, and synthesis.

In 3 lists

LibXtract

A simple, portable, lightweight library of audio feature extraction functions.

In 2 lists

Marsyas

Music Analysis, Retrieval, and Synthesis for Audio Signals.

muda

A library for augmenting annotated audio data.

madmom

Python audio and music signal processing library.

Computer Vision

torchvision

Datasets, Transforms, and Models specific to Computer Vision.

In 9 listsDetails

PyTorch3D

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data.

In 5 listsDetails

KerasCV

Industry-strength Computer Vision workflows with Keras.

In 2 lists

OpenCV

Open Source Computer Vision Library.

In 5 listsDetails

Decord

An efficient video loader for deep learning with smart shuffling that's super easy to digest.

In 2 lists

MMEngine

OpenMMLab Foundational Library for Training Deep Learning Models.

scikit-image

Image Processing SciKit (Toolbox for SciPy).

In 6 listsDetails

imgaug

Image augmentation for machine learning experiments.

In 4 lists

imgaug_extension

Additional augmentations for imgaug.

Augmentor

Image augmentation library in Python for machine learning.

In 4 listsDetails

albumentations

Fast image augmentation library and easy-to-use wrapper around other libraries.

In 4 listsDetails

LAVIS

A One-stop Library for Language-Vision Intelligence.

In 4 listsDetails

Time Series

sktime

A unified framework for machine learning with time series.

In 4 listsDetails

skforecast

Time series forecasting with machine learning models

darts

A python library for easy manipulation and forecasting of time series.

In 6 listsDetails

statsforecast

Lightning fast forecasting with statistical and econometric models.

In 3 lists

mlforecast

Scalable machine learning-based time series forecasting.

In 3 lists

neuralforecast

Scalable machine learning-based time series forecasting.

tslearn

Machine learning toolkit dedicated to time-series data.

tick

Module for statistical learning, with a particular emphasis on time-dependent modeling.

greykite

A flexible, intuitive, and fast forecasting library next.

Prophet

Automatic Forecasting Procedure.

In 6 listsDetails

PyFlux

Open source time series library for Python.

In 3 lists

bayesloop

Probabilistic programming framework that facilitates objective model selection for time-varying parameter models.

luminol

Anomaly Detection and Correlation library.

dateutil

Powerful extensions to the standard datetime module

maya

makes it very easy to parse a string and for changing timezones

Chaos Genius

ML powered analytics engine for outlier/anomaly detection and root cause analysis

In 5 listsDetails

Reinforcement Learning

Gymnasium

An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym).

In 6 listsDetails

PettingZoo

An API standard for multi-agent reinforcement learning environments, with popular reference environments and related utilities.

In 2 lists

MAgent2

An engine for high performance multi-agent environments with very large numbers of agents, along with a set of reference environments.

Stable Baselines3

A set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines.

In 8 listsDetails

Shimmy

An API conversion tool for popular external reinforcement learning environments.

EnvPool

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.

In 2 lists

RLlib

Scalable Reinforcement Learning.

Tianshou

An elegant PyTorch deep reinforcement learning library.

In 3 lists

Acme

A library of reinforcement learning components and agents.

In 2 lists

Catalyst-RL

PyTorch framework for RL research.

d3rlpy

An offline deep reinforcement learning library.

In 3 lists

DI-engine

OpenDILab Decision AI Engine.

In 3 lists

TF-Agents

A library for Reinforcement Learning in TensorFlow.

In 4 listsDetails

TensorForce

A TensorFlow library for applied reinforcement learning.

In 4 lists

TRFL

TensorFlow Reinforcement Learning.

In 2 lists

Dopamine

A research framework for fast prototyping of reinforcement learning algorithms.

In 3 lists

keras-rl

Deep Reinforcement Learning for Keras.

In 2 lists

garage

A toolkit for reproducible reinforcement learning research.

In 3 lists

Horizon

A platform for Applied Reinforcement Learning.

rlpyt

Reinforcement Learning in PyTorch.

In 2 lists

cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG).

In 4 listsDetails

Machin

A reinforcement library designed for pytorch.

SKRL

Modular reinforcement learning library (on PyTorch and JAX) with support for NVIDIA Isaac Gym, Isaac Orbit and Omniverse Isaac Gym.

In 4 listsDetails

Imitation

Clean PyTorch implementations of imitation and reward learning algorithms.

Graph Machine Learning

pytorch_geometric

Geometric Deep Learning Extension Library for PyTorch.

In 4 listsDetails

pytorch_geometric_temporal

Temporal Extension Library for PyTorch Geometric.

In 5 listsDetails

PyTorch Geometric Signed Directed

A signed/directed graph neural network extension library for PyTorch Geometric.

In 2 lists

dgl

Python package built to ease deep learning on graph, on top of existing DL frameworks.

In 5 listsDetails

GRAPE

GRAPE is a Rust/Python Graph Representation Learning library for Predictions and Evaluations

Spektral

Deep learning on graphs.

In 2 lists

StellarGraph

Machine Learning on Graphs.

In 3 lists

Graph Nets

Build Graph Nets in Tensorflow.

TensorFlow GNN

A library to build Graph Neural Networks on the TensorFlow platform.

Auto Graph Learning

An autoML framework & toolkit for machine learning on graphs.

In 2 lists

PyTorch-BigGraph

Generate embeddings from large-scale graph-structured data.

Karate Club

An unsupervised machine learning library for graph-structured data.

In 7 listsDetails

Little Ball of Fur

A library for sampling graph structured data.

In 5 listsDetails

GreatX

A graph reliability toolbox based on PyTorch and PyTorch Geometric (PyG).

Jraph

A Graph Neural Network Library in Jax.

TRL

Train transformer language models with reinforcement learning.

In 8 listsDetails

Cleora

The Graph Embedding Engine.

Graph Manipulation

Networkx

Network Analysis in Python.

In 6 listsDetails

Rustworkx

A high performance Python graph library implemented in Rust.

In 4 listsDetails

graph-tool

an efficient Python module for manipulation and statistical analysis of graphs (a.k.a. networks).

igraph

Python interface for igraph.

Learning-to-Rank & Recommender Systems

LightFM

A Python implementation of LightFM, a hybrid recommendation algorithm.

In 2 lists

Spotlight

Deep recommender models using PyTorch.

Surprise

A Python scikit for building and analyzing recommender systems.

In 3 lists

RecBole

A unified, comprehensive and efficient recommendation library.

allRank

allRank is a framework for training learning-to-rank neural models based on PyTorch.

TensorFlow Recommenders

A library for building recommender system models using TensorFlow.

TensorFlow Ranking

Learning to Rank in TensorFlow.

Probabilistic Graphical Models

pomegranate

Probabilistic and graphical models for Python.

In 4 listsDetails

pgmpy

A python library for working with Probabilistic Graphical Models.

In 5 listsDetails

pyAgrum

A GRaphical Universal Modeler.

Probabilistic Methods

pyro

A flexible, scalable deep probabilistic programming library built on PyTorch.

In 2 lists

PyMC

Bayesian Stochastic Modelling in Python.

In 10 listsDetails

ZhuSuan

Bayesian Deep Learning.

GPflow

Gaussian processes in TensorFlow.

InferPy

Deep Probabilistic Modelling Made Easy.

PyStan

Bayesian inference using the No-U-Turn sampler (Python interface).

In 2 lists

sklearn-bayes

Python package for Bayesian Machine Learning with scikit-learn API.

In 3 lists

skpro

Supervised domain-agnostic prediction framework for probabilistic modelling by The Alan Turing Institute.

PyVarInf

Bayesian Deep Learning methods with Variational Inference for PyTorch.

In 3 lists

emcee

The Python ensemble sampling toolkit for affine-invariant MCMC.

In 2 lists

hsmmlearn

A library for hidden semi-Markov models with explicit durations.

pyhsmm

Bayesian inference in HSMMs and HMMs.

In 2 lists

GPyTorch

A highly efficient and modular implementation of Gaussian Processes in PyTorch.

In 3 lists

sklearn-crfsuite

A scikit-learn-inspired API for CRFsuite.

In 2 lists

Model Explanation

dalex

moDel Agnostic Language for Exploration and explanation.

Shapley

A data-driven framework to quantify the value of classifiers in a machine learning ensemble.

In 4 listsDetails

Alibi

Algorithms for monitoring and explaining machine learning models.

In 3 lists

anchor

Code for "High-Precision Model-Agnostic Explanations" paper.

aequitas

Bias and Fairness Audit Toolkit.

In 2 lists

Contrastive Explanation

Contrastive Explanation (Foil Trees).

yellowbrick

Visual analysis and diagnostic tools to facilitate machine learning model selection.

In 5 listsDetails

scikit-plot

An intuitive library to add plotting functionality to scikit-learn objects.

In 2 lists

shap

A unified approach to explain the output of any machine learning model.

In 4 listsDetails

InterpretML

InterpretML implements the Explainable Boosting Machine (EBM), a modern, fully interpretable machine learning model based on Generalized Additive Models (GAMs). This open-source package also provides visualization tools for EBMs, other glass-box models, and black-box explanations.

In 8 listsDetails

ELI5

A library for debugging/inspecting machine learning classifiers and explaining their predictions.

In 2 lists

Lime

Explaining the predictions of any machine learning classifier.

In 5 listsDetails

FairML

FairML is a python toolbox auditing the machine learning models for bias.

L2X

Code for replicating the experiments in the paper Learning to Explain: An Information-Theoretic Perspective on Model Interpretation.

PDPbox

Partial dependence plot toolbox.

PyCEbox

Python Individual Conditional Expectation Plot Toolbox.

Skater

Python Library for Model Interpretation.

model-analysis

Model analysis tools for TensorFlow.

In 2 lists

themis-ml

A library that implements fairness-aware machine learning algorithms.

treeinterpreter

Interpreting scikit-learn's decision tree and random forest predictions.

AI Explainability 360

Interpretability and explainability of data and machine learning models.

Auralisation

Auralisation of learned features in CNN (for audio).

CapsNet-Visualization

A visualization of the CapsNet layers to better understand how it works.

lucid

A collection of infrastructure and tools for research in neural network interpretability.

In 2 lists

Netron

Visualizer for deep learning and machine learning models (no Python code, but visualizes models from most Python Deep Learning frameworks).

In 15 listsDetails

FlashLight

Visualization Tool for your NeuralNetwork.

tensorboard-pytorch

Tensorboard for PyTorch (and chainer, mxnet, numpy, ...).

In 2 lists

Genetic Programming

gplearn

Genetic Programming in Python.

In 2 lists

PyGAD

Genetic Algorithm in Python.

DEAP

Distributed Evolutionary Algorithms in Python.

In 7 listsDetails

karoo_gp

A Genetic Programming platform for Python with GPU support.

monkeys

A strongly-typed genetic programming framework for Python.

sklearn-genetic

Genetic feature selection module for scikit-learn.

Optimization

Optuna

A hyperparameter optimization framework.

In 8 listsDetails

pymoo

Multi-objective Optimization in Python.

pycma

Python implementation of CMA-ES.

Spearmint

Bayesian optimization.

In 3 lists

BoTorch

Bayesian optimization in PyTorch.

In 2 lists

scikit-opt

Heuristic Algorithms for optimization.

In 3 lists

sklearn-genetic-opt

Hyperparameters tuning and feature selection using evolutionary algorithms.

In 2 lists

SMAC3

Sequential Model-based Algorithm Configuration.

Optunity

Is a library containing various optimizers for hyperparameter tuning.

hyperopt

Distributed Asynchronous Hyperparameter Optimization in Python.

In 4 lists

hyperopt-sklearn

Hyper-parameter optimization for sklearn.

In 2 lists

sklearn-deap

Use evolutionary algorithms instead of gridsearch in scikit-learn.

In 2 lists

sigopt_sklearn

SigOpt wrappers for scikit-learn methods.

Bayesian Optimization

A Python implementation of global optimization with gaussian processes.

SafeOpt

Safe Bayesian Optimization.

scikit-optimize

Sequential model-based optimization with a scipy.optimize interface.

In 3 lists

Solid

A comprehensive gradient-free optimization framework written in Python.

PySwarms

A research toolkit for particle swarm optimization in Python.

Platypus

A Free and Open Source Python Library for Multiobjective Optimization.

GPflowOpt

Bayesian Optimization using GPflow.

POT

Python Optimal Transport library.

Talos

Hyperparameter Optimization for Keras Models.

In 3 lists

nlopt

Library for nonlinear optimization (global and local, constrained or unconstrained).

OR-Tools

An open-source software suite for optimization by Google; provides a unified programming interface to a half dozen solvers: SCIP, GLPK, GLOP, CP-SAT, CPLEX, and Gurobi.

Feature Engineering >General

Featuretools

Automated feature engineering.

In 3 lists

Feature Engine

Feature engineering package with sklearn-like functionality.

In 7 listsDetails

OpenFE

Automated feature generation with expert-level performance.

skl-groups

A scikit-learn addon to operate on set/"group"-based features.

Feature Forge

A set of tools for creating and testing machine learning features.

In 2 lists

few

A feature engineering wrapper for sklearn.

scikit-mdr

A sklearn-compatible Python implementation of Multifactor Dimensionality Reduction (MDR) for feature construction.

tsfresh

Automatic extraction of relevant features from time series.

In 7 listsDetails

dirty_cat

Machine learning on dirty tabular data (especially: string-based variables for classifcation and regression).

NitroFE

Moving window features.

sk-transformer

A collection of various pandas & scikit-learn compatible transformers for all kinds of preprocessing and feature engineering steps

tubular

Collection of scikit-learn compatible transformers written in narwhals, which can accept either polars/pandas inputs and utilise the chosen library under the hood.

In 2 lists

Feature Engineering >Feature Selection

scikit-feature

Feature selection repository in Python.

In 2 lists

boruta_py

Implementations of the Boruta all-relevant feature selection method.

BoostARoota

A fast xgboost feature selection algorithm.

scikit-rebate

A scikit-learn-compatible Python implementation of ReBATE, a suite of Relief-based feature selection algorithms for Machine Learning.

In 2 lists

zoofs

A feature selection library based on evolutionary algorithms.

Visualization >General Purposes

Matplotlib

Plotting with Python.

In 7 listsDetails

seaborn

Statistical data visualization using matplotlib.

In 5 listsDetails

prettyplotlib

Painlessly create beautiful matplotlib plots.

python-ternary

Ternary plotting library for Python with matplotlib.

missingno

Missing data visualization module for Python.

In 4 lists

chartify

Python library that makes it easy for data scientists to create charts.

In 3 lists

physt

Improved histograms.

Visualization >Interactive plots

animatplot

A python package for animating plots built on matplotlib.

plotly

A Python library that makes interactive and publication-quality graphs.

In 3 lists

Bokeh

Interactive Web Plotting for Python.

In 7 listsDetails

Altair

Declarative statistical visualization library for Python. Can easily do many data transformation within the code to create graph

In 3 lists

bqplot

Plotting library for IPython/Jupyter notebooks

In 2 lists

pyecharts

Migrated from Echarts, a charting and visualization library, to Python's interactive visual drawing library.

In 4 listsDetails

Visualization >Map

folium

Makes it easy to visualize data on an interactive open street map

geemap

Python package for interactive mapping with Google Earth Engine (GEE)

In 4 listsDetails

Visualization >Automatic Plotting

HoloViews

Stop plotting your data - annotate your data and let it visualize itself.

AutoViz

Visualize data automatically with 1 line of code (ideal for machine learning)

In 4 listsDetails

SweetViz

Visualize and compare datasets, target values and associations, with one line of code.

In 4 listsDetails

Visualization >NLP

pyLDAvis

Visualize interactive topic model

Deployment

fastapi

Modern, fast (high-performance), a web framework for building APIs with Python

In 6 listsDetails

streamlit

Make it easy to deploy the machine learning model

In 2 lists

streamsync

No-code in the front, Python in the back. An open-source framework for creating data apps.

gradio

Create UIs for your machine learning model in Python in 3 minutes.

In 11 listsDetails

Vizro

A toolkit for creating modular data visualization applications.

In 2 lists

datapane

A collection of APIs to turn scripts and notebooks into interactive reports.

binder

Enable sharing and execute Jupyter Notebooks

In 4 lists

Deepnote

Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnote cloud for real-time collaboration, Deepnote agent, and deployable data apps.

In 6 listsDetails

Statistics

pandas_summary

Extension to pandas dataframes describe function.

Pandas Profiling

Create HTML profiling reports from pandas DataFrame objects.

In 2 lists

statsmodels

Statistical modeling and econometrics in Python.

In 7 listsDetails

stockstats

Supply a wrapper StockDataFrame based on the pandas.DataFrame with inline stock statistics/indicators support.

weightedcalcs

A pandas-based utility to calculate weighted means, medians, distributions, standard deviations, and more.

scikit-posthocs

Pairwise Multiple Comparisons Post-hoc Tests.

In 3 lists

Alphalens

Performance analysis of predictive (alpha) stock factors.

In 3 lists

Data Manipulation >Data Frames

pandas

Powerful Python data analysis toolkit.

polars

A fast multi-threaded, hybrid-out-of-core DataFrame library.

In 10 listsDetails

Arctic

High-performance datastore for time series and tick data.

datatable

Data.table for Python.

In 2 lists

Pandas Profiling

Create HTML profiling reports from pandas DataFrame objects.

In 2 lists

cuDF

GPU DataFrame Library.

In 5 listsDetails

blaze

NumPy and pandas interface to Big Data.

In 2 lists

pandasql

Allows you to query pandas DataFrames using SQL syntax.

pandas-gbq

pandas Google Big Query.

xpandas

Universal 1d/2d data containers with Transformers .functionality for data analysis by The Alan Turing Institute.

pysparkling

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

modin

Speed up your pandas workflows by changing a single line of code.

In 8 listsDetails

swifter

A package that efficiently applies any function to a pandas dataframe or series in the fastest available manner.

pandas-log

A package that allows providing feedback about basic pandas operations and finds both business logic and performance issues.

In 2 lists

vaex

Out-of-Core DataFrames for Python, ML, visualize and explore big tabular data at a billion rows per second.

In 9 listsDetails

xarray

Xarray combines the best features of NumPy and pandas for multidimensional data selection by supplementing numerical axis labels with named dimensions for more intuitive, concise, and less error-prone indexing routines.

In 4 listsDetails

Data Manipulation >Pipelines

pdpipe

Sasy pipelines for pandas DataFrames.

SSPipe

Python pipe (|) operator with support for DataFrames and Numpy, and Pytorch.

pandas-ply

Functional data manipulation for pandas.

Dplython

Dplyr for Python.

sklearn-pandas

pandas integration with sklearn.

In 2 lists

Dataset

Helps you conveniently work with random or sequential batches of your data and define data processing.

pyjanitor

Clean APIs for data cleaning.

meza

A Python toolkit for processing tabular data.

Prodmodel

Build system for data science pipelines.

In 4 listsDetails

dopanda

Hints and tips for using pandas in an analysis environment.

Hamilton

A microframework for dataframe generation that applies Directed Acyclic Graphs specified by a flow of lazily evaluated Python functions.

In 10 listsDetails

Data Manipulation >Data-centric AI

cleanlab

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

In 8 listsDetails

snorkel

A system for quickly generating training data with weak supervision.

In 6 listsDetails

dataprep

Collect, clean, and visualize your data in Python with a few lines of code.

In 2 lists

Data Manipulation >Synthetic Data

ydata-synthetic

A package to generate synthetic tabular and time-series data leveraging the state-of-the-art generative models.

In 2 lists

Distributed Computing

Horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

PySpark

Exposes the Spark programming model to Python.

Veles

Distributed machine learning platform.

In 4 listsDetails

Jubatus

Framework and Library for Distributed Online Machine Learning.

DMTK

Microsoft Distributed Machine Learning Toolkit.

In 2 lists

PaddlePaddle

PArallel Distributed Deep LEarning.

In 6 listsDetails

dask-ml

Distributed and parallel machine learning.

Distributed

Distributed computation in Python.

Experimentation

mlflow

Open source platform for the machine learning lifecycle.

In 7 listsDetails

Neptune

A lightweight ML experiment tracking, results visualization, and management tool.

In 6 listsDetails

dvc

Data Version Control | Git for Data & Models | ML Experiments Management.

In 8 listsDetails

envd

🏕️ machine learning development environment for data science and AI/ML engineering teams.

In 5 listsDetails

Sacred

A tool to help you configure, organize, log, and reproduce experiments.

In 6 listsDetails

Ax

Adaptive Experimentation Platform.

In 3 lists

Data Validation

great_expectations

Always know what to expect from your data.

In 5 listsDetails

pandera

A lightweight, flexible, and expressive statistical data testing library.

In 4 listsDetails

deepchecks

Validation & testing of ML models and data during model development, deployment, and production.

In 8 listsDetails

evidently

Evaluate and monitor ML models from validation to production.

In 8 listsDetails

TensorFlow Data Validation

Library for exploring and validating machine learning data.

In 4 listsDetails

DataComPy

A library to compare Pandas, Polars, and Spark data frames. It provides stats and lets users adjust for match accuracy.

In 4 listsDetails

Evaluation

recmetrics

Library of useful metrics and plots for evaluating recommender systems.

Metrics

Machine learning evaluation metric.

sklearn-evaluation

Model evaluation made easy: plots, tables, and markdown reports.

In 2 lists

AI Fairness 360

Fairness metrics for datasets and ML models, explanations, and algorithms to mitigate bias in datasets and models.

alibi-detect

Algorithms for outlier, adversarial and drift detection.

In 6 listsDetails

Computations

NumPy

The fundamental package for scientific computing with Python

In 7 listsDetails

Dask

Parallel computing with task scheduling.

In 11 listsDetails

bottleneck

Fast NumPy array functions written in C.

CuPy

NumPy-like API accelerated with CUDA.

In 8 listsDetails

scikit-tensor

Python library for multilinear algebra and tensor factorizations.

numdifftools

Solve automatic numerical differentiation problems in one or more variables.

quaternion

Add built-in support for quaternions to numpy.

adaptive

Tools for adaptive and parallel samping of mathematical functions.

NumExpr

A fast numerical expression evaluator for NumPy that comes with an integrated computing virtual machine to speed calculations up by avoiding memory allocation for intermediate results.

In 3 lists

Web Scraping

BeautifulSoup

The easiest library to scrape static websites for beginners

In 3 lists

Scrapy

Fast and extensible scraping library. Can write rules and create customized scraper without touching the core

In 5 listsDetails

Selenium

Use Selenium Python API to access all functionalities of Selenium WebDriver in an intuitive way like a real user.

Pattern

High level scraping for well-establish websites such as Google, Twitter, and Wikipedia. Also has NLP, machine learning algorithms, and visualization

In 3 lists

twitterscraper

Efficient library to scrape Twitter

Spatial Analysis

GeoPandas

Python tools for geographic data.

In 7 listsDetails

PySal

Python Spatial Analysis Library.

In 2 lists

Quantum Computing

qiskit

Qiskit is an open-source SDK for working with quantum computers at the level of circuits, algorithms, and application modules.

In 4 listsDetails

cirq

A python framework for creating, editing, and invoking Noisy Intermediate Scale Quantum (NISQ) circuits.

In 4 listsDetails

PennyLane

Quantum machine learning, automatic differentiation, and optimization of hybrid quantum-classical computations.

In 2 lists

QML

A Python Toolkit for Quantum Machine Learning.

In 2 lists

Conversion

sklearn-porter

Transpile trained scikit-learn estimators to C, Java, JavaScript, and others.

ONNX

Open Neural Network Exchange.

In 6 listsDetails

MMdnn

A set of tools to help users inter-operate among different deep learning frameworks.

In 2 lists

treelite

Universal model exchange and serialization format for decision tree forests.

See category
94

Awesome Rust

rust-unofficial/awesome-rust

A curated list of Rust code and resources.

Fresh★ 60k1833 entriesPushed today
94

Awesome Mac

jaywcjlove/awesome-mac

 This project is dedicated to collecting high-quality macOS software and organizing them systematically by different categories for easy search and use.

Fresh★ 115k1316 entriesPushed today
94

Awesome Python

vinta/awesome-python

The definitive list that answers "I want to do X in Python, which tool should I use?"

Fresh★ 324k504 entriesPushed today
94

Awesome C++

fffaraz/awesome-cpp

A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.

Fresh★ 74k1358 entriesPushed yesterday
94

Awesome Go

avelino/awesome-go

A curated list of awesome Go frameworks, libraries and software

Fresh★ 186k3119 entriesPushed yesterday
94

Awesome PHP

ziadoz/awesome-php

A curated list of amazingly awesome PHP libraries, resources and shiny things.

Fresh★ 33k87 entriesPushed 2 days ago