Skip to content
82

Awesome Data Science with Python

Curated list of Python resources for data science.

4.7k stars717 forks147 entriesLast push Sep 7, 2026 (22 days ago)License CC0-1.0

This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.

General

pandas

Data structures built on top of numpy. scikit-learn - Core ML library, intelex. matplotlib - Plotting library. seaborn - Data visualization library based on matplotlib. ydata-profiling - Descriptive statistics using ProfileReport. sklearn_pandas - Helpful DataFrameMapper class. missingno - Missing…

In 5 listsDetails

Advanced Python Features

Generics, Protocols, Structural Pattern Matching and more. uv - Dependency management. pdm - For large binary distributions, works with uv. just - Command runner. Replacement for make. python-dotenv - Manage environment variables. structlog - Python logging. more_itertools - Extension of…

duckdb

Efficiently run SQL queries on pandas DataFrame, duckplyr for R, Great Intro. ducklake - Duckdb extention for storing data in a datalake. fireducks - Speedier alternative to pandas with similar API. pandasvault - Large collection of pandas tricks. polars - Multi-threaded alternative to pandas.…

In 8 listsDetails

great-tables

Display tabular data nicely.

In 3 lists

pygwalker

Interactive dataframe. marimo - Visualization and reproducible environment. lux - DataFrame visualization within Jupyter. dtale - View and analyze Pandas data structures, integrating with Jupyter. pandasgui - GUI for viewing, plotting and analyzing Pandas DataFrames. quak - Scalable, interactive…

In 3 lists

Jupyter Tricks

nteract - Open Jupyter Notebooks with doubleclick. papermill - Parameterize and execute Jupyter notebooks, tutorial. nbdime - Diff two notebook files, Alternative GitHub App: ReviewNB. RISE - Turn Jupyter notebooks into presentations. handcalcs - More convenient way of writing mathematical…

In 2 lists

positron

Data Science IDE. Deepnote - Data Science platform with real-time collaboration, environment management.

In 2 lists

textract

Extract text from any document. docling - Text extraction. DeepSeek-OCR - OCR. chandra - OCR.

In 2 lists

spark

DataFrame for big data, cheatsheet, tutorial. dask, dask-ml - Pandas DataFrame for big data and machine learning library, resources, talk1, talk2, notebooks, videos. h2o - Helpful H2OFrame class for out-of-memory dataframes. cuDF - GPU DataFrame Library, Intro. cupy - NumPy-like API accelerated…

csvkit

Command line tool for CSV files. csvsort - Sort large csv files.

In 6 listsDetails

Lakens - Improving Your Statistical Inferences

Testing, Effect Sizes, Confidence Intervals, Sample Size, Equivalence Testing, Sequential Analysis, Github Models Demystified - From Linear Regression to Deep Learning. Github. The Math Behind Artificial Intelligence - Engineering-focused book covering linear algebra, calculus, probability &…

Rdatasets

Collection of more than 2000 datasets, stored as csv files (R package). crimedatasets - Datasets focused on crimes, criminal activities (R package). educationr - Datasets related to education (performance, learning methods, test scores, absenteeism) (R package). MedDataSets - Datasets related to…

The ASA Statement on p-Values: Context, Process, and Purpose

Greenland - Statistical tests, P-values, confidence intervals, and power: a guide to misinterpretations Rubin - Inconsistent multiple testing corrections: The fallacy of using family-based error rates to make inferences about individual hypotheses Gigerenzer - Mindless Statistics Rubin - That's…

Guess the Correlation

Correlation guessing game. phik - Correlation between categorical, ordinal and interval variables. hoeffd - Hoeffding's D Statistics, measure of dependence (R package).

Morey - The fallacy of placing confidence in confidence intervals

statsmodels

Statistical tests. linearmodels - Instrumental variable and panel data models. nomograms - Visualization for linear models, explanation (Part of rms R package) pingouin - Statistical tests. Pairwise correlation between columns of pandas DataFrame scipy.stats - Statistical tests. scikit-posthocs -…

In 3 lists

MOTE Effect Size Calculator

Shiny App, R package Estimating Effect Sizes From Pretest-Posttest-Control Group Designs - Scott B. Morris, Twitter

test_proportions_2indep

Proportion test. G-Test - Alternative to chi-square test, power_divergence.

torch-two-sample

Friedman-Rafsky Test: Compare two population based on a multivariate generalization of the Runstest. Explanation, Application

In 2 lists

pwrss

Statistical Power and Sample Size Calculation Tools (R package), Tutorial with t-test

Stop Early Stopping

Nice visualization Sequential Analysis - Wikipedia. sequential - Exact Sequential Analysis for Poisson and Binomial Data (R package). confseq - Uniform boundaries, confidence sequences, and always-valid p-values.

Friends don't let friends make certain types of data visualization

Great Overview over Visualizations 1 dataset, 100 visualizations Dependent Propabilities Null Hypothesis Significance Testing (NHST) and Sample Size Calculation estimationstats - Online Tool for visualizing mean differences, effect sizes (Cohen's d) and others. Sample Size / Duration Calculator…

In 2 lists

The Art of Data Visualization with ggplot2, The TidyTuesday Cookbook

Best Practices for Data Visualization tidytuesday - Weekly challenge for visualization and lots of publicly available datasets for practice. z3tt/TidyTuesday - Nice charts (R). nrennie/tidytuesday - Nice charts (R). poncest/tidytuesday - Nice charts (R).

Inverse Propensity Weighting

Dealing with Selection Bias By Propensity Based Feature Selection

Modes, Medians and Means: A Unifying Perspective

Using Norms to Understand Linear Regression Verifying the Assumptions of Linear Models Mediation and Moderation Intro Montgomery et al. - How conditioning on post-treatment variables can ruin your experiment and what to do about it Lindeløv - Common statistical tests are linear models Chatruc -…

Collins et al. - Evaluation of clinical prediction models (part 1): from development to external validation

Twitter

Lesko et al. - A Framework for Descriptive Epidemiology

R Epidemics Consortium - Large tool suite for working with epidemiological data (R packages). Github incidence2 - Computation, handling, visualisation and simple modelling of incidence (R package). EpiEstim - Estimate time varying instantaneous reproduction number R during epidemics (R package)…

Statistical Inference and Regression

Applied Machine Learning in Python Convolutional Neural Networks for Visual Recognition - Stanford CS class. Intuition for the Algorithms in Machine Learning - Lecture Series.

Checklist

. pyjanitor - Clean messy column names. skimpy - Create summary statistics of dataframes. Helpful clean_columns() function. pandera - Data / Schema validation. dataframely - Data / Schema validation. pointblank - Data / Schema validation. great_expectations - Data validation, documentation, and…

cleanlab

Machine learning with noisy labels, finding mislabelled data, and uncertainty quantification. Also see awesome list below. doubtlab - Find bad or noisy labels.

In 8 listsDetails

iterative-stratification

Stratification of multilabel data.

Vincent Warmerdam: Untitled12.ipynb

Using df.pipe() Vincent Warmerdam: Winning with Simple, even Linear, Models sklearn - Pipeline, examples. pdpipe - Pipelines for DataFrames. scikit-lego - Custom transformers for pipelines. categorical-encoding - Categorical encoding of variables, vtreat (R package). patsy - R-like syntax for…

Overview Paper

, Talk, Repo Blog post series - 1, 2, 3, 4 Tutorials - 1, 2 sklearn - Feature selection. eli5 - Feature selection using permutation importance. scikit-feature - Feature selection algorithms. stability-selection - Stability selection. scikit-rebate - Relief-based feature selection algorithms.…

apricot

Selecting subsets of data sets to train machine learning models quickly. ducks - Index data for fast lookup by any combination of fields.

esvit

Vision Transformers for Representation Learning (Microsoft). MCML - Semi-supervised dimensionality reduction of Multi-Class, Multi-Label data (sequencing data) paper.

Dangers of PCA (paper)

. Phantom oscillations in PCA. What to use instead of PCA. Talk, tsne intro. sklearn.manifold and sklearn.decomposition - PCA, t-SNE, MDS, Isomaps and others. Additional plots for PCA - Factor Loadings, Cumulative Variance Explained, Correlation Circle Plot, Tweet sklearn.random_projection -…

All charts

physt - Better histograms, talk, notebook. fast-histogram - Fast histograms. matplotlib_venn - Venn diagrams. penrose - Venn diagrams. ridgeplot - Ridge plots. mosaic plots - Categorical variable visualization, example. yellowbrick - Visualizations for ML models (similar to scikit-plot). bokeh -…

In 3 lists

palettable

Color palettes from colorbrewer2. colorcet - Collection of perceptually uniform colormaps. Named Colors Wheel - Color wheel for all named HTML colors.

In 2 lists

py-shiny

Shiny for Python, talk. superset - Dashboarding solution by Apache. streamlit - Dashboarding solution. Resources, Gallery Components, bokeh-events. mercury - Convert Python notebook to web app, Example. dash - Dashboarding solution by plot.ly. Resources. visdom - Dashboarding library by Facebook.…

gradio

Create UIs for your machine learning model.

In 11 listsDetails

samplics

Sampling techniques for complex survey designs.

folium

Plot geographical maps using the Leaflet.js library, jupyter plugin. gmaps - Google Maps for Jupyter notebooks. stadiamaps - Plot geographical maps. datashader - Draw millions of points on a map. sklearn - BallTree. pynndescent - Nearest neighbor descent for approximate nearest neighbors. geocoder…

In 4 listsDetails

Intro to Decision Trees and Random Forests

, Another good visualization, Intro to Gradient Boosting 1, 2, Decision Tree Visualization lightgbm - Gradient boosting (GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, doc. xgboost - Gradient boosting (GBDT, GBRT or GBM) library, doc, Methods for CIs: link1, link2. catboost…

talk

nb, nb2, talk. Text classification Intro, Preprocessing blog post. gensim - NLP, doc2vec, word2vec, text processing, topic modelling (LSA, LDA), Example, Coherence Model for evaluation. Embeddings - GloVe ([1], [2]), StarSpace, wikipedia2vec, visualization. magnitude - Vector embedding utility…

Lee et al. - A beginner's guide to rigor and reproducibility in fluorescence imaging experiments

Awesome Cytodata

MIT 7.016 Introductory Biology, Fall 2018

Videos 27, 28, and 29 talk about staining and imaging. Bio-image Analysis Notebooks - Large collection of image processing workflows, including point-spread-function estimation and deconvolution, 3D cell segmentation, feature extraction using pyclesperanto and others. python_for_microscopists -…

jump-cellpainting

Cellpainting dataset. MedMNIST - Datasets for 2D and 3D Biomedical Image Classification. CytoImageNet - Huge diverse dataset like ImageNet but for cell images. Haghighi - Gene Expression and Morphology Profiles. broadinstitute/lincs-profiling-complementarity - Cellpainting vs. L1000 assay.

In 2 lists

MinCovDet

Robust estimator of covariance, RMPV, Paper, App1, App2. moderated z-score - Weighted average of z-scores based on Spearman correlation. winsorize - Simple adjustment of outliers.

Zhang XHD (2008) - Novel analytic criteria and effective plate designs for quality control in genome-wide RNAi screens

Iversen - A Comparison of Assay Performance Measures in Screening Assays, Signal Window, Z′ Factor, and Assay Variability Ratio Z-factor - Measure of statistical effect size. Z'-factor - Measure of statistical effect size. CV - Coefficient of variation. SSMD - Strictly standardized mean…

BD Spectrum Viewer

Calculate spectral overlap, bleed through for fluorescence microscopy dyes. SpectraViewer - Visualize the spectral compatibility of fluorophores (PerkinElmer). Thermofisher Spectrum Viewer - Thermofisher Spectrum Viewer. Microscopy Resolution Calculator - Calculate resolution of images (Nikon).…

anndata

annotated data matrices in memory and on disk, Docs. muon - Multimodal omics framework. mudata - Multimodal Data (.h5mu) implementation. bdz - Zarr-based format for storing quantitative biological dynamics data.

napari

Image viewer and image processing tool. Fiji - General purpose tool. Image viewer and image processing tool. vizarr - Browser-based image viewer for zarr format. avivator - Browser-based image viewer for tiff files. OMERO - Image viewer for high-content screening. IDR uses OMERO. Intro fiftyone -…

In 4 lists

napari-sam

Segment Anything Plugin. napari-chatgpt - ChatGPT Plugin.

aydin

Image denoising. DivNoising - Unsupervised denoising method. CSBDeep - Content-aware image restoration, Project page. gibbs-diffusion - Image denoising.

skimage

Illumination correction (CLAHE). cidre - Illumination correction method for optical microscopy. BaSiCPy - Background and Shading Correction of Optical Microscopy Images, BaSiC.

PICASSO

Blind unmixing without reference spectra measurement, Paper cytoflow - Flow cytometry. Includes Bleedthrough correction methods. Linear unmixing in Fiji for Bleedthrough Correction - Youtube. Bleedthrough Correction using Lumos and Fiji - Link. AutoUnmix - Link.

CellProfiler

, CellProfilerAnalyst - Create image analysis pipelines. fractal - Framework to process high-content imaging data from UZH, Github. atomai - Deep and Machine Learning for Microscopy. py-clesperanto - Tools for 3D microscopy analysis, deskewing and lots of other tutorials, interacts with napari.…

In 2 lists

mcmicro

Multiple-choice microscopy pipeline, Website, Paper. MCQuant - Quantification of cell features. cylinter - Quality assurance for microscopy images, Website. ashlar - Whole-slide microscopy image stitching and registration. scimap - Spatial Single-Cell Analysis Toolkit.

microscopy-tree

Review of cell segmentation algorithms, Paper. Review of organoid pipelines - Paper. BioImage.IO - BioImage Model Zoo. MEDIAR - Cell segmentation. cellpose - Cell segmentation. Paper, Dataset. stardist - Cell segmentation with Star-convex Shapes. instanseg - Cell segmentation. UnMicst -…

cellpose

Cell images. omnipose - Cell images. LIVECell - Cell images. Sartorius - Neurons. EmbedSeg - 2D + 3D images. connectomics - Annotation of the EPFL Hippocampus dataset. ZeroCostDL4Mic - Stardist example training and test dataset.

seg-eval

Cell segmentation performance evaluation without Ground Truth labels, Paper.

Computer vision challenges in drug discovery - Maciej Hermanowicz

CellProfiler - Biological image analysis. scikit-image - Image processing. scikit-image regionprops - Regionprops: area, eccentricity, extent. mahotas - Zernike, Haralick, LBP, and TAS features, example. pyradiomics - Radiomics features from medical imaging. pyefd - Elliptical feature descriptor,…

Tran - A benchmark of batch-effect correction methods for single-cell RNA sequencing data

, Code. R Tutorial on correcting batch effects. harmonypy - Fuzzy k-means and locally linear adjustments. pyliger - Batch-effect correction, R package. nimfa - Nonnegative matrix factorization. scgen - Batch removal. Doc. CORAL - Correcting for Batch Effects Using Wasserstein Distance, Code,…

Single cell tutorial

. PyDESeq2 - Analyzing RNA-seq data. cellxgene - Interactive explorer for single-cell transcriptomics data. scanpy - Analyze single-cell gene expression data, tutorial. besca - Beyond single-cell analysis. janggu - Deep Learning for Genomics. gdsctools - Drug responses in the context of the…

In 2 lists

TDC

Drug Discovery and Development. DeepPurpose - Deep Learning Based Molecular Modelling and Prediction Toolkit.

In 2 lists

mit6874

Computational Systems Biology: Deep Learning in the Life Sciences. ConvNet Shape Calculator - Calculate output dimensions of Conv2D layer. Great Gradient Descent Article. Intro to semi-supervised learning.

Google Tuning Playbook

A playbook for systematically maximizing the performance of deep learning models by Google. fast.ai course - Practical Deep Learning for Coders. Tensorflow without a PhD - Neural Network course by Google. Feature Visualization: Blog, PPT Tensorflow Playground Visualization of optimization…

imgaug

More sophisticated image preprocessing. Augmentor - Image augmentation library. keras preprocessing - Preprocess images. albumentations - Wrapper around imgaug and other libraries. augmix - Image augmentation from Google. kornia - Image augmentation, feature extraction and loss functions. augly -…

In 4 lists

SegLoss

List of loss functions for medical image segmentation.

rational_activations

Rational activation functions.

ktext

Utilities for pre-processing text for deep learning in Keras. textgenrnn - Ready-to-use LSTM for text generation. ctrl - Text generation.

OpenMMLab

Framework for segmentation, classification and lots of other computer vision tasks. caffe - Deep learning framework, pretrained models. mxnet - Deep learning framework, book.

keras

Neural Networks on top of tensorflow, examples. keras-contrib - Keras community contributions. keras-tuner - Hyperparameter tuning for Keras. hyperas - Keras + Hyperopt: Convenient hyperparameter optimization wrapper. elephas - Distributed Deep learning with Keras & Spark. tflearn - Neural…

In 8 listsDetails

Good PyTorch Introduction

skorch - Scikit-learn compatible neural network library that wraps PyTorch, talk, slides. fastai - Neural Networks in PyTorch. timm - PyTorch image models. ignite - Highlevel library for PyTorch. torchcv - Deep Learning in Computer Vision. pytorch-optimizer - Collection of optimizers for PyTorch.…

flexflow

Distributed TensorFlow Keras and PyTorch. horovod - Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Awesome List

. netron - Viewer for neural networks. visualkeras - Visualize Keras networks.

roboflow

Reusable computer vision tools.

In 4 listsDetails

Metrics reloaded: Recommendations for image analysis validation

Guide for choosing correct image analysis metrics, Code, Twitter Thread Good Yolo Explanation ultralytics - Easily accessible Yolo and SAM models. yolact - Fully convolutional model for real-time instance segmentation. EfficientDet Pytorch, EfficientDet Keras - Scalable and Efficient Object…

nfnets

Neural network. efficientnet - Neural network. pycls - PyTorch image classification networks: ResNet, ResNeXt, EfficientNet, and RegNet (by Facebook).

SPADE

Semantic Image Synthesis. Entity Embeddings of Categorical Variables, code, kaggle Image Super-Resolution - Super-scaling using a Residual Dense Network. Cell Segmentation - Talk, Blog Posts: 1, 2 deeplearning-models - Deep learning models.

Variational Autoencoder Explanation Video

disentanglement_lib - BetaVAE, FactorVAE, BetaTCVAE, DIP-VAE. ladder-vae-pytorch - Ladder Variational Autoencoders (LVAE). benchmark_VAE - Unifying Generative Autoencoder implementations.

Awesome GAN Applications

The GAN Zoo - List of Generative Adversarial Networks. CycleGAN and Pix2pix - Various image-to-image tasks. TensorFlow GAN implementations PyTorch GAN implementations PyTorch GAN implementations StudioGAN - PyTorch GAN implementations.

The Annotated Transformer

Intro to transformers. Transformers from Scratch - Intro. Neural Networks: Zero to Hero - Video series on building neural networks. SegFormer - Simple and Efficient Design for Semantic Segmentation with Transformers. esvit - Efficient self-supervised Vision Transformers. nystromformer - More…

Great overview for deep learning for tabular data

TabPFN - Foundation Model for Tabular Data.

How to do Deep Learning on Graphs with Graph Convolutional Networks

Introduction To Graph Convolutional Networks An attempt at demystifying graph deep learning ogb - Open Graph Benchmark, Benchmark datasets. networkx - Graph library. cugraph - RAPIDS, Graph library on the GPU. pytorch-geometric - Various methods for deep learning on graphs. dgl - Deep Graph…

hummingbird

Compile trained ML models into tensor computations (by Microsoft).

cuML

RAPIDS, Run traditional tabular ML tasks on GPUs, Intro. flashlib - A GPU library for classical machine-learning operators.

In 7 listsDetails

pyearth

Multivariate Adaptive Regression Splines (MARS), tutorial. pygam - Generalized Additive Models (GAMs), Explanation. GLRM - Generalized Low Rank Models. tweedie - Specialized distribution for zero inflated targets, Talk. MAPIE - Estimating prediction intervals.

Talk

, Notebook Blog post: Probability Scoring All classification metrics DESlib - Dynamic classifier and ensemble selection. human-learn - Create and tune classifier based on your rule set.

Contrastive Representation Learning

metric-learn

Supervised and weakly-supervised metric learning algorithms. pytorch-metric-learning - PyTorch metric learning. deep_metric_learning - Methods for deep metric learning. ivis - Metric learning using siamese neural networks. TensorFlow similarity - Metric learning.

In 2 lists

Steck et al. - Is Cosine-Similarity of Embeddings Really About Similarity?

scipy.spatial - All kinds of distance metrics. vegdist - Distance metrics (R package). pyemd - Earth Mover's Distance / Wasserstein distance, similarity between histograms. OpenCV implementation, POT implementation dcor - Distance correlation and related Energy statistics. GeomLoss - Kernel norms,…

lightly

MoCo, SimCLR, SimSiam, Barlow Twins, BYOL, NNCLR. vissl - Self-Supervised Learning with PyTorch: RotNet, Jigsaw, NPID, ClusterFit, PIRL, SimCLR, MoCo, DeepCluster, SwAV.

In 6 listsDetails

Overview of clustering algorithms applied image data (= Deep Clustering)

. Clustering with Deep Learning: Taxonomy and New Methods. Hierarchical Cluster Analysis (R Tutorial) - Dendrogram, Tanglegram Schubert - Stop using the elbow criterion for k-means and how to choose the number of clusters instead hdbscan - Clustering algorithm, talk, blog. pyclustering - All sorts…

Wagner, Wagner - Comparing Clusterings - An Overview

Adjusted Rand Index

Normalized Mutual Information

Adjusted Mutual Information

Fowlkes-Mallows Score

Silhouette Coefficient

Variation of Information

, Julia

Pair Confusion Matrix

Consensus Score

The similarity of two sets of biclusters.

Assessing the quality of a clustering (video)

fpc

Various methods for clustering and cluster validation (R package).; Minimum distance between any two clusters; Distance between centroids; p-separation index: Like minimum distance. Look at the average distance to nearest point in different cluster for p=10% "border" points in any cluster.…

In 2 lists

scikit-multilearn

Multi-label classification, talk.

In 3 lists

Sublime - The Return of Pseudosciences in Artificial Intelligence: Have Machine Learning and Deep Learning Forgotten…

Stanford Lecture Series on Fourier Transformation

, Youtube, Lecture Notes. Visual Fourier explanation. The Scientist & Engineer's Guide to Digital Signal Processing (1999) - Chapter 3 has good introduction to Bessel, Butterworth and Chebyshev filters. Kalman Filter article. Kalman Filter book - Focuses on intuition using Jupyter Notebooks.…

scipy.signal

Butterworth low-pass filter example

Simple Python demo on signal processing.

In 2 lists

Savitzky–Golay filter

, W pandas.Series.rolling - Choose appropriate win_type.

geomstats

Computations and statistics on manifolds with geometric structures.

In 2 lists

Time Series Anomaly Detection Review Paper

statsmodels - Time series analysis, seasonal decompose example, SARIMA, granger causality. darts - Time Series library (LightGBM, Neural Networks). kats - Time series prediction library by Facebook. prophet - Time series prediction library by Facebook. neural_prophet - Time series prediction built…

nixtla

Pretrained Time Series Foundation Model for forecasting and anomaly detection. statsforecast - Forecasting with statistical and econometric models. neuralforecast - Forecasting with neural networks. mlforecast - Forecasting with ML models. hierarchicalforecast - Hierarchical forecasting with…

In 2 lists

TimeSeriesSplit

Sklearn time series split. tscv - Evaluation with gap.

pyfolio

Portfolio and risk analytics. zipline - Algorithmic trading. alphalens - Performance analysis of predictive stock factors. empyrical - Financial risk metrics. trading_calendars - Calendars for various securities exchanges.

In 5 listsDetails

Time-dependent Cox Model in R

. lifelines - Survival analysis, Cox PH Regression, talk, talk2. scikit-survival - Survival analysis. xgboost - "objective": "survival:cox" NHANES example survivalstan - Survival analysis, intro. convoys - Analyze time lagged conversions. RandomSurvivalForests (R packages: randomForestSRC,…

sklearn

Isolation Forest and others. pyod - Outlier Detection / Anomaly Detection. eif - Extended Isolation Forest. AnomalyDetection - Anomaly detection (R package). luminol - Anomaly Detection and Correlation library from Linkedin. Distances for comparing histograms and detecting outliers - Talk:…

TorchDrift

Drift Detection for PyTorch Models. alibi-detect - Algorithms for outlier, adversarial and drift detection. evidently - Evaluate and monitor ML models from validation to production. Lipton et al. - Detecting and Correcting for Label Shift with Black Box Predictors. Bu et al. - A pdf-Free Change…

In 3 lists

lightning

Large-scale linear classification, regression and ranking.

Chatton et al. - The Causal Cookbook: Recipes for Propensity Scores, G-Computation, and Doubly Robust Standardization

Statistical Rethinking - Video Lecture Series, Bayesian Statistics, Causal Models, R, python, numpyro1, numpyro2, tensorflow-probability. Naimi et al. - An introduction to g methods CS 594 Causal Inference and Learning Marginal Effects Tutorial - Marginal Effects, g-computation and more. Python…

pecan

Online tool for building interactive perceived causal networks. dagitty - Build causal DAG. dowhy - Estimate causal effects. CausalImpact - Causal Impact Analysis (R package). causallib - Modular causal inference analysis and model evaluations by IBM, examples. causalml - Causal inference by Uber.…

Bours - Confounding

Bours - Effect Modification and Interaction

Intro

, Guide PyMC3 - Bayesian modelling. numpyro - Probabilistic programming with numpy, built on pyro. pomegranate - Probabilistic modelling, talk. pmlearn - Probabilistic machine learning. arviz - Exploratory analysis of Bayesian models. zhusuan - Bayesian deep learning, generative models. edward -…

Visualization

, Article GPyOpt - Gaussian process optimization. GPflow - Gaussian processes (TensorFlow). gpytorch - Gaussian processes (PyTorch).

Model Stacking Blog Post

mlxtend - EnsembleVoteClassifier, StackingRegressor, StackingCVRegressor for model stacking. vecstack - Stacking ML models. StackNet - Stacking ML models. mlens - Ensemble learning. combo - Combining ML models (stacking, ensembling).

evaluate

Evaluate machine learning models (huggingface). pycm - Multi-class confusion matrix. pandas_ml - Confusion matrix. Plotting learning curve: link. yellowbrick - Learning curve. pyroc - Receiver Operating Characteristic (ROC) curves.

In 4 listsDetails

awesome-conformal-prediction

Uncertainty quantification. uncertainty-toolbox - Predictive uncertainty quantification, calibration, metrics, and visualization.

Princeton - Reproducibility Crisis in ML‑based Science

Book, Examples scikit-learn - Permutation Importance (can be used on any trained classifier) and Partial Dependence shap - Explain predictions of machine learning models, talk, Good Shap intro. shapiq - Shapley interaction quantification. treeinterpreter - Interpreting scikit-learn's decision tree…

AdaNet

Automated machine learning based on TensorFlow. tpot - Automated machine learning tool, optimizes machine learning pipelines. autokeras - AutoML for deep learning. nni - Toolkit for neural architecture search and hyper-parameter tuning by Microsoft. mljar - Automated machine learning. automl_zero…

Karate Club

Unsupervised learning on graphs. PyTorch Geometric - Graph representation learning with PyTorch. DLG - Graph representation learning with TensorFlow.

In 7 listsDetails

cvxpy

Modelling language for convex optimization problems. Tutorial: 1, 2

deap

Evolutionary computation framework (Genetic Algorithm, Evolution strategies). evol - DSL for composable evolutionary algorithms, talk. platypus - Multiobjective optimization. autograd - Efficiently computes derivatives of numpy code. nevergrad - Derivation-free optimization. gplearn - Sklearn-like…

In 7 listsDetails

sklearn

GridSearchCV, RandomizedSearchCV. sklearn-deap - Hyperparameter search using genetic algorithms. hyperopt - Hyperparameter optimization. hyperopt-sklearn - Hyperopt + sklearn. optuna - Hyperparamter optimization, Talk. skopt - BayesSearchCV for Hyperparameter search. tune - Hyperparameter search…

In 5 listsDetails

Talk

modAL - Active learning framework.

YouTube

, YouTube Intro to Monte Carlo Tree Search (MCTS) - 1, 2, 3 AlphaZero methodology - 1, 2, 3, Cheat Sheet RLLib - Library for reinforcement learning. Horizon - Facebook RL framework.

nextflow

Run scripts and workflow graphs in Docker image using Google Life Sciences, AWS Batch, Website. airflow - Schedule and monitor workflows. prefect - Python specific workflow scheduling. dagster - Development, production and observation of data assets. ploomber - Workflow orchestration. kestra -…

Reduce size of docker images (video)

Optimize Docker Image Size cog - Facilitates building Docker images.

dvc

Version control for large files. kedro - Build data pipelines. feast - Feature store. Video. pgvector - Vector similarity search for Postgres. pinecone - Database for vector search applications. truss - Serve ML models. milvus - Vector database for similarity search. mlem - Version and deploy your…

In 8 listsDetails

m2cgen

Transpile trained ML models into other languages. sklearn-porter - Transpile trained scikit-learn estimators to C, Java, JavaScript and others. mlflow - Manage the machine learning lifecycle, including experimentation, reproducibility and deployment. skll - Command-line utilities to make it easier…

In 16 listsDetails

All kinds of math and statistics resources

Gilbert Strang - Linear Algebra Gilbert Strang - Matrix Methods in Data Analysis, Signal Processing, and Machine Learning

In 2 lists

Distill.pub

Blog. Machine Learning Videos Data Science Notebooks Recommender Systems (Microsoft) Datascience Cheatsheets

In 4 listsDetails

datasharing

Guide to data sharing.

In 2 lists

Blum - Foundations of Data Science

Chan - Introduction to Probability for Data Science Colonescu - Principles of Econometrics with R Rafael Irizarry - Introduction to Data Science (R Language) Rafael Irizarry - Advanced Data Science (R Language)

Awesome Adversarial Machine Learning

Awesome AI Booksmarks Awesome AI on Kubernetes Awesome Big Data Awesome Biological Image Analysis Awesome Business Machine Learning Awesome Causality Awesome Community Detection Awesome CSV Awesome Cytodata Awesome Data Science Awesome Data Science with Ruby Awesome Dash Awesome Decision Trees…

NYU Deep Learning SP21

YouTube Playlist.

Color Codes

Frequency codes for time series Date parsing codes

See category
94

Awesome Rust

rust-unofficial/awesome-rust

A curated list of Rust code and resources.

Fresh★ 60k1833 entriesPushed today
94

Awesome Mac

jaywcjlove/awesome-mac

 This project is dedicated to collecting high-quality macOS software and organizing them systematically by different categories for easy search and use.

Fresh★ 115k1316 entriesPushed today
94

Awesome Python

vinta/awesome-python

The definitive list that answers "I want to do X in Python, which tool should I use?"

Fresh★ 324k504 entriesPushed today
94

Awesome C++

fffaraz/awesome-cpp

A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.

Fresh★ 74k1358 entriesPushed yesterday
94

Awesome Go

avelino/awesome-go

A curated list of awesome Go frameworks, libraries and software

Fresh★ 186k3119 entriesPushed yesterday
94

Awesome PHP

ziadoz/awesome-php

A curated list of amazingly awesome PHP libraries, resources and shiny things.

Fresh★ 33k87 entriesPushed 2 days ago