README

Awesome Production Machine Learning

This repository contains a curated list of awesome open source libraries that will help you deploy, monitor, version, scale, and secure your production machine learning 🚀

You can keep up to date by watching this github repo to get a summary of the new production ML libraries added every month via releases 🤩

Additionally, we provide a search toolkit that helps you quickly navigate through the toolchain.

 Quick links to sections on this page

| | | |
|-|-|-|
| 🔧 AutoML | 🧮 Computation & Communication Optimisation | 🏷️ Data Annotation & Synthesis |
| 🧵 Data Pipeline | 📓 Data Science Notebook | 💾 Data Storage Optimisation |
| 💸 Data Stream Processing | 💪 Deployment & Serving | 📈 Evaluation & Monitoring |
| 🔍 Explainability & Fairness | 🎁 Feature Store | 🔴 Industry-strength Anomaly Detection |
| 👁️ Industry-strength Computer Vision | 🔥 Industry-strength Information Retrieval | 🔠 Industry-strength Natural Language Processing |
| 🙌 Industry-strength Recommender System | 🍕 Industry-strength Reinforcement Learning | 🤖 Industry-strength Robotics |
| 📊 Industry-strength Visualisation | 📅 Metadata Management | 📜 Model, Data & Experiment Management |
| 🔩 Model Storage Optimisation | 🏁 Model Training & Orchestration | 🔏 Privacy & Safety |

 Contributing to the list

Please review our CONTRIBUTING.md requirements when submitting a PR to help us keep the list clean and up-to-date - thank you to the community for supporting its steady growth 🚀


  
  
  


 10 Min Video Overview


  
    
        This 10 minute video provides an overview of the motivations for machine learning operations as well as a high level overview on some of the tools in this repo. This newer video covers the an updated 2024 version of the state of MLOps.
    
    
        
    
  


 Want to receive recurrent updates on this repo and other advancements?


  
    
         You can join the Machine Learning Engineer newsletter. Join over 70,000 ML professionals and enthusiasts who receive weekly curated articles & tutorials on production Machine Learning.
    
    
        
    
  
  
    
         Also check out the Awesome Production GenAI List, where we aim to map a curated list of awesome open source libraries to deploy, monitor, version and scale your generative artificial intelligence applications and systems.
    
    
        
    
  


 Main Content

 AutoML
 AIDE ! - AIDE is an open-source ML engineering agent that uses a tree search algorithm to autonomously explore, implement, and evaluate solution strategies for machine learning tasks.
 AutoGluon ! - Automated feature, model, and hyperparameter selection for tabular, image, and text data on top of popular machine learning libraries (Scikit-Learn, LightGBM, CatBoost, PyTorch, MXNet).
 Autokeras ! - AutoML library for Keras based on "Auto-Keras: Efficient Neural Architecture Search with Network Morphism".
 auto-sklearn ! - Framework to automate algorithm and hyperparameter tuning for sklearn