A comprehensive list of machine learning algorithms

Question

I could not find a comprehensive list of machine learning algorithms online.

Can we try to make one here and improve and update it as needed?

There are challenges in the algorithm definitions and how to group and organize them, but my preliminary list (built from e.g. 1, 2, 3), is given in my answer below.

Answer 1

Supervised learning

• ANOVA
• Averaged one-dependence estimators
• Artificial neural network
  • Convolutional neural network
  • Extreme learning machine
  • Feedforward neural network
  • Logic learning machine
  • Long short-term memory
  • Recurrent neural network
  • Self-organizing map
• Bayesian networks
• Boosting
• Case-based reasoning
• Conditional random field
• Decision tree algorithms
  • C4.5 algorithm
  • C5.0 algorithm
  • Chi-squared automatic interaction detection
  • Classification and regression tree
  • Conditional decision tree
  • Decision stump
  • Decision tree
  • ID3 algorithm
  • Iterative dichotomiser 3
  • Random forest
  • SLIQ
• Ensembles of classifiers
  • Bootstrap aggregating
  • Boosting
• Gaussian process regression
• Gene expression programming
• Group method of data handling
• Inductive logic programming
• Information fuzzy networks
• Instance-based learning
• K-nearest neighbour
• Lazy learning
• Learning vector quantization
• Linear
  • Elastic-net
  • Lasso
  • Linear discriminant analysis
  • Linear regression
  • Logistic regression
  • Multinomial logistic regression
  • Naive bayes classifier
  • Ordinary least squares
  • Passive aggressive algorithms
  • Perceptron
  • Polynomial regression
  • Ridge regression / classification
  • Support vector machine
• Logistic model tree
• Minimum message length
  • Analogical modelling
  • Nearest neighbour algorithm
• Ordinal classification
• Probably approximately correct learning
• Quadratic classifiers
• Random forests
• Ripple down rules
• Symbolic machine learning

Semi-supervised learning

• Active learning
• Co-training
• Graph-based methods
• Generative models
• Low-density separation
• Transduction

Unsupervised learning

• Association rule learning
  • Apriori algorithm
  • Eclat algorithm
  • FP-growth algorithm
• Auto-encoders
• Cluster analysis
  • BIRCH
  • Conceptual clustering
  • DBSCAN
  • Expectation-maximization
  • Fuzzy clustering
  • Hierarchical clustering
  • K-means clustering
  • K-medians
  • Mean-shift
  • OPTICS algorithm
  • Single-linkage clustering
• Dimensionality reduction
  • Canonical correlation analysis
  • Dynamic mode decomposition
  • Factor analysis
  • Feature extraction
  • Feature selection
  • Independent component analysis
  • Linear discriminant analysis
  • Multidimensional scaling
  • Non-negative matrix factorization
  • Partial least squares regression
  • Principal component analysis
  • Principal component regression
  • Projection pursuit
  • Sammon mapping
  • T-distributed stochastic neighbour embedding
• Expectation-maximization algorithm
• Generative topographic map
• Information bottleneck method
• Manifold learning
• Vector quantization

Reinforcement learning

• Deterministic policy gradient
• Learning automata
• Proximal policy optimization
• Q-learning
• Soft actor-critic
• State–action–reward–state–action
• Temporal difference learning
• Trust region policy Optimization

Other

• Bayesian belief network
• Bayesian knowledge base
• Deep belief networks
• Deep boltzmann machines
• Deep neural networks
• Discrepancy modelling
• Gaussian naive bayes
• Generative adversarial network
• Hierarchical temporal memory
• Knowledge-enhanced machine learning
• Markov models
• Multinomial naive bayes
• Neural style transfer
• Physics-informed machine learning
• Sparse identification of nonlinear dynamics
• Transformer