Discriminative and Generative models

Discriminative models.


Discriminative models directly map inputs to outputs using conditional distribution or prediction function.

  • Logistic regression/maximum entropy classifiers
  • Linear discriminant analysis
  • Support vector machines
  • Boosting
  • Conditional random fields
  • Linear regression
  • Neural networks


Generative models.


Generative model assume a common distribution that govern by parameters and find parameters values that best fit the training data.

  • Mixture model
  • Hidden Markov model
  • Naive Bayes
  • AODE
  • Latent Dirichlet allocation
  • Restricted Boltzmann Machine