Talk:Discriminative model

Clarifications required

"Discriminative models differ from generative models in that they do not allow one to generate samples..."

Samples of what? ---good question, because there are many discriminative models that allow one to generate samples of a target variable by modeling the posterior, but they are just not full probability models for all of the latent variables, or variables one might not care about in certain applications. Therefore, that's a poor statement by the authors if they don't specify. Mcswell 15:13, 12 November 2007 (UTC)

Conflict: In page on Discriminative_model"However, for tasks such as classification and regression that do not require the joint distribution, discriminative models generally yield superior performance. " (compared to generative models)

In page on Generative_model "They(discriminative models) don't necessarily perform better than generative models at classification and regression tasks." vks1712 14:53, 23 April 2012 (EST)

Questions

Here are some questions that should be clarified in this article:

• Why is an SVM a discriminative model? It does not model a probability distribution. If modeling probability distributions is not a necessary condition, it should be removed from the definition.
  • Yes it does, just in an odd way. It selects decision boundaries, and these decision boundaries almost always coincide to an optimal set of decision boundaries for some particular probability distributions for the classes. Of course, the classes usually do not obey these distributions, but an SVM will be equivalent to modeling the classes with those distributions, then selecting the optimal decision boundary.
• Is it true that all supervised learning algorithms are considered to be discriminative because they make predictions in one one direction? (ie X predicts Y, but Y does not necessarily predict X). If so, then why are Decision_trees, Naive_bayes, KNN , etc not on the list next to SVMs?
• Does this diagram represent the kind of data for which discriminative models are well-suited?
• If you train two discriminative models, one to predict X->Y, and one to predict Y->X, do they together form a generative model, since you can use them to predict in both directions? To be considered generative, would the Y->X model need to probabilistically sometimes predict '3' and sometimes predict '4'? Or would it need to return a distribution that specifies the probabilities of '3' and '4'?

Discriminative vs. Discriminant

Bishop (2007) distinguishes between discriminative approaches that learn p(y|x) use it to construct a decision rule and discriminant approaches that directly learn a discriminant function ${\hat {y}}=f(x)$ without learning the posterior density. According to this terminology some of the examples listed in this article are not discriminative methods, e.g. SVM. My suggestion would be to introduce the distinction between discriminative and discriminant and create two separate lists. Falk (talk) 21:52, 21 September 2010 (UTC)

Linear discriminant analysis

According to Linear classifier#Generative models vs. discriminative models, LDA is not a discriminative model despite its name. It models each class by a Gaussian, and the constraints on the covariance matrix determine the shape of the decision boundary (linear, quadratic, ..). Amro (talk) 23:43, 29 September 2010 (UTC)

Pure discriminative model vs. conditional model

This section makes it clear that a conditional model models the conditional distribution, but the contrast with the "traditional" discriminative model is vague and the citation points to a dead link. Are conditional models a specific kind of discriminative model, or vice versa? What exactly does "mapping the input around the most similar trained samples" mean? It sounds like some kind of regression or classification but there is no further explanation. Eblon2 (talk) 17:50, 4 January 2023 (UTC)