Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not understand why normal distributions can be used for classification #2

Open
LinyeLi60 opened this issue Apr 12, 2022 · 2 comments
Open

Comments

@LinyeLi60
Copy link

As in the case for classification, we can consider an ensemble of networks which parameterize multivariate normal distributions (MVN)
We usually use categorical distribution for classfication, I don't known how to use normal distribution for classification, can you give some examples?

@JanRocketMan
Copy link
Owner

Hi, let me resolve some ambiguity of this sentence - it means that for performing uncertainty estimation in regression, we could, similarly to classification case, train an ensemble of networks which parameterize MVNs (compared to Categorical distributions in classification). The emphasis is on ensemble here, not MVNs.

At the same time, you can indeed use normal distribution for classification, e.g. by treating the outputs of your network as p(x|y) instead of p(y|x), and then performing Bayesian inference (similarly to LDA). E.g. see impostor networks.

@LinyeLi60
Copy link
Author

LinyeLi60 commented Oct 11, 2022 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants