Learning document representations using subspace multinomial model

conference paper

English

Subspace multinomial model (SMM) is a log-linear model and can be used for learning low dimensional continuous representation for discrete data. SMMand its variants have been used for speaker verification based on prosodic features and phonotactic language recognition. In this paper, we propose a new variant of SMM that introduces sparsity and call the resulting model as `1 SMM. We show that `1 SMM can be used for learning document representations that are helpful in topic identification or classification and clustering tasks. Our experiments in document classification show that SMM achieves comparable results to models such as latent Dirichlet allocation and sparse topical coding, while having a useful property that the resulting document vectors are Gaussian distributed.

Document representation, subspace modelling, topic identification, latent topic discovery

KESIRAJU, S.; BURGET, L.; SZŐKE, I.; ČERNOCKÝ, J.

8. 9. 2016

International Speech Communication Association

San Francisco

978-1-5108-3313-5

Proceedings of Interspeech 2016

700

704

5

https://www.researchgate.net/publication/307889473_Learning_Document_Representations_Using_Subspace_Multinomial_Model

kesiraju_interspeech2016_IS161634.pdf