首页 > 代码库 > Topic modeling【经典模型】

Topic modeling【经典模型】

2024-07-14 12:56:43   215人阅读

http://www.cs.princeton.edu/~blei/topicmodeling.html

Topic models are a suite of algorithms that uncover the hidden thematic structure in document collections. These algorithms help us develop new ways to search, browse and summarize large archives of texts.

Below, you will find links to introductory materials, corpus browsers based on topic models, and open source software (from my research group) for topic modeling.

Introductory materials

  • I wrote a general introduction to topic modeling .
  • John Lafferty and I wrote a more technical review paper about this field.
  • Here are slides from some recent tutorials about topic modeling:
    • KDD-2011
    • ICML-2012
    • Machine Learning Summer School (2012)
  • Here is a video from a talk on dynamic and correlated topic models applied to the journal Science . (Here are the slides.)
  • David Mimno maintains a bibliography of topic modeling papers and software.
  • The topic models mailing list is a good forum for discussing topic modeling.

Corpus browsers based on topic models

The structure uncovered by topic models can be used to explore an otherwise unorganized collection. The following are browsers of large collections of documents, built with topic models.

  • A 100-topic browser of the dynamic topic model fit to Science (1882-2001).
  • A 100-topic browser of the correlated topic model fit to Science (1980-2000)
  • A 50-topic browser of latent Dirichlet allocation fit to the 2006 arXiv.
  • A 20-topic browser of latent Dirichlet allocation fit to The American Political Science Review

Also see Sean Gerrish‘s discipline browser for an interesting application of topic modeling at JSTOR.

To build your own browsers, see Allison Chaney‘s excellent Topic Model Visualization Engine (TMVE). For example, here is a browser of 100,000 Wikipedia articles that uses TMVE.

Topic modeling software

Our research group has released many open-source software packages for topic modeling. Please post questions, comments, and suggestions about this code to the topic models mailing list. 

LinkModel/AlgorithmLanguageAuthorNotes
lda-cLatent Dirichlet allocationCD. BleiThis implements variational inference for LDA.
class-sldaSupervised topic models for classifiationC++C. WangImplements supervised topic models with a categorical response.
ldaR package for Gibbs sampling in many modelsRJ. ChangImplements many models and is fast . Supports LDA, RTMs (for networked documents), MMSB (for network data), and sLDA (with a continuous response).
online ldaOnline inference for LDAPythonM. HoffmanFits topic models to massive data. The demo downloads random Wikipedia articles and fits a topic model to them.
online hdpOnline inference for the HDPPythonC. WangFits hierarchical Dirichlet process topic models to massive data. The algorithm determines the number of topics.
tmve(online)Topic Model Visualization EnginePythonA. ChaneyA package for creating corpus browsers. See, for example,Wikipedia .
ctrCollaborative modeling for recommendationC++C. WangImplements variational inference for a collaborative topic models. These models recommend items to users based on item content and other users‘ ratings.
dtmDynamic topic models and the influence modelC++S. GerrishThis implements topics that change over time and a model of how individual documents predict that change.
hdpHierarchical Dirichlet processesC++C. WangTopic models where the data determine the number of topics. This implements Gibbs sampling.
ctm-cCorrelated topic modelsCD. BleiThis implements variational inference for the CTM.
dilnDiscrete infinite logistic normalCJ. PaisleyThis implements the discrete infinite logistic normal, a Bayesian nonparametric topic model that finds correlated topics.
hldaHierarchical latent Dirichlet allocationCD. BleiThis implements a topic model that finds a hierarchy of topics. The structure of the hierarchy is determined by the data.
turbotopicsTurbo topicsPythonD. BleiTurbo topics find significant multiword phrases in topics.


联系
我们