Clustering the Tagged Web

Abstract Automatically clustering web pages into semantic groups promises improved search and browsing on the web. In this paper, we demonstrate how user-generated tags from largescale social bookmarking websites such as del.icio.us can be used as a complementary data source to page text and anchor text for improving automatic clustering of web pages. This paper explores the use of tags in 1) K-means clustering in an extended vector space model that includes tags as well as page text and 2) a novel generative clustering algorithm based on latent Dirichlet allocation that jointly models text and tags. We evaluate the models by comparing their output to an established web directory. We find that the naive inclusion of tagging data improves cluster quality versus page text alone, but a more principled inclusion can substantially improve the quality of all models with a statistically signifi- cant absolute F-score increase of 4%. The generative model outperforms K-means with another 8% F-score increase.
Keywords No keywords specified (fix it)
Categories No categories specified (fix it)
Options
 Save to my reading list
Follow the author(s)
My bibliography
Export citation
Find it on Scholar
Edit this record
Mark as duplicate
Revision history Request removal from index
 
Download options
PhilPapers Archive


Upload a copy of this paper     Check publisher's policy on self-archival     Papers currently archived: 5,679
External links
  •   Try with proxy.
  • Through your library Only published papers are available at libraries

    Similar books and articles
    Paul R. Smart (2012). The Web-Extended Mind. Metaphilosophy 43 (4):446-463.
    Harry Halpin (2011). Sense and Reference on the Web. Minds and Machines 21 (2):153-178.
    Marsha Woodbury (1998). Defining Web Ethics. Science and Engineering Ethics 4 (2):203-212.

    Analytics

    Monthly downloads

    Added to index

    2010-12-22

    Total downloads

    2 ( #232,501 of 549,088 )

    Recent downloads (6 months)

    1 ( #63,317 of 549,088 )

    How can I increase my downloads?


    My notes
    Sign in to use this feature


    Discussion
    Start a new thread
    Order:
    There  are no threads in this forum
    Nothing in this forum yet.

    Other forums