Welcome to the InfoSci Platform
Building Multi-Modal Relational Graphs for Multimedia Retrieval

Building Multi-Modal Relational Graphs for Multimedia Retrieval

Jyh-Ren Shieh, Ching-Yung Lin, Shun-Xuan Wang, Ja-Ling Wu
Copyright: © 2013 |Pages: 22
ISBN13: 9781466629400|ISBN10: 1466629401|EISBN13: 9781466629417
DOI: 10.4018/978-1-4666-2940-0.ch009
Cite Chapter Cite Chapter

MLA

Shieh, Jyh-Ren, et al. "Building Multi-Modal Relational Graphs for Multimedia Retrieval." Multimedia Data Engineering Applications and Processing, edited by Shu-Ching Chen and Mei-Ling Shyu, IGI Global, 2013, pp. 171-192. https://doi.org/10.4018/978-1-4666-2940-0.ch009

APA

Shieh, J., Lin, C., Wang, S., & Wu, J. (2013). Building Multi-Modal Relational Graphs for Multimedia Retrieval. In S. Chen & M. Shyu (Eds.), Multimedia Data Engineering Applications and Processing (pp. 171-192). IGI Global. https://doi.org/10.4018/978-1-4666-2940-0.ch009

Chicago

Shieh, Jyh-Ren, et al. "Building Multi-Modal Relational Graphs for Multimedia Retrieval." In Multimedia Data Engineering Applications and Processing, edited by Shu-Ching Chen and Mei-Ling Shyu, 171-192. Hershey, PA: IGI Global, 2013. https://doi.org/10.4018/978-1-4666-2940-0.ch009

Export Reference

Mendeley
Favorite

Abstract

The abundance of Web 2.0 social media in various media formats calls for integration that takes into account tags associated with these resources. The authors present a new approach to multi-modal media search, based on novel related-tag graphs, in which a query is a resource in one modality, such as an image, and the results are semantically similar resources in various modalities, for instance text and video. Thus the use of resource tagging enables the use of multi-modal results and multi-modal queries, a marked departure from the traditional text-based search paradigm. Tag relation graphs are built based on multi-partite networks of existing Web 2.0 social media such as Flickr and Wikipedia. These multi-partite linkage networks (contributor-tag, tag-category, and tag-tag) are extracted from Wikipedia to construct relational tag graphs. In fusing these networks, the authors propose incorporating contributor-category networks to model contributor’s specialization; it is shown that this step significantly enhances the accuracy of the inferred relatedness of the term-semantic graphs. Experiments based on 200 TREC-5 ad-hoc topics show that the algorithms outperform existing approaches. In addition, user studies demonstrate the superiority of this visualization system and its usefulness in the real world.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.