Photo2Trip: Exploiting Visual Contents in Geo-Tagged Photos for Personalized Tour Recommendation

Pengpeng Zhao, Chengfeng Xu, Yanchi Liu, Victor S. Sheng, Kai Zheng, Hui Xiong, Xiaofang Zhou

Research output: Contribution to journalArticlepeer-review

5 Scopus citations


Recently accumulated massive amounts of geo-Tagged photos provide an excellent opportunity to understand human behaviors and can be used for personalized tour recommendation. However, no existing work has considered the visual content information in these photos for tour recommendation. We believe the visual features of photos provide valuable information on measuring user / Point-of-Interest (POI) similarities, which is challenging due to data sparsity. To this end, in this paper, we propose a visual feature enhanced tour recommender system, named 'Photo2Trip', to utilize the visual contents and collaborative filtering models for recommendation. Specifically, we propose a Visual-enhanced Probabilistic Matrix Factorization model (VPMF), which integrates visual features into the collaborative filtering model, to learn user interests by leveraging the historical travel records. We then extend VPMF to End-To-End training framework to incorporate users (POIs) latent factors into the learning process of the visual content of photos, which generalizes the applicability of the proposed VPMF framework in tour recommendation. Extensive empirical studies verify that our proposed visual-enhanced personalized tour recommendation method outperforms other benchmark methods in terms of recommendation accuracy. The results also show that visual features are effective in alleviating the data sparsity and cold start problems on personalized tour recommendation.

Original languageEnglish (US)
Article number8850032
Pages (from-to)1708-1721
Number of pages14
JournalIEEE Transactions on Knowledge and Data Engineering
Issue number4
StatePublished - Apr 1 2021

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Computational Theory and Mathematics


  • Tour recommendation
  • collaborative filtering
  • visual content


Dive into the research topics of 'Photo2Trip: Exploiting Visual Contents in Geo-Tagged Photos for Personalized Tour Recommendation'. Together they form a unique fingerprint.

Cite this