News

Computer Vision for Global Challenges Workshop @ CVPR 2019 (January 2019)

Our first Workshop on Computer vision for Global Challenges (CV4GC) was accepted at CVPR this year! Really excited about organizing an initiative to bring the computer vision community closer to socially impactful tasks, datasets and applications for the whole world. Check out the CV4GC website!

Paper accepted in TPAMI (January 2019)

Our paper Focal Visual-Text Attention for Memex Question Answering was accepted for publication at the IEEE Transactions on Pattern Analysis and Machine Inteligence (impact factor: 9.455). It introduces our MemexQA Dataset, the first publicly available multimodal question answering dataset consisting of real personal photo albums. More info in the project page above.

Large-scale Visual Relationship Detection @ AAAI 2019 (November 2018)

Our paper Large-scale Visual Relationship Detection was accepted at the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI 2019, acceptance rate 16.2%). Code and models will be out soon!

Double Attention Networks @ NIPS 2018 (September 2018)

Our paper A^2-Nets: Double Attention Networks was accepted at NIPS 2018. See you in Montreal! Work with awesome collaborators from the National University of Singapore.

Multi-Fiber Networks @ ECCV 2018 (July 2018)

Our paper Multi-Fiber Networks for Video Recognition was accepted at the European Conference on Computer Vision (ECCV) 2018. Work with awesome collaborators from the National University of Singapore. Code on GitHub.

Do Silhouettes Dream? (May 2017)

Our interactive art installation entitled Do Silhouettes Dream? will be on display from July 26th till August 2nd 2017 at the ArtScience Museum in Singapore.
More information at this page. You may watch a short interview with Cheng and me here.

Similarity Search at Flickr (March 2017)

Our work on visual similarity search over the whole Flickr corpus just launched! Try it yourselves by clicking on the magnifying glass icon at the top right corner of any photopage! Story covered in The Verge, Engadget, Petapixel, Digital Trends and Venture Beat.

New chapter: Facebook Research (February 2017)

After two amazing years at Yahoo Research, joined the Computer Vision Group at Facebook Research in Menlo Park.

Best paper at LSCVS Workshop in NIPS 2016 (December 2016)

Our paper "Tag Prediction in Flickr: A view from the darkroom" on large scale image classification with noisy training data received the best paper award at the 1st Workshop on Large Scale Computer Vision Systems at NIPS 2016.

Paper accepted at CHI 2017 (December 2016)

Our paper "Multimodal Classification of Moderated Online Pro-Eating Disorder Content" was accepted at the ACM CHI 2017 conference (25% acceptance rate).

Demo paper accepted at AAAI 2017 (November 2016)

Our demo paper "Visual MemoryQA: your personal photo and video search agent" on personal media search using natural language questions was accepted at the Thirty-First AAAI Conference on Artificial Intelligence (AAAI 2017). You may also watch the demo's video.

Guest Lecturer at Stanford CS-131 (October 2016)

Will be a guest lecturer at Fei-Fei's and Juan Carlos' CS 131 Computer Vision: Foundations and Applications course at Stanford during the 2016-2017 Fall Semester.

Paper accepted at WSDM 2017 (October 2016)

Our paper "Delving Deep into Personal Photo and Video Search" was accepted for publication at WSDM 2017 (16% acceptance rate).

About Me

Grew up and lived in Greece until 2015 with brief breaks in Sweden, Spain and the United States. Lived in San Francisco from 2015 till 2017 and currently in Oakland.

Got my PhD in late 2014 from the National Technical University of Athens under the supervision of Prof. Stefanos Kollias and Yannis Avrithis, working closely with my research brother Giorgos Tolias.

The large-scale visual similarity search work of my PhD came to a nice closure while a researcher at Yahoo Research, as it was applied on a trully web scale powering the visual search feature on Flickr. At the same time, my interests expanded towards modeling of vision and language and collaborated with Stanford on the Visual Genome project.

Currently conducting research and development on video understanding, temporal segmentation, learning image & video representations, multi-modal classification and large-scale vision and language.

Contact Details

ykalant(at)image.ntua.gr yannisk(at)fb.com

One Page Resume Complete CV

Development projects and Demos

LOPQ Resources: Project page and code, Python code at Yahoo GitHub.
Code for the Crow features at the Yahoo GitHub.
Online demo for VIRaL: Visual Image Retrieval and Localization.

Selected Publications

Full list at my Google Scholar profile.

L. Jiang, L. Cao, Y.~Kalantidis, S. Farfade and A. Hauptmann. Focal Visual-Text Attention for Memex Question Answering. In IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2019.
Z. Shou, Z. Yan, Y. Kalantidis, L. Sevilla-Lara, M. Rohrbach, X. Lin, S.-F. Chang. DMC-Net: Generating Discriminative Motion Cues for Fast Compressed Video Action Recognition.. In arXiv:1901.03460, 2019.
L. Zhou, Y. Kalantidis, X. Chen, J. Corso, M. Rohrbach. Grounded Video Description. In arXiv:1812.06587, 2018.
Y. Chen, M. Rohrbach, Z. Yan, Y. Shuicheng, J. Feng, Y. Kalantidis. Graph-Based Global Reasoning Networks. In arXiv:1811.12814, 2018.
J. Zhang, Y. Kalantidis, M. Rohrbach, M. Paluri A. Elgammal, M. Elhoseiny. Large-Scale Visual Relationship Understanding. In the thirty-third AAAI Conference on Artificial Intelligence (AAAI), 2019.
Y. Chen, Y. Kalantidis, J. Li, Y. Shuicheng, J. Feng. A^2-Nets: Double Attention Networks. In Neural Information Processing Systems (NIPS), 2018 (accepted).
Y. Chen, Y. Kalantidis, J. Li, Y. Shuicheng, J. Feng. Multi-Fiber Networks for Video Recognition. In European Conference on Computer Vision (ECCV), 2018. [code]
R. Krishna, Y. Zhu, O. Groth, J. Johnson, K. Hata, J. Kravitz, S. Chen, Y. Kalantidis, L.-J. Li, D.A. Shamma, M. Bernstein and L. Fei-Fei. Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations. In International Journal of Computer Vision (IJCV), 2017.
L. Jiang, L. Cao, Y. Kalantidis, S. Farfade and A. Hauptmann. MemexQA: Visual Memex Question Answering. arXiv:1708.01336, 2017.
L. Jiang, Y. Kalantidis, L. Cao, S. Farfade, J. Tang and A. Hauptmann. Delving Deep into Personal Photo and Video Search. In Web Search and Data Mining (WSDM), 2017.
S. Chancellor, Y. Kalantidis, J. A. Pater, M. De Choudhury and D. A. Shamma. Multimodal Classification of Moderated Online Pro-Eating Disorder Content. In ACM CHI Conference on Human Factors in Computing Systems (CHI), 2017.
P. Garrigues, S. Farfade, H. Izadinia, Kofi Boakye and Y. Kalantidis. Tag Prediction in Flickr: A view from the darkroom. (Best paper award) In Large Scale Computer Vision systems Workshop at NIPS, 2016.
Y. Kalantidis, C. Mellina and S. Osindero. Cross-dimensional Weighting for Aggregated Deep Convolutional Features. In Web-scale Vision and Social Media (VSM) Workshop, ECCV, 2016. [code]
Y. Kalantidis, L. Kennedy, H. Nguyen, C. Mellina and D.A. Shamma. LOH and behold: Web-scale visual search, recommendation and clustering using Locally Optimized Hashing. In Web-scale Vision and Social Media (VSM) Workshop, ECCV, 2016.
Y. Kalantidis, A. Farahat, L. Kennedy, R. Baeza-Yates and D.A. Shamma. Visual Congruent Ads for Image Search. In International Conference on Pattern Recognition (ICPR), 2016.
Y. Avrithis, Y. Kalantidis, E. Anagnostopoulos and I. Z. Emiris. Web-scale image clustering revisited. In International Conference on Computer Vision (oral) (ICCV), 2015.
Y. Kalantidis and Y. Avrithis. Locally Optimized Product Quantization for Approximate Nearest Neighbor Search. In Computer Vision and Pattern Recognition (CVPR), 2014. [code]
G. Tolias, Y. Kalantidis, and Y. Avrithis. Towards large-scale geometry indexing by feature selection. Computer Vision and Image Understanding (CVIU), 2014.
Y. Kalantidis, L. Kennedy and L.-J. Li. Getting the Look: Clothing Recognition and Segmentation for Automatic Clothing Suggestions in Everyday Photos. In International Conference on Multimedia Retrieval (Oral paper) (ICMR), 2013.
Y. Avrithis and Y. Kalantidis. Approximate gaussian mixtures for large scale vocabularies. In European Conference on Computer Vision (ECCV), 2012.
G. Tolias, Y. Kalantidis, and Y. Avrithis. Symcity: Feature selection by symmetry for large scale image retrieval. In ACM Multimedia (Oral paper) (ACM MM 2012), 2012.
Y. Avrithis, Y. Kalantidis, G. Tolias, and E. Spyrou. Retrieving landmark and non-landmark images from community photo collections. In ACM Multimedia (Oral paper) (ACM MM 2010), 2010.
Y. Avrithis, G. Tolias, and Y. Kalantidis. Feature map hashing: Sub-linear indexing of appearance and global geometry. In ACM Multimedia (Oral paper) (ACM MM 2010), 2010.
Y. Kalantidis, LG. Pueyo, M. Trevisiol, R. van Zwol, and Y. Avrithis. Scalable triangulation-based logo recognition. In International Conference on Multimedia Retrieval (ICMR), 2011.
Y. Kalantidis, G. Tolias, Y. Avrithis, M. Phinikettos, E. Spyrou, P. Mylonas, and S. Kollias. Viral: Visual image retrieval and localization. Multimedia Tools and Applications (MTAP), 2011.