A short research bio
Grew up and lived in Greece until 2015 with brief breaks in Sweden, Spain and the United States. Lived in San Francisco and Oakland from 2015 till 2020. I am currently based in Grenoble but probably spend as much time in Barcelona.
Got my PhD in late 2014 from the National Technical University of Athens under the supervision of Prof. Stefanos Kollias and Yannis Avrithis, working closely with my research brother Giorgos Tolias. My PhD was on large-scale geometry indexing, nearest neighbor search and clustering.
From 2015 to 2017 I was a research scientist at Yahoo Research in San Francisco. The large-scale visual similarity search work of my PhD came to a nice closure when we applied it on a trully web-scale real-time application, powering the visual search feature on Flickr. At the same time, my interests expanded towards modeling of vision and language and collaborated with Stanford on the Visual Genome project.
From 2017 and till 2020, I was a research scientist at Facebook AI in Menlo Park, California. During this time my interests expanded to video understanding and deep learning architecture modeling.
On March 2020 I started working as a research scientist at Naver Labs Europe in Grenoble, France. Currently, my research interests include self-supervised representation learning, continual and streaming learning, multi-modal learning, video understanding and vision & language.
I am also very passionate about urging the research community tackle more socially impactful problems. Together with Laura Sevilla-Lara, we lead the Computer Vision for Global Challenges initative. Under this umbrella, we organized the CV4GC workshop at CVPR 2019, and the Computer Vision for Agrigulture (CV4A) workshop at ICLR 2020.
Contact Details
email: ykalant(at)image.ntua.gr yannis.kalantidis(at)naverlabs.com
Selected Publications
Full list at my Google Scholar profile.
2021
- S. Chun, S.J. Oh, R.S. de Rezende, Y. Kalantidis, D. Larlus. Probabilistic Embeddings for Cross-Modal Retrieval. In Computer Vision and Pattern recognition (CVPR), 2021.
- M.B. Sariyildiz, Y. Kalantidis, D. Larlus, K. Alahari. Concept Generalization in Visual Representation Learning. arxiv:2012.05649, 2020. [Project page]
- Y. Kalantidis, M.B. Sariyildiz, N. Pion, P. Weinzaepfel, D. Larlus. Hard Negative Mixing for Contrastive Learning. In Neural Information Processing Systems (NeurIPS), 2020. [Project page and pretrained models], [Blog post], [slides]
- B. Kang, S. Xie, M. Rohrbach, Z. Yan, A. Gordo, J. Feng, Y. Kalantidis. Decoupling Representation and Classifier for Long-Tailed Recognition. In International Conference on Learning Representations (ICLR), 2020.
- C.Y. Ma, Y. Kalantidis, G. AlRegib, P. Vajda, M. Rohrbach, Z. Kira. Learning to Generate Grounded Image Captions without Localization Supervision. In European Conference on Computer Vision (ECCV), 2020. [Project Page], [code]
- Y. Chen, H. Fan, B. Xu, Z. Yan, Y. Kalantidis, M. Rohrbach, Z. Yan, Y. Shuicheng, J. Feng. Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution. In International Conference on Computer Vision (ICCV), 2019. [Numerous Opensource Implementations].
- Y. Chen, M. Rohrbach, Z. Yan, Y. Shuicheng, J. Feng, Y. Kalantidis. Graph-Based Global Reasoning Networks. In Computer Vision and Pattern recognition (CVPR), 2019.
- L. Zhou, Y. Kalantidis, X. Chen, J. Corso, M. Rohrbach. Grounded Video Description. In Computer Vision and Pattern recognition (CVPR), 2019 (oral). [ActivityNet-Entities dataset on github]
- B. Xiong, Y. Kalantidis, D. Ghadiyaram, K. Grauman. Less is More: Learning Highlight Detection from Video Duration.. In Computer Vision and Pattern recognition (CVPR), 2019.
- Z. Shou, Z. Yan, Y. Kalantidis, L. Sevilla-Lara, M. Rohrbach, X. Lin, S.-F. Chang. DMC-Net: Generating Discriminative Motion Cues for Fast Compressed Video Action Recognition.. In Computer Vision and Pattern recognition (CVPR), 2019.
- L. Jiang, L. Cao, Y.~Kalantidis, S. Farfade and A. Hauptmann. Focal Visual-Text Attention for Memex Question Answering. In IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2019.
- J. Zhang, Y. Kalantidis, M. Rohrbach, M. Paluri A. Elgammal, M. Elhoseiny. Large-Scale Visual Relationship Understanding. In the thirty-third AAAI Conference on Artificial Intelligence (AAAI), 2019. [code]
- Y. Chen, Y. Kalantidis, J. Li, Y. Shuicheng, J. Feng. A^2-Nets: Double Attention Networks. In Neural Information Processing Systems (NeurIPS), 2018.
- Y. Chen, Y. Kalantidis, J. Li, Y. Shuicheng, J. Feng. Multi-Fiber Networks for Video Recognition. In European Conference on Computer Vision (ECCV), 2018. [code]
- R. Krishna, Y. Zhu, O. Groth, J. Johnson, K. Hata, J. Kravitz, S. Chen, Y. Kalantidis, L.-J. Li, D.A. Shamma, M. Bernstein and L. Fei-Fei. Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations. In International Journal of Computer Vision (IJCV), 2017.
- L. Jiang, L. Cao, Y. Kalantidis, S. Farfade and A. Hauptmann. MemexQA: Visual Memex Question Answering. arXiv:1708.01336, 2017.
- L. Jiang, Y. Kalantidis, L. Cao, S. Farfade, J. Tang and A. Hauptmann. Delving Deep into Personal Photo and Video Search. In Web Search and Data Mining (WSDM), 2017.
- S. Chancellor, Y. Kalantidis, J. A. Pater, M. De Choudhury and D. A. Shamma. Multimodal Classification of Moderated Online Pro-Eating Disorder Content. In ACM CHI Conference on Human Factors in Computing Systems (CHI), 2017.
- P. Garrigues, S. Farfade, H. Izadinia, Kofi Boakye and Y. Kalantidis. Tag Prediction in Flickr: A view from the darkroom. (Best paper award) In Large Scale Computer Vision systems Workshop at NeurIPS, 2016.
- Y. Kalantidis, C. Mellina and S. Osindero. Cross-dimensional Weighting for Aggregated Deep Convolutional Features. In Web-scale Vision and Social Media (VSM) Workshop, ECCV, 2016. [code]
- Y. Kalantidis, L. Kennedy, H. Nguyen, C. Mellina and D.A. Shamma. LOH and behold: Web-scale visual search, recommendation and clustering using Locally Optimized Hashing. In Web-scale Vision and Social Media (VSM) Workshop, ECCV, 2016.
- Y. Kalantidis, A. Farahat, L. Kennedy, R. Baeza-Yates and D.A. Shamma. Visual Congruent Ads for Image Search. In International Conference on Pattern Recognition (ICPR), 2016.
- Y. Avrithis, Y. Kalantidis, E. Anagnostopoulos and I. Z. Emiris. Web-scale image clustering revisited. In International Conference on Computer Vision (oral) (ICCV), 2015.
- Y. Kalantidis and Y. Avrithis. Locally Optimized Product Quantization for Approximate Nearest Neighbor Search. In Computer Vision and Pattern Recognition (CVPR), 2014. [code]
- G. Tolias, Y. Kalantidis, and Y. Avrithis. Towards large-scale geometry indexing by feature selection. Computer Vision and Image Understanding (CVIU), 2014.
- Y. Kalantidis, L. Kennedy and L.-J. Li. Getting the Look: Clothing Recognition and Segmentation for Automatic Clothing Suggestions in Everyday Photos. In International Conference on Multimedia Retrieval (Oral paper) (ICMR), 2013.
- Y. Avrithis and Y. Kalantidis. Approximate gaussian mixtures for large scale vocabularies. In European Conference on Computer Vision (ECCV), 2012.
- G. Tolias, Y. Kalantidis, and Y. Avrithis. Symcity: Feature selection by symmetry for large scale image retrieval. In ACM Multimedia (Oral paper) (ACM MM 2012), 2012.
- Y. Avrithis, Y. Kalantidis, G. Tolias, and E. Spyrou. Retrieving landmark and non-landmark images from community photo collections. In ACM Multimedia (Oral paper) (ACM MM 2010), 2010.
- Y. Avrithis, G. Tolias, and Y. Kalantidis. Feature map hashing: Sub-linear indexing of appearance and global geometry. In ACM Multimedia (Oral paper) (ACM MM 2010), 2010.
- Y. Kalantidis, LG. Pueyo, M. Trevisiol, R. van Zwol, and Y. Avrithis. Scalable triangulation-based logo recognition. In International Conference on Multimedia Retrieval (ICMR), 2011.
- Y. Kalantidis, G. Tolias, Y. Avrithis, M. Phinikettos, E. Spyrou, P. Mylonas, and S. Kollias. Viral: Visual image retrieval and localization. Multimedia Tools and Applications (MTAP), 2011.
