Chanjun Park, Minsoo Khang, Dahyun Kim. Model-Based Data-Centric AI: Bridging the Divide Between Academic Ideals and Industrial Pragmatism. arXiv preprint arXiv:2403.01832, 2024. arXiv
Xiaoyuan Zhang, Chengdong Ma, Yizhe Huang, Weidong Huang, Siyuan Qi, Song-Chun Zhu, Xue Feng, Yaodong Yang. World Models Should Prioritize the Unification of Physical and Social Dynamics. arXiv preprint arXiv:2510.21219, 2025. arXiv
Xiaoxiao Long, Qingrui Zhao, Kaiwen Zhang, Zihao Zhang, Dingrui Wang, Yumeng Liu, Zhengjie Shu, Yi Lu, Shouzheng Wang, Xinzhe Wei, et al.. A Survey: Learning Embodied Intelligence from Physical Simulators and World Models. arXiv preprint arXiv:2507.00917, 2025. arXiv
David Ha, Jürgen Schmidhuber. World models. arXiv preprint arXiv:1803.10122, 2018. arXiv
Fei-Fei Li. From Words to Worlds: Spatial Intelligence is AI’s Next Frontier. 2025. Link
Qishuo Hua, Lyumanshan Ye, Dayuan Fu, Yang Xiao, Xiaojie Cai, Yunze Wu, Jifan Lin, Junfei Wang, Pengfei Liu. Context Engineering 2.0: The Context of Context Engineering. arXiv preprint arXiv:2510.26493, 2025. arXiv
Fei-Fei Li. With Spatial Intelligence, AI Will Understand the Real World. TED Talk, 2024. Link
James M. Coughlan, Alan L. Yuille. Manhattan World: Compass Direction from a Single Image by Bayesian Inference. Proc. ICCV, 1999.
Xinyu Dou, Cuijuan Liao, Hengqi Wang, Ying Huang, Ying Tu, Xiaomeng Huang, Yiran Peng, Biqing Zhu, Jianguang Tan, Zhu Deng, et al.. Estimates of daily ground-level NO2 concentrations in China based on Random Forest model integrated K-means. Advances in Applied Energy, 2021.
Ian Goodfellow, Yoshua Bengio, Aaron Courville, Yoshua Bengio. Deep learning. 2016.
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al.. Gpt-4 technical report. arXiv preprint arXiv:2303.08774, 2023. arXiv
Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, Eric P. Xing. Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality. 2023. Link
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al.. PaLM: Scaling language modeling with pathways. Journal of Machine Learning Research, 2023.
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al.. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023. arXiv
Yutaro Yamada, Yihan Bao, Andrew K Lampinen, Jungo Kasai, Ilker Yildirim. Evaluating spatial understanding of large language models. arXiv preprint arXiv:2310.14540, 2023. arXiv
Wanyue Zhang, Yibin Huang, Yangbin Xu, JingJing Huang, Helu Zhi, Shuo Ren, Wang Xu, Jiajun Zhang. Why do mllms struggle with spatial understanding? a systematic analysis from data to architecture. arXiv preprint arXiv:2509.02359, 2025. arXiv
Yann LeCun. A path towards autonomous machine intelligence version 0.9. 2, 2022-06-27. Open Review, 2022.
Richard Sutton. The bitter lesson. Incomplete Ideas (blog), 2019.
David Silver, Richard S. Sutton. Welcome to the Era of Experience. Preprint of a chapter in an Intelligence, George Konidaris (Ed.), MIT Press, 2025.
Yoshua Bengio. The consciousness prior. arXiv preprint arXiv:1709.08568, 2017. arXiv
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik R Narasimhan, Yuan Cao. React: Synergizing reasoning and acting in language models. The eleventh international conference on learning representations, 2022.
Shibo Hao, Yi Gu, Haodi Ma, Joshua Hong, Zhen Wang, Daisy Wang, Zhiting Hu. Reasoning with language model is planning with world model. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023.
Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2016.
Jiasen Lu, Dhruv Batra, Devi Parikh, Stefan Lee. Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2019.
Shengqiong Wu, Hao Fei, Leigang Qu, Wei Ji, Tat-Seng Chua. Next-gpt: Any-to-any multimodal llm. Forty-first International Conference on Machine Learning, 2024.
Wilson Yan, Yunzhi Zhang, Pieter Abbeel, Aravind Srinivas. Videogpt: Video generation using vq-vae and transformers. arXiv preprint arXiv:2104.10157, 2021. arXiv
Heeseung Yun, Youngjae Yu, Wonsuk Yang, Kangil Lee, Gunhee Kim. Pano-avqa: Grounded audio-visual question answering on 360deg videos. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Jianguo Zhang, Kun Qian, Zhiwei Liu, Shelby Heinecke, Rui Meng, Ye Liu, Zhou Yu, Huan Wang, Silvio Savarese, Caiming Xiong. Dialogstudio: Towards richest and most diverse unified dataset collection for conversational ai. Findings of the Association for Computational Linguistics: EACL 2024, 2024.
Qiang Li, Oliver Kroemer, Zhe Su, Filipe Fernandes Veiga, Mohsen Kaboli, Helge Joachim Ritter. A review of tactile information: Perception and action through touch. IEEE Transactions on Robotics, 2020.
Haoming Liu, Zhenyu Liu. A multimodal dynamic hand gesture recognition based on radar--vision fusion. IEEE Transactions on Instrumentation and Measurement, 2023.
Seonghyun Park, An Gia Vien, Chul Lee. Cross-modal transformers for infrared and visible image fusion. IEEE Transactions on Circuits and Systems for Video Technology, 2023.
HK Salih, AA Al-Ani. Odors detection and recognition based on intelligent E-nose. J. Electr. Syst., 2024.
Eric J Topol. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine, 2019.
Sergey Levine, Peter Pastor, Alex Krizhevsky, Julian Ibarz, Deirdre Quillen. Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection. The International journal of robotics research, 2018.
SS Muhammad Nizam, Rimaniza Zainal Abidin, Nurhazarifah Che Hashim, Meng Chun Lam, Haslina Arshad, NAA Majid. A review of multimodal interaction technique in augmented reality environment. Int. J. Adv. Sci. Eng. Inf. Technol, 2018.
Ashutosh Saxena, Min Sun, Andrew Y Ng. Make3d: Learning 3d scene structure from a single still image. IEEE transactions on pattern analysis and machine intelligence, 2008.
Songyou Peng, Kyle Genova, Chiyu Jiang, Andrea Tagliasacchi, Marc Pollefeys, Thomas Funkhouser, et al.. Openscene: 3d scene understanding with open vocabularies. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Gioele Ciaparrone, Francisco Luque Sánchez, Siham Tabik, Luigi Troiano, Roberto Tagliaferri, Francisco Herrera. Deep learning in video multi-object tracking: A survey. Neurocomputing, 2020.
Daichi Azuma, Taiki Miyanishi, Shuhei Kurita, Motoaki Kawanabe. Scanqa: 3d question answering for spatial scene understanding. proceedings of the CVPR, 2022.
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers), 2019.
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al.. Language models are few-shot learners. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2020.
Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C Lawrence Zitnick, Devi Parikh. Vqa: Visual question answering. Proceedings of the IEEE International Conference on Computer Vision, 2015.
Jing Gu, Eliana Stefani, Qi Wu, Jesse Thomason, Xin Wang. Vision-and-language navigation: A survey of tasks, methods, and future directions. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022.
Changan Chen, Unnat Jain, Carl Schissler, Sebastia Vicenc Amengual Gari, Ziad Al-Halah, Vamsi Krishna Ithapu, Philip Robinson, Kristen Grauman. Soundspaces: Audio-visual navigation in 3d environments. European conference on computer vision, 2020.
Changan Chen, Carl Schissler, Sanchit Garg, Philip Kobernik, Alexander Clegg, Paul Calamia, Dhruv Batra, Philip Robinson, Kristen Grauman. Soundspaces 2.0: A simulation platform for visual-acoustic learning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
David Howard, Agoston E Eiben, Danielle Frances Kennedy, Jean-Baptiste Mouret, Philip Valencia, Dave Winkler. Evolving embodied intelligence from materials to machines. Nature Machine Intelligence, 2019.
Agrim Gupta, Silvio Savarese, Surya Ganguli, Li Fei-Fei. Embodied intelligence via learning and evolution. Nature communications, 2021.
Bhargavi Janga, Gokul Prathin Asamani, Ziheng Sun, Nicoleta Cristea. A review of practical ai for remote sensing in earth sciences. Remote Sensing, 2023.
John O'keefe, Lynn Nadel. The hippocampus as a cognitive map. 1978.
Lawrence W Barsalou. Grounded cognition. Annu. Rev. Psychol., 2008.
Benjamin Kuipers. Modeling spatial knowledge. Cognitive science, 1978.
Sebastian Thrun, Wolfram Burgard, Dieter Fox. Probabilistic Robotics. Communications of the ACM, 2002.
David Eigen, Christian Puhrsch, Rob Fergus. Depth map prediction from a single image using a multi-scale deep network. Advances in neural information processing systems (NeurIPS), 2014.
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence. PaLM-E: An Embodied Multimodal Language Model. International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA, 2023.
Benjamin Kuipers. The spatial semantic hierarchy. Artificial intelligence, 2000.
Ron Sun. Robust reasoning: integrating rule-based and similarity-based reasoning. Artificial Intelligence, 1995.
Howard Eichenbaum, Paul Dudchenko, Emma Wood, Matthew Shapiro, Heikki Tanila. The hippocampus, memory, and place cells: is it spatial memory or a memory space?. Neuron, 1999.
Gary L Allen. Human spatial memory. Mahwah, NJ, 2004.
Nils J Nilsson. Shakey the robot. 1984.
R. C. Arkin. Behavior-Based Robotics. 1998.
Edward C Tolman. Cognitive maps in rats and men.. Psychological review, 1948.
John McCarthy, Marvin L. Minsky, Nathaniel Rochester, Claude E. Shannon. A proposal for the Dartmouth summer research project on artificial intelligence, August 31, 1955. AI Magazine, 2006.
Patrick Krauss. What is Artificial Intelligence?. Artificial Intelligence and Brain Research: Neural Networks, Deep Learning and the Future of Cognition, 2024.
P. E. Hart, N. J. Nilsson, B. Raphael. A formal basis for the heuristic determination of minimum cost paths. IEEE Transactions on Systems Science and Cybernetics, 1968.
R. E. Fikes, N. J. Nilsson. STRIPS: A new approach to the application of theorem proving to problem solving. Artificial Intelligence, 1971.
Nils J Nilsson. Principles of artificial intelligence. 2014.
Judea Pearl. Heuristics: intelligent search strategies for computer problem solving. 1983.
E. W. Dijkstra. A note on two problems in connexion with graphs. Numerische Mathematik, 1959.
Roger N. Shepard, Jacqueline Metzler. Mental rotation of three-dimensional objects. Science, 1971.
Terry Winograd. Understanding natural language. Cognitive psychology, 1972.
Marvin Minsky. A Framework for Representing Knowledge. 1974.
J. F. Allen. Maintaining knowledge about temporal intervals. Communications of the ACM, 1983.
Howard E Gardner. Frames of mind: The theory of multiple intelligences. 2011.
D. A. Randell, Z. Cui, A. G. Cohn. A Spatial Logic based on Regions and Connection. Proc. KR, 1992.
Torkel Hafting, Marianne Fyhn, Sturla Molden, May-Britt Moser, Edvard I Moser. Microstructure of a spatial map in the entorhinal cortex. Nature, 2005.
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al.. Chain-of-thought prompting elicits reasoning in large language models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
H. P. Moravec, A. Elfes. High resolution maps from wide angle sonar. Proceedings of IEEE ICRA, 1985.
Randall C. Smith, Peter Cheeseman. On the Representation and Estimation of Spatial Uncertainty. The International Journal of Robotics Research, 1986.
R. A. Brooks. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, 1986.
Feng Lu, Evangelos Milios. Globally consistent range scan alignment for environment mapping. Autonomous robots, 1997.
Frank Dellaert, Dieter Fox, Wolfram Burgard, Sebastian Thrun. Monte Carlo Localization for Mobile Robots. IEEE International Conference on Robotics and Automation, 1999.
Michael Montemerlo, Sebastian Thrun, Daphne Koller, Ben Wegbreit, et al.. FastSLAM: A factored solution to the simultaneous localization and mapping problem. Aaai/iaai, 2002.
Sebastian Thrun, Mike Montemerlo, Hendrik Dahlkamp, David Stavens, Andrei Aron, James Diebel, Philip Fong, John Gale, Morgan Halpenny, Gabriel Hoffmann, et al.. Stanley: The Robot that Won the DARPA Grand Challenge. Journal of Field Robotics, 2006.
Sebastian Thrun, Michael Montemerlo. The graph SLAM algorithm with applications to large-scale mapping of urban structures. The International Journal of Robotics Research, 2006.
Andrew J Davison, Ian D Reid, Nicholas D Molton, Olivier Stasse. MonoSLAM: Real-time single camera SLAM. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2007.
Georg Klein, David Murray. Parallel Tracking and Mapping for Small AR Workspaces. Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), 2007.
Armin Hornung, Kai M Wurm, Maren Bennewitz, Cyrill Stachniss, Wolfram Burgard. OctoMap: An efficient probabilistic 3D mapping framework based on octrees. Autonomous robots, 2013.
Ji Zhang, Sanjiv Singh. LOAM: Lidar Odometry and Mapping in Real-time. Robotics: Science and Systems, 2014.
Raul Mur-Artal, Jose Maria Martinez Montiel, Juan D Tardos. ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE transactions on robotics, 2015.
Wolfgang Hess, Damon Kohler, Holger Rapp, Daniel Andor. Real-Time Loop Closure in 2D LIDAR SLAM. IEEE International Conference on Robotics and Automation, 2016.
Fei Xia, Amir R Zamir, Zhiyang He, Alexander Sax, Jitendra Malik, Silvio Savarese. Gibson env: Real-world perception for embodied agents. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, Vladlen Koltun, Jitendra Malik, et al.. Habitat: A platform for embodied ai research. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Zachary Teed, Jia Deng. Droid-slam: Deep visual slam for monocular, stereo, and rgb-d cameras. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2021.
Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Joseph Dabis, Chelsea Finn, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Jasmine Hsu, et al.. Rt-1: Robotics transformer for real-world control at scale. arXiv preprint arXiv:2212.06817, 2022. arXiv
Brianna Zitkovich, Tianhe Yu, Sichun Xu, Peng Xu, Ted Xiao, Fei Xia, Jialin Wu, Paul Wohlhart, Stefan Welker, Ayzaan Wahid, Quan Vuong, Vincent Vanhoucke, Huong T. Tran, Radu Soricut, Anikait Singh, Jaspiar Singh, Pierre Sermanet, Pannag R. Sanketi, Grecia Salazar, Michael S. Ryoo, Krista Reymann, Kanishka Rao, Karl Pertsch, Igor Mordatch, Henryk Michalewski, Yao Lu, Sergey Levine, Lisa Lee, Tsang-Wei Edward Lee, Isabel Leal, Yuheng Kuang, Dmitry Kalashnikov, Ryan Julian, Nikhil J. Joshi, Alex Irpan, Brian Ichter, Jasmine Hsu, Alexander Herzog, Karol Hausman, Keerthana Gopalakrishnan, Chuyuan Fu, Pete Florence, Chelsea Finn, Kumar Avinava Dubey, Danny Driess, Tianli Ding, Krzysztof Marcin Choromanski, Xi Chen, Yevgen Chebotar, Justice Carbajal, Noah Brown, Anthony Brohan, Montserrat Gonzalez Arenas, Kehang Han. RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control. Conference on Robot Learning, CoRL 2023, 6-9 November 2023, Atlanta, GA, USA, 2023.
Xavier Puig, Eric Undersander, Andrew Szot, Mikael Dallaire Cote, Tsung-Yen Yang, Ruslan Partsey, Ruta Desai, Alexander William Clegg, Michal Hlavac, So Yeon Min, et al.. Habitat 3.0: A co-habitat for humans, avatars and robots. arXiv preprint arXiv:2310.13724, 2023. arXiv
Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan Paul Foster, Pannag R. Sanketi, Quan Vuong, Thomas Kollar, Benjamin Burchfiel, Russ Tedrake, Dorsa Sadigh, Sergey Levine, Percy Liang, Chelsea Finn. OpenVLA: An Open-Source Vision-Language-Action Model. Conference on Robot Learning, 6-9 November 2024, Munich, Germany, 2024. Link
Kevin Black, Noah Brown, Danny Driess, Adnan Esmail, Michael Equi, Chelsea Finn, Niccolo Fusai, Lachy Groom, Karol Hausman, Brian Ichter, Szymon Jakubczak, Tim Jones, Liyiming Ke, Sergey Levine, Adrian Li-Bell, Mohith Mothukuri, Suraj Nair, Karl Pertsch, Lucy Xiaoyang Shi, James Tanner, Quan Vuong, Anna Walling, Haohuan Wang, Ury Zhilinsky. \(π\)\(_0\): A Vision-Language-Action Flow Model for General Robot Control. CoRR, 2024. arXivDOI
M. A. Fischler, R. C. Bolles. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 1981.
H. C. Longuet-Higgins. A computer algorithm for reconstructing a scene from two projections. Nature, 1981.
Bruce D Lucas, Takeo Kanade. An Iterative Image Registration Technique with an Application to Stereo Vision. International Joint Conference on Artificial Intelligence, 1981.
David Marr. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. 1982.
William E Lorensen, Harvey E Cline. Marching cubes: A high resolution 3D surface construction algorithm. Seminal graphics: pioneering efforts that shaped the field, 1998.
Paul J. Besl, Neil D. McKay. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992.
Carlo Tomasi, Takeo Kanade. Shape and motion from image streams under orthography: a factorization method. International journal of computer vision (IJCV), 1992.
Michael F Goodchild. Geographical information science. International journal of geographical information systems, 1992.
Brian Curless, Marc Levoy. A volumetric method for building complex models from range images. Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996.
Bill Triggs, Philip F McLauchlan, Richard I Hartley, Andrew W Fitzgibbon. Bundle adjustment—a modern synthesis. Vision Algorithms: Theory and Practice: International Workshop on Vision Algorithms Corfu, Greece, 2000.
David G Lowe. Distinctive image features from scale-invariant keypoints. International journal of computer vision, 2004.
Richard Hartley, Andrew Zisserman. Multiple View Geometry in Computer Vision. 2004.
Noah Snavely, Steven M Seitz, Richard Szeliski. Photo tourism: exploring photo collections in 3D. ACM siggraph 2006 papers, 2006.
Richard A Newcombe, Shahram Izadi, Otmar Hilliges, David Molyneaux, David Kim, Andrew J Davison, Pushmeet Kohi, Jamie Shotton, Steve Hodges, Andrew Fitzgibbon. Kinectfusion: Real-time dense surface mapping and tracking. 2011 10th IEEE international symposium on mixed and augmented reality, 2011.
Johannes L Schonberger, Jan-Michael Frahm. Structure-from-motion revisited. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
Yao Yao, Zixin Luo, Shiwei Li, Tian Fang, Long Quan. Mvsnet: Depth inference for unstructured multi-view stereo. Proceedings of the European conference on computer vision (ECCV), 2018.
Jeong Joon Park, Peter Florence, Julian Straub, Richard Newcombe, Steven Lovegrove. Deepsdf: Learning continuous signed distance functions for shape representation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2019.
Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, Andreas Geiger. Occupancy networks: Learning 3d reconstruction in function space. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2019.
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, Ren Ng. Nerf: Representing scenes as neural radiance fields for view synthesis. Communications of the ACM, 2021.
Thomas Müller, Alex Evans, Christoph Schied, Alexander Keller. Instant neural graphics primitives with a multiresolution hash encoding. ACM transactions on graphics (TOG), 2022.
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis. 3D Gaussian splatting for real-time radiance field rendering.. ACM Trans. Graph., 2023.
Shuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii, Jerome Revaud. Dust3r: Geometric 3d vision made easy. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Jianyuan Wang, Minghao Chen, Nikita Karaev, Andrea Vedaldi, Christian Rupprecht, David Novotny. Vggt: Visual geometry grounded transformer. Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR), 2025.
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, Li Fei-Fei. ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2009.
Alex Krizhevsky, Ilya Sutskever, Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems (NeurIPS), 2012.
Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2014.
Jonathan Long, Evan Shelhamer, Trevor Darrell. Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2015.
Alexey Dosovitskiy, et al.. FlowNet: Learning Optical Flow with Convolutional Networks. Proceedings of theInternational Conference on Computer Vision (ICCV), 2015.
Shaoqing Ren, Kaiming He, Ross Girshick, Jian Sun. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE transactions on pattern analysis and machine intelligence, 2016.
Joseph Redmon, Santosh Divvala, Ross Girshick, Ali Farhadi. You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2016.
Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick. Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Charles R Qi, Hao Su, Kaichun Mo, Leonidas J Guibas. Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2017.
Tinghui Zhou, Matthew Brown, Noah Snavely, David G Lowe. Unsupervised learning of depth and ego-motion from video. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2017.
Sen Wang, Ronald Clark, Hongkai Wen, Niki Trigoni. DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2017.
Yin Zhou, Oncel Tuzel. Voxelnet: End-to-end learning for point cloud based 3d object detection. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, Sergey Zagoruyko. End-to-end object detection with transformers. European conference on computer vision, 2020.
Jonah Philion, Sanja Fidler. Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D. European Conference on Computer Vision, 2020.
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al.. Segment anything. IEEE/CVF International Conference on Computer Vision, Proceedings of theInternational Conference on Computer Vision (ICCV) 2023, Paris, France, October 1-6, 2023, 2023.
Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Mahmoud Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jegou, Julien Mairal, Patrick Labatut, Armand Joulin, Piotr Bojanowski. DINOv2: Learning Robust Visual Features without Supervision. 2024. arXiv
Lihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu, Jiashi Feng, Hengshuang Zhao. Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2024.
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, Illia Polosukhin. Attention is all you need. Advances in neural information processing systems (NeurIPS), 2017.
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al.. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020. arXiv
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al.. Learning transferable visual models from natural language supervision. Proceedings of the International Conference on Machine Learning (ICML), 2021.
Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, et al.. Flamingo: a visual language model for few-shot learning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Boyuan Chen, Zhuo Xu, Sean Kirmani, Brian Ichter, Dorsa Sadigh, Leonidas J. Guibas, Fei Xia. SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2024.
Danijar Hafner, Timothy Lillicrap, Jimmy Ba, Mohammad Norouzi. Dream to Control: Learning Behaviors by Latent Imagination. arXiv preprint arXiv:1912.01603, 2019. arXiv
Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, Laurent Sifre, Simon Schmitt, Arthur Guez, Edward Lockhart, Demis Hassabis, Thore Graepel, Timothy Lillicrap, David Silver. Mastering atari, go, chess and shogi by planning with a learned model. Nature, 2020.
Scott Reed, Konrad Zolna, Emilio Parisotto, et al.. A Generalist Agent. Transactions on Machine Learning Research (TMLR), 2022.
Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, Anima Anandkumar. Voyager: An open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291, 2023. arXiv
Mahmoud Assran, Quentin Duval, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Yann LeCun, Nicolas Ballas. Self-supervised learning from images with a joint-embedding predictive architecture. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, Timothy Lillicrap. Mastering diverse domains through world models. arXiv preprint arXiv:2301.04104, 2023. arXiv
Jake Bruce, Michael Dennis, Ashley Edwards, Jack Parker-Holder, Yuge Shi, Edward Hughes, Matthew Lai, Aditi Mavalankar, Richie Steigerwald, Chris Apps, et al.. Genie: Generative Interactive Environments. International Conference on Machine Learning, 2024.
Tim Brooks, Bill Peebles, Connor Holmes, Will DePue, Yufei Guo, Li Jing, David Schnurr, Joe Taylor, Troy Luhman, Eric Luhman, et al.. Video generation models as world simulators. OpenAI Blog, 2024.
Mido Assran, Adrien Bardes, David Fan, Quentin Garrido, Russell Howes, Matthew Muckley, Ammar Rizvi, Claire Roberts, Koustuv Sinha, Artem Zholus, et al.. V-jepa 2: Self-supervised video models enable understanding, prediction and planning. arXiv preprint arXiv:2506.09985, 2025. arXiv
NVIDIA. Cosmos World Foundation Model Platform for Physical AI. 2025. arXiv
Philip J. Ball, Jakob Bauer, Frank Belletti, Bethanie Brownfield, Ariel Ephrat, Shlomi Fruchter, Agrim Gupta, Kristian Holsheimer, Aleksander Holynski, Jiri Hron, Christos Kaplanis, Marjorie Limont, Matt McGill, Yanko Oliveira, Jack Parker-Holder, Frank Perbet, Guy Scully, Jeremy Shar, Stephen Spencer, Omer Tov, Ruben Villegas, Emma Wang, Jessica Yung, Cip Baetu, Jordi Berbel, David Bridson, Jake Bruce, Gavin Buttimore, Sarah Chakera, Bilva Chandra, Paul Collins, Alex Cullum, Bogdan Damoc, Vibha Dasagi, Maxime Gazeau, Charles Gbadamosi, Woohyun Han, Ed Hirst, Ashyana Kachra, Lucie Kerley, Kristian Kjems, Eva Knoepfel, Vika Koriakin, Jessica Lo, Cong Lu, Zeb Mehring, Alex Moufarek, Henna Nandwani, Valeria Oliveira, Fabio Pardo, Jane Park, Andrew Pierson, Ben Poole, Helen Ran, Tim Salimans, Manuel Sanchez, Igor Saprykin, Amy Shen, Sailesh Sidhwani, Duncan Smith, Joe Stanton, Hamish Tomlinson, Dimple Vijaykumar, Luyu Wang, Piers Wingfield, Nat Wong, Keyang Xu, Christopher Yew, Nick Young, Vadim Zubov, Douglas Eck, Dumitru Erhan, Koray Kavukcuoglu, Demis Hassabis, Zoubin Gharamani, Raia Hadsell, Aäron van den Oord, Inbar Mosseri, Adrian Bolton, Satinder Singh, Tim Rocktäschel. Genie 3: A New Frontier for World Models. 2025.
Fei-Fei Li. Marble: A Multimodal World Model. 2025. Link
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, Anil Anthony Bharath. Deep reinforcement learning: A brief survey. IEEE signal processing magazine, 2017.
Frank Dellaert, Michael Kaess. Square root SAM: Simultaneous localization and mapping via square root information smoothing. The International Journal of Robotics Research, 2006.
Randall Smith, Matthew Self, Peter Cheeseman. Estimating uncertain spatial relationships in robotics. Autonomous robot vehicles, 1990.
Yaakov Bar-Shalom, X Rong Li, Thiagalingam Kirubarajan. Estimation with applications to tracking and navigation: theory algorithms and software. 2001.
Sebastian Thrun, et al.. Robotic mapping: A survey. Exploring artificial intelligence in the new millennium, 2002.
Gary Bishop, Greg Welch, et al.. An introduction to the kalman filter. Proc of SIGGRAPH, Course, 2001.
S. M. LaValle. Planning Algorithms. 2006.
MWM Gamini Dissanayake, Paul Newman, Steve Clark, Hugh F Durrant-Whyte, Michael Csorba. A solution to the simultaneous localization and map building (SLAM) problem. IEEE Transactions on robotics and automation, 2001.
Tim Bailey, Juan Nieto, Jose Guivant, Michael Stevens, Eduardo Nebot. Consistency of the EKF-SLAM algorithm. 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2006.
Giorgio Grisetti, Rainer Kümmerle, Cyrill Stachniss, Wolfram Burgard. A Tutorial on Graph-Based SLAM. IEEE Intelligent Transportation Systems Magazine, 2010.
Dmitry Chetverikov, Dmitry Svirko, Dmitry Stepanov, Pavel Krsek. The trimmed iterative closest point algorithm. 2002 International Conference on Pattern Recognition, 2002.
Matthias Nießner, Michael Zollhöfer, Shahram Izadi, Marc Stamminger. Real-time 3D reconstruction at scale using voxel hashing. ACM Transactions on Graphics (ToG), 2013.
Zhenlong Li, Huan Ning, Song Gao, Krzysztof Janowicz, Wenwen Li, Samantha T Arundel, Chaowei Yang, Budhendra Bhaduri, Shaowen Wang, A-Xing Zhu, et al.. Giscience in the era of artificial intelligence: A research agenda towards autonomous gis. Annals of GIS, 2025.
Shaoqing Ren, Kaiming He, Ross Girshick, Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2015.
Andreas Geiger, Philip Lenz, Raquel Urtasun. Are we ready for autonomous driving? The KITTI vision benchmark suite. 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, June 16-21, 2012, 2012.
Olaf Ronneberger, Philipp Fischer, Thomas Brox. U-Net: Convolutional Networks for Biomedical Image Segmentation. MICCAI, 2015.
Waseem Rawat, Zenghui Wang. Deep convolutional neural networks for image classification: A comprehensive review. Neural computation, 2017.
Haotian Tang, Zhijian Liu, Shengyu Zhao, Yujun Lin, Ji Lin, Hanrui Wang, Song Han. Searching efficient 3d architectures with sparse point-voxel convolution. European conference on computer vision, 2020.
Arun CS Kumar, Suchendra M Bhandarkar, Mukta Prasad. Depthnet: A recurrent neural network architecture for monocular depth prediction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018.
Keisuke Tateno, Federico Tombari, Iro Laina, Nassir Navab. Cnn-slam: Real-time dense monocular slam with learned depth prediction. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Clément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J Brostow. Digging into self-supervised monocular depth estimation. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Zhijian Liu, Haotian Tang, Alexander Amini, Xinyu Yang, Huizi Mao, Daniela L Rus, Song Han. Bevfusion: Multi-task multi-sensor fusion with unified bird's-eye view representation. 2023 IEEE international conference on robotics and automation (ICRA), 2023.
Alex Kendall, Hayk Martirosyan, Saumitro Dasgupta, Peter Henry, Ryan Kennedy, Abraham Bachrach, Adam Bry. End-to-end learning of geometry and context for deep stereo regression. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Vincent Sitzmann, Michael Zollhöfer, Gordon Wetzstein. Scene representation networks: Continuous 3d-structure-aware neural scene representations. Advances in Neural Information Processing Systems (NeurIPS), 2019.
Jonathan Ho, Ajay Jain, Pieter Abbeel. Denoising diffusion probabilistic models. Advances in neural information processing systems (NeurIPS), 2020.
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, Björn Ommer. High-resolution image synthesis with latent diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Lingdong Kong, Wesley Yang, Jianbiao Mei, Youquan Liu, Ao Liang, Dekai Zhu, Dongyue Lu, Wei Yin, Xiaotao Hu, Mingkai Jia, et al.. 3d and 4d world modeling: A survey. arXiv preprint arXiv:2509.07996, 2025. arXiv
Albert Pumarola, Enric Corona, Gerard Pons-Moll, Francesc Moreno-Noguer. D-nerf: Neural radiance fields for dynamic scenes. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2021.
Zhengqi Li, Simon Niklaus, Noah Snavely, Oliver Wang. Neural scene flow fields for space-time view synthesis of dynamic scenes. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Weikang Bian, Zhaoyang Huang, Xiaoyu Shi, Yijin Li, Fu-Yun Wang, Hongsheng Li. GS-DiT: Advancing Video Generation with Pseudo 4D Gaussian Fields through Efficient Dense 3D Point Tracking. 2025. arXiv
Yezhen Cong, Samar Khanna, Chenlin Meng, Patrick Liu, Erik Rozi, Yutong He, Marshall Burke, David Lobell, Stefano Ermon. Satmae: Pre-training transformers for temporal and multi-spectral satellite imagery. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Xian Sun, Peijin Wang, Wanxuan Lu, Zicong Zhu, Xiaonan Lu, Qibin He, Junxi Li, Xuee Rong, Zhujun Yang, Hao Chang, et al.. RingMo: A remote sensing foundation model with masked image modeling. IEEE Transactions on Geoscience and Remote Sensing, 2022.
Nicholas Pfaff, Evelyn Fu, Jeremy Binagia, Phillip Isola, Russ Tedrake. Scalable real2sim: Physics-aware asset generation via robotic pick-and-place setups. 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025.
Mutian Xu, Chongjie Ye, Haolin Liu, Yushuang Wu, Jiahao Chang, Xiaoguang Han. Stable-sim2real: Exploring simulation of real-captured 3d data with two-stage depth diffusion. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Arslan Ali, Junjie Bai, Maciej Bala, Yogesh Balaji, Aaron Blakeman, Tiffany Cai, Jiaxin Cao, Tianshi Cao, Elizabeth Cha, Yu-Wei Chao, et al.. World simulation with video foundation models for physical ai. arXiv preprint arXiv:2511.00062, 2025. arXiv
Yufei Wang, Zhou Xian, Feng Chen, Tsun-Hsuan Wang, Yian Wang, Katerina Fragkiadaki, Zackory Erickson, David Held, Chuang Gan. Robogen: Towards unleashing infinite data for automated robot learning via generative simulation. arXiv preprint arXiv:2311.01455, 2023. arXiv
Delong Chen, Mustafa Shukor, Theo Moutakanni, Willy Chung, Jade Yu, Tejaswi Kasarla, Yejin Bang, Allen Bolourchi, Yann LeCun, Pascale Fung. Vl-jepa: Joint embedding predictive architecture for vision-language. arXiv preprint arXiv:2512.10942, 2025. arXiv
Haoyu Zhen, Xiaowen Qiu, Peihao Chen, Jincheng Yang, Xin Yan, Yilun Du, Yining Hong, Chuang Gan. 3d-vla: A 3d vision-language-action generative world model. arXiv preprint arXiv:2403.09631, 2024. arXiv
Yuncong Yang, Jiageng Liu, Zheyuan Zhang, Siyuan Zhou, Reuben Tan, Jianwei Yang, Yilun Du, Chuang Gan. Mindjourney: Test-time scaling with world models for spatial reasoning. Advances in Neural Information Processing Systems, 2026.
Samuel Garcin, Thomas Walker, Steven McDonagh, Tim Pearce, Hakan Bilen, Tianyu He, Kaixin Wang, Jiang Bian. Beyond Pixel Histories: World Models with Persistent 3D State. arXiv preprint arXiv:2603.03482, 2026. arXiv
Andrew Szot, Alexander Clegg, Eric Undersander, Erik Wijmans, Yili Zhao, John Turner, Noah Maestre, Mustafa Mukadam, Devendra Singh Chaplot, Oleksandr Maksymets, et al.. Habitat 2.0: Training home assistants to rearrange their habitat. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2021.
Santhosh Kumar Ramakrishnan, Aaron Gokaslan, Erik Wijmans, Oleksandr Maksymets, Alexander Clegg, John M. Turner, Eric Undersander, Wojciech Galuba, Andrew Westbury, Angel X. Chang, Manolis Savva, Yili Zhao, Dhruv Batra. Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI. Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2021. arXiv
Yufeng Cui, Honghao Chen, Haoge Deng, Xu Huang, Xinghang Li, Jirong Liu, Yang Liu, Zhuoyan Luo, Jinsheng Wang, Wenxuan Wang, et al.. Emu3. 5: Native multimodal models are world learners. arXiv preprint arXiv:2510.26583, 2025. arXiv
Jie Feng, Jinwei Zeng, Qingyue Long, Hongyi Chen, Jie Zhao, Yanxin Xi, Zhilun Zhou, Yuan Yuan, Shengyuan Wang, Qingbin Zeng, et al.. A survey of large language model-powered spatial intelligence across scales: Advances in embodied agents, smart cities, and earth science. arXiv preprint arXiv:2504.09848, 2025. arXiv
Rui Yang, Hanyang Chen, Junyu Zhang, Mark Zhao, Cheng Qian, Kangrui Wang, Qineng Wang, Teja Venkat Koripella, Marziyeh Movahedi, Manling Li, et al.. Embodiedbench: Comprehensive benchmarking multi-modal large language models for vision-driven embodied agents. arXiv preprint arXiv:2502.09560, 2025. arXiv
Max J Egenhofer. Reasoning about binary topological relations. Symposium on Spatial Databases, 1991.
James F. Allen. Maintaining knowledge about temporal intervals. Communications of the ACM, 1983.
Frank Dellaert, Michael Kaess. Factor graphs for robot perception. Foundations and Trends® in Robotics, 2017.
Tong Wu, Guandao Yang, Zhibing Li, Kai Zhang, Ziwei Liu, Leonidas Guibas, Dahua Lin, Gordon Wetzstein. Gpt-4v (ision) is a human-aligned evaluator for text-to-3d generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Barbara Landau, Ray Jackendoff. Whence and whither in spatial language and spatial cognition?. Behavioral and brain sciences, 1993.
Daniel R. Montello. Scale and multiple psychologies of space. Spatial Information Theory: A Theoretical Basis for GIS (COSIT), 1993.
Stephen C. Levinson. Space in Language and Cognition: Explorations in Cognitive Diversity. 2003.
David H. Uttal, Nathaniel G. Meadow, Elizabeth Tipton, Linda L. Hand, Alison R. Alden, Christopher Warren, Nora S. Newcombe. The malleability of spatial skills: a meta-analysis of training studies. Psychological Bulletin, 2013.
Kimberly L Stachenfeld, Matthew M Botvinick, Samuel J Gershman. The hippocampus as a predictive map. Nature neuroscience, 2017.
Scott Ettinger, Shuyang Cheng, Benjamin Caine, Chenxi Liu, Hang Zhao, Sabeek Pradhan, Yuning Chai, Ben Sapp, Charles Qi, Yin Zhou, Zoey Yang, Aurelien Chouard, Pei Sun, Jiquan Ngiam, Vijay Vasudevan, Alexander McCauley, Jonathon Shlens, Dragomir Anguelov. Large Scale Interactive Motion Forecasting for Autonomous Driving: The Waymo Open Motion Dataset. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Khan Muhammad, Tanveer Hussain, Hayat Ullah, Javier Del Ser, Mahdi Rezaei, Neeraj Kumar, Mohammad Hijji, Paolo Bellavista, Victor Hugo C De Albuquerque. Vision-based semantic segmentation in scene understanding for autonomous driving: Recent achievements, challenges, and outlooks. IEEE Transactions on Intelligent Transportation Systems, 2022.
Lele Chen, Chen Cao, Fernando De la Torre, Jason Saragih, Chenliang Xu, Yaser Sheikh. High-fidelity face tracking for ar/vr via deep lighting adaptation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip Davidson, Olaf Kähler, Mingsong Dou, Vladimir Tankovich, Shahram Izadi. Holoportation: Virtual 3D Teleportation in Real-Time. Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST), 2016.
Jinxing Hu, Zhihan Lv, Diping Yuan, Bing He, Wenjiang Chen, Xiongfei Ye, Donghao Li, Ge Yang. A spatiotemporal intelligent framework and experimental platform for urban digital twins. Virtual Real. Intell. Hardw., 2023.
Diogo Carbonera Luvizon, Bogdan Tomoyuki Nassu, Rodrigo Minetto. A Video-Based System for Vehicle Speed Measurement in Urban Roadways. IEEE Transactions on Intelligent Transportation Systems, 2017.
Yao Mu, Tianxing Chen, Shijia Peng, Zanxin Chen, Zeyu Gao, Yude Zou, Lunkai Lin, Zhiqiang Xie, Ping Luo. Robotwin: Dual-arm robot benchmark with generative digital twins (early version). European Conference on Computer Vision, 2024.
Gauthier Picard, Clément Caron, Jean-Loup Farges, Jonathan Guerra, Cédric Pralet, Stéphanie Roussel. Autonomous Agents and Multiagent Systems Challenges in Earth Observation Satellite Constellations. arXiv preprint, 2021.
John B. Carroll. Human Cognitive Abilities: A Survey of Factor-Analytic Studies. 1993.
Jihan Yang, Shusheng Yang, Anjali W Gupta, Rilyn Han, Li Fei-Fei, Saining Xie. Thinking in space: How multimodal large language models see, remember, and recall spaces. 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Leonard Talmy. How language structures space. Spatial Orientation: Theory, Research, and Application, 1983.
Boyuan Chen, Zhuo Xu, Sean Kirmani, Brain Ichter, Dorsa Sadigh, Leonidas Guibas, Fei Xia. Spatialvlm: Endowing vision-language models with spatial reasoning capabilities. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Tongtong Feng, Xin Wang, Yu-Gang Jiang, Wenwu Zhu. Embodied ai: From llms to world models. arXiv preprint arXiv:2509.20021, 2025. arXiv
Pingyue Zhang, Zihan Huang, Yue Wang, Jieyu Zhang, Letian Xue, Zihan Wang, Qineng Wang, Keshigeyan Chandrasegaran, Ruohan Zhang, Yejin Choi, et al.. Theory of Space: Can Foundation Models Construct Spatial Beliefs through Active Exploration?. The Fourteenth International Conference on Learning Representations, 2026.
Edward T. Hall. The Hidden Dimension. 1966.
Rafael C. Gonzalez, Richard E. Woods. Digital Image Processing. 2011.
Richard Szeliski. Computer Vision: Algorithms and Applications. 2022.
Yann LeCun, Léon Bottou, Yoshua Bengio, Patrick Haffner. Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE, 1998.
Andrej Karpathy, et al.. Large-Scale Video Classification with Convolutional Neural Networks. CVPR, 2014.
Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, Saining Xie. A convnet for the 2020s. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Du Tran, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, Manohar Paluri. Learning spatiotemporal features with 3d convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, 2015.
Joao Carreira, Andrew Zisserman. Quo vadis, action recognition? a new model and the kinetics dataset. proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
Anurag Arnab, Mostafa Dehghani, Georg Heigold, Chen Sun, Mario Lučić, Cordelia Schmid. Vivit: A video vision transformer. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Ze Liu, Jia Ning, Yue Cao, Yixuan Wei, Zheng Zhang, Stephen Lin, Han Hu. Video swin transformer. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Xiangtai Li, Henghui Ding, Haobo Yuan, Wenwei Zhang, Jiangmiao Pang, Guangliang Cheng, Kai Chen, Ziwei Liu, Chen Change Loy. Transformer-Based Visual Segmentation: A Survey. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2024.
Alexander Kirillov, et al.. Panoptic Segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2019.
Federico Perazzi, Jordi Pont-Tuset, Brian McWilliams, Luc Van Gool, Markus Gross, Alexander Sorkine-Hornung. A benchmark dataset and evaluation methodology for video object segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
Zhaoqing Wang, Yu Lu, Qiang Li, Xunqiang Tao, Yandong Guo, Mingming Gong, Tongliang Liu. Cris: Clip-driven referring image segmentation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Seonguk Seo, Joon-Young Lee, Bohyung Han. Urvos: Unified referring video object segmentation network with a large-scale benchmark. European conference on computer vision, 2020.
Jonathan T. Barron, Jitendra Malik. Shape, Illumination, and Reflectance from Shading. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015.
Robert J. Woodham. Photometric Method for Determining Surface Orientation from Multiple Images. Optical Engineering, 1980.
David Eigen, Rob Fergus. Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture. Proceedings of theInternational Conference on Computer Vision (ICCV), 2015.
John Canny. A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986.
Saining Xie, Zhuowen Tu. Holistically-Nested Edge Detection. Proceedings of theInternational Conference on Computer Vision (ICCV), 2015.
Berthold K. P. Horn, Brian G. Schunck. Determining Optical Flow. Artificial Intelligence, 1981.
Thomas Brox, Andres Bruhn, Nils Papenberg, Joachim Weickert. High Accuracy Optical Flow Estimation Based on a Theory for Warping. European Conference on Computer Vision, 2004.
Zachary Teed, Jia Deng. RAFT: Recurrent All-Pairs Field Transforms for Optical Flow. ECCV, 2020.
Alejandro Newell, Kaiyu Yang, Jia Deng. Stacked Hourglass Networks for Human Pose Estimation. ECCV, 2016.
Chris Harris, Mike Stephens. A Combined Corner and Edge Detector. Alvey Vision Conference, 1988.
Alexander Toshev, Christian Szegedy. DeepPose: Human Pose Estimation via Deep Neural Networks. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2014.
Ce Zheng, Wenjun Wu, Chen Chen, Tao Yang, Sijie Zhu, Chao Chen, Runze Yang, Zhenzhong Yu. Deep Learning-Based Human Pose Estimation: A Survey. arXiv preprint arXiv:2204.07370, 2022. arXiv
Jifeng Dai, Yi Li, Kaiming He, Jian Sun. R-fcn: Object detection via region-based fully convolutional networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2016.
Tuan-Hung Vu, Himalaya Jain, Maxime Bucher, Matthieu Cord, Patrick Pérez. Dada: Depth-aware domain adaptation in semantic segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Guilherme N DeSouza, Avinash C Kak. Vision for mobile robot navigation: A survey. IEEE transactions on pattern analysis and machine intelligence, 2002.
Antonio Bicchi, Vijay Kumar. Robotic grasping and contact: A review. Proceedings 2000 ICRA. Millennium conference. IEEE international conference on robotics and automation. Symposia proceedings (Cat. No. 00CH37065), 2000.
Ashutosh Saxena, Justin Driemeyer, Justin Kearns, Andrew Ng. Robotic grasping of novel objects. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2006.
Haoyu Zhao, Linghao Zhuang, Xingyue Zhao, Cheng Zeng, Haoran Xu, Yuming Jiang, Jun Cen, Kexiang Wang, Jiayan Guo, Siteng Huang, et al.. Towards Affordance-Aware Robotic Dexterous Grasping with Human-like Priors. arXiv preprint arXiv:2508.08896, 2025. arXiv
Özgün Çiçek, Ahmed Abdulkadir, Soeren S Lienkamp, Thomas Brox, Olaf Ronneberger. 3D U-Net: learning dense volumetric segmentation from sparse annotation. International conference on medical image computing and computer-assisted intervention, 2016.
Behnam Behroozpour, Phillip AM Sandborn, Ming C Wu, Bernhard E Boser. Lidar system architectures and circuits. IEEE Communications Magazine, 2017.
Charles Ruizhongtai Qi, Li Yi, Hao Su, Leonidas J Guibas. PointNet++: Deep hierarchical feature learning on point sets in a metric space. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017.
Jonathan T Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, Pratul P Srinivasan. Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields. Proceedings of the IEEE/CVF international conference on computer vision (ICCV), 2021.
Jonathan T Barron, Ben Mildenhall, Dor Verbin, Pratul P Srinivasan, Peter Hedman. Zip-nerf: Anti-aliased grid-based neural radiance fields. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan, Peter Hedman, Ricardo Martin-Brualla, Jonathan T. Barron. MultiNeRF: A Code Release for Mip-NeRF 360, Ref-NeRF, and RawNeRF. 2022. Link
Thomas Porter, Tom Duff. Compositing digital images. Proceedings of the 11th annual conference on Computer graphics and interactive techniques, 1984.
Shichen Liu, Tianye Li, Weikai Chen, Hao Li. Soft rasterizer: A differentiable renderer for image-based 3d reasoning. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Tianchang Shen, Jun Gao, Kangxue Yin, Ming-Yu Liu, Sanja Fidler. Deep marching tetrahedra: a hybrid representation for high-resolution 3d shape synthesis. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2021.
Delio Vicini, Sébastien Speierer, Wenzel Jakob. Differentiable signed distance function rendering. ACM Transactions on Graphics (ToG), 2022.
Eric R Chan, Connor Z Lin, Matthew A Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas J Guibas, Jonathan Tremblay, Sameh Khamis, et al.. Efficient geometry-aware 3d generative adversarial networks. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
John McCormac, Ankur Handa, Andrew Davison, Stefan Leutenegger. Semanticfusion: Dense 3d semantic mapping with convolutional neural networks. 2017 IEEE International Conference on Robotics and automation (ICRA), 2017.
Daniel Maturana, Sebastian Scherer. Voxnet: A 3d convolutional neural network for real-time object recognition. 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS), 2015.
Maxim Tatarchenko, Alexey Dosovitskiy, Thomas Brox. Octree generating networks: Efficient convolutional architectures for high-resolution 3d outputs. Proceedings of the IEEE international conference on computer vision, 2017.
Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip HS Torr, Vladlen Koltun. Point transformer. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Guocheng Qian, Yuchen Li, Houwen Peng, Jinjie Mai, Hasan Hammoud, Mohamed Elhoseiny, Bernard Ghanem. Pointnext: Revisiting pointnet++ with improved training and scaling strategies. Advances in neural information processing systems, 2022.
Rana Hanocka, Amir Hertz, Noa Fish, Raja Giryes, Shachar Fleishman, Daniel Cohen-Or. Meshcnn: a network with an edge. ACM Transactions on Graphics (ToG), 2019.
Nanyang Wang, Yinda Zhang, Zhuwen Li, Yanwei Fu, Wei Liu, Yu-Gang Jiang. Pixel2mesh: Generating 3d mesh models from single rgb images. Proceedings of the European conference on computer vision (ECCV), 2018.
Thibault Groueix, Matthew Fisher, Vladimir G Kim, Bryan C Russell, Mathieu Aubry. A papier-mâché approach to learning 3d surface generation. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Wenzheng Chen, Huan Ling, Jun Gao, Edward Smith, Jaakko Lehtinen, Alec Jacobson, Sanja Fidler. Learning to predict 3d objects with an interpolation-based differentiable renderer. Advances in neural information processing systems (NeurIPS), 2019.
Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, Wenping Wang. Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction. Advances in Neural Information Processing Systems (NeurIPS), 2021.
Sara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen, Benjamin Recht, Angjoo Kanazawa. Plenoxels: Radiance fields without neural networks. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2022.
Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, Andreas Geiger. Mip-splatting: Alias-free 3d gaussian splatting. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2024.
Tao Lu, Mulin Yu, Linning Xu, Yuanbo Xiangli, Limin Wang, Dahua Lin, Bo Dai. Scaffold-gs: Structured 3d gaussians for view-adaptive rendering. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Xiuming Zhang, Pratul P. Srinivasan, Boyang Deng, Paul Debevec, William T. Freeman, Jonathan T. Barron. NeRFactor: Neural factorization of shape and reflectance under an unknown illumination. ACM Transactions on Graphics, 2021.
Yiran Wang, Min Shi, Jiaqi Li, Zihao Huang, Zhiguo Cao, Jianming Zhang, Ke Xian, Guosheng Lin. Neural video depth stabilizer. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Wenbo Hu, Xiangjun Gao, Xiaoyu Li, Sijie Zhao, Xiaodong Cun, Yong Zhang, Long Quan, Ying Shan. Depthcrafter: Generating consistent long depth sequences for open-world videos. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Sili Chen, Hengkai Guo, Shengnan Zhu, Feihu Zhang, Zilong Huang, Jiashi Feng, Bingyi Kang. Video depth anything: Consistent depth estimation for super-long videos. Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR), 2025.
Zhengqi Li, Richard Tucker, Forrester Cole, Qianqian Wang, Linyi Jin, Vickie Ye, Angjoo Kanazawa, Aleksander Holynski, Noah Snavely. MegaSaM: Accurate, fast and robust structure and motion from casual dynamic videos. Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR), 2025.
Wei Cao, Chang Luo, Biao Zhang, Matthias Nießner, Jiapeng Tang. Motion2vecsets: 4d latent vector set diffusion for non-rigid shape reconstruction and tracking. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2024.
Michael Kazhdan, Matthew Bolitho, Hugues Hoppe. Poisson surface reconstruction. Proceedings of the fourth Eurographics symposium on Geometry processing, 2006.
Keunhong Park, Utkarsh Sinha, Jonathan T Barron, Sofien Bouaziz, Dan B Goldman, Steven M Seitz, Ricardo Martin-Brualla. Nerfies: Deformable neural radiance fields. Proceedings of the IEEE/CVF international conference on computer vision (ICCV), 2021.
Chen Gao, Ayush Saraf, Johannes Kopf, Jia-Bin Huang. Dynamic view synthesis from dynamic monocular video. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov. RoBERTa: A robustly optimized BERT pretraining approach. arXiv preprint arXiv:1907.11692, 2019. arXiv
Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Ruslan Salakhutdinov, Quoc V Le. XLNet: Generalized autoregressive pretraining for language understanding. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2019.
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 2020.
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever. Language models are unsupervised multitask learners. OpenAI blog, 2019.
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, et al.. Beyond the imitation game: Quantifying and extrapolating the capabilities of language models. arXiv preprint arXiv:2206.04615, 2022. arXiv
Ian Tenney, Dipanjan Das, Ellie Pavlick. BERT rediscovers the classical NLP pipeline. arXiv preprint arXiv:1905.05950, 2019. arXiv
John Hewitt, Christopher D. Manning. A structural probe for finding syntax in word representations. NAACL-HLT, 2019.
Belinda Z. Li, Maxwell Nye, Jacob Andreas. Implicit representations of meaning in neural language models. arXiv preprint arXiv:2106.00737, 2021. arXiv
Roma Patel, Ellie Pavlick. Mapping language models to grounded conceptual spaces. International Conference on Learning Representations (ICLR), 2022. Link
Mostafa Abdou, Artur Kulmizev, Daniel Hershcovich, Stella Frank, Ellie Pavlick, Anders Søgaard. Can language models encode perceptual structure without grounding? A case study in color. arXiv preprint arXiv:2109.06129, 2021. arXiv
Kenneth Li, Aspen K. Hopkins, David Bau, Fernanda Viégas, Hanspeter Pfister, Martin Wattenberg. Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task. International Conference on Learning Representations (ICLR), 2023. arXiv
Guillaume Alain, Yoshua Bengio. Understanding intermediate layers using linear classifier probes. arXiv preprint arXiv:1610.01644, 2016. arXiv
Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viégas, Rory Sayres. Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (TCAV). Proceedings of the International Conference on Machine Learning (ICML), 2018.
Amirata Ghorbani, James Wexler, James Y. Zou, Been Kim. Towards automatic concept-based explanations. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2019.
Shubham Toshniwal, Sam Wiseman, Karen Livescu, Kevin Gimpel. Learning chess blindfolded: Evaluating language models on state tracking. arXiv preprint arXiv:2102.13249, 2021. arXiv
David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre, Dharshan Kumaran, Thore Graepel, et al.. A general reinforcement learning algorithm that masters chess, shogi, and go through self-play. Science, 2018.
Thomas McGrath, Andrei Kapishnikov, Nenad Tomašev, Adam Pearce, Demis Hassabis, Been Kim, Ulrich Paquet, Vladimir Kramnik. Acquisition of chess knowledge in AlphaZero. arXiv preprint arXiv:2111.09259, 2021. arXiv
Ewan A Macpherson, John C Middlebrooks. Listener weighting of cues for lateral angle: The duplex theory of sound localization revisited. The Journal of the Acoustical Society of America, 2002.
John C Middlebrooks. Sound localization. Handbook of clinical neurology, 2015.
William G Gardner. 3-D audio using loudspeakers. 1998.
Heinrich Kuttruff. Room acoustics. 2016.
Jens Blauert. Spatial hearing: the psychophysics of human sound localization. 1997.
Frederic L Wightman, Doris J Kistler. Headphone simulation of free-field listening. I: Stimulus synthesis. The Journal of the Acoustical Society of America, 1989.
Franz Zotter, Matthias Frank. Ambisonics: A practical 3D audio theory for recording, studio production, sound reinforcement, and virtual reality. 2019.
Goksenin Yuksel, Marcel van Gerven, Kiki van der Heijden. General-purpose audio representation learning for real-world sound scenes. arXiv preprint arXiv:2506.00934, 2025. arXiv
Ruohan Gao, Changan Chen, Ziad Al-Halah, Carl Schissler, Kristen Grauman. Visualechoes: Spatial image representation learning through echolocation. European Conference on Computer Vision, 2020.
Pedro Morgado, Nuno Nvasconcelos, Timothy Langlois, Oliver Wang. Self-supervised generation of spatial audio for 360 video. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2018.
Triantafyllos Afouras, Andrew Owens, Joon Son Chung, Andrew Zisserman. Self-supervised learning of audio-visual objects from video. European Conference on Computer Vision, 2020.
Pedro Morgado, Yi Li, Nuno Nvasconcelos. Learning representations from audio-visual spatial alignment. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2020.
Zhisheng Zheng, Puyuan Peng, Ziyang Ma, Xie Chen, Eunsol Choi, David Harwath. Bat: Learning to reason about spatial sounds with large language models. arXiv preprint arXiv:2402.01591, 2024. arXiv
Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam. OWL: Geometry-Aware Spatial Reasoning for Audio Large Language Models. arXiv preprint arXiv:2509.26140, 2025. arXiv
Angela Dai, Matthias Nießner, Michael Zollhöfer, Shahram Izadi, Christian Theobalt. Bundlefusion: Real-time globally consistent 3d reconstruction using on-the-fly surface reintegration. ACM Transactions on Graphics (ToG), 2017.
Peter Florence, Lucas Manuelli, Russ Tedrake. Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulation. Conference on Robot Learning, 2018.
Jeffrey Mahler, Jacky Liang, Shahrouz Niyaz, Michael Laskey, Ross Doan, Xinyu Liu, Jose Ojea, Ken Goldberg. Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metrics. Robotics: Science and Systems (RSS), 2017.
Kaichun Mo, Leonidas J Guibas, Mustafa Mukadam, Abhinav Gupta, Shubham Tulsiani. Where2Act: From Pixels to Actions for Articulated 3D Objects. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, Michael J. Black. SMPL: A Skinned Multi-Person Linear Model. ACM Transactions on Graphics, 2015.
J. Straub, T. Whelan, L. Ma, Y. Chen, E. Wijmans, S. Green, J. H. Engel, R. M. Salas-Moreno, R. Sandilands, M. S. Dill, D. Pang, B. Williams, P. Vajda, R. M. Turner, R. Newcombe. The Replica Dataset: A Digital Replica of Indoor Spaces. Proceeding of CVPR, 2019.
Angel Chang, Angela Dai, Thomas Funkhouser, Maciej Halber, Matthias Nießner, Manolis Savva, Shuran Song, Andy Zeng, Yinda Zhang. Matterport3D: Learning from RGB-D Data in Indoor Environments. Proceedings of the International Conference on 3D Vision (3DV), 2017.
Iro Armeni, Zhi-Yang He, JunYoung Gwak, Amir R Zamir, Martin Fischer, Jitendra Malik, Silvio Savarese. 3d scene graph: A structure for unified semantics, 3d space, and camera. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Johanna Wald, Helisa Dhamo, Nassir Navab, Federico Tombari. Learning 3d semantic scene graphs from 3d indoor reconstructions. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.
Shun-Cheng Wu, Johanna Wald, Keisuke Tateno, Nassir Navab, Federico Tombari. Scenegraphfusion: Incremental 3d scene graph prediction from rgb-d sequences. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021.
Chao Jia, Yinfei Yang, Ye Xia, Yi-Ting Chen, Zarana Parekh, Hieu Pham, Quoc Le, Yun-Hsuan Sung, Zhen Li, Tom Duerig. Scaling up visual and vision-language representation learning with noisy text supervision. Proceedings of the International Conference on Machine Learning (ICML), 2021.
Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, Jingjing Liu. Uniter: Universal image-text representation learning. European conference on computer vision, 2020.
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, et al.. Oscar: Object-semantics aligned pre-training for vision-language tasks. European conference on computer vision, 2020.
Jiayuan Mao, Chuang Gan, Pushmeet Kohli, Joshua B Tenenbaum, Jiajun Wu. The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision. arXiv preprint arXiv:1904.12584, 2019. arXiv
Joy Hsu, Jiayuan Mao, Josh Tenenbaum, Jiajun Wu. What’s left? concept grounding with logic-enhanced foundation models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Xiaohua Zhai, Xiao Wang, Basil Mustafa, Andreas Steiner, Daniel Keysers, Alexander Kolesnikov, Lucas Beyer. Lit: Zero-shot transfer with locked-image text tuning. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Yan Zeng, Xinsong Zhang, Hang Li. Multi-grained vision language pre-training: Aligning texts with visual concepts. arXiv preprint arXiv:2111.08276, 2021. arXiv
Junnan Li, Ramprasaath Selvaraju, Akhilesh Gotmare, Shafiq Joty, Caiming Xiong, Steven Chu Hong Hoi. Align before fuse: Vision and language representation learning with momentum distillation. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2021.
Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Subhojit Som, Songhao Piao, Furu Wei. Vlmo: Unified vision-language pre-training with mixture-of-modality-experts. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, et al.. Image as a foreign language: Beit pretraining for vision and vision-language tasks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, Yuan Cao. Simvlm: Simple visual language model pretraining with weak supervision. arXiv preprint arXiv:2108.10904, 2021. arXiv
Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi. Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. Proceedings of the International Conference on Machine Learning (ICML), 2022.
Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang. Git: A generative image-to-text transformer for vision and language. arXiv preprint arXiv:2205.14100, 2022. arXiv
Aishwarya Kamath, Mannat Singh, Yann LeCun, Gabriel Synnaeve, Ishan Misra, Nicolas Carion. Mdetr-modulated detection for end-to-end multi-modal understanding. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, et al.. Grounded language-image pre-training. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, et al.. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. European conference on computer vision, 2024.
Yongming Rao, Wenliang Zhao, Guangyi Chen, Yansong Tang, Zheng Zhu, Guan Huang, Jie Zhou, Jiwen Lu. Denseclip: Language-guided dense prediction with context-aware prompting. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang. Groupvit: Semantic segmentation emerges from text supervision. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Le Xue, Mingfei Gao, Chen Xing, Roberto Martı́n-Mart\ń, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Silvio Savarese. Ulip: Learning a unified representation of language, images, and point clouds for 3d understanding. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Minghua Liu, Ruoxi Shi, Kaiming Kuang, Yinhao Zhu, Xuanlin Li, Shizhong Han, Hong Cai, Fatih Porikli, Hao Su. Openshape: Scaling up 3d shape representation towards open-world understanding. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Renrui Zhang, Ziyu Guo, Wei Zhang, Kunchang Li, Xupeng Miao, Bin Cui, Yu Qiao, Peng Gao, Hongsheng Li. Pointclip: Point cloud understanding by clip. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Tianyu Huang, Bowen Dong, Yunhan Yang, Xiaoshui Huang, Rynson WH Lau, Wanli Ouyang, Wangmeng Zuo. Clip2point: Transfer clip to point cloud classification with image-depth pre-training. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Justin Kerr, Chung Min Kim, Ken Goldberg, Angjoo Kanazawa, Matthew Tancik. Lerf: Language embedded radiance fields. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
Nur Muhammad Mahi Shafiullah, Chris Paxton, Lerrel Pinto, Soumith Chintala, Arthur Szlam. Clip-fields: Weakly supervised semantic fields for robotic memory. arXiv preprint arXiv:2210.05663, 2022. arXiv
Minghan Qin, Wanhua Li, Jiawei Zhou, Haoqian Wang, Hanspeter Pfister. Langsplat: 3d language gaussian splatting. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Aaron van den Oord, Yazhe Li, Oriol Vinyals. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748, 2018. arXiv
Dave Zhenyu Chen, Angel X Chang, Matthias Nießner. Scanrefer: 3d object localization in rgb-d scans using natural language. European conference on computer vision, 2020.
Panos Achlioptas, Ahmed Abdelreheem, Fei Xia, Mohamed Elhoseiny, Leonidas Guibas. Referit3d: Neural listeners for fine-grained 3d object identification in real-world scenes. European conference on computer vision, 2020.
Ziyu Zhu, Xiaojian Ma, Yixin Chen, Zhidong Deng, Siyuan Huang, Qing Li. 3d-vista: Pre-trained transformer for 3d vision and text alignment. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Ayush Jain, Nikolaos Gkanatsios, Ishita Mediratta, Katerina Fragkiadaki. Bottom up top down detection transformers for language grounding in images and point clouds. European Conference on Computer Vision, 2022.
Joy Hsu, Jiayuan Mao, Jiajun Wu. Ns3d: Neuro-symbolic grounding of 3d objects and relations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Zhihao Yuan, Xu Yan, Yinghong Liao, Ruimao Zhang, Sheng Wang, Zhen Li, Shuguang Cui. Instancerefer: Cooperative holistic understanding for visual grounding on point clouds through instance multi-level contextual referring. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Fabian Fuchs, Daniel Worrall, Volker Fischer, Max Welling. Se (3)-transformers: 3d roto-translation equivariant attention networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2020.
Congyue Deng, Or Litany, Yueqi Duan, Adrien Poulenard, Andrea Tagliasacchi, Leonidas J Guibas. Vector neurons: A general framework for so (3)-equivariant networks. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Benjamin Elizalde, Soham Deshmukh, Mahmoud Al Ismail, Huaming Wang. Clap learning audio concepts from natural language supervision. ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
Yusong Wu, Ke Chen, Tianyu Zhang, Yuchen Hui, Taylor Berg-Kirkpatrick, Shlomo Dubnov. Large-scale contrastive language-audio pretraining with feature fusion and keyword-to-caption augmentation. ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
Andrey Guzhov, Federico Raue, Jörn Hees, Andreas Dengel. Audioclip: Extending clip to image, text and audio. ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
Ho-Hsiang Wu, Prem Seetharaman, Kundan Kumar, Juan Pablo Bello. Wav2clip: Learning robust audio representations from clip. ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
Khaled Koutini, Jan Schlüter, Hamid Eghbal-Zadeh, Gerhard Widmer. Efficient training of audio transformers with patchout. arXiv preprint arXiv:2110.05069, 2021. arXiv
Ke Chen, Xingjian Du, Bilei Zhu, Zejun Ma, Taylor Berg-Kirkpatrick, Shlomo Dubnov. Hts-at: A hierarchical token-semantic audio transformer for sound classification and detection. ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
Yuan Gong, Cheng-I Lai, Yu-An Chung, James Glass. Ssast: Self-supervised audio spectrogram transformer. Proceedings of the AAAI Conference on Artificial Intelligence, 2022.
Alan Baade, Puyuan Peng, David Harwath. Mae-ast: Masked autoencoding audio spectrogram transformer. arXiv preprint arXiv:2203.16691, 2022. arXiv
Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer. Masked autoencoders that listen. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Thomas Whelan, Stefan Leutenegger, Renato F Salas-Moreno, Ben Glocker, Andrew J Davison. ElasticFusion: Dense SLAM without a pose graph.. Robotics: science and systems, 2015.
Raul Mur-Artal, Juan D Tardós. Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras. IEEE transactions on robotics, 2017.
Jiaming Sun, Yiming Xie, Linghao Chen, Xiaowei Zhou, Hujun Bao. Neuralrecon: Real-time coherent 3d reconstruction from monocular video. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
William Shen, Ge Yang, Alan Yu, Jansen Wong, Leslie Pack Kaelbling, Phillip Isola. Distilled feature fields enable few-shot language-guided manipulation. arXiv preprint arXiv:2308.07931, 2023. arXiv
Jianglong Ye, Naiyan Wang, Xiaolong Wang. Featurenerf: Learning generalizable nerfs by distilling foundation models. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Rohit Girdhar, Alaaeldin El-Nouby, Zhuang Liu, Mannat Singh, Kalyan Vasudev Alwala, Armand Joulin, Ishan Misra. Imagebind: One embedding space to bind them all. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Relja Arandjelovic, Andrew Zisserman. Look, listen and learn. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Andrew Owens, Alexei A Efros. Audio-visual scene analysis with self-supervised multisensory features. Proceedings of the European conference on computer vision (ECCV), 2018.
Hang Zhao, Chuang Gan, Andrew Rouditchenko, Carl Vondrick, Josh McDermott, Antonio Torralba. The sound of pixels. Proceedings of the European conference on computer vision (ECCV), 2018.
Zhengxia Zou, Zhenwei Shi, Yuhong Guo, Jieping Ye. Object Detection in 20 Years: A Survey. arXiv preprint arXiv:1905.05055, 2019. arXiv
Paul Viola, Michael Jones. Rapid Object Detection using a Boosted Cascade of Simple Features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2001.
Navneet Dalal, Bill Triggs. Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2005.
Pedro F. Felzenszwalb, Ross B. Girshick, David McAllester, Deva Ramanan. Object Detection with Discriminatively Trained Part-Based Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010.
Ross Girshick. Fast R-CNN. Proceedings of theInternational Conference on Computer Vision (ICCV), 2015.
Peize Sun, Rufeng Zhang, Yi Jiang, Tao Kong, Chenfeng Xu, Wei Zhan, Masayoshi Tomizuka, Lei Li, Zehuan Yuan, Changhu Wang, Ping Luo. Sparse R-CNN: End-to-End Object Detection with Learnable Proposals. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Joseph Redmon, Ali Farhadi. YOLO9000: better, faster, stronger. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Joseph Redmon, Ali Farhadi. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767, 2018. arXiv
Alexey Bochkovskiy, Chien-Yao Wang, Hong-Yuan Mark Liao. YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv preprint arXiv:2004.10934, 2020. arXiv
Glenn Jocher, Ayush Chaurasia, Alex Stoken, Jirka Borovec, Yonghye Kwon, Jiacong Fang, Kalen Michael, Diego Montes, Jebastin Nadar, Piotr Skalski, et al.. ultralytics/yolov5: v6. 1-tensorrt, tensorflow edge tpu and openvino export and inference. Zenodo, 2022.
Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, Alexander C Berg. SSD: Single Shot MultiBox Detector. ECCV, 2016.
Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, Piotr Dollár. Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
Glenn Jocher, Ayush Chaurasia, Jing Qiu. YOLOv8: A New State-of-the-Art in Object Detection. Ultralytics, 2023.
Ao Wang, Hui Chen, Lihao Liu, Kai Chen, Zijia Lin, Jungong Han, et al.. Yolov10: Real-time end-to-end object detection. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
X. Zhu, W. Su, L. Lu, B. Li, X. Wang, J. Dai. Deformable DETR: Deformable Transformers for End-to-End Object Detection. Proc. ICLR, 2021.
Depu Meng, Xiaokang Chen, Zejia Fan, Gang Zeng, Houqiang Li, Yuhui Yuan, Lei Sun, Jingdong Wang. Conditional detr for fast training convergence. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Hao Zhang, Feng Li, Shilong Liu, Lei Zhang, Hang Su, Jun Zhu, Lionel M Ni, Heung-Yeung Shum. Dino: Detr with improved denoising anchor boxes for end-to-end object detection. arXiv preprint arXiv:2203.03605, 2022. arXiv
Yian Zhao, Wenyu Lv, Shangliang Xu, Jinman Wei, Guanzhong Wang, Qingqing Dang, Yi Liu, Jie Chen. Detrs beat yolos on real-time object detection. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Xiuye Gu, Tsung-Yi Lin, Weicheng Kuo, Yin Cui. Open-vocabulary object detection via vision and language knowledge distillation. arXiv preprint arXiv:2104.13921, 2021. arXiv
Alireza Zareian, Svebor Karaman, Shih-Fu Chang. Open-Vocabulary Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Xingyi Zhou, Rohit Girdhar, Armand Joulin, Philipp Krähenbühl, Ishan Misra. Detecting twenty-thousand classes using image-level supervision. European conference on computer vision, 2022.
Tianheng Cheng, Lin Song, Yixiao Ge, Wenyu Liu, Xinggang Wang, Ying Shan. Yolo-world: Real-time open-vocabulary object detection. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Chaoyang Zhu, Long Chen. A survey on open-vocabulary detection and segmentation: Past, present, and future. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024.
Jianzong Wu, Xiangtai Li, Shilin Xu, Haobo Yuan, Henghui Ding, Yibo Yang, Xia Li, Jiangning Zhang, Yunhai Tong, Xudong Jiang, et al.. Towards open vocabulary learning: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024.
Alex H Lang, Sourabh Vora, Holger Caesar, Lubing Zhou, Jiong Yang, Oscar Beijbom. PointPillars: Fast Encoders for Object Detection from Point Clouds. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Shaoshuai Shi, Xiaogang Wang, Hongsheng Li. PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Shaoshuai Shi, Chaoxu Guo, Li Jiang, Zhe Wang, Jianping Shi, Xiaogang Wang, Hongsheng Li. PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Tianwei Yin, Xingyi Zhou, Philipp Krahenbuhl. Center-based 3d object detection and tracking. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Charles R Qi, Or Litany, Kaiming He, Leonidas J Guibas. Deep Hough Voting for 3D Object Detection in Point Clouds. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Ishan Misra, Rohit Girdhar, Armand Joulin. An End-to-End Transformer Model for 3D Object Detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Yan Wang, Wei-Lun Chao, Divyansh Garg, Bharath Hariharan, Mark Campbell, Kilian Q Weinberger. Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Driving. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Yue Wang, Vitor Campagnolo Guizilini, Tianyuan Zhang, Yilun Wang, Hang Zhao, Justin Solomon. DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries. Conference on Robot Learning, 2022.
Zhiqi Li, Wenhai Wang, Hongyang Li, Enze Xie, Chonghao Sima, Tong Lu, Yu Qiao, Jifeng Dai. BEVFormer: Learning Bird's-Eye-View Representation from Multi-camera Images via Spatiotemporal Transformers. Proc. ECCV, 2022.
Charles R Qi, Wei Liu, Chenxia Wu, Hao Su, Leonidas J Guibas. Frustum PointNets for 3D Object Detection from RGB-D Data. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Garrick Brazil, Abhinav Kumar, Julian Straub, Nikhila Ravi, Justin Johnson, Georgia Gkioxari. Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wild. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2023.
M. Everingham, L. Van~Gool, C. K. I. Williams, J. Winn, A. Zisserman. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html, 2007.
M. Everingham, L. Van~Gool, C. K. I. Williams, J. Winn, A. Zisserman. The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html, 2012.
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael S. Bernstein, Alexander C. Berg, Li Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. Int. J. Comput. Vis., 2015.
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, C Lawrence Zitnick. Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision (ECCV), 2014.
Shuai Shao, Zeming Li, Tianyuan Zhang, Chao Peng, Gang Yu, Xiangyu Zhang, Jing Li, Jian Sun. Objects365: A large-scale, high-quality dataset for object detection. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Alina Kuznetsova, Hassan Rom, Neil Alldrin, Jasper Uijlings, Ivan Krasin, Jordi Pont-Tuset, Shahab Kamali, Stefan Popov, Matteo Malloci, Alexander Kolesnikov, et al.. The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale. International journal of computer vision, 2020.
Agrim Gupta, Piotr Dollar, Ross Girshick. Lvis: A dataset for large vocabulary instance segmentation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Mark Everingham, Luc Van Gool, Christopher K. I. Williams, John Winn, Andrew Zisserman. The PASCAL Visual Object Classes (VOC) Challenge. International Journal of Computer Vision, 2010.
Holger Caesar, Varun Bankiti, Alex H. Lang, Sourabh Vora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, Oscar Beijbom. nuScenes: A Multimodal Dataset for Autonomous Driving. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2020.
Pei Sun, Henrik Kretzschmar, Xerxes Dotiwalla, Aurelien Chouard, Vijaysai Patnaik, Paul Tsui, James Guo, Yin Zhou, Yuning Chai, Benjamin Caine, Vijay Vasudevan, Wei Han, Jiquan Ngiam, Hang Zhao, Aleksei Timofeev, Scott Ettinger, Maxim Krivokon, Amy Gao, Aditya Joshi, Yu Zhang, Jonathon Shlens, Zhifeng Chen, Dragomir Anguelov. Scalability in Perception for Autonomous Driving: Waymo Open Dataset. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2020.
Shuran Song, Samuel P Lichtenberg, Jianxiong Xiao. Sun rgb-d: A rgb-d scene understanding benchmark suite. Proceedings of the IEEE conference on computer vision and pattern recognition, 2015.
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner. ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes. Proceedings of the CVPR, 2017.
Xinzhu Ma, et al.. Delving into Localization Errors for Monocular 3D Object Detection. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021.
Nobuyuki Otsu. A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics, 1979.
Rolf Adams, Leanne Bischof. Seeded Region Growing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994.
James MacQueen. Some Methods for Classification and Analysis of Multivariate Observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, 1967.
Luc Vincent, Pierre Soille. Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1991.
Michael Kass, Andrew Witkin, Demetri Terzopoulos. Snakes: Active Contour Models. International Journal of Computer Vision, 1988.
Yuri Boykov, Marie-Pierre Jolly. Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2001.
Stuart Geman, Donald Geman. Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1984.
John Lafferty, Andrew McCallum, Fernando Pereira. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. Proceedings of the 18th International Conference on Machine Learning (ICML), 2001.
Vijay Badrinarayanan, Alex Kendall, Roberto Cipolla. SegNet: A Deep Convolutional Encoder–Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017.
Hengshuang Zhao, Jianping Shi, Xiaojuan Qi, Xiaogang Wang, Jiaya Jia. Pyramid Scene Parsing Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, Alan L. Yuille. Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs. International Conference on Learning Representations (ICLR), 2015.
Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, Alan L. Yuille. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017.
Liang-Chieh Chen, George Papandreou, Florian Schroff, Hartwig Adam. Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv preprint arXiv:1706.05587, 2017. arXiv
Liang-Chieh Chen, Yukun Zhu, George Papandreou, Florian Schroff, Hartwig Adam. Encoder--Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision (ECCV), 2018.
Shu Liu, Lu Qi, Haifang Qin, Jianping Shi, Jiaya Jia. Path Aggregation Network for Instance Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Kai Chen, Jiangmiao Pang, Jiaqi Wang, et al.. Hybrid Task Cascade for Instance Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Alexander Kirillov, Yuxin Wu, Kaiming He, Ross Girshick. PointRend: Image Segmentation as Rendering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Sixiao Zheng, Jiachen Lu, Hengshuang Zhao, Xiatian Zhu, Zekun Luo, Yabiao Wang, Yanwei Fu, Jianfeng Feng, Tao Xiang, Philip H. S. Torr, Li Zhang. Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M. Alvarez, Ping Luo. SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers. Advances in Neural Information Processing Systems (NeurIPS), 2021.
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, Baining Guo. Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of theInternational Conference on Computer Vision (ICCV), 2021.
Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, Ross Girshick. Masked autoencoders are scalable vision learners. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Huiyu Wang, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen. MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Bowen Cheng, Alexander G. Schwing, Alexander Kirillov. Per-Pixel Classification is Not All You Need for Semantic Segmentation. Advances in Neural Information Processing Systems (NeurIPS), 2021.
Wenwei Zhang, Jiangmiao Pang, Kai Chen, Chen Change Loy. K-Net: Towards Unified Image Segmentation. Advances in Neural Information Processing Systems (NeurIPS), 2021.
Bowen Cheng, Ishan Misra, Alexander G. Schwing, Alexander Kirillov, Rohit Girdhar. Masked-attention Mask Transformer for Universal Image Segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Yuxin Fang, Shusheng Yang, Xinggang Wang, Yu Li, Chen Fang, Ying Shan, Bin Feng, Wenyu Liu. Instances as Queries. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Zhiqi Li, Wenhai Wang, Enze Xie, Zhiding Yu, Anima Anandkumar, Jose M. Alvarez, Ping Luo, Tong Lu. Panoptic SegFormer: Delving Deeper Into Panoptic Segmentation With Transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Yuqing Wang, Zhaoliang Xu, Xinlong Wang, Chunhua Shen, Baoshan Cheng, Hao Shen, Huaxia Xia. VisTR: End-to-End Video Instance Segmentation with Transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Xiangtai Li, Wenwei Zhang, Jiangmiao Pang, Kai Chen, Guangliang Cheng, Yunhai Tong, Chen Change Loy. Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Dahun Kim, Jun Xie, Huiyu Wang, Siyuan Qiao, Qihang Yu, Hong-Seok Kim, Hartwig Adam, In So Kweon, Liang-Chieh Chen. TubeFormer-DeepLab: Video Mask Transformer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Xueyan Zou, Zi-Yi Dou, Jianwei Yang, Zhe Gan, Linjie Li, Chunyuan Li, Xiyang Dai, Harkirat Behl, Jianfeng Wang, Lu Yuan, Nanyun Peng, Lijuan Wang, Yong Jae Lee, Jianfeng Gao. Generalized Decoding for Pixel, Image, and Language. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Xiangtai Li, Haobo Yuan, Wei Li, Henghui Ding, Size Wu, Wenwei Zhang, Yining Li, Kai Chen, Chen Change Loy. OMG-Seg: Is one model good enough for all segmentation?. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2024.
Nikhila Ravi, Valentin Gabeur, Yuan-Ting Hu, Ronghang Hu, Chaitanya Ryali, Tengyu Ma, Haitham Khedr, Roman Rädle, Chloe Rolland, Laura Gustafson, Eric Mintun, Junting Pan, Kalyan Vasudev Alwala, Nicolas Carion, Chao-Yuan Wu, Ross Girshick, Piotr Dollár, Christoph Feichtenhofer. SAM 2: Segment Anything in Images and Videos. arXiv preprint arXiv:2408.00714, 2024. arXiv
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E Sarma, Michael M Bronstein, Justin M Solomon. Dynamic Graph CNN for Learning on Point Clouds. ACM Transactions on Graphics, 2019.
Hugues Thomas, Charles R Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui, François Goulette, Leonidas J Guibas. KPConv: Flexible and Deformable Convolution for Point Clouds. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Qingyong Hu, Bo Yang, Linhai Xie, Stefano Rosa, Yulan Guo, Zhihua Wang, Niki Trigoni, Andrew Markham. RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Christopher Choy, JunYoung Gwak, Silvio Savarese. 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Andres Milioto, Ignacio Vizzo, Jens Behley, Cyrill Stachniss. RangeNet++: Fast and Accurate LiDAR Semantic Segmentation. IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019.
Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, Hengshuang Zhao. Point Transformer V3: Simpler, Faster, Stronger. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia. PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe. Mask3D: Mask Transformer for 3D Semantic Instance Segmentation. IEEE International Conference on Robotics and Automation, 2023.
Ayça Takmaz, Elisabetta Fedele, Robert W Sumner, Marc Pollefeys, Federico Tombari, Francis Engelmann. OpenMask3D: Open-Vocabulary 3D Instance Segmentation. Advances in Neural Information Processing Systems, 2023.
Bolei Zhou, Hang Zhao, Xavier Puig, Tete Xiao, Sanja Fidler, Alberto Barriuso, Antonio Torralba. Scene Parsing through ADE20K Dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
Holger Caesar, Jasper R. R. Uijlings, Vittorio Ferrari. COCO-Stuff: Thing and Stuff Classes in Context. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2018.
Girish Varma, Anbumani Subramanian, Anoop M. Namboodiri, Manmohan Chandraker, C. V. Jawahar. IDD: A Dataset for Exploring Problems of Autonomous Navigation in Unconstrained Environments. IEEE Winter Conference on Applications of Computer Vision, WACV 2019, Waikoloa Village, HI, USA, January 7-11, 2019, 2019.
Christos Sakaridis, Dengxin Dai, Luc Van Gool. Guided Curriculum Model Adaptation and Uncertainty-Aware Evaluation for Semantic Nighttime Image Segmentation. 2019 IEEE/CVF International Conference on Computer Vision, Proceedings of theInternational Conference on Computer Vision (ICCV) 2019, Seoul, Korea (South), October 27 - November 2, 2019, 2019.
Christos Sakaridis, Dengxin Dai, Luc Van Gool. ACDC: The Adverse Conditions Dataset with Correspondences for Semantic Driving Scene Understanding. 2021 IEEE/CVF International Conference on Computer Vision, Proceedings of theInternational Conference on Computer Vision (ICCV) 2021, Montreal, QC, Canada, October 10-17, 2021, 2021.
Ju He, Shuo Yang, Shaokang Yang, Adam Kortylewski, Xiaoding Yuan, Jieneng Chen, Shuai Liu, Cheng Yang, Qihang Yu, Alan L. Yuille. PartImageNet: A Large, High-Quality Dataset of Parts. Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part VIII, 2022.
Ce Liu, Jenny Yuen, Antonio Torralba. Nonparametric scene parsing: Label transfer via dense scene alignment. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2009.
David R. Martin, Charless C. Fowlkes, Doron Tal, Jitendra Malik. A Database of Human Segmented Natural Images and its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics. Proceedings of the Eighth International Conference On Computer Vision (ICCV-01), Vancouver, British Columbia, Canada, July 7-14, 2001 - Volume 2, 2001.
Alessandro Prest, Christian Leistner, Javier Civera, Cordelia Schmid, Vittorio Ferrari. Learning object class detectors from weakly annotated video. 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, June 16-21, 2012, 2012.
Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, Bernt Schiele. The Cityscapes Dataset for Semantic Urban Scene Understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Gabriel J. Brostow, Julien Fauqueur, Roberto Cipolla. Semantic object classes in video: A high-definition ground truth database. Pattern Recognit. Lett., 2009.
Gerhard Neuhold, Tobias Ollmann, Samuel Rota Bulò, Peter Kontschieder. The Mapillary Vistas Dataset for Semantic Understanding of Street Scenes. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
Nathan Silberman, Derek Hoiem, Pushmeet Kohli, Rob Fergus. Indoor segmentation and support inference from rgbd images. European conference on computer vision, 2012.
Jianxiong Xiao, Andrew Owens, Antonio Torralba. Sun3d: A database of big spaces reconstructed using sfm and object labels. Proceedings of the IEEE International Conference on Computer Vision, 2013.
Jens Behley, Martin Garbade, Andres Milioto, Jan Quenzel, Sven Behnke, Cyrill Stachniss, Jürgen Gall. SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences. 2019 IEEE/CVF International Conference on Computer Vision, Proceedings of theInternational Conference on Computer Vision (ICCV) 2019, Seoul, Korea (South), October 27 - November 2, 2019, 2019.
Iro Armeni, Ozan Sener, Amir R. Zamir, Helen Jiang, Ioannis Brilakis, Martin Fischer, Silvio Savarese. 3D Semantic Parsing of Large-Scale Indoor Spaces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Sang-Ki Ko, Chang Jo Kim, Hyedong Jung, Choongsang Cho. Neural sign language translation based on human keypoint estimation. Applied sciences, 2019.
Peixuan Li, Huaici Zhao, Pengfei Liu, Feidao Cao. Rtm3d: Real-time monocular 3d detection from object keypoints for autonomous driving. European Conference on Computer Vision, 2020.
Jessy Lauer, Mu Zhou, Shaokai Ye, William Menegas, Steffen Schneider, Tanmay Nath, Mohammed Mostafizur Rahman, Valentina Di Santo, Daniel Soberanes, Guoping Feng, et al.. Multi-animal pose estimation, identification and tracking with DeepLabCut. Nature Methods, 2022.
Heqin Zhu, Qingsong Yao, Li Xiao, S Kevin Zhou. You only learn once: Universal anatomical landmark detection. International conference on medical image computing and computer-assisted intervention, 2021.
Hans Peter Moravec. Obstacle avoidance and navigation in the real world by a seeing robot rover. 1980.
Jianbo Shi, et al.. Good features to track. 1994 Proceedings of IEEE conference on computer vision and pattern recognition, 1994.
Herbert Bay, Tinne Tuytelaars, Luc Van Gool. Surf: Speeded up robust features. European conference on computer vision, 2006.
Edward Rosten, Tom Drummond. Machine learning for high-speed corner detection. European Conference on Computer Vision, 2006.
Michael Calonder, Vincent Lepetit, Christoph Strecha, Pascal Fua. Brief: Binary robust independent elementary features. European conference on computer vision, 2010.
Ethan Rublee, Vincent Rabaud, Kurt Konolige, Gary Bradski. ORB: An efficient alternative to SIFT or SURF. 2011 International conference on computer vision, 2011.
Timothy F. Cootes, Christopher J. Taylor, David H. Cooper, Jim Graham. Active shape models-their training and application. Computer Vision and Image Understanding, 1995.
Timothy F Cootes, Gareth J Edwards, Christopher J Taylor. Active appearance models. European conference on computer vision, 1998.
Jason M Saragih, Simon Lucey, Jeffrey F Cohn. Deformable model fitting by regularized landmark mean-shift. International journal of computer vision, 2011.
Xuehan Xiong, Fernando De la Torre. Supervised descent method and its applications to face alignment. Proceedings of the IEEE conference on computer vision and pattern recognition, 2013.
Jonathan Tompson, Arjun Jain, Yann LeCun, Christoph Bregler. Joint training of a convolutional network and a graphical model for human pose estimation. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2014.
Jonathan Tompson, Ross Goroshin, Arjun Jain, Yann LeCun, Christoph Bregler. Efficient object localization using convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition, 2015.
Shih-En Wei, Varun Ramakrishna, Takeo Kanade, Yaser Sheikh. Convolutional pose machines. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2016.
Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, et al.. Deep high-resolution representation learning for visual recognition. IEEE transactions on pattern analysis and machine intelligence, 2020.
Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh. Realtime multi-person 2d pose estimation using part affinity fields. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, Yaser Sheikh. OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. IEEE Trans. Pattern Anal. Mach. Intell., 2021.
Debapriya Maji, Soyeb Nagori, Manu Mathew, Deepak Poddar. Yolo-pose: Enhancing yolo for multi person pose estimation using object keypoint similarity loss. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Tao Jiang, Peng Lu, Li Zhang, Ningsheng Ma, Rui Han, Chengqi Lyu, Yining Li, Kai Chen. Rtmpose: Real-time multi-person pose estimation based on mmpose. arXiv preprint arXiv:2303.07399, 2023. arXiv
Peng Lu, Tao Jiang, Yining Li, Xiangtai Li, Kai Chen, Wenming Yang. Rtmo: Towards high-performance one-stage real-time multi-person pose estimation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Yufei Xu, Jing Zhang, Qiming Zhang, Dacheng Tao. Vitpose: Simple vision transformer baselines for human pose estimation. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Rawal Khirodkar, Timur Bagautdinov, Julieta Martinez, Su Zhaoen, Austin James, Peter Selednik, Stuart Anderson, Shunsuke Saito. Sapiens: Foundation for human vision models. European Conference on Computer Vision, 2024.
Julieta Martinez, Rayat Hossain, Javier Romero, James J Little. A Simple Yet Effective Baseline for 3D Human Pose Estimation. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Dario Pavllo, Christoph Feichtenhofer, David Grangier, Michael Auli. 3D Human Pose Estimation in Video with Temporal Convolutions and Semi-Supervised Training. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Wentao Zhu, Xiaoxuan Ma, Zhaoyang Liu, Libin Liu, Wayne Wu, Yizhou Wang. MotionBERT: A Unified Perspective on Learning Human Motion Representations. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Jia Gong, Lin Geng Foo, Zhipeng Fan, Qiuhong Ke, Hossein Rahmani, Jun Liu. Diffpose: Toward more reliable 3d pose estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Georgios Pavlakos, Xiaowei Zhou, Konstantinos G Derpanis, Kostas Daniilidis. Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Pose. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Karim Iskakov, Egor Burkov, Victor Lempitsky, Yury Malkov. Learnable Triangulation of Human Pose. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
Daniel DeTone, Tomasz Malisiewicz, Andrew Rabinovich. Superpoint: Self-supervised interest point detection and description. Proceedings of the IEEE conference on computer vision and pattern recognition workshops (CVPRW), 2018.
Michał Tyszkiewicz, Pascal Fua, Eduard Trulls. Disk: Learning local features with policy gradient. Advances in neural information processing systems (NeurIPS), 2020.
Paul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, Andrew Rabinovich. Superglue: Learning feature matching with graph neural networks. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2020.
Jiaming Sun, Zehong Shen, Yuang Wang, Hujun Bao, Xiaowei Zhou. LoFTR: Detector-Free Local Feature Matching with Transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Yu Zhong. Intrinsic Shape Signatures: A Shape Descriptor for 3D Object Recognition. IEEE International Conference on Computer Vision Workshops, 2009.
Jiaxin Li, Gim Hee Lee. USIP: Unsupervised Stable Interest Point Detection from 3D Point Clouds. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Xuyang Bai, Zixin Luo, Lei Zhou, Hongbo Fu, Long Quan, Chiew-Lan Tai. D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Supasorn Suwajanakorn, Noah Snavely, Jonathan J Tompson, Mohammad Norouzi. Discovery of Latent 3D Keypoints via End-to-end Geometric Reasoning. Advances in Neural Information Processing Systems, 2018.
Lucas Manuelli, Wei Gao, Peter Florence, Russ Tedrake. kpam: Keypoint affordances for category-level robotic manipulation. The International Symposium of Robotics Research, 2019.
Mykhaylo Andriluka, Leonid Pishchulin, Peter Gehler, Bernt Schiele. 2d human pose estimation: New benchmark and state of the art analysis. Proceedings of the IEEE Conference on computer Vision and Pattern Recognition, 2014.
Mykhaylo Andriluka, Umar Iqbal, Eldar Insafutdinov, Leonid Pishchulin, Anton Milan, Juergen Gall, Bernt Schiele. Posetrack: A benchmark for human pose estimation and tracking. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Catalin Ionescu, Dragos Papava, Vlad Olaru, Cristian Sminchisescu. Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments. IEEE Trans. Pattern Anal. Mach. Intell., 2014.
Rıza Alp Güler, Natalia Neverova, Iasonas Kokkinos. Densepose: Dense human pose estimation in the wild. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Jiefeng Li, Can Wang, Hao Zhu, Yihuan Mao, Hao-Shu Fang, Cewu Lu. Crowdpose: Efficient crowded scenes pose estimation and a new benchmark. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Martin Koestinger, Paul Wohlhart, Peter M Roth, Horst Bischof. Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. 2011 IEEE international conference on computer vision workshops (ICCV workshops), 2011.
Vuong Le, Jonathan Brandt, Zhe Lin, Lubomir Bourdev, Thomas S Huang. Interactive facial feature localization. European conference on computer vision, 2012.
Xavier P Burgos-Artizzu, Pietro Perona, Piotr Dollár. Robust face landmark estimation under occlusion. Proceedings of the IEEE International Conference on Computer Vision, 2013.
Christos Sagonas, Georgios Tzimiropoulos, Stefanos Zafeiriou, Maja Pantic. 300 faces in-the-wild challenge: The first facial landmark localization challenge. Proceedings of the IEEE international conference on computer vision workshops, 2013.
Xiangyu Zhu, Zhen Lei, Xiaoming Liu, Hailin Shi, Stan Z Li. Face alignment across large poses: A 3d solution. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
Wayne Wu, Chen Qian, Shuo Yang, Quan Wang, Yici Cai, Qiang Zhou. Look at boundary: A boundary-aware face alignment algorithm. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Tomas Simon, Hanbyul Joo, Iain Matthews, Yaser Sheikh. Hand keypoint detection in single images using multiview bootstrapping. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2017.
Christian Zimmermann, Thomas Brox. Learning to estimate 3d hand pose from single rgb images. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox. Freihand: A dataset for markerless capture of hand pose and shape from single rgb images. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Gyeongsik Moon, Shoou-I Yu, He Wen, Takaaki Shiratori, Kyoung Mu Lee. Interhand2. 6m: A dataset and baseline for 3d interacting hand pose estimation from a single rgb image. European Conference on Computer Vision, 2020.
Jinkun Cao, Hongyang Tang, Hao-Shu Fang, Xiaoyong Shen, Cewu Lu, Yu-Wing Tai. Cross-domain adaptation for animal pose estimation. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Hang Yu, Yufei Xu, Jing Zhang, Wei Zhao, Ziyu Guan, Dacheng Tao. Ap-10k: A benchmark for animal pose estimation in the wild. arXiv preprint arXiv:2108.12617, 2021. arXiv
Xibin Song, Peng Wang, Dingfu Zhou, Rui Zhu, Chenye Guan, Yuchao Dai, Hao Su, Hongdong Li, Ruigang Yang. Apollocar3d: A large 3d car instance understanding benchmark for autonomous driving. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Yang You, Yujing Lou, Chengkun Li, Zhoujun Cheng, Liangwei Li, Lizhuang Ma, Cewu Lu, Weiming Wang. Keypointnet: A large-scale 3d keypoint dataset aggregated from numerous human annotations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.
Dushyant Mehta, Helge Rhodin, Dan Casas, Pascal Fua, Oleksandr Sotnychenko, Weipeng Xu, Christian Theobalt. Monocular 3D Human Pose Estimation in the Wild Using Improved CNN Supervision. International Conference on 3D Vision, 2017.
Andy Zeng, Shuran Song, Matthias Nießner, Matthew Fisher, Jianxiong Xiao, Thomas Funkhouser. 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Nagwa R Fisal, Ahmed Fathalla, Dina Elmanakhly, Ahmad Salah. Reported Challenges in Deep Learning-Based Human Pose Estimation: A Systematic Review. IEEE Access, 2025.
Yan Guo, Tianhan Gao, Aoshuang Dong, Xinbei Jiang, Zichen Zhu, Fuxin Wang. A Survey of the State of the Art in Monocular 3D Human Pose Estimation: Methods, Benchmarks, and Challenges. Sensors (Basel, Switzerland), 2025.
Marsha Mariya Kappan, Eduardo Benitez Sandoval, Erik Meijering, Francisco Cruz. A survey on deep learning for 2D and 3D human pose estimation. Artificial Intelligence Review, 2026.
Le Jiang, Caleb Lee, Divyang Teotia, Sarah Ostadabbas. Animal pose estimation: A closer look at the state-of-the-art, existing gaps and opportunities. Computer Vision and Image Understanding, 2022.
Kostiantyn Khabarlak, Larysa Koriashkina. Fast facial landmark detection and applications: A survey. arXiv preprint arXiv:2101.10808, 2021. arXiv
Constantino Álvarez Casado, Miguel Bordallo López. Real-time face alignment: evaluation methods, training strategies and implementation optimization. Journal of Real-Time Image Processing, 2021.
Delu Zeng, Minyu Liao, Mohammad Tavakolian, Yulan Guo, Bolei Zhou, Dewen Hu, Matti Pietikäinen, Li Liu. Deep learning for scene classification: A survey. arXiv preprint arXiv:2101.10531, 2021. arXiv
John M Henderson, Andrew Hollingworth. High-level scene perception. Annual review of psychology, 1999.
Russell Epstein. The cortical basis of visual scene processing. Visual Cognition, 2005.
Yiyi Liao, Sarath Kodagoda, Yue Wang, Lei Shi, Yong Liu. Understand scene categories by objects: A semantic regularized scene classifier using convolutional neural networks. 2016 IEEE international conference on robotics and automation (ICRA), 2016.
Jianjun Ni, Kang Shen, Yinan Chen, Weidong Cao, Simon X Yang. An improved deep network-based scene classification method for self-driving cars. IEEE Transactions on Instrumentation and Measurement, 2022.
Fangfang Zhang, Arianna Salazar-Miranda, Fábio Duarte, Lawrence J. Vale, Gary Hack, Min Chen, Yu Liu, Michael Batty, Carlo Ratti. Urban Visual Intelligence: Studying Cities with Artificial Intelligence and Street-Level Imagery. Annals of the American Association of Geographers, 2024. Link
Matthew R Boutell, Jiebo Luo, Xipeng Shen, Christopher M Brown. Learning multi-label scene classification. Pattern recognition, 2004.
Ariadna Quattoni, Antonio Torralba. Recognizing indoor scenes. 2009 IEEE conference on computer vision and pattern recognition, 2009.
R. Raja, S. Md. Mansoor Roomi, D. Dharmalakshmi, S. Rohini. Classification of indoor/outdoor scene. 2013 IEEE International Conference on Computational Intelligence and Computing Research, 2013. DOI
Keiller Nogueira, Otávio AB Penatti, Jefersson A Dos Santos. Towards better exploiting convolutional neural networks for remote sensing scene classification. Pattern Recognition, 2017.
Gong Cheng, Junwei Han, Xiaoqiang Lu. Remote sensing image scene classification: Benchmark and state of the art. Proceedings of the IEEE, 2017.
Jincheng Huang, Zhu Liu, Yao Wang, Yu Chen, Edward K Wong. Integration of multimodal features for video scene classification based on HMM. 1999 IEEE third workshop on multimedia signal processing (Cat. No. 99TH8451), 1999.
Annamaria Mesaros, Toni Heittola, Tuomas Virtanen. A multi-device dataset for urban acoustic scene classification. arXiv preprint arXiv:1807.09840, 2018. arXiv
Aude Oliva, Antonio Torralba. Modeling the shape of the scene: A holistic representation of the spatial envelope. International journal of computer vision, 2001.
Gabriella Csurka, Christopher Dance, Lixin Fan, Jutta Willamowski, Cédric Bray. Visual categorization with bags of keypoints. Workshop on statistical learning in computer vision, ECCV, 2004.
Marco San Biagio, Loris Bazzani, Marco Cristani, Vittorio Murino. Weighted bag of visual words for object recognition. 2014 IEEE International Conference on Image Processing (ICIP), 2014. DOI
Svetlana Lazebnik, Cordelia Schmid, Jean Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2006.
Keiron O'shea, Ryan Nash. An introduction to convolutional neural networks. arXiv preprint arXiv:1511.08458, 2015. arXiv
Karen Simonyan, Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014. arXiv
Gao Huang, Zhuang Liu, Laurens Van Der Maaten, Kilian Q Weinberger. Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Bolei Zhou, Agata Lapedriza, Jianxiong Xiao, Antonio Torralba, Aude Oliva. Learning deep features for scene recognition using places database. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2014.
Tsung-Yi Lin, Piotr Dollár, Ross Girshick, Kaiming He, Bharath Hariharan, Serge Belongie. Feature pyramid networks for object detection. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Justin Johnson, Ranjay Krishna, Michael Stark, Li-Jia Li, David Shamma, Michael Bernstein, Li Fei-Fei. Image retrieval using scene graphs. Proceedings of the IEEE conference on computer vision and pattern recognition, 2015.
Thomas N. Kipf, Max Welling. Semi-Supervised Classification with Graph Convolutional Networks. International Conference on Learning Representations (ICLR), 2017.
Jiali Liang, Yufan Deng, Dan Zeng. A Deep Neural Network Combined CNN and GCN for Remote Sensing Scene Classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020. Link
Xiang Li, Congcong Wen, Yuan Hu, Nan Zhou. RS-CLIP: Zero shot remote sensing scene classification via contrastive vision-language supervision. International Journal of Applied Earth Observation and Geoinformation, 2023.
Pranab Sahoo, Ayush Kumar Singh, Sriparna Saha, Vinija Jain, Samrat Mondal, Aman Chadha. A systematic survey of prompt engineering in large language models: Techniques and applications. arXiv preprint arXiv:2402.07927, 2024. arXiv
Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, Jingren Zhou. Qwen-vl: A frontier large vision-language model with versatile abilities. arXiv preprint arXiv:2308.12966, 2023. arXiv
Oindrila Saha, Grant Van Horn, Subhransu Maji. Improved Zero-Shot Classification by Adapting VLMs with Text Descriptions. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Runnan Chen, Youquan Liu, Lingdong Kong, Xinge Zhu, Yuexin Ma, Yikang Li, Yuenan Hou, Yu Qiao, Wenping Wang. Clip2scene: Towards label-efficient 3d scene understanding by clip. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Jianxiong Xiao, James Hays, Krista A. Ehinger, Aude Oliva, Antonio Torralba. SUN database: Large-scale scene recognition from abbey to zoo. Proc. CVPR, 2010.
Jianxiong Xiao, Krista A. Ehinger, James Hays, Antonio Torralba, Aude Oliva. SUN Database: Exploring a Large Collection of Scene Categories. International Journal of Computer Vision, 2014. Link
Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, Antonio Torralba. Places: A 10 million Image Database for Scene Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018.
Yuhui Zhang, Alyssa Unell, Xiaohan Wang, Dhruba Ghosh, Yuchang Su, Ludwig Schmidt, Serena Yeung-Levy. Why are Visually-Grounded Language Models Bad at Image Classification?. Advances in Neural Information Processing Systems, 2024. Link
Peiran Xu, Sudong Wang, Yao Zhu, Jianing Li, Gege Qi, Yunjian Zhang. SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition. arXiv preprint arXiv:2511.21471, 2025. arXiv
Erik Daxberger, Nina Wenzel, David Griffiths, Haiming Gang, Justin Lazarow, Gefen Kohavi, Kai Kang, Marcin Eichner, Yinfei Yang, Afshin Dehghan, Peter Grasch. MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMs. arXiv preprint arXiv:2503.13111, 2025. arXiv
Xiaodong Gu, Zhiwen Fan, Siyu Zhu, Zuozhuo Dai, Feitong Tan, Ping Tan. Cascade cost volume for high-resolution multi-view stereo and stereo matching. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Ashutosh Saxena, Sung H Chung, Andrew Y Ng. Learning depth from single monocular images. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2005.
Fayao Liu, Chunhua Shen, Guosheng Lin. Deep convolutional neural fields for depth estimation from a single image. Proceedings of the IEEE conference on computer vision and pattern recognition, 2015.
Iro Laina, Christian Rupprecht, Vasileios Belagiannis, Federico Tombari, Nassir Navab. Deeper depth prediction with fully convolutional residual networks. 2016 Fourth international conference on 3D vision (3DV), 2016.
Huan Fu, Mingming Gong, Chaohui Wang, Kayhan Batmanghelich, Dacheng Tao. Deep ordinal regression network for monocular depth estimation. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Jure Zbontar, Yann LeCun. Computing the stereo matching cost with a convolutional neural network. Proceedings of the IEEE conference on computer vision and pattern recognition, 2015.
Nikolaus Mayer, Eddy Ilg, Philip Hausser, Philipp Fischer, Daniel Cremers, Alexey Dosovitskiy, Thomas Brox. A large dataset to train convolutional networks for disparity, optical flow, and scene flow estimation. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
Jia-Ren Chang, Yong-Sheng Chen. Pyramid stereo matching network. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Mengqi Ji, Juergen Gall, Haitian Zheng, Yebin Liu, Lu Fang. Surfacenet: An end-to-end 3d neural network for multiview stereopsis. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Yao Yao, Zixin Luo, Shiwei Li, Tianwei Shen, Tian Fang, Long Quan. Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inference. Computer Vision and Pattern Recognition (CVPR), 2019.
Sudheendra Vijayanarasimhan, Susanna Ricco, Cordelia Schmid, Rahul Sukthankar, Katerina Fragkiadaki. Sfm-net: Learning of structure and motion from video. arXiv preprint arXiv:1704.07804, 2017. arXiv
Clément Godard, Oisin Mac Aodha, Gabriel J Brostow. Unsupervised monocular depth estimation with left-right consistency. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Zhichao Yin, Jianping Shi. Geonet: Unsupervised learning of dense depth, optical flow and camera pose. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2018.
Peng Wang, Xiaohui Shen, Zhe Lin, Scott Cohen, Brian Price, Alan L Yuille. Towards unified depth and semantic prediction from a single image. Proceedings of the IEEE conference on computer vision and pattern recognition, 2015.
Ibraheem Alhashim, Peter Wonka. High quality monocular depth estimation via transfer learning. arXiv preprint arXiv:1812.11941, 2018. arXiv
Jin Han Lee, Myung-Kyu Han, Dong Wook Ko, Il Hong Suh. From big to small: Multi-scale local planar guidance for monocular depth estimation. arXiv preprint arXiv:1907.10326, 2019. arXiv
René Ranftl, Katrin Lasinger, David Hafner, Konrad Schindler, Vladlen Koltun. Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2020.
René Ranftl, Alexey Bochkovskiy, Vladlen Koltun. Vision transformers for dense prediction. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2021.
Zhenyu Li, Zehui Chen, Xianming Liu, Junjun Jiang. Depthformer: Exploiting long-range correlation and local information for accurate monocular depth estimation. Machine Intelligence Research, 2023.
Shariq Farooq Bhat, Reiner Birkl, Diana Wofk, Peter Wonka, Matthias Müller. Zoedepth: Zero-shot transfer by combining relative and metric depth. arXiv preprint arXiv:2302.12288, 2023. arXiv
Jamie Watson, Oisin Mac Aodha, Victor Prisacariu, Gabriel Brostow, Michael Firman. The temporal opportunist: Self-supervised multi-frame monocular depth. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Chaoqiang Zhao, Youmin Zhang, Matteo Poggi, Fabio Tosi, Xianda Guo, Zheng Zhu, Guan Huang, Yang Tang, Stefano Mattoccia. Monovit: Self-supervised monocular depth estimation with a vision transformer. 2022 international conference on 3D vision (3DV), 2022.
Wenliang Zhao, Yongming Rao, Zuyan Liu, Benlin Liu, Jie Zhou, Jiwen Lu. Unleashing text-to-image diffusion models for visual perception. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Bingxin Ke, Anton Obukhov, Shengyu Huang, Nando Metzger, Rodrigo Caye Daudt, Konrad Schindler. Repurposing diffusion-based image generators for monocular depth estimation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Xiao Fu, Wei Yin, Mu Hu, Kaixuan Wang, Yuexin Ma, Ping Tan, Shaojie Shen, Dahua Lin, Xiaoxiao Long. Geowizard: Unleashing the diffusion priors for 3d geometry estimation from a single image. European Conference on Computer Vision, 2024.
Misha Mahowald. VLSI analogs of neuronal visual processing: a synthesis of form and function. 1992.
Patrick Lichtsteiner, Christoph Posch, Tobi Delbruck. A 128×128 120 dB 15 \(µ\)s latency asynchronous temporal contrast vision sensor. IEEE journal of solid-state circuits, 2008.
Henri Rebecq, Guillermo Gallego, Elias Mueggler, Davide Scaramuzza. EMVS: Event-based multi-view stereo—3D reconstruction with an event camera in real-time. International Journal of Computer Vision, 2018.
Sio-Hoi Ieng, Joao Carneiro, Marc Osswald, Ryad Benosman. Neuromorphic event-based generalized time-based stereovision. Frontiers in neuroscience, 2018.
Yi Zhou, Guillermo Gallego, Henri Rebecq, Laurent Kneip, Hongdong Li, Davide Scaramuzza. Semi-dense 3D reconstruction with a stereo event camera. Proceedings of the European conference on computer vision (ECCV), 2018.
Zhen Xie, Shengyong Chen, Garrick Orchard. Event-based stereo depth estimation using belief propagation. Frontiers in neuroscience, 2017.
Stepan Tulyakov, Francois Fleuret, Martin Kiefel, Peter Gehler, Michael Hirsch. Learning an event sequence embedding for dense event-based deep stereo. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Kaixuan Zhang, Kaiwei Che, Jianguo Zhang, Jie Cheng, Ziyang Zhang, Qinghai Guo, Luziwei Leng. Discrete time convolution for fast event-based stereo. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Mohammad Mostafavi, Kuk-Jin Yoon, Jonghyun Choi. Event-intensity stereo: Estimating depth by the best of both worlds. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Suman Ghosh, Guillermo Gallego. Multi-Event-Camera Depth Estimation and Outlier Rejection by Refocused Events Fusion. Advanced Intelligent Systems, 2022.
Hoonhee Cho, Jegyeong Cho, Kuk-Jin Yoon. Learning adaptive dense event stereo from the image domain. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Diego de Oliveira Hitzges, Suman Ghosh, Guillermo Gallego. DERD-Net: Learning depth from event-based ray densities. The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025.
Hoonhee Cho, Jae-Young Kang, Kuk-Jin Yoon. Temporal event stereo via joint learning with stereoscopic flow. European Conference on Computer Vision, 2024.
Suman Ghosh, Guillermo Gallego. Event-based stereo depth estimation: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025.
J. Sturm, N. Engelhard, F. Endres, W. Burgard, D. Cremers. A benchmark for the evaluation of RGB-D SLAM systems. Proc. IROS, 2012.
A. Geiger, P. Lenz, R. Urtasun. Vision Meets Robotics: The KITTI Dataset. International Journal of Robotics Research, 2013.
Jonas Uhrig, Nick Schneider, Lukas Schneider, Uwe Franke, Thomas Brox, Andreas Geiger. Sparsity invariant cnns. 2017 international conference on 3D Vision (3DV), 2017.
Weifeng Chen, Zhao Fu, Dawei Yang, Jia Deng. Single-image depth perception in the wild. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2016.
Ke Xian, Chunhua Shen, Zhiguo Cao, Hao Lu, Yang Xiao, Ruibo Li, Zhenbo Luo. Monocular relative depth perception with web stereo data supervision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018.
Zhengqi Li, Noah Snavely. Megadepth: Learning single-view depth prediction from internet photos. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Thomas Schöps, Johannes L. Schönberger, Silvano Galliani, Torsten Sattler, Konrad Schindler, Marc Pollefeys, Andreas Geiger. A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017. DOILink
Tobias Koch, Lukas Liebel, Friedrich Fraundorfer, Marco Korner. Evaluation of cnn-based single-image depth estimation methods. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, 2018.
Peng Wang, Xinyu Huang, Xinjing Cheng, Dingfu Zhou, Qichuan Geng, Ruigang Yang. The apolloscape open dataset for autonomous driving and its application. IEEE transactions on pattern analysis and machine intelligence, 2019.
Benjamin Wilson, William Qi, Tanmay Agarwal, John Lambert, Jagjeet Singh, Siddhesh Khandelwal, Bowen Pan, Ratnesh Kumar, Andrew Hartnett, Jhony Kaesemodel Pontes, Deva Ramanan, Peter Carr, James Hays. Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting. Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks (NeurIPS Datasets and Benchmarks), 2021.
Yiyi Liao, Jun Xie, Andreas Geiger. Kitti-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
Vitor Guizilini, Rares Ambrus, Sudeep Pillai, Allan Raventos, Adrien Gaidon. 3d packing for self-supervised monocular depth estimation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Mike Roberts, Jason Ramapuram, Anurag Ranjan, Atulit Kumar, Miguel Angel Bautista, Nathan Paczan, Russ Webb, Joshua M Susskind. Hypersim: A photorealistic synthetic dataset for holistic indoor scene understanding. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Jose L Gómez, Manuel Silva, Antonio Seoane, Agnès Borrás, Mario Noriega, Germán Ros, Jose A Iglesias-Guitian, Antonio M López. All for one, and one for all: Urbansyn dataset, the third musketeer of synthetic driving scenes. arXiv preprint arXiv:2312.12176, 2023. arXiv
Wenshan Wang, Delong Zhu, Xiangwei Wang, Yaoyu Hu, Yuheng Qiu, Chen Wang, Yafei Hu, Ashish Kapoor, Sebastian Scherer. Tartanair: A dataset to push the limits of visual slam. IROS, 2020.
Igor Vasiljevic, Nick Kolkin, Shanyi Zhang, Ruotian Luo, Haochen Wang, Falcon Z Dai, Andrea F Daniele, Mohammadreza Mostajabi, Steven Basart, Matthew R Walter, et al.. Diode: A dense indoor and outdoor depth dataset. arXiv preprint arXiv:1908.00463, 2019. arXiv
Yao Yao, Zixin Luo, Shiwei Li, Jingyang Zhang, Yufan Ren, Lei Zhou, Tian Fang, Long Quan. Blendedmvs: A large-scale dataset for generalized multi-view stereo networks. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Gilad Baruch, Zhuoyuan Chen, Afshin Dehghan, Tal Dimry, Yuri Feigin, Peter Fu, Thomas Gebauer, Brandon Joffe, Daniel Kurz, Arik Schwartz, et al.. Arkitscenes: A diverse real-world dataset for 3d indoor scene understanding using mobile rgb-d data. arXiv preprint arXiv:2111.08897, 2021. arXiv
Zhengqi Li, Tali Dekel, Forrester Cole, Richard Tucker, Noah Snavely, Ce Liu, William T Freeman. Learning the depths of moving people by watching frozen people. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Hongchi Xia, Yang Fu, Sifei Liu, Xiaolong Wang. Rgbd objects in the wild: Scaling real-world 3d object learning from rgb-d videos. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Luigi Piccinelli, Yung-Hsu Yang, Christos Sakaridis, Mattia Segu, Siyuan Li, Luc Van Gool, Fisher Yu. UniDepth: Universal Monocular Metric Depth Estimation. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2024.
Jiahao Shao, Yuanbo Yang, Hongyu Zhou, Youmin Zhang, Yujun Shen, Vitor Guizilini, Yue Wang, Matteo Poggi, Yiyi Liao. Learning temporally consistent video depth from video diffusion priors. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Bingxin Ke, Dominik Narnhofer, Shengyu Huang, Lei Ke, Torben Peters, Katerina Fragkiadaki, Anton Obukhov, Konrad Schindler. Video depth without video models. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Haofei Xu, Songyou Peng, Fangjinhua Wang, Hermann Blum, Daniel Barath, Andreas Geiger, Marc Pollefeys. DepthSplat: Connecting Gaussian Splatting and Depth. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Ziyao Zeng, Yangchao Wu, Hyoungseob Park, Daniel Wang, Fengyu Yang, Stefano Soatto, Dong Lao, Byung-Woo Hong, Alex Wong. Rsa: Resolving scale ambiguities in monocular depth estimators through language descriptions. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Jacob Munkberg, Jon Hasselgren, Tianchang Shen, Jun Gao, Wenzheng Chen, Alex Evans, Thomas Müller, Sanja Fidler. Extracting triangular 3d models, materials, and lighting from images. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Daniel M. Bear, Elias Wang, Damian Mrowca, Felix J. Binder, Hsiao-Yu Fish Tung, R. T. Pramod, Cameron Holdaway, Sirui Tao, Kevin Smith, Fan-Yun Sun, Li Fei-Fei, Nancy Kanwisher, Joshua B. Tenenbaum, Daniel L. K. Yamins, Judith E. Fan. Physion: Evaluating Physical Prediction from Vision in Humans and Machines. 2021. arXivDOI
Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, et al.. Ego4d: Around the world in 3,000 hours of egocentric video. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Amir R. Zamir, Alexander Sax, William Shen, Leonidas J. Guibas, Jitendra Malik, Silvio Savarese. Taskonomy: Disentangling Task Transfer Learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Ainaz Eftekhar, Alexander Sax, Jitendra Malik, Amir R. Zamir. Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scans. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Gwangbin Bae, Andrew J. Davison. Rethinking Inductive Biases for Surface Normal Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Mu Hu, Wei Yin, Chi Zhang, Zhipeng Cai, Xiaoxiao Long, Hao Chen, Kaixuan Wang, Gang Yu, Chunhua Shen, Shaojie Shen. Metric3D v2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024.
Mingwei Li, Hehe Fan, Yi Yang. TransNormal: Dense Visual Semantics for Diffusion-based Transparent Object Normal Estimation. arXiv preprint arXiv:2602.00839, 2026. arXiv
Sean Bell, Kavita Bala, Noah Snavely. Intrinsic Images in the Wild. ACM Transactions on Graphics (SIGGRAPH), 2014.
Qifeng Chen, Vladlen Koltun. A Simple Model for Intrinsic Image Decomposition with Depth Cues. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2013.
Duane C Brown. Close-range camera calibration. Photogrammetric Engineering, 1971.
Zhengyou Zhang. A Flexible New Technique for Camera Calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000.
D. Scharstein, R. Szeliski. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Computer Vision, 2002.
S. M. Seitz, B. Curless, J. Diebel, D. Scharstein, R. Szeliski. A comparison and evaluation of multi-view stereo reconstruction algorithms. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2006.
Lahav Lipson, Zachary Teed, Jia Deng. RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching. International Conference on 3D Vision, 2021.
Peiliang Li, Xiaozhi Chen, Shaojie Shen. Stereo R-CNN Based 3D Object Detection for Autonomous Driving. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019.
Yilun Chen, Shu Liu, Xiaoyong Shen, Jiaya Jia. DSGN: Deep Stereo Geometry Network for 3D Object Detection. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.
Xiaoyang Guo, et al.. LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-Based 3D Detector. IEEE/CVF International Conference on Computer Vision, 2021.
Antonio Criminisi, Ian Reid, Andrew Zisserman. Single View Metrology. International Journal of Computer Vision, 2000.
Bruno Caprile, Vincenzo Torre. Using Vanishing Points for Camera Calibration. International Journal of Computer Vision, 1990.
David Liebowitz, Andrew Zisserman. Metric Rectification for Perspective Images of Planes. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 1998.
Xiaozhi Chen, Kaustav Kundu, Yukun Zhu, Huimin Ma, Sanja Fidler, Raquel Urtasun. Monocular 3D Object Detection for Autonomous Driving. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Arsalan Mousavian, Dragomir Anguelov, John Flynn, Jana Kosecka. 3D Bounding Box Estimation Using Deep Learning and Geometry. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2017.
Manei, et al.. MonoDIS: Geometry and Context Aware Monocular 3D Object Detection. IEEE/CVF International Conference on Computer Vision Workshops, 2019.
Garrick Brazil, Xiaoming Liu. M3D-RPN: Monocular 3D Region Proposal Network for Object Detection. IEEE/CVF International Conference on Computer Vision, 2019.
Zechen Liu, Zizhang Wu, Roland Toth, et al.. SMOKE: Single-Stage Monocular 3D Object Detection via Keypoint Estimation. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020.
Tai Wang, et al.. FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detection. IEEE/CVF International Conference on Computer Vision Workshops, 2021.
Liu, et al.. MonoCon: Monocular 3D Object Detection with Monocular Contextual Constraints. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Wei Yin, et al.. Metric3D: Towards Zero-Shot Metric 3D Prediction from a Single Image. arXiv preprint, 2024.
He Wang, Srinath Sridhar, Jingwei Huang, Julien Valentin, Shuran Song, Leonidas J. Guibas. Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimation. CVPR, 2019.
Fisher Yu, Haofeng Chen, Xin Wang, Wenqi Xian, Yingying Chen, Fangchen Liu, Vashisht Madhavan, Trevor Darrell. Bdd100k: A diverse driving dataset for heterogeneous multitask learning. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Milind Naphade, Ming-Ching Chang, Anuj Sharma, David C. Anastasiu, Vamsi Jagarlamudi, Pranamesh Chakraborty, Tingting Huang, Shuo Wang, Ming-Yu Liu, Rama Chellappa, Jenq-Neng Hwang, Siwei Lyu. The 2018 NVIDIA AI City Challenge. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) Workshop, 2018.
Jakub Sochor, Roman Juránek, Jakub Spanhel, Lukás Marsík, Adam Siroký, Adam Herout, Pavel Zemcík. BrnoCompSpeed: Review of Traffic Camera Calibration and Comprehensive Dataset for Monocular Speed Measurement. arXiv preprint arXiv:1702.06441, 2017. arXiv
Md Golam Moazzam, Mohammad Reduanul Haque, Mohammad Shorif Uddin. Image-based vehicle speed estimation. Journal of computer and communications, 2019.
Ruimin Ke, Sung Kim, Zhibin Li, Yinhai Wang. Motion-vector clustering for traffic speed detection from UAV video. ISC2, 2015.
Sameer Agarwal, Noah Snavely, Steven M Seitz, Richard Szeliski. Bundle adjustment in the large. Proceedings of the European Conference on Computer Vision (ECCV), 2010.
Linfei Pan, Dániel Baráth, Marc Pollefeys, Johannes Lutz Schönberger. Global Structure-from-Motion Revisited. European Conference on Computer Vision (ECCV), 2024.
Jakob Engel, Thomas Schöps, Daniel Cremers. LSD-SLAM: Large-scale direct monocular SLAM. Proceedings of the European Conference on Computer Vision (ECCV), 2014.
Jakob Engel, Vladlen Koltun, Daniel Cremers. Direct sparse odometry. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2017.
Jianyuan Wang, Nikita Karaev, Christian Rupprecht, David Novotny. Vggsfm: Visual geometry grounded deep structure from motion. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2024.
Eric Brachmann, Jamie Wynn, Shuai Chen, Tommaso Cavallari, Áron Monszpart, Daniyar Turmukhambetov, Victor Adrian Prisacariu. Scene coordinate reconstruction: Posing of image collections via incremental learning of a relocalizer. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Weirong Chen, Le Chen, Rui Wang, Marc Pollefeys. Leap-vo: Long-term effective any point tracking for visual odometry. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2024.
Alex Kendall, Matthew Grimes, Roberto Cipolla. Posenet: A convolutional network for real-time 6-dof camera relocalization. Proceedings of the IEEE international conference on computer vision (ICCV), 2015.
Jamie Shotton, Ben Glocker, Christopher Zach, Shahram Izadi, Antonio Criminisi, Andrew Fitzgibbon. Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2013.
Eric Brachmann, Alexander Krull, Sebastian Nowozin, Jamie Shotton, Frank Michel, Stefan Gumhold, Carsten Rother. DSAC - Differentiable RANSAC for camera localization. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2017.
Paul-Edouard Sarlin, Cesar Cadena, Roland Siegwart, Marcin Dymczyk. From coarse to fine: Robust hierarchical localization at large scale. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2019.
Siyan Dong, Shuzhe Wang, Shaohui Liu, Lulu Cai, Qingnan Fan, Juho Kannala, Yanchao Yang. Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization. arXiv, 2024. arXiv
Vincent Leroy, Yohann Cabon, Jerome Revaud. Grounding Image Matching in 3D with MASt3R. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Bardienus Duisterhof, Lojze Zust, Philippe Weinzaepfel, Vincent Leroy, Yohann Cabon, Jerome Revaud. MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motion. arXiv, 2024. arXiv
Junyi Zhang, Charles Herrmann, Junhwa Hur, Varun Jampani, Trevor Darrell, Forrester Cole, Deqing Sun, Ming-Hsuan Yang. MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion. ICLR, 2025.
Qianqian Wang, Yifei Zhang, Aleksander Holynski, Alexei A Efros, Angjoo Kanazawa. Continuous 3d perception model with persistent state. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Jianing Yang, Alexander Sax, Kevin J Liang, Mikael Henaff, Hao Tang, Ang Cao, Joyce Chai, Franziska Meier, Matt Feiszli. Fast3r: Towards 3d reconstruction of 1000+ images in one forward pass. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
M. Burri, J. Nikolic, P. Gohl, T. Schneider, J. Rehder, S. Omari, M. W. Achtelik, R. Siegwart. The EuRoC micro aerial vehicle datasets. Int. J. Robotics Research, 2016.
Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, Noah Snavely. Stereo magnification: Learning view synthesis using multiplane images. arXiv preprint arXiv:1805.09817, 2018. arXiv
Lu Ling, Yichen Sheng, Zhi Tu, Wentian Zhao, Cheng Xin, Kun Wan, Lantao Yu, Qianyu Guo, Zixun Yu, Yawen Lu, et al.. DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Vision. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
C. Campos, R. Elvira, J. J. G. Rodrı́guez, J. M. Montiel, J. D. Tardós. ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multi-Map SLAM. Proc. IEEE IROS, 2021.
Yu Xiang, Tanner Schmidt, Venkatraman Narayanan, Dieter Fox. Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes. arXiv preprint arXiv:1711.00199, 2017. arXiv
Sida Peng, Yuan Liu, Qixing Huang, Xiaowei Zhou, Hujun Bao. PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Wadim Kehl, Fabian Manhardt, Federico Tombari, Slobodan Ilic, Nassir Navab. SSD-6D: Making RGB-Based 3D Detection and 6D Pose Estimation Great Again. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
C. Wang, D. Xu, Y. Zhu, R. Martı́n-Mart\ń, C. Lu, L. Fei-Fei, S. Savarese. DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion. Proc. CVPR, 2019.
Gu Wang, Fabian Manhardt, Federico Tombari, Xiangyang Ji. GDR-Net: Geometry-Guided Direct Regression Network for Monocular 6D Object Pose Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Yongzhi Su, Mahdi Saleh, Torben Fetzer, Jason Rambach, Nassir Navab, Benjamin Busam, Didier Stricker, Federico Tombari. ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Rasmus Laurvig Haugaard, Anders Glent Buch. SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddings. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Hansheng Chen, Pichao Wang, Fan Wang, Wei Tian, Lu Xiong, Hao Li. EPro-PnP: Generalized end-to-end probabilistic perspective-n-points for monocular object pose estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Yi Li, Gu Wang, Xiangyang Ji, Yu Xiang, Dieter Fox. DeepIM: Deep Iterative Matching for 6D Pose Estimation. Proceedings of the European Conference on Computer Vision (ECCV), 2018.
Y. Labbé, J. Carpentier, M. Aubry, J. Sivic. CosyPose: Consistent Multi-View Multi-Object 6D Pose Estimation. 2020. arXiv
Yinlin Hu, Sebastien Speierer, Wenzel Jakob, Pascal Fua, Mathieu Salzmann. Wide-depth-range 6d object pose estimation in space. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021.
Wei Chen, Xi Jia, Hyung Jin Chang, Jinming Duan, Linlin Shen, Aleš Leonardis. FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanism. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Yan Di, Ruida Zhang, Zhiqiang Lou, Fabian Manhardt, Xiangyang Ji, Nassir Navab, Federico Tombari. GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Voting. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Haitao Lin, Zichang Liu, Chilam Cheang, Yanwei Fu, Guodong Guo, Xiangyang Xue. SAR-Net: Shape Alignment and Recovery Network for Category-Level 6D Object Pose and Size Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Jianhui Liu, Yukang Chen, Xiaoqing Ye, Xiaojuan Qi. Prior-free Category-level Pose Estimation with Implicit Space Transformation. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Yamei Chen, Yan Di, Guangyao Zhai, Fabian Manhardt, Chenyangguang Zhang, Ruida Zhang, Federico Tombari, Nassir Navab, Benjamin Busam. SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Xiao Lin, Wenfei Yang, Yuan Gao, Tianzhu Zhang. Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Jiyao Zhang, Mingdong Wu, Hao Dong. GenPose: Generative Category-level Object Pose Estimation via Diffusion Models. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Jiaming Sun, Zihao Wang, Siyu Zhang, Xingyi He, Hongcheng Zhao, Guofeng Zhang, Xiaowei Zhou. OnePose: One-Shot Object Pose Estimation without CAD Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Xingyi He, Jiaming Sun, Yuang Wang, Di Huang, Hujun Bao, Xiaowei Zhou. OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Models. Advances in Neural Information Processing Systems (NeurIPS), 2022.
Yuan Liu, Yilin Wen, Sida Peng, Cheng Lin, Xiaoxiao Long, Taku Komura, Wenping Wang. Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Images. Proceedings of the European Conference on Computer Vision (ECCV), 2022.
Yann Labbé, Lucas Manuelli, Arsalan Mousavian, Stephen Tyree, Stan Birchfield, Jonathan Tremblay, Justin Carpentier, Mathieu Aubry, Dieter Fox, Josef Sivic. MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare. Conference on Robot Learning (CoRL), 2022.
Bowen Wen, Wei Yang, Jan Kautz, Stan Birchfield. FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Van Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann, Vincent Lepetit. GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Jiehong Lin, Lihua Liu, Dekun Lu, Kui Jia. SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Evin Pınar Örnek, Yann Labbé, Bugra Tekin, Lingni Ma, Cem Keskin, Christian Forster, Tomas Hodan. FoundPose: Unseen Object Pose Estimation with Foundation Features. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Andrea Caraffa, Davide Boscaini, Amir Hamza, Fabio Poiesi. FreeZe: Training-free Zero-shot 6D Pose Estimation with Geometric and Vision Foundation Models. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Van Nguyen Nguyen, Stephen Tyree, Andrew Guo, Médéric Fourmy, Anas Gouda, Taeyeop Lee, Sungphill Moon, Hyeontae Son, Lukas Ranftl, Jonathan Tremblay, Eric Brachmann, Bertram Drost, Vincent Lepetit, Carsten Rother, Stan Birchfield, Jiri Matas, Yann Labbé, Martin Sundermeyer, Tomas Hodan. BOP Challenge 2024 on Model-Based and Model-Free 6D Object Pose Estimation. arXiv preprint arXiv:2504.02812, 2024. arXiv
Stefan Hinterstoisser, Vincent Lepetit, Slobodan Ilic, Stefan Holzer, Gary Bradski, Kurt Konolige, Nassir Navab. Model Based Training, Detection and Pose Estimation of Texture-Less 3D Objects in Heavily Cluttered Scenes. Asian Conference on Computer Vision (ACCV), 2012.
Eric Brachmann, Alexander Krull, Frank Michel, Stefan Gumhold, Jamie Shotton, Carsten Rother. Learning 6D Object Pose Estimation Using 3D Object Coordinates. Proceedings of the European Conference on Computer Vision (ECCV), 2014.
T. Hodaň, P. Haluza, Š. Obdržálek, J. Matas, M. Lourakis, X. Zabulis. T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objects. Proc. IEEE WACV, 2017.
Roman Kaskman, Sergey Zakharov, Ivan Shugurov, Slobodan Ilic. HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objects. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), 2019.
Sandeep Sharma, Tae Hyung Park, Simone D'Amico. Spacecraft Pose Estimation Dataset (SPEED). Stanford Digital Repository, 2019.
Tomáš Hodaň, Frank Michel, Eric Brachmann, Wadim Kehl, Anders Glent Buch, Dirk Kraft, Bertram Drost, Joel Vidal, Stephan Ihrke, Xenophon Zabulis, Caner Sahin, Fabian Manhardt, Federico Tombari, Tae-Kyun Kim, Jiri Matas, Carsten Rother. BOP: Benchmark for 6D Object Pose Estimation. Proceedings of the European Conference on Computer Vision (ECCV), 2018.
Tomáš Hodaň, Martin Sundermeyer, Bertram Drost, Yann Labbé, Eric Brachmann, Frank Michel, Carsten Rother, Jiří Matas. BOP Challenge 2020 on 6D Object Localization. Proceedings of the European Conference on Computer Vision Workshops (ECCVW), 2020.
Martin Sundermeyer, Tomáš Hodaň, Yann Labbé, Gu Wang, Eric Brachmann, Bertram Drost, Carsten Rother, Jiří Matas. BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objects. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2023.
Taeyeop Lee, Bowen Wen, Minjun Kang, Gyuree Kang, In So Kweon, Kuk-Jin Yoon. Any6D: Model-free 6D Pose Estimation of Novel Objects. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Zhiwen Fan, Panwang Pan, Peihao Wang, Yifan Jiang, Dejia Xu, Hanwen Jiang, Zhangyang Wang. POPE: 6-DoF Promptable Pose Estimation of Any Object, in Any Scene, with One Reference. arXiv preprint arXiv:2305.15727, 2023. arXiv
Mingjie Xu, Mengyang Wu, Yuzhi Zhao, Jason Chun Lok Li, Weifeng Ou. Llava-spacesgg: Visual instruct tuning for open-vocabulary scene graph generation with enhanced spatial relations. 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025.
Rongjie Li, Songyang Zhang, Dahua Lin, Kai Chen, Xuming He. From pixels to graphs: Open-vocabulary scene graph generation with vision-language models. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Shengqiong Wu, Hao Fei, Tat-Seng Chua. Universal scene graph generation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Arnav Vaibhav Malawade, Shih-Yuan Yu, Brandon Hsu, Harsimrat Kaeley, Anurag Karra, Mohammad Abdullah Al Faruque. roadscene2vec: A tool for extracting and embedding road scene-graphs. Knowledge-Based Systems, 2022.
Xinxin Liu, Yuchen Zhou, Yongqi Ye, Chao Gou. Edge Feature-Enhanced Network for Collision Risk Assessment Using Traffic Scene Graphs. IEEE Intelligent Transportation Systems Magazine, 2024.
Linkai Liu, Xiaoyan Xiao, Yijian Yang, Yuchen Zhou, Zipeng Guo, Chao Gou. Boosting Road Event Detection with Adaptive Multi-Modal Models. 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025.
Chan Hee Song, Valts Blukis, Jonathan Tremblay, Stephen Tyree, Yu Su, Stan Birchfield. RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2025.
Shiduo Zhang, Zhe Xu, Peiju Liu, Xiaopeng Yu, Yuan Li, Qinghui Gao, Zhaoye Fei, Zhangyue Yin, Zuxuan Wu, Yu-Gang Jiang, et al.. Vlabench: A large-scale benchmark for language-conditioned robotics manipulation with long-horizon reasoning tasks. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Kaiyu Yang, Olga Russakovsky, Jia Deng. Spatialsense: An adversarially crowdsourced benchmark for spatial relation recognition. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Yu Zhao, Hao Fei, Bobo Li, Meishan Zhang, Min Zhang. The ACM Multimedia 2024 Viual Spatial Description Grand Challenge. Proceedings of the 32nd ACM International Conference on Multimedia, 2024.
Yu Zhao, Jianguo Wei, ZhiChao Lin, Yueheng Sun, Meishan Zhang, Min Zhang. Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022.
Yu Zhao, Hao Fei, Wei Ji, Jianguo Wei, Meishan Zhang, Min Zhang, Tat-Seng Chua. Generating Visual Spatial Description via Holistic 3D Scene Understanding. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023.
An-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo, Ruihan Yang, Jan Kautz, Xiaolong Wang, Sifei Liu. Spatialrgpt: Grounded spatial reasoning in vision-language models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Yuchen Zhou, Xinxin Liu, Zipeng Guo, Ming Cai, Chao Gou. Hktsg: A hierarchical knowledge-guided traffic scene graph representation learning framework for intelligent vehicles. IEEE Transactions on Intelligent Vehicles, 2024.
Yu-Chih Liu, Kai-Ying Lin, Yong-Sheng Chen. Bird’s-eye view vision system for vehicle surrounding monitoring. International Workshop on Robot Vision, 2008.
Yinyu Nie, Xiaoguang Han, Shihui Guo, Yujian Zheng, Jian Chang, Jian Jun Zhang. Total3dunderstanding: Joint layout, object pose and mesh reconstruction for indoor scenes from a single image. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.
Wenxiao Cai, Yaroslav Ponomarenko, Jianhao Yuan, Xiaoqi Li, Wankou Yang, Hao Dong, Bo Zhao. SpatialBot: Precise Spatial Understanding with Vision Language Models. arXiv preprint arXiv:2406.13642, 2024. arXiv
Wufei Ma, Luoxin Ye, Celso M de Melo, Alan Yuille, Jieneng Chen. Spatialllm: A compound 3d-informed design towards spatially-intelligent large multimodal models. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Ranjay Krishna, Yuke Zhu, Oliver Groth, Justin Johnson, Kenji Hata, Joshua Kravitz, Stephanie Chen, Yannis Kalantidis, Li-Jia Li, David A Shamma, et al.. Visual genome: Connecting language and vision using crowdsourced dense image annotations. International journal of computer vision, 2017.
Anja Belz, Adrian Muscat, Pierre Anguill, Mouhamadou Sow, Gaétan Vincent, Yassine Zinessabah. Spatialvoc2k: A multilingual dataset of images with annotations and features for spatial relations between objects. Proceedings of the 11th International Conference on Natural Language Generation, 2018.
Danfei Xu, Yuke Zhu, Christopher B Choy, Li Fei-Fei. Scene graph generation by iterative message passing. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Xiaojun Chang, Pengzhen Ren, Pengfei Xu, Zhihui Li, Xiaojiang Chen, Alex Hauptmann. A comprehensive survey of scene graphs: Generation and application. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021.
Hongsheng Li, Guangming Zhu, Liang Zhang, Youliang Jiang, Yixuan Dang, Haoran Hou, Peiyi Shen, Xia Zhao, Syed Afaq Ali Shah, Mohammed Bennamoun. Scene graph generation: A comprehensive survey. Neurocomputing, 2024.
Yang Miao, Francis Engelmann, Olga Vysotska, Federico Tombari, Marc Pollefeys, Dániel Béla Baráth. Scenegraphloc: Cross-modal coarse visual localization on 3d scene graphs. European Conference on Computer Vision, 2024.
Yiwu Zhong, Liwei Wang, Jianshu Chen, Dong Yu, Yin Li. Comprehensive image captioning via scene graph decomposition. European conference on computer vision, 2020.
Fan Lu, Wei Wu, Kecheng Zheng, Shuailei Ma, Biao Gong, Jiawei Liu, Wei Zhai, Yang Cao, Yujun Shen, Zheng-Jun Zha. Benchmarking large vision-language models via directed scene graph for comprehensive image captioning. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Yuchen Zhou, Yue Zhang, Zhanwei Zhao, Kaidong Zhang, Chao Gou. Toward driving scene understanding: A paradigm and benchmark dataset for ego-centric traffic scene graph representation. IEEE Journal of Radio Frequency Identification, 2022.
Xinxin Liu, Yuchen Zhou, Chao Gou. Learning from interaction-enhanced scene graph for pedestrian collision risk assessment. IEEE Transactions on Intelligent Vehicles, 2023.
Giang Nguyen, Mihai Pomarlan, Sascha Jongebloed, Nils Leusmann, Minh Nhat Vu, Michael Beetz. Generating Actionable Robot Knowledge Bases by Combining 3D Scene Graphs with Robot Ontologies. arXiv preprint arXiv:2507.11770, 2025. arXiv
Abdelrhman Werby, Chenguang Huang, Martin Büchner, Abhinav Valada, Wolfram Burgard. Hierarchical open-vocabulary 3d scene graphs for language-grounded robot navigation. First Workshop on Vision-Language Models for Navigation and Manipulation at ICRA 2024, 2024.
Sourav Garg, Krishan Rana, Mehdi Hosseinzadeh, Lachlan Mares, Niko Sünderhauf, Feras Dayoub, Ian Reid. Robohop: Segment-based topological map representation for open-world visual navigation. 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024.
Rowan Zellers, Mark Yatskar, Sam Thomson, Yejin Choi. Neural motifs: Scene graph parsing with global context. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Yao Teng, Limin Wang, Zhifeng Li, Gangshan Wu. Target adaptive context aggregation for video scene graph generation. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Yuren Cong, Wentong Liao, Hanno Ackermann, Bodo Rosenhahn, Michael Ying Yang. Spatial-temporal transformer for dynamic scene graph generation. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Zhuang Li, Yuyang Chai, Terry Yue Zhuo, Lizhen Qu, Gholamreza Haffari, Fei Li, Donghong Ji, Quan Hung Tran. Factual: A benchmark for faithful and consistent textual scene graph parsing. arXiv preprint arXiv:2305.17497, 2023. arXiv
Woo Suk Choi, Yu-Jung Heo, Dharani Punithan, Byoung-Tak Zhang. Scene graph parsing via abstract meaning representation in pre-trained language models. Proceedings of the 2nd workshop on deep learning on graphs for natural language processing (DLG4NLP 2022), 2022.
Yong-Lu Li, Siyuan Zhou, Xijie Huang, Liang Xu, Ze Ma, Hao-Shu Fang, Yanfeng Wang, Cewu Lu. Transferable interactiveness knowledge for human-object interaction detection. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Jinwang Wang, Wen Yang, Heng-Chao Li, Haijian Zhang, Gui-Song Xia. Learning center probability map for detecting objects in aerial images. IEEE Transactions on Geoscience and Remote Sensing, 2020.
Jingkang Yang, Yi Zhe Ang, Zujin Guo, Kaiyang Zhou, Wayne Zhang, Ziwei Liu. Panoptic scene graph generation. European conference on computer vision, 2022.
Jingkang Yang, Wenxuan Peng, Xiangtai Li, Zujin Guo, Liangyu Chen, Bo Li, Zheng Ma, Kaiyang Zhou, Wayne Zhang, Chen Change Loy, et al.. Panoptic video scene graph generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Rongjie Li, Songyang Zhang, Bo Wan, Xuming He. Bipartite graph network with adaptive message passing for unbiased scene graph generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Xin Lin, Changxing Ding, Jinquan Zeng, Dacheng Tao. Gps-net: Graph property sensing network for scene graph generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Lin Li, Guikun Chen, Jun Xiao, Yi Yang, Chunping Wang, Long Chen. Compositional feature augmentation for unbiased scene graph generation. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Yuchen Zhou, Guang Tan, Chao Gou. Hierarchical home action understanding with implicit and explicit prior knowledge. ICASSP, 2024.
Jinbae Im, JeongYeon Nam, Nokyung Park, Hyungmin Lee, Seunghyun Park. Egtr: Extracting graph from transformer for scene graph generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Guan Wang, Zhimin Li, Qingchao Chen, Yang Liu. Oed: Towards one-stage end-to-end dynamic scene graph generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Alejandro Newell, Jia Deng. Pixels to graphs by associative embedding. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017.
Hengyue Liu, Ning Yan, Masood Mortazavi, Bir Bhanu. Fully convolutional scene graph generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Yuren Cong, Michael Ying Yang, Bodo Rosenhahn. Reltr: Relation transformer for scene graph generation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
Rongjie Li, Songyang Zhang, Xuming He. Sgtr: End-to-end scene graph generation with transformer. proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Xiaodan Liang, Lisa Lee, Eric P Xing. Deep variation-structured reinforcement learning for visual relationship and attribute detection. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Cewu Lu, Ranjay Krishna, Michael Bernstein, Li Fei-Fei. Visual relationship detection with language priors. European conference on computer vision, 2016.
Zhen Cui, Chunyan Xu, Wenming Zheng, Jian Yang. Context-dependent diffusion network for visual relationship detection. Proceedings of the 26th ACM international conference on Multimedia, 2018.
Ruichi Yu, Ang Li, Vlad I Morariu, Larry S Davis. Visual relationship detection with internal and external linguistic knowledge distillation. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Yuchen Zhou, Guang Tan, Mengtang Li, Chao Gou. Learning from easy to hard pairs: Multi-step reasoning network for human-object interaction detection. Proceedings of the 31st ACM International Conference on Multimedia, 2023.
Robyn Speer, Joshua Chin, Catherine Havasi. Conceptnet 5.5: An open multilingual graph of general knowledge. Proceedings of the AAAI conference on artificial intelligence, 2017.
Ce Zhang, Simon Stepputtis, Joseph Campbell, Katia Sycara, Yaqi Xie. Hiker-sgg: Hierarchical knowledge enhanced robust scene graph generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Zhanwen Chen, Saed Rezayi, Sheng Li. More knowledge, less bias: Unbiasing scene graph generation with explicit ontological adjustment. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023.
Guikun Chen, Jin Li, Wenguan Wang. Scene graph generation with role-playing large language models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Kibum Kim, Kanghoon Yoon, Jaehyeong Jeon, Yeonjun In, Jinyoung Moon, Donghyun Kim, Chanyoung Park. Llm4sgg: Large language models for weakly supervised scene graph generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Mohammad Amin Sadeghi, Ali Farhadi. Recognition using Visual Phrases. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011.
Drew A Hudson, Christopher D Manning. Gqa: A new dataset for real-world visual reasoning and compositional question answering. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Yuanzhi Liang, Yalong Bai, Wei Zhang, Xueming Qian, Li Zhu, Tao Mei. Vrr-vg: Refocusing visually-relevant relationships. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Julia Peyre, Ivan Laptev, Cordelia Schmid, Josef Sivic. Weakly-supervised learning of visual relations. Proceedings of the IEEE international conference on computer vision, 2017.
Yansheng Li, Kun Li, Yongjun Zhang, Linlin Wang, Dingwen Zhang. Aug: A new dataset and an efficient model for aerial image urban scene graph generation. arXiv preprint arXiv:2404.07788, 2024. arXiv
Yansheng Li, Linlin Wang, Tingzhu Wang, Xue Yang, Junwei Luo, Qi Wang, Youming Deng, Wenbin Wang, Xian Sun, Haifeng Li, et al.. STAR: A first-ever dataset and a large-scale benchmark for scene graph generation in large-size satellite imagery. IEEE Trans. Pattern Anal. Mach. Intell, 2025.
Qiwei Yan, Chubo Deng, Chenglong Liu, Zhongyan Hou, Xiaorui Liu, Yi Jiang, Wanxuan Lu, Fanglong Yao, Xiaoyu Liu, Lingxiang Hao, et al.. Recon1m: A large-scale benchmark dataset for relation comprehension in remote sensing imagery. IEEE Transactions on Geoscience and Remote Sensing, 2025.
Junwei Luo, Zhen Pang, Yongjun Zhang, Tingzhu Wang, Linlin Wang, Bo Dang, Jiangwei Lao, Jian Wang, Jingdong Chen, Yihua Tan, et al.. Skysensegpt: A fine-grained instruction tuning dataset and model for remote sensing vision-language understanding. arXiv preprint arXiv:2406.10100, 2024. arXiv
Xindi Shang, Tongwei Ren, Jingfan Guo, Hanwang Zhang, Tat-Seng Chua. Video Visual Relation Detection. ACM International Conference on Multimedia, 2017.
Xindi Shang, Donglin Di, Junbin Xiao, Yu Cao, Xun Yang, Tat-Seng Chua. Annotating Objects and Relations in User-Generated Videos. Proceedings of the 2019 on International Conference on Multimedia Retrieval, 2019.
Jingwei Ji, Ranjay Krishna, Li Fei-Fei, Juan Carlos Niebles. Action genome: Actions as compositions of spatio-temporal scene graphs. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Trong-Thuan Nguyen, Pha Nguyen, Xin Li, Jackson Cothren, Alper Yilmaz, Khoa Luu. CYCLO: Cyclic graph transformer approach to multi-object relationship modeling in aerial videos. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Trong-Thuan Nguyen, Pha Nguyen, Khoa Luu. Hig: Hierarchical interlacement graph approach to scene graph generation in video understanding. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Ivan Rodin, Antonino Furnari, Kyle Min, Subarna Tripathi, Giovanni Maria Farinella. Action scene graphs for long-form understanding of egocentric videos. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Jingkang Yang, Jun Cen, Wenxuan Peng, Shuai Liu, Fangzhou Hong, Xiangtai Li, Kaiyang Zhou, Qifeng Chen, Ziwei Liu. 4d panoptic scene graph generation. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Ege Özsoy, Evin Pınar Örnek, Ulrich Eck, Tobias Czempiel, Federico Tombari, Nassir Navab. 4d-or: Semantic scene graphs for or domain modeling. International conference on medical image computing and computer-assisted intervention, 2022.
Ege Özsoy, Chantal Pellegrini, Tobias Czempiel, Felix Tristram, Kun Yuan, David Bani-Harouni, Ulrich Eck, Benjamin Busam, Matthias Keicher, Nassir Navab. Mm-or: A large multimodal operating room dataset for semantic understanding of high-intensity surgical environments. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Ege Özsoy, Arda Mamur, Felix Tristram, Chantal Pellegrini, Magdalena Wysocki, Benjamin Busam, Nassir Navab. Egoexor: An ego-exo-centric operating room dataset for surgical activity understanding. Advances in Neural Information Processing Systems, 2025.
Dongil Yang, Minjin Kim, Sunghwan Kim, Beong-woo Kwak, Minjun Park, Jinseok Hong, Woontack Woo, Jinyoung Yeo. Llm meets scene graph: Can large language models understand and generate scene graphs? a benchmark and empirical study. arXiv preprint arXiv:2505.19510, 2025. arXiv
Shaoqing Lin, Chong Teng, Fei Li, Donghong Ji, Lizhen Qu, Zhuang Li. DiscoSG: Towards Discourse-Level Text Scene Graph Parsing through Iterative Graph Refinement. arXiv preprint arXiv:2506.15583, 2025. arXiv
Weixiang Yang, Qi Li, Wenxi Liu, Yuanlong Yu, Yuexin Ma, Shengfeng He, Jia Pan. Projecting Your View Attentively: Monocular Road Scene Layout Estimation via Cross-View Transformation. Proc. CVPR, 2021.
Varsha Hedau, Derek Hoiem, David A. Forsyth. Recovering the spatial layout of cluttered rooms. Proc. ICCV, 2009.
Carsten Rother. A new approach to vanishing point detection in architectural environments. Image Vis. Comput., 2002.
Arun Mallya, Svetlana Lazebnik. Learning Informative Edge Maps for Indoor Scene Layout Prediction. Proc. ICCV, 2015.
Chen-Yu Lee, Vijay Badrinarayanan, Tomasz Malisiewicz, Andrew Rabinovich. RoomNet: End-to-End Room Layout Estimation. Proc. ICCV, 2017.
Chuhang Zou, Alex Colburn, Qi Shan, Derek Hoiem. LayoutNet: Reconstructing the 3D Room Layout From a Single RGB Image. Proc. CVPR, 2018.
Cheng Sun, Chi-Wei Hsiao, Min Sun, Hwann-Tzong Chen. HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Cheng Sun, Min Sun, Hwann-Tzong Chen. HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Features. Proc. CVPR, 2021.
Fu-En Wang, Yu-Hsuan Yeh, Min Sun, Wei-Chen Chiu, Yi-Hsuan Tseng. LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Rendering. Proc. CVPR, 2021.
Shang-Ta Yang, Fu-En Wang, Chi-Han Peng, Peter Wonka, Min Sun, Hung-Kuo Chu. DuLa-Net: A Dual-Projection Network for Estimating Room Layouts from a Single RGB Panorama. Proc. CVPR, 2019.
Giovanni Pintore, Marco Agus, Enrico Gobbetti. AtlantaNet: Inferring the 3D Indoor Layout from a Single 360 Image beyond the Manhattan World Assumption. Proc. ECCV, 2020.
Weidong Zhang, Wei Zhang, Yinda Zhang. GeoLayout: Geometry Driven Room Layout Estimation Based on Depth Maps of Planes. Proc. ECCV, 2020.
Fisher Yu, Ari Seff, Yinda Zhang, Shuran Song, Thomas Funkhouser, Jianxiong Xiao. LSUN: Construction of a Large-Scale Image Dataset using Deep Learning with Humans in the Loop. arXiv preprint arXiv:1506.03365, 2015. arXiv
Shichao Yang, Daniel Maturana, Sebastian A. Scherer. Real-time 3D scene layout from a single image using Convolutional Neural Networks. Proc. ICRA, 2016.
Axel Furlan, Stephen D. Miller, Domenico G. Sorrenti, Li Fei-Fei, Silvio Savarese. Free your Camera: 3D Indoor Scene Understanding from Arbitrary Camera Motion. Proc. BMVC, 2013.
Grace Tsai, Changhai Xu, Jingen Liu, Benjamin Kuipers. Real-time indoor scene understanding using Bayesian filtering with motion cues. Proc. ICCV, 2011.
Yinda Zhang, Shuran Song, Ping Tan, Jianxiong Xiao. PanoContext: A Whole-Room 3D Context Model for Panoramic Scene Understanding. Proc. ECCV, 2014.
Iro Armeni, Sasha Sax, Amir R. Zamir, Silvio Savarese. Joint 2D-3D-Semantic Data for Indoor Scene Understanding. arXiv preprint arXiv:1702.01105, 2017. arXiv
Karen Simonyan, Andrew Zisserman. Two-stream convolutional networks for action recognition in videos. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2014.
Ali Diba, Mohsen Fayyaz, Vivek Sharma, Amir Hossein Karami, Mohammad Mahdi Arzani, Rahman Yousefzadeh, Luc Van Gool. Temporal 3d convnets: New architecture and transfer learning for video classification. arXiv preprint arXiv:1711.08200, 2017. arXiv
Du Tran, Heng Wang, Lorenzo Torresani, Jamie Ray, Yann LeCun, Manohar Paluri. A closer look at spatiotemporal convolutions for action recognition. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2018.
Zhaofan Qiu, Ting Yao, Tao Mei. Learning spatio-temporal representation with pseudo-3d residual networks. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Limin Wang, Yuanjun Xiong, Zhe Wang, Yu Qiao, Dahua Lin, Xiaoou Tang, Luc Van Gool. Temporal segment networks: Towards good practices for deep action recognition. European conference on computer vision, 2016.
Rohit Girdhar, Joao Carreira, Carl Doersch, Andrew Zisserman. Video action transformer network. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Jiewen Yang, Xingbo Dong, Liujun Liu, Chao Zhang, Jiajun Shen, Dahai Yu. Recurring the transformer for video action recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Yue Zhao, Yuanjun Xiong, Limin Wang, Zhirong Wu, Xiaoou Tang, Dahua Lin. Temporal action detection with structured segment networks. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Tianwei Lin, Xu Zhao, Haisheng Su, Chongjing Wang, Ming Yang. Bsn: Boundary sensitive network for temporal action proposal generation. Proceedings of the European conference on computer vision (ECCV), 2018.
Zheng Shou, Hang Gao, Lei Zhang, Kazuyuki Miyazawa, Shih-Fu Chang. Autoloc: Weakly-supervised temporal action localization in untrimmed videos. Proceedings of the european conference on computer vision (ECCV), 2018.
Can Zhang, Meng Cao, Dongming Yang, Jie Chen, Yuexian Zou. Cola: Weakly-supervised temporal action localization with snippet contrastive learning. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Sujoy Paul, Sourya Roy, Amit K Roy-Chowdhury. W-talc: Weakly-supervised temporal activity localization and classification. Proceedings of the European conference on computer vision (ECCV), 2018.
Ziying Xia, Jian Cheng, Siyu Liu, Yongxiang Hu, Shiguang Wang, Yijie Zhang, Liwan Dang. Realigning confidence with temporal saliency information for point-level weakly-supervised temporal action localization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Pilhyeon Lee, Hyeran Byun. Learning action completeness from points for weakly-supervised temporal action localization. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Jie Fu, Junyu Gao, Changsheng Xu. Compact representation and reliable classification learning for point-level weakly-supervised action localization. IEEE Transactions on Image Processing, 2022.
Jiyang Gao, Zhenheng Yang, Kan Chen, Chen Sun, Ram Nevatia. Turn tap: Temporal unit regression network for temporal action proposals. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Zheng Shou, Dongang Wang, Shih-Fu Chang. Temporal action localization in untrimmed videos via multi-stage cnns. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
Tianwei Lin, Xu Zhao, Zheng Shou. Single shot temporal action detection. Proceedings of the 25th ACM international conference on Multimedia, 2017.
Chuming Lin, Chengming Xu, Donghao Luo, Yabiao Wang, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang, Yanwei Fu. Learning salient boundary feature for anchor-free temporal action localization. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Yuanjun Xiong, Yue Zhao, Limin Wang, Dahua Lin, Xiaoou Tang. A pursuit of temporal accuracy in general activity detection. arXiv preprint arXiv:1703.02716, 2017. arXiv
Guoqiang Gong, Liangfeng Zheng, Kun Bai, Yadong Mu. Scale matters: Temporal scale aggregation network for precise action localization in untrimmed videos. arXiv preprint arXiv:1908.00707, 2019. arXiv
Yaosen Chen, Bing Guo, Yan Shen, Wei Wang, Weichen Lu, Xinhua Suo. Boundary graph convolutional network for temporal action detection. Image and Vision Computing, 2021.
Jiannan Wu, Peize Sun, Shoufa Chen, Jiewen Yang, Zihao Qi, Lan Ma, Ping Luo. Towards high-quality temporal action detection with sparse proposals. arXiv preprint arXiv:2109.08847, 2021. arXiv
Dingfeng Shi, Yujie Zhong, Qiong Cao, Jing Zhang, Lin Ma, Jia Li, Dacheng Tao. React: Temporal action detection with relational queries. European conference on computer vision, 2022.
Jihwan Kim, Miso Lee, Jae-Pil Heo. Self-feedback detr for temporal action detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Yuhan Zhu, Guozhen Zhang, Jing Tan, Gangshan Wu, Limin Wang. Dual detrs for multi-label temporal action detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Khurram Soomro, Amir Roshan Zamir, Mubarak Shah. Ucf101: A dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv:1212.0402, 2012. arXiv
Hildegard Kuehne, Hueihan Jhuang, Estı́baliz Garrote, Tomaso Poggio, Thomas Serre. HMDB: a large video database for human motion recognition. 2011 International conference on computer vision, 2011.
Chunhui Gu, Chen Sun, David A Ross, Carl Vondrick, Caroline Pantofaru, Yeqing Li, Sudheendra Vijayanarasimhan, George Toderici, Susanna Ricco, Rahul Sukthankar, et al.. Ava: A video dataset of spatio-temporally localized atomic visual actions. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Yu-Gang Jiang, Jingen Liu, A Roshan Zamir, George Toderici, Ivan Laptev, Mubarak Shah, Rahul Sukthankar. THUMOS challenge: Action recognition with a large number of classes. 2014.
Fabian Caba Heilbron, Victor Escorcia, Bernard Ghanem, Juan Carlos Niebles. Activitynet: A large-scale video benchmark for human activity understanding. Proceedings of the ieee conference on computer vision and pattern recognition, 2015.
Hang Zhao, Antonio Torralba, Lorenzo Torresani, Zhicheng Yan. Hacs: Human action clips and segments dataset for recognition and temporal localization. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Yi Liu, Limin Wang, Yali Wang, Xiao Ma, Yu Qiao. Fineaction: A fine-grained video dataset for temporal action localization. IEEE transactions on image processing, 2022.
Serena Yeung, Olga Russakovsky, Ning Jin, Mykhaylo Andriluka, Greg Mori, Li Fei-Fei. Every moment counts: Dense detailed labeling of actions in complex videos. International Journal of Computer Vision, 2018.
Gunnar A Sigurdsson, Gül Varol, Xiaolong Wang, Ali Farhadi, Ivan Laptev, Abhinav Gupta. Hollywood in homes: Crowdsourcing data collection for activity understanding. European conference on computer vision, 2016.
Roeland De Geest, Efstratios Gavves, Amir Ghodrati, Zhenyang Li, Cees Snoek, Tinne Tuytelaars. Online action detection. European Conference on Computer Vision, 2016.
Hilde Kuehne, Ali Arslan, Thomas Serre. The language of actions: Recovering the syntax and semantics of goal-directed human activities. Proceedings of the IEEE conference on computer vision and pattern recognition, 2014.
Sebastian Stein, Stephen J McKenna. Combining embedded accelerometers with computer vision for recognizing food preparation activities. Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing, 2013.
Marcus Rohrbach, Anna Rohrbach, Michaela Regneri, Sikandar Amin, Mykhaylo Andriluka, Manfred Pinkal, Bernt Schiele. Recognizing fine-grained and composite activities using hand-centric features and script data. International Journal of Computer Vision, 2016.
Yansong Tang, Dajun Ding, Yongming Rao, Yu Zheng, Danyang Zhang, Lili Zhao, Jiwen Lu, Jie Zhou. Coin: A large-scale dataset for comprehensive instructional video analysis. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019.
Kellie Corona, Katie Osterdahl, Roderic Collins, Anthony Hoogs. Meva: A large-scale multiview, multimodal video dataset for activity detection. Proceedings of the IEEE/CVF winter conference on applications of computer vision, 2021.
Saeed Ghorbani, Kimia Mahdaviani, Anne Thaler, Konrad Kording, Douglas James Cook, Gunnar Blohm, Nikolaus F Troje. MoVi: A large multi-purpose human motion and video dataset. Plos one, 2021.
Zhihao Zhao, Reza Ghoddoosian, Isht Dwivedi, Nakul Agarwal, Behzad Dariush. Pose-Aware Weakly-Supervised Action Segmentation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Reza Ghoddoosian, Isht Dwivedi, Nakul Agarwal, Behzad Dariush. Weakly-supervised action segmentation and unseen error detection in anomalous instructional videos. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Yuchen Zhou, Linkai Liu, Chao Gou. Learning from observer gaze: Zero-shot attention prediction oriented by human-object interaction recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Wentao Bao, Kai Li, Yuxiao Chen, Deep Patel, Martin Renqiang Min, Yu Kong. Exploiting vlm localizability and semantics for open vocabulary action detection. 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025.
Linkai Liu, Yuchen Zhou, Zipeng Guo, Lei Yu, Chao Gou. Synergistic audio-textual cues: A cross-modal framework for weakly-supervised temporal action localization. Pattern Recognition, 2026.
Edgar Sucar, Shikun Liu, Joseph Ortiz, Andrew J. Davison. iMAP: Implicit Mapping and Positioning in Real-Time. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Zihan Zhu, Songyou Peng, Viktor Larsson, Weiwei Xu, Hujun Bao, Zhaopeng Cui, Marc Pollefeys. NICE-SLAM: Neural Implicit Scalable Encoding for SLAM. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022. arXiv
Nikhil Keetha, Jay Karhade, Krishna Murthy Jatavallabhula, Gengshan Yang, Sebastian Scherer, Deva Ramanan, Jonathon Luiten. SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Chi Yan, Delin Qu, Dan Xu, Bin Zhao, Zhigang Wang, Dong Wang, Xuelong Li. GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Hidenobu Matsuki, Riku Murai, Paul H. J. Kelly, Andrew J. Davison. Monocular 3D Gaussian Splatting SLAM. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Ignacio Vizzo, Tiziano Guadagnino, Benedikt Mersch, Louis Wiesmann, Jens Behley, Cyrill Stachniss. KISS-ICP: In Defense of Point-to-Point ICP---Simple, Accurate, and Robust Registration If Done the Right Way. IEEE Robotics and Automation Letters, 2023.
Tiziano Guadagnino, Benedikt Mersch, Ignacio Vizzo, Simon Schaupp, Jens Behley, Martin Stumberg, Wolfram Burgard, Luca Carlone. KISS-SLAM: A Simple, Robust, and Accurate 3D LiDAR SLAM System with Enhanced Generalization Capabilities. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025.
Kunping Huang, Sen Zhang, Jingwen Zhang, Dacheng Tao. Event-Based Simultaneous Localization and Mapping: A Comprehensive Survey. International Journal of Computer Vision, 2026.
Riku Murai, Eric Dexheimer, Andrew J. Davison. MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Andrzej Pronobis, Barbara Caputo. COLD: The CoSy Localization Database. Int. J. Robotics Res., 2009.
Ankur Handa, Thomas Whelan, John McDonald, Andrew J. Davison. A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM. Proc. ICRA, 2014.
John McCormac, Ankur Handa, Stefan Leutenegger, Andrew J. Davison. SceneNet RGB-D: Can 5M Synthetic Images Beat Generic ImageNet Pre-training on Indoor Segmentation?. Proc. ICV, 2017.
D. Schubert, T. Goll, N. Demmel, V. Usenko, J. Stückler, D. Cremers. The TUM VI benchmark for evaluating visual-inertial odometry. Proc. IROS, 2018.
Emanuele Palazzolo, Jens Behley, Philipp Lottes, Philippe Giguère, Cyrill Stachniss. ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residuals. Proc. IROS, 2019.
Wenbin Li, Sajad Saeedi, John McCormac, Ronald Clark, Dimos Tzoumanikas, Qing Ye, Yuzhong Huang, Rui Tang, Stefan Leutenegger. InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset. Proc. BMVC, 2018.
Xuesong Shi, Dongjiang Li, Pengpeng Zhao, Qinbin Tian, Yuxin Tian, Qiwei Long, Chunhao Zhu, Jingwei Song, Fei Qiao, Le Song, Yangquan Guo, Zhigang Wang, Yimin Zhang, Baoxing Qin, Wei Yang, Fangshi Wang, Rosa H. M. Chan, Qi She. Are We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAM. Proc. ICRA, 2020.
Chandan Yeshwanth, Yueh-Cheng Liu, Matthias Nießner, Angela Dai. Scannet++: A high-fidelity dataset of 3d indoor scenes. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
ETH3D. ETH3D SLAM Benchmark. r̆lhttps://www.eth3d.net/slam_benchmark, 2018.
Mathias Gehrig, Willem Aarents, Daniel Gehrig, Davide Scaramuzza. DSEC: A Stereo Event Camera Dataset for Driving Scenarios. IEEE Robotics and Automation Letters, 2021.
Doncey Albin, Miles Mena, Annika Thomas, Harel Biggie, Xuefei Sun, Dusty Woods, Steve McGuire, Christoffer Heckman. Cu-multi: A dataset for multi-robot data association. arXiv preprint arXiv:2505.17576, 2025. arXiv
Xiaowei Li, Kuan Xu, Fen Liu, Ruofei Bai, Shenghai Yuan, Lihua Xie. Airswarm: Enabling cost-effective multi-uav research with cots drones. 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025.
Sundar Vedula, Simon Baker, Peter Rander, Robert Collins, Takeo Kanade. Three-Dimensional Scene Flow. Proceedings of the Seventh IEEE International Conference on Computer Vision (ICCV), Kerkyra, Greece, September 20-27, 1999, 1999.
Frederic Huguet, Frederic Devernay. A Variational Method for Scene Flow Estimation from Stereo Sequences. 2007 IEEE 11th International Conference on Computer Vision (ICCV), Rio de Janeiro, Brazil, October 14-21, 2007, 2007.
Andreas Wedel, Thomas Brox, Tobi Vaudrey, Clemens Rabe, Uwe Franke, Daniel Cremers. Stereoscopic Scene Flow Computation for 3D Motion Understanding. International Journal of Computer Vision, 2011.
Tali Basha, Yael Moses, Nahum Kiryati. Multi-View Scene Flow Estimation: A View Centered Variational Approach. International Journal of Computer Vision, 2013.
Christoph Vogel, Konrad Schindler, Stefan Roth. 3D Scene Flow Estimation with a Piecewise Rigid Scene Model. International Journal of Computer Vision, 2015.
Huaizu Jiang, Deqing Sun, Varun Jampani, Zhaoyang Lv, Erik Learned-Miller, Jan Kautz. SENSE: A Shared Encoder Network for Scene-Flow Estimation. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), October 27 - November 2, 2019, 2019.
Wei-Chiu Ma, Shenlong Wang, Rui Hu, Yuwen Xiong, Raquel Urtasun. Deep Rigid Instance Scene Flow. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, June 15-20, 2019, 2019.
Zachary Teed, Jia Deng. RAFT-3D: Scene Flow using Rigid-Motion Embeddings. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, June 19-25, 2021, 2021.
Fabian Brickwedde, Steffen Abraham, Rudolf Mester. Mono-SF: Multi-View Geometry Meets Single-View Depth for Monocular Scene Flow Estimation of Dynamic Objects. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), October 27 - November 2, 2019, 2019.
Junhwa Hur, Stefan Roth. Self-Supervised Monocular Scene Flow Estimation. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, June 13-19, 2020, 2020.
Xueqian Li, Jhony Kaesemodel Pontes, Simon Lucey. Neural Scene Flow Prior. Advances in Neural Information Processing Systems (NeurIPS) 34, 2021.
Moritz Menze, Andreas Geiger. Object Scene Flow for Autonomous Vehicles. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, June 7-12, 2015, 2015.
Daniel J Butler, Jonas Wulff, Garrett B Stanley, Michael J Black. A naturalistic open source movie for optical flow evaluation. Proceedings of the European Conference on Computer Vision (ECCV), 2012.
Lukas Mehl, Jenny Schmalfuss, Azin Jahedi, Yaroslava Nalivayko, Andrés Bruhn. Spring: A high-resolution high-detail dataset and benchmark for scene flow, optical flow and stereo. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2023.
Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al.. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. arXiv
Chenxu Luo, Xiaodong Yang, Alan Yuille. Exploring simple 3d multi-object tracking for autonomous driving. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Hsu-kuang Chiu, Jie Li, Rareş Ambruş, Jeannette Bohg. Probabilistic 3D multi-modal, multi-object tracking for autonomous driving. 2021 IEEE international conference on robotics and automation (ICRA), 2021.
Shipra Ojha, Sachin Sakhare. Image processing techniques for object tracking in video surveillance-A survey. 2015 International Conference on Pervasive Computing (ICPC), 2015.
Matt Deitke, Winson Han, Alvaro Herrasti, Aniruddha Kembhavi, Eric Kolve, Roozbeh Mottaghi, Jordi Salvador, Dustin Schwenk, Eli VanderBilt, Matthew Wallingford, et al.. Robothor: An open simulation-to-real embodied ai platform. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Heng Fan, Liting Lin, Fan Yang, Peng Chu, Ge Deng, Sijia Yu, Hexin Bai, Yong Xu, Chunyuan Liao, Haibin Ling. Lasot: A high-quality benchmark for large-scale single object tracking. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Matthias Muller, Adel Bibi, Silvio Giancola, Salman Alsubaihi, Bernard Ghanem. Trackingnet: A large-scale dataset and benchmark for object tracking in the wild. Proceedings of the European conference on computer vision (ECCV), 2018.
Anton Milan, Laura Leal-Taixé, Ian Reid, Stefan Roth, Konrad Schindler. MOT16: A benchmark for multi-object tracking. arXiv preprint arXiv:1603.00831, 2016. arXiv
Patrick Dendorfer, Hamid Rezatofighi, Anton Milan, Javen Shi, Daniel Cremers, Ian Reid, Stefan Roth, Konrad Schindler, Laura Leal-Taixé. Mot20: A benchmark for multi object tracking in crowded scenes. arXiv preprint arXiv:2003.09003, 2020. arXiv
Paul Voigtlaender, Michael Krause, Aljosa Osep, Jonathon Luiten, Berin Balachandar Gnana Sekar, Andreas Geiger, Bastian Leibe. Mots: Multi-object tracking and segmentation. Proceedings of the ieee/cvf conference on computer vision and pattern recognition, 2019.
Xinshuo Weng, Jianren Wang, David Held, Kris Kitani. AB3DMOT: A Baseline for 3D Multi-Object Tracking and New Evaluation Metrics. CoRR, 2020.
Umar Iqbal, Anton Milan, Juergen Gall. Posetrack: Joint multi-person pose estimation and tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
Soumitra Samanta, Bhabatosh Chanda. A data-driven approach for human pose tracking based on spatio-temporal pictorial structure. arXiv preprint arXiv:1608.00199, 2016. arXiv
Stefanos Zafeiriou, Grigorios G Chrysos, Anastasios Roussos, Evangelos Ververas, Jiankang Deng, George Trigeorgis. The 3d menpo facial landmark tracking challenge. Proceedings of the IEEE international conference on computer vision workshops, 2017.
Daniel Stadler, Jurgen Beyerer. Improving multiple pedestrian tracking by track management and occlusion handling. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
J Van Leuven, MB Van Leeuwen, FCA Groen. Real-time vehicle tracking in image sequences. IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No. 01CH 37188), 2001.
Libo Zhang, Junyuan Gao, Zhen Xiao, Heng Fan. Animaltrack: A benchmark for multi-animal tracking in the wild. International Journal of Computer Vision, 2023.
David S Bolme, J Ross Beveridge, Bruce A Draper, Yui Man Lui. Visual object tracking using adaptive correlation filters. 2010 IEEE computer society conference on computer vision and pattern recognition, 2010.
João F Henriques, Rui Caseiro, Pedro Martins, Jorge Batista. High-speed tracking with kernelized correlation filters. IEEE transactions on pattern analysis and machine intelligence, 2014.
Ming Tang, Jiayi Feng. Multi-kernel correlation filter for visual tracking. Proceedings of the IEEE International Conference on Computer Vision, 2015.
Martin Danelljan, Goutam Bhat, Fahad Shahbaz Khan, Michael Felsberg. ECO: Efficient Convolution Operators for Tracking. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2017.
Hyeonseob Nam, Bohyung Han. Learning Multi-domain Convolutional Neural Networks for Visual Tracking. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2016.
Luca Bertinetto, Jack Valmadre, João F. Henriques, Andrea Vedaldi, Philip H. S. Torr. Fully-Convolutional Siamese Networks for Object Tracking. Computer Vision - ECCV 2016 Workshops - Amsterdam, The Netherlands, October 8-10 and 15-16, 2016, Proceedings, Part II, 2016.
Bo Li, Junjie Yan, Wei Wu, Zheng Zhu, Xiaolin Hu. High Performance Visual Tracking With Siamese Region Proposal Network. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2018.
Martin Danelljan, Goutam Bhat, Fahad Shahbaz Khan, Michael Felsberg. ATOM: Accurate Tracking by Overlap Maximization. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2019.
Goutam Bhat, Martin Danelljan, Luc Van Gool, Radu Timofte. Learning Discriminative Model Prediction for Tracking. 2019 IEEE/CVF International Conference on Computer Vision, Proceedings of theInternational Conference on Computer Vision (ICCV) 2019, Seoul, Korea (South), October 27 - November 2, 2019, 2019.
Xin Chen, Bin Yan, Jiawen Zhu, Dong Wang, Xiaoyun Yang, Huchuan Lu. Transformer Tracking. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2021.
Bin Yan, Houwen Peng, Jianlong Fu, Dong Wang, Huchuan Lu. Learning Spatio-Temporal Transformer for Visual Tracking. 2021 IEEE/CVF International Conference on Computer Vision, Proceedings of theInternational Conference on Computer Vision (ICCV) 2021, Montreal, QC, Canada, October 10-17, 2021, 2021.
Botao Ye, Hong Chang, Bingpeng Ma, Shiguang Shan, Xilin Chen. Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework. Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XXII, 2022.
Jordi Pont-Tuset, Federico Perazzi, Sergi Caelles, Pablo Arbeláez, Alex Sorkine-Hornung, Luc Van Gool. The 2017 davis challenge on video object segmentation. arXiv preprint arXiv:1704.00675, 2017. arXiv
Ning Xu, Linjie Yang, Yuchen Fan, Jianchao Yang, Dingcheng Yue, Yuchen Liang, Brian Price, Scott Cohen, Thomas Huang. Youtube-vos: Sequence-to-sequence video object segmentation. Proceedings of the European conference on computer vision (ECCV), 2018.
Ho Kei Cheng, Alexander G. Schwing. XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model. Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XXVIII, 2022.
Zongxin Yang, Yunchao Wei, Yi Yang. Associating Objects with Transformers for Video Object Segmentation. Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual, 2021.
Zongxin Yang, Yi Yang. Decoupling Features in Hierarchical Propagation for Video Object Segmentation. Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022, 2022.
Alex Bewley, Zongyuan Ge, Lionel Ott, Fabio Ramos, Ben Upcroft. Simple online and realtime tracking. 2016 IEEE international conference on image processing (ICIP), 2016.
Harold W. Kuhn. The Hungarian Method for the Assignment Problem. 50 Years of Integer Programming 1958-2008 - From the Early Years to the State-of-the-Art, 2010.
Nicolai Wojke, Alex Bewley, Dietrich Paulus. Simple online and realtime tracking with a deep association metric. 2017 IEEE International Conference on Image Processing, ICIP 2017, Beijing, China, September 17-20, 2017, 2017.
Zhongdao Wang, Liang Zheng, Yixuan Liu, Yali Li, Shengjin Wang. Towards Real-Time Multi-Object Tracking. Computer Vision - ECCV 2020 - 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part XI, 2020.
Yifu Zhang, Chunyu Wang, Xinggang Wang, Wenjun Zeng, Wenyu Liu. FairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking. Int. J. Comput. Vis., 2021.
Yifu Zhang, Peize Sun, Yi Jiang, Dongdong Yu, Fucheng Weng, Zehuan Yuan, Ping Luo, Wenyu Liu, Xinggang Wang. ByteTrack: Multi-object Tracking by Associating Every Detection Box. Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XXII, 2022.
Xingyi Zhou, Vladlen Koltun, Philipp Krähenbühl. Tracking Objects as Points. Computer Vision - ECCV 2020 - 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part IV, 2020.
Tim Meinhardt, Alexander Kirillov, Laura Leal-Taixé, Christoph Feichtenhofer. TrackFormer: Multi-Object Tracking with Transformers. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Fangao Zeng, Bin Dong, Yuang Zhang, Tiancai Wang, Xiangyu Zhang, Yichen Wei. Motr: End-to-end multiple-object tracking with transformer. European conference on computer vision, 2022.
Peize Sun, Jinkun Cao, Yi Jiang, Zehuan Yuan, Song Bai, Kris Kitani, Ping Luo. DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motion. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Zhongdao Wang, Hengshuang Zhao, Ya-Li Li, Shengjin Wang, Philip Torr, Luca Bertinetto. Do different tracking tasks require different appearance models?. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2021.
Bin Yan, Yi Jiang, Peize Sun, Dong Wang, Zehuan Yuan, Ping Luo, Huchuan Lu. Towards grand unification of object tracking. European conference on computer vision, 2022.
Fan Ma, Mike Zheng Shou, Linchao Zhu, Haoqi Fan, Yilei Xu, Yi Yang, Zhicheng Yan. Unified Transformer Tracker for Object Tracking. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Minghan Li, Shuai Li, Xindong Zhang, Lei Zhang. Univs: Unified and universal video segmentation with prompts as queries. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Lingyi Hong, Shilin Yan, Renrui Zhang, Wanyun Li, Xinyu Zhou, Pinxue Guo, Kaixun Jiang, Yiting Chen, Jinglun Li, Zhaoyu Chen, Wenqiang Zhang. OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2024.
He Wang, Tianyang Xu, Zhangyong Tang, Xiaojun Wu, Josef Kittler. UASTrack: A Unified Adaptive Selection Framework with Modality-Customization in Single Object Tracking. CoRR, 2025.
Zongwei Wu, Jilai Zheng, Xiangxuan Ren, Florin-Alexandru Vasluianu, Chao Ma, Danda Pani Paudel, Luc Van Gool, Radu Timofte. Single-Model and Any-Modality for Video Object Tracking. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2024.
Xiao Wang, Xiujun Shu, Zhipeng Zhang, Bo Jiang, Yaowei Wang, Yonghong Tian, Feng Wu. Towards More Flexible and Accurate Object Tracking With Natural Language: Algorithms and Benchmark. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Yunhao Li, Xiaoqiong Liu, Luke Liu, Heng Fan, Libo Zhang. Lamot: Language-guided multi-object tracking. 2025 IEEE International Conference on Robotics and Automation (ICRA), 2025.
Robert Collins, Xuhui Zhou, Seng Keat Teh. An open source tracking testbed and evaluation web site. IEEE international workshop on performance evaluation of tracking and surveillance, 2005.
Yi Wu, Jongwoo Lim, Ming-Hsuan Yang. Online object tracking: A benchmark. Proceedings of the IEEE conference on computer vision and pattern recognition, 2013.
Arnold WM Smeulders, Dung M Chu, Rita Cucchiara, Simone Calderara, Afshin Dehghan, Mubarak Shah. Visual tracking: An experimental survey. IEEE transactions on pattern analysis and machine intelligence, 2013.
Pengpeng Liang, Erik Blasch, Haibin Ling. Encoding color information for visual tracking: Algorithms and benchmark. IEEE transactions on image processing, 2015.
Giorgio Roffo, Simone Melzi, et al.. The visual object tracking vot2016 challenge results. Computer Vision--ECCV 2016 Workshops: Amsterdam, The Netherlands, October 8-10 and 15-16, 2016, Proceedings, Part II, 2016.
U Benchmark. A benchmark and simulator for uav tracking. European conference on computer vision, 2016.
A Li, M Lin, Y Wu, MH Yang, S Yan. NUS-PRO: A New Visual Tracking Challenge. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016.
Matej Kristan, Ales Leonardis, Jiri Matas, Michael Felsberg, Roman P. Pflugfelder, Luka Cehovin Zajc, Tomas Vojir, Gustav Häger, Alan Lukezic, Abdelrahman Eldesokey, Gustavo Fernández, Álvaro García-Martín, Andrej Muhic, Alfredo Petrosino, Alireza Memarmoghadam, Andrea Vedaldi, Antoine Manzanera, Antoine Tran, A. Aydin Alatan, Bogdan Mocanu, Boyu Chen, Chang Huang, Changsheng Xu, Chong Sun, Dalong Du, David Zhang, Dawei Du, Deepak Mishra, Erhan Gundogdu, Erik Velasco-Salido, Fahad Shahbaz Khan, Francesco Battistone, Gorthi R. K. Sai Subrahmanyam, Goutam Bhat, Guan Huang, Guilherme Sousa Bastos, Guna Seetharaman, Hongliang Zhang, Houqiang Li, Huchuan Lu, Isabela Drummond, Jack Valmadre, Jae-chan Jeong, Jaeil Cho, Jae-Yeong Lee, Jana Noskova, Jianke Zhu, Jin Gao, Jingyu Liu, Ji-Wan Kim, João F. Henriques, José M. Martínez, Junfei Zhuang, Junliang Xing, Junyu Gao, Kai Chen, Kannappan Palaniappan, Karel Lebeda, Ke Gao, Kris M. Kitani, Lei Zhang, Lijun Wang, Lingxiao Yang, Longyin Wen, Luca Bertinetto, Mahdieh Poostchi, Martin Danelljan, Matthias Mueller, Mengdan Zhang, Ming-Hsuan Yang, Nianhao Xie, Ning Wang, Ondrej Miksik, Payman Moallem, Pallavi M. Venugopal, Pedro Senna, Philip H. S. Torr, Qiang Wang, Qifeng Yu, Qingming Huang, Rafael Martin Nieto, Richard Bowden, Risheng Liu, Ruxandra Tapu, Simon Hadfield, Siwei Lyu, Stuart Golodetz, Sunglok Choi, Tianzhu Zhang, Titus Zaharia, Vincenzo Santopietro, Wei Zou, Weiming Hu, Wenbing Tao, Wenbo Li, Wengang Zhou, Xianguo Yu, Xiao Bian, Yang Li, Yifan Xing, Yingruo Fan, Zheng Zhu, Zhipeng Zhang, Zhiqun He. The Visual Object Tracking VOT2017 Challenge Results. 2017 IEEE International Conference on Computer Vision Workshops, Proceedings of theInternational Conference on Computer Vision (ICCV) Workshops 2017, Venice, Italy, October 22-29, 2017, 2017.
Esteban Real, Jonathon Shlens, Stefano Mazzocchi, Xin Pan, Vincent Vanhoucke. Youtube-boundingboxes: A large high-precision human-annotated data set for object detection in video. proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
Hamed Kiani Galoogahi, Ashton Fagg, Chen Huang, Deva Ramanan, Simon Lucey. Need for speed: A benchmark for higher frame rate object tracking. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Lianghua Huang, Xin Zhao, Kaiqi Huang. GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild. IEEE transactions on pattern analysis and machine intelligence, 2021.
Shuran Song, Jianxiong Xiao. Tracking revisited using RGBD camera: Unified benchmark and baselines. Proceedings of the IEEE International Conference on Computer Vision, 2013.
Jingjing Xiao, Rustam Stolkin, Yuqing Gao, Aleš Leonardis. Robust fusion of color and depth data for RGB-D target tracking using adaptive range-invariant depth models and spatio-temporal consistency constraints. IEEE transactions on cybernetics, 2017.
Alan Lukezic, Ugur Kart, Jani Kapyla, Ahmed Durmush, Joni-Kristian Kamarainen, Jiri Matas, Matej Kristan. Cdtb: A color and depth visual object tracking dataset and benchmark. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019.
Song Yan, Jinyu Yang, Jani Käpylä, Feng Zheng, Aleš Leonardis, Joni-Kristian Kämäräinen. Depthtrack: Unveiling the power of rgbd tracking. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Haojie Zhao, Junsong Chen, Lijun Wang, Huchuan Lu. Arkittrack: a new diverse dataset for tracking using mobile RGB-D data. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Xue-Feng Zhu, Tianyang Xu, Zhangyong Tang, Zucheng Wu, Haodong Liu, Xiao Yang, Xiao-Jun Wu, Josef Kittler. RGBD1K: A large-scale dataset and benchmark for RGB-D object tracking. Proceedings of the AAAI Conference on Artificial Intelligence, 2023.
Benjamin Sapp, David Weiss, Ben Taskar. Parsing human motion with stretchable models. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2011.
Anoop Cherian, Julien Mairal, Karteek Alahari, Cordelia Schmid. Mixing body-part sequences for human pose estimation. Proceedings of the IEEE conference on computer vision and pattern recognition, 2014.
H Joo, T Simon, X Li, H Liu, L Tan, L Gui, S Banerjee, T Godisart, B Nabbe, I Matthews, et al.. Panoptic Studio: A Massively Multiview System for Social Interaction Capture.. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017.
Keni Bernardin, Rainer Stiefelhagen. Evaluating multiple object tracking performance: the clear mot metrics. EURASIP Journal on Image and Video Processing, 2008.
Jonathon Luiten, Aljosa Osep, Patrick Dendorfer, Philip Torr, Andreas Geiger, Laura Leal-Taixé, Bastian Leibe. Hota: A higher order metric for evaluating multi-object tracking. International journal of computer vision, 2021.
Lisa Anne Hendricks, Oliver Wang, Eli Shechtman, Josef Sivic, Trevor Darrell, Bryan Russell. Localizing Moments in Video with Natural Language. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
Jiyang Gao, Chen Sun, Zhenheng Yang, Ram Nevatia. TALL: Temporal Activity Localization via Language Query. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
Ranjay Krishna, Kenji Hata, Frederic Ren, Li Fei-Fei, Juan Carlos Niebles. Dense-Captioning Events in Videos. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
Zheng Shou, Junting Pan, Jonathan Chan, Kazuyuki Miyazawa, Hassan Mansour, Anthony Vetro, Xavier Giro-i-Nieto, Shih-Fu Chang. Online Detection of Action Start in Untrimmed, Streaming Videos. Proceedings of the European Conference on Computer Vision (ECCV), 2018.
Mingfei Gao, Mingze Xu, Larry S. Davis, Richard Socher, Caiming Xiong. StartNet: Online Detection of Action Start in Untrimmed Videos. arXiv preprint arXiv:1903.09868, 2019. arXiv
Minuk Ma, Sunjae Yoon, Junyeong Kim, Youngjoon Lee, Sunghun Kang, Chang D. Yoo. VLANet: Video-Language Alignment Network for Weakly-Supervised Video Moment Retrieval. Proceedings of the European Conference on Computer Vision (ECCV), 2020.
Zhan Tong, Yibing Song, Jue Wang, Limin Wang. VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training. Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS), 2022.
Limin Wang, Bingkun Huang, Zhiyu Zhao, Zhan Tong, Yinan He, Yi Wang, Yali Wang, Yu Qiao. VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Benedetta Liberatori, Alessandro Conti, Paolo Rota, Yiming Wang, Elisa Ricci. Test-Time Zero-Shot Temporal Action Localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Jie Lei, Licheng Yu, Tamara L. Berg, Mohit Bansal. TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval. Proceedings of the European Conference on Computer Vision (ECCV), 2020.
Jie Lei, Tamara L. Berg, Mohit Bansal. QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries. Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS), 2021.
Heng Wang, Cordelia Schmid. Action Recognition with Improved Trajectories. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2013.
Huijuan Xu, Abir Das, Kate Saenko. R-C3D: Region Convolutional 3D Network for Temporal Activity Detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
Yu-Wei Chao, Sudheendra Vijayanarasimhan, Birkan Seybold, David A. Ross, Jia Deng, Rahul Sukthankar. Rethinking the Faster R-CNN Architecture for Temporal Action Localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Tianwei Lin, Xiao Liu, Xin Li, Errui Ding, Shilei Wen. BMN: Boundary-Matching Network for Temporal Action Proposal Generation. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2019.
Min Xu, Chen Zhao, Dev Sharma Das, Daniel S. Rojas, Ali Thabet, Bernard Ghanem. G-TAD: Sub-Graph Localization for Temporal Action Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Chen-Lin Zhang, Jianxin Wu, Yin Li. ActionFormer: Localizing Moments of Actions with Transformers. Proceedings of the European Conference on Computer Vision (ECCV), 2022.
Dingfeng Shi, Yujie Zhong, Qiong Cao, Lin Ma, Jia Li, Dacheng Tao. TriDet: Temporal Action Detection with Relative Boundary Modeling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Jing Tan, Jian Tang, Limin Wang, Gang Wu. Relaxed Transformer Decoders for Direct Action Proposal Generation. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2021.
Xiaolong Liu, Qimeng Wang, Yao Hu, Xu Tang, Shiwei Zhang, Song Bai, Xiang Bai. End-to-End Temporal Action Detection with Transformer. IEEE Transactions on Image Processing, 2022.
Xiaolong Liu, Song Bai, Xiang Bai. An Empirical Study of End-to-End Temporal Action Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Jihwan Kim, Miso Lee, Jae-Pil Heo. TE-TAD: Towards Full End-to-End Temporal Action Detection via Time-Aligned Coordinate Expression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Da Zhang, Xiyang Dai, Xin Wang, Yuan-Fang Wang, Larry S. Davis. MAN: Moment Alignment Network for Natural Language Moment Retrieval via Iterative Graph Adjustment. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Songyang Zhang, Houwen Peng, Jianlong Fu, Jiebo Luo. Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2020.
Hao Zhang, Aixin Sun, Wei Jing, Joey Tianyi Zhou. Span-based Localizing Network for Natural Language Video Localization. Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2020.
Jie Lei, Tamara L. Berg, Mohit Bansal. Moment-DETR: End-to-End Transformer for Moment Retrieval and Highlight Detection. Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS), 2021.
Michaela Regneri, Marcus Rohrbach, Dietrich Wetzel, Stefan Thater, Bernt Schiele, Manfred Pinkal. TACoS: Saarbrücken Corpus of Textually Annotated Cooking Scenes. 2013.
Luowei Zhou, Chenliang Xu, Jason J. Corso. Towards Automatic Learning of Procedures from Web Instructional Videos. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2018.
Dima Damen, Hazel Doughty, Giovanni Maria Farinella, Antonino Furnari, Evangelos Kazakos, et al.. Rescaling Egocentric Vision: EPIC-KITCHENS-100. arXiv preprint arXiv:2006.13256, 2020. arXiv
ActivityNet Challenge Organizers. ActivityNet Challenge 2019: Temporal Action Proposals Evaluation Protocol. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019.
Ryo Togashi, Norimichi Nishida, Yasuhiro Nakashima, Noboru Babaguchi. AxIoU: An Axiomatically Justified Measure for Video Moment Retrieval. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Ruijie Tao, Zexu Pan, Rohan Kumar Das, Xinyuan Qian, Mike Zheng Shou, Haizhou Li. Is Someone Speaking? Exploring Long-Term Temporal Features for Audio-Visual Active Speaker Detection. Proceedings of the 29th ACM International Conference on Multimedia (ACM MM), 2021.
Archontis Politis, Kazuki Shimada, Parthasaarathy Sudarsanam, Sharath Adavanne, Daniel Krause, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji, Tuomas Virtanen. STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events. Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2023.
Arda Senocak, Tae-Hyun Oh, Junsik Kim, Ming-Hsuan Yang, In So Kweon. Learning to Localize Sound Source in Visual Scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Honglie Chen, Weidi Xie, Triantafyllos Afouras, Arsha Nagrani, Andrea Vedaldi, Andrew Zisserman. Localizing Visual Sounds the Hard Way. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Di Hu, Feiping Nie, Xuelong Li. Deep Multimodal Clustering for Unsupervised Audiovisual Learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Rui Qian, Di Hu, Heinrich Dinkel, Mengyue Wu, Ning Xu, Weiyao Lin. Multiple Sound Sources Localization from Coarse to Fine. Proceedings of the European Conference on Computer Vision (ECCV), 2020.
Shentong Mo, Yapeng Tian. A Closer Look at Weakly-Supervised Audio-Visual Source Localization. Advances in Neural Information Processing Systems (NeurIPS) 35, 2022.
Juan León Alcázar, Fabian Caba, Long Mai, Federico Perazzi, Joon-Young Lee, Pablo Arbeláez, Bernard Ghanem. Active Speakers in Context. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Okan Köpüklü, Maja Taseska, Gerhard Rigoll. How to Design a Three-Stage Architecture for Audio-Visual Active Speaker Detection in the Wild. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Sharath Adavanne, Archontis Politis, Joonas Nikunen, Tuomas Virtanen. Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks. IEEE Journal of Selected Topics in Signal Processing, 2018.
Kazuki Shimada, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji. ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detection. ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021.
Archontis Politis, Sharath Adavanne, Tuomas Virtanen. Overview and Evaluation of Sound Event Localization and Detection in DCASE 2019. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2020.
Charles Knapp, Glifford Carter. The Generalized Correlation Method for Estimation of Time Delay. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1976.
Joseph H. DiBiase, Harvey F. Silverman, Michael S. Brandstein. Robust Localization in Reverberant Rooms. Microphone Arrays: Signal Processing Techniques and Applications, 2001.
Honglie Chen, Weidi Xie, Andrea Vedaldi, Andrew Zisserman. VGG-Sound: A Large-Scale Audio-Visual Dataset. ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020.
Jinxing Zhou, Jianyuan Wang, Jiayi Zhang, Weixuan Sun, Jing Zhang, Stan Birchfield, Dan Guo, Lingpeng Kong, Meng Wang, Yiran Zhong. Audio--visual segmentation. European Conference on Computer Vision, 2022.
Joseph Roth, Sourish Chaudhuri, Ondrej Klimesch, Felix Lluis, Steven Genuit, Yu Tao, Pedro Trindade, Caroline Zhu. AVA Active Speaker: An Audio-Visual Dataset for Active Speaker Detection. ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020.
Yapeng Tian, Jing Shi, Bochen Li, Zhiyao Duan, Chenliang Xu. Audio-Visual Event Localization in Unconstrained Videos. Proceedings of the European Conference on Computer Vision (ECCV), 2018.
Licheng Yu, Patrick Poirson, Shan Yang, Alexander C Berg, Tamara L Berg. Modeling context in referring expressions. Computer Vision--ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14, 2016.
Junhua Mao, Jonathan Huang, Alexander Toshev, Oana Camburu, Alan L Yuille, Kevin Murphy. Generation and comprehension of unambiguous object descriptions. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
Chang Liu, Henghui Ding, Xudong Jiang. Gres: Generalized referring expression segmentation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, Jiaya Jia. Lisa: Reasoning segmentation via large language model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Meng Luo, Shengqiong Wu, Liqiang Jing, Tianjie Ju, Li Zheng, Jinxiang Lai, Tianlong Wu, Xinya Du, Jian Li, Siyuan Yan, et al.. Dr. V: A Hierarchical Perception-Temporal-Cognition Framework to Diagnose Video Hallucination by Fine-Grained Spatial-Temporal Grounding. International Journal of Computer Vision, 2026.
Qi Chen, Changli Wu, Jiayi Ji, Yiwei Ma, Liujuan Cao. 3D-DRES: Detailed 3D Referring Expression Segmentation. Proceedings of the AAAI Conference on Artificial Intelligence, 2026.
Sahar Kazemzadeh, Vicente Ordonez, Mark Matten, Tamara Berg. Referitgame: Referring to objects in photographs of natural scenes. Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014.
Bryan A Plummer, Liwei Wang, Chris M Cervantes, Juan C Caicedo, Julia Hockenmaier, Svetlana Lazebnik. Flickr30k entities: Collecting region-to-phrase correspondences for richer image-to-sentence models. Proceedings of the IEEE International Conference on Computer Vision, 2015.
Peter Young, Alice Lai, Micah Hodosh, Julia Hockenmaier. From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions. Transactions of the association for computational linguistics, 2014.
Yutao Hu, Qixiong Wang, Wenqi Shao, Enze Xie, Zhenguo Li, Jungong Han, Ping Luo. Beyond one-to-one: Rethinking the referring image segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Chenyun Wu, Zhe Lin, Scott Cohen, Trung Bui, Subhransu Maji. Phrasecut: Language-based image segmentation in the wild. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.
Samuel Schulter, Yumin Suh, Konstantinos M Dafnis, Zhixing Zhang, Shiyu Zhao, Dimitris Metaxas, et al.. Omnilabel: A challenging benchmark for language-based object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Shengcao Cao, Zijun Wei, Jason Kuen, Kangning Liu, Lingzhi Zhang, Jiuxiang Gu, HyunJoon Jung, Liang-Yan Gui, Yu-Xiong Wang. Refer to Any Segmentation Mask Group With Vision-Language Prompts. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Runtao Liu, Chenxi Liu, Yutong Bai, Alan L Yuille. Clevr-ref+: Diagnosing visual reasoning with referring expressions. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
Donggon Jang, Yucheol Cho, Suin Lee, Taehyeon Kim, Dae-Shik Kim. Mmr: A large-scale benchmark dataset for multi-target and multi-granularity reasoning segmentation. arXiv preprint arXiv:2503.13881, 2025. arXiv
Senqiao Yang, Tianyuan Qu, Xin Lai, Zhuotao Tian, Bohao Peng, Shu Liu, Jiaya Jia. Lisa++: An improved baseline for reasoning segmentation with large language model. arXiv preprint arXiv:2312.17240, 2023. arXiv
Yunqiu Xu, Linchao Zhu, Yi Yang. Mc-bench: A benchmark for multi-context visual grounding in the era of mllms. arXiv preprint arXiv:2410.12332, 2024. arXiv
Anna Khoreva, Anna Rohrbach, Bernt Schiele. Video object segmentation with language referring expressions. Asian conference on computer vision, 2018.
Kirill Gavrilyuk, Amir Ghodrati, Zhenyang Li, Cees GM Snoek. Actor and action video segmentation from a sentence. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Henghui Ding, Chang Liu, Shuting He, Xudong Jiang, Chen Change Loy. MeViS: A large-scale benchmark for video segmentation with motion expressions. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
Cilin Yan, Haochen Wang, Shilin Yan, Xiaolong Jiang, Yao Hu, Guoliang Kang, Weidi Xie, Efstratios Gavves. Visa: Reasoning video object segmentation via large language models. European Conference on Computer Vision, 2024.
Zechen Bai, Tong He, Haiyang Mei, Pichao Wang, Ziteng Gao, Joya Chen, Zheng Zhang, Mike Zheng Shou. One token to seg them all: Language instructed reasoning segmentation in videos. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Anurag Bagchi, Zhipeng Bao, Yu-Xiong Wang, Pavel Tokmakov, Martial Hebert. Refereverything: Towards segmenting everything we can speak of in videos. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Hao Fang, Runmin Cong, Xiankai Lu, Xiaofei Zhou, Sam Kwong, Wei Zhang. Decoupled Motion Expression Video Segmentation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Yiming Zhang, ZeMing Gong, Angel X Chang. Multi3drefer: Grounding text description to multiple 3d objects. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Shuting He, Henghui Ding, Xudong Jiang, Bihan Wen. Segpoint: Segment any point cloud via large language model. European Conference on Computer Vision, 2024.
Changli Wu, Yihang Liu, Jiayi Ji, Yiwei Ma, Haowei Wang, Gen Luo, Henghui Ding, Xiaoshuai Sun, Rongrong Ji. 3d-gres: Generalized 3d referring expression segmentation. Proceedings of the 32nd ACM International Conference on Multimedia, 2024.
Andrej Karpathy, Armand Joulin, Li Fei-Fei. Deep fragment embeddings for bidirectional image sentence mapping. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2014.
Ronghang Hu, Marcus Rohrbach, Jacob Andreas, Trevor Darrell, Kate Saenko. Modeling relationships in referential expressions with compositional modular networks. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Licheng Yu, Zhe Lin, Xiaohui Shen, Jimei Yang, Xin Lu, Mohit Bansal, Tamara L Berg. Mattnet: Modular attention network for referring expression comprehension. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Sibei Yang, Guanbin Li, Yizhou Yu. Dynamic graph attention for referring expression comprehension. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Zhengyuan Yang, Boqing Gong, Liwei Wang, Wenbing Huang, Dong Yu, Jiebo Luo. A fast and accurate one-stage approach to visual grounding. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Jiajun Deng, Zhengyuan Yang, Tianlang Chen, Wengang Zhou, Houqiang Li. Transvg: End-to-end visual grounding with transformers. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Liunian Li, Zi-Yi Dou, Nanyun Peng, Kai-Wei Chang. Desco: Learning object recognition with rich language descriptions. Advances in Neural Information Processing Systems, 2023.
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Furu Wei. Kosmos-2: Grounding multimodal large language models to the world. arXiv preprint arXiv:2306.14824, 2023. arXiv
Haoxuan You, Haotian Zhang, Zhe Gan, Xianzhi Du, Bowen Zhang, Zirui Wang, Liangliang Cao, Shih-Fu Chang, Yinfei Yang. Ferret: Refer and ground anything anywhere at any granularity. arXiv preprint arXiv:2310.07704, 2023. arXiv
Haotian Zhang, Haoxuan You, Philipp Dufter, Bowen Zhang, Chen Chen, Hong-You Chen, Tsu-Jui Fu, William Yang Wang, Shih-Fu Chang, Zhe Gan, et al.. Ferret-v2: An improved baseline for referring and grounding with large language models. arXiv preprint arXiv:2404.07973, 2024. arXiv
Hanoona Rasheed, Muhammad Maaz, Sahal Shaji, Abdelrahman Shaker, Salman Khan, Hisham Cholakkal, Rao M. Anwer, Eric Xing, Ming-Hsuan Yang, Fahad S. Khan. GLaMM: Pixel Grounding Large Multimodal Model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Haobo Yuan, Xiangtai Li, Tao Zhang, Yueyi Sun, Zilong Huang, Shilin Xu, Shunping Ji, Yunhai Tong, Lu Qi, Jiashi Feng, Ming-Hsuan Yang. Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos. arXiv preprint arXiv:2501.04001, 2025. arXiv
Ethan Reid. Moondream Segmentation: From Words to Masks. arXiv preprint arXiv:2604.02593, 2026. arXiv
Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan. Florence-2: Advancing a unified representation for a variety of vision tasks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Machel Reid, Nikolay Savinov, Denis Teplyashin, Dmitry Lepikhin, Timothy Lillicrap, Jean-baptiste Alayrac, Radu Soricut, Angeliki Lazaridou, Orhan Firat, Julian Schrittwieser, et al.. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. arXiv preprint arXiv:2403.05530, 2024. arXiv
Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, et al.. The llama 3 herd of models. arXiv preprint arXiv:2407.21783, 2024. arXiv
Tianhe Ren, Shilong Liu, Ailing Zeng, Jing Lin, Kunchang Li, He Cao, Jiayu Chen, Xinyu Huang, Yukang Chen, Feng Yan, et al.. Grounded sam: Assembling open-world models for diverse visual tasks. arXiv preprint arXiv:2401.14159, 2024. arXiv
D́ac Surı́s, Sachit Menon, Carl Vondrick. Vipergpt: Visual inference via python execution for reasoning. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
Muzhi Zhu, Yuzhuo Tian, Hao Chen, Chunluan Zhou, Qingpei Guo, Yang Liu, Ming Yang, Chunhua Shen. Segagent: Exploring pixel understanding capabilities in mllms by imitating human annotator trajectories. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Ziwei Zheng, Michael Yang, Jack Hong, Chenxiao Zhao, Guohai Xu, Le Yang, Chao Shen, Xing Yu. Deepeyes: Incentivizing "thinking with images" via reinforcement learning. arXiv preprint arXiv:2505.14362, 2025. arXiv
Nicolas Carion, Laura Gustafson, Yuan-Ting Hu, Shoubhik Debnath, Ronghang Hu, Didac Suris, Chaitanya Ryali, Kalyan Vasudev Alwala, Haitham Khedr, Andrew Huang, et al.. Sam 3: Segment anything with concepts. arXiv preprint arXiv:2511.16719, 2025. arXiv
Zixin Zhu, Xuelu Feng, Dongdong Chen, Junsong Yuan, Chunming Qiao, Gang Hua. Exploring pre-trained text-to-video diffusion models for referring video object segmentation. European Conference on Computer Vision, 2024.
Valentin Gabeur, Shangbang Long, Songyou Peng, Paul Voigtlaender, Shuyang Sun, Yanan Bao, Karen Truong, Zhicheng Wang, Wenlei Zhou, Jonathan T Barron, et al.. Image generators are generalist vision learners. arXiv preprint arXiv:2604.20329, 2026. arXiv
Jierun Chen, Fangyun Wei, Jinjing Zhao, Sizhe Song, Bohuai Wu, Zhuoxuan Peng, S-H Gary Chan, Hongyang Zhang. Revisiting referring expression comprehension evaluation in the era of large multimodal models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025.
Fangyun Wei, Jinjing Zhao, Kun Yan, Hongyang Zhang, Chang Xu. A Large-Scale Human-Centric Benchmark for Referring Expression Comprehension in the LMM Era. Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2024.
Tao Ma, Bing Bai, Haozhe Lin, Heyuan Wang, Yu Wang, Lin Luo, Lu Fang. When Visual Grounding Meets Gigapixel-level Large-scale Scenes: Benchmark and Approach. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Rang Li, Lei Li, Shuhuai Ren, Hao Tian, Shuhao Gu, Shicheng Li, Zihao Yue, Yudong Wang, Wenhan Ma, Zhe Yang, et al.. Groundingme: Exposing the visual grounding gap in mllms through multi-dimensional evaluation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026.
Yining Hong, Haoyu Zhen, Peihao Chen, Shuhong Zheng, Yilun Du, Zhenfang Chen, Chuang Gan. 3d-llm: Injecting the 3d world into large language models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
R. M. Murray, Z. Li, S. S. Sastry. A Mathematical Introduction to Robotic Manipulation. 1994.
K. M. Lynch, F. C. Park. Modern Robotics: Mechanics, Planning, and Control. 2017.
Bruno Siciliano, Lorenzo Sciavicco, Luigi Villani, Giuseppe Oriolo. Robotics: Modelling, Planning and Control. 2010.
Ronald T. Azuma. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, 1997.
Joan Solà, Jeremie Deray, Dinesh Atchuthan. A Micro Lie Theory for State Estimation in Robotics. arXiv preprint arXiv:1812.01537, 2018. arXiv
J. Denavit, R. S. Hartenberg. A kinematic notation for lower‐pair mechanisms based on matrices. ASME Journal of Applied Mechanics, 1955.
R. P. Paul. Robot Manipulators: Mathematics, Programming, and Control. 1981.
K. Shoemake. Animating rotation with quaternion curves. Proc. SIGGRAPH, 1985.
B. K. P. Horn. Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A, 1987.
K. Daniilidis. Hand--eye calibration using dual quaternions. Int. J. Robotics Research, 1999.
Markus Horn, Thomas Wodtko, Michael Buchholz, Klaus Dietmayer. Online Extrinsic Calibration based on Per-Sensor Ego-Motion Using Dual Quaternions. IEEE Robotics and Automation Letters, 2021. arXivDOI
R. I. Hartley. In defense of the eight-point algorithm. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 1997.
D. Nistér. An efficient solution to the five-point relative pose problem. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2004.
D. E. Whitney. Resolved motion rate control of manipulators and human prostheses. IEEE Trans. Man-Machine Systems, 1969.
Y. Nakamura, H. Hanafusa. Inverse kinematic solutions with singularity robustness for robot manipulator control. ASME J. Dynamic Systems, Measurement, and Control, 1986.
A. Liegeois. Automatic supervisory control of the configuration and behavior of multibody mechanisms. IEEE Trans. Systems, Man, and Cybernetics, 1977.
B. Siciliano, J. J. E. Slotine. A general framework for managing multiple tasks in highly redundant robotic systems. Proc. Int. Conf. Advanced Robotics, 1991.
O. Khatib. A unified approach for motion and force control of robot manipulators: The operational space formulation. IEEE J. Robotics and Automation, 1987.
V. Chvátal. A combinatorial theorem in plane geometry. J. Combin. Theory, Series B, 1975.
J. O'Rourke. Art Gallery Theorems and Algorithms. 1987.
D. T. Lee. Visibility of a simple polygon. CVGIP, 1983.
L. J. Guibas, J. Hershberger. Optimal shortest path queries in a simple polygon. J. Comput. Syst. Sci., 1987.
K. A. Tarabanis, P. K. Allen, R. Y. Tsai. A survey of sensor planning in computer vision. IEEE Trans. Robotics and Automation, 1995.
B. Roth. Performance evaluation of manipulators from a kinematic viewpoint. ASME J. Mechanical Design, 1975.
C. Gosselin, J. Angeles. Singularity analysis of closed-loop kinematic chains. IEEE Trans. Robotics and Automation, 1990.
J. P. Merlet. Determination of 6D workspaces of Gough-type parallel manipulators and comparison between different geometries. Int. J. Robotics Research, 1998.
Dimiter Zlatanov, Ilian A. Bonev, Clément M. Gosselin. Constraint Singularities of Parallel Mechanisms. Proceedings of the 2002 IEEE International Conference on Robotics and Automation, 2002. DOILink
Yupu Lu, Yuxiang Ma, Jia Pan. RichMap: A Reachability Map Balancing Precision, Efficiency, and Flexibility for Rich Robot Manipulation Tasks. 2026. arXivDOI
C. Ferrari, J. Canny. Planning optimal grasps. Proc. ICRA, 1992.
A. T. Miller, P. K. Allen. GraspIt!: A versatile simulator for robotic grasping. IEEE Robotics and Automation Magazine, 2004.
Y. Lin, Y. Sun. Task-oriented grasp quality measures for grasp synthesis. IEEE Trans. Robotics, 2015.
A. Knapitsch, J. Park, Q. Y. Zhou, V. Koltun. Tanks and Temples: Benchmarking large-scale scene reconstruction. ACM Trans. Graphics (SIGGRAPH), 2017.
H. Aanæs, R. R. Jensen, G. Vogiatzis, E. Tola, A. B. Dahl. Large-scale data for multiple-view stereopsis. Int. J. Computer Vision, 2016.
V. Balntas, K. Lenc, A. Vedaldi, K. Mikolajczyk. HPatches: A benchmark and evaluation of handcrafted and learned local descriptors. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2017.
T. Sattler, W. Maddern, A. Torii, J. Sivic, J. Kosecka, T. Pajdla, M. Pollefeys, T. Weyand. Benchmarking 6DOF outdoor visual localization in changing conditions. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2018.
H. Taira, M. Okutomi, T. Sattler, T. Pajdla, M. Pollefeys, J. Sivic, A. Torii, A. Irschara. InLoc: Indoor visual localization with dense matching and view synthesis. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2018.
Patrick Wenzel, Rui Wang, Nan Yang, Qing Cheng, Qadeer Khan, Lukas von Stumberg, Niclas Zeller, Daniel Cremers. 4Seasons: A Cross-Season Dataset for Multi-Weather SLAM in Autonomous Driving. Pattern Recognition, 2021. arXivDOI
S. Agarwal, N. Snavely, I. Simon, S. M. Seitz, R. Szeliski. Building Rome in a day. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2010.
E. Johns, S. Leutenegger, A. J. Davison. Pairwise decomposition of image sequences for active multi-view recognition. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2016.
Y. Jiang, S. Moseson, A. Saxena. Efficient grasping from RGBD images: Learning using a new rectangle representation. Proc. ICRA, 2011.
A. Depierre, E. Dellandréa, L. Chen. Jacquard: A large-scale dataset for robotic grasp detection. Proc. IROS, 2018.
Hao-Shu Fang, Chenxi Wang, Minghao Gou, Cewu Lu. GraspNet-1Billion: A Large-Scale Benchmark for General Object Grasping. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Berk Calli, Aaron Walsman, Arjun Singh, Siddhartha Srinivasa, Pieter Abbeel, Aaron M Dollar. Benchmarking in manipulation research: The YCB object and model set and benchmarking protocols. IEEE Robotics & Automation Magazine, 2015.
B. J. Cohen, I. A. Şucan. Benchmarking motion planning algorithms: An open source infrastructure for the robotics community. Proc. IROS, 2012.
Emanuel Todorov, Tom Erez, Yuval Tassa. MuJoCo: A physics engine for model-based control. 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2012. DOI
Erwin Coumans, Yunfei Bai. PyBullet, a Python module for physics simulation for games, robotics and machine learning. r̆lhttp://pybullet.org, 2016--2021.
Russell Smith. Open Dynamics Engine. r̆lhttps://ode.org/, 2021.
Jeffrey C Trinkle, J-S Pang, Sandra Sudarsky, Grace Lo. On dynamic multi-rigid-body contact problems with Coulomb friction. ZAMM-Journal of Applied Mathematics and Mechanics/Zeitschrift für Angewandte Mathematik und Mechanik, 1997.
Richard W Cottle, Jong-Shi Pang, Richard E Stone. The linear complementarity problem. 2009.
YY Lin, J-S Pang. Iterative methods for large convex quadratic programs: A survey. SIAM Journal on Control and Optimization, 1987.
Farid Alizadeh, Donald Goldfarb. Second-order cone programming. Mathematical programming, 2003.
Oliver Groth, Fabian B Fuchs, Ingmar Posner, Andrea Vedaldi. Shapestacks: Learning vision-based physical intuition for generalised object stacking. Proceedings of the european conference on computer vision (eccv), 2018.
Anton Bakhtin, Laurens van der Maaten, Justin Johnson, Laura Gustafson, Ross Girshick. Phyre: A new benchmark for physical reasoning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2019.
Zhiao Huang, Yuanming Hu, Tao Du, Siyuan Zhou, Hao Su, Joshua B Tenenbaum, Chuang Gan. Plasticinelab: A soft-body manipulation benchmark with differentiable physics. arXiv preprint arXiv:2104.03311, 2021. arXiv
Ronan Riochet, Mario Ynocente Castro, Mathieu Bernard, Adam Lerer, Rob Fergus, Véronique Izard, Emmanuel Dupoux. Intphys: A framework and benchmark for visual intuitive physics reasoning. arXiv preprint arXiv:1803.07616, 2018. arXiv
K. Yi, C. Gan, Y. Li, P. Kohli, J. Wu, A. Torralba, J. B. Tenenbaum. CLEVRER: CoLlision Events for Video REpresentation and Reasoning. ICLR, 2020.
Zhenfang Chen, Kexin Yi, Yunzhu Li, Mingyu Ding, Antonio Torralba, Joshua B Tenenbaum, Chuang Gan. Comphy: Compositional physical reasoning of objects and events from videos. arXiv preprint arXiv:2205.01089, 2022. arXiv
Peter Battaglia, Razvan Pascanu, Matthew Lai, Danilo Jimenez Rezende, et al.. Interaction networks for learning about objects, relations and physics. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2016.
Chae H An, Christopher G Atkeson, John M Hollerbach. Estimation of inertial parameters of rigid body links of manipulators. 1985 24th IEEE Conference on Decision and Control, 1985.
Nikhil Muralidhar, Jie Bu, Ze Cao, Long He, Naren Ramakrishnan, Danesh Tafti, Anuj Karpatne. Phynet: Physics guided neural networks for particle drag force prediction in assembly. Proceedings of the 2020 SIAM international conference on data mining, 2020.
Jiajun Wu, Ilker Yildirim, Joseph J Lim, Bill Freeman, Josh Tenenbaum. Galileo: Perceiving physical object properties by integrating a physics engine with deep learning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2015.
T. Lozano-Pérez, M. A. Wesley. An algorithm for planning collision-free paths among polyhedral obstacles. Communications of the ACM, 1979.
T. Lozano-Pérez. Spatial planning: A configuration space approach. IEEE Transactions on Computers, 1983.
J. Hershberger, S. Suri. An optimal algorithm for Euclidean shortest paths in the plane. SIAM Journal on Computing, 1999.
J. S. B. Mitchell. Geometric shortest paths and network optimization. Handbook of Computational Geometry, 2000.
D. Ferguson, A. Stentz. Using interpolation to improve path planning: The Field D* algorithm. Journal of Field Robotics, 2006.
A. Nash, K. Daniel, S. Koenig, A. Felner. Theta*: Any-angle path planning on grids. Proceedings of AAAI, 2007.
D. Harabor, A. Grastien. Online graph pruning for pathfinding on grid maps (Jump Point Search). Proceedings of AAAI, 2011.
S. Fortune. A sweepline algorithm for Voronoi diagrams. Algorithmica, 1987.
H. Choset, J. Burdick. The hierarchical generalized Voronoi graph. International Journal of Robotics Research, 2000.
H. Choset. Sensor-based exploration: Incremental construction of the generalized Voronoi graph. International Journal of Robotics Research, 2000.
Pedro F. Felzenszwalb, Daniel P. Huttenlocher. Distance Transforms of Sampled Functions. Theory of Computing, 2012. DOILink
B. Lau, C. Sprunk, W. Burgard. Efficient grid-based spatial representations for robot navigation in dynamic environments. Robotics and Autonomous Systems, 2013.
A. Elfes. Using occupancy grids for mobile robot perception and navigation. Computer, 1989.
H. Choset, P. Pignon. Coverage path planning: The boustrophedon cellular decomposition. Proceedings of Field and Service Robotics, 1998.
E. Galceran, M. Carreras. A survey on coverage path planning for robotics. Robotics and Autonomous Systems, 2013.
L. E. Kavraki, P. Švestka, J.-C. Latombe, M. H. Overmars. Probabilistic roadmaps for path planning in high-dimensional configuration spaces. IEEE Transactions on Robotics and Automation, 1996.
S. M. LaValle. Rapidly-exploring Random Trees: A new tool for path planning. 1998.
J. J. Kuffner, S. M. LaValle. RRT-Connect: An efficient approach to single-query path planning. Proceedings of IEEE ICRA, 2000.
S. Karaman, E. Frazzoli. Sampling-based algorithms for optimal motion planning. International Journal of Robotics Research, 2011.
L. Janson, E. Schmerling, M. Pavone. Fast Marching Tree (FMT*): A fast marching sampling-based method for optimal motion planning. International Journal of Robotics Research, 2015.
J. D. Gammell, S. S. Srinivasa, T. D. Barfoot. Batch Informed Trees (BIT*): Sampling-based optimal planning via the heuristically guided search of implicit random geometric graphs. Proceedings of IEEE ICRA, 2015.
S. Koenig, M. Likhachev. Lifelong Planning A*. Artificial Intelligence, 2004.
S. Koenig, M. Likhachev. D* Lite. Proceedings of AAAI, 2002.
G. Sharon, R. Stern, A. Felner, N. Sturtevant. Conflict-based search for optimal multi-agent pathfinding. Artificial Intelligence, 2015.
G. Sharon, R. Stern, M. Goldenberg, A. Felner. The increasing cost tree search for optimal multi-agent pathfinding. Artificial Intelligence, 2013.
M. Barer, G. Sharon, R. Stern, A. Felner. Suboptimal variants of the conflict-based search algorithm for the multi-agent pathfinding problem (ECBS). Proceedings of SoCS, 2014.
J. Li, W. Ruml, S. Koenig. EECBS: A bounded-suboptimal search for multi-agent path finding. Proceedings of AAAI, 2021.
P. Surynek, A. Felner, R. Stern, E. Boyarski. An efficient SAT approach to multi-agent path finding under the sum-of-costs objective. Proceedings of ECAI, 2016.
J. Yu, S. M. LaValle. Optimal multirobot path planning on graphs: Complete algorithms and effective heuristics. IEEE Transactions on Robotics, 2016.
A. Botea, M. Müller, J. Schaeffer. Near optimal hierarchical path-finding. Journal of Game Development, 2004.
R. Geisberger, P. Sanders, D. Schultes, D. Delling. Contraction hierarchies: Faster and simpler hierarchical routing in road networks. Proceedings of WEA, 2008.
N. R. Sturtevant. Benchmarks for grid-based pathfinding. IEEE Transactions on Computational Intelligence and AI in Games, 2012.
A. Howard, N. Roy. The robotics data set repository (radish). 2003.
W. Maddern, G. Pascoe, C. Linegar, P. Newman. 1 year, 1000 km: The Oxford RobotCar dataset. International Journal of Robotics Research, 2017.
N. Carlevaris-Bianco, A. K. Ushani, R. M. Eustice. University of Michigan North Campus Long-Term (NCLT) dataset. International Journal of Robotics Research, 2016.
Daniel Olid, José M Fácil, Javier Civera. Single-view place recognition under seasonal changes. arXiv preprint arXiv:1808.06516, 2018. arXiv
Cyrill Stachniss, Giorgio Grisetti, Wolfram Burgard. Information Gain-based Exploration Using Rao-Blackwellized Particle Filters. Robotics: Science and Systems (RSS), 2006.
Brandon D. Luders, Marsette Vona, Jonathan P. How. Chance-Constrained RRT for Probabilistic Robustness to Environmental Uncertainty. Proc. IEEE Conf. on Robotics and Automation (ICRA), 2010.
Sihua Zhang, Di-Hua Zhai, Yuhan Xiong, Juncheng Lin, Yuanqing Xia. Safety-Critical Control for Robotic Systems with Uncertain Model via Control Barrier Function. International Journal of Robust and Nonlinear Control, 2023. DOILink
Daiki Kimura, Masaki Ono, Subhajit Chaudhury, Ryosuke Kohita, Akifumi Wachi, Don Joven Agravante, Michiaki Tatsubori, Asim Munawar, Alexander Gray. Neuro-Symbolic Reinforcement Learning with First-Order Logic. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021. DOILink
T. Lozano-Pérez, L. P. Kaelbling. A constraint-based method for solving sequential manipulation planning problems. Proc. IEEE/RSJ IROS, 2014.
F. Lagriffoul, D. Dimitrov, A. Saffiotti, L. Karlsson. Constraint propagation on interval bounds for dealing with geometric backtracking. Proc. IEEE/RSJ IROS, 2012.
N. T. Dantam, Z. K. Kingston, S. Chaudhuri, L. E. Kavraki. An incremental constraint-based framework for task and motion planning. Int. J. Robotics Research, 2018.
S. Gao, S. Kong, E. M. Clarke. dReal: An SMT solver for nonlinear theories over the reals. Proc. CADE, 2013.
Yasser Shoukry, Pierluigi Nuzzo, Indranil Saha, Alberto L. Sangiovanni-Vincentelli, Sanjit A. Seshia, George J. Pappas, Paulo Tabuada. Scalable Motion Planning Using Lazy SMT-Based Solving. Proceedings of the 55th IEEE Conference on Decision and Control, 2016. DOILink
T. Kolářík, S. Ratschan, P. Surynek. Multi-agent path finding with continuous time using SAT/SMT. arXiv preprint arXiv:2312.08051, 2023. arXiv
W.-J. Tan, H. Ma, S. Koenig, R. Stern. Robust multi-agent pathfinding with continuous time. Proc. ICAPS, 2024.
R. Deits, R. Tedrake. Computing large convex regions of obstacle-free space through semidefinite programming (IRIS). Proc. WAFR, 2014.
T. Marcucci, J. Umenberger, P. A. Parrilo, R. Tedrake. Shortest paths in graphs of convex sets. SIAM J. Optimization, 2024.
T. Marcucci, M. Petersen, D. von Wrangel, R. Tedrake. Motion planning around obstacles with convex optimization. Science Robotics, 2023.
H. Dai, A. Amice, S. Morozov, R. Tedrake. Certified polyhedral decompositions of collision-free configuration space (C-IRIS). International Journal of Robotics Research, 2024.
M. Zucker, N. Ratliff, M. Stolle, J. A. Bagnell, C. G. Atkeson, J. Kuffner. CHOMP: Covariant Hamiltonian optimization for motion planning. Int. J. Robotics Research, 2013.
M. Kalakrishnan, S. Chitta, E. Theodorou, P. Pastor, S. Schaal. STOMP: Stochastic trajectory optimization for motion planning. Proc. IEEE ICRA, 2011.
J. Schulman, J. Ho, A. Lee, I. Awwal, H. Bradlow, P. Abbeel. Motion planning with sequential convex optimization and convex collision checking. Int. J. Robotics Research, 2014.
M. Mukadam, J. Dong, X. Yan, F. Dellaert, B. Boots. Continuous-time Gaussian process motion planning via probabilistic inference. Int. J. Robotics Research, 2018.
R. Diankov. Automated Construction of Robotic Manipulation Programs. 2010.
P. Beeson, B. Ames. TRAC-IK: An open-source library for improved solving of generic inverse kinematics. Proc. IEEE-RAS Humanoids, 2015.
H. Dai, G. Izatt, R. Tedrake. Global inverse kinematics via mixed-integer convex optimization. Int. J. Robotics Research, 2019.
M. Toussaint. Logic-Geometric Programming: An optimization-based approach to combined task and motion planning. IJCAI, 2015.
M. Toussaint, M. Lopes. Multi-bound tree search for logic-geometric programming in cooperative manipulation domains. Proc. IEEE ICRA, 2017.
Caelan Reed Garrett, Tomás Lozano-Pérez, Leslie Pack Kaelbling. Pddlstream: Integrating symbolic planners and blackbox samplers via optimistic adaptive planning. Proceedings of the international conference on automated planning and scheduling, 2020.
K. T. Ly, V. Semenov, M. Risiglione, W. Merkt, I. Havoutis. R-LGP: A reachability-guided logic-geometric programming framework for optimal task and motion planning on mobile manipulators. arXiv preprint arXiv:2310.02791, 2023. arXiv
B. Vu, T. Migimatsu, J. Bohg. COAST: Constraints and Streams for Task and Motion Planning. Proc. IEEE ICRA, 2024.
I. A. Şucan, M. Moll, L. E. Kavraki. The Open Motion Planning Library. IEEE Robotics & Automation Magazine, 2012.
F. Lagriffoul, N. T. Dantam, C. Garrett, A. Akbari, S. Srivastava, L. E. Kavraki. Platform-Independent Benchmarks for Task and Motion Planning. IEEE Robotics and Automation Letters, 2018.
J. Collins, M. Gupta, F. Fang, S. S. Srinivasa, D. Held. RAMP: A Benchmark for Evaluating Robotic Assembly Manipulation and Planning. IEEE Robotics and Automation Letters, 2023.
Y. Tian, R. Li, A. Varava, T. Asfour, M. Toussaint, K. Goldberg. ASAP: Automated Sequence Planning for Complex Robotic Assembly with Physical Feasibility. arXiv preprint arXiv:2309.16909, 2024. arXiv
M. Heo, Y. Lee, D. Lee, J. J. Lim. FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation. Proc. Robotics: Science and Systems (RSS), 2023.
L. Blackmore, M. Ono, B. C. Williams. Chance-constrained optimal path planning with obstacles. IEEE Trans. Robotics, 2011.
Vasumathi Raman, Mehdi Maasoumy, Alexandre Donzé. Model predictive control from signal temporal logic specifications: A case study. Proceedings of the 4th ACM SIGBED international workshop on design, modeling, and evaluation of cyber-physical systems, 2014.
A. D. Ames, S. Coogan, M. Egerstedt, G. Notomista, K. Sreenath, P. Tabuada. Control barrier functions: Theory and applications. arXiv preprint arXiv:1903.11199, 2019. arXiv
D. McDermott, M. Ghallab, A. Howe, C. Knoblock, A. Ram, M. Veloso, D. Weld, D. Wilkins. PDDL---The Planning Domain Definition Language. 1998.
A. L. Blum, M. L. Furst. Fast planning through planning graph analysis. Artificial Intelligence, 1997.
J. Hoffmann, B. Nebel. The FF planning system: Fast plan generation through heuristic search. Journal of Artificial Intelligence Research, 2001.
L. P. Kaelbling, T. Lozano-Pérez. Hierarchical planning in the now. Proc. IEEE ICRA, 2011.
C. R. Garrett, R. Chitnis, R. Holladay, B. Kim, T. Silver, L. P. Kaelbling, T. Lozano-Pérez. Integrated Task and Motion Planning. Annual Review of Control, Robotics, and Autonomous Systems, 2021.
Z. Zhao, S. Cheng, Y. Ding, Z. Zhou, S. Zhang, D. Xu, Y. Zhao. A Survey of Optimization-based Task and Motion Planning: From Classical to Learning Approaches. arXiv preprint arXiv:2404.02817, 2024. arXiv
D. Harel. Statecharts: A visual formalism for complex systems. Science of Computer Programming, 1987.
N. J. Nilsson. Teleo-Reactive Programs for Agent Control. Journal of Artificial Intelligence Research, 1994.
David C. Conner. FlexBE -- The Flexible Behavior Engine: Collaborative Autonomy in ROS 2. 2023. Link
Damian Isla. Handling Complexity in the Halo 2 AI. Proceedings of the 2005 Game Developers Conference, 2005. Link
A. Marzinotto, M. Colledanchise, C. Smith, P. Ögren. Towards a Unified Behavior Trees Framework for Robot Control. Proc. IEEE ICRA, 2014.
M. Colledanchise, P. Ögren. How behavior trees modularize robustness and safety in hybrid systems. Proc. IEEE/RSJ IROS, 2017.
M. Colledanchise, P. Ögren. Behavior Trees in Robotics and AI: An Introduction. 2018.
Francisco Martín, Matteo Morelli, Huáscar Espinoza, Francisco J. Rodríguez-Lera, Vicente Matellán. Optimized Execution of PDDL Plans using Behavior Trees. CoRR, 2021. arXiv
Ruikai Liu, Guangxi Wan, Maowei Jiang, Haojie Chen, Peng Zeng. Autonomous Robot Task Execution in Flexible Manufacturing: Integrating PDDL and Behavior Trees in ARIAC 2023. Biomimetics, 2024. DOILink
R. A. Agis, S. Gottifredi, A. J. García. An event-driven behavior trees extension to facilitate non-player multi-agent coordination in video games. Expert Systems With Applications, 2020.
C. L. Forgy. OPS5 User's Manual. 1981.
C. L. Forgy. Rete: A fast algorithm for the many pattern/many object pattern-matching problem. Communications of the ACM, 1982.
G. Riley, F. Culbert, R. T. Savely, F. Lopez. CLIPS: The C Language Integrated Production System. 1991.
J. E. Laird, A. Newell, P. S. Rosenbloom. Soar: An architecture for general intelligence. Artificial Intelligence, 1987.
M. Tenorth, M. Beetz. KnowRob---A knowledge processing infrastructure for cognition-enabled robots. International Journal of Robotics Research, 2013.
M. Beetz, L. Mösenlechner, M. Tenorth. CRAM---A Cognitive Robot Abstract Machine for everyday manipulation in human environments. Proc. IEEE/RSJ IROS, 2010.
Michael Beetz, Gayane Kazhoyan, David Vernon. The CRAM Cognitive Architecture for Robot Manipulation in Everyday Activities. 2023. arXiv
C. Finucane, G. Jing, H. Kress-Gazit. LTLMoP: Experimenting with language, temporal logic and robot control. Proc. IEEE/RSJ IROS, 2010.
planning.domains: PDDL problem/domain repository and API. 2016.
S. Srivastava, C. Li, R. Lingelbach, R. Martín-Mart\ń, F. Xia, L. Fei-Fei, et al.. BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecologically Valid Environments. Proc. CoRL (PMLR), 2022.
Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gokmen, Sanjana Srivastava, Roberto Martín-Mart\ń, Chen Wang, Gabrael Levine, Wensi Ai, Benjamin Martinez, Hang Yin, Michael Lingelbach, Minjune Hwang, Ayano Hiranaka, Sujay Garlanka, Arman Aydin, Sharon Lee, Jiankai Sun, Mona Anvari, Manasi Sharma, Dhruva Bansal, Samuel Hunter, Kyu-Young Kim, Alan Lou, Caleb R. Matthews, Ivan Villa-Renteria, Jerry Huayang Tang, Claire Tang, Fei Xia, Yunzhu Li, Silvio Savarese, Hyowon Gweon, C. Karen Liu, Jiajun Wu, Li Fei-Fei. BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation. 2024. arXivDOI
Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, Dieter Fox. Alfred: A benchmark for interpreting grounded instructions for everyday tasks. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
A. Padmakumar, J. Thomason, A. Shrivastava, D. Hakkani-Tür, et al.. TEACh: Task-Driven Embodied Agents that Chat. Proc. AAAI, 2022.
Thomas Wisspeintner, Tijn van der Zant, Luca Iocchi, Stefan Schiffer. RoboCup@Home: Results in Benchmarking Domestic Service Robots. Proc. RoboCup Symposium (Lecture Notes in Computer Science #5949), 2010.
Tomi Janhunen, Michael Sioutis. Allen’s interval algebra makes the difference. International Conference on Applications of Declarative Programming and Knowledge Management, 2019.
Michael Ahn, Anthony Brohan, Noah Brown, Yevgen Chebotar, Omar Cortes, Byron David, Chelsea Finn, Chuyuan Fu, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Daniel Ho, Jasmine Hsu, Julian Ibarz, Brian Ichter, Alex Irpan, Eric Jang, Rosario Jauregui Ruano, Kyle Jeffrey, Sally Jesmonth, Nikhil J Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Kuang-Huei Lee, Sergey Levine, Yao Lu, Linda Luu, Carolina Parada, Peter Pastor, Jornell Quiambao, Kanishka Rao, Jarek Rettinghouse, Diego Reyes, Pierre Sermanet, Nicolas Sievers, Clayton Tan, Alexander Toshev, Vincent Vanhoucke, Fei Xia, Ted Xiao, Peng Xu, Sichun Xu, Mengyuan Yan, Andy Zeng. Do As I Can, Not As I Say: Grounding Language in Robotic Affordances. 2022. arXiv
J. Pearl. Causality: Models, Reasoning, and Inference (2nd ed.). 2009. Link
J. Peters, D. Janzing, B. Schölkopf. Elements of Causal Inference: Foundations and Learning Algorithms. 2017. Link
A. Sharma, E. Kiciman. DoWhy: A Python Library for Causal Inference. 2020. arXiv
Patrick Blöbaum, Peter Götz, Kailash Budhathoki, Atalanti A. Mastakouri, Dominik Janzing. DoWhy-GCM: An Extension of DoWhy for Causal Inference in Graphical Causal Models. Journal of Machine Learning Research, 2024. arXivDOI
P. Spirtes, C. Glymour, R. Scheines. Causation, Prediction, and Search (2nd ed.). 2000. Link
D. M. Chickering. Optimal Structure Identification with Greedy Search. Journal of Machine Learning Research, 2002.
C. Meek. Graphical Models: Selecting Causal and Statistical Models (Ph.D. thesis). 1997. Link
D. Colombo, M. H. Maathuis. Order-Independent Constraint-Based Causal Structure Learning. Journal of Machine Learning Research, 2014.
M. Kalisch, P. Bühlmann. Estimating High-Dimensional Directed Acyclic Graphs with the PC-Algorithm. Journal of Machine Learning Research, 2007.
Yujia Zheng, Biwei Huang, Wei Chen, Joseph Ramsey, Mingming Gong, Ruichu Cai, Shohei Shimizu, Peter Spirtes, Kun Zhang. Causal-learn: Causal Discovery in Python. Journal of Machine Learning Research, 2024. Link
Joseph D. Ramsey, Kun Zhang, Madelyn Glymour, Ruben Sanchez Romero, Biwei Huang, Imme Ebert-Uphoff, Savini Samarasinghe, Elizabeth A. Barnes, Clark Glymour. TETRAD: A Toolbox for Causal Discovery. Proceedings of the 8th International Workshop on Climate Informatics, 2018. Link
Joseph D. Ramsey, Bryan Andrews. Py-Tetrad and RPy-Tetrad: A New Python Interface with R Support for Tetrad Causal Search. 2023. arXivDOI
S. Shimizu, P. O. Hoyer, A. Hyvärinen, A. Kerminen. A Linear Non-Gaussian Acyclic Model for Causal Discovery. Journal of Machine Learning Research, 2006.
S. Shimizu, T. Inazumi, Y. Sogawa, A. Hyvärinen, Y. Kawahara, T. Washio, P. O. Hoyer, K. Bollen. DirectLiNGAM: A Direct Method for Learning a Linear Non-Gaussian Structural Equation Model. Journal of Machine Learning Research, 2011.
E. Giunchiglia, J. Lee, V. Lifschitz, N. McCain, H. Turner. Nonmonotonic Causal Theories. Artificial Intelligence, 2004.
V. Lifschitz. Missionaries and Cannibals in the Causal Calculator. Proc. KR, 2000.
Enrico Giunchiglia, Joohyung Lee, Vladimir Lifschitz, Hudson Turner. Causal Laws and Multi-Valued Fluents. arXiv preprint arXiv:2307.10227, 2023. arXivDOI
David McAllester, David Rosenblitt. Systematic Nonlinear Planning. Proceedings of the Ninth National Conference on Artificial Intelligence, 1991. Link
J. S. Penberthy, D. S. Weld. UCPOP: A Sound, Complete, Partial Order Planner for ADL. Proc. KR, 1992.
H. L. S. Younes, M. L. Littman. VHPOP: Versatile Heuristic Partial Order Planner. Journal of Artificial Intelligence Research, 2004.
R. Dechter, I. Meiri, J. Pearl. Temporal Constraint Networks. Artificial Intelligence, 1991.
I. Tsamardinos, N. Muscettola, P. Morris. Fast Transformation of Temporal Plans for Efficient Execution. Proc. AAAI, 1998.
P. Morris, N. Muscettola, T. Vidal. Dynamic Control of Plans with Temporal Uncertainty. Proc. IJCAI, 2001.
S. Kong, S. Gao, W. Chen, E. M. Clarke. dReach: $δ$-Reachability Analysis for Hybrid Systems. Proc. CAV, 2015.
J. Mao, X. Yang, X. Zhang, N. D. Goodman, J. Wu. CLEVRER-Humans: Describing Physical and Causal Events the Human Way. Proc. NeurIPS Datasets and Benchmarks, 2023.
Hsiao-Yu Tung, Mingyu Ding, Zhenfang Chen, Daniel Bear, Chuang Gan, Josh Tenenbaum, Dan Yamins, Judith Fan, Kevin Smith. Physion++: Evaluating physical scene understanding that requires online inference of different physical properties. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
A. Saha, S. Joty, S. C. H. Hoi. CRaFT: Causal Reasoning about Forces and Interactions from Videos. Findings of ACL, 2022.
Z. Zheng, Y. Ding, M. Ibrayev, M. Juluru, A. Kumar, A. Girdhar, D. Shen, A. Shrivastava, R. Feris, D. Parikh, A. Jain. ContPhy: Continuum Physical Concept Learning and Reasoning from Videos. Proc. ICML, 2024.
S. Xiao, J. Wang, L. Ji, L. Chen, S. Yang, S. Geng, W. Ji, T.-S. Chua. NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions. Proc. CVPR, 2021.
M. Grunde-McLaughlin, R. Krishna, M. Agrawala. AGQA: A Benchmark for Compositional Spatio-Temporal Reasoning. Proc. CVPR, 2021.
M. Grunde-McLaughlin, R. Krishna, M. Agrawala. AGQA 2.0: An Updated Benchmark for Compositional Spatio-Temporal Reasoning. 2022. arXiv
L. Xu, H. Huang, J. Liu. SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Events. Proc. CVPR, 2021.
Chengshu Li, Fei Xia, Roberto Martín-Mart\ń, Michael Lingelbach, Sanjana Srivastava, Bokui Shen, Kent Vainio, Cem Gokmen, Gokul Dharan, Tanish Jain, Andrey Kurenkov, C. Karen Liu, Hyowon Gweon, Jiajun Wu, Li Fei-Fei, Silvio Savarese. iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks. Proceedings of the 5th Conference on Robot Learning, 2021. arXivDOI
Jiayuan Gu, Fanbo Xiang, Xuanlin Li, Zhan Ling, Xiqiang Liu, Tongzhou Mu, Yihe Tang, Stone Tao, Xinyue Wei, Yunchao Yao, Xiaodi Yuan, Pengwei Xie, Zhiao Huang, Rui Chen, Hao Su. ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills. International Conference on Learning Representations, 2023. arXiv
S. James, Z. Ma, D. R. Arrojo, A. J. Davison, E. Johns. RLBench: The Robot Learning Benchmark & Learning Environment. IEEE Robotics and Automation Letters, 2020.
S. Mohanty, E. Nygren, F. Laurent, M. Schneider, C. Scheller, N. Bhattacharya, J. Watson, A. Egli, C. Eichenberger, et al.. Flatland-RL: Multi-Agent Reinforcement Learning on Trains. 2020. arXiv
L. Geretti, S. Bak, S. Bogomolov, X. Chen, G. Frehse, T. A. Henzinger, et al.. ARCH-COMP 2024 Category Report: Continuous and Hybrid Systems with Nonlinear Dynamics. Proc. ARCH Workshop (EPiC Series in Computing), 2024.
Adam Santoro, David Raposo, David G Barrett, Mateusz Malinowski, Razvan Pascanu, Peter Battaglia, Timothy Lillicrap. A simple neural network module for relational reasoning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017.
Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, Yoshua Bengio. Show, attend and tell: Neural image caption generation with visual attention. Proceedings of the International Conference on Machine Learning (ICML), 2015.
Yuke Zhu, Oliver Groth, Michael Bernstein, Li Fei-Fei. Visual7w: Grounded question answering in images. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
Long Chen, Hanwang Zhang, Jun Xiao, Liqiang Nie, Jian Shao, Wei Liu, Tat-Seng Chua. Sca-cnn: Spatial and channel-wise attention in convolutional networks for image captioning. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling Shao. Pyramid vision transformer: A versatile backbone for dense prediction without convolutions. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Xiangxiang Chu, Zhi Tian, Yuqing Wang, Bo Zhang, Haibing Ren, Xiaolin Wei, Huaxia Xia, Chunhua Shen. Twins: Revisiting the design of spatial attention in vision transformers. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2021.
Ethan Perez, Florian Strub, Harm De Vries, Vincent Dumoulin, Aaron Courville. Film: Visual reasoning with a general conditioning layer. Proceedings of the AAAI conference on artificial intelligence, 2018.
Sara Sabour, Nicholas Frosst, Geoffrey E Hinton. Dynamic routing between capsules. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017.
Taco Cohen, Max Welling. Group equivariant convolutional networks. Proceedings of the International Conference on Machine Learning (ICML), 2016.
Justin Johnson, Bharath Hariharan, Laurens Van Der Maaten, Li Fei-Fei, C Lawrence Zitnick, Ross Girshick. Clevr: A diagnostic dataset for compositional language and elementary visual reasoning. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, Devi Parikh. Making the v in vqa matter: Elevating the role of image understanding in visual question answering. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Drew A. Hudson, Christopher D. Manning. Compositional Attention Networks for Machine Reasoning. International Conference on Learning Representations (ICLR), 2018. Link
Drew Hudson, Christopher D Manning. Learning by abstraction: The neural state machine. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2019.
Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Dan Klein. Neural module networks. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
Justin Johnson, Bharath Hariharan, Laurens Van Der Maaten, Judy Hoffman, Li Fei-Fei, C Lawrence Zitnick, Ross Girshick. Inferring and executing programs for visual reasoning. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Kexin Yi, Jiajun Wu, Chuang Gan, Antonio Torralba, Pushmeet Kohli, Josh Tenenbaum. Neural-symbolic vqa: Disentangling reasoning from vision and language understanding. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2018.
Tanmay Gupta, Aniruddha Kembhavi. Visual programming: Compositional visual reasoning without training. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, Andy Zeng. Code as policies: Language model programs for embodied control. 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023.
Ronald J Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, 1992.
Max Jaderberg, Karen Simonyan, Andrew Zisserman, et al.. Spatial transformer networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2015.
Taco S. Cohen, Max Welling. Steerable CNNs. International Conference on Learning Representations, 2017. Link
Nathaniel Thomas, Tess Smidt, Steven Kearnes, Lusann Yang, Li Li, Kai Kohlhoff, Patrick Riley. Tensor Field Networks: Rotation- and Translation-Equivariant Neural Networks for 3D Point Clouds. arXiv preprint arXiv:1802.08219, 2018. arXiv
Min Lin, Qiang Chen, Shuicheng Yan. Network in network. arXiv preprint arXiv:1312.4400, 2013. arXiv
Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabás Póczos, Ruslan Salakhutdinov, Alexander J. Smola. Deep Sets. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017.
Maurice Weiler, Gabriele Cesa. General e (2)-equivariant steerable cnns. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2019.
Ziqiao Meng, Liang Zeng, Zixing Song, Tingyang Xu, Peilin Zhao, Irwin King. Towards Geometric Normalization Techniques in SE(3) Equivariant Graph Neural Networks for Physical Dynamics Simulations. Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, IJCAI-24, 2024. DOILink
Víctor Garcia Satorras, Emiel Hoogeboom, Max Welling. E(n) Equivariant Graph Neural Networks. Proceedings of the International Conference on Machine Learning (ICML), 2021.
Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, Jianxiong Xiao. 3d shapenets: A deep representation for volumetric shapes. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2015.
Mikaela Angelina Uy, Quang-Hieu Pham, Binh-Son Hua, Thanh Nguyen, Sai-Kit Yeung. Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Data. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
Raghunathan Ramakrishnan, Pavlo O. Dral, Matthias Rupp, O. Anatole von Lilienfeld. Quantum chemistry structures and properties of 134 kilo molecules. Scientific Data, 2014.
Simon Batzner, Albert Musaelian, Lixin Sun, Mario Geiger, Jonathan P. Mailoa, Mordechai Kornbluth, Nicola Molinari, Tess E. Smidt, Boris Kozinsky. E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials. Nature Communications, 2022.
Ilyes Batatia, Dávid P. Kovács, Gregor N. C. Simm, Christoph Ortner, Gábor Csányi. MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fields. Advances in Neural Information Processing Systems (NeurIPS), 2022.
Omri Puny, Matan Atzmon, Heli Ben-Hamu, Ishan Misra, Aditya Grover, Edward J. Smith, Yaron Lipman. Frame Averaging for Invariant and Equivariant Network Design. Proceedings of the International Conference on Learning Representations (ICLR), 2022.
Stephen Gould, Dylan Campbell, Itzik Ben-Shabat, Chamin Hewa Koneputugodage, Zhiwei Xu. Exploiting problem structure in deep declarative networks: Two case studies. arXiv preprint arXiv:2202.12404, 2022. arXiv
Brandon Amos, J Zico Kolter. Optnet: Differentiable optimization as a layer in neural networks. Proceedings of the International Conference on Machine Learning (ICML), 2017.
Po-Wei Wang, Priya Donti, Bryan Wilder, Zico Kolter. Satnet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver. Proceedings of the International Conference on Machine Learning (ICML), 2019.
Brandon Amos, Ivan Jimenez, Jacob Sacks, Byron Boots, J Zico Kolter. Differentiable MPC for end-to-end planning and control. Advances in Neural Information Processing Systems (NeurIPS), 2018.
Akshay Agrawal, Brandon Amos, Shane Barratt, Stephen Boyd, Steven Diamond, J Zico Kolter. Differentiable convex optimization layers. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2019.
Steven Diamond, Stephen Boyd. CVXPY: A Python-embedded modeling language for convex optimization. Journal of Machine Learning Research, 2016.
Stephen Gould, Richard Hartley, Dylan Campbell. Deep declarative networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021.
Dylan Campbell, Liu Liu, Stephen Gould. Solving the blind perspective-n-point problem end-to-end with robust differentiable geometric optimization. European Conference on Computer Vision, 2020.
Hikaru Shindo, Viktor Pfanschilling, Devendra Singh Dhami, Kristian Kersting. Learning differentiable logic programs for abstract visual reasoning. Machine Learning, 2024.
Zico Kolter, David Duvenaud, Matt Johnson. Chapter 5: Differentiable optimization. r̆lhttps://implicit-layers-tutorial.org/differentiable_optimization/, 2020.
Shaojie Bai, J Zico Kolter, Vladlen Koltun. Deep equilibrium models. Advances in Neural Information Processing Systems (NeurIPS), 2019.
Luis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman, Paloma Sodhi, Ricky T Q Chen, Joseph Ortiz, Daniel DeTone, Austin Wang, Stuart Anderson, et al.. Theseus: A library for differentiable nonlinear optimization. Advances in Neural Information Processing Systems (NeurIPS), 2022.
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al.. Human-level control through deep reinforcement learning. Nature, 2015.
Jianqing Fan, Zhaoran Wang, Yuchen Xie, Zhuoran Yang. A theoretical analysis of deep Q-learning. Learning for dynamics and control, 2020.
Juan C Caicedo, Svetlana Lazebnik. Active object localization with deep reinforcement learning. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2015.
Aviv Tamar, Yi Wu, Garrett Thomas, Sergey Levine, Pieter Abbeel. Value iteration networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2016.
Lisa Lee, Emilio Parisotto, Devendra Singh Chaplot, Eric Xing, Ruslan Salakhutdinov. Gated path planning networks. Proceedings of the International Conference on Machine Learning (ICML), 2018.
Peter Karkus, David Hsu, Wee Sun Lee. Qmdp-net: Deep learning for planning under partial observability. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017.
Michael L Littman, Anthony R Cassandra, Leslie Pack Kaelbling. Learning policies for partially observable environments: Scaling up. Machine Learning Proceedings 1995, 1995.
Junzi Zhang, Jongho Kim, Brendan O'Donoghue, Stephen Boyd. Sample efficient reinforcement learning with REINFORCE. Proceedings of the AAAI conference on artificial intelligence, 2021.
Devendra Singh Chaplot, Emilio Parisotto, Ruslan Salakhutdinov. Active neural localization. arXiv preprint arXiv:1801.08214, 2018. arXiv
Abhishek Das, Samyak Datta, Georgia Gkioxari, Stefan Lee, Devi Parikh, Dhruv Batra. Embodied Question Answering. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Saurabh Gupta, James Davidson, Sergey Levine, Rahul Sukthankar, Jitendra Malik. Cognitive mapping and planning for visual navigation. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Michael Janner, Karthik Narasimhan, Regina Barzilay. Representation learning for grounded spatial reasoning. Transactions of the Association for Computational Linguistics, 2018.
Vinicius Zambaldi, David Raposo, Adam Santoro, Victor Bapst, Yujia Li, Igor Babuschkin, Karl Tuyls, David Reichert, Timothy Lillicrap, Edward Lockhart, et al.. Deep reinforcement learning with relational inductive biases. International conference on learning representations, 2019.
Thomas Degris, Patrick M Pilarski, Richard S Sutton. Model-free reinforcement learning with continuous action in practice. 2012 American control conference (ACC), 2012.
Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, Koray Kavukcuoglu. Asynchronous methods for deep reinforcement learning. Proceedings of the International Conference on Machine Learning (ICML), 2016.
Yuke Zhu, Roozbeh Mottaghi, Eric Kolve, Joseph J Lim, Abhinav Gupta, Li Fei-Fei, Ali Farhadi. Target-driven visual navigation in indoor scenes using deep reinforcement learning. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2017.
Jingwei Zhang, Lei Tai, Ming Liu, Joschka Boedecker, Wolfram Burgard. Neural slam: Learning to explore with external memory. arXiv preprint arXiv:1706.09520, 2017. arXiv
Piotr Mirowski, Razvan Pascanu, Fabio Viola, Hubert Soyer, Andrew J Ballard, Andrea Banino, Misha Denil, Ross Goroshin, Laurent Sifre, Koray Kavukcuoglu, et al.. Learning to navigate in complex environments. arXiv preprint arXiv:1611.03673, 2016. arXiv
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, Oleg Klimov. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017. arXiv
Erik Wijmans, Abhishek Kadian, Ari Morcos, Stefan Lee, Irfan Essa, Devi Parikh, Manolis Savva, Dhruv Batra. DD-PPO: Learning near-perfect pointgoal navigators from 2.5 billion frames. Proceedings of the International Conference on Learning Representations (ICLR), 2020.
Peter Anderson, Qi Wu, Damien Teney, Jake Bruce, Mark Johnson, Niko Sünderhauf, Ian Reid, Stephen Gould, Anton van den Hengel. Vision-and-Language Navigation: Interpreting Visually-Grounded Navigation Instructions in Real Environments. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Devendra Singh Chaplot, Dhiraj Prakashchand Gandhi, Abhinav Gupta, Russ R. Salakhutdinov. Object Goal Navigation Using Goal-Oriented Semantic Exploration. Advances in Neural Information Processing Systems (NeurIPS), 2020.
Edward Beeching, Jilles Dibangoye, Olivier Simonin, Christian Wolf. Learning to plan with uncertain topological maps. European Conference on Computer Vision, 2020.
Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, Chelsea Finn. Direct preference optimization: Your language model is secretly a reward model. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Ralph Allan Bradley, Milton E Terry. Rank analysis of incomplete block designs: I. the method of paired comparisons. Biometrika, 1952.
Zhijian Huang, Tao Tang, Shaoxiang Chen, Sihao Lin, Zequn Jie, Lin Ma, Guangrun Wang, Xiaodan Liang. Making large language models better planners with reasoning-decision alignment. European Conference on Computer Vision, 2024.
Han Qiu, Peng Gao, Lewei Lu, Xiaoqin Zhang, Ling Shao, Shijian Lu. Spatial Preference Rewarding for MLLMs Spatial Understanding. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, et al.. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948, 2025. arXiv
Huajie Tan, Yuheng Ji, Xiaoshuai Hao, Xiansheng Chen, Pengwei Wang, Zhongyuan Wang, Shanghang Zhang. Reason-rft: Reinforcement fine-tuning for visual reasoning of vision language models. The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025.
Chen Gao, Liankai Jin, Xingyu Peng, Jiazhao Zhang, Yue Deng, Annan Li, He Wang, Si Liu. Octonav: Towards generalist embodied navigation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026.
Kexian Tang, Junyao Gao, Yanhong Zeng, Haodong Duan, Yanan Sun, Zhening Xing, Wenran Liu, Kaifeng Lyu, Kai Chen. LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning?. arXiv preprint arXiv:2503.19990, 2025. arXiv
Kun Ouyang, Yuanxin Liu, Haoning Wu, Yi Liu, Hao Zhou, Jie Zhou, Fandong Meng, Xu Sun. SpaceR: Reinforcing MLLMs in Video Spatial Reasoning. arXiv preprint arXiv:2504.01805, 2025. arXiv
Emilio Parisotto, Ruslan Salakhutdinov. Neural map: Structured memory for deep reinforcement learning. Proceedings of the International Conference on Learning Representations (ICLR), 2018.
Devendra Singh Chaplot, Dhiraj Gandhi, Saurabh Gupta, Abhinav Gupta, Ruslan Salakhutdinov. Learning to explore using active neural slam. Proceedings of the International Conference on Learning Representations (ICLR), 2020.
Fengda Zhu, Xiwen Liang, Yi Zhu, Qizhi Yu, Xiaojun Chang, Xiaodan Liang. Soon: Scenario oriented object navigation with graph-based exploration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021.
Ryan Lowe, Yi Wu, Aviv Tamar, Jean Harb, Pieter Abbeel, Igor Mordatch. Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments. Proceedings of the Conference on Neural Information Processing Systems (NeurIPS), 2017.
Jakob Foerster, Gregory Farquhar, Triantafyllos Afouras, Nantas Nardelli, Shimon Whiteson. Counterfactual Multi-Agent Policy Gradients. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2018.
Tabish Rashid, Mikayel Samvelyan, Christian Schroeder, Gregory Farquhar, Jakob Foerster, Shimon Whiteson. QMIX: Monotonic Value Function Factorization for Deep Multi-Agent Reinforcement Learning. Proceedings of the 35th International Conference on Machine Learning (ICML), 2018.
Anthony Goeckner, Yueyuan Sui, Nicolas Martinet, Xinliang Li, Qi Zhu. Graph Neural Network-based Multi-agent Reinforcement Learning for Resilient Distributed Coordination of Multi-Robot Systems. 2024. arXiv
Mikayel Samvelyan, Tabish Rashid, Christian Schroeder de Witt, Gregory Farquhar, Nantas Nardelli, Tim G. J. Rudner, Chia-Man Hung, Philip H. S. Torr, Jakob Foerster, Shimon Whiteson. The StarCraft Multi-Agent Challenge. Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems (AAMAS), 2019.
Karol Kurach, Anton Raichuk, Piotr Sta\ʼnczyk, Michał Zając, Olivier Bachem, Lasse Espeholt, Carlos Riquelme, Damien Vincent, Marcin Michalski, Olivier Bousquet, Sylvain Gelly. Google Research Football: A Novel Reinforcement Learning Environment. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2020.
Peter Sunehag, Guy Lever, Audrunas Gruslys, Wojciech Marian Czarnecki, Vinicius Zambaldi, Max Jaderberg, Marc Lanctot, Nicolas Sonnerat, Joel Z. Leibo, Karl Tuyls, Thore Graepel. Value-Decomposition Networks for Cooperative Multi-Agent Learning Based on Team Reward. Proceedings of the International Conference on Autonomous Agents and MultiAgent Systems (AAMAS), 2018.
Muning Wen, Jakub Grudzien Kuba, Runji Lin, Weinan Zhang, Ying Wen, Jun Wang, Yaodong Yang. Multi-Agent Reinforcement Learning is a Sequence Modeling Problem. Advances in Neural Information Processing Systems, 2022.
Joseph Suarez, Yilun Du, Igor Mordatch, Phillip Isola. Neural MMO v1.3: A Massively Multiagent Game Environment for Training and Evaluating Neural Networks. Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems, AAMAS, 2020.
Joseph Suarez, David Bloomin, Kyoung Whan Choe, Hao Xiang Li, Ryan Sullivan, Nishaanth Kanna, Daniel Scott, Rose S. Shuman, Herbie Bradley, Louis Castricato, Phillip Isola, Chenghui Yu, Yuhao Jiang, Qimai Li, Jiaxin Chen, Xiaolong Zhu. Neural MMO 2.0: A Massively Multi-task Addition to Massively Multi-agent Learning. Advances in Neural Information Processing Systems, 2023.
Kyunghwan Son, Daewoo Kim, Wan Ju Kang, David Earl Hostallero, Yung Yi. Qtran: Learning to factorize with transformation for cooperative multi-agent reinforcement learning. International conference on machine learning, 2019.
Tabish Rashid, Mikayel Samvelyan, Christian Schroeder De Witt, Gregory Farquhar, Jakob Foerster, Shimon Whiteson. Monotonic value function factorisation for deep multi-agent reinforcement learning. Journal of Machine Learning Research, 2020.
Jianhao Wang, Zhizhou Ren, Terry Liu, Yang Yu, Chongjie Zhang. Qplex: Duplex dueling multi-agent q-learning. arXiv preprint arXiv:2008.01062, 2020. arXiv
Daniel Bogdoll, Yitian Yang, Tim Joseph, Melih Yazgan, J Marius Zollner. Muvo: A multimodal generative world model for autonomous driving with geometric representations. 2025 IEEE Intelligent Vehicles Symposium (IV), 2025.
Hong-Xing Yu, Haoyi Duan, Charles Herrmann, William T. Freeman, Jiajun Wu. WonderWorld: Interactive 3D Scene Generation from a Single Image. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Xinhang Liu, Yu-Wing Tai, Chi-Keung Tang. Agentic 3D Scene Generation with Spatially Contextualized VLMs. arXiv preprint arXiv:2505.20129, 2025. arXiv
Fangjun Li, David C Hogg, Anthony G Cohn. Advancing spatial reasoning in large language models: An in-depth evaluation and enhancement using the stepgame benchmark. Proceedings of the AAAI Conference on Artificial Intelligence, 2024.
Jiayu Wang, Yifei Ming, Zhenmei Shi, Vibhav Vineet, Xin Wang, Sharon Li, Neel Joshi. Is a picture worth a thousand words? delving into spatial reasoning for vision language models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Disheng Liu, Tuo Liang, Zhe Hu, Jierui Peng, Yiren Lu, Yi Xu, Yun Fu, Yu Yin. Deconstructing Spatial Intelligence in Vision-Language Models. 2025.
Yuan-Hong Liao, Rafid Mahmood, Sanja Fidler, David Acuna. Reasoning paths with reference objects elicit quantitative spatial reasoning in large vision-language models. arXiv preprint arXiv:2409.09788, 2024. arXiv
Chancharik Mitra, Brandon Huang, Trevor Darrell, Roei Herzig. Compositional chain-of-thought prompting for large multimodal models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Junfei Wu, Jian Guan, Kaituo Feng, Qiang Liu, Shu Wu, Liang Wang, Wei Wu, Tieniu Tan. Reinforcing spatial reasoning in vision-language models with interwoven thinking and visual drawing. arXiv preprint arXiv:2506.09965, 2025. arXiv
Yifan Shen, Yuanzhe Liu, Jingyuan Zhu, Xu Cao, Xiaofeng Zhang, Yixiao He, Wenming Ye, James Matthew Rehg, Ismini Lourentzou. Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMs. arXiv preprint arXiv:2506.21656, 2025. arXiv
Peiyao Wang, Haibin Ling. SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization. arXiv preprint arXiv:2506.01371, 2025. arXiv
Weiyun Wang, Yiming Ren, Haowen Luo, Tiantong Li, Chenxiang Yan, Zhe Chen, Wenhai Wang, Qingyun Li, Lewei Lu, Xizhou Zhu, et al.. The all-seeing project v2: Towards general relation comprehension of the open world. European Conference on Computer Vision, 2024.
Yihong Tang, Ao Qu, Zhaokai Wang, Dingyi Zhuang, Zhaofeng Wu, Wei Ma, Shenhao Wang, Yunhan Zheng, Zhan Zhao, Jinhua Zhao. Sparkle: Mastering basic spatial capabilities in vision language models elicits generalization to spatial reasoning. Findings of the Association for Computational Linguistics: EMNLP, 2025.
Haojun Jiang, Yuanze Lin, Dongchen Han, Shiji Song, Gao Huang. Pseudo-q: Generating pseudo language queries for visual grounding. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Qiushan Guo, Shalini De Mello, Hongxu Yin, Wonmin Byeon, Ka Chun Cheung, Yizhou Yu, Ping Luo, Sifei Liu. Regiongpt: Towards region understanding vision language model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Chenming Zhu, Tai Wang, Wenwei Zhang, Jiangmiao Pang, Xihui Liu. Llava-3d: A simple yet effective pathway to empowering lmms with 3d-awareness. arXiv preprint arXiv:2409.18125, 2024. arXiv
Jiayu Tang, Yuchen Zhou, Chao Gou. SpatialSV: Internalizing Interpretable 3D Spatial Awareness in MLLMs via Task-Oriented Visual Supervision. arXiv preprint arXiv:2606.19915, 2026. arXiv
Ji Hyeok Jung, Eun Tae Kim, Seoyeon Kim, Joo Ho Lee, Bumsoo Kim, Buru Chang. Is ‘right’right? enhancing object orientation understanding in multimodal large language models through egocentric instruction tuning. 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Shehreen Azad, Yash Jain, Rishit Garg, Vibhav Vineet, Yogesh Rawat. Understanding Depth and Height Perception in Large Visual-Language Models. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Peter Tong, Ellis Brown, Penghao Wu, Sanghyun Woo, Adithya Jairam Vedagiri IYER, Sai Charitha Akula, Shusheng Yang, Jihan Yang, Manoj Middepogu, Ziteng Wang, et al.. Cambrian-1: A fully open, vision-centric exploration of multimodal llms. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Amita Kamath, Jack Hessel, Kai-Wei Chang. What's "up" with vision-language models? Investigating their struggle with spatial reasoning. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023, 2023.
Ilias Stogiannidis, Steven McDonagh, Sotirios A Tsaftaris. Mind the gap: Benchmarking spatial reasoning in vision-language models. arXiv preprint arXiv:2503.19707, 2025. arXiv
Baiqiao Yin, Qineng Wang, Pingyue Zhang, Jianshu Zhang, Kangrui Wang, Zihan Wang, Jieyu Zhang, Keshigeyan Chandrasegaran, Han Liu, Ranjay Krishna, et al.. Spatial mental modeling from limited views. Structural Priors for Vision Workshop at ICCV'25, 2025.
xAI Team. Grok-1.5V Vision Preview. r̆lhttps://x.ai/news/grok-1.5v, 2024.
Mengdi Jia, Zekun Qi, Shaochen Zhang, Wenyao Zhang, Xinqiang Yu, Jiawei He, He Wang, Li Yi. OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models. arXiv preprint arXiv:2506.03135, 2025. arXiv
Guangzhi Wang, Yixiao Ge, Xiaohan Ding, Mohan Kankanhalli, Ying Shan. What makes for good visual tokenizers for large language models?. arXiv preprint arXiv:2305.12223, 2023. arXiv
Shengbang Tong, Zhuang Liu, Yuexiang Zhai, Yi Ma, Yann LeCun, Saining Xie. Eyes wide shut? exploring the visual shortcomings of multimodal llms. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Zehan Wang, Sashuai Zhou, Shaoxuan He, Haifeng Huang, Lihe Yang, Ziang Zhang, Xize Cheng, Shengpeng Ji, Tao Jin, Hengshuang Zhao, et al.. SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Fangyu Liu, Guy Emerson, Nigel Collier. Visual spatial reasoning. Transactions of the Association for Computational Linguistics, 2023.
Palaash Agrawal, Haidi Azaman, Cheston Tan. Stupd: A synthetic dataset for spatial and temporal relation reasoning. arXiv preprint arXiv:2309.06680, 2023. arXiv
Phillip Y Lee, Jihyeon Je, Chanho Park, Mikaela Angelina Uy, Leonidas Guibas, Minhyuk Sung. Perspective-aware reasoning in vision-language models via mental imagery simulation. arXiv preprint arXiv:2504.17207, 2025. arXiv
Dapeng Zhang, Jing Sun, Chenghui Hu, Xiaoyan Wu, Zhenlong Yuan, Rui Zhou, Fei Shen, Qingguo Zhou. Pure vision language action (vla) models: A comprehensive survey. arXiv preprint arXiv:2509.19012, 2025. arXiv
Ranjan Sapkota, Yang Cao, Konstantinos I Roumeliotis, Manoj Karkee. Vision-language-action models: Concepts, progress, applications and challenges. arXiv preprint arXiv:2505.04769, 2025. arXiv
Chengmeng Li, Junjie Wen, Yan Peng, Yaxin Peng, Feifei Feng, Yichen Zhu. Pointvla: Injecting the 3d world into vision-language-action models. arXiv preprint arXiv:2503.07511, 2025. arXiv
Julen Urain, Niklas Funk, Jan Peters, Georgia Chalvatzaki. Se (3)-diffusionfields: Learning smooth cost functions for joint grasp and motion optimization through diffusion. arXiv preprint arXiv:2209.03855, 2022. arXiv
Tsung-Wei Ke, Nikolaos Gkanatsios, Katerina Fragkiadaki. 3d diffuser actor: Policy diffusion with 3d scene representations. arXiv preprint arXiv:2402.10885, 2024. arXiv
Jiawen Yu, Hairuo Liu, Qiaojun Yu, Jieji Ren, Ce Hao, Haitong Ding, Guangyu Huang, Guofan Huang, Yan Song, Panpan Cai, et al.. ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation. arXiv preprint arXiv:2505.22159, 2025. arXiv
Yecheng Jason Ma, Shagun Sodhani, Dinesh Jayaraman, Osbert Bastani, Vikash Kumar, Amy Zhang. Vip: Towards universal visual reward and representation via value-implicit pre-training. arXiv preprint arXiv:2210.00030, 2022. arXiv
An-Chieh Cheng, Yandong Ji, Zhaojing Yang, Zaitian Gongye, Xueyan Zou, Jan Kautz, Erdem Bıyık, Hongxu Yin, Sifei Liu, Xiaolong Wang. Navila: Legged robot vision-language-action model for navigation. arXiv preprint arXiv:2412.04453, 2024. arXiv
Borong Zhang, Yuhao Zhang, Jiaming Ji, Yingshan Lei, Josef Dai, Yuanpei Chen, Yaodong Yang. Safevla: Towards safety alignment of vision-language-action model via safe reinforcement learning. arXiv e-prints, 2025.
Wenlong Huang, Chen Wang, Ruohan Zhang, Yunzhu Li, Jiajun Wu, Li Fei-Fei. Voxposer: Composable 3d value maps for robotic manipulation with language models. arXiv preprint arXiv:2307.05973, 2023. arXiv
Wenlong Huang, Chen Wang, Yunzhu Li, Ruohan Zhang, Li Fei-Fei. ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation. arXiv preprint arXiv:2409.01652, 2024. arXiv
Wentao Yuan, Jiafei Duan, Valts Blukis, Wilbert Pumacay, Ranjay Krishna, Adithyavairavan Murali, Arsalan Mousavian, Dieter Fox. RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics. arXiv preprint arXiv:2406.10721, 2024. arXiv
Yunfan Jiang, Agrim Gupta, Zichen Zhang, Guanzhi Wang, Yongqiang Dou, Yanjun Chen, Li Fei-Fei, Anima Anandkumar, Yuke Zhu, Linxi Fan. VIMA: General Robot Manipulation with Multimodal Prompts. International Conference on Machine Learning (ICML), 2023.
Oier Mees, Lukas Hermann, Erick Rosete-Beas, Wolfram Burgard. Calvin: A benchmark for language-conditioned policy learning for long-horizon robot manipulation tasks. IEEE Robotics and Automation Letters, 2022.
Abby O’Neill, Abdul Rehman, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, Ajinkya Jain, et al.. Open x-embodiment: Robotic learning datasets and rt-x models: Open x-embodiment collaboration 0. 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024.
Frederik Ebert, Yanlai Yang, Karl Schmeckpeper, Bernadette Bucher, Georgios Georgakis, Kostas Daniilidis, Chelsea Finn, Sergey Levine. Bridge data: Boosting generalization of robotic skills with cross-domain datasets. arXiv preprint arXiv:2109.13396, 2021. arXiv
Hao-Shu Fang, Hongjie Fang, Zhenyu Tang, Jirong Liu, Chenxi Wang, Junbo Wang, Haoyi Zhu, Cewu Lu. Rh20t: A comprehensive robotic dataset for learning diverse skills in one-shot. 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024.
Sai Srinivas Kancheti, Aditya Sanjiv Kanade, Vineeth N. Balasubramanian, Tanuja Ganu. Chain-of-Thought Degrades Visual Spatial Reasoning Capabilities of Multimodal LLMs. arXiv preprint arXiv:2604.16060, 2026. arXiv
Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Tom Griffiths, Yuan Cao, Karthik Narasimhan. Tree of thoughts: Deliberate problem solving with large language models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Michal Podstawski, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Hubert Niewiadomski, Piotr Nyczyk, et al.. Graph of thoughts: Solving elaborate problems with large language models. Proceedings of the AAAI conference on artificial intelligence, 2024.
Wenhu Chen, Xueguang Ma, Xinyi Wang, William W Cohen. Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks. arXiv preprint arXiv:2211.12588, 2022. arXiv
Zhenyu Pan, Haozheng Luo, Manling Li, Han Liu. Chain-of-action: Faithful and multimodal question answering through large language models. arXiv preprint arXiv:2403.17359, 2024. arXiv
Hongjie Zhang, Hourui Deng, Jie Ou, Chaosheng Feng. Mitigating spatial hallucination in large language models for path planning via prompt engineering. Scientific Reports, 2025.
Wei Chen, Yancheng Long, Mingqiao Liu, Haojie Ding, Yankai Yang, Hongyang Wei, Yi-Fan Zhang, Bin Wen, Fan Yang, Tingting Gao, Han Li, Long Chen. Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation. arXiv preprint arXiv:2602.11980, 2026. arXiv
Joy Hsu, Jiayuan Mao, Joshua B Tenenbaum, Noah D Goodman, Jiajun Wu. What Makes a Maze Look Like a Maze?. International Conference on Learning Representations (ICLR), 2025.
Bingqian Lin, Yunshuang Nie, Ziming Wei, Jiaqi Chen, Shikui Ma, Jianhua Han, Hang Xu, Xiaojun Chang, Xiaodan Liang. Navcot: Boosting llm-based vision-and-language navigation via learning disentangled reasoning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025.
Qingxiang Liu, Ting Huang, Zeyu Zhang, Hao Tang. Nav-R1: Reasoning and Navigation in Embodied Scenes. 2025. arXiv
Guanxing Lu, Ziwei Wang, Changliu Liu, Jiwen Lu, Yansong Tang. ThinkBot: Embodied Instruction Following with Thought Chain Reasoning. 2023. arXiv
Yao Mu, Qinglong Zhang, Mengkang Hu, Wenhai Wang, Mingyu Ding, Jun Jin, Bin Wang, Jifeng Dai, Yu Qiao, Ping Luo. EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought. 2023. arXiv
Qingqing Zhao, Yao Lu, Moo Jin Kim, Zipeng Fu, Zhuoyang Zhang, Yecheng Wu, Zhaoshuo Li, Qianli Ma, Song Han, Chelsea Finn, Ankur Handa, Ming-Yu Liu, Donglai Xiang, Gordon Wetzstein, Tsung-Yi Lin. CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models. 2025. arXiv
Linqing Zhong, Yi Liu, Yifei Wei, Ziyu Xiong, Maoqing Yao, Si Liu, Guanghui Ren. ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Models. arXiv preprint arXiv:2601.11404, 2026. arXiv
Binbin Ji, Siddharth Agrawal, Qiance Tang, Yvonne Wu. Enhancing Spatial Reasoning in Vision-Language Models via Chain-of-Thought Prompting and Reinforcement Learning. arXiv preprint arXiv:2507.13362, 2025. arXiv
Damiano Marsili, Rohun Agrawal, Yisong Yue, Georgia Gkioxari. Visual agentic ai for spatial reasoning with a dynamic api. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Jianing Yang, Xuweiyi Chen, Shengyi Qian, Nikhil Madaan, Madhavan Iyengar, David F Fouhey, Joyce Chai. Llm-grounder: Open-vocabulary 3d visual grounding with large language model as an agent. 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024.
Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, Yonatan Bisk, Adam Trischler, Matthew Hausknecht. ALFWorld: Aligning Text and Embodied Environments for Interactive Learning. Proceedings of the International Conference on Learning Representations (ICLR), 2021.
Xavier Puig, Kevin Ra, Marko Boben, Jiaman Li, Tingwu Wang, Sanja Fidler, Antonio Torralba. VirtualHome: Simulating Household Activities via Programs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Huanyu Zhang, Chengzu Li, Wenshan Wu, Shaoguang Mao, Yifan Zhang, Haochen Tian, Ivan Vulić, Zhang Zhang, Liang Wang, Tieniu Tan, Furu Wei. Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes. 2025. arXiv
Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Joseph Dabis, Chelsea Finn, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Jasmine Hsu, Julian Ibarz, Brian Ichter, Alex Irpan, Tomas Jackson, Sally Jesmonth, Nikhil J Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Isabel Leal, Kuang-Huei Lee, Sergey Levine, Yao Lu, Utsav Malla, Deeksha Manjunath, Igor Mordatch, Ofir Nachum, Carolina Parada, Jodilyn Peralta, Emily Perez, Karl Pertsch, Jornell Quiambao, Kanishka Rao, Michael Ryoo, Grecia Salazar, Pannag Sanketi, Kevin Sayed, Jaspiar Singh, Sumedh Sontakke, Austin Stone, Clayton Tan, Huong Tran, Vincent Vanhoucke, Steve Vega, Quan Vuong, Fei Xia, Ted Xiao, Peng Xu, Sichun Xu, Tianhe Yu, Brianna Zitkovich. RT-1: Robotics Transformer for Real-World Control at Scale. 2023. arXiv
Seokju Cho, Ryo Hachiuma, Abhishek Badki, Hang Su, Byung-Kwan Lee, Chan Hee Song, Sifei Liu, Subhashree Radhakrishnan, Seungryong Kim, Yu-Chiang Frank Wang, Min-Hung Chen. SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning. arXiv preprint arXiv:2606.13673, 2026. arXiv
Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, Pierre Sermanet, Noah Brown, Tomas Jackson, Linda Luu, Sergey Levine, Karol Hausman, Brian Ichter. Inner Monologue: Embodied Reasoning through Planning with Language Models. 2022. arXiv
Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, Animesh Garg. Progprompt: Generating situated robot task plans using large language models. 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023.
Zhutian Yang, Caelan Garrett, Dieter Fox, Tomás Lozano-Pérez, Leslie Pack Kaelbling. Guiding Long-Horizon Task and Motion Planning with Vision Language Models. 2024. arXiv
Yongchao Chen, Jacob Arkin, Charles Dawson, Yang Zhang, Nicholas Roy, Chuchu Fan. AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkers. 2024. arXiv
Vineet Bhat, Ali Umut Kaypak, Prashanth Krishnamurthy, Ramesh Karri, Farshad Khorrami. Grounding LLMs For Robot Task Planning Using Closed-loop State Feedback. 2024. arXiv
Yushi Hu, Weijia Shi, Xingyu Fu, Dan Roth, Mari Ostendorf, Luke Zettlemoyer, Noah A Smith, Ranjay Krishna. Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models. 2024. arXiv
Ziyang Xiao, Dongxiang Zhang, Xiongwei Han, Xiaojin Fu, Wing Yin Yu, Tao Zhong, Sai Wu, Yuan Wang, Jianwei Yin, Gang Chen. Enhancing llm reasoning via vision-augmented prompting. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Changye Li, Meng Lu, Yi Wu, Ligeng Zhu. Perceive, Interact, Reason: Building Tool-Augmented Visual Agents for Spatial Reasoning. arXiv preprint arXiv:2606.12830, 2026. arXiv
Bo Liu, Yuqian Jiang, Xiaohan Zhang, Qiang Liu, Shiqi Zhang, Joydeep Biswas, Peter Stone. LLM+P: Empowering Large Language Models with Optimal Planning Proficiency. 2023. arXiv
Zhun Yang, Adam Ishay, Joohyung Lee. Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text. 2023. arXiv
Ruibo Liu, Jason Wei, Shixiang Shane Gu, Te-Yen Wu, Soroush Vosoughi, Claire Cui, Denny Zhou, Andrew M Dai. Mind's eye: Grounded language model reasoning through simulation. arXiv preprint arXiv:2210.05359, 2022. arXiv
Zhun Yang, Adam Ishay, Joohyung Lee. NeurASP: Embracing Neural Networks into Answer Set Programming. 2023. arXiv
Tanawan Premsri, Parisa Kordjamshidi. Neuro-symbolic Training for Reasoning over Spatial Language. Findings of the Association for Computational Linguistics: NAACL 2025, 2025. DOILink
Mingcong Lei, Yiming Zhao, Ge Wang, Zhixin Mai, Shuguang Cui, Yatong Han, Jinke Ren. STMA: A spatio-temporal memory agent for long-horizon embodied task planning. arXiv preprint arXiv:2502.10177, 2025. arXiv
Weizheng Wang, Ike Obi, Byung-Cheol Min. Multi-Agent LLM Actor-Critic Framework for Social Robot Navigation. 2025. arXiv
Antoni Rosinol, Arjun Gupta, Marcus Abate, Jingnan Shi, Luca Carlone. 3D dynamic scene graphs: Actionable spatial perception with places, objects, and humans. arXiv preprint arXiv:2002.06289, 2020. arXiv
Zhiyu Li, Shichao Song, Chenyang Xi, Hanyu Wang, Chen Tang, Simin Niu, Ding Chen, Jiawei Yang, Chunyu Li, Qingchen Yu, et al.. Memos: A memory os for ai system. arXiv preprint arXiv:2507.03724, 2025. arXiv
Abrar Anwar, John Welsh, Joydeep Biswas, Soha Pouya, Yan Chang. Remembr: Building and reasoning over long-horizon spatio-temporal memory for robot navigation. 2025 IEEE International Conference on Robotics and Automation (ICRA), 2025.
Xingyu Tan, Xiaoyang Wang, Qing Liu, Xiwei Xu, Xin Yuan, Liming Zhu, Wenjie Zhang. MemoTime: Memory-Augmented Temporal Knowledge Graph Enhanced Large Language Model Reasoning. arXiv preprint arXiv:2510.13614, 2025. arXiv
Bingshuai Liu, Chenyang Lyu, Zijun Min, Zhanyu Wang, Jinsong Su, Longyue Wang. Retrieval-augmented multi-modal chain-of-thoughts reasoning for large language models. arXiv preprint arXiv:2312.01714, 2023. arXiv
Nathan Hughes, Yun Chang, Luca Carlone. Hydra: A real-time spatial perception system for 3D scene graph construction and optimization. arXiv preprint arXiv:2201.13360, 2022. arXiv
Qiao Gu, Ali Kuwajerwala, Sacha Morin, Krishna Murthy Jatavallabhula, Bipasha Sen, Aditya Agarwal, Corban Rivera, William Paul, Kirsty Ellis, Rama Chellappa, et al.. Conceptgraphs: Open-vocabulary 3d scene graphs for perception and planning. 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024.
Krishan Rana, Jesse Haviland, Sourav Garg, Jad Abou-Chakra, Ian Reid, Niko Suenderhauf. Sayplan: Grounding large language models using 3d scene graphs for scalable robot task planning. arXiv preprint arXiv:2307.06135, 2023. arXiv
Quanting Xie, So Yeon Min, Pengliang Ji, Yue Yang, Tianyi Zhang, Kedi Xu, Aarav Bajaj, Ruslan Salakhutdinov, Matthew Johnson-Roberson, Yonatan Bisk. Embodied-RAG: General non-parametric embodied memory for retrieval and generation. arXiv preprint arXiv:2409.18313, 2024. arXiv
Mingcong Lei, Honghao Cai, Zezhou Cui, Liangchen Tan, Junkun Hong, Gehan Hu, Shuangyu Zhu, Yimou Wu, Shaohan Jiang, Ge Wang, et al.. RoboMemory: A Brain-inspired Multi-memory Agentic Framework for Lifelong Learning in Physical Embodied Systems. NeurIPS 2025 Workshop on Space in Vision, Language, and Embodied AI, 2025.
Yuncong Yang, Han Yang, Jiachen Zhou, Peihao Chen, Hongxin Zhang, Yilun Du, Chuang Gan. 3D-mem: 3D scene memory for embodied exploration and reasoning. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Wenbo Hu, Yining Hong, Yanjun Wang, Leison Gao, Zibu Wei, Xingcheng Yao, Nanyun Peng, Yonatan Bitton, Idan Szpektor, Kai-Wei Chang. 3DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Model. arXiv preprint arXiv:2505.22657, 2025. arXiv
Zuntao Liu, Yi Du, Taimeng Fu, Shaoshu Su, Cherie Ho, Chen Wang. Vision-Language Memory for Spatial Reasoning. arXiv preprint arXiv:2511.20644, 2025. arXiv
Zhongyi Cai, Yi Du, Chen Wang, Yu Kong. Vision to Geometry: 3D Spatial Memory for Sequential Embodied MLLM Reasoning and Exploration. arXiv preprint arXiv:2512.02458, 2025. arXiv
Arjun Majumdar, Anurag Ajay, Xiaohan Zhang, Pranav Putta, Sriram Yenamandra, Mikael Henaff, Sneha Silwal, Paul Mcvay, Oleksandr Maksymets, Sergio Arnaud, et al.. Openeqa: Embodied question answering in the era of foundation models. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Ziyang Gong, Wenhao Li, Oliver Ma, Songyuan Li, Zhaokai Wang, Songyuan Li, Jiayi Ji, Xue Yang, Gen Luo, Junchi Yan, Rongrong Ji. SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligence. 2025. arXiv
Xinmiao Huang, Qisong He, Zhenglin Huang, Boxuan Wang, Zhuoyun Li, Guangliang Cheng, Yi Dong, Xiaowei Huang. Spatial-DISE: A Unified Benchmark for Evaluating Spatial Reasoning in Vision-Language Models. arXiv preprint arXiv:2510.13394, 2025. arXiv
Weichen Zhang, Zile Zhou, Xin Zeng, Xuchen Liu, Jianjie Fang, Chen Gao, Yong Li, Jinqiang Cui, Xinlei Chen, Xiao-Ping Zhang. Open3D-VQA: A Benchmark for Comprehensive Spatial Reasoning with Multimodal Large Language Model in Open Space. arXiv preprint arXiv:2503.11094, 2025. arXiv
Yufan Mao, Hanjing Ye, Wenlong Dong, Chengjie Zhang, Hong Zhang. Meta-Memory: Retrieving and Integrating Semantic-Spatial Memories for Robot Spatial Reasoning. arXiv preprint arXiv:2509.20754, 2025. arXiv
Yuecheng Liu, Dafeng Chi, Shiguang Wu, Zhanguang Zhang, Yaochen Hu, Lingfeng Zhang, Yingxue Zhang, Shuang Wu, Tongtong Cao, Guowei Huang, et al.. SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning. arXiv preprint arXiv:2501.10074, 2025. arXiv
Jiaqi Chen, Bingqian Lin, Ran Xu, Zhenhua Chai, Xiaodan Liang, Kwan-Yee Wong. Mapgpt: Map-guided prompting with adaptive path planning for vision-and-language navigation. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024.
Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, Shunyu Yao. Reflexion: Language agents with verbal reinforcement learning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Zihao Wang, Shaofei Cai, Guanzhou Chen, Anji Liu, Xiaojian Ma, Yitao Liang. Describe, explain, plan and select: Interactive planning with large language models enables open-world multi-task agents. arXiv preprint arXiv:2302.01560, 2023. arXiv
Delong Chen, Theo Moutakanni, Willy Chung, Yejin Bang, Ziwei Ji, Allen Bolourchi, Pascale Fung. Planning with Reasoning using Vision Language World Model. arXiv preprint arXiv:2509.02722, 2025. arXiv
Zhao Mandi, Shreeya Jain, Shuran Song. Roco: Dialectic multi-robot collaboration with large language models. 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024.
Ceyao Zhang, Kaijie Yang, Siyi Hu, Zihao Wang, Guanghe Li, Yihang Sun, Cheng Zhang, Zhaowei Zhang, Anji Liu, Song-Chun Zhu, et al.. Proagent: building proactive cooperative agents with large language models. Proceedings of the AAAI Conference on Artificial Intelligence, 2024.
Octo Model Team, Dibya Ghosh, Homer Walke, Karl Pertsch, Kevin Black, Oier Mees, Sudeep Dasari, Joey Hejna, Tobias Kreiman, Charles Xu, et al.. Octo: An open-source generalist robot policy. arXiv preprint arXiv:2405.12213, 2024. arXiv
Yi Yang, Zhihong Liu, Siqi Kou, Yiyang Chen, Yanzhe Hu, Jianbo Zhou, Boyuan Zhao, Zhijie Wei, Xiao Xia, Xueqi Li, Pengfei Liu, Zhijie Deng. World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis. arXiv preprint arXiv:2606.05979, 2026. arXiv
Konstantinos Bousmalis, Giulia Vezzani, Dushyant Rao, Coline Devin, Alex X Lee, Maria Bauzá, Todor Davchev, Yuxiang Zhou, Agrim Gupta, Akhil Raju, et al.. Robocat: A self-improving generalist agent for robotic manipulation. arXiv preprint arXiv:2306.11706, 2023. arXiv
Wufei Ma, Haoyu Chen, Guofeng Zhang, Yu-Cheng Chou, Jieneng Chen, Celso de Melo, Alan Yuille. 3dsrbench: A comprehensive 3d spatial reasoning benchmark. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Nianchen Deng, Lixin Gu, Shenglong Ye, Yinan He, Zhe Chen, Songze Li, Haomin Wang, Xingguang Wei, Tianshuo Yang, Min Dou, et al.. InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models. arXiv preprint arXiv:2506.18385, 2025. arXiv
Xingrui Wang, Wufei Ma, Tiezheng Zhang, Celso M de Melo, Jieneng Chen, Alan Yuille. Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Mutimodal Models. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Chun-Hsiao Yeh, Chenyu Wang, Shengbang Tong, Ta-Ying Cheng, Ruoyu Wang, Tianzhe Chu, Yuexiang Zhai, Yubei Chen, Shenghua Gao, Yi Ma. Seeing from another perspective: Evaluating multi-view understanding in mllms. arXiv preprint arXiv:2504.15280, 2025. arXiv
Mengfei Du, Binhao Wu, Zejun Li, Xuan-Jing Huang, Zhongyu Wei. Embspatial-bench: Benchmarking spatial understanding for embodied tasks with large vision-language models. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2024.
Sihan Yang, Runsen Xu, Yiman Xie, Sizhe Yang, Mo Li, Jingli Lin, Chenming Zhu, Xiaochen Chen, Haodong Duan, Xiangyu Yue, et al.. MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence. arXiv preprint arXiv:2505.23764, 2025. arXiv
Shijie Zhou, Alexander Vilesov, Xuehai He, Ziyu Wan, Shuwang Zhang, Aditya Nagachandra, Di Chang, Dongdong Chen, Xin Eric Wang, Achuta Kadambi. Vlm4d: Towards spatiotemporal awareness in vision language models. Proceedings of the IEEE/CVF international conference on computer vision, 2025.
Yun Li, Yiming Zhang, Tao Lin, XiangRui Liu, Wenxiao Cai, Zheng Liu, Bo Zhao. Sti-bench: Are mllms ready for precise spatial-temporal world understanding?. arXiv preprint arXiv:2503.23765, 2025. arXiv
Ziang Zhang, Zehan Wang, Guanghao Zhang, Weilong Dai, Yan Xia, Ziang Yan, Minjie Hong, Zhou Zhao. DSI-Bench: A Benchmark for Dynamic Spatial Intelligence. arXiv preprint arXiv:2510.18873, 2025. arXiv
Ruining Li, Chuanxia Zheng, Christian Rupprecht, Andrea Vedaldi. Dragapart: Learning a part-level motion prior for articulated objects. ECCV, 2024.
Ruining Li, Chuanxia Zheng, Christian Rupprecht, Andrea Vedaldi. Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamics. Proceedings of theInternational Conference on Computer Vision (ICCV), 2025.
Aditya Vora, Sauradip Nag, Hao Zhang. Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization. arXiv preprint arXiv:2502.07278, 2025. arXiv
Ruijie Lu, Yu Liu, Jiaxiang Tang, Junfeng Ni, Yuxiang Wang, Diwen Wan, Gang Zeng, Yixin Chen, Siyuan Huang. Dreamart: Generating interactable articulated objects from a single image. arXiv preprint arXiv:2507.05763, 2025. arXiv
Shoubin Yu, Yue Zhang, Zun Wang, Jaehong Yoon, Huaxiu Yao, Mingyu Ding, Mohit Bansal. When and how much to imagine: Adaptive test-time scaling with world models for visual spatial reasoning. arXiv preprint arXiv:2602.08236, 2026. arXiv
Meng Cao, Xingyu Li, Xue Liu, Ian Reid, Xiaodan Liang. SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery. arXiv preprint arXiv:2512.07733, 2025. arXiv
Siyuan Zhou, Yilun Du, Yuncong Yang, Lei Han, Peihao Chen, Dit-Yan Yeung, Chuang Gan. Learning 3D Persistent Embodied World Models. arXiv preprint arXiv:2505.05495, 2025. arXiv
Joel Jang, Seonghyeon Ye, Zongyu Lin, Jiannan Xiang, Johan Bjorck, Yu Fang, Fengyuan Hu, Spencer Huang, Kaushil Kundalia, Yen-Chen Lin, et al.. DreamGen: Unlocking Generalization in Robot Learning through Video World Models. arXiv preprint arXiv:2505.12705, 2025. arXiv
Kangrui Wang, Pingyue Zhang, Zihan Wang, Yaning Gao, Linjie Li, Qineng Wang, Hanyang Chen, Yiping Lu, Zhengyuan Yang, Lijuan Wang, Ranjay Krishna, Jiajun Wu, Li Fei-Fei, Yejin Choi, Manling Li. VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents. Advances in Neural Information Processing Systems (NeurIPS), 2025.
Zhangquan Chen, Manyuan Zhang, Xinlei Yu, Xufang Luo, Mingze Sun, Zihao Pan, Xiang An, Yan Feng, Peng Pei, Xunliang Cai, Ruqi Huang. Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views. arXiv preprint arXiv:2510.18632, 2025. arXiv
Saurav Jha, M. Jehanzeb Mirza, Wei Lin, Shiqi Yang, Sarath Chandar. Probing the Effectiveness of World Models for Spatial Reasoning through Test-time Scaling. arXiv preprint arXiv:2512.05809, 2025. arXiv
Ningwei Xie, Zizi Tian, Lei Yang, Xiao-Ping Zhang, Meng Guo, Jie Li. From 2D to 3D Cognition: A Brief Survey of General World Models. arXiv preprint arXiv:2506.20134, 2025. arXiv
Runjia Li, Philip Torr, Andrea Vedaldi, Tomas Jakab. VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory. arXiv preprint arXiv:2506.18903, 2025. arXiv
Nate Gillman, Charles Herrmann, Michael Freeman, Daksh Aggarwal, Evan Luo, Deqing Sun, Chen Sun. Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signals. 2025. arXiv
Wanyue Zhang, Wenxiang Wu, Wang Xu, Jiaxin Luo, Helu Zhi, Yibin Huang, Shuo Ren, Zitao Liu, Jiajun Zhang. World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning. arXiv preprint arXiv:2604.26934, 2026. arXiv
Baining Zhao, Ziyou Wang, Jianjie Fang, Chen Gao, Fanhang Man, Jinqiang Cui, Xin Wang, Xinlei Chen, Yong Li, Wenwu Zhu. Embodied-r: Collaborative framework for activating embodied spatial reasoning in foundation models via reinforcement learning. Proceedings of the 33rd ACM International Conference on Multimedia, 2025.
Anoop Cherian, Radu Corcodel, Siddarth Jain, Diego Romeres. LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Engines. Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), 2026.
Yang Jin, Jun Lv, Shuqiang Jiang, Cewu Lu. Diffgen: Robot demonstration generation via differentiable physics simulation, differentiable rendering, and vision-language model. arXiv preprint arXiv:2405.07309, 2024. arXiv
Weijie Zhou, Manli Tao, Chaoyang Zhao, Haiyun Guo, Honghui Dong, Ming Tang, Jinqiao Wang. Physvlm: Enabling visual language models to understand robotic physical reachability. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Jingquan Wang, Andrew Negrut, Harry Zhang, Khailanii Slaton, Shu Wang, Radu Serban, Jinlong Wu, Dan Negrut. Chronollm: Customizing language models for physics-based simulation code generation. arXiv preprint arXiv:2508.13975, 2025. arXiv
Yunzhi Zhang, Zizhang Li, Matt Zhou, Shangzhe Wu, Jiajun Wu. The scene language: Representing scenes with programs, words, and embeddings. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Daixun Li, Yusi Zhang, Mingxiang Cao, Donglai Liu, Weiying Xie, Tianlin Hui, Lunkai Lin, Zhiqiang Xie, Yunsong Li. Towards Long-Horizon Vision-Language-Action System: Reasoning, Acting and Memory. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Hantao Zhang, Jingyang Liu, Ed Li. See it. Say it. Sorted: Agentic System for Compositional Diagram Generation. arXiv preprint arXiv:2508.15222, 2025. arXiv
Bui Duc Manh, Soumyaratna Debnath, Zetong Zhang, Shriram Damodaran, Arvind Kumar, Yueyi Zhang, Lu Mi, Erik Cambria, Lin Wang. Mind meets space: Rethinking agentic spatial intelligence from a neuroscience-inspired perspective. arXiv preprint arXiv:2509.09154, 2025. arXiv
Hyunjun Kim, Sooyoung Ryu. DrawingBench: Evaluating Spatial Reasoning and UI Interaction Capabilities of Large Language Models through Mouse-Based Drawing Tasks. arXiv preprint arXiv:2512.01174, 2025. arXiv
Eric Kolve, Roozbeh Mottaghi, Winson Han, Eli VanderBilt, Luca Weihs, Alvaro Herrasti, Daniel Gordon, Yuke Zhu, Abhinav Gupta, Ali Farhadi. AI2-THOR: An Interactive 3D Environment for Visual AI. arXiv preprint arXiv:1712.05474, 2017. arXiv
Florian Bordes, Quentin Garrido, Justine T Kao, Adina Williams, Michael Rabbat, Emmanuel Dupoux. IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environments. arXiv preprint arXiv:2506.09849, 2025. arXiv
Luis S Piloto, Ari Weinstein, Peter Battaglia, Matthew Botvinick. Intuitive physics learning in a deep-learning model inspired by developmental psychology. Nature human behaviour, 2022.
Saman Motamed, Laura Culp, Kevin Swersky, Priyank Jaini, Robert Geirhos. Do generative video models understand physical principles?. arXiv preprint arXiv:2501.09038, 2025. arXiv
Philipp D. Siedler. SPhyR: Spatial-Physical Reasoning Benchmark on Material Distribution. arXiv preprint arXiv:2505.16048, 2025. arXiv
Nils Hoehing, Mayug Maniparambil, Ellen Rushe, Noel E O'Connor, Anthony Ventresque. Understanding Space Is Rocket Science--Only Top Reasoning Models Can Solve Spatial Understanding Tasks. arXiv preprint arXiv:2509.02175, 2025. arXiv
Michael Ogezi, Freda Shi. SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data. CoRR, 2025.
Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A Smith, Wei-Chiu Ma, Ranjay Krishna. Blink: Multimodal large language models can see but not perceive. European Conference on Computer Vision, 2024.
Kexin Tian, Jingrui Mao, Yunlong Zhang, Jiwan Jiang, Yang Zhou, Zhengzhong Tu. Nuscenes-spatialqa: A spatial understanding and reasoning benchmark for vision-language models in autonomous driving. arXiv preprint arXiv:2504.03164, 2025. arXiv
Jieyu Zhang, Le Xue, Linxin Song, Jun Wang, Weikai Huang, Manli Shu, An Yan, Zixian Ma, Juan Carlos Niebles, Silvio Savarese, Caiming Xiong, Zeyuan Chen, Ranjay Krishna, Ran Xu. ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models. CoRR, 2024.
Wei Liang, Yibiao Zhao, Yixin Zhu, Song-Chun Zhu. What Is Where: Inferring Containment Relations from Videos. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016, New York, NY, USA, 9-15 July 2016, 2016.
Xianda Guo, Ruijun Zhang, Yiqun Duan, Yuhang He, Dujun Nie, Wenke Huang, Chenming Zhang, Shuai Liu, Hao Zhao, Long Chen. SURDS: Benchmarking Spatial Understanding and Reasoning in Driving Scenarios with Vision Language Models. arXiv preprint arXiv:2411.13112, 2024. arXiv
Jinkai Li, Zhenliang Zhang, Lifeng Fan, Wei Wang. PureSpace: A Benchmark for Abstract Spatial Reasoning in Vision-Language Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026.
Arijit Ray, Jiafei Duan, Reuben Tan, Dina Bashkirova, Rose Hendrix, Kiana Ehsani, Aniruddha Kembhavi, Bryan A Plummer, Ranjay Krishna, Kuo-Hao Zeng, et al.. SAT: Spatial Aptitude Training for Multimodal Language Models. arXiv preprint arXiv:2412.07755, 2024. arXiv
Yuechen Xie, Xiaoyan Zhang, Yicheng Shan, Zhu Hao, Rui Tang, Rong Wei, Mingli Song, Yuanyu Wan, Jie Song. Spatialqa: A benchmark for evaluating spatial logical reasoning in vision-language models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026.
Ruiyuan Lyu, Jingli Lin, Tai Wang, Shuai Yang, Xiaohan Mao, Yilun Chen, Runsen Xu, Haifeng Huang, Chenming Zhu, Dahua Lin, et al.. Mmscan: A multi-modal 3d scene dataset with hierarchical grounded language annotations. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Emilia Szyma\ʼnska, Mihai Dusmanu, Jan-Willem Buurlage, Mahdi Rad, Marc Pollefeys. Space3d-bench: Spatial 3d question answering benchmark. European Conference on Computer Vision, 2024.
Zhenyu Chen, Ali Gholami, Matthias Nießner, Angel X Chang. Scan2cap: Context-aware dense captioning in rgb-d scans. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Weili Guan, Haoyu Zhang, Meng Liu, Qianlong Xiang, Yaowei Wang, Liqiang Nie. SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026.
Mohsen Gholami, Ahmad Rezaei, Zhou Weimin, Sitong Mao, Shunbo Zhou, Yong Zhang, Mohammad Akbari. Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes. arXiv preprint arXiv:2509.06266, 2025. arXiv
Haoning Wu, Xiao Huang, Yaohui Chen, Ya Zhang, Yanfeng Wang, Weidi Xie. SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence. arXiv preprint arXiv:2505.17012, 2025. arXiv
Chuang Gan, Jeremy Schwartz, Seth Alter, Damian Mrowca, Martin Schrimpf, James Traer, Julian De Freitas, Jonas Kubilius, Abhishek Bhandwaldar, Nick Haber, et al.. Threedworld: A platform for interactive multi-modal physical simulation. arXiv preprint arXiv:2007.04954, 2020. arXiv
Alexander Ku, Peter Anderson, Roma Patel, Eugene Ie, Jason Baldridge. Room-across-room: Multilingual vision-and-language navigation with dense spatiotemporal grounding. arXiv preprint arXiv:2010.07954, 2020. arXiv
William Peebles, Saining Xie. Scalable Diffusion Models with Transformers. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio. Generative adversarial nets. Advances in Neural Information Processing Systems (NeurIPS), 2014.
Han Zhang, Tao Xu, Hongsheng Li, Shaoting Zhang, Xiaogang Wang, Xiaolei Huang, Dimitris Metaxas. StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
Tao Xu, Pengchuan Zhang, Qiuyuan Huang, Han Zhang, Zhe Gan, Xiaolei Huang, Xiaodong He. AttnGAN: Fine-grained text to image generation with attentional generative adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Han Zhang, Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang. Cross-modal contrastive learning for text-to-image generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, Ilya Sutskever. Zero-shot text-to-image generation. Proceedings of the 38th International Conference on Machine Learning (ICML), 2021.
Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang M. Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, Yonghui Wu. Scaling autoregressive models for content-rich text-to-image generation. arXiv preprint arXiv:2206.10789, 2022. arXiv
Huiwen Chang, Han Zhang, Jarred Barber, AJ Maschinot, José Lezama, Lu Jiang, Ming-Hsuan Yang, Kevin Murphy, William T. Freeman, Michael Rubinstein, Yuanzhen Li, Dilip Krishnan. Muse: Text-to-image generation via masked generative transformers. arXiv preprint arXiv:2301.00704, 2023. arXiv
Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, Mark Chen. GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models. Proceedings of the International Conference on Machine Learning (ICML), 2022.
Aditya Ramesh, et al.. Hierarchical Text-Conditional Image Generation with CLIP Latents. arXiv preprint arXiv:2204.06125, 2022. arXiv
Jonathan Ho, Tim Salimans. Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598, 2022. arXiv
Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel, Matt Le. Flow matching for generative modeling. International Conference on Learning Representations (ICLR), 2023.
Xingchao Liu, Chengyue Gong, Qiang Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow. International Conference on Learning Representations (ICLR), 2023.
Michael S. Albergo, Eric Vanden-Eijnden. Building normalizing flows with stochastic interpolants. International Conference on Learning Representations (ICLR), 2023.
Patrick Esser, et al.. Scaling Rectified Flow Transformers for High-Resolution Image Synthesis. arXiv preprint arXiv:2403.03206, 2024. arXiv
Tim Salimans, Jonathan Ho. Progressive distillation for fast sampling of diffusion models. International Conference on Learning Representations (ICLR), 2022.
Yang Song, Prafulla Dhariwal, Mark Chen, Ilya Sutskever. Consistency models. Proceedings of the 40th International Conference on Machine Learning (ICML), 2023.
Kaiwen Luo, et al.. Latent Consistency Models: Synthesizing High-Fidelity Images with Few-Step Inference. arXiv preprint arXiv:2310.04378, 2023. arXiv
OpenAI. The new ChatGPT Images is here. 2025. Link
Black Forest Labs. FLUX.2 [max] - Top-Tier Quality Image Generation. 2025. Link
Catherine Wah, Steve Branson, Peter Welinder, Pietro Perona, Serge Belongie. The Caltech-UCSD birds-200-2011 dataset. 2011.
Maria E. Nilsback, Andrew Zisserman. Automated flower classification over a large number of classes. Proceedings of the Indian Conference on Computer Vision, Graphics and Image Processing, 2008.
Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, Patrick Schramowski, Srivatsa R. Kundurthy, Katherine Crowson, Ludwig Schmidt, Robert Kaczmarczyk, Jenia Jitsev. LAION-5b: An open large-scale dataset for training next generation image-text models. Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2022.
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al.. Photorealistic text-to-image diffusion models with deep language understanding. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Eslam Mohamed Bakr, Pengzhan Sun, Xiaoqian Shen, Faizan Farooq Khan, Li Erran Li, Mohamed Elhoseiny. HRS-Bench: Holistic, reliable and scalable benchmark for text-to-image models. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Tony Lee, Michihiro Yasunaga, Chenlin Meng, Yifan Mai, Joon Sung Park, Agrim Gupta, Yunzhi Zhang, Deepak Narayanan, Hannah Benita Teufel, Marco Bellagente, Minguk Kang, Taesung Park, Jure Leskovec, Jun-Yan Zhu, Li Fei-Fei, Jiajun Wu, Stefano Ermon, Percy Liang. Holistic evaluation of text-to-image models. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Yushi Hu, Benlin Liu, Jungo Kasai, Yizhong Wang, Mari Ostendorf, Ranjay Krishna, Noah A. Smith. TIFA: Accurate and interpretable text-to-image faithfulness evaluation with question answering. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Dhruba Ghosh, Hannaneh Hajishirzi, Ludwig Schmidt. GenEval: An object-focused framework for evaluating text-to-image alignment. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Kaiyi Huang, Kaiyue Sun, Enze Xie, Zhenguo Li, Xihui Liu. T2I-CompBench: A comprehensive benchmark for open-world compositional text-to-image generation. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Yuwei Niu, Munan Ning, Mengren Zheng, Bin Lin, Peng Jin, Jiaqi Liao, Kunpeng Ning, Bin Zhu, Li Yuan. WISE: A world knowledge-informed semantic evaluation for text-to-image generation. arXiv preprint arXiv:2503.07265, 2025. arXiv
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, Sepp Hochreiter. GANs trained by a two time-scale update rule converge to a local nash equilibrium. Advances in Neural Information Processing Systems (NeurIPS), 2017.
Mehdi SM Sajjadi, Olivier Bachem, Mario Lucic, Olivier Bousquet, Sylvain Gelly. Assessing generative models via precision and recall. Advances in neural information processing systems, 2018.
Tuomas Kynkäänniemi, Tero Karras, Samuli Laine, Jaakko Lehtinen, Timo Aila. Improved precision and recall metric for assessing generative models. Advances in neural information processing systems, 2019.
Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, Yejin Choi. CLIPScore: A reference-free evaluation metric for image captioning. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021.
Xiaoshi Wu, Yiming Hao, Keqiang Sun, Yixiong Chen, Feng Zhu, Rui Zhao, Hongsheng Li. Human preference score v2: A solid benchmark for evaluating human preferences of text-to-image synthesis. arXiv preprint arXiv:2306.09341, 2023. arXiv
Jiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong, Qinkai Li, Ming Ding, Jie Tang, Yuxiao Dong. ImageReward: Learning and evaluating human preferences for text-to-image generation. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Yuval Kirstain, Adam Polyak, Uriel Singer, Shahbuland Matiana, Joe Penna, Omer Levy. Pick-a-Pic: An open dataset of user preferences for text-to-image generation. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Zhiqiu Lin, Deepak Pathak, Baiqi Li, Jiayao Li, Xide Xia, Graham Neubig, Pengchuan Zhang, Deva Ramanan. Evaluating text-to-visual generation with image-to-text generation. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Max Ku, Dongfu Jiang, Cong Wei, Xiang Yue, Wenhu Chen. VIEScore: Towards explainable metrics for conditional image synthesis evaluation. arXiv preprint arXiv:2312.14867, 2023. arXiv
Yujie Lu, Xianjun Yang, Xiujun Li, Xin Eric Wang, William Yang Wang. LLMScore: Unveiling the power of large language models in text-to-image synthesis evaluation. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Agneet Chatterjee, Gabriela Ben Melech Stan, Estelle Aflalo, Sayak Paul, Dhruba Ghosh, Tejas Gokhale, Ludwig Schmidt, Hannaneh Hajishirzi, Vasudev Lal, Chitta Baral, et al.. Getting it right: Improving spatial consistency in text-to-image models. European Conference on Computer Vision, 2024.
Omer Bar-Tal, Lior Yariv, Yaron Lipman, Tali Dekel. MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation. Proceedings of the International Conference on Machine Learning (ICML), 2023.
Lvmin Zhang, Anyi Rao, Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Chong Mou, et al.. T2I-Adapter: Learning Adapters to Dig Out More Controllable Ability for Text-to-Image Diffusion Models. arXiv preprint arXiv:2302.08453, 2023. arXiv
Guangcong Zheng, Xianpan Zhou, Xuewei Li, Zhongang Qi, Ying Shan, Xi Li. Layoutdiffusion: Controllable diffusion model for layout-to-image generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Leigang Qu, Shengqiong Wu, Hao Fei, Liqiang Nie, Tat-Seng Chua. Layoutllm-t2i: Eliciting layout guidance from llm for text-to-image generation. Proceedings of the 31st ACM International Conference on Multimedia, 2023.
Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jianwei Yang, Jianfeng Gao, Chunyuan Li, Yong Jae Lee. GLIGEN: Open-set grounded text-to-image generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Justin Johnson, Agrim Gupta, Li Fei-Fei. Image generation from scene graphs. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Dustin Podell, et al.. SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis. arXiv preprint arXiv:2307.01952, 2023. arXiv
Jinheng Xie, Yuexiang Li, Yawen Huang, Haozhe Liu, Wentian Zhang, Yefeng Zheng, Mike Zheng Shou. BoxDiff: Text-to-image synthesis with training-free box-constrained diffusion. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun Reddy Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang. Training-free structured diffusion guidance for compositional text-to-image synthesis. International Conference on Learning Representations (ICLR), 2023.
Weixi Feng, Wanrong Zhu, Tsu-jui Fu, Varun Jampani, Arjun Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang. Layoutgpt: Compositional visual planning and generation with large language models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Ling Yang, Zhaochen Yu, Chenlin Meng, Minkai Xu, Stefano Ermon, Bin Cui. Mastering text-to-image diffusion: Recaptioning, planning, and generating with multimodal LLMs. arXiv preprint arXiv:2401.11708, 2024. arXiv
Andreas Lugmayr, Martin Danelljan, Andres Romero, Fisher Yu, Radu Timofte, Luc Van Gool. RePaint: Inpainting using denoising diffusion probabilistic models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Omri Avrahami, Dani Lischinski, Ohad Fried. Blended diffusion for text-driven editing of natural images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Roman Suvorov, Elizaveta Logacheva, Anton Mashikhin, Anastasia Remizova, Arsenii Ashukha, Aleksei Silvestrov, Naejin Kong, Harshith Goka, Kiwoong Park, Victor Lempitsky. Resolution-robust large mask inpainting with Fourier convolutions. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022.
Amir Hertz, Ron Mokady, Jay Tenenbaum, Kfir Aberman, Yael Pritch, Daniel Cohen-or. Prompt-to-Prompt Image Editing with Cross-Attention Control. International Conference on Learning Representations (ICLR), 2023.
Bahjat Kawar, Shiran Zada, Oran Lang, Omer Tov, Huiwen Chang, Tali Dekel, Inbar Mosseri, Michal Irani. Imagic: Text-based real image editing with diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Ron Mokady, Amir Hertz, Kfir Aberman, Yael Pritch, Daniel Cohen-Or. Null-text inversion for editing real images using guided diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Tim Brooks, Aleksander Holynski, Alexei A. Efros. InstructPix2Pix: Learning to Follow Image Editing Instructions. 2023. arXiv
Kai Zhang, Lingbo Mo, Wenhu Chen, Huan Sun, Yu Su. MagicBrush: A manually annotated dataset for instruction-guided image editing. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Shelly Sheynin, Adam Polyak, Uriel Singer, Yuval Kirstain, Amit Zohar, Oron Ashual, Devi Parikh, Yaniv Taigman. Emu Edit: Precise image editing via recognition and generation tasks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Binxin Yang, Shuyang Gu, Bo Zhang, Ting Zhang, Xuejin Chen, Xiaoyan Sun, Dong Chen, Fang Wen. Paint by Example: Exemplar-based image editing with diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, Wei Yang. IP-Adapter: Text compatible image prompt adapter for text-to-image diffusion models. arXiv preprint arXiv:2308.06721, 2023. arXiv
Xingang Pan, Ayush Tewari, Thomas Leimkühler, Lingjie Liu, Abhimitra Meka, Christian Theobalt. Drag your GAN: Interactive point-based manipulation on the generative image manifold. ACM SIGGRAPH 2023 Conference Proceedings, 2023.
Yujun Shi, Chuhui Xue, Jun Hao Liew, Jiachun Pan, Hanshu Yan, Wenqing Zhang, Vincent Y.\ F. Tan, Song Bai. DragDiffusion: Harnessing diffusion models for interactive point-based image editing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Su Wang, Chitwan Saharia, Ceslee Montgomery, Jordi Pont-Tuset, Shai Noy, Stefano Pellegrini, Yasumasa Onoe, Sarah Laszlo, David J Fleet, Radu Soricut, et al.. Imagen editor and editbench: Advancing and evaluating text-guided image inpainting. 2023 ieee/cvf conference on computer vision and pattern recognition (cvpr), 2023.
Gowthami Somepalli, Vasu Singla, Micah Goldblum, Jonas Geiping, Tom Goldstein. Diffusion art or digital forgery? Investigating data replication in diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Shawn Shan, Jenna Cryan, Emily Wenger, Haitao Zheng, Rana Hanocka, Ben Y. Zhao. Glaze: Protecting artists from style mimicry by text-to-image models. Proceedings of the 32nd USENIX Security Symposium, 2023.
Jianfeng Xiang, Zelong Lv, Sicheng Xu, Yu Deng, Ruicheng Wang, Bowen Zhang, Dong Chen, Xin Tong, Jiaolong Yang. Structured 3d latents for scalable and versatile 3d generation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Jun Gao, Tianchang Shen, Zian Wang, Wenzheng Chen, Kangxue Yin, Daiqing Li, Or Litany, Zan Gojcic, Sanja Fidler. Get3d: A generative model of high quality 3d textured shapes learned from images. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Jiajun Wu, Chengkai Zhang, Tianfan Xue, Bill Freeman, Josh Tenenbaum. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2016.
Bo Yang, Hongkai Wen, Sen Wang, Ronald Clark, Andrew Markham, Niki Trigoni. 3d object reconstruction from a single depth view with adversarial learning. Proceedings of the IEEE international conference on computer vision workshops, 2017.
Jun-Yan Zhu, Zhoutong Zhang, Chengkai Zhang, Jiajun Wu, Antonio Torralba, Josh Tenenbaum, Bill Freeman. Visual object networks: Image generation with disentangled 3D representations. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2018.
Chen-Hsuan Lin, Chen Kong, Simon Lucey. Learning efficient point cloud generation for dense 3d object reconstruction. proceedings of the AAAI Conference on Artificial Intelligence, 2018.
Zitian Huang, Yikuan Yu, Jiawen Xu, Feng Ni, Xinyi Le. Pf-net: Point fractal network for 3d point cloud completion. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alexander C Berg. Transformation-grounded image generation network for novel 3d view synthesis. Proceedings of the ieee conference on computer vision and pattern recognition, 2017.
Thu Nguyen-Phuoc, Chuan Li, Lucas Theis, Christian Richardt, Yong-Liang Yang. Hologan: Unsupervised learning of 3d representations from natural images. Proceedings of the IEEE/CVF international conference on computer vision, 2019.
Eric R Chan, Marco Monteiro, Petr Kellnhofer, Jiajun Wu, Gordon Wetzstein. pi-gan: Periodic implicit generative adversarial networks for 3d-aware image synthesis. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Yu Deng, Jiaolong Yang, Jianfeng Xiang, Xin Tong. Gram: Generative radiance manifolds for 3d-aware image generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Michael Niemeyer, Andreas Geiger. Giraffe: Representing scenes as compositional generative neural feature fields. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Katja Schwarz, Yiyi Liao, Michael Niemeyer, Andreas Geiger. Graf: Generative radiance fields for 3d-aware image synthesis. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2020.
Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian, Zhuowen Tu, Lingjie Liu, Hao Su. Single-stage diffusion nerf: A unified approach to 3d generation and reconstruction. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
J Ryan Shue, Eric Ryan Chan, Ryan Po, Zachary Ankner, Jiajun Wu, Gordon Wetzstein. 3d neural field generation using triplane diffusion. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, et al.. Rodin: A generative model for sculpting 3d digital avatars using diffusion. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Christopher Wewer, Kevin Raj, Eddy Ilg, Bernt Schiele, Jan Eric Lenssen. latentsplat: Autoencoding variational gaussians for fast generalizable 3d reconstruction. European conference on computer vision, 2024.
Barbara Roessle, Norman Müller, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder, Angela Dai, Matthias Nießner. L3dg: Latent 3d gaussian diffusion. SIGGRAPH Asia 2024 Conference Papers, 2024.
Zi-Xin Zou, Zhipeng Yu, Yuan-Chen Guo, Yangguang Li, Ding Liang, Yan-Pei Cao, Song-Hai Zhang. Triplane meets gaussian splatting: Fast and generalizable single-view 3d reconstruction with transformers. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Ajay Jain, Ben Mildenhall, Jonathan T Barron, Pieter Abbeel, Ben Poole. Zero-shot text-guided object generation with dream fields. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Ben Poole, Ajay Jain, Jonathan T Barron, Ben Mildenhall. Dreamfusion: Text-to-3d using 2d diffusion. arXiv preprint arXiv:2209.14988, 2022. arXiv
Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, Tsung-Yi Lin. Magic3d: High-resolution text-to-3d content creation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CV), 2023.
Haochen Wang, Xiaodan Du, Jiahao Li, Raymond A Yeh, Greg Shakhnarovich. Score jacobian chaining: Lifting pretrained 2d diffusion models for 3d generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Taoran Yi, Jiemin Fang, Junjie Wang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Qi Tian, Xinggang Wang. Gaussiandreamer: Fast generation from text to 3d gaussians by bridging 2d and 3d diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, Jun Zhu. ProlificDreamer: High-fidelity and diverse text-to-3D generation with variational score distillation. Advances in Neural Information Processing Systems (NeurIPS), 2023.
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al.. Lora: Low-rank adaptation of large language models.. ICLR, 2022.
Amit Raj, Srinivas Kaza, Ben Poole, Michael Niemeyer, Nataniel Ruiz, Ben Mildenhall, Shiran Zada, Kfir Aberman, Michael Rubinstein, Jonathan Barron, et al.. Dreambooth3d: Subject-driven text-to-3d generation. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
Junyoung Seo, Wooseok Jang, Min-Seop Kwak, Hyeonsu Kim, Jaehoon Ko, Junho Kim, Jin-Hwa Kim, Jiyoung Lee, Seungryong Kim. Let 2d diffusion model know 3d-consistency for robust text-to-3d generation. arXiv preprint arXiv:2303.07937, 2023. arXiv
Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov, Sergey Zakharov, Carl Vondrick. Zero-1-to-3: Zero-shot one image to 3d object. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
Yichun Shi, Peng Wang, Jianglong Ye, Mai Long, Kejie Li, Xiao Yang. Mvdream: Multi-view diffusion for 3d generation. arXiv preprint arXiv:2308.16512, 2023. arXiv
Peng Wang, Yichun Shi. Imagedream: Image-prompt multi-view diffusion for 3d generation. arXiv preprint arXiv:2312.02201, 2023. arXiv
Guocheng Qian, Jinjie Mai, Abdullah Hamdi, Jian Ren, Aliaksandr Siarohin, Bing Li, Hsin-Ying Lee, Ivan Skorokhodov, Peter Wonka, Sergey Tulyakov, et al.. Magic123: One image to high-quality 3d object generation using both 2d and 3d diffusion priors. arXiv preprint arXiv:2306.17843, 2023. arXiv
Minghua Liu, Chao Xu, Haian Jin, Linghao Chen, Mukund Varma T, Zexiang Xu, Hao Su. One-2-3-45: Any single image to 3d mesh in 45 seconds without per-shape optimization. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Yukang Lin, Haonan Han, Chaoqun Gong, Zunnan Xu, Yachao Zhang, Xiu Li. Consistent123: One image to highly consistent 3d asset using case-aware diffusion priors. Proceedings of the 32nd ACM International Conference on Multimedia, 2024.
Hanzhe Hu, Zhizhuo Zhou, Varun Jampani, Shubham Tulsiani. Mvd-fusion: Single-view 3d via depth-consistent multi-view generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Ruiqi Gao, Aleksander Holynski, Philipp Henzler, Arthur Brussee, Ricardo Martin-Brualla, Pratul Srinivasan, Jonathan T Barron, Ben Poole. Cat3d: Create anything in 3d with multi-view diffusion models. arXiv preprint arXiv:2405.10314, 2024. arXiv
Chuanxia Zheng, Andrea Vedaldi. Free3d: Consistent novel view synthesis without 3d representation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Ruoxi Shi, Hansheng Chen, Zhuoyang Zhang, Minghua Liu, Chao Xu, Xinyue Wei, Linghao Chen, Chong Zeng, Hao Su. Zero123++: a single image to consistent multi-view diffusion base model. arXiv preprint arXiv:2310.15110, 2023. arXiv
Minghua Liu, Ruoxi Shi, Linghao Chen, Zhuoyang Zhang, Chao Xu, Xinyue Wei, Hansheng Chen, Chong Zeng, Jiayuan Gu, Hao Su. One-2-3-45++: Fast single image to 3d objects with consistent multi-view generation and 3d diffusion. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, Sai Bi. Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model. arXiv preprint arXiv:2311.06214, 2023. arXiv
Jiale Xu, Weihao Cheng, Yiming Gao, Xintao Wang, Shenghua Gao, Ying Shan. Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models. arXiv preprint arXiv:2404.07191, 2024. arXiv
Xuying Zhang, Yupeng Zhou, Kai Wang, Yikai Wang, Zhen Li, Shaohui Jiao, Daquan Zhou, Qibin Hou, Ming-Ming Cheng. Ar-1-to-3: Single image to consistent 3d object via next-view prediction. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, Ali Farhadi. Objaverse: A universe of annotated 3d objects. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Matt Deitke, Ruoshi Liu, Matthew Wallingford, Huong Ngo, Oscar Michel, Aditya Kusupati, Alan Fan, Christian Laforte, Vikram Voleti, Samir Yitzhak Gadre, et al.. Objaverse-xl: A universe of 10m+ 3d objects. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, Hao Tan. Lrm: Large reconstruction model for single image to 3d. arXiv preprint arXiv:2311.04400, 2023. arXiv
Jiaxiang Tang, Zhaoxi Chen, Xiaokang Chen, Tengfei Wang, Gang Zeng, Ziwei Liu. Lgm: Large multi-view gaussian model for high-resolution 3d content creation. European Conference on Computer Vision, 2024.
Zhengyi Wang, Yikai Wang, Yifei Chen, Chendong Xiang, Shuo Chen, Dajiang Yu, Chongxuan Li, Hang Su, Jun Zhu. Crm: Single image to 3d textured mesh with convolutional reconstruction model. European conference on computer vision, 2024.
Zhaoxi Chen, Jiaxiang Tang, Yuhao Dong, Ziang Cao, Fangzhou Hong, Yushi Lan, Tengfei Wang, Haozhe Xie, Tong Wu, Shunsuke Saito, et al.. 3dtopia-xl: Scaling high-quality 3d asset generation via primitive diffusion. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Biao Zhang, Jiapeng Tang, Matthias Niessner, Peter Wonka. 3dshape2vecset: A 3d shape representation for neural fields and generative diffusion models. ACM Transactions On Graphics (TOG), 2023.
Chenchen Ye, Lizi Liao, Fuli Feng, Wei Ji, Tat-Seng Chua. Structured and natural responses co-generation for conversational search. ACM SIGIR, 2022.
Yuanbo Yang, Jiahao Shao, Xinyang Li, Yujun Shen, Andreas Geiger, Yiyi Liao. Prometheus: 3d-aware latent diffusion models for feed-forward text-to-3d scene generation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Longwen Zhang, Ziyu Wang, Qixuan Zhang, Qiwei Qiu, Anqi Pang, Haoran Jiang, Wei Yang, Lan Xu, Jingyi Yu. Clay: A controllable large-scale generative model for creating high-quality 3d assets. ACM Transactions on Graphics (TOG), 2024.
Yiyang Shen, Kun Zhou, He Wang, Yin Yang, Tianjia Shao. High-fidelity 3D Object Generation from Single Image with RGBN-Volume Gaussian Reconstruction Model. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Tencent Hunyuan3D Team. Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation. 2024. arXiv
Angel X. Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, Fisher Yu. ShapeNet: An Information-Rich 3D Model Repository. 2015.
Laura Downs, Anthony Francis, Nate Koenig, Brandon Kinman, Ryan Hickman, Krista Reymann, Thomas B McHugh, Vincent Vanhoucke. Google scanned objects: A high-quality dataset of 3d scanned household items. 2022 International Conference on Robotics and Automation (ICRA), 2022.
Tong Wu, Jiarui Zhang, Xiao Fu, Yuxin Wang, Jiawei Ren, Liang Pan, Wayne Wu, Lei Yang, Jiaqi Wang, Chen Qian, et al.. Omniobject3d: Large-vocabulary 3d object dataset for realistic perception, reconstruction and generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Qi Zuo, Xiaodong Gu, Yuan Dong, Zhengyi Zhao, Weihao Yuan, Lingteng Qiu, Liefeng Bo, Zilong Dong. High-fidelity 3d textured shapes generation by sparse encoding and adversarial decoding. European Conference on Computer Vision, 2024.
Xiao Cai, Sitong Su, Jingkuan Song, Pengpeng Zeng, Ji Zhang, Qinhong Du, Mengqi Li, Heng Tao Shen, Lianli Gao. Gt23d-bench: A comprehensive general text-to-3d generation benchmark. arXiv preprint arXiv:2412.09997, 2024. arXiv
Yujie Zhang, Bingyang Cui, Qi Yang, Zhu Li, Yiling Xu. Benchmarking and learning multi-dimensional quality evaluator for text-to-3D generation. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Haohui Li, Bowen Qu, Wei Gao. T23D-QA: An Open Dataset and Benchmark for Text-driven 3D Generation Quality Assessment. Proceedings of the 33rd ACM International Conference on Multimedia, 2025.
Shalini Maiti, Lourdes Agapito, Filippos Kokkinos. Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objects. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Zixuan Huang, Mark Boss, Aaryaman Vasishta, James M Rehg, Varun Jampani. Spar3d: Stable point-aware reconstruction of 3d objects from single images. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Dmitry Tochilkin, David Pankratz, Zexiang Liu, Zixuan Huang, Adam Letts, Yangguang Li, Ding Liang, Christian Laforte, Varun Jampani, Yan-Pei Cao. TripoSR: Fast 3D object reconstruction from a single image. arXiv preprint arXiv:2403.02151, 2024. arXiv
Tencent Hunyuan3D Team. Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation. 2025. arXiv
Raphael Bensadoun, Tom Monnier, Yanir Kleiman, Filippos Kokkinos, Yawar Siddiqui, Mahendra Kariya, Omri Harosh, Roman Shapovalov, Benjamin Graham, Emilien Garreau, et al.. Meta 3d gen. arXiv preprint arXiv:2407.02599, 2024. arXiv
Team Hunyuan3D, Bowen Zhang, Chunchao Guo, Haolin Liu, Hongyu Yan, Huiwen Shi, Jingwei Huang, Junlin Yu, Kunhong Li, Penghao Wang, et al.. Hunyuan3d-omni: A unified framework for controllable generation of 3d assets. arXiv preprint arXiv:2509.21245, 2025. arXiv
Xinpeng Wang, Chandan Yeshwanth, Matthias Nießner. Sceneformer: Indoor scene generation with transformers. 2021 International Conference on 3D Vision (3DV), 2021.
Jiapeng Tang, Yinyu Nie, Lev Markhasin, Angela Dai, Justus Thies, Matthias Nießner. Diffuscene: Denoising diffusion models for generative indoor scene synthesis. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Fan-Yun Sun, Weiyu Liu, Siyi Gu, Dylan Lim, Goutam Bhat, Federico Tombari, Manling Li, Nick Haber, Jiajun Wu. Layoutvlm: Differentiable optimization of 3d layout via vision-language models. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Gege Gao, Weiyang Liu, Anpei Chen, Andreas Geiger, Bernhard Schölkopf. Graphdreamer: Compositional 3d scene synthesis from scene graphs. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Guangyao Zhai, Evin Pınar Örnek, Shun-Cheng Wu, Yan Di, Federico Tombari, Nassir Navab, Benjamin Busam. Commonscenes: Generating commonsense 3d indoor scenes with scene graph diffusion. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Guangyao Zhai, Evin Pınar Örnek, Dave Zhenyu Chen, Ruotong Liao, Yan Di, Nassir Navab, Federico Tombari, Benjamin Busam. Echoscene: Indoor scene generation via information echo over scene graph diffusion. European Conference on Computer Vision, 2024.
Chenguo Lin, Yadong Mu. Instructscene: Instruction-driven 3d indoor scene synthesis with semantic graph prior. arXiv preprint arXiv:2402.04717, 2024. arXiv
Jie Deng, Wenhao Chai, Junsheng Huang, Zhonghan Zhao, Qixuan Huang, Mingyan Gao, Jianshu Guo, Shengyu Hao, Wenhao Hu, Jenq-Neng Hwang, et al.. Citycraft: A real crafter for 3d city generation. arXiv preprint arXiv:2406.04983, 2024. arXiv
Alex Yu, Vickie Ye, Matthew Tancik, Angjoo Kanazawa. pixelnerf: Neural radiance fields from one or few images. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2021.
David Charatan, Sizhe Lester Li, Andrea Tagliasacchi, Vincent Sitzmann. pixelsplat: 3d gaussian splats from image pairs for scalable generalizable 3d reconstruction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Yuedong Chen, Haofei Xu, Chuanxia Zheng, Bohan Zhuang, Marc Pollefeys, Andreas Geiger, Tat-Jen Cham, Jianfei Cai. Mvsplat: Efficient 3d gaussian splatting from sparse multi-view images. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Yuedong Chen, Chuanxia Zheng, Haofei Xu, Bohan Zhuang, Andrea Vedaldi, Tat-Jen Cham, Jianfei Cai. MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Views. Neural Information Processing Systems (NeurIPS), 2024.
Haoran Li, Haolin Shi, Wenli Zhang, Wenjun Wu, Yong Liao, Lin Wang, Lik-hang Lee, Peng Yuan Zhou. Dreamscene: 3d gaussian-based text-to-3d scene generation via formation pattern sampling. European Conference on Computer Vision, 2024.
Katja Schwarz, Norman Müller, Peter Kontschieder. Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors. Proc. of the IEEE International Conf. on Computer Vision (ICCV) (ICCV), 2025.
Mehdi SM Sajjadi, Henning Meyer, Etienne Pot, Urs Bergmann, Klaus Greff, Noha Radwan, Suhani Vora, Mario Lučić, Daniel Duckworth, Alexey Dosovitskiy, et al.. Scene representation transformer: Geometry-free novel view synthesis through set-latent scene representations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Haian Jin, Hanwen Jiang, Hao Tan, Kai Zhang, Sai Bi, Tianyuan Zhang, Fujun Luan, Noah Snavely, Zexiang Xu. LVSM: A Large View Synthesis Model with Minimal 3D Inductive Bias. The Thirteenth International Conference on Learning Representations, 2025.
Jason J Yu, Fereshteh Forghani, Konstantinos G Derpanis, Marcus A Brubaker. Long-term photometric consistent novel view synthesis with diffusion models. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Jensen Jinghao Zhou, Hang Gao, Vikram Voleti, Aaryaman Vasishta, Chun-Han Yao, Mark Boss, Philip Torr, Christian Rupprecht, Varun Jampani. STABLE VIRTUAL CAMERA: Generative View Synthesis with Diffusion Models. arXiv preprint arXiv:2503.14489, 2025. arXiv
Xin Kong, Daniel Watson, Yannick Strümpler, Michael Niemeyer, Federico Tombari. CausNVS: Autoregressive Multi-view Diffusion for Flexible 3D Novel View Synthesis. arXiv preprint arXiv:2509.06579, 2025. arXiv
Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein, Bo Dai, Hongsheng Li, Ceyuan Yang. Cameractrl: Enabling camera control for text-to-video generation. arXiv preprint arXiv:2404.02101, 2024. arXiv
Zhouxia Wang, Ziyang Yuan, Xintao Wang, Yaowei Li, Tianshui Chen, Menghan Xia, Ping Luo, Ying Shan. Motionctrl: A unified and flexible motion controller for video generation. ACM SIGGRAPH 2024 Conference Papers, 2024.
Xuanchi Ren, Tianchang Shen, Jiahui Huang, Huan Ling, Yifan Lu, Merlin Nimier-David, Thomas Müller, Alexander Keller, Sanja Fidler, Jun Gao. GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025.
Rundi Wu, Ruiqi Gao, Ben Poole, Alex Trevithick, Changxi Zheng, Jonathan T Barron, Aleksander Holynski. Cat4d: Create anything in 4d with multi-view video diffusion models. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Daniel Watson, Saurabh Saxena, Lala Li, Andrea Tagliasacchi, David J Fleet. Controlling space and time with diffusion models. arXiv preprint arXiv:2407.07860, 2024. arXiv
Huan Fu, Bowen Cai, Lin Gao, Ling-Xiao Zhang, Jiaming Wang, Cao Li, Qixun Zeng, Chengyue Sun, Rongfei Jia, Binqiang Zhao, Dacheng Tao. 3D-FRONT: 3D Furnished Rooms with Layouts and Semantics. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Huan Fu, Rongfei Jia, Lin Gao, Mingming Gong, Binqiang Zhao, Steve Maybank, Dacheng Tao. 3D-FUTURE: 3D Furniture Shape with Texture. International Journal of Computer Vision, 2021.
Dani Valevski, Yaniv Leviathan, Moab Arar, Shlomi Fruchter. Diffusion models are real-time game engines. arXiv preprint arXiv:2408.14837, 2024. arXiv
Eloi Alonso, Adam Jelley, Vincent Micheli, Anssi Kanervisto, Amos Storkey, Tim Pearce, François Fleuret. Diffusion for World Modeling: Visual Details Matter in Atari. Thirty-eighth Conference on Neural Information Processing Systems, 2024. arXiv
World Labs. RTFM: A Real-Time Frame Model. r̆lhttps://www.worldlabs.ai/blog/rtfm, 2025.
Jiahui Zhang, Yuelei Li, Anpei Chen, Muyu Xu, Kunhao Liu, Jianyuan Wang, Xiao-Xiao Long, Hanxue Liang, Zexiang Xu, Hao Su, et al.. Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey. arXiv preprint arXiv:2507.14501, 2025. arXiv
Robert C Bolles, H Harlyn Baker, David H Marimont. Epipolar-plane image analysis: An approach to determining structure from motion. International journal of computer vision (IJCV), 1987.
Andrew W Fitzgibbon, Andrew Zisserman. Automatic camera recovery for closed or open image sequences. European conference on computer vision (ECCV), 1998.
Shimon Ullman. The interpretation of visual motion.. 1979.
Yasutaka Furukawa, Carlos Hernández, et al.. Multi-view stereo: A tutorial. Foundations and trends® in Computer Graphics and Vision, 2015.
Johannes L Schönberger, Enliang Zheng, Jan-Michael Frahm, Marc Pollefeys. Pixelwise view selection for unstructured multi-view stereo. European conference on computer vision, 2016.
Julian Chibane, Gerard Pons-Moll, et al.. Neural unsigned distance fields for implicit function learning. Advances in Neural Information Processing Systems (NeurIPS), 2020.
Zehao Yu, Songyou Peng, Michael Niemeyer, Torsten Sattler, Andreas Geiger. Monosdf: Exploring monocular geometric cues for neural implicit surface reconstruction. Advances in neural information processing systems (NeurIPS), 2022.
Songyou Peng, Michael Niemeyer, Lars Mescheder, Marc Pollefeys, Andreas Geiger. Convolutional occupancy networks. European Conference on Computer Vision (ECCV), 2020.
Zirui Wang, Shangzhe Wu, Weidi Xie, Min Chen, Victor Adrian Prisacariu. NeRF--: Neural radiance fields without known camera parameters. arXiv preprint arXiv:2102.07064, 2021. arXiv
Jonathan T Barron, Ben Mildenhall, Dor Verbin, Pratul P Srinivasan, Peter Hedman. Mip-nerf 360: Unbounded anti-aliased neural radiance fields. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2022.
Alex Yu, Ruilong Li, Matthew Tancik, Hao Li, Ren Ng, Angjoo Kanazawa. Plenoctrees for real-time rendering of neural radiance fields. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Dor Verbin, Peter Hedman, Ben Mildenhall, Todd Zickler, Jonathan T Barron, Pratul P Srinivasan. Ref-nerf: Structured view-dependent appearance for neural radiance fields. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Anpei Chen, Zexiang Xu, Andreas Geiger, Jingyi Yu, Hao Su. Tensorf: Tensorial radiance fields. European conference on computer vision (ECCV), 2022.
Michael Niemeyer, Jonathan T Barron, Ben Mildenhall, Mehdi SM Sajjadi, Andreas Geiger, Noha Radwan. Regnerf: Regularizing neural radiance fields for view synthesis from sparse inputs. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2022.
Barbara Roessle, Jonathan T Barron, Ben Mildenhall, Pratul P Srinivasan, Matthias Nießner. Dense depth priors for neural radiance fields from sparse input views. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2022.
Kangle Deng, Andrew Liu, Jun-Yan Zhu, Deva Ramanan. Depth-supervised nerf: Fewer views and faster training for free. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2022.
Qiangeng Xu, Zexiang Xu, Julien Philip, Sai Bi, Zhixin Shu, Kalyan Sunkavalli, Ulrich Neumann. Point-nerf: Point-based neural radiance fields. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Michael Oechsle, Songyou Peng, Andreas Geiger. Unisurf: Unifying neural implicit surfaces and radiance fields for multi-view reconstruction. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Luke Melas-Kyriazi, Iro Laina, Christian Rupprecht, Andrea Vedaldi. Realfusion: 360deg reconstruction of any object from a single image. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2023.
Gal Metzer, Elad Richardson, Or Patashnik, Raja Giryes, Daniel Cohen-Or. Latent-nerf for shape-guided generation of 3d shapes and textures. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2023.
Junshu Tang, Tengfei Wang, Bo Zhang, Ting Zhang, Ran Yi, Lizhuang Ma, Dong Chen. Make-it-3d: High-fidelity 3d creation from a single image with diffusion prior. Proceedings of the IEEE/CVF international conference on computer vision (ICCV), 2023.
Jaeyoung Chung, Jeongtaek Oh, Kyoung Mu Lee. Depth-regularized optimization for 3d gaussian splatting in few-shot images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao. 2d gaussian splatting for geometrically accurate radiance fields. ACM SIGGRAPH 2024 conference papers, 2024.
Antoine Guédon, Vincent Lepetit. Sugar: Surface-aligned gaussian splatting for efficient 3d mesh reconstruction and high-quality mesh rendering. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Fayao Liu, Chunhua Shen, Guosheng Lin, Ian Reid. Learning depth from single monocular images using deep convolutional neural fields. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2015.
Christopher B Choy, Danfei Xu, JunYoung Gwak, Kevin Chen, Silvio Savarese. 3d-r2n2: A unified approach for single and multi-view 3d object reconstruction. European conference on computer vision (ECCV), 2016.
Haoqiang Fan, Hao Su, Leonidas J Guibas. A point set generation network for 3d object reconstruction from a single image. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2017.
Georgia Gkioxari, Jitendra Malik, Justin Johnson. Mesh r-cnn. Proceedings of the IEEE/CVF international conference on computer vision (ICCV), 2019.
Mihai Dusmanu, Ignacio Rocco, Tomas Pajdla, Marc Pollefeys, Josef Sivic, Akihiko Torii, Torsten Sattler. D2-net: A trainable cnn for joint description and detection of local features. Proceedings of the ieee/cvf conference on computer vision and pattern recognition (CVPR), 2019.
Philipp Lindenberger, Paul-Edouard Sarlin, Marc Pollefeys. Lightglue: Local feature matching at light speed. Proceedings of the IEEE/CVF international conference on computer vision (ICCV), 2023.
Alex Kendall, Roberto Cipolla. Geometric loss functions for camera pose regression with deep learning. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2017.
Jure Žbontar, Yann LeCun. Stereo matching by training a convolutional neural network to compare image patches. Journal of Machine Learning Research, 2016.
Zhenggang Tang, Yuchen Fan, Dilin Wang, Hongyu Xu, Rakesh Ranjan, Alexander Schwing, Zhicheng Yan. MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Shangzhan Zhang, Jianyuan Wang, Yinghao Xu, Nan Xue, Christian Rupprecht, Xiaowei Zhou, Yujun Shen, Gordon Wetzstein. FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Views. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Vincent Sitzmann, Semon Rezchikov, Bill Freeman, Josh Tenenbaum, Fredo Durand. Light field networks: Neural scene representations with single-evaluation rendering. Advances in Neural Information Processing Systems (NeurIPS), 2021.
Mohammed Suhail, Carlos Esteves, Leonid Sigal, Ameesh Makadia. Light field neural rendering. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Mohammed Suhail, Carlos Esteves, Leonid Sigal, Ameesh Makadia. Generalizable patch-based neural rendering. European Conference on Computer Vision (ECCV), 2022.
Hanwen Jiang, Hao Tan, Peng Wang, Haian Jin, Yue Zhao, Sai Bi, Kai Zhang, Fujun Luan, Kalyan Sunkavalli, Qixing Huang, et al.. RayZer: A Self-supervised Large View Synthesis Model. International Conference on Computer Vision (ICCV), 2025.
Anpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang, Fanbo Xiang, Jingyi Yu, Hao Su. Mvsnerf: Fast generalizable radiance field reconstruction from multi-view stereo. Proceedings of the IEEE/CVF international conference on computer vision (ICCV), 2021.
Haofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu. Murf: Multi-baseline radiance fields. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Yuedong Chen, Haofei Xu, Qianyi Wu, Chuanxia Zheng, Tat-Jen Cham, Jianfei Cai. Explicit correspondence matching for generalizable neural radiance fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.
Yilun Du, Cameron Smith, Ayush Tewari, Vincent Sitzmann. Learning to render novel views from wide-baseline stereo pairs. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Stanislaw Szymanowicz, Chrisitian Rupprecht, Andrea Vedaldi. Splatter image: Ultra-fast single-view 3d reconstruction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Stanislaw Szymanowicz, Eldar Insafutdinov, Chuanxia Zheng, Dylan Campbell, João F Henriques, Christian Rupprecht, Andrea Vedaldi. Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Image. International Conference on 3D Vision (3DV), 2025.
Brandon Smart, Chuanxia Zheng, Iro Laina, Victor Adrian Prisacariu. Splatt3r: Zero-shot gaussian splatting from uncalibarated image pairs. arXiv preprint arXiv:2408.13912, 2024. arXiv
Kai Zhang, Sai Bi, Hao Tan, Yuanbo Xiangli, Nanxuan Zhao, Kalyan Sunkavalli, Zexiang Xu. Gs-lrm: Large reconstruction model for 3d gaussian splatting. European Conference on Computer Vision, 2024.
Botao Ye, Sifei Liu, Haofei Xu, Xueting Li, Marc Pollefeys, Ming-Hsuan Yang, Songyou Peng. No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images. International Conference on Learning Representations (ICLR), 2025.
Arash Vahdat, Francis Williams, Zan Gojcic, Or Litany, Sanja Fidler, Karsten Kreis, et al.. Lion: Latent point diffusion models for 3d shape generation. Advances in Neural Information Processing Systems (NeurIPS), 2022.
Zibo Zhao, Wen Liu, Xin Chen, Xianfang Zeng, Rui Wang, Pei Cheng, Bin Fu, Tao Chen, Gang Yu, Shenghua Gao. Michelangelo: Conditional 3d shape generation based on shape-image-text aligned latent representation. Advances in neural information processing systems (NeurIPS), 2023.
Xuanchi Ren, Jiahui Huang, Xiaohui Zeng, Ken Museth, Sanja Fidler, Francis Williams. Xcube: Large-scale 3d generative modeling using sparse voxel hierarchies. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2024.
Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch, Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram Voleti, Adam Letts, et al.. Stable video diffusion: Scaling latent video diffusion models to large datasets. arXiv preprint arXiv:2311.15127, 2023. arXiv
Kyle Sargent, Zizhang Li, Tanmay Shah, Charles Herrmann, Hong-Xing Yu, Yunzhi Zhang, Eric Ryan Chan, Dmitry Lagun, Li Fei-Fei, Deqing Sun, et al.. Zeronvs: Zero-shot 360-degree view synthesis from a single image. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Rundi Wu, Ben Mildenhall, Philipp Henzler, Keunhong Park, Ruiqi Gao, Daniel Watson, Pratul P Srinivasan, Dor Verbin, Jonathan T Barron, Ben Poole, et al.. Reconfusion: 3d reconstruction with diffusion priors. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2024.
Matthew Wallingford, Anand Bhattad, Aditya Kusupati, Vivek Ramanujan, Matt Deitke, Aniruddha Kembhavi, Roozbeh Mottaghi, Wei-Chiu Ma, Ali Farhadi. From an Image to a Scene: Learning to Imagine the World from a Million 360° Videos. Advances in Neural Information Processing Systems (NeurIPS), 2024.
Fangfu Liu, Wenqiang Sun, Hanyang Wang, Yikai Wang, Haowen Sun, Junliang Ye, Jun Zhang, Yueqi Duan. ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model. 2024. arXiv
Qihang Zhang, Shuangfei Zhai, Miguel Angel Bautista, Kevin Miao, Alexander Toshev, Joshua Susskind, Jiatao Gu. World-consistent Video Diffusion with Explicit 3D Modeling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Stanislaw Szymanowicz, Jason Y Zhang, Pratul Srinivasan, Ruiqi Gao, Arthur Brussee, Aleksander Holynski, Ricardo Martin-Brualla, Jonathan T Barron, Philipp Henzler. Bolt3D: Generating 3D Scenes in Seconds. International Conference on Computer Vision (ICCV), 2025.
Rui Li, Biao Zhang, Zhenyu Li, Federico Tombari, Peter Wonka. Lari: Layered ray intersections for single-view 3d geometric reasoning. arXiv preprint arXiv:2504.18424, 2025. arXiv
Hanwen Jiang, Zexiang Xu, Desai Xie, Ziwen Chen, Haian Jin, Fujun Luan, Zhixin Shu, Kai Zhang, Sai Bi, Xin Sun, et al.. Megasynth: Scaling up 3d scene reconstruction with synthesized data. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Desai Xie, Sai Bi, Zhixin Shu, Kai Zhang, Zexiang Xu, Yi Zhou, Sören Pirk, Arie Kaufman, Xin Sun, Hao Tan. Lrm-zero: Training large reconstruction models with synthesized data. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Ben Mildenhall, Pratul P. Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, Abhishek Kar. Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines. TOG, 2019.
Zhou Wang, Alan C Bovik, Hamid R Sheikh, Eero P Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 2004.
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Zhe Zhang, Rui Peng, Yuxi Hu, Ronggang Wang. Geomvsnet: Learning multi-view stereo with geometry perception. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Tri Dao. Flashattention-2: Faster attention with better parallelism and work partitioning. arXiv preprint arXiv:2307.08691, 2023. arXiv
Christopher May, Daniel Aliaga. CubeGAN: omnidirectional image synthesis using generative adversarial networks. Computer Graphics Forum, 2023.
Weicai Ye, Chenhao Ji, Zheng Chen, Junyao Gao, Xiaoshui Huang, Song-Hai Zhang, Wanli Ouyang, Tong He, Cairong Zhao, Guofeng Zhang. Diffpano: Scalable and consistent text to panorama generation with spherical epipolar-aware diffusion. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Xiancheng Sun, Mai Xu, Shengxi Li, Senmao Ma, Xin Deng, Lai Jiang, Gang Shen. Spherical Manifold Guided Diffusion Model for Panoramic Image Generation. IEEE Conference on Computer Vision and Pattern Recognition, 2025.
Jionghao Wang, Ziyu Chen, Jun Ling, Rong Xie, Li Song. 360-Degree Panorama Generation from Few Unregistered NFoV Images. Proceedings of the 31st ACM International Conference on Multimedia, 2023.
Tianhao Wu, Chuanxia Zheng, Tat-Jen Cham. PanoDiffusion: 360-degree Panorama Outpainting via Diffusion. International Conference on Learning Representations, 2024.
Hai Wang, Xiaoyu Xiang, Yuchen Fan, Jing-Hao Xue. Customizing 360-degree panoramas through text-to-image diffusion models. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024.
Cheng Zhang, Qianyi Wu, Camilo Cruz Gambardella, Xiaoshui Huang, Dinh Phung, Wanli Ouyang, Jianfei Cai. Taming stable diffusion for text to 360 panorama image generation. IEEE Conference on Computer Vision and Pattern Recognition, 2024.
Naofumi Akimoto, Yuhi Matsuo, Yoshimitsu Aoki. Diverse plausible 360-degree image outpainting for efficient 3dcg background creation. CVPR, 2022.
Zhuqiang Lu, Kun Hu, Chaoyue Wang, Lei Bai, Zhiyong Wang. Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generation. AAAI, 2024.
Dian Zheng, Cheng Zhang, Xiao-Ming Wu, Cao Li, Chengfei Lv, Jian-Fang Hu, Wei-Shi Zheng. Panorama generation from nfov image done right. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Nikolai Kalischek, Michael Oechsle, Fabian Manhardt, Philipp Henzler, Konrad Schindler, Federico Tombari. Cubediff: Repurposing diffusion-based image models for panorama generation. International Conference on Learning Representations, 2025.
Yukun Huang, Yanning Zhou, Jianan Wang, Kaiyi Huang, Xihui Liu. DreamCube: RGB-D Panorama Generation via Multi-plane Synchronization. International Conference on Computer Vision, 2025.
Jialu Li, Mohit Bansal. Panogen: Text-conditioned panoramic environment generation for vision-and-language navigation. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Qinsheng Zhang, Jiaming Song, Xun Huang, Yongxin Chen, Ming-Yu Liu. Diffcollage: Parallel generation of large content with diffusion models. IEEE Conference on Computer Vision and Pattern Recognition, 2023.
Aoming Liu, Zhong Li, Zhang Chen, Nannan Li, Yi Xu, Bryan A Plummer. PanoFree: Tuning-Free Holistic Multi-view Image Generation with Cross-View Self-guidance. European Conference on Computer Vision, 2024.
Minho Park, Taewoong Kang, Jooyeol Yun, Sungwon Hwang, Jaegul Choo. SphereDiff: Tuning-free Omnidirectional Panoramic Image and Video Generation via Spherical Latent Representation. arXiv:2504.14396, 2025. arXiv
Shitao Tang, Fuayng Zhang, Jiacheng Chen, Peng Wang, Furukawa Yasutaka. MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Hakan Çapuk, Andrew Bond, Muhammed Burak Kızıl, Emir Göçen, Erkut Erdem, Aykut Erdem. TanDiT: Tangent-Plane Diffusion Transformer for High-Quality 360-Degree Panorama Generation. arXiv preprint arXiv:2506.21681, 2025. arXiv
Qian Wang, Weiqi Li, Chong Mou, Xinhua Cheng, Jian Zhang. 360dvd: Controllable panorama video generation with 360-degree video diffusion model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Ke Xing, Hanwen Liang, Dejia Xu, Yuyang Yin, Konstantinos N Plataniotis, Yao Zhao, Yunchao Wei. Tip4gen: Text to immersive panorama 4d scene generation. Proceedings of the 33rd ACM International Conference on Multimedia, 2025.
Yifei Xia, Shuchen Weng, Siqi Yang, Jingqi Liu, Chengxuan Zhu, Minggui Teng, Zijian Jia, Han Jiang, Boxin Shi. PanoWan: Lifting Diffusion Video Generation Models to 360 $\$$$deg$\$ with Latitude/Longitude-aware Mechanisms. arXiv preprint arXiv:2505.22016, 2025. arXiv
Zeyu Dong, Yuyang Yin, Yuqi Li, Eric Li, Hao-Xiang Guo, Yikai Wang. Panolora: Bridging perspective and panoramic video generation with lora adaptation. arXiv preprint arXiv:2509.11092, 2025. arXiv
Jinxiu Liu, Shaoheng Lin, Yinxiao Li, Ming-Hsuan Yang. Dynamicscaler: Seamless and scalable video generation for panoramic scenes. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Rundong Luo, Matthew Wallingford, Ali Fahardi, Noah Snavely, Wei-Chiu Ma. Beyond the Frame: Generating 360$^∘$ Panoramic Videos from Perspective Videos. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2025.
Shreyas Kulkarni, Peng Yin, Sebastian Scherer. 360FusionNeRF: Panoramic Neural Radiance Fields with Joint Guidance. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023.
Changwoon Choi, Sang Min Kim, Young Min Kim. Balanced Spherical Grid for Egocentric View Synthesis. IEEE Conf. Comput. Vis. Pattern Recog., 2023.
Kai Gu, Thomas Maugey, Sebastian Knorr, Christine Guillemot. Omni-nerf: neural radiance field from 360 image captures. 2022 IEEE International Conference on Multimedia and Expo (ICME), 2022.
Suyoung Lee, Jaeyoung Chung, Jaeyoo Huh, Kyoung Mu Lee. ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splattings. Adv. Neural Inform. Process. Syst., 2024.
Letian Huang, Jiayang Bai, Jie Guo, Yuanqi Li, Yanwen Guo. On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategy. European Conference on Computer Vision (ECCV), 2024.
Longwei Li, Huajian Huang, Sai-Kit Yeung, Hui Cheng. OmniGS: Omnidirectional Gaussian Splatting for Fast Radiance Field Reconstruction using Omnidirectional Images. arXiv preprint arXiv:2404.03202, 2024. arXiv
Changha Shin, Woong Oh Cho, Seon Joo Kim. Seam360GS: Seamless 360° Gaussian Splatting from Real-World Omnidirectional Images. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2025.
Shuai Yang, Jing Tan, Mengchen Zhang, Tong Wu, Yixuan Li, Gordon Wetzstein, Ziwei Liu, Dahua Lin. Scene4U: Layered Panoramic Reconstruction for Hyper-Immersive Scene Generation. arXiv preprint arXiv:2408.13252, 2024. arXiv
Zhongqi Yang, Wenhang Ge, Yuqi Li, Jiaqi Chen, Haoyuan Li, Mengyin An, Fei Kang, Hua Xue, Baixin Xu, Yuyang Yin, et al.. Matrix-3d: Omnidirectional explorable 3d world generation. arXiv preprint arXiv:2508.08086, 2025. arXiv
HunyuanWorld Team, Zhenwei Wang, Yuhao Liu, Junta Wu, Zixiao Gu, Haoyuan Wang, Xuhui Zuo, Tianyu Huang, Wenhuan Li, Sheng Zhang, et al.. Hunyuanworld 1.0: Generating immersive, explorable, and interactive 3d worlds from words or pixels. arXiv:2507.21809, 2025. arXiv
Jia Zheng, Junfei Zhang, Jing Li, Rui Tang, Shenghua Gao, Zihan Zhou. Structured3d: A large photo-realistic dataset for structured 3d modeling. European Conference on Computer Vision, 2020.
Jianxiong Xiao, Krista A Ehinger, Aude Oliva, Antonio Torralba. Recognizing scene viewpoint using panoramic place representation. 2012 IEEE conference on computer vision and pattern recognition, 2012.
Alexander Veicht, Paul-Edouard Sarlin, Philipp Lindenberger, Marc Pollefeys. Geocalib: Learning single-image calibration with geometric optimization. European Conference on Computer Vision, 2024.
Hao Chen, Yuqi Hou, Chenyuan Qu, Irene Testini, Xiaohan Hong, Jianbo Jiao. 360+x: A Panoptic Multi-modal Scene Understanding Dataset. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Tewodros Habtegebrial, Christiano Gava, Marcel Rogge, Didier Stricker, Varun Jampani. Somsi: Spherical novel view synthesis with soft occlusion multi-sphere images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Huajian Huang, Changkun Liu, Yipeng Zhu, Hui Cheng, Tristan Braud, Sai-Kit Yeung. 360Loc: A Dataset and Benchmark for Omnidirectional Visual Localization with Cross-device Queries. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Zhaohui Wu, Yuanhan Zhang, Yuming Jiang, Ziqi Huang, Chenyang Si, Yinan Si, Qingyang Jin, Xinyuan Chen, Yaohui Wang, Yaohui Wang, et al.. Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels. International Conference on Machine Learning (ICML), 2024.
Thomas Unterthiner, Sjoerd van Steenkiste, Karol Kurach, Raphaël Marinier, Marcin Michalski, Sylvain Michalski. Towards Accurate Generative Models of Video: A New Metric & Challenges. arXiv preprint arXiv:1812.01717, 2018. arXiv
Ziqi Huang, Yinan He, Jiashuo Yu, Fan Zhang, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, Qingyang Jin, Nattapol Chanpaisit, et al.. VBench: Comprehensive Benchmark Suite for Video Generative Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Chen-Yang Zhu, Xin-Yao Liu, Kai Xu, Ren-Jiao Yi. A survey on 3D editing based on NeRF and 3DGS. Frontiers of Computer Science, 2026.
Chong Bao, Yinda Zhang, Bangbang Yang, Tianxing Fan, Zesong Yang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui. Sine: Semantic-driven image-based nerf editing with prior-guided editing field. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Umar Khalid, Hasan Iqbal, Nazmul Karim, Muhammad Tayyab, Jing Hua, Chen Chen. Latenteditor: Text driven local editing of 3d scenes. European Conference on Computer Vision, 2024.
Aryan Mikaeili, Or Perel, Mehdi Safaee, Daniel Cohen-Or, Ali Mahdavi-Amiri. Sked: Sketch-guided text-based 3d editing. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Xingchen Zhou, Ying He, F Richard Yu, Jianqiang Li, You Li. Repaint-nerf: Nerf editting via semantic masks and diffusion models. arXiv preprint arXiv:2306.05668, 2023. arXiv
Ayaan Haque, Matthew Tancik, Alexei A Efros, Aleksander Holynski, Angjoo Kanazawa. Instruct-nerf2nerf: Editing 3d scenes with instructions. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
Steven Liu, Xiuming Zhang, Zhoutong Zhang, Richard Zhang, Jun-Yan Zhu, Bryan Russell. Editing conditional radiance fields. Proceedings of the IEEE/CVF international conference on computer vision, 2021.
Nazmul Karim, Hasan Iqbal, Umar Khalid, Chen Chen, Jing Hua. Free-editor: zero-shot text-driven 3D scene editing. European Conference on Computer Vision, 2024.
Kai He, Chin-Hsuan Wu, Igor Gilitschenski. CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusion. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Cyrus Vachha, Ayaan Haque. Instruct-gs2gs: Editing 3d gaussian splats with instructions. 2024.
Yuxuan Wang, Xuanyu Yi, Zike Wu, Na Zhao, Long Chen, Hanwang Zhang. View-consistent 3d editing with gaussian splatting. European conference on computer vision, 2024.
Jamie Wynn, Zawar Qureshi, Jakub Powierza, Jamie Watson, Mohamed Sayed. Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylization. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Minghao Chen, Iro Laina, Andrea Vedaldi. Dge: Direct gaussian 3d editing by consistent multi-view editing. European Conference on Computer Vision, 2024.
Jing Wu, Jia-Wang Bian, Xinghui Li, Guangrun Wang, Ian Reid, Philip Torr, Victor Adrian Prisacariu. Gaussctrl: Multi-view consistent text-driven 3d gaussian splatting editing. European Conference on Computer Vision, 2024.
Ruihao Xia, Yang Tang, Pan Zhou. Towards Scalable and Consistent 3D Editing. arXiv preprint arXiv:2510.02994, 2025. arXiv
Eyal Gomel, Lior Wolf. Diffusion-Based Attention Warping for Consistent 3D Scene Editing. arXiv preprint arXiv:2412.07984, 2024. arXiv
Ziyang Yan, Lei Li, Yihua Shao, Siyu Chen, Zongkai Wu, Jenq-Neng Hwang, Hao Zhao, Fabio Remondino. 3dsceneeditor: Controllable 3d scene editing with gaussian splatting. arXiv preprint arXiv:2412.01583, 2024. arXiv
Minghao Wen, Shengjie Wu, Kangkan Wang, Dong Liang. Intergsedit: Interactive 3d gaussian splatting editing with 3d geometry-consistent attention prior. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Yiwen Chen, Zilong Chen, Chi Zhang, Feng Wang, Xiaofeng Yang, Yikai Wang, Zhongang Cai, Lei Yang, Huaping Liu, Guosheng Lin. Gaussianeditor: Swift and controllable 3d editing with gaussian splatting. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Jiazhong Cen, Jiemin Fang, Chen Yang, Lingxi Xie, Xiaopeng Zhang, Wei Shen, Qi Tian. Segment any 3d gaussians. Proceedings of the AAAI Conference on Artificial Intelligence, 2025.
Junliang Ye, Zhengyi Wang, Ruowen Zhao, Shenghao Xie, Jun Zhu. ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understanding. arXiv preprint arXiv:2506.01853, 2025. arXiv
Sining Lu, Guan Chen, Nam Anh Dinh, Itai Lang, Ari Holtzman, Rana Hanocka. Ll3m: Large language 3d modelers. arXiv preprint arXiv:2508.08228, 2025. arXiv
Ziqi Ma, Hongqiao Chen, Yisong Yue, Georgia Gkioxari. Feedforward 3D Editing via Text-Steerable Image-to-3D. arXiv preprint arXiv:2512.13678, 2025. arXiv
Ian Huang, Guandao Yang, Leonidas Guibas. Blenderalchemy: Editing 3d graphics with vision-language models. European Conference on Computer Vision, 2024.
Ziya Erkoç, Can Gümeli, Chaoyang Wang, Matthias Nießner, Angela Dai, Peter Wonka, Hsin-Ying Lee, Peiye Zhuang. Preditor3d: Fast and precise 3d shape editing. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Lin Li, Zehuan Huang, Haoran Feng, Gengxiong Zhuang, Rui Chen, Chunchao Guo, Lu Sheng. Voxhammer: Training-free precise and coherent 3d editing in native 3d space. arXiv preprint arXiv:2508.19247, 2025. arXiv
Vivek Madhavaram, Shivangana Rawat, Chaitanya Devaguptapu, Charu Sharma, Manohar Kaul. Towards a Training Free Approach for 3D Scene Editing. 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025.
Peng Li, Suizhi Ma, Jialiang Chen, Yuan Liu, Congyi Zhang, Wei Xue, Wenhan Luo, Alla Sheffer, Wenping Wang, Yike Guo. Cmd: Controllable multiview diffusion for 3d editing and progressive generation. Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers, 2025.
Stephanie Fu, Netanel Y Tamir, Shobhita Sundaram, Lucy Chai, Richard Zhang, Tali Dekel, Phillip Isola. DreamSim: learning new dimensions of human visual similarity using synthetic data. Proceedings of the 37th International Conference on Neural Information Processing Systems, 2023.
Will Gao, Dilin Wang, Yuchen Fan, Aljaz Bozic, Tuur Stuyck, Zhengqin Li, Zhao Dong, Rakesh Ranjan, Nikolaos Sarafianos. 3d mesh editing using masked lrms. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Zhenyu Shu, Junlong Yu, Kai Chao, Shiqing Xin, Ligang Liu. Gaussedit: Adaptive 3d scene editing with text and image prompts. IEEE Transactions on Visualization and Computer Graphics, 2025.
Xiao Han, Runze Tian, Yifei Tong, Fenggen Yu, Dingyao Liu, Yan Zhang. ARAP-GS: Drag-driven As-Rigid-As-Possible 3D Gaussian Splatting Editing with Diffusion Prior. arXiv preprint arXiv:2504.12788, 2025. arXiv
Jian Gao, Chun Gu, Youtian Lin, Hao Zhu, Xun Cao, Li Zhang, Yao Yao. Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracing. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Jongsu Park, Shokhikha Amalana Murdivien, Kyungwan Choi, Duhwan Mun, Jumyung Um. Generative 3D appearance design: A survey of generation, segmentation and editing by artificial intelligence. Journal of Computational Design and Engineering, 2026.
Amir Barda, Matheus Gadelha, Vladimir G Kim, Noam Aigerman, Amit H Bermano, Thibault Groueix. Instant3dit: Multiview inpainting for fast editing of 3d objects. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Adam Polyak, Amit Zohar, Andrew Brown, Andros Tjandra, Animesh Sinha, Ann Lee, Apoorv Vyas, Bowen Shi, Chih-Yao Ma, Ching-Yao Chuang, et al.. Movie gen: A cast of media foundation models. arXiv preprint arXiv:2410.13720, 2024. arXiv
Wenyi Hong, Ming Ding, Wendi Zheng, Xinghan Liu, Jie Tang. Cogvideo: Large-scale pretraining for text-to-video generation via transformers. arXiv preprint arXiv:2205.15868, 2022. arXiv
Team Wan, Ang Wang, Baole Ai, Bin Wen, Chaojie Mao, Chen-Wei Xie, Di Chen, Feiwu Yu, Haiming Zhao, Jianxiao Yang, et al.. Wan: Open and advanced large-scale video generative models. arXiv preprint arXiv:2503.20314, 2025. arXiv
Tim Brooks, Bill Peebles, Connor Holmes, Will DePue, Yufei Guo, Li Jing, David Schnurr, Joe Taylor, Troy Luhman, Eric Luhman, Clarence Wing Yan, Ricky Wang, Aditya Ramesh. Video Generation Models as World Simulators. Technical report, OpenAI, 2024. Link
Xuan Ju, Yiming Gao, Zhaoyang Zhang, Ziyang Yuan, Xintao Wang, Ailing Zeng, Yu Xiong, Qiang Xu, Ying Shan. MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions. Advances in Neural Information Processing Systems, 2024. Link
Masaki Saito, Eiichi Matsumoto, Shunta Saito. Temporal generative adversarial nets with singular value clipping. Proceedings of the IEEE International Conference on Computer Vision, 2017.
Masaki Saito, Shunta Saito, Masanori Koyama, Sosuke Kobayashi. Train sparsely, generate densely: Memory-efficient unsupervised training of high-resolution temporal gan. International Journal of Computer Vision, 2020.
Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, Jan Kautz. Mocogan: Decomposing motion and content for video generation. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Yu Tian, Jian Ren, Menglei Chai, Kyle Olszewski, Xi Peng, Dimitris N Metaxas, Sergey Tulyakov. A good image generator is what you need for high-resolution video synthesis. arXiv preprint arXiv:2104.15069, 2021. arXiv
Aidan Clark, Jeff Donahue, Karen Simonyan. Adversarial video generation on complex datasets. arXiv preprint arXiv:1907.06571, 2019. arXiv
Sihyun Yu, Jihoon Tack, Sangwoo Mo, Hyunsu Kim, Junho Kim, Jung-Woo Ha, Jinwoo Shin. Generating videos with dynamics-aware implicit generative adversarial networks. arXiv preprint arXiv:2202.10571, 2022. arXiv
Ivan Skorokhodov, Sergey Tulyakov, Mohamed Elhoseiny. Stylegan-v: A continuous video generator with the price, image quality and perks of stylegan2. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang, Nan Duan. Nüwa: Visual synthesis pre-training for neural visual world creation. European conference on computer vision, 2022.
Songwei Ge, Thomas Hayes, Harry Yang, Xi Yin, Guan Pang, David Jacobs, Jia-Bin Huang, Devi Parikh. Long video generation with time-agnostic vqgan and time-sensitive transformer. European Conference on Computer Vision, 2022.
Xinlong Wang, Xiaosong Zhang, Zhengxiong Luo, Quan Sun, Yufeng Cui, Jinsheng Wang, Fan Zhang, Yueze Wang, Zhen Li, Qiying Yu, et al.. Emu3: Next-Token Prediction is All You Need. arXiv preprint arXiv:2409.18869, 2024. arXiv
Tianwei Yin, Qiang Zhang, Richard Zhang, William T Freeman, Fredo Durand, Eli Shechtman, Xun Huang. From slow bidirectional to fast autoregressive video diffusion models. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Sand. ai, Hansi Teng, Hongyu Jia, Lei Sun, Lingzhi Li, Maolin Li, Mingqiu Tang, Shuai Han, Tianning Zhang, W. Q. Zhang, Weifeng Luo, Xiaoyang Kang, Yuchen Sun, Yue Cao, Yunpeng Huang, Yutong Lin, Yuxin Fang, Zewei Tao, Zheng Zhang, Zhongshu Wang, Zixun Liu, Dai Shi, Guoli Su, Hanwen Sun, Hong Pan, Jie Wang, Jiexin Sheng, Min Cui, Min Hu, Ming Yan, Shucheng Yin, Siran Zhang, Tingting Liu, Xianping Yin, Xiaoyu Yang, Xin Song, Xuan Hu, Yankai Zhang, Yuqiao Li. MAGI-1: Autoregressive Video Generation at Scale. 2025. arXiv
Jonathan Ho, Tim Salimans, Alexey Gritsenko, William Chan, Mohammad Norouzi, David J Fleet. Video diffusion models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Andreas Blattmann, Robin Rombach, Huan Ling, Tim Dockhorn, Seung Wook Kim, Sanja Fidler, Karsten Kreis. Align your latents: High-resolution video synthesis with latent diffusion models. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023.
Yingqing He, Tianyu Yang, Yong Zhang, Ying Shan, Qifeng Chen. Latent video diffusion models for high-fidelity long video generation. arXiv preprint arXiv:2211.13221, 2022. arXiv
Jonathan Ho, William Chan, Chitwan Saharia, Jay Whang, Ruiqi Gao, Alexey Gritsenko, Diederik P Kingma, Ben Poole, Mohammad Norouzi, David J Fleet, et al.. Imagen video: High definition video generation with diffusion models. arXiv preprint arXiv:2210.02303, 2022. arXiv
Uriel Singer, Adam Polyak, Thomas Hayes, Xi Yin, Jie An, Songyang Zhang, Qiyuan Hu, Harry Yang, Oron Ashual, Oran Gafni, et al.. Make-a-video: Text-to-video generation without text-video data. arXiv preprint arXiv:2209.14792, 2022. arXiv
Haoxin Chen, Menghan Xia, Yingqing He, Yong Zhang, Xiaodong Cun, Shaoshu Yang, Jinbo Xing, Yaofang Liu, Qifeng Chen, Xintao Wang, et al.. Videocrafter1: Open diffusion models for high-quality video generation. arXiv preprint arXiv:2310.19512, 2023. arXiv
Haoxin Chen, Yong Zhang, Xiaodong Cun, Menghan Xia, Xintao Wang, Chao Weng, Ying Shan. Videocrafter2: Overcoming data limitations for high-quality video diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Yaohui Wang, Xinyuan Chen, Xin Ma, Shangchen Zhou, Ziqi Huang, Yi Wang, Ceyuan Yang, Yinan He, Jiashuo Yu, Peiqing Yang, et al.. Lavie: High-quality video generation with cascaded latent diffusion models. International Journal of Computer Vision, 2025.
Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei, Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, Xiaohu Qie, Mike Zheng Shou. Tune-a-video: One-shot tuning of image diffusion models for text-to-video generation. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
Yuwei Guo, Ceyuan Yang, Anyi Rao, Zhengyang Liang, Yaohui Wang, Yu Qiao, Maneesh Agrawala, Dahua Lin, Bo Dai. AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning. International Conference on Learning Representations, 2024.
Zangwei Zheng, Xiangyu Peng, Tianji Yang, Chenhui Shen, Shenggui Li, Hongxin Liu, Yukun Zhou, Tianyi Li, Yang You. Open-sora: Democratizing efficient video production for all. arXiv preprint arXiv:2412.20404, 2024. arXiv
Zhuoyi Yang, Jiayan Teng, Wendi Zheng, Ming Ding, Shiyu Huang, Jiazheng Xu, Yuanming Yang, Wenyi Hong, Xiaohan Zhang, Guanyu Feng, et al.. Cogvideox: Text-to-video diffusion models with an expert transformer. arXiv preprint arXiv:2408.06072, 2024. arXiv
Guoqing Ma, Haoyang Huang, Kun Yan, Liangyu Chen, Nan Duan, Shengming Yin, Changyi Wan, Ranchen Ming, Xiaoniu Song, Xing Chen, Yu Zhou, Deshan Sun, Deyu Zhou, Jian Zhou, Kaijun Tan, Kang An, Mei Chen, Wei Ji, Qiling Wu, Wen Sun, Xin Han, Yanan Wei, Zheng Ge, Aojie Li, Bin Wang, Bizhu Huang, Bo Wang, Brian Li, Changxing Miao, Chen Xu, Chenfei Wu, Chenguang Yu, Dapeng Shi, Dingyuan Hu, Enle Liu, Gang Yu, Ge Yang, Guanzhe Huang, Gulin Yan, Haiyang Feng, Hao Nie, Haonan Jia, Hanpeng Hu, Hanqi Chen, Haolong Yan, Heng Wang, Hongcheng Guo, Huilin Xiong, Huixin Xiong, Jiahao Gong, Jianchang Wu, Jiaoren Wu, Jie Wu, Jie Yang, Jiashuai Liu, Jiashuo Li, Jingyang Zhang, Junjing Guo, Junzhe Lin, Kaixiang Li, Lei Liu, Lei Xia, Liang Zhao, Liguo Tan, Liwen Huang, Liying Shi, Ming Li, Mingliang Li, Muhua Cheng, Na Wang, Qiaohui Chen, Qinglin He, Qiuyan Liang, Quan Sun, Ran Sun, Rui Wang, Shaoliang Pang, Shiliang Yang, Sitong Liu, Siqi Liu, Shuli Gao, Tiancheng Cao, Tianyu Wang, Weipeng Ming, Wenqing He, Xu Zhao, Xuelin Zhang, Xianfang Zeng, Xiaojia Liu, Xuan Yang, Yaqi Dai, Yanbo Yu, Yang Li, Yineng Deng, Yingming Wang, Yilei Wang, Yuanwei Lu, Yu Chen, Yu Luo, Yuchu Luo, Yuhe Yin, Yuheng Feng, Yuxiang Yang, Zecheng Tang, Zekai Zhang, Zidong Yang, Binxing Jiao, Jiansheng Chen, Jing Li, Shuchang Zhou, Xiangyu Zhang, Xinhao Zhang, Yibo Zhu, Heung-Yeung Shum, Daxin Jiang. Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Model. 2025. arXiv
Google DeepMind. Veo: Google's DeepMind Text‐to‐Video Generation Model. r̆lhttps://deepmind.google/models/veo/, 2024.
Weijie Kong, Qi Tian, Zijian Zhang, Rox Min, Zuozhuo Dai, Jin Zhou, Jiangfeng Xiong, Xin Li, Bo Wu, Jianwei Zhang, et al.. Hunyuanvideo: A systematic framework for large video generative models. arXiv preprint arXiv:2412.03603, 2024. arXiv
Genmo Team. Mochi 1: A New State-of-the-Art in Open-Source Video Generation. r̆lhttps://github.com/genmoai/models, 2024.
Yoav HaCohen, Nisan Chiprut, Benny Brazowski, Daniel Shalem, Dudu Moshe, Eitan Richardson, Eran Levin, Guy Shiran, Nir Zabari, Ori Gordon, Poriya Panet, Sapir Weissbuch, Victor Kulikov, Yaki Bitterman, Zeev Melumian, Ofir Bibi. LTX-Video: Realtime Video Latent Diffusion. 2024. arXiv
Max Bain, Arsha Nagrani, Gül Varol, Andrew Zisserman. Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Qiuheng Wang, Yukai Shi, Jiarong Ou, Rui Chen, Ke Lin, Jiahao Wang, Boyuan Jiang, Haotian Yang, Mingwu Zheng, Xin Tao, Fei Yang, Pengfei Wan, Di Zhang. Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Content. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Jun Xu, Tao Mei, Ting Yao, Yong Rui. MSR-VTT: A Large Video Description Dataset for Bridging Video and Language. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Yaofang Liu, Xiaodong Cun, Xuebo Liu, Xintao Wang, Yong Zhang, Haoxin Chen, Yang Liu, Tieyong Wang, Ying Shan. EvalCrafter: Benchmarking and Evaluating Large Video Generation Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Kaiyue Sun, Kaiyi Huang, Xian Liu, Yue Wu, Zihan Xu, Zhenguo Li, Xihui Liu. T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Omer Bar-Tal, Hila Chefer, Omer Tov, Charles Herrmann, Roni Paiss, Shiran Zada, Ariel Ephrat, Junhwa Hur, Guanghui Liu, Amit Raj, et al.. Lumiere: A space-time diffusion model for video generation. SIGGRAPH Asia 2024 Conference Papers, 2024.
Weiming Ren, Huan Yang, Ge Zhang, Cong Wei, Xinrun Du, Wenhao Huang, Wenhu Chen. Consisti2v: Enhancing visual consistency for image-to-video generation. arXiv preprint arXiv:2402.04324, 2024. arXiv
Jinbo Xing, Menghan Xia, Yong Zhang, Haoxin Chen, Wangbo Yu, Hanyuan Liu, Gongye Liu, Xintao Wang, Ying Shan, Tien-Tsin Wong. Dynamicrafter: Animating open-domain images with video diffusion priors. European Conference on Computer Vision, 2024.
Xuan Ju, Ailing Zeng, Chenchen Zhao, Jianan Wang, Lei Zhang, Qiang Xu. Humansd: A native skeleton-guided diffusion model for human image generation. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Xuan Ju, Ailing Zeng, Jianan Wang, Qiang Xu, Lei Zhang. Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
MMPose Contributors. OpenMMLab Pose Estimation Toolbox and Benchmark. r̆lhttps://github.com/open-mmlab/mmpose, 2020.
Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Hanshu Yan, Jia-Wei Liu, Chenxu Zhang, Jiashi Feng, Mike Zheng Shou. Magicanimate: Temporally consistent human image animation using diffusion model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Li Hu. Animate anyone: Consistent and controllable image-to-video synthesis for character animation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Yue Ma, Yingqing He, Xiaodong Cun, Xintao Wang, Siran Chen, Xiu Li, Qifeng Chen. Follow your pose: Pose-guided text-to-video generation using pose-free videos. Proceedings of the AAAI Conference on Artificial Intelligence, 2024.
Johanna Karras, Aleksander Holynski, Ting-Chun Wang, Ira Kemelmacher-Shlizerman. Dreampose: Fashion image-to-video synthesis via stable diffusion. 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Hongxiang Li, Yaowei Li, Yuhang Yang, Junjie Cao, Zhihong Zhu, Xuxin Cheng, Long Chen. Dispose: Disentangling pose guidance for controllable human image animation. arXiv preprint arXiv:2412.09349, 2024. arXiv
Shenhao Zhu, Junming Leo Chen, Zuozhuo Dai, Zilong Dong, Yinghui Xu, Xun Cao, Yao Yao, Hao Zhu, Siyu Zhu. Champ: Controllable and consistent human image animation with 3d parametric guidance. European Conference on Computer Vision, 2024.
Di Chang, Yichun Shi, Quankai Gao, Jessica Fu, Hongyi Xu, Guoxian Song, Qing Yan, Yizhe Zhu, Xiao Yang, Mohammad Soleymani. Magicpose: Realistic human poses and facial expressions retargeting with identity-aware diffusion. arXiv preprint arXiv:2311.12052, 2023. arXiv
Min Zhao, Rongzhen Wang, Fan Bao, Chongxuan Li, Jun Zhu. ControlVideo: conditional control for one-shot text-driven video editing and beyond. Science China Information Sciences, 2025.
Jinbo Xing, Menghan Xia, Yuxin Liu, Yuechen Zhang, Yong Zhang, Yingqing He, Hanyuan Liu, Haoxin Chen, Xiaodong Cun, Xintao Wang, et al.. Make-your-video: Customized video generation using textual and structural guidance. IEEE Transactions on Visualization and Computer Graphics, 2024.
Weifeng Chen, Jie Wu, Pan Xie, Hefeng Wu, Jiashi Li, Xin Xia, Xuefeng Xiao, Liang Lin. Control-a-video: Controllable text-to-video generation with diffusion models. CoRR, 2023.
Bohao Peng, Jian Wang, Yuechen Zhang, Wenbo Li, Ming-Chang Yang, Jiaya Jia. Controlnext: Powerful and efficient control for image and video generation. arXiv preprint arXiv:2408.06070, 2024. arXiv
Yatian Pang, Bin Zhu, Bin Lin, Mingzhe Zheng, Francis EH Tay, Ser-Nam Lim, Harry Yang, Li Yuan. Dreamdance: Animating human images by enriching 3d geometry cues from 2d poses. arXiv preprint arXiv:2412.00397, 2024. arXiv
Yuwei Guo, Ceyuan Yang, Anyi Rao, Maneesh Agrawala, Dahua Lin, Bo Dai. Sparsectrl: Adding sparse controls to text-to-video diffusion models. European Conference on Computer Vision, 2024.
Chen Zhiyuan, Cao Jiajiong, Chen Zhiquan, Li Yuming, Ma Chenguang. EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning. 2024. arXiv
Zunnan Xu, Zhentao Yu, Zixiang Zhou, Jun Zhou, Xiaoyu Jin, Fa-Ting Hong, Xiaozhong Ji, Junwei Zhu, Chengfei Cai, Shiyu Tang, et al.. Hunyuanportrait: Implicit condition control for enhanced portrait animation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Jianzhu Guo, Dingyun Zhang, Xiaoqiang Liu, Zhizhou Zhong, Yuan Zhang, Pengfei Wan, Di Zhang. Liveportrait: Efficient portrait animation with stitching and retargeting control. arXiv preprint arXiv:2407.03168, 2024. arXiv
Hongxiang Zhao, Xingchen Liu, Mutian Xu, Yiming Hao, Weikai Chen, Xiaoguang Han. TASTE-Rob: Advancing video generation of task-oriented hand-object interaction for generalizable robotic manipulation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Bin Lin, Yanzhen Yu, Jianhao Ye, Ruitao Lv, Yuguang Yang, Ruoye Xie, Pan Yu, Hongbin Zhou. Takin-ADA: Emotion Controllable Audio-Driven Animation with Canonical and Landmark Loss Optimization. arXiv preprint arXiv:2410.14283, 2024. arXiv
Yihao Meng, Hao Ouyang, Hanlin Wang, Qiuyu Wang, Wen Wang, Ka Leong Cheng, Zhiheng Liu, Yujun Shen, Huamin Qu. Anidoc: Animation creation made easier. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Dagmar Loftsdottir, Matthew Guzdial. Sketchbetween: Video-to-video synthesis for sprite animation via sketches. Proceedings of the 17th International Conference on the Foundations of Digital Games, 2022.
Yuxue Yang, Lue Fan, Zuzen Lin, Feng Wang, Zhaoxiang Zhang. Layeranimate: Layer-specific control for animation. arXiv e-prints, 2025.
Yue Ma, Xiaodong Cun, Sen Liang, Jinbo Xing, Yingqing He, Chenyang Qi, Siran Chen, Qifeng Chen. Magicstick: Controllable video editing via control handle transformations. 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025.
Ruiyuan Gao, Kai Chen, Enze Xie, Lanqing Hong, Zhenguo Li, Dit-Yan Yeung, Qiang Xu. Magicdrive: Street view generation with diverse 3d geometry control. arXiv preprint arXiv:2310.02601, 2023. arXiv
Xiaofeng Wang, Zheng Zhu, Guan Huang, Xinze Chen, Jiagang Zhu, Jiwen Lu. Drivedreamer: Towards real-world-drive world models for autonomous driving. European conference on computer vision, 2024.
Wei Wu, Xi Guo, Weixuan Tang, Tingxuan Huang, Chiyu Wang, Dongyue Chen, Chenjing Ding. Drivescape: Towards high-resolution controllable multi-view driving video generation. arXiv preprint arXiv:2409.05463, 2024. arXiv
Jianbiao Mei, Tao Hu, Xuemeng Yang, Licheng Wen, Yu Yang, Tiantian Wei, Yukai Ma, Min Dou, Botian Shi, Yong Liu. Dreamforge: Motion-aware autoregressive video generation for multi-view driving scenes. arXiv preprint arXiv:2409.04003, 2024. arXiv
Junpeng Jiang, Gangyi Hong, Lijun Zhou, Enhui Ma, Hengtong Hu, Xia Zhou, Jie Xiang, Fan Liu, Kaicheng Yu, Haiyang Sun, et al.. Dive: Dit-based video generation with enhanced control. arXiv preprint arXiv:2409.01595, 2024. arXiv
Jiawei Wang, Yuchen Zhang, Jiaxin Zou, Yan Zeng, Guoqiang Wei, Liping Yuan, Hang Li. Boximator: Generating rich and controllable motions for video synthesis. arXiv preprint arXiv:2402.01566, 2024. arXiv
Ge Ya Luo, ZhiHao Luo, Anthony Gosselin, Alexia Jolicoeur-Martineau, Christopher Pal. Ctrl-v: Higher fidelity autonomous vehicle video generation with bounding-box controlled object motion. Transactions on Machine Learning Research, 2025.
Xiaoyu Shi, Zhaoyang Huang, Fu-Yun Wang, Weikang Bian, Dasong Li, Yi Zhang, Manyuan Zhang, Ka Chun Cheung, Simon See, Hongwei Qin, et al.. Motion-i2v: Consistent and controllable image-to-video generation with explicit motion modeling. ACM SIGGRAPH 2024 Conference Papers, 2024.
Muyao Niu, Xiaodong Cun, Xintao Wang, Yong Zhang, Ying Shan, Yinqiang Zheng. Mofa-video: Controllable image animation via generative motion field adaptions in frozen image-to-video diffusion model. European Conference on Computer Vision, 2024.
Ryan Burgert, Yuancheng Xu, Wenqi Xian, Oliver Pilarski, Pascal Clausen, Mingming He, Li Ma, Yitong Deng, Lingxiao Li, Mohsen Mu, et al.. Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Jinbo Xing, Long Mai, Cusuh Ham, Jiahui Huang, Aniruddha Mahapatra, Chi-Wing Fu, Tien-Tsin Wong, Feng Liu. Motioncanvas: Cinematic shot design with controllable image-to-video generation. Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers, 2025.
Zhenghao Zhang, Junchao Liao, Menghao Li, Zuozhuo Dai, Bingxue Qiu, Siyu Zhu, Long Qin, Weizhi Wang. Tora: Trajectory-oriented diffusion transformer for video generation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Haonan Qiu, Zhaoxi Chen, Zhouxia Wang, Yingqing He, Menghan Xia, Ziwei Liu. Freetraj: Tuning-free trajectory control in video diffusion models. arXiv preprint arXiv:2406.16863, 2024. arXiv
Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl. Peekaboo: Interactive video generation via masked-diffusion. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Shengming Yin, Chenfei Wu, Jian Liang, Jie Shi, Houqiang Li, Gong Ming, Nan Duan. Dragnuwa: Fine-grained control in video generation by integrating text, image, and trajectory. arXiv preprint arXiv:2308.08089, 2023. arXiv
Weijia Wu, Zhuang Li, Yuchao Gu, Rui Zhao, Yefei He, David Junhao Zhang, Mike Zheng Shou, Yan Li, Tingting Gao, Di Zhang. Draganything: Motion control for anything using entity representation. European Conference on Computer Vision, 2024.
Hao He, Ceyuan Yang, Shanchuan Lin, Yinghao Xu, Meng Wei, Liangke Gui, Qi Zhao, Gordon Wetzstein, Lu Jiang, Hongsheng Li. Cameractrl ii: Dynamic scene exploration via camera-controlled video diffusion models. arXiv preprint arXiv:2503.10592, 2025. arXiv
Shiyuan Yang, Liang Hou, Haibin Huang, Chongyang Ma, Pengfei Wan, Di Zhang, Xiaodong Chen, Jing Liao. Direct-a-video: Customized video generation with user-directed camera movement and object motion. ACM SIGGRAPH 2024 Conference Papers, 2024.
Xiao Fu, Xian Liu, Xintao Wang, Sida Peng, Menghan Xia, Xiaoyu Shi, Ziyang Yuan, Pengfei Wan, Di Zhang, Dahua Lin. 3dtrajmaster: Mastering 3d trajectory for multi-entity motion in video generation. arXiv preprint arXiv:2412.07759, 2024. arXiv
Tuna Han Salih Meral, Hidir Yesiltepe, Connor Dunlop, Pinar Yanardag. Motionflow: Attention-driven motion transfer in video diffusion models. arXiv preprint arXiv:2412.05275, 2024. arXiv
Qinghe Wang, Yawen Luo, Xiaoyu Shi, Xu Jia, Huchuan Lu, Tianfan Xue, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai. Cinemaster: A 3d-aware and controllable framework for cinematic text-to-video generation. Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers, 2025.
Jianhong Bai, Menghan Xia, Xiao Fu, Xintao Wang, Lianrui Mu, Jinwen Cao, Zuozhu Liu, Haoji Hu, Xiang Bai, Pengfei Wan, Di Zhang. ReCamMaster: Camera-Controlled Generative Rendering from A Single Video. arXiv preprint arXiv:2503.11647, 2025. arXiv
Mark Yu, Wenbo Hu, Jinbo Xing, Ying Shan. TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models. arXiv preprint arXiv:2503.05638, 2025. arXiv
Zekai Gu, Rui Yan, Jiahao Lu, Peng Li, Zhiyang Dou, Chenyang Si, Zhen Dong, Qifeng Liu, Cheng Lin, Ziwei Liu, Wenping Wang, Yuan Liu. Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control. 2025. arXiv
Rui Zhao, Yuchao Gu, Jay Zhangjie Wu, David Junhao Zhang, Jia-Wei Liu, Weijia Wu, Jussi Keppo, Mike Zheng Shou. Motiondirector: Motion customization of text-to-video diffusion models. European Conference on Computer Vision, 2024.
Pengyang Ling, Jiazi Bu, Pan Zhang, Xiaoyi Dong, Yuhang Zang, Tong Wu, Huaian Chen, Jiaqi Wang, Yi Jin. Motionclone: Training-free motion cloning for controllable video generation. arXiv preprint arXiv:2406.05338, 2024. arXiv
Hyeonho Jeong, Geon Yeong Park, Jong Chul Ye. Vmc: Video motion customization using temporal attention adaption for text-to-video diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Daniel Geng, Charles Herrmann, Junhwa Hur, Forrester Cole, Serena Zhang, Tobias Pfaff, Tatiana Lopez-Guevara, Yusuf Aytar, Michael Rubinstein, Chen Sun, et al.. Motion prompting: Controlling video generation with motion trajectories. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Xinyao Liao, Xianfang Zeng, Liao Wang, Gang Yu, Guosheng Lin, Chi Zhang. Motionagent: Fine-grained controllable video generation via motion field agent. arXiv preprint arXiv:2502.03207, 2025. arXiv
Yen-Siang Wu, Chi-Pin Huang, Fu-En Yang, Yu-Chiang Frank Wang. Motionmatcher: Motion customization of text-to-video diffusion models via motion feature matching. arXiv preprint arXiv:2502.13234, 2025. arXiv
Hyeonho Jeong, Jinho Chang, Geon Yeong Park, Jong Chul Ye. Dreammotion: Space-time self-similarity score distillation for zero-shot video editing. CoRR, 2024.
Yixuan Ren, Yang Zhou, Jimei Yang, Jing Shi, Difan Liu, Feng Liu, Mingi Kwon, Abhinav Shrivastava. Customize-a-video: One-shot motion customization of text-to-video diffusion models. European Conference on Computer Vision, 2024.
Nikita Karaev, Ignacio Rocco, Benjamin Graham, Natalia Neverova, Andrea Vedaldi, Christian Rupprecht. Cotracker: It is better to track together. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Shuai Yang, Yifan Zhou, Ziwei Liu, Chen Change and Loy. Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation. ACM SIGGRAPH Asia Conference Proceedings, 2023.
Shuai Yang, Yifan Zhou, Ziwei Liu, Chen Change and Loy. FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation. CVPR, 2024.
Zixuan Ye, Huijuan Huang, Xintao Wang, Pengfei Wan, Di Zhang, Wenhan Luo. Stylemaster: Stylize your video with artistic generation and translation. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Quanjian Song, Mingbao Lin, Wengyi Zhan, Shuicheng Yan, Liujuan Cao, Rongrong Ji. UniVST: A Unified Framework for Training-free Localized Video Style Transfer. arXiv preprint arXiv:2410.20084, 2024. arXiv
Sangwon Jang, Taekyung Ki, Jaehyeong Jo, Jaehong Yoon, Soo Ye Kim, Zhe Lin, Sung Ju Hwang. Frame Guidance: Training-Free Guidance for Frame-Level Control in Video Diffusion Models. 2025. arXiv
Dianbing Xi, Jiepeng Wang, Yuanzhi Liang, Xi Qiu, Yuchi Huo, Rui Wang, Chi Zhang, Xuelong Li. OmniVDiff: Omni Controllable Video Diffusion for Generation and Understanding. 2025. arXiv
Yao Teng, Enze Xie, Yue Wu, Haoyu Han, Zhenguo Li, Xihui Liu. Drag-A-Video: Non-rigid Video Editing with Point-based Interaction. arXiv preprint arXiv:2312.02936, 2023. arXiv
Hyeonho Jeong, Chun-Hao Paul Huang, Jong Chul Ye, Niloy Mitra, Duygu Ceylan. Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generation. 2025. arXiv
Guosheng Zhao, Xiaofeng Wang, Zheng Zhu, Xinze Chen, Guan Huang, Xiaoyi Bao, Xingang Wang. DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation. 2024. arXiv
Ruiyuan Gao, Kai Chen, Bo Xiao, Lanqing Hong, Zhenguo Li, Qiang Xu. MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Control. 2025. arXiv
Yuqing Wen, Yucheng Zhao, Yingfei Liu, Fan Jia, Yanhui Wang, Chong Luo, Chi Zhang, Tiancai Wang, Xiaoyan Sun, Xiangyu Zhang. Panacea: Panoramic and Controllable Video Generation for Autonomous Driving. 2023. arXiv
Lin Liu, Quande Liu, Shengju Qian, Yuan Zhou, Wengang Zhou, Houqiang Li, Lingxi Xie, Qi Tian. Text-Animator: Controllable Visual Text Video Generation. 2024. arXiv
Linrui Tian, Qi Wang, Bang Zhang, Liefeng Bo. EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions. 2024. arXiv
Junxian Ma, Shiwen Wang, Jian Yang, Junyi Hu, Jian Liang, Guosheng Lin, Jingbo chen, Kai Li, Yu Meng. SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusion. 2025. arXiv
Yue Zhang, Zhizhou Zhong, Minhao Liu, Zhaokang Chen, Bin Wu, Yubin Zeng, Chao Zhan, Yingjie He, Junxin Huang, Wenjiang Zhou. MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Sampling. 2025. arXiv
Hejia Chen, Haoxian Zhang, Shoulong Zhang, Xiaoqiang Liu, Sisi Zhuang, Yuan Zhang, Pengfei Wan, Di Zhang, Shuai Li. Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained Control. 2025. arXiv
Cong Wang, Kuan Tian, Jun Zhang, Yonghang Guan, Feng Luo, Fei Shen, Zhiwei Jiang, Qing Gu, Xiao Han, Wei Yang. V-Express: Conditional Dropout for Progressive Training of Portrait Video Generation. 2024. arXiv
Shurong Yang, Huadong Li, Juhao Wu, Minhao Jing, Linze Li, Renhe Ji, Jiajun Liang, Haoqiang Fan. MegActor: Harness the Power of Raw Video for Vivid Portrait Animation. 2024. arXiv
Minglu Zhao, Wenmin Wang, Tongbao Chen, Rui Zhang, Ruochen Li. TA2V: Text-Audio Guided Video Generation. IEEE Transactions on Multimedia, 2024. DOI
Luca Savant Aira, Antonio Montanaro, Emanuele Aiello, Diego Valsesia, Enrico Magli. MotionCraft: Physics-based Zero-Shot Video Generation. 2024. arXiv
Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Ivan Skorokhodov, Alper Canberk, Kwot Sin Lee, Vicente Ordonez, Sergey Tulyakov. AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation. 2025. arXiv
Lin Zhang, Shentong Mo, Yijing Zhang, Pedro Morgado. Audio-Synchronized Visual Animation. Proceedings of the European Conference on Computer Vision (ECCV), 2024.
Hongwei Yi, Tian Ye, Shitong Shao, Xuancheng Yang, Jiantong Zhao, Hanzhong Guo, Terrance Wang, Qingyu Yin, Zeke Xie, Lei Zhu, Wei Li, Michael Lingelbach, Daquan Zhou. MagicInfinite: Generating Infinite Talking Videos with Your Words and Voice. 2025. arXiv
Anoop Cherian, Moitreya Chatterjee, Narendra Ahuja. Sound2Sight: Generating Visual Dynamics from Sound and Context. 2020. arXiv
Dan Kondratyuk, Lijun Yu, Xiuye Gu, José Lezama, Jonathan Huang, Grant Schindler, Rachel Hornung, Vighnesh Birodkar, Jimmy Yan, Ming-Chang Chiu, Krishna Somandepalli, Hassan Akbari, Yair Alon, Yong Cheng, Josh Dillon, Agrim Gupta, Meera Hahn, Anja Hauth, David Hendon, Alonso Martinez, David Minnen, Mikhail Sirotenko, Kihyuk Sohn, Xuan Yang, Hartwig Adam, Ming-Hsuan Yang, Irfan Essa, Huisheng Wang, David A. Ross, Bryan Seybold, Lu Jiang. VideoPoet: A Large Language Model for Zero-Shot Video Generation. 2024. arXiv
Xiang Wang, Hangjie Yuan, Shiwei Zhang, Dayou Chen, Jiuniu Wang, Yingya Zhang, Yujun Shen, Deli Zhao, Jingren Zhou. VideoComposer: Compositional Video Synthesis with Motion Controllability. 2023. arXiv
Gaojie Lin, Jianwen Jiang, Jiaqi Yang, Zerong Zheng, Chao Liang. OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Models. 2025. arXiv
Xuan Ju, Weicai Ye, Quande Liu, Qiulin Wang, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Qiang Xu. FullDiT: Multi-Task Video Generative Foundation Model with Full Attention. 2025. arXiv
Zhimeng Zhang, Lincheng Li, Yu Ding, Changjie Fan. Flow-guided one-shot talking face generation with a high-resolution audio-visual dataset. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Liangbin Xie, Xintao Wang, Honglun Zhang, Chao Dong, Ying Shan. VFHQ: A high-quality dataset and benchmark for video face super-resolution. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2022.
Xuan Ju, Ailing Zeng, Yuxuan Bian, Shaoteng Liu, Qiang Xu. Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Code. 2023. arXiv
Levon Khachatryan, Andranik Movsisyan, Vahram Tadevosyan, Roberto Henschel, Zhangyang Wang, Shant Navasardyan, Humphrey Shi. Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Duygu Ceylan, Chun-Hao Paul Huang, Niloy J. Mitra. Pix2Video: Video Editing using Image Diffusion. 2023. arXiv
Wen Wang, Yan Jiang, Kangyang Xie, Zide Liu, Hao Chen, Yue Cao, Xinlong Wang, Chunhua Shen. Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models. 2024. arXiv
Wenqi Ouyang, Yi Dong, Lei Yang, Jianlou Si, Xingang Pan. I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models. 2024. arXiv
Ozgur Kara, Bariscan Kurtkaya, Hidir Yesiltepe, James M. Rehg, Pinar Yanardag. RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Youyuan Zhang, Xuan Ju, James J. Clark. FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing. 2024. arXiv
Eyal Molad, Eliahu Horwitz, Dani Valevski, Alex Rav Acha, Yossi Matias, Yael Pritch, Yaniv Leviathan, Yedid Hoshen. Dreamix: Video Diffusion Models are General Video Editors. 2023. arXiv
Jiaxin Cheng, Tianjun Xiao, Tong He. Consistent Video-to-Video Transfer Using Synthetic Dataset. 2023. arXiv
Shaoteng Liu, Tianyu Wang, Jui-Hsien Wang, Qing Liu, Zhifei Zhang, Joon-Young Lee, Yijun Li, Bei Yu, Zhe Lin, Soo Ye Kim, Jiaya Jia. Generative Video Propagation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
Yuxuan Bian, Zhaoyang Zhang, Xuan Ju, Mingdeng Cao, Liangbin Xie, Ying Shan, Qiang Xu. VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control. Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers, 2025. DOILink
Zixuan Ye, Xuanhua He, Quande Liu, Qiulin Wang, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Qifeng Chen, Wenhan Luo. UNIC: Unified In-Context Video Editing. 2025. arXiv
Xuan Ju, Tianyu Wang, Yuqian Zhou, He Zhang, Qing Liu, Nanxuan Zhao, Zhifei Zhang, Yijun Li, Yuanhao Cai, Shaoteng Liu, Daniil Pakhomov, Zhe Lin, Soo Ye Kim, Qiang Xu. EditVerse: Unifying Image and Video Editing and Generation with In-Context Learning. 2025. arXiv
Shaoteng Liu, Yuechen Zhang, Wenbo Li, Zhe Lin, Jiaya Jia. Video-P2P: Video Editing with Cross-attention Control. arXiv:2303.04761, 2023. arXiv
Chaehun Shin, Heeseung Kim, Che Hyun Lee, Sang-gil Lee, Sungroh Yoon. Edit-A-Video: Single Video Editing with Object-Aware Consistency. 2023. arXiv
Michal Geyer, Omer Bar-Tal, Shai Bagon, Tali Dekel. TokenFlow: Consistent Diffusion Features for Consistent Video Editing. arXiv preprint arxiv:2307.10373, 2023. arXiv
Jianhong Bai, Tianyu He, Yuchi Wang, Junliang Guo, Haoji Hu, Zuozhu Liu, Jiang Bian. UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing. arXiv preprint arXiv:2402.13185, 2024. arXiv
Max Ku, Cong Wei, Weiming Ren, Harry Yang, Wenhu Chen. AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Tasks. 2024. arXiv
Jun Hao Liew, Hanshu Yan, Jianfeng Zhang, Zhongcong Xu, Jiashi Feng. MagicEdit: High-Fidelity and Temporally Coherent Video Editing. arXiv, 2023.
Jay Zhangjie Wu, Xiuyu Li, Difei Gao, Zhen Dong, Jinbin Bai, Aishani Singh, Xiaoyu Xiang, Youzeng Li, Zuwei Huang, Yuanxi Sun, Rui He, Feng Hu, Junhua Hu, Hai Huang, Hanyu Zhu, Xu Cheng, Jie Tang, Mike Zheng Shou, Kurt Keutzer, Forrest Iandola. CVPR 2023 text guided video editing competition. arXiv preprint arXiv:2310.16003, 2023. arXiv
Minghan Li, Chenxi Xie, Yichen Wu, Lei Zhang, Mengyu Wang. FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2025.
Yinan Chen, Jiangning Zhang, Teng Hu, Yuxiang Zeng, Zhucun Xue, Qingdong He, Chengjie Wang, Yong Liu, Xiaobin Hu, Shuicheng Yan. IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessment. International Conference on Learning Representations (ICLR), 2026.
Yan Wu, Jiahao Wang, Yan Zhang, Siwei Zhang, Otmar Hilliges, Fisher Yu, Siyu Tang. SAGA: Stochastic Whole-Body Grasping with Contact. Proc. ECCV, 2022.
Omid Taheri, Vasileios Choutas, Michael J. Black, Dimitrios Tzionas. GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping. Proc. CVPR, 2022.
Ping Yu, Yang Zhao, Chunyuan Li, Junsong Yuan, Changyou Chen. Structure-Aware Human-Action Generation. Proc. ECCV, 2020.
Bruno Degardin, João Neves, Vasco Lopes, João Brito, Ehsan Yaghoubi, Hugo Proença. Generative Adversarial Graph Convolutional Networks for Human Action Synthesis. Proc. WACV, 2022.
Chuan Guo, Xinxin Zuo, Sen Wang, Shihao Zou, Qingyao Sun, Annan Deng, Minglun Gong, Li Cheng. Action2Motion: Conditioned Generation of 3D Human Motions. Proc. ACM MM, 2020.
Mathis Petrovich, Michael J. Black, Gül Varol. Action-Conditioned 3D Human Motion Synthesis with Transformer VAE. Proc. ICCV, 2021.
Qiujing Lu, Yipeng Zhang, Mingjian Lu, Vwani Roychowdhury. Action-conditioned On-demand Motion Generation. Proc. ACM MM, 2022.
Thomas Lucas, Fabien Baradel, Philippe Weinzaepfel, Grégory Rogez. PoseGPT: Quantization-Based 3D Human Motion Generation and Forecasting. Proc. ECCV, 2022.
Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Daniel Cohen-Or, Amit Haim Bermano. Human Motion Diffusion Model. Proc. ICLR, 2023.
Xin Chen, Biao Jiang, Wen Liu, Zilong Huang, Bin Fu, Tao Chen, Gang Yu. Executing your Commands via Motion Diffusion in Latent Space. Proc. CVPR, 2023.
Taeryung Lee, Gyeongsik Moon, Kyoung Mu Lee. MultiAct: Long-Term 3D Human Motion Generation from Multiple Action Labels. Proc. AAAI, 2023.
Hyemin Ahn, Timothy Ha, Yunho Choi, Hwiyeon Yoo, Songhwai Oh. Text2Action: Generative Adversarial Synthesis from Language to Action. Proc. ICRA, 2018.
Chaitanya Ahuja, Louis-Philippe Morency. Language2Pose: Natural Language Grounded Pose Forecasting. Proc. 3DV, 2019.
Anindita Ghosh, Noshaba Cheema, Cennet Oguz, Christian Theobalt, Philipp Slusallek. Synthesis of Compositional Animations from Textual Descriptions. Proc. Proceedings of theInternational Conference on Computer Vision (ICCV), 2021.
Mathis Petrovich, Michael J. Black, Gül Varol. TEMOS: Generating Diverse Human Motions from Textual Descriptions. Proc. ECCV 2022, 2022.
Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol. TEACH: Temporal Action Composition for 3D Humans. Proc. 3DV, 2022.
Guy Tevet, Brian Gordon, Amir Hertz, Amit H. Bermano, Daniel Cohen-Or. MotionCLIP: Exposing Human Motion Generation to CLIP Space. Proc. ECCV, 2022.
Fangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai, Lei Yang, Ziwei Liu. AvatarCLIP: zero-shot text-driven generation and animation of 3D avatars. ACM Trans. Graph., 2022.
Chuan Guo, Xinxin Zuo, Sen Wang, Li Cheng. TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Texts. Proc. ECCV, 2022.
Jianrong Zhang, Yangsong Zhang, Xiaodong Cun, Shaoli Huang, Yong Zhang, Hongwei Zhao, Hongtao Lu, Xi Shen. T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations. Proc. CVPR, 2023.
Jihoon Kim, Jiseob Kim, Sungjoon Choi. FLAME: Free-Form Language-Based Motion Synthesis & Editing. Proc. AAAI, 2023.
Rishabh Dabral, Muhammad Hamza Mughal, Vladislav Golyanik, Christian Theobalt. MoFusion: A Framework for Denoising-Diffusion-Based Motion Synthesis. Proc. CVPR, 2023.
Chuan Guo, Yuxuan Mu, Muhammad Gohar Javed, Sen Wang, Li Cheng. MoMask: Generative Masked Modeling of 3D Human Motions. Proc. CVPR, 2024.
Taoran Tang, Jia Jia, Hanyang Mao. Dance with Melody: An LSTM-autoencoder Approach to Music-oriented Dance Synthesis. Proc. ACM MM, 2018.
Ruilong Li, Shan Yang, David A. Ross, Angjoo Kanazawa. AI Choreographer: Music Conditioned 3D Dance Generation with AIST++. Proc. Proceedings of theInternational Conference on Computer Vision (ICCV), 2021.
Zixuan Wang, Jia Jia, Haozhe Wu, Junliang Xing, Jinghe Cai, Fanbo Meng, Guowen Chen, Yanfeng Wang. GroupDancer: Music to Multi-People Dance Synthesis with Style Collaboration. Proc. ACM MM, 2022.
Nhat Le, Trong-Thang Pham, Tuong Do, Erman Tjiputra, Quang D. Tran, Anh Nguyen. Music-Driven Group Choreography. Proc. CVPR, 2023.
Jinwoo Kim, Heeseok Oh, Seongjean Kim, Hoseok Tong, Sanghoon Lee. A Brand New Dance Partner: Music-Conditioned Pluralistic Dancing Controlled by Multiple Dance Genres. Proc. CVPR, 2022.
Guillermo Valle Pérez, Gustav Eje Henter, Jonas Beskow, Andre Holzapfel, Pierre-Yves Oudeyer, Simon Alexanderson. Transflower: probabilistic autoregressive dance generation with multimodal attention. ACM Trans. Graph., 2021.
Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, Ziwei Liu. Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory. Proc. CVPR, 2022.
Jonathan Tseng, Rodrigo Castellon, C. Karen Liu. EDGE: Editable Dance Generation From Music. Proc. CVPR, 2023.
Jibin Gao, Junfu Pu, Honglun Zhang, Ying Shan, Wei-Shi Zheng. PC-Dance: Posture-controllable Music-driven Dance Synthesis. Proc. ACM MM, 2022.
Ho Yin Au, Jie Chen, Junkun Jiang, Yike Guo. ChoreoGraph: Music-conditioned Automatic Dance Choreography over a Style and Tempo Consistent Dynamic Graph. Proc. ACM MM, 2022.
Ruozi Huang, Huang Hu, Wei Wu, Kei Sawada, Mi Zhang, Daxin Jiang. Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learning. Proc. ICLR, 2021.
Jiangxin Sun, Chunyu Wang, Huang Hu, Hanjiang Lai, Zhi Jin, Jian-Fang Hu. You Never Stop Dancing: Non-freezing Dance Generation via Bank-constrained Manifold Projection. Proc. NeurIPS, 2022.
Andreas Aristidou, Anastasios Yiannakidis, Kfir Aberman, Daniel Cohen-Or, Ariel Shamir, Yiorgos Chrysanthou. Rhythm is a Dancer: Music-Driven Motion Synthesis With Global Structure. IEEE Trans. Vis. Comput. Graph., 2023.
Shiry Ginosar, Amir Bar, Gefen Kohavi, Caroline Chan, Andrew Owens, Jitendra Malik. Learning Individual Styles of Conversational Gesture. Proc. CVPR, 2019.
Taras Kucherenko, Dai Hasegawa, Gustav Eje Henter, Naoshi Kaneko, Hedvig Kjellström. Analyzing Input and Output Representations for Speech-Driven Gesture Generation. Proc. IVA, 2019.
Ikhsanul Habibie, Weipeng Xu, Dushyant Mehta, Lingjie Liu, Hans-Peter Seidel, Gerard Pons-Moll, Mohamed Elgharib, Christian Theobalt. Learning Speech-driven 3D Conversational Gestures from Video. Proc. IVA, 2021.
Simon Alexanderson, Rajmund Nagy, Jonas Beskow, Gustav Eje Henter. Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models. ACM Trans. Graph., 2023.
Tenglong Ao, Zeyi Zhang, Libin Liu. GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents. ACM Trans. Graph., 2023. Link
Hongwei Yi, Hualin Liang, Yifei Liu, Qiong Cao, Yandong Wen, Timo Bolkart, Dacheng Tao, Michael J. Black. Generating Holistic 3D Human Motion from Speech. Proc. CVPR, 2023.
Chaitanya Ahuja, Dong Won Lee, Yukiko I. Nakano, Louis-Philippe Morency. Style Transfer for Co-speech Gesture Animation: A Multi-speaker Conditional-Mixture Approach. Proc. ECCV, 2020.
Zhe Cao, Hang Gao, Karttikeya Mangalam, Qi-Zhi Cai, Minh Vo, Jitendra Malik. Long-Term Human Motion Prediction with Scene Context. Proc. ECCV, 2020.
Jingbo Wang, Sijie Yan, Bo Dai, Dahua Lin. Scene-Aware Generative Network for Human Motion Synthesis. Proc. CVPR, 2021.
Mohamed Hassan, Duygu Ceylan, Ruben Villegas, Jun Saito, Jimei Yang, Yi Zhou, Michael J. Black. Stochastic Scene-Aware Motion Prediction. Proc. Proceedings of theInternational Conference on Computer Vision (ICCV), 2021.
Wei Mao, Miaomiao Liu, Richard I. Hartley, Mathieu Salzmann. Contact-aware Human Motion Forecasting. Proc. NeurIPS, 2022.
Jingbo Wang, Yu Rong, Jingyuan Liu, Sijie Yan, Dahua Lin, Bo Dai. Towards Diverse and Natural Scene-aware 3D Human Motion Synthesis. Proc. CVPR, 2022.
Jiashun Wang, Huazhe Xu, Jingwei Xu, Sifei Liu, Xiaolong Wang. Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes. Proc. CVPR, 2021.
João Pedro Araújo, Jiaman Li, Karthik Vetrivel, Rishi Agarwal, Jiajun Wu, Deepak Gopinath, Alexander Clegg, C. Karen Liu. CIRCLE: Capture In Rich Contextual Environments. Proc. CVPR, 2023.
Matthias Plappert, Christian Mandery, Tamim Asfour. The KIT Motion-Language Dataset. Big Data, 2016.
Chuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang, Wei Ji, Xingyu Li, Li Cheng. Generating Diverse and Natural 3D Human Motions from Text. Proc. CVPR, 2022.
Abhinanda R. Punnakkal, Arjun Chandrasekaran, Nikos Athanasiou, Alejandra Quiros-Ramirez, Michael J. Black. BABEL: Bodies, Action and Behavior With English Labels. Proc. CVPR, 2021.
Naureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll, Michael J. Black. AMASS: Archive of Motion Capture as Surface Shapes. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
Yanli Ji, Feixiang Xu, Yang Yang, Fumin Shen, Heng Tao Shen, Wei-Shi Zheng. A Large-scale RGB-D Database for Arbitrary-view Human Action Recognition. Proc. ACM MM, 2018.
Jun Liu, Amir Shahroudy, Mauricio Perez, Gang Wang, Ling-Yu Duan, Alex C. Kot. NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding. IEEE Trans. Pattern Anal. Mach. Intell., 2020.
Ylva Ferstl, Rachel McDonnell. Investigating the use of recurrent motion modelling for speech gesture generation. Proc. IVA, 2018.
Haiyang Liu, Zihao Zhu, Naoya Iwamoto, Yichen Peng, Zhengqing Li, You Zhou, Elif Bozkurt, Bo Zheng. BEAT: A Large-Scale Semantic and Emotional Multi-modal Dataset for Conversational Gestures Synthesis. Proc. ECCV, 2022.
Mohamed Hassan, Vasileios Choutas, Dimitrios Tzionas, Michael J. Black. Resolving 3D Human Pose Ambiguities With 3D Scene Constraints. Proc. ICCV, 2019.
Omid Taheri, Nima Ghorbani, Michael J. Black, Dimitrios Tzionas. GRAB: A Dataset of Whole-Body Human Grasping of Objects. Proc. ECCV, 2020.
Zan Wang, Yixin Chen, Tengyu Liu, Yixin Zhu, Wei Liang, Siyuan Huang. HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes. Proc. NeurIPS, 2022.
Zhongang Cai, Daxuan Ren, Ailing Zeng, Zhengyu Lin, Tao Yu, Wenjia Wang, Xiangyu Fan, Yang Gao, Yifan Yu, Liang Pan, Fangzhou Hong, Mingyuan Zhang, Chen Change Loy, Lei Yang, Ziwei Liu. HuMMan: Multi-modal 4D Human Dataset for Versatile Sensing and Modeling. Proc. ECCV, 2022.
Hsin-Ying Lee, Xiaodong Yang, Ming-Yu Liu, Ting-Chun Wang, Yu-Ding Lu, Ming-Hsuan Yang, Jan Kautz. Dancing to Music. Proc. NeurIPS, 2019.
Buyu Li, Yongchi Zhao, Zhelun Shi, Lu Sheng. DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformer. Proc. AAAI, 2022.
Youngwoo Yoon, Woo-Ri Ko, Minsu Jang, Jaeyeon Lee, Jaehong Kim, Geehyuk Lee. Robots Learn Social Skills: End-to-End Learning of Co-Speech Gesture Generation for Humanoid Robots. Proc. ICRA, 2019.
Youngwoo Yoon, Bok Cha, Joo-Haeng Lee, Minsu Jang, Jaeyeon Lee, Jaehong Kim, Geehyuk Lee. Speech gesture generation from the trimodal context of text, audio, and speaker identity. ACM Trans. Graph., 2020.
Saeed Ghorbani, Ylva Ferstl, Daniel Holden, Nikolaus F. Troje, Marc-André Carbonneau. ZeroEGGS: Zero-shot Example-based Gesture Generation from Speech. Comput. Graph. Forum, 2023.
Christian Mandery, Ömer Terlemez, Martin Do, Nikolaus Vahrenkamp, Tamim Asfour. The KIT whole-body human motion database. Proc. ICAR, 2015.
Manolis Savva, Angel X. Chang, Pat Hanrahan, Matthew Fisher, Matthias Nießner. PiGraphs: learning interaction snapshots from observations. ACM Trans. Graph., 2016.
Áron Monszpart, Paul Guerrero, Duygu Ceylan, Ersin Yumer, Niloy J. Mitra. iMapper: interaction-guided scene mapping from monocular videos. ACM Trans. Graph., 2019.
Vladimir Guzov, Aymen Mir, Torsten Sattler, Gerard Pons-Moll. Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-Localization in Large Scenes From Body-Mounted Sensors. Proc. CVPR, 2021.
Xiaohan Zhang, Bharat Lal Bhatnagar, Sebastian Starke, Vladimir Guzov, Gerard Pons-Moll. COUCH: Towards Controllable Human-Chair Interactions. Proc. ECCV, 2022.
Anand Gopalakrishnan, Ankur Arjun Mali, Dan Kifer, C. Lee Giles, Alexander G. Ororbia II. A Neural Temporal Model for Human Motion Prediction. Proc. CVPR, 2019.
Julian Tanke, Chintan Zaveri, Juergen Gall. Intention-based Long-Term Human Motion Anticipation. Proc. 3DV, 2021.
Yi Yang, Deva Ramanan. Articulated Human Detection with Flexible Mixtures of Parts. IEEE Trans. Pattern Anal. Mach. Intell., 2013.
Sicheng Yang, Zhiyong Wu, Minglei Li, Zhensong Zhang, Lei Hao, Weihong Bao, Haolin Zhuang. Qpgesture: Quantization-based and phase-guided motion matching for natural speech-driven gesture generation. Proc. CVPR, 2023.
Alejandro Hernandez Ruiz, Jürgen Gall, Francesc Moreno. Human Motion Prediction via Spatio-Temporal Inpainting. Proc. Proceedings of theInternational Conference on Computer Vision (ICCV), 2019.
Yan Zhang, Siyu Tang. The Wanderings of Odysseus in 3D Scenes. Proc. CVPR, 2022.
Ye Yuan, Kris Kitani. DLow: Diversifying Latent Flows for Diverse Human Motion Prediction. Proc. ECCV, 2020.
Zhangsihao Yang, Mingyuan Zhou, Mengyi Shan, Bingbing Wen, Ziwei Xuan, Mitch Hill, Junjie Bai, Guo-Jun Qi, Yalin Wang. OmniMotionGPT: Animal Motion Generation with Limited Data. Proc. CVPR, 2024.
Zeyu Zhang, Yiran Wang, Biao Wu, Shuo Chen, Zhiyuan Zhang, Shiya Huang, Wenbo Zhang, Meng Fang, Ling Chen, Yang Zhao. Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motion. Proc. BMVC, 2024.
Sigal Raab, Inbal Leibovitch, Guy Tevet, Moab Arar, Amit Haim Bermano, Daniel Cohen-Or. Single Motion Diffusion. Proc. ICLR, 2024.
Xuan Wang, Kai Ruan, Xing Zhang, Gaoang Wang. AniMo: Species-Aware Model for Text-Driven Animal Motion Generation. Proc. CVPR, 2025.
Xuan Wang, Kai Ruan, Liyang Qian, Zhizhi Guo, Chang Su, Gaoang Wang. X-MoGen: Unified Motion Generation across Humans and Animals. CoRR, 2025.
Sinead Kearney, Wenbin Li, Martin Parsons, Kwang In Kim, Darren Cosker. RGBD-Dog: Predicting Canine Pose from RGBD Sensors. Proc. CVPR, 2020.
Moira Shooter, Charles Malleson, Adrian Hilton. Benchmarking Monocular 3D Dog Pose Estimation Using In-The-Wild Motion Capture Data. CoRR, 2024.
Yang Li, Hikari Takehara, Takafumi Taketomi, Bo Zheng, Matthias Nießner. 4DComplete: Non-Rigid Motion Estimation Beyond the Observable Surface. Proc. Proceedings of theInternational Conference on Computer Vision (ICCV), 2021.
Jiyang Gao, Chen Sun, Hang Zhao, Yi Shen, Dragomir Anguelov, Congcong Li, Cordelia Schmid. VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Ming Liang, Bin Yang, Rui Hu, Yun Chen, Renjie Liao, Song Feng, Raquel Urtasun. Learning Lane Graph Representations for Motion Forecasting. Proceedings of the European Conference on Computer Vision (ECCV), 2020.
Nigamaa Nayakanti, Rami Al-Rfou, Aurick Zhou, Kratarth Goel, Khaled S Refaat, Benjamin Sapp. Wayformer: Motion Forecasting via Simple and Efficient Attention Networks. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2023.
Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele. Motion Transformer with Global Intention Localization and Local Movement Refinement. Advances in Neural Information Processing Systems (NeurIPS), 2022.
Kunpeng Zhang, Xiaoliang Feng, Lan Wu, Zhengbing He. Trajectory Prediction for Autonomous Driving Using Spatial-Temporal Graph Attention Transformer. IEEE Trans. Intell. Transp. Syst., 2022.
Alexandre Alahi, Kratarth Goel, Vignesh Ramanathan, Alexandre Robicquet, Li Fei-Fei, Silvio Savarese. Social LSTM: Human Trajectory Prediction in Crowded Spaces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Agrim Gupta, Justin Johnson, Li Fei-Fei, Silvio Savarese, Alexandre Alahi. Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Tim Salzmann, Boris Ivanovic, Punarjay Chakravarty, Marco Pavone. Trajectron++: Dynamically-Feasible Trajectory Forecasting with Heterogeneous Data. Proceedings of the European Conference on Computer Vision (ECCV), 2020.
Junru Gu, Chen Sun, Hang Zhao. DenseTNT: End-to-End Trajectory Prediction from Dense Goal Sets. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
Chiyu Max Jiang, Andre Cornman, Cheolho Park, Benjamin Sapp, Yin Zhou, Dragomir Anguelov. MotionDiffuser: Controllable Multi-Agent Motion Prediction Using Diffusion. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Mayank Bansal, Alex Krizhevsky, Abhijit Ogale. ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst. Robotics: Science and Systems (RSS), 2019.
Ming-Fang Chang, John Lambert, Patsorn Sangkloy, Jagjeet Singh, Slawomir Bak, Andrew Hartnett, De Wang, Peter Carr, Simon Lucey, Deva Ramanan, James Hays. Argoverse: 3D Tracking and Forecasting With Rich Maps. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2019.
Félix G Harvey, Mike Yurick, Derek Nowrouzezahrai, Christopher Pal. Robust Motion In-betweening. ACM Transactions on Graphics (TOG), 2020.
Setareh Cohan, Guy Tevet, Daniele Reda, Xue Bin Peng, Michiel van de Panne. Flexible Motion In-betweening with Diffusion Models. ACM SIGGRAPH Conference Papers, 2024.
Yonatan Shafir, Guy Tevet, Roy Kapon, Amit H Bermano. Human Motion Diffusion as a Generative Prior. International Conference on Learning Representations (ICLR), 2024.
Korrawe Karunratanakul, Konpat Preechakul, Supasorn Suwajanakorn, Siyu Tang. Guided Motion Diffusion for Controllable Human Motion Synthesis. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Yiming Xie, Varun Jampani, Lei Zhong, Deqing Sun, Huaizu Jiang. OmniControl: Control Any Joint at Any Time for Human Motion Generation. International Conference on Learning Representations (ICLR), 2024.
Korrawe Karunratanakul, Konpat Preechakul, Emre Aksan, Thabo Beeler, Supasorn Suwajanakorn, Siyu Tang. Optimizing Diffusion Noise Can Serve as Universal Motion Priors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Nikos Athanasiou, Alpar Cseke, Markos Diomataris, Michael J Black, Gül Varol. MotionFix: Text-Driven 3D Human Motion Editing. SIGGRAPH Asia Conference Papers, 2024.
Purvi Goel, Kuan-Chieh Wang, C Karen Liu, Kayvon Fatahalian. Iterative Motion Editing with Natural Language. ACM SIGGRAPH Conference Papers, 2024.
William Harvey, Saeid Naderiparizi, Vaden Masrani, Christian Weilbach, Frank Wood. Flexible diffusion modeling of long videos. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Haoyu Zhao, Hao Wang, Chen Yang, Wei Shen. Chase: 3d-consistent human avatars with sparse inputs via gaussian splatting and contrastive learning. arXiv e-prints, 2024.
Uriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, et al.. Text-to-4d dynamic scene generation. arXiv preprint arXiv:2301.11280, 2023. arXiv
Yufeng Zheng, Xueting Li, Koki Nagano, Sifei Liu, Otmar Hilliges, Shalini De Mello. A unified approach for text-and image-guided 4d scene generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Yanqin Jiang, Li Zhang, Jin Gao, Weimin Hu, Yao Yao. Consistent4d: Consistent 360 $\$$$deg$\$ dynamic object generation from monocular video. arXiv preprint arXiv:2311.02848, 2023. arXiv
Huan Ling, Seung Wook Kim, Antonio Torralba, Sanja Fidler, Karsten Kreis. Align your gaussians: Text-to-4d with dynamic 3d gaussians and composed diffusion models. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Chen Guo, Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges. Vid2avatar: 3d avatar reconstruction from videos in the wild via self-supervised scene decomposition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Haoyu Zhao, Xingyue Zhao, Lingting Zhu, Weixi Zheng, Yongchao Xu. Hfgs: 4d gaussian splatting with emphasis on spatial and temporal high-frequency components for endoscopic scene reconstruction. arXiv preprint arXiv:2405.17872, 2024. arXiv
Qiaowei Miao, Jinsheng Quan, Kehan Li, Yawei Luo. Pla4d: Pixel-level alignments for text-to-4d gaussian splatting. arXiv preprint arXiv:2405.19957, 2024. arXiv
Ruiyuan Gao, Kai Chen, Zhihao Li, Lanqing Hong, Zhenguo Li, Qiang Xu. Magicdrive3d: Controllable 3d generation for any-view rendering in street scenes. arXiv preprint arXiv:2405.14475, 2024. arXiv
Haoyu Zhao, Hao Wang, Xingyue Zhao, Hao Fei, Hongqiu Wang, Chengjiang Long, Hua Zou. Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splatting. arXiv preprint arXiv:2411.12789, 2024. arXiv
Ce Chen, Shaoli Huang, Xuelin Chen, Guangyi Chen, Xiaoguang Han, Kun Zhang, Mingming Gong. Ct4d: Consistent text-to-4d generation with animatable meshes. arXiv preprint arXiv:2408.08342, 2024. arXiv
Ziyi Yang, Xinyu Gao, Wen Zhou, Shaohui Jiao, Yuqing Zhang, Xiaogang Jin. Deformable 3d gaussians for high-fidelity monocular dynamic scene reconstruction. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Dejia Xu, Hanwen Liang, Neel P Bhatt, Hezhen Hu, Hanxue Liang, Konstantinos N Plataniotis, Zhangyang Wang. Comp4d: Llm-guided compositional 4d scene generation. arXiv preprint arXiv:2403.16993, 2024. arXiv
Sisi Dai, Xinxin Su, Boyan Wan, Ruizhen Hu, Kai Xu. TextMesh4D: High-Quality Text-to-4D Mesh Generation. arXiv preprint arXiv:2506.24121, 2025. arXiv
Sherwin Bahmani, Ivan Skorokhodov, Victor Rong, Gordon Wetzstein, Leonidas Guibas, Peter Wonka, Sergey Tulyakov, Jeong Joon Park, Andrea Tagliasacchi, David B Lindell. 4d-fy: Text-to-4d generation using hybrid score distillation sampling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Heng Yu, Chaoyang Wang, Peiye Zhuang, Willi Menapace, Aliaksandr Siarohin, Junli Cao, László Jeni, Sergey Tulyakov, Hsin-Ying Lee. 4real: Towards photorealistic 4d scene generation via video diffusion models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Yukang Cao, Liang Pan, Kai Han, Kwan-Yee K Wong, Ziwei Liu. Avatargo: Zero-shot 4d human-object interaction generation and animation. arXiv preprint arXiv:2410.07164, 2024. arXiv
Hanwen Liang, Yuyang Yin, Dejia Xu, Hanxue Liang, Zhangyang Wang, Konstantinos N Plataniotis, Yao Zhao, Yunchao Wei. Diffusion4d: Fast spatial-temporal consistent 4d generation via video diffusion models. arXiv preprint arXiv:2405.16645, 2024. arXiv
Yiming Xie, Chun-Han Yao, Vikram Voleti, Huaizu Jiang, Varun Jampani. Sv4d: Dynamic 3d content generation with multi-frame and multi-view consistency. arXiv preprint arXiv:2407.17470, 2024. arXiv
Alain Hore, Djemel Ziou. Image quality metrics: PSNR vs. SSIM. 2010 20th international conference on pattern recognition, 2010.
Zeyu Yang, Zijie Pan, Chun Gu, Li Zhang. Diffusion$^2$: Dynamic 3d content generation via score composition of video and multi-view diffusion models. arXiv preprint arXiv:2404.02148, 2024. arXiv
Yuyang Zhao, Chung-Ching Lin, Kevin Lin, Zhiwen Yan, Linjie Li, Zhengyuan Yang, Jianfeng Wang, Gim Hee Lee, Lijuan Wang. Genxd: Generating any 3d and 4d scenes. arXiv preprint arXiv:2411.02319, 2024. arXiv
Ruizhi Shao, Youxin Pang, Zerong Zheng, Jingxiang Sun, Yebin Liu. 360-degree human video generation with 4d diffusion transformer. ACM Transactions on Graphics (TOG), 2024.
Hui En Pang, Shuai Liu, Zhongang Cai, Lei Yang, Tianwei Zhang, Ziwei Liu. Disco4d: Disentangled 4d human generation and animation from a single image. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Zhiqi Li, Yiming Chen, Peidong Liu. Dreammesh4d: Video-to-4d generation with sparse-controlled gaussian-mesh hybrid representation. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Jianqi Chen, Biao Zhang, Xiangjun Tang, Peter Wonka. V2M4: 4D Mesh Animation Reconstruction from a Single Monocular Video. arXiv preprint arXiv:2503.09631, 2025. arXiv
Haiyu Zhang, Xinyuan Chen, Yaohui Wang, Xihui Liu, Yunhong Wang, Yu Qiao. 4diffusion: Multi-view video diffusion model for 4d generation. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Zijie Pan, Zeyu Yang, Xiatian Zhu, Li Zhang. Efficient4d: Fast dynamic 3d object generation from a single-view video. arXiv preprint arXiv:2401.08742, 2024. arXiv
Zijie Wu, Chaohui Yu, Yanqin Jiang, Chenjie Cao, Fan Wang, Xiang Bai. Sc4d: Sparse-controlled video-to-4d generation and motion transfer. European Conference on Computer Vision, 2024.
Jiawei Ren, Cheng Xie, Ashkan Mirzaei, Karsten Kreis, Ziwei Liu, Antonio Torralba, Sanja Fidler, Seung Wook Kim, Huan Ling, et al.. L4gm: Large 4d gaussian reconstruction model. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024.
Ziya Erkoç, Fangchang Ma, Qi Shan, Matthias Nießner, Angela Dai. Hyperdiffusion: Generating implicit neural fields with weight-space diffusion. Proceedings of the IEEE/CVF international conference on computer vision, 2023.
Naima Otberdout, Claudio Ferrari, Mohamed Daoudi, Stefano Berretti, Alberto Del Bimbo. Sparse to dense dynamic 3d facial expression generation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
Chaoyue Song, Jianfeng Zhang, Xiu Li, Fan Yang, Yiwen Chen, Zhongcong Xu, Jun Hao Liew, Xiaoyang Guo, Fayao Liu, Jiashi Feng, et al.. Magicarticulate: Make your 3d models articulation-ready. Proceedings of the Computer Vision and Pattern Recognition Conference, 2025.
Isabella Liu, Zhan Xu, Wang Yifan, Hao Tan, Zexiang Xu, Xiaolong Wang, Hao Su, Zifan Shi. Riganything: Template-free autoregressive rigging for diverse 3d assets. ACM Transactions on Graphics (TOG), 2025.
Chaoyue Song, Xiu Li, Fan Yang, Zhongcong Xu, Jiacheng Wei, Fayao Liu, Jiashi Feng, Guosheng Lin, Jianfeng Zhang. Puppeteer: Rig and animate your 3d models. arXiv preprint arXiv:2508.10898, 2025. arXiv
Zijie Wu, Chaohui Yu, Fan Wang, Xiang Bai. AnimateAnyMesh: A Feed-Forward 4D Foundation Model for Text-Driven Universal Mesh Animation. arXiv preprint arXiv:2506.09982, 2025. arXiv
Sherwin Bahmani, Xian Liu, Wang Yifan, Ivan Skorokhodov, Victor Rong, Ziwei Liu, Xihui Liu, Jeong Joon Park, Sergey Tulyakov, Gordon Wetzstein, et al.. Tc4d: Trajectory-conditioned text-to-4d generation. European Conference on Computer Vision, 2024.
Jiajing Lin, Zhenzhong Wang, Yongjie Hou, Yuzhou Tang, Min Jiang. Phy124: Fast physics-driven 4d content generation from a single image. arXiv preprint arXiv:2409.07179, 2024. arXiv
Shengqu Cai, Duygu Ceylan, Matheus Gadelha, Chun-Hao Paul Huang, Tuanfeng Yang Wang, Gordon Wetzstein. Generative rendering: Controllable 4d-guided video generation with 2d diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Guo-Wei Yang, Dong-Yu Chen, Tai-Jiang Mu. Sketch-2-4D: Sketch driven dynamic 3D scene generation. Graphical Models, 2024.
Pascale Fung, Yoram Bachrach, Asli Celikyilmaz, Kamalika Chaudhuri, Delong Chen, Willy Chung, Emmanuel Dupoux, Hongyu Gong, Hervé Jégou, Alessandro Lazaric, et al.. Embodied ai agents: Modeling the world. arXiv preprint arXiv:2506.22355, 2025. arXiv
Xinqing Li, Xin He, Le Zhang, Min Wu, Xiaoli Li, Yun Liu. A Comprehensive Survey on World Models for Embodied AI. arXiv preprint arXiv:2510.16732, 2025. arXiv
Jingtao Ding, Yunke Zhang, Yu Shang, Yuheng Zhang, Zefang Zong, Jie Feng, Yuan Yuan, Hongyuan Su, Nian Li, Nicholas Sukiennik, et al.. Understanding world or predicting future? a comprehensive survey of world models. ACM Computing Surveys, 2025.
Adrien Bardes, Quentin Garrido, Jean Ponce, Xinlei Chen, Michael Rabbat, Yann LeCun, Mahmoud Assran, Nicolas Ballas. Revisiting Feature Prediction for Learning Visual Representations from Video. International Conference on Learning Representations, 2025.
Randall Balestriero, Yann LeCun. LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics. arXiv preprint arXiv:2511.08544, 2025. arXiv
Lucas Maes, Quentin Le Lidec, Damien Scieur, Yann LeCun, Randall Balestriero. LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels. arXiv preprint arXiv:2603.19312, 2026. arXiv
Hai Huang, Yann LeCun, Randall Balestriero. LLM-JEPA: Large Language Models Meet Joint Embedding Predictive Architectures. International Conference on Learning Representations, 2026.
Federico Baldassarre, Marc Szafraniec, Basile Terver, Vasil Khalidov, Francisco Massa, Yann LeCun, Patrick Labatut, Maximilian Seitzer, Piotr Bojanowski. Back to the features: Dino as a foundation for video world models. arXiv preprint arXiv:2507.19468, 2025. arXiv
Chen Min, Dawei Zhao, Liang Xiao, Yiming Nie, Bin Dai. Uniworld: Autonomous driving pre-training via world models. arXiv preprint arXiv:2308.07234, 2023. arXiv
Haoyi Zhu, Yifan Wang, Jianjun Zhou, Wenzheng Chang, Yang Zhou, Zizun Li, Junyi Chen, Chunhua Shen, Jiangmiao Pang, Tong He. Aether: Geometric-aware unified world modeling. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Jessy Lin, Yuqing Du, Olivia Watkins, Danijar Hafner, Pieter Abbeel, Dan Klein, Anca Dragan. Learning to model the world with language. arXiv preprint arXiv:2308.01399, 2023. arXiv
Alexey Dosovitskiy, German Ros, Felipe Codevilla, Antonio López, Vladlen Koltun. CARLA: An Open Urban Driving Simulator. Conference on Robot Learning (CoRL), 2017.
NVIDIA. NVIDIA Isaac SDK and Isaac Sim (2021) — Developer Documentation. 2021. Link
Anthony Hu, Lloyd Russell, Hudson Yeo, Zak Murez, George Fedoseev, Alex Kendall, Jamie Shotton, Gianluca Corrado. Gaia-1: A generative world model for autonomous driving. arXiv preprint arXiv:2309.17080, 2023. arXiv
Genesis Authors. Genesis: A Generative and Universal Physics Engine for Robotics and Beyond. 2024. Link
Xuemeng Yang, Licheng Wen, Tiantian Wei, Yukai Ma, Jianbiao Mei, Xin Li, Wenjie Lei, Daocheng Fu, Pinlong Cai, Min Dou, et al.. Drivearena: A closed-loop generative simulation platform for autonomous driving. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025.
Wenzhao Zheng, Weiliang Chen, Yuanhui Huang, Borui Zhang, Yueqi Duan, Jiwen Lu. Occworld: Learning a 3d occupancy world model for autonomous driving. European conference on computer vision, 2024.
Lening Wang, Wenzhao Zheng, Yilong Ren, Han Jiang, Zhiyong Cui, Haiyang Yu, Jiwen Lu. Occsora: 4d occupancy generation models as world simulators for autonomous driving. arXiv preprint arXiv:2405.20337, 2024. arXiv
Lunjun Zhang, Yuwen Xiong, Ze Yang, Sergio Casas, Rui Hu, Raquel Urtasun. Copilot4d: Learning unsupervised world models for autonomous driving via discrete diffusion. arXiv preprint arXiv:2311.01017, 2023. arXiv
World Labs. Atlas: A World Model for Spatial Intelligence. r̆lhttps://www.worldlabs.ai/blog/atlas, 2026.
Nicola Dainese, Matteo Merler, Minttu Alakuijala, Pekka Marttinen. Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search. Advances in Neural Information Processing Systems, 2024.
Hao Tang, Darren Key, Kevin Ellis. WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment. Advances in Neural Information Processing Systems, 2024.
Ziniu Hu, Ahmet Iscen, Aashi Jain, Thomas Kipf, Yisong Yue, David A Ross, Cordelia Schmid, Alireza Fathi. SceneCraft: An LLM Agent for Synthesizing 3D Scenes as Blender Code. International Conference on Machine Learning, 2024.
Yi Zhang, Yunshuang Wang, Zeyu Zhang, Hao Tang. Code2Worlds: Empowering Coding LLMs for 4D World Generation. arXiv preprint arXiv:2602.11757, 2026. arXiv
Haoyu Zhang, Siming Li, Zeyu Zhang, Yi Zhang, Tat-Seng Chua, Hao Tang. Code2Worlds-2: Physically Plausible Agent Harness for Embodied World Simulation. arXiv preprint arXiv:2610.17651, 2026. arXiv
Hongyu Wang, Jingquan Wang, Ashvin Anilkumar, Bocheng Zou, Radu Serban, Dan Negrut. ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Construction. arXiv preprint arXiv:2605.14398, 2026. arXiv
Janet Wilde Astington, Jennifer M Jenkins. Theory of mind development and social understanding. Cognition & Emotion, 1995.
Nancy J Nersessian. In the theoretician's laboratory: Thought experimenting as mental modeling. PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association, 1993.
Nancy Staggers, Anthony F. Norcio. Mental models: concepts for human-computer interaction research. International Journal of Man-machine studies, 1993.
Anand S Rao, Michael P Georgeff, et al.. BDI agents: From theory to practice.. Icmas, 1995.
Michael Georgeff, Barney Pell, Martha Pollack, Milind Tambe, Michael Wooldridge. The belief-desire-intention model of agency. International workshop on agent theories, architectures, and languages, 1998.
Matthew Le, Y-Lan Boureau, Maximilian Nickel. Revisiting the evaluation of theory of mind through question answering. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019.
Kanishk Gandhi, Jan-Philipp Fränken, Tobias Gerstenberg, Noah Goodman. Understanding social reasoning in language models with language models. Advances in Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track, 2023.
Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Tomer Ullman, Antonio Torralba, Joshua Tenenbaum, Tianmin Shu. MMToM-QA: Multimodal theory of mind question answering. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024.
Yoav IH Parish, Pascal Müller. Procedural modeling of cities. Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 2001.
Aristid Lindenmayer. Mathematical models for cellular interactions in development I. Filaments with one-sided inputs. Journal of theoretical biology, 1968.
George Stiny. Introduction to shape and shape grammars. Environment and planning B: planning and design, 1980.
Qi Bing, Chaoyi Zhang, Weidong Cai. Learning to synthesize graphics programs for geometric artworks. International Conference on Pattern Recognition, 2025.
Kevin Ellis, Daniel Ritchie, Armando Solar-Lezama, Josh Tenenbaum. Learning to infer graphics programs from hand-drawn images. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2018.
Yunnong Chen, Shixian Ding, YingYing Zhang, Wenkai Chen, Jinzhou Du, Lingyun Sun, Liuqing Chen. DesignCoder: Hierarchy-Aware and Self-Correcting UI Code Generation with Large Language Models. arXiv preprint arXiv:2506.13663, 2025. arXiv
Zhihao Zhu, Zhan Xue, Zejian Yuan. Automatic graphics program generation using attention-based hierarchical decoder. Asian Conference on Computer Vision, 2018.
R Kenny Jones, Theresa Barton, Xianghao Xu, Kai Wang, Ellen Jiang, Paul Guerrero, Niloy J Mitra, Daniel Ritchie. Shapeassembly: Learning to generate programs for 3d shape structure synthesis. ACM Transactions on Graphics (TOG), 2020.
Rio Aguina-Kang, Maxim Gumin, Do Heon Han, Stewart Morris, Seung Jean Yoo, Aditya Ganeshan, R Kenny Jones, Qiuhong Anna Wei, Kailiang Fu, Daniel Ritchie. Open-universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases. arXiv preprint arXiv:2403.09675, 2024. arXiv
Joy Hsu, Emily Jin, Jiajun Wu, Niloy J Mitra. From Programs to Poses: Factored Real-World Scene Generation via Learned Program Libraries. arXiv preprint arXiv:2510.10292, 2025. arXiv
Yue Yang, Fan-Yun Sun, Luca Weihs, Eli VanderBilt, Alvaro Herrasti, Winson Han, Jiajun Wu, Nick Haber, Ranjay Krishna, Lingjie Liu, et al.. Holodeck: Language Guided Generation of 3D Embodied AI Environments. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Kaichun Mo, Shilin Zhu, Angel X. Chang, Li Yi, Subarna Tripathi, Leonidas J. Guibas, Hao Su. PartNet: A large-scale benchmark for fine-grained and hierarchical part-level 3D object understanding. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019.
Jiaming Guo, Rui Zhang, Shaohui Peng, Qi Yi, Xing Hu, Ruizhi Chen, Zidong Du, Ling Li, Qi Guo, Yunji Chen, et al.. Efficient symbolic policy learning with differentiable symbolic expression. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Matt Deitke, Eli VanderBilt, Alvaro Herrasti, Luca Weihs, Jordi Salvador, Kiana Ehsani, Winson Han, Eric Kolve, Ali Farhadi, Aniruddha Kembhavi, Roozbeh Mottaghi. ProcTHOR: Large-Scale Embodied AI Using Procedural Generation. NeurIPS, 2022.
Rong Wang, Kun Sun, Jonas Kuhn. A pipeline of neural-symbolic integration to enhance spatial reasoning in large language models. arXiv e-prints, 2024.
Mara Levy, Siddhant Haldar, Lerrel Pinto, Abhinav Shirivastava. P3-PO: Prescriptive Point Priors for Visuo-Spatial Generalization of Robot Policies. 2024. arXiv
Mathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou, Julien Mairal, Piotr Bojanowski, Armand Joulin. Emerging properties in self-supervised vision transformers. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2021.
Haoyu Zhao, Cheng Zeng, Linghao Zhuang, Yaxi Zhao, Shengke Xue, Hao Wang, Xingyue Zhao, Zhongyu Li, Kehan Li, Siteng Huang, et al.. High-Fidelity Simulated Data Generation for Real-World Zero-Shot Robotic Manipulation Learning with Gaussian Splatting. arXiv preprint arXiv:2510.10637, 2025. arXiv
Junyi Zhang, Charles Herrmann, Junhwa Hur, Luisa Polania Cabrera, Varun Jampani, Deqing Sun, Ming-Hsuan Yang. A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence. 2023. arXiv
Homanga Bharadhwaj, Roozbeh Mottaghi, Abhinav Gupta, Shubham Tulsiani. Track2act: Predicting point tracks from internet videos enables generalizable robot manipulation. European Conference on Computer Vision, 2024.
Xiaolin Fang, Bo-Ruei Huang, Jiayuan Mao, Jasmine Shone, Joshua B. Tenenbaum, Tomás Lozano-Pérez, Leslie Pack Kaelbling. Keypoint Abstraction using Large Models for Object-Relative Imitation Learning. 2024. arXiv
Siddhant Haldar, Lerrel Pinto. Point Policy: Unifying Observations and Actions with Key Points for Robot Manipulation. 2025. arXiv
Viktor Makoviychuk, Lukasz Wawrzyniak, Yunrong Guo, Michelle Lu, Kier Storey, Miles Macklin, David Hoeller, Nikita Rudin, Arthur Allshire, Ankur Handa, et al.. Isaac gym: High performance gpu-based physics simulation for robot learning. arXiv preprint arXiv:2108.10470, 2021. arXiv
Haoran Geng, Helin Xu, Chengyang Zhao, Chao Xu, Li Yi, Siyuan Huang, He Wang. Gapartnet: Cross-category domain-generalizable object perception and manipulation via generalizable and actionable parts. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Ajay Mandlekar, Danfei Xu, Josiah Wong, Soroush Nasiriany, Chen Wang, Rohun Kulkarni, Li Fei-Fei, Silvio Savarese, Yuke Zhu, Roberto Martín-Mart\ń. What Matters in Learning from Offline Human Demonstrations for Robot Manipulation. arXiv preprint arXiv:2108.03298, 2021.
Yan Duan, Marcin Andrychowicz, Bradly C. Stadie, Jonathan Ho, Jonas Schneider, Ilya Sutskever, Pieter Abbeel, Wojciech Zaremba. One-Shot Imitation Learning. 2017. arXiv
Thanh-Toan Do, Anh Nguyen, Ian Reid. Affordancenet: An end-to-end deep learning approach for object affordance detection. International Conference on Robotics and Automation (ICRA), 2018.
Zengyi Qin, Kuan Fang, Yuke Zhu, Li Fei-Fei, Silvio Savarese. Keto: Learning keypoint representations for tool manipulation. 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020.
Andy Zeng, Pete Florence, Jonathan Tompson, Stefan Welker, Jonathan Chien, Maria Attarian, Travis Armstrong, Ivan Krasin, Dan Duong, Vikas Sindhwani, et al.. Transporter networks: Rearranging the visual world for robotic manipulation. Conference on Robot Learning, 2020.
Weiyu Liu, Chris Paxton, Tucker Hermans, Dieter Fox. Structformer: Learning spatial structure for language-guided semantic rearrangement of novel objects. 2022 International Conference on Robotics and Automation (ICRA), 2022.
Yuchi Zhao, Miroslav Bogdanovic, Chengyuan Luo, Steven Tohme, Kourosh Darvish, Alán Aspuru-Guzik, Florian Shkurti, Animesh Garg. AnyPlace: Learning Generalized Object Placement for Robot Manipulation. arXiv preprint arXiv:2502.04531, 2025. arXiv
Alexander Stoytchev. Learning the affordances of tools using a behavior-grounded approach. Towards Affordance-Based Robot Control: International Seminar, Dagstuhl Castle, Germany, June 5-9, 2006. Revised Papers, 2008.
Vadim Tikhanoff, Ugo Pattacini, Lorenzo Natale, Giorgio Metta. Exploring affordances and tool use on the iCub. 2013 13th IEEE-RAS international conference on humanoid robots (humanoids), 2013.
Tongzhou Mu, Zhan Ling, Fanbo Xiang, Derek C Yang, Xuan Li, Stone Tao, Zhiao andJZhiwei, Jia Huang, Hao Su. ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrations. Proceedings of the Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2021.
Fanbo Xiang, Yuzhe Qin, Kaichun Mo, Yikuan Xia, Hao Zhu, Fangchen Liu, Minghua Liu, Hanxiao Jiang, Yifu Yuan, He Wang, Li Yi, Angel X. Chang, Leonidas J. Guibas, Hao Su. SAPIEN: A SimulAted Part-based Interactive ENvironment. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Ishika Singh, Ankit Goyal, Stan Birchfield, Dieter Fox, Animesh Garg, Valts Blukis. OG-VLA: 3D-Aware Vision Language Action Model via Orthographic Image Generation. arXiv preprint arXiv:2506.01196, 2025. arXiv
Delin Qu, Haoming Song, Qizhi Chen, Yuanqi Yao, Xinyi Ye, Yan Ding, Zhigang Wang, JiaYuan Gu, Bin Zhao, Dong Wang, et al.. Spatialvla: Exploring spatial representations for visual-language-action model. arXiv preprint arXiv:2501.15830, 2025. arXiv
Qi Sun, Pengfei Hong, Tej Deep Pala, Vernon Toh, U Tan, Deepanway Ghosal, Soujanya Poria, et al.. Emma-x: An embodied multimodal action model with grounded chain of thought and look-ahead spatial reasoning. arXiv preprint arXiv:2412.11974, 2024. arXiv
Jason Lee, Jiafei Duan, Haoquan Fang, Yuquan Deng, Shuo Liu, Boyang Li, Bohan Fang, Jieyu Zhang, Yi Ru Wang, Sangho Lee, et al.. Molmoact: Action reasoning models that can reason in space. arXiv preprint arXiv:2508.07917, 2025. arXiv
Haoquan Fang, Jiafei Duan, Donovan Clay, Sam Wang, Shuo Liu, Weikai Huang, Xiang Fan, Wei-Chuan Tsai, Shirui Chen, Yi Ru Wang, et al.. Molmoact2: Action reasoning models for real-world deployment. arXiv preprint arXiv:2605.02881, 2026. arXiv
Lin Shao, et al.. Robo-ABC: Affine-Invariant Spatial Reasoning for Robot Manipulation. arXiv preprint arXiv:2401.10321, 2024. arXiv
Muyang Yan, Miras Mengdibayev, Ardon Floros, Weihang Guo, Lydia E. Kavraki, Zachary Kingston. Using VLM Reasoning to Constrain Task and Motion Planning. 2025. arXiv
Lucas Chen, Shrutheesh R. Iyer, Zachary Kingston. Differentiable Particle Optimization for Fast Sequential Manipulation. 2025. arXiv
C. Daniel Freeman, Erik Frey, Anton Raichuk, Sertan Girgin, Igor Mordatch, Olivier Bachem. Brax--a differentiable physics engine for large scale rigid body simulation. Advances in Neural Information Processing Systems, Datasets and Benchmarks Track, 2021.
C. P. Quintero, et al.. Stochastic Implicit Neural Signed Distance Functions for Safe Motion Planning under Sensing Uncertainty. IEEE Robotics and Automation Letters, 2024.
Wonsuhk Jung, Utkarsh A. Mishra, et al.. Joint Model-based Model-free Diffusion for Planning with Constraints. 2025.
Jianlan Luo, et al.. FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learning. arXiv preprint arXiv:2301.12345, 2023. arXiv
Ralf Römer, Alexander von Rohr, Angela P. Schoellig. Diffusion Predictive Control with Constraints. 2025. arXiv
Ekim Yurtsever, Jacob Lambert, Alexander Carballo, Kazuya Takeda. A Survey of Autonomous Driving: Common Practices and Emerging Technologies. IEEE Access, 2020.
Bernd Carsten Stahl, Job Timmermans, Brent Daniel Mittelstadt. The Ethics of Computing: A Survey of the Computing-Oriented Literature. ACM Comput. Surv., 2016.
Ronald C Fisher. Governmental expenditure implications of autonomous vehicles. National Tax Journal, 2020.
Hong Wang, Bing Lu, Jun Li, Teng Liu, Yang Xing, Chen Lv, Dongpu Cao, Jingxuan Li, Jinwei Zhang, Ehsan Hashemi. Risk Assessment and Mitigation in Local Path Planning for Autonomous Vehicles With LSTM Based Predictive Model. IEEE Trans Autom. Sci. Eng., 2022.
Dekang Zhu, Qianyi Bu, Zhongpan Zhu, Yujie Zhang, Zhipeng Wang. Advancing autonomy through lifelong learning: a survey of autonomous intelligent systems. Frontiers Neurorobotics, 2024.
Di Feng, Ali Harakeh, Steven L. Waslander, Klaus Dietmayer. A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving. IEEE Trans. Intell. Transp. Syst., 2022.
Philip Koopman, Frank Fratrik. How Many Operational Design Domains, Objects, and Events?. Proc. Workshop on Artificial Intelligence Safety AAAI, 2019.
Yuxiao Zhang, Alexander Carballo, Hanting Yang, Kazuya Takeda. Perception and sensing for autonomous vehicles under adverse weather conditions: A survey. ISPRS Journal of Photogrammetry and Remote Sensing, 2023.
Noor Ul Ain Tahir, Zuping Zhang, Muhammad Asim, Junhong Chen, Mohammed Ahmed El-Affendi. Object Detection in Autonomous Vehicles under Adverse Weather: A Review of Traditional and Deep Learning Approaches. Algorithms, 2024.
Mazin Hnewa, Hayder Radha. Object Detection Under Rainy Conditions for Autonomous Vehicles: A Review of State-of-the-Art and Emerging Techniques. IEEE Signal Process. Mag., 2021.
M. Hassaballah, Mourad A. Kenk, Khan Muhammad, Shervin Minaee. Vehicle Detection and Tracking in Adverse Weather Using a Deep Learning Framework. IEEE Trans. Intell. Transp. Syst., 2021.
Chenyu Yang, Yuntao Chen, Hao Tian, Chenxin Tao, Xizhou Zhu, Zhaoxiang Zhang, Gao Huang, Hongyang Li, Yu Qiao, Lewei Lu, Jie Zhou, Jifeng Dai. BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervision. Proc. CVPR, 2023.
Yangguang Li, Bin Huang, Zeren Chen, Yufeng Cui, Feng Liang, Mingzhu Shen, Fenggang Liu, Enze Xie, Lu Sheng, Wanli Ouyang, Jing Shao. Fast-BEV: A Fast and Strong Bird's-Eye View Perception Baseline. IEEE Trans. Pattern Anal. Mach. Intell., 2024.
Haisong Liu, Yao Teng, Tao Lu, Haiguang Wang, Limin Wang. SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos. Proc. ICCV, 2023.
Wei Zhou, Julie Stephany Berrio, Stewart Worrall, Eduardo M. Nebot. Automated Evaluation of Semantic Segmentation Robustness for Autonomous Driving. IEEE Trans. Intell. Transp. Syst., 2020.
Federico Nesti, Giulio Rossolini, Saasha Nair, Alessandro Biondi, Giorgio C. Buttazzo. Evaluating the Robustness of Semantic Segmentation for Autonomous Driving against Real-World Adversarial Patch Attacks. Proc. WACV, 2022.
Yuanhui Huang, Wenzhao Zheng, Yunpeng Zhang, Jie Zhou, Jiwen Lu. Tri-Perspective View for Vision-Based 3D Semantic Occupancy Prediction. Proc. CVPR, 2023.
Yi Wei, Linqing Zhao, Wenzhao Zheng, Zheng Zhu, Jie Zhou, Jiwen Lu. SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Driving. Proc. ICCV, 2023.
Binhui Xie, Shuang Li, Mingjia Li, Chi Harold Liu, Gao Huang, Guoren Wang. SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 2023.
Abolfazl Abdollahi, Biswajeet Pradhan, Gaurav Sharma, Khairul Nizam Abdul Maulud, Abdullah M. Alamri. Improving Road Semantic Segmentation Using Generative Adversarial Network. IEEE Access, 2021.
Shanshan Zhang, Rodrigo Benenson, Bernt Schiele. Citypersons: A diverse dataset for pedestrian detection. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017.
Junyi Ma, Xieyuanli Chen, Jingyi Xu, Guangming Xiong. SeqOT: A Spatial-Temporal Transformer Network for Place Recognition Using Sequential LiDAR Data. IEEE Transactions on Industrial Electronics, 2022.
Alex X Lee, Anusha Nagabandi, Pieter Abbeel, Sergey Levine. Stochastic Latent Actor-Critic: Deep Reinforcement Learning with a Latent Variable Model. Advances in Neural Information Processing Systems (NeurIPS), 2020.
Maria Huegle, Gabriel Kalweit, Branka Mirchevska, Moritz Werling, Joschka Boedecker. Dynamic Input for Deep Reinforcement Learning in Autonomous Driving. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019.
Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, Daan Wierstra. Continuous Control with Deep Reinforcement Learning. arXiv preprint arXiv:1509.02971, 2015. arXiv
Dat Vu, Bao Ngo, Hung Phan. HybridNets: End-to-End Perception Network. arXiv preprint arXiv:2203.09035, 2022. arXiv
Kashyap Chitta, Aditya Prakash, Bernhard Jaeger, Zehao Yu, Katrin Renz, Andreas Geiger. TransFuser: Imitation with transformer-based sensor fusion for autonomous driving. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
Yihan Hu, Jiazhi Yang, Li Chen, Keyu Li, Chonghao Sima, Xizhou Zhu, Siqi Chai, Senyao Du, Tianwei Lin, Wenhai Wang, Lewei Lu, Xiaosong Jia, Qiang Liu, Jifeng Dai, Yu Qiao, Hongyang Li. Planning-oriented autonomous driving. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Sebastian Bach, Alexander Binder, Grégoire Montavon, Frederick Klauschen, Klaus-Robert Müller, Wojciech Samek. On Pixel-wise Explanations for Non-linear Classifier Decisions by Layer-wise Relevance Propagation. PLoS ONE, 2015.
Holger Caesar, Juraj Kabzan, Kok Seang Tan, Whye Kit Fong, Eric Wolff, Alex Lang, Luke Fletcher, Oscar Beijbom, Sammy Omari. nuPlan: A Closed-loop ML-based Planning Benchmark for Autonomous Vehicles. arXiv preprint arXiv:2106.11810, 2021. arXiv
Shyamal Patel, Hyung Park, Paolo Bonato, Leighton Chan, Mary Rodgers. A review of wearable sensors and systems with application in rehabilitation. Journal of NeuroEngineering and Rehabilitation, 2012.
Yinghao Huang, Manuel Kaufmann, Emre Aksan, Michael J. Black, Otmar Hilliges, Gerard Pons-Moll. Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time. ACM Transactions on Graphics, 2018.
Timo von Marcard, Bodo Rosenhahn, Michael J. Black, Gerard Pons-Moll. Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs. Computer Graphics Forum, 2017.
Manfredo Atzori, Arjan Gijsberts, Claudio Castellini, Barbara Caputo, Anne-Gabrielle Mittaz Hager, Simone Elsig, Giorgio Giatsidis, Franco Bassetto, Henning Müller. Electromyography data for non-invasive naturally-controlled robotic hand prostheses. Scientific Data, 2014.
Xinyu Yi, Yuxiao Zhou, Feng Xu. TransPose: Real-time 3D Human Translation and Pose Estimation with Six Inertial Sensors. ACM Transactions on Graphics, 2021.
Matthew Trumble, Andrew Gilbert, Charles Malleson, Adrian Hilton, John Collomosse. Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors. Proceedings of the British Machine Vision Conference (BMVC), 2017.
Yiyue Luo, Yunzhu Li, Michael Foshey, Wan Shou, Pratyusha Sharma, Tomás Palacios, Antonio Torralba, Wojciech Matusik. Learning human--environment interactions using conformal tactile textiles. Nature Electronics, 2021.
Manfredo Atzori, Matteo Cognolato, Henning Müller. Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands. Frontiers in Neurorobotics, 2016.
Xiaqing Pan, Nicholas Charron, Yongqian Yang, Scott Peters, Thomas Whelan, Chen Kong, Omkar Parkhi, Richard Newcombe, Yuheng Carl Ren. Aria digital twin: A new benchmark dataset for egocentric 3d machine perception. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2023.
Claudio Pacchierotti, Stephen Sinclair, Massimiliano Solazzi, Antonio Frisoli, Vincent Hayward, Domenico Prattichizzo. Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives. IEEE Transactions on Haptics, 2017.
Aaron J. Young, Daniel P. Ferris. State of the Art and Future Directions for Lower Limb Robotic Exoskeletons. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2017.
Sebastian O. H. Madgwick, Andrew J. L. Harrison, Ravi Vaidyanathan. Estimation of IMU and MARG orientation using a gradient descent algorithm. IEEE International Conference on Rehabilitation Robotics (ICORR), 2011.
Xinyu Yi, Yuxiao Zhou, Marc Habermann, Soshi Shimada, Vladislav Golyanik, Christian Theobalt, Feng Xu. Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Rayan Armani, Changlin Qian, Jiaxi Jiang, Christian Holz. Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging. ACM SIGGRAPH 2024 Conference Papers, 2024.
Xinyu Yi, Yuxiao Zhou, Marc Habermann, Vladislav Golyanik, Shaohua Pan, Christian Theobalt, Feng Xu. EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors. ACM Transactions on Graphics (SIGGRAPH), 2023.
Francisco Javier Ordóñez, Daniel Roggen. Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition. Sensors, 2016.
Shaojie Bai, J. Zico Kolter, Vladlen Koltun. An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. arXiv preprint arXiv:1803.01271, 2018. arXiv
Harish Haresamudram, Irfan Essa, Thomas Plötz. Contrastive Predictive Coding for Human Activity Recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2021.
Huatao Xu, Pengfei Zhou, Rui Tan, Mo Li, Guobin Shen. LIMU-BERT: Unleashing the Potential of Unlabeled Data for IMU Sensing Applications. Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems (SenSys), 2021.
Seungwhan Moon, Andrea Madotto, Zhaojiang Lin, Aparajita Saraf, Amy Bearman, Babak Damavandi. IMU2CLIP: Language-grounded Motion Sensor Translation with Multimodal Contrastive Learning. Findings of the Association for Computational Linguistics: EMNLP, 2023.
Sijie Yan, Yuanjun Xiong, Dahua Lin. Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition. Proceedings of the AAAI Conference on Artificial Intelligence, 2018.
Patrick Kaifosh, Thomas R. Reardon, et al.. A generic non-invasive neuromotor interface for human-computer interaction. Nature, 2025.
Attila Reiss, Didier Stricker. Introducing a New Benchmarked Dataset for Activity Monitoring. Proceedings of the 16th International Symposium on Wearable Computers (ISWC), 2012.
Ricardo Chavarriaga, Hesam Sagha, Alberto Calatroni, Sundara Tejaswi Digumarti, Gerhard Tröster, José del R. Millán, Daniel Roggen. The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition. Pattern Recognition Letters, 2013.
Dima Damen, Hazel Doughty, Giovanni Maria Farinella, Sanja Fidler, Antonino Furnari, Evangelos Kazakos, Davide Moltisanti, Jonathan Munro, Toby Perrett, Will Price, Michael Wray. Scaling Egocentric Vision: The EPIC-KITCHENS Dataset. CoRR, 2018.
Yunze Liu, Yun Liu, Che Jiang, Kangbo Lyu, Weikang Wan, Hao Shen, Boqiang Liang, Zhoujie Fu, He Wang, Li Yi. Hoi4d: A 4d egocentric dataset for category-level human-object interaction. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Geoffrey Hinton, Oriol Vinyals, Jeff Dean. Distilling the Knowledge in a Neural Network. arXiv preprint arXiv:1503.02531, 2015. arXiv
Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, Hartwig Adam. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv preprint arXiv:1704.04861, 2017. arXiv
Viswanath Sivakumar, et al.. emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyography. Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2024.
Jakob Engel, Kiran Somasundaram, Michael Goesele, Albert Sun, Alexander Gamino, Andrew Turner, Arjang Talattof, Arnie Yuan, Bilal Souti, Brighid Meredith, et al.. Project Aria: A New Tool for Egocentric Multi-Modal AI Research. arXiv preprint arXiv:2308.13561, 2023. arXiv
Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani, Jitendra Malik, Triantafyllos Afouras, Kumar Ashutosh, Vijay Baiyya, Siddhant Bansal, Bikram Boote, et al.. Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Lingni Ma, Yuting Ye, Fangzhou Hong, Vladimir Guzov, Yifeng Jiang, Rowan Postyeni, Luis Pesqueira, Alexander Gamino, Vijay Baiyya, Hyo Jin Kim, et al.. Nymeria: A Massive Collection of Egocentric Multi-modal Human Motion in the Wild. European Conference on Computer Vision, 2024.
Per K Enge. The global positioning system: Signals, measurements, and performance. International Journal of Wireless Information Networks, 1994.
Alfred Leick, Lev Rapoport, Dmitry Tatarnikov. GPS satellite surveying. 2015.
Elliott D Kaplan, Christopher Hegarty. Understanding GPS/GNSS: principles and applications. 2017.
N Ivanov, V Salischev. The GLONASS system--An overview. The Journal of Navigation, 1992.
J Benedicto, S Dinwiddy, G Gatti, R Lucas, M Lugert. GALILEO: Satellite system design. European Space Agency, 2000.
Yuanxi Yang, Yue Mao, Bijiao Sun. Basic performance and future developments of BeiDou global navigation satellite system. Satellite Navigation, 2020.
Zishen Li, Liang Wang, Ningbo Wang, Ran Li, Ang Liu. Real-time GNSS precise point positioning with smartphones for vehicle navigation. Satellite Navigation, 2022.
Farzaneh Zangenehnejad, Yang Gao. GNSS smartphones positioning: Advances, challenges, opportunities, and future perspectives. Satellite navigation, 2021.
Khondokar Fida Hasan, Yanming Feng, Yu-Chu Tian. GNSS time synchronization in vehicular ad-hoc networks: Benefits and feasibility. IEEE Transactions on Intelligent Transportation Systems, 2018.
J-P Malingreau. Global vegetation dynamics: satellite observations over Asia. International Journal of Remote Sensing, 1986.
DV Dobrynin, VV Rozhnov, AA Saveliev, OV Sukhova, AA Yachmennikova. Integration of Satellite Tracking Data and Satellite Images for Detailed Characteristics of Wildlife Habitats. Izvestiya, Atmospheric and Oceanic Physics, 2017.
Vagner G Ferreira, Zheng Gong, Xiufeng He, Yonglei Zhang, Samuel A Andam-Akorful. Estimating total discharge in the Yangtze River Basin using satellite-based observations. Remote Sensing, 2013.
Compton J Tucker, John RG Townshend. Strategies for monitoring tropical deforestation using satellite data. International Journal of Remote Sensing, 2000.
Matt Finer, Sidney Novoa, Mikaela J Weisse, Rachael Petersen, Joseph Mascaro, Tamia Souto, Forest Stearns, Raúl Garcı́a Martinez. Combating deforestation: From satellite to intervention. Science, 2018.
HF Del Valle, NO Elissalde, D Antonio Gagliardini, Jorge Milovich. Status of desertification in the Patagonian region: Assessment and mapping from satellite imagery. Arid Land Research and Management, 1998.
Alfredo D Collado, Emilio Chuvieco, Ana Camarasa. Satellite remote sensing analysis to monitor desertification processes in the crop-rangeland boundary of Argentina. Journal of Arid Environments, 2002.
Woody Turner, Carlo Rondinini, Nathalie Pettorelli, Brice Mora, Allison K Leidner, Zoltan Szantoi, Graeme Buchanan, Stefan Dech, John Dwyer, Martin Herold, et al.. Free and open-access satellite data are key to biodiversity conservation. Biological Conservation, 2015.
Jun Yang, Peng Gong, Rong Fu, Minghua Zhang, Jingming Chen, Shunlin Liang, Bing Xu, Jiancheng Shi, Robert Dickinson. The role of satellite remote sensing in climate change studies. Nature climate change, 2013.
Yoram J Kaufman, Didier Tanré, Olivier Boucher. A satellite view of aerosols in the climate system. Nature, 2002.
Nathalie Pettorelli, Kamran Safi, Woody Turner. Satellite remote sensing, biodiversity research and conservation of the future. Philosophical Transactions of the Royal Society B: Biological Sciences, 2014.
Sarah A Boyle, Christina M Kennedy, Julio Torres, Karen Colman, Pastor E Pérez-Estigarribia, Noé U De La Sancha. High-resolution satellite imagery is an important yet underutilized resource in conservation biology. PLoS One, 2014.
David L Verbyla. Satellite remote sensing of natural resources. 2022.
Nathalie Pettorelli. Satellite remote sensing and the management of natural resources. 2019.
Manuel Perez-Ruiz, Shrini K Upadhyaya. GNSS in precision agricultural operations. New approach of indoor and outdoor localization systems, 2012.
Jing Guo, Xingxing Li, Zhenhong Li, Leyin Hu, Guijun Yang, Chunjiang Zhao, David Fairbairn, David Watson, Maorong Ge. Multi-GNSS precise point positioning for precision agriculture. Precision agriculture, 2018.
SJ Maas. Using satellite data to improve model estimates of crop yield. Agronomy Journal, 1988.
Cs Ferencz, P Bognár, János Lichtenberger, Daniel Hamar, Gy Tarcsai, Gábor Timár, Gábor Molnár, SZ Pásztor, Peter Steinbach, Balázs Székely, et al.. Crop yield estimation by satellite remote sensing. International Journal of Remote Sensing, 2004.
Chong Fang, Kaishan Song, Hans W Paerl, Pierre-Andre Jacinthe, Zhidan Wen, Ge Liu, Hui Tao, Xiaofeng Xu, Tiit Kutser, Zongming Wang, et al.. Global divergent trends of algal blooms detected by satellite during 1982--2018. Global Change Biology, 2022.
Sudhanshu Pandey, Ritesh Gautam, Sander Houweling, Hugo Denier Van Der Gon, Pankaj Sadavarte, Tobias Borsdorff, Otto Hasekamp, Jochen Landgraf, Paul Tol, Tim Van Kempen, et al.. Satellite observations reveal extreme methane leakage from a natural gas well blowout. Proceedings of the National Academy of Sciences, 2019.
LiangLiang Zhao, MinLing Zhu. MS-YOLOv7: YOLOv7 Based on Multi-Scale for Object Detection on UAV Aerial Photography. Drones, 2023.
Mingwen Shao, Chao Wang, Wangmeng Zuo, Deyu Meng. Efficient pyramidal GAN for versatile missing data reconstruction in remote sensing images. TGRS, 2022.
Ioannis Pitas, Ioannis Mademlis. Autonomous UAV Cinematography. ACM Multimedia, 2022.
Zhedong Zheng, Yunchao Wei, Yi Yang. University-1652: A multi-view multi-source benchmark for drone-based geo-localization. ACM Multimedia, 2020.
Tingyu Wang, Zhedong Zheng, Chenggang Yan, Jiyong Zhang, Yaoqi Sun, Bolun Zheng, Yi Yang. Each part matters: Local patterns facilitate cross-view geo-localization. TCSVT, 2022.
Jinliang Lin, Zhedong Zheng, Zhun Zhong, Zhiming Luo, Shaozi Li, Yi Yang, Nicu Sebe. Joint representation learning and keypoint detection for cross-view geo-localization. IEEE Transactions on Image Processing, 2022.
Payton Goodrich, Omar Betancourt, Ana Claudia Arias, Tarek Zohdi. Placement and drone flight path mapping of agricultural soil sensors using machine learning. Computers and Electronics in Agriculture, 2023.
Redmond Ramin Shamshiri, Ibrahim A Hameed, Siva K Balasundram, Desa Ahmad, Cornelia Weltzien, Muhammad Yamin. Fundamental research on unmanned aerial vehicles to support precision agriculture in oil palm plantations. Agricultural Robots-Fundamentals and Application, 2018.
Liu Liu, Hongdong Li. Lending orientation to neural networks for cross-view geo-localization. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2019.
Yujiao Shi, Liu Liu, Xin Yu, Hongdong Li. Spatial-Aware Feature Aggregation for Image based Cross-View Geo-Localization. NeurIPS, 2019.
Yujiao Shi, Xin Yu, Liu Liu, Tong Zhang, Hongdong Li. Optimal feature transport for cross-view image geo-localization. AAAI, 2020.
Yujiao Shi, Xin Yu, Dylan Campbell, Hongdong Li. Where am I looking at? joint location and orientation estimation by cross-view matching. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2020.
Yujiao Shi, Hongdong Li. Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Yujiao Shi, Xin Yu, Liu Liu, Dylan Campbell, Piotr Koniusz, Hongdong Li. Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2022.
Yujiao Shi, Xin Yu, Shan Wang, Hongdong Li. CVLNet: Cross-View Feature Correspondence Learning for Video-based Camera Localization. ACCV, 2022.
Yujiao Shi, Fei Wu, Akhil Perincherry, Ankit Vora, Hongdong Li. Boosting 3-DoF Ground-to-Satellite Camera Localization Accuracy via Geometry-Guided Cross-View Transformer. Proceedings of theInternational Conference on Computer Vision (ICCV), 2023.
Zhenbo Song, Xianghui Ze, Jianfeng Lu, Yujiao Shi. Learning Dense Flow Field for Highly-accurate Cross-view Camera Localization. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2023.
Francesco Betti Sorbelli, Federico Corò, Lorenzo Palazzetti, Cristina M Pinotti, Giulio Rigoni. How the Wind Can Be Leveraged for Saving Energy in a Truck-Drone Delivery System. TITS, 2023.
Didula Dissanayaka, Thumeera R Wanasinghe, Oscar De Silva, Awantha Jayasiri, George KI Mann. Review of Navigation Methods for UAV-Based Parcel Delivery. TASE, 2023.
Kristina Lemmer. Propulsion for cubesats. Acta astronautica, 2017.
Jesús Gonzalo, Deibi López, Diego Domı́nguez, Adrián Garc\á, Alberto Escapa. On the capabilities and limitations of high altitude pseudo-satellites. Progress in Aerospace Sciences, 2018.
John D Cunningham, Hal J Bloom, Craig S Nelson. National Polar-orbiting Operational Environmental Satellite System: meeting future user needs for Earth system observations. Weather and Environmental Satellites, 2004.
Alexander Köthe. Flight Mechanics and Flight Control for a Multibody Aircraft. Technische Universitaet Berlin: Berlin, Germany, 2019.
Matt Fladeland, Susan Schoenung, Randal Albertson. Demonstrating next generation high-altitude, long endurance aircraft for earth science. 2019.
Zhedong Zheng, Yi Yang. Adaptive boosting for domain adaptation: Toward robust predictions in scene segmentation. IEEE Transactions on Image Processing, 2022.
Tianjiao Li, Jun Liu, Wei Zhang, Yun Ni, Wenqian Wang, Zhiheng Li. Uav-human: A large benchmark for human behavior understanding with unmanned aerial vehicles. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2021.
Pu Jin, Lichao Mou, Gui-Song Xia, Xiao Xiang Zhu. Anomaly Detection in Aerial Videos With Transformers. TGRS, 2022.
Zhedong Zheng, Yi Yang. Unsupervised scene adaptation with memory regularization in vivo. IJCAI, 2019.
Chao Wang, Zhedong Zheng, Ruijie Quan, Yifan Sun, Yi Yang. Context-Aware Pretraining for Efficient Blind Image Decomposition. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2023.
Hao Ju, Shaofei Huang, Si Liu, Zhedong Zheng. Video2bev: Transforming drone videos to bevs for video-based geo-localization. Proceedings of theInternational Conference on Computer Vision (ICCV), 2025.
Haotian Zhang, Gaoang Wang, Zhichao Lei, Jenq-Neng Hwang. Eye in the sky: Drone-based object tracking and 3d localization. ACM Multimedia, 2019.
Longyin Wen, Dawei Du, Pengfei Zhu, Qinghua Hu, Qilong Wang, Liefeng Bo, Siwei Lyu. Detection, tracking, and counting meets drones in crowds: A benchmark. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2021.
Yujiao Shi, Dylan John Campbell, Xin Yu, Hongdong Li. Geometry-guided street-view panorama synthesis from satellite imagery. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2022.
Meng Chu, Zhedong Zheng, Wei Ji, Tingyu Wang, Tat-Seng Chua. Towards natural language-guided drones: GeoText-1652 benchmark with spatial relation matching. European Conference on Computer Vision, 2024.
Ou Zheng, Mohamed Abdel-Aty, Lishengsa Yue, Amr Abdelraouf, Zijin Wang, Nada Mahmoud. CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety Oriented Research and Digital Twins. arXiv:2208.11036, 2022. arXiv
Scott Workman, Nathan Jacobs. On the location dependence of convolutional neural network features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2015.
Scott Workman, Richard Souvenir, Nathan Jacobs. Wide-area image geolocalization with aerial reference imagery. Proceedings of the IEEE International Conference on Computer Vision, 2015.
Tsung-Yi Lin, Yin Cui, Serge Belongie, James Hays. Learning deep representations for ground-to-aerial geolocalization. Proceedings of the IEEE conference on computer vision and pattern recognition, 2015.
Liu Liu, Hongdong Li, Yuchao Dai. Stochastic Attraction-Repulsion Embedding for Large Scale Image Localization. Proceedings of the IEEE International Conference on Computer Vision, 2019.
Fabian Deuser, Konrad Habel, Norbert Oswald. Sample4geo: Hard negative sampling for cross-view geo-localisation. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Nam N Vo, James Hays. Localizing and orienting street views using overhead imagery. European conference on computer vision, 2016.
Menghua Zhai, Zachary Bessinger, Scott Workman, Nathan Jacobs. Predicting ground-level scene layout from aerial imagery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
Sixing Hu, Mengdan Feng, Rang MH Nguyen, Gim Hee Lee. CVM-net: Cross-view matching network for image-based ground-to-aerial geo-localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018.
Hongji Yang, Xiufan Lu, Yingying Zhu. Cross-view geo-localization with layer-to-layer transformer. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2021.
Xiaohan Zhang, Xingyu Li, Waqas Sultani, Yi Zhou, Safwan Wshah. Cross-view geo-localization via learning disentangled geometric layout correspondence. Proceedings of the AAAI conference on artificial intelligence, 2023.
Sijie Zhu, Mubarak Shah, Chen Chen. Transgeo: Transformer is all you need for cross-view image geo-localization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Runzhe Zhu, Ling Yin, Mingze Yang, Fei Wu, Yuncheng Yang, Wenbo Hu. SUES-200: A multi-height multi-scene cross-view image benchmark across drone and satellite. IEEE Transactions on Circuits and Systems for Video Technology, 2023.
Yicong Tian, Chen Chen, Mubarak Shah. Cross-view image matching for geo-localization in urban environments. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
Gui-Song Xia, Xiang Bai, Jian Ding, Zhen Zhu, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, Liangpei Zhang. DOTA: A large-scale dataset for object detection in aerial images. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Jian Ding, Nan Xue, Gui-Song Xia, Xiang Bai, Wen Yang, Michael Ying Yang, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, et al.. Object detection in aerial images: A large-scale benchmark and challenges. IEEE transactions on pattern analysis and machine intelligence, 2021.
Dawei Du, Pengfei Zhu, Longyin Wen, Xiao Bian, Haibin Lin, Qinghua Hu, Tao Peng, Jiayu Zheng, Xinyao Wang, Yue Zhang, et al.. VisDrone-DET2019: The vision meets drone object detection in image challenge results. Proceedings of the IEEE/CVF international conference on computer vision workshops, 2019.
Cédric Vermeulen, Philippe Lejeune, Jonathan Lisein, Prosper Sawadogo, Philippe Bouché. Unmanned aerial survey of elephants. PloS one, 2013.
Yousaf Albaluchi, Biying Fu, Naser Damer, Raghavendra Ramachandra, Kiran Raja. UAV-based person re-identification: A survey of UAV datasets, approaches, and challenges. Computer Vision and Image Understanding, 2025.
Xian Sun, Peijin Wang, Zhiyuan Yan, Feng Xu, Ruiping Wang, Wenhui Diao, Jin Chen, Jihao Li, Yingchao Feng, Tao Xu, et al.. FAIR1M: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 2022.
Zikun Liu, Hongzhen Wang, Lubin Weng, Yiping Yang. Ship rotated bounding box space for ship extraction from high-resolution optical satellite images with complex backgrounds. IEEE Geoscience and Remote Sensing Letters, 2016.
Gong Cheng, Jiabao Wang, Ke Li, Xingxing Xie, Chunbo Lang, Yanqing Yao, Junwei Han. Anchor-free oriented proposal generator for object detection. IEEE Transactions on Geoscience and Remote Sensing, 2022.
Yazhou Yao, Tao Chen, Hanbo Bi, Xinhao Cai, Gensheng Pei, Guoye Yang, Zhiyuan Yan, Xian Sun, Xing Xu, Hai Zhang. Automated object recognition in high-resolution optical remote sensing imagery. National Science Review, 2023.
Xue Yang, Jirui Yang, Junchi Yan, Yue Zhang, Tengfei Zhang, Zhi Guo, Xian Sun, Kun Fu. Scrdet: Towards more robust detection for small, cluttered and rotated objects. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2019.
Xue Yang, Junchi Yan, Ziming Feng, Tao He. R3det: Refined single-stage detector with feature refinement for rotating object. Proceedings of the AAAI conference on artificial intelligence, 2021.
Jian Ding, Nan Xue, Yang Long, Gui-Song Xia, Qikai Lu. Learning RoI transformer for oriented object detection in aerial images. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2019.
Xingxing Xie, Gong Cheng, Jiabao Wang, Xiwen Yao, Junwei Han. Oriented R-CNN for object detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2021.
Liping Hou, Ke Lu, Jian Xue, Yuqiu Li. Shape-adaptive selection and measurement for oriented object detection. Proceedings of the AAAI conference on artificial intelligence, 2022.
Jiaming Han, Jian Ding, Nan Xue, Gui-Song Xia. Redet: A rotation-equivariant detector for aerial object detection. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2021.
Qi Ming, Zhiqiang Zhou, Lingjuan Miao, Hongwei Zhang, Linhao Li. Dynamic anchor learning for arbitrary-oriented object detection. Proceedings of the AAAI conference on artificial intelligence, 2021.
Kun Fu, Zhonghan Chang, Yue Zhang, Xian Sun. Point-based estimator for arbitrary-oriented object detection in aerial images. IEEE Transactions on Geoscience and Remote Sensing, 2020.
Wentong Li, Yijie Chen, Kaixuan Hu, Jianke Zhu. Oriented reppoints for aerial object detection. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Yongchao Xu, Mingtao Fu, Qimeng Wang, Yukang Wang, Kai Chen, Gui-Song Xia, Xiang Bai. Gliding vertex on the horizontal bounding box for multi-oriented object detection. IEEE transactions on pattern analysis and machine intelligence (TPAMI), 2020.
Xue Yang, Junchi Yan, Qi Ming, Wentao Wang, Xiaopeng Zhang, Qi Tian. Rethinking rotated object detection with gaussian wasserstein distance loss. Proceedings of the International Conference on Machine Learning (ICML), 2021.
Xue Yang, Xiaojiang Yang, Jirui Yang, Qi Ming, Wentao Wang, Qi Tian, Junchi Yan. Learning high-precision bounding box for rotated object detection via kullback-leibler divergence. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2021.
Gong Cheng, Yanqing Yao, Shengyang Li, Ke Li, Xingxing Xie, Jiabao Wang, Xiwen Yao, Junwei Han. Dual-aligned oriented detector. IEEE Transactions on Geoscience and Remote Sensing, 2022.
Wen Qian, Xue Yang, Silong Peng, Junchi Yan, Yue Guo. Learning modulated loss for rotated object detection. Proceedings of the AAAI conference on artificial intelligence, 2021.
Yuanlin Zhang, Yuan Yuan, Yachuang Feng, Xiaoqiang Lu. Hierarchical and robust convolutional neural network for very high-resolution remote sensing object detection. IEEE Transactions on Geoscience and Remote Sensing, 2019.
Zhuo Zheng, Yanfei Zhong, Ailong Ma, Xiaobing Han, Ji Zhao, Yanfei Liu, Liangpei Zhang. HyNet: Hyper-scale object detection network framework for multiple spatial resolution remote sensing imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 2020.
Guanqun Wang, Yin Zhuang, He Chen, Xiang Liu, Tong Zhang, Lianlin Li, Shan Dong, Qianbo Sang. FSoD-Net: Full-Scale Object Detection From Optical Remote Sensing Imagery. IEEE Transactions on Geoscience and Remote Sensing, 2022. DOI
Liping Hou, Ke Lu, Jian Xue. Refined one-stage oriented object detection method for remote sensing images. IEEE Transactions on Image Processing, 2022.
Wenhua Zhang, Licheng Jiao, Yuxuan Li, Zhongjian Huang, Haoran Wang. Laplacian feature pyramid network for object detection in VHR optical remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 2021.
Haoyuan Guo, Xi Yang, Nannan Wang, Bin Song, Xinbo Gao. A rotational libra R-CNN method for ship detection. IEEE Transactions on Geoscience and Remote Sensing, 2020.
Wei Guo, Wen Yang, Haijian Zhang, Guang Hua. Geospatial object detection in high resolution satellite images based on multi-scale convolutional neural network. Remote Sensing, 2018.
Jie-Bo Hou, Xiaobin Zhu, Xu-Cheng Yin. Self-adaptive aspect ratio anchor for oriented object detection in remote sensing images. Remote Sensing, 2021.
Heqian Qiu, Hongliang Li, Qingbo Wu, Fanman Meng, King Ngi Ngan, Hengcan Shi. A2RMNet: Adaptively aspect ratio multi-scale network for object detection in remote sensing images. Remote Sensing, 2019.
Yuxuan Li, Qibin Hou, Zhaohui Zheng, Ming-Ming Cheng, Jian Yang, Xiang Li. Large Selective Kernel Network for Remote Sensing Object Detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2023.
Xiaohan Ding, Xiangyu Zhang, Jungong Han, Guiguang Ding. Scaling up your kernels to 31x31: Revisiting large kernel design in cnns. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
Shiwei Liu, Tianlong Chen, Xiaohan Chen, Xuxi Chen, Qiao Xiao, Boqian Wu, Mykola Pechenizkiy, Decebal Mocanu, Zhangyang Wang. More convnets in the 2020s: Scaling up kernels beyond 51x51 using sparsity. arXiv preprint arXiv:2207.03620, 2022. arXiv
Meng-Hao Guo, Cheng-Ze Lu, Qibin Hou, Zhengning Liu, Ming-Ming Cheng, Shi-Min Hu. Segnext: Rethinking convolutional attention design for semantic segmentation. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2022.
Yingpeng Dai, Chenglin Li, Xiaohang Su, Hongxian Liu, Jiehao Li. Multi-Scale Depthwise Separable Convolution for Semantic Segmentation in Street--Road Scenes. Remote Sensing, 2023.
Ke Zhang, Inuwa Mamuda Bello, Yu Su, Jingyu Wang, Ibrahim Maryam. Multiscale depthwise separable convolution based network for high-resolution image segmentation. International Journal of Remote Sensing, 2022.
Xinhao Cai, Qiuxia Lai, Yuwei Wang, Wenguan Wang, Zeren Sun, Yazhou Yao. Poly kernel inception network for remote sensing detection. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Dawei Du, Yuankai Qi, Hongyang Yu, Yifan Yang, Kaiwen Duan, Guorong Li, Weigang Zhang, Qingming Huang, Qi Tian. The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking. ECCV, 2018.
Syed Waqas Zamir, Aditya Arora, Akshita Gupta, Salman Khan, Guolei Sun, Fahad Shahbaz Khan, Fan Zhu, Ling Shao, Gui-Song Xia, Xiang Bai. iSAID: A Large-Scale Dataset for Instance Segmentation in Aerial Images. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) Workshop, 2019.
Guang Yang, Wenqi Li, Jian Zhang, Wei Wang, Jun Liu. LAI-YOLOv5s: A Lightweight Aerial Image Object Detection Algorithm. IEEE Transactions on Geoscience and Remote Sensing, 2023.
Chien-Yao Wang, I-Hau Yeh, Hong-Yuan Mark Liao. YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information. arXiv preprint arXiv:2402.13616, 2024. arXiv
Georgios Albanis, Nikolaos Zioulis, Anastasios Dimou, Dimitrios Zarpalas, Petros Daras. Dronepose: photorealistic uav-assistant dataset synthesis for 3d pose estimation via a smooth silhouette loss. European Conference on Computer Vision, 2020.
Yue Fan, Winson Chen, Tongzhou Jiang, Chun Zhou, Yi Zhang, Xin Eric Wang. Aerial vision-and-dialog navigation. arXiv preprint arXiv:2205.12219, 2022. arXiv
Shubo Liu, Hongsheng Zhang, Yuankai Qi, Peng Wang, Yanning Zhang, Qi Wu. Aerialvln: Vision-and-language navigation for uavs. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
Antonio Loquercio, Ana I Maqueda, Carlos R Del-Blanco, Davide Scaramuzza. Dronet: Learning to fly by driving. IEEE Robotics and Automation Letters, 2018.
Katie Kang, Suneel Belkhale, Gregory Kahn, Pieter Abbeel, Sergey Levine. Generalization through simulation: Integrating simulated and real data into deep reinforcement learning for vision-based autonomous flight. 2019 international conference on robotics and automation (ICRA), 2019.
Alessandro Giusti, Jérôme Guzzi, Dan C Cireşan, Fang-Lin He, Juan P Rodrı́guez, Flavio Fontana, Matthias Faessler, Christian Forster, Jürgen Schmidhuber, Gianni Di Caro, et al.. A machine learning approach to visual perception of forest trails for mobile robots. IEEE Robotics and Automation Letters, 2015.
Nikolai Smolyanskiy, Alexey Kamenev, Jeffrey Smith, Stan Birchfield. Toward low-flying autonomous MAV trail navigation using deep neural networks for environmental awareness. 2017 IEEE/RSJ international conference on intelligent robots and systems (IROS), 2017.
Yue Fan, Shilei Chu, Wei Zhang, Ran Song, Yibin Li. Learn by observation: Imitation learning for drone patrolling from videos of a human navigator. 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020.
Ilker Bozcan, Erdal Kayacan. Au-air: A multi-modal unmanned aerial vehicle dataset for low altitude traffic surveillance. 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020.
András L Majdik, Charles Till, Davide Scaramuzza. The Zurich urban micro aerial vehicle dataset. The International Journal of Robotics Research, 2017.
Fanglong Yao, Yuanchang Yue, Youzhi Liu, Xian Sun, Kun Fu. AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models. arXiv preprint arXiv:2408.15511, 2024. arXiv
Fei Lin, Yonglin Tian, Tengchao Zhang, Jun Huang, Sangtian Guan, Fei-Yue Wang. AirVista-II: An Agentic System for Embodied UAVs Toward Dynamic Scene Semantic Understanding. arXiv preprint arXiv:2504.09583, 2025. arXiv
Yatai Ji, Zhengqiu Zhu, Yong Zhao, Beidan Liu, Chen Gao, Yihao Zhao, Sihang Qiu, Yue Hu, Quanjun Yin, Yong Li. Towards Autonomous UAV Visual Object Search in City Space: Benchmark and Agentic Methodology. arXiv preprint arXiv:2505.08765, 2025. arXiv
Liangqi Yuan, Chuhao Deng, Dong-Jun Han, Inseok Hwang. Next-Generation LLM for UAV: From Natural Language to Autonomous Flight. arXiv preprint arXiv:2510.21739, 2025. arXiv
Ruipu Wu, Yige Zhang, Jinyu Chen, Linjiang Huang, Shifeng Zhang, Xu Zhou, Liang Wang, Si Liu. AeroDuo: Aerial Duo for UAV-based Vision and Language Navigation. arXiv preprint arXiv:2508.15232, 2025. arXiv
François Michel, Martino Trevisan, Danilo Giordano, Olivier Bonaventure. A first look at starlink performance. Proceedings of the 22nd ACM Internet Measurement Conference, 2022.
N. Correll, K. E. Bekris, D. Berenson, O. Brock, A. Causo, K. Hauser, K. Okada, A. Rodriguez, J. M. Romano, P. R. Wurman. Analysis and Observations from the First Amazon Picking Challenge. Proc. IEEE Trans. Automation Science and Engineering (T-ASE), 2016.
A. A. Tubis, A. Radanliev, N. Choudhary, M. R. Abdulsalam, A. Garliñski, K. M. Panasiuk. Intelligent Warehouse in Industry 4.0—Systematic Review. Sustainability, 2023.
C. Cadena, L. Carlone, H. Carrillo, Y. Latif, D. Scaramuzza, J. Neira, I. Reid, J. J. Leonard. Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age. IEEE Transactions on Robotics, 2016.
T. Shan, B. Englot, D. Meyers, W. Wang, C. Ratti, D. Rus. LIO-SAM: Tightly-coupled LiDAR Inertial Odometry via Smoothing and Mapping. Proc. IEEE IROS, 2020.
M. Labbé, F. Michaud. RTAB-Map as an Open-Source Lidar and Visual Simultaneous Localization and Mapping Library for Large-Scale and Long-Term Online Operation. Journal of Field Robotics, 2019.
F. Dellaert. Factor Graphs and GTSAM: A Hands-on Introduction. Proc. Georgia Institute of Technology Technical Report GT-RIM-CP&R-2012-002, 2012.
M. Veloso, J. Biswas, B. Coltin, S. Rosenthal. CoBots: Robust Symbiotic Autonomous Mobile Service Robots. Proc. IJCAI, 2015.
J.-F. Cordeau, G. Laporte, M. W. P. Savelsbergh, D. Vigo. Vehicle Routing. Handbooks in Operations Research and Management Science, 2007.
G. Sartoretti, J. Kerr, Y. Shi, G. Wagner, T. K. S. Kumar, S. Koenig, H. Choset. PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learning. Proc. IEEE ICRA, 2019.
L. Perron, V. Furnon. OR-Tools: Google's Open Source Software Suite for Optimization. 2019. arXiv
M. M. Solomon. Algorithms for the Vehicle Routing and Scheduling Problems with Time Window Constraints. Operations Research, 1987.
I. Sucan, S. Chitta. MoveIt! Motion Planning Framework. Proc. IEEE ICRA Workshop on Open Source Software, 2010.
P. A. Lasota, J. A. Shah. Analyzing the Effects of Human-Aware Motion Planning on Close-Proximity Human–Robot Collaboration. Human Factors, 2015.
J. Mainprice, R. Hayne, D. Berenson. Goal Set Inverse Optimal Control and Iterative Replanning for Predicting Human Reaching Motions in Shared Workspaces. Proc. IEEE ICRA, 2016.
Anca D Dragan, Kenton CT Lee, Siddhartha S Srinivasa. Legibility and predictability of robot motion. 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2013.
Zebra Technologies. Zebra RFID and Barcode Scanning Platforms (2021) — Product Documentation. 2021. Link
M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, A. Y. Ng. ROS: An Open-Source Robot Operating System. Proc. ICRA Workshop on Open Source Software, 2009.
E. Tzeng, J. Hoffman, K. Saenko, T. Darrell. Adversarial Discriminative Domain Adaptation. Proc. CVPR, 2017.
R. Bajcsy, Y. Aloimonos, J. K. Tsotsos. Revisiting Active Perception. Autonomous Robots, 2018.
Tong Qin, Peiliang Li, Shaojie Shen. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator. IEEE Transactions on Robotics, 2018.
Ruofei Du, Eric Turner, Maksym Dzitsiuk, Luca Prasso, Ivo Duarte, Jason Dourgarian, Joao Afonso, Jose Pascoal, Josh Gladstone, Nuno Cruces, Shahram Izadi, Adarsh Kowdle, Konstantine Tsotsos, David Kim. DepthLab: Real-Time 3D Interaction with Depth Maps for Mobile Augmented Reality. Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST), 2020.
Marc-André Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Christian Gagné, Jean-François Lalonde. Learning to Predict Indoor Illumination from a Single Image. ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2017.
Javier Romero, Dimitrios Tzionas, Michael J. Black. Embodied Hands: Modeling and Capturing Hands and Bodies Together. ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2017.
Fan Zhang, Valentin Bazarevsky, Andrey Vakunov, Andrei Tkachenka, George Sung, Chuo-Ling Chang, Matthias Grundmann. MediaPipe Hands: On-device Real-time Hand Tracking. arXiv preprint arXiv:2006.10214, 2020. arXiv
Kyle Krafka, Aditya Khosla, Petr Kellnhofer, Harini Kannan, Suchendra Bhandarkar, Wojciech Matusik, Antonio Torralba. Eye Tracking for Everyone. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Stephan J. Garbin, Yiru Shen, Immo Schuetz, Robert Cavin, Gregory Hughes, Sachin S. Talathi. OpenEDS: Open Eye Dataset. arXiv preprint arXiv:1905.03702, 2019. arXiv
Jiaxi Jiang, Paul Streli, Huajian Qiu, Andreas Fender, Larissa Laich, Patrick Snape, Christian Holz. AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensing. European Conference on Computer Vision (ECCV), 2022.
Yuming Du, Robin Kips, Albert Pumarola, Sebastian Starke, Ali Thabet, Artsiom Sanakoyeu. Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Richard A. Bolt. ``Put-That-There'': Voice and Gesture at the Graphics Interface. Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), 1980.
Sharif Razzaque, Zachariah Kohn, Mary C. Whitton. Redirected Walking. Eurographics Short Presentations, 2001.
Brian Guenter, Mark Finch, Steven Drucker, Desney Tan, John Snyder. Foveated 3D Graphics. ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2012.
Anjul Patney, Marco Salvi, Joohwan Kim, Anton Kaplanyan, Chris Wyman, Nir Benty, David Luebke, Aaron Lefohn. Towards Foveated Rendering for Gaze-Tracked Virtual Reality. ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2016.
J. M. P. van Waveren. The Asynchronous Time Warp for Virtual Reality on Consumer Hardware. Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology (VRST), 2016.
Andrew Maimone, Andreas Georgiou, Joel S. Kollin. Holographic Near-Eye Displays for Virtual and Augmented Reality. ACM Transactions on Graphics (Proc. SIGGRAPH), 2017.
Stephen Lombardi, Jason Saragih, Tomas Simon, Yaser Sheikh. Deep Appearance Models for Face Rendering. ACM Transactions on Graphics (Proc. SIGGRAPH), 2018.
Richard A. Newcombe, Dieter Fox, Steven M. Seitz. DynamicFusion: Reconstruction and Tracking of Non-Rigid Scenes in Real-Time. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
Shenhan Qian, Tobias Kirschstein, Liam Schoneveld, Davide Davoli, Simon Giebenhain, Matthias Nießner. Gaussianavatars: Photorealistic head avatars with rigged 3d gaussians. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Zhe Li, Zerong Zheng, Lizhen Wang, Yebin Liu. Animatable gaussians: Learning pose-dependent gaussian maps for high-fidelity human avatar modeling. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024.
Robert Dongas, Kazjon Grace, Marius Hoggenmüller. Designing to Leverage Presence in VR Rhythm Games. Multimodal Technologies and Interaction, 2023.
Adrian Azzarelli, Nantheera Anantrasirichai, David R. Bull. Intelligent Cinematography: A Review of AI Research for Cinematographic Production. Artificial Intelligence Review, 2025. DOI
Werner Kritzinger, Matthias Karner, Georg Traar, Jan Henjes, Wilfried Sihn. Digital twin in manufacturing: A categorical literature review and classification. IFAC-PapersOnLine, 2018.
Michael Grieves, John Vickers. Digital twin: Mitigating unpredictable, undesirable emergent behavior in complex systems. Transdisciplinary Perspectives on Complex Systems, 2017.
Edward Glaessgen, David Stargel. The digital twin paradigm for future NASA and U.S. Air Force vehicles. 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, 2012.
Fei Tao, He Zhang, Ang Liu, Andrew Y. C. Nee. Digital twin in industry: State-of-the-art. IEEE Transactions on Industrial Informatics, 2019.
Yuntao Wang, Zhou Su, Shaolong Guo, Minghui Dai, Tom H. Luan, Yiliang Liu. A survey on digital twins: Architecture, enabling technologies, security and privacy, and future prospects. IEEE Internet of Things Journal, 2023.
Zhaoshuo Li, Thomas Müller, Alex Evans, Russell H. Taylor, Mathias Unberath, Ming-Yu Liu, Chen-Hsuan Lin. Neuralangelo: High-fidelity neural surface reconstruction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
Zhenyu Jiang, Cheng-Chun Hsu, Yuke Zhu. Ditto: Building digital twins of articulated objects from interaction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Zoey Chen, Aaron Walsman, Marius Memmel, et al.. URDFormer: A pipeline for constructing articulated simulation environments from real-world images. Robotics: Science and Systems, 2024.
Xuan Li, Yi-Ling Qiao, Peter Yichen Chen, Krishna Murthy Jatavallabhula, Ming Lin, Chenfanfu Jiang, Chuang Gan. PAC-NeRF: Physics augmented continuum neural radiance fields for geometry-agnostic system identification. International Conference on Learning Representations, 2023.
Tianyi Xie, Zeshun Zong, Yuxing Qiu, Xuan Li, Yutao Feng, Yin Yang, Chenfanfu Jiang. PhysGaussian: Physics-integrated 3D Gaussians for generative dynamics. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
Zhao Dong, et al.. Digital twin catalog: A large-scale photorealistic 3D object digital twin dataset. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025.
Jasmine Collins, Shubham Goel, Kenan Deng, Achleshwar Luthra, Leon Xu, Erhan Gundogdu, Xi Zhang, Tomas F. Yago Vicente, Thomas Dideriksen, Himanshu Arora, et al.. ABO: Dataset and benchmarks for real-world 3D object understanding. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
Jeremy Reizenstein, Roman Shapovalov, Philipp Henzler, Luca Sbordone, Patrick Labatut, David Novotny. Common objects in 3D: Large-scale learning and evaluation of real-life 3D category reconstruction. Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021.
Yuanming Hu, Luke Anderson, Tzu-Mao Li, Qi Sun, Nathan Carr, Jonathan Ragan-Kelley, Frédo Durand. DiffTaichi: Differentiable programming for physical simulation. International Conference on Learning Representations, 2020.
Krishna Murthy Jatavallabhula, Miles Macklin, Florian Golemo, Vikram Voleti, Linda Petrini, Martin Weiss, Breandan Considine, Jerome Parent-Lévesque, Kevin Xie, Kenny Erleben, et al.. gradSim: Differentiable simulation for system identification and visuomotor control. International Conference on Learning Representations, 2021.
Maziar Raissi, Paris Perdikaris, George E Karniadakis. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics, 2019.
George Em Karniadakis, Ioannis G. Kevrekidis, Lu Lu, Paris Perdikaris, Sifan Wang, Liu Yang. Physics-informed machine learning. Nature Reviews Physics, 2021.
Dirk Hartmann, Matthias Herz, Utz Wever. Model order reduction a key technology for digital twins. Reduced-Order Modeling (ROM) for Simulation and Optimization, 2018.
Francisco Chinesta, Elı́as Cueto, Emmanuelle Abisset-Chavanne, Jean Louis Duval, Fouad El Khaldi. Virtual, digital and hybrid twins: A new paradigm in data-based engineering and engineered data. Archives of Computational Methods in Engineering, 2020.
Josh Tobin, Rachel Fong, Alex Ray, Jonas Schneider, Wojciech Zaremba, Pieter Abbeel. Domain randomization for transferring deep neural networks from simulation to the real world. 2017 IEEE/RSJ international conference on intelligent robots and systems (IROS), 2017.
Xue Bin Peng, Marcin Andrychowicz, Wojciech Zaremba, Pieter Abbeel. Sim-to-real transfer of robotic control with dynamics randomization. International Conference on Robotics and Automation, 2018.
Marcel Torne, Anthony Simeonov, Zechu Li, April Chan, Tao Chen, Abhishek Gupta, Pulkit Agrawal. Reconciling reality through simulation: A real-to-sim-to-real approach for robust manipulation. Robotics: Science and Systems, 2024.
Tianyuan Dai, Josiah Wong, Yunfan Jiang, Chen Wang, Cem Gokmen, Ruohan Zhang, Jiajun Wu, Li Fei-Fei. Automated creation of digital cousins for robust policy learning. Conference on Robot Learning, 2024.
Rudolph Emil Kalman. A new approach to linear filtering and prediction problems. Journal of Basic Engineering, 1960.
Geir Evensen. Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. Journal of Geophysical Research: Oceans, 1994.
Michael G. Kapteyn, Jacob V. R. Pretorius, Karen E. Willcox. A probabilistic graphical model foundation for enabling predictive digital twins at scale. Nature Computational Science, 2021.
Fei Tao, Meng Zhang, Yushan Liu, Andrew Y. C. Nee. Digital twin driven prognostics and health management for complex equipment. CIRP Annals, 2018.
Fabian Dembski, Uwe Wössner, Mike Letzgus, Michael Ruddat, Claudia Yamu. Urban digital twins for smart cities and citizens: The case study of Herrenberg, Germany. Sustainability, 2020.
Kean Huat Soon, Victor Hwee Seng Khoo. CityGML modelling for Singapore 3D national mapping. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2017.
Jorge Corral-Acero, Francesca Margara, Maciej Marciniak, Cristobal Rodero, Filip Loncaric, Yingjing Feng, Andrew Gilbert, Joao F. Fernandes, Hassaan A. Bukhari, Ali Wajdan, et al.. The `digital twin' to enable the vision of precision cardiology. European Heart Journal, 2020.
Evangelia Katsoulakis, Qi Wang, Huanmei Wu, Leili Shahriyari, Richard Fletcher, Jinwei Liu, Luke Achenie, Hongfang Liu, Pamela Jackson, Ying Xiao, et al.. Digital twins for health: a scoping review. npj Digital Medicine, 2024.
Cor Verdouw, Bedir Tekinerdogan, Adrie Beulens, Sjaak Wolfert. Digital twins in smart farming. Agricultural Systems, 2021.
Yang Liu, Chuanchen Luo, Zhongkai Mao, Junran Peng, Zhaoxiang Zhang. CityGaussianV2: Efficient and geometrically accurate reconstruction for large-scale scenes. International Conference on Learning Representations, 2025.
Anasse Boutayeb, Iyad Lahsen-cherif, Ahmed El Khadimi. A comprehensive GeoAI review: Progress, challenges and outlooks. arXiv preprint arXiv:2412.11643, 2024. arXiv
Zhu Han, Ce Zhang, Lianru Gao, Zhiqiang Zeng, Bing Zhang, Peter M Atkinson. Spatio-temporal multi-level attention crop mapping method using time-series SAR imagery. ISPRS Journal of Photogrammetry and Remote Sensing, 2023.
Ignazio Gallo, Luigi Ranghetti, Nicola Landro, Riccardo La Grassa, Mirco Boschetti. In-season and dynamic crop mapping using 3D convolution neural networks and sentinel-2 time series. ISPRS Journal of Photogrammetry and Remote Sensing, 2023.
Mohammadi Sina, Belgiu Mariana, Stein Alfred. Improvement in crop mapping from satellite image time series by effectively supervising deep neural networks. ISPRS Journal of Photogrammetry and Remote Sensing, 2023.
Varun Tiwari, Mirela G Tulbure, Júlio Caineta, Mollie D Gaines, Vinicius Perin, Mustafa Kamal, Timothy J Krupnik, Md Abdullah Aziz, AFM Tariqul Islam. Automated in-season rice crop mapping using Sentinel time-series data and Google Earth Engine: A case study in climate-risk prone Bangladesh. Journal of Environmental Management, 2024.
João Batista Ribeiro, Renato Rodrigues da Silva, Jocival Dantas Dias, Mauricio Cunha Escarpinati, André Ricardo Backes. Automated detection of sugarcane crop lines from UAV images using deep learning. Information Processing in Agriculture, 2024.
Franciele Morlin Carneiro, Armando Lopes de Brito Filho, Francielle Morelli Ferreira, Getulio de Freitas Seben Junior, Ziany Neiva Brandão, Rouverson Pereira da Silva, Luciano Shozo Shiratsuchi. Soil and satellite remote sensing variables importance using machine learning to predict cotton yield. Smart agricultural technology, 2023.
Zeeshan Ramzan, HM Shahzad Asif, Irfan Yousuf, Muhammad Shahbaz. A multimodal data fusion and deep neural networks based technique for tea yield estimation in Pakistan using satellite imagery. IEEe Access, 2023.
Jinbang Peng, Dongliang Wang, Wanxue Zhu, Ting Yang, Zhen Liu, Ehsan Eyshi Rezaei, Jing Li, Zhigang Sun, Xiaoping Xin. Combination of UAV and deep learning to estimate wheat yield at ripening stage: The potential of phenotypic features. Int. J. Appl. Earth Obs. Geoinformation, 2023.
Yanyu Wang, Ke Zhang, Chunlan Tang, Qiang Cao, Yongchao Tian, Yan Zhu, Weixing Cao, Xiaojun Liu. Estimation of Rice Growth Parameters Based on Linear Mixed-Effect Model Using Multispectral Images from Fixed-Wing Unmanned Aerial Vehicles. Remote Sensing, 2019.
Emmanuel Abiodun Abioye, Mohamad Shukri Zainal Abidin, Mohd Saiful Azimi Mahmud, Salinda Buyamin, Mohamad Hafis Izran Ishak, Muhammad Khairie Idham Abd Rahman, Abdulrahaman Okino Otuoze, Patrick Onotu, Muhammad Shahrul Azwan Ramli. A review on monitoring and advanced control strategies for precision irrigation. Comput. Electron. Agric., 2020.
Anesmar Olino de Albuquerque, Osmar Luiz Ferreira de Carvalho Jr., Cristiano Rosa Silva, Argélica Saiaka Luiz, Pablo Pozzobon de Bem, Roberto Arnaldo Trancoso Gomes, Renato Fontes Guimarães, Osmar Abílio de Carvalho Júnior. Dealing With Clouds and Seasonal Changes for Center Pivot Irrigation Systems Detection Using Instance Segmentation in Sentinel-2 Time Series. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens., 2021.
Ehsan Raei, Ata Akbari Asanjan, Mohammad Reza Nikoo, Mojtaba Sadegh, Shokoufeh Pourshahabi, Jan Franklin Adamowski. A deep learning image segmentation model for agricultural irrigation system classification. Comput. Electron. Agric., 2022.
Harikrishnan Muraleedharan Jalajamony, Midhun Nair, Patricia F. Mead, Renny Edwin Fernandez. Drone Aided Thermal Mapping for Selective Irrigation of Localized Dry Spots. IEEE Access, 2023.
Abebaw Alem, Shailender Kumar. Deep Learning Models Performance Evaluations for Remote Sensed Image Classification. IEEE Access, 2022.
Boan Chen, Quanlong Feng, Bowen Niu, Fengqin Yan, Bingbo Gao, Jianyu Yang, Jianhua Gong, Jiantao Liu. Multi-modal fusion of satellite and street-view images for urban village classification based on a dual-branch deep neural network. Int. J. Appl. Earth Obs. Geoinformation, 2022.
Sally El Hajjar, Fahed Abdallah, H Kassem, H Omrani. Long short-term memory and attention models for simulating urban densification. Sustainable Cities and Society, 2023.
Shuting Sun, Lin Mu, Ruyi Feng, Lizhe Wang, Jijun He. GAN-Based LUCC Prediction via the Combination of Prior City Planning Information and Land-Use Probability. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens., 2021.
Alireza Attarhay Tehrani, Omid Veisi, Bahereh Vojdani Fakhr, Delong Du. Predicting solar radiation in the urban area: A data-driven analysis for sustainable city planning using artificial neural networking. Sustainable Cities and Society, 2024.
Hikmet Canli, Sinan Toklu. Deep Learning-Based Mobile Application Design for Smart Parking. IEEE Access, 2021.
Nanqi Ye, Bowen Wang, Michihiro Kita, Ming Xie, Wenyue Cai. Urban Commerce Distribution Analysis Based on Street View and Deep Learning. IEEE Access, 2019.
Dancho Panovski, Titus Zaharia. Long and Short-Term Bus Arrival Time Prediction With Traffic Density Matrix. IEEE Access, 2020.
Noureen Zafar, Irfan Ul Haq, Huniya Sohail, Jawad-ur-Rehman Chughtai, Muhammad Muneeb. Traffic Prediction in Smart Cities Based on Hybrid Feature Space. IEEE Access, 2022.
Yihang Lu, Xianwei Meng, Liqun Peng, Shucai Xu, Enhong Chen. IODRNN - Incremental output decomposition for a valid traffic flow prediction with GNSS data. Eng. Appl. Artif. Intell., 2024.
Lei Chen, Lu Zhang, Shanshan Cao, Zhiang Wu, Jie Cao. Personalized itinerary recommendation: Deep and collaborative learning with textual information. Expert Syst. Appl., 2020.
Erik Rúa, Antón Núñez-Seoane, Pedro Arias, Joaquín Martínez-Sánchez. Automatic detection to inventory road slopes using open LiDAR point clouds. Int. J. Appl. Earth Obs. Geoinformation, 2023.
Sean P. Kearney, Nicholas C. Coops, Suborna Sethi, Gordon B. Stenhouse. Maintaining accurate, current, rural road network data: An extraction and updating routine using RapidEye, participatory GIS and deep learning. International Journal of Applied Earth Observation and Geoinformation, 2020.
Javier Grandio, Belén Riveiro, Daniel Lamas, Pedro Arias. Multimodal deep learning for point cloud panoptic segmentation of railway environments. Automation in Construction, 2023.
Jianhua Guo, Qingsong Xu, Yue Zeng, Zhiheng Liu, Xiao Xiang Zhu. Nationwide urban tree canopy mapping and coverage assessment in Brazil from high-resolution remote sensing images using deep learning. ISPRS Journal of Photogrammetry and Remote Sensing, 2023.
Shinjita Das, Qian Chayn Sun, Heng Zhou, et al.. GeoAI to implement an individual tree inventory: Framework and application of heat mitigation. Urban Forestry & Urban Greening, 2022.
Angus J Carnegie, Harry Eslick, Paul Barber, Matthew Nagel, Christine Stone. Airborne multispectral imagery and deep learning for biosecurity surveillance of invasive forest pests in urban landscapes. Urban forestry & urban greening, 2023.
Peiqing Lou, Tonghua Wu, Sizhong Yang, Xiaodong Wu, Jianjun Chen, Xiaofan Zhu, Jie Chen, Xingchen Lin, Ren Li, Chengpeng Shang, Dong Wang, Yune La, Amin Wen, Xin Ma. Deep learning reveals rapid vegetation greening in changing climate from 1988 to 2018 on the Qinghai-Tibet Plateau. Ecological Indicators, 2023.
Shidong Wang, Dunyue Cui, Lu Wang, Jinyan Peng. Applying deep-learning enhanced fusion methods for improved NDVI reconstruction and long-term vegetation cover study: A case of the Danjiang River Basin. Ecological Indicators, 2023.
Qinchuan Xin, Jing Li, Ziming Li, Yaoming Li, Xuewen Zhou. Evaluations and comparisons of rule-based and machine-learning-based methods to retrieve satellite-based vegetation phenology using MODIS and USA National Phenology Network data. Int. J. Appl. Earth Obs. Geoinformation, 2020.
Han Ma, Shunlin Liang. Development of the GLASS 250-m leaf area index product (version 6) from MODIS data using the bidirectional LSTM deep learning model. Remote sensing of environment, 2022.
Minsu Kim, Dominik Brunner, Gerrit Kuhlmann. Importance of satellite observations for high-resolution mapping of near-surface NO2 by machine learning. Remote Sensing of Environment, 2021.
Ronald Opio, Isaac Mugume, Joyce Nakatumba-Nabende, Michael Mbogga. Modeling the atmospheric dispersion of SO2 from Mount Nyiragongo. Journal of African Earth Sciences, 2023.
Andrew Rowley, Oktay Karakuş. Predicting air quality via multimodal AI and satellite imagery. Remote Sensing of Environment, 2023.
Dewen Seng, Qiyan Zhang, Xuefeng Zhang, Guangsen Chen, Xiyuan Chen. Spatiotemporal prediction of air quality based on LSTM neural network. Alexandria Engineering Journal, 2021.
Jiyunting Sun, J. Pepijn Veefkind, Peter van Velthoven, Pieternel F. Levelt. Aerosol Absorption Over Land Derived From the Ultra-Violet Aerosol Index by Deep Learning. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens., 2021.
Saeed Alqadhi, Ahmed Ali Bindajam, Javed Mallick, Swapan Talukdar, Atiqur Rahman. Applying deep learning to manage urban ecosystems in arid Abha, Saudi Arabia: Remote sensing-based modelling for ecological condition assessment and decision-making. Heliyon, 2024.
Lorenzo Gianquintieri, Daniele Oxoli, Enrico Gianluca Caiani, Maria Antonia Brovelli. Implementation of a GEOAI model to assess the impact of agricultural land on the spatial distribution of PM2. 5 concentration. Chemosphere, 2024.
Valeriy Shevchenko, Aleksandr Lukashevich, Daria Taniushkina, Alexander Bulkin, Roland Grinis, Kirill Kovalev, Veronika Narozhnaia, Nazar Sotiriadi, Alexander Krenke, Yury Maximov. Climate Change Impact on Agricultural Land Suitability: An Interpretable Machine Learning-Based Eurasia Case Study. IEEE Access, 2024.
Md Touhidul Islam, Keisuke Yoshida, Satoshi Nishiyama, Koichi Sakai. Mutual validation of remote hydraulic estimates and flow model simulations using UAV-borne LiDAR and deep learning-based imaging techniques. Results in Engineering, 2023.
Ling Du, Gregory W McCarty, Xia Li, Xin Zhang, Martin C Rabenhorst, Megan W Lang, Zhenhua Zou, Xuesong Zhang, Audra L Hinson. Drainage ditch network extraction from lidar data using deep convolutional neural networks in a low relief landscape. Journal of Hydrology, 2024.
Shuting Sun, Lin Mu, Ruyi Feng, Yifu Chen, Wei Han. Quadtree decomposition-based Deep learning method for multiscale coastline extraction with high-resolution remote sensing imagery. Science of Remote Sensing, 2024.
Ting On Chan, Simin Zhang, Linyuan Xia, Ming Luo, Jinhua Wu, Joseph L. Awange. A novel reflectance transformation and convolutional neural network framework for generating bathymetric data for long rivers: A case study on the Bei River in South China. Int. J. Appl. Earth Obs. Geoinformation, 2024.
Eyob Betru Wegayehu, Fiseha Behulu Muluneh. Super ensemble based streamflow simulation using multi-source remote sensing and ground gauged rainfall data fusion. Heliyon, 2023.
Rami Al-Ruzouq, Abdallah Shanableh, Ratiranjan Jena, Sunanda Mukherjee, Mohamad Ali Khalil, Mohamed Barakat A Gibril, Biswajeet Pradhan, Nezar Atalla Hammouri. Hybrid deep learning and remote sensing for the delineation of artificial groundwater recharge zones. The Egyptian Journal of Remote Sensing and Space Sciences, 2024.
Hossein Sahour, Mohamed Sultan, Bassam Abdellatif, Mustafa Emil, Abotalib Z Abotalib, Karem Abdelmohsen, Mehdi Vazifedan, Abdullah T Mohammad, Safaa M Hassan, Mohamed R Metwalli, et al.. Identification of shallow groundwater in arid lands using multi-sensor remote sensing data and machine learning algorithms. Journal of Hydrology, 2022.
Viet-Ha Nhu, Duong Cao Phan, Pham Viet Hoa, Pham The Vinh, Dieu Tien Bui. A new approach based on deep neural networks and multisource geospatial data for spatial prediction of groundwater spring potential. IEEE Access, 2024.
Jae Young Seo, Sang-Il Lee. Predicting changes in spatiotemporal groundwater storage through the integration of multi-satellite data and deep learning models. IEEE Access, 2021.
F Sabzehee, AR Amiri-Simkooei, S Iran-Pour, BD Vishwakarma, R Kerachian. Enhancing spatial resolution of GRACE-derived groundwater storage anomalies in Urmia catchment using machine learning downscaling methods. Journal of Environmental Management, 2023.
Zhibin Sun, Ni-Bin Chang, Chi-Farn Chen, Chandan Mostafiz, Wei Gao. Ensemble learning via higher order singular value decomposition for integrating data and classifier fusion in water quality monitoring. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021.
Wenlan Yang, Bolin Fu, Sunzhe Li, Zhinan Lao, Tengfang Deng, Wen He, Hongchang He, Zhikun Chen. Monitoring multi-water quality of internationally important karst wetland through deep learning, multi-sensor and multi-platform remote sensing images: A case study of Guilin, China. Ecological Indicators, 2023.
Sensen Wu, Jin Qi, Zhen Yan, Fangzheng Lyu, Tao Lin, Yuanyuan Wang, Zhenhong Du. Spatiotemporal assessments of nutrients and water quality in coastal areas using remote sensing and a spatiotemporal deep learning model. International Journal of Applied Earth Observation and Geoinformation, 2022.
Taleb Vakili, Jamil Amanollahi. Determination of optically inactive water quality variables using Landsat 8 data: A case study in Geshlagh reservoir affected by agricultural land use. Journal of Cleaner Production, 2020.
Edson Filisbino Freire da Silva, Evlyn Márcia Leão de Moraes Novo, Felipe de Lucia Lobo, Cláudio Clemente Faria Barbosa, Carolline Tressmann Cairo, Mauricio Almeida Noernberg, Luiz Henrique da Silva Rotta. A machine learning approach for monitoring Brazilian optical water types using Sentinel-2 MSI. Remote Sensing Applications: Society and Environment, 2021.
Dan Niu, Hongshu Che, Chunlei Shi, Zengliang Zang, Hongbin Wang, Xunlai Chen, Qunbo Huang. A heterogeneous spatiotemporal attention fusion prediction network for precipitation nowcasting. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2023.
Qizhao Jin, Xinbang Zhang, Xinyu Xiao, Ying Wang, Gaofeng Meng, Shiming Xiang, Chunhong Pan. Spatiotemporal inference network for precipitation nowcasting with multimodal fusion. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2023.
Chuyao Luo, Xutao Li, Yunming Ye. PFST-LSTM: A spatiotemporal LSTM model with pseudoflow prediction for precipitation nowcasting. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020.
Cenker Sengoz, Sheela Ramanna, Scott Kehler, Rushil Goomer, Paul Pries. Machine learning approaches to improve north american precipitation forecasts. IEEE Access, 2023.
Ratiranjan Jena, Biswajeet Pradhan, Sambit Prasanajit Naik, Abdullah M Alamri. Earthquake risk assessment in NE India using deep learning and geospatial analysis. Geoscience Frontiers, 2021.
Pan Xiong, Cheng Long, Huiyu Zhou, Xuemin Zhang, Xuhui Shen. GNSS TEC-based earthquake ionospheric perturbation detection using a novel deep learning framework. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022.
Amna Hafeez, Munawar Shah, Muhsan Ehsan, Punyawi Jamjareegulgarn, Junaid Ahmed, M Arslan Tariq, Shahid Iqbal, Najam Abbas Naqvi. Possible atmosphere and ionospheric anomalies of the 2019 Pakistan earthquake using statistical and machine learning procedures on MODIS LST, GPS TEC, and GIM TEC. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021.
Yolanda Torres, José Juan Arranz, Jorge M Gaspar-Escribano, Azadeh Haghi, Sandra Martı́nez-Cuevas, Belén Benito, Juan Carlos Ojeda. Integration of LiDAR and multispectral images for rapid exposure and earthquake vulnerability estimation. Application in Lorca, Spain. International Journal of Applied Earth Observation and Geoinformation, 2019.
Vivien Zahs, Katharina Anders, Julia Kohns, Alexander Stark, Bernhard Höfle. Classification of structural building damage grades from multi-temporal photogrammetric point clouds using a machine learning model trained on virtual laser scanning data. International Journal of Applied Earth Observation and Geoinformation, 2023.
Supattra Puttinaovarat, Paramate Horkaew. Flood Forecasting System Based on Integrated Big and Crowdsource Data by Using Machine Learning Techniques. IEEE Access, 2020.
Mohammed Moishin, Ravinesh C. Deo, Ramendra Prasad, Nawin Raj, Shahab A. Abdulla. Designing Deep-Based Learning Flood Forecast Model With ConvLSTM Hybrid Algorithm. IEEE Access, 2021.
Wenmei Li, Jiaqi Wu, Huaihuai Chen, Yu Wang, Yan Jia, Guan Gui. UNet Combined With Attention Mechanism Method for Extracting Flood Submerged Range. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens., 2022.
Tejas Rathod, Vinay Patil, R Harikrishnan, Priti Shahane. Multipurpose deep learning-powered UAV for forest fire prevention and emergency response. HardwareX, 2023.
Van The Pham, Tuyet Anh Thi Do, Hau Duc Tran, Anh Ngoc Thi Do. Classifying forest cover and mapping forest fire susceptibility in Dak Nong province, Vietnam utilizing remote sensing and machine learning. Ecological Informatics, 2024.
Xiwen Chen, Bryce Hopkins, Hao Wang, Leo O’Neill, Fatemeh Afghah, Abolfazl Razi, Peter Fulé, Janice Coen, Eric Rowell, Adam Watts. Wildland fire detection and monitoring using a drone-collected RGB/IR image dataset. IEEE Access, 2022.
Ali Akbar Siddique, Nada Alasbali, Maha Driss, Wadii Boulila, Mohammed S. Alshehri, Jawad Ahmad. Sustainable collaboration: Federated learning for environmentally conscious forest fire classification in Green Internet of Things (IoT). Internet Things, 2024.
Ah Young Cho, Si-eun Park, Duk-jin Kim, Junwoo Kim, Chenglei Li, Juyoung Song. Burned Area Mapping Using Unitemporal PlanetScope Imagery With a Deep Learning Based Approach. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens., 2023.
Siva R. Venna, Amirhossein Tavanaei, Raju N. Gottumukkala, Vijay V. Raghavan, Anthony S. Maida, Stephen Nichols. A Novel Data-Driven Model for Real-Time Influenza Forecasting. IEEE Access, 2019.
Hongping Hu, Haiyan Wang, Feng Wang, Daniel Langley, Adrian Avram, Maoxing Liu. Prediction of influenza-like illness based on the improved artificial tree algorithm and artificial neural network. Scientific reports, 2018.
Fred S Lu, Mohammad W Hattab, Cesar Leonardo Clemente, Matthew Biggerstaff, Mauricio Santillana. Improved state-level influenza nowcasting in the United States leveraging Internet-based data and network approaches. Nature communications, 2019.
Pi Guo, Tao Liu, Qin Zhang, Li Wang, Jianpeng Xiao, Qingying Zhang, Ganfeng Luo, Zhihao Li, Jianfeng He, Yonghui Zhang, et al.. Developing a dengue forecast model using machine learning: A case study in China. PLoS neglected tropical diseases, 2017.
Adam Sadilek, Stephanie Caty, Lauren DiPrete, Raed Mansour, Tom Schenk Jr., Mark Bergtholdt, Ashish Jha, Prem Ramaswami, Evgeniy Gabrilovich. Machine-learned epidemiology: real-time detection of foodborne illness at scale. npj Digit. Medicine, 2018.
Yunxiang Zhao, Mingda Hu, Yuan Jin, Fei Chen, Xin Wang, Boqian Wang, Junjie Yue, Hongguang Ren. Predicting the transmission trend of respiratory viruses in new regions via geospatial similarity learning. Int. J. Appl. Earth Obs. Geoinformation, 2023.
Cecilia Cordeiro da Silva, Clarisse Lins de Lima, Ana Clara Gomes da Silva, Eduardo Luiz Silva, Gabriel Souza Marques, Lucas Job Brito de Araújo, Luiz Antônio Albuquerque Júnior, Samuel Barbosa Jatobá de Souza, Maı́ra Araújo de Santana, Juliana Carneiro Gomes, et al.. Covid-19 dynamic monitoring and real-time spatio-temporal forecasting. Frontiers in public health, 2021.
Sofiane Atek, Cristiano Pesaresi, Marco Eugeni, Corrado De Vito, Vincenzo Cardinale, Massimo Mecella, Antonello Rescio, Luca Petronzio, Aldo Vincenzi, Pasquale Pistillo, et al.. A Geospatial Artificial Intelligence and satellite-based earth observation cognitive system in response to COVID-19. Acta astronautica, 2022.
Boxing Zhang, Huan Lei, Yingjie Cai, Zhenyu Zhong, Zeyu Jiao. COVID-19 contact tracking based on person reidentification and geospatial data. J. King Saud Univ. Comput. Inf. Sci., 2023.
Zhenyu Tan, Xinghua Li, Meiling Gao, Liangcun Jiang. The Environmental Story During the COVID-19 Lockdown: How Human Activities Affect PM2.5 Concentration in China?. IEEE Geosci. Remote. Sens. Lett., 2022.
James G Kahn, Joshua S Yang, James S Kahn. ‘Mobile’health needs and opportunities in developing countries. Health affairs, 2010.
Santosh Kumar, Gregory D. Abowd, William T. Abraham, Mustafa al'Absi, J. Gayle Beck, Duen Horng Chau, Tyson Condie, David E. Conroy, Emre Ertin, Deborah Estrin, Deepak Ganesan, Cho Lam, Benjamin M. Marlin, Clay B. Marsh, Susan A. Murphy, Inbal Nahum-Shani, Kevin Patrick, James M. Rehg, Moushumi Sharmin, Vivek Shetty, Ida Sim, Bonnie Spring, Mani B. Srivastava, David W. Wetter. Center of excellence for mobile sensor data-to-knowledge (MD2K). J. Am. Medical Informatics Assoc., 2015.
Yu Zhan, Yuzhou Luo, Xunfei Deng, Huajin Chen, Michael L Grieneisen, Xueyou Shen, Lizhong Zhu, Minghua Zhang. Spatiotemporal prediction of continuous daily PM2. 5 concentrations across China using a spatially explicit machine learning algorithm. Atmospheric environment, 2017.
Qian Di, Itai Kloog, Petros Koutrakis, Alexei Lyapustin, Yujie Wang, Joel Schwartz. Assessing PM2. 5 exposures with high spatiotemporal resolution across the continental United States. Environmental science & technology, 2016.
Colorado J. Reed, Ritwik Gupta, Shufan Li, Sarah Brockman, Christopher Funk, Brian Clipp, Kurt Keutzer, Salvatore Candido, Matt Uyttendaele, Trevor Darrell. Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learning. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Johannes Jakubik, Sujit Roy, C. E. Phillips, Paolo Fraccaro, Denys Godwin, Bianca Zadrozny, Daniela Szwarcman, Carlos Gomes, Gabby Nyirjesy, Blair Edwards, et al.. Foundation Models for Generalist Geospatial Artificial Intelligence. arXiv preprint arXiv:2310.18660, 2023. arXiv
Fan Liu, Delong Chen, Zhangqingyun Guan, Xiaocong Zhou, Jiale Zhu, Qiaolin Ye, Liyong Fu, Jun Zhou. RemoteCLIP: A Vision Language Foundation Model for Remote Sensing. IEEE Transactions on Geoscience and Remote Sensing, 2024.
Kartik Kuckreja, Muhammad Sohail Danish, Muzammal Naseer, Abhijit Das, Salman Khan, Fahad Shahbaz Khan. GeoChat: Grounded Large Vision-Language Model for Remote Sensing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Kaiyu Li, Zepeng Xin, Li Pang, Chao Pang, Yupeng Deng, Jing Yao, Guisong Xia, Deyu Meng, Zhi Wang, Xiangyong Cao. SegEarth-R1: Geospatial Pixel Reasoning via Large Language Model. arXiv preprint arXiv:2504.09644, 2025. arXiv
Simone D’Amico, Mathias Benn, John L Jørgensen. Pose estimation of an uncooperative spacecraft from actual space imagery. International Journal of Space Science and Engineering 5, 2014.
Pedro F Proença, Yang Gao. Deep learning for spacecraft pose estimation from photorealistic rendering. 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020.
Albert Garcia, Mohamed Adel Musallam, Vincent Gaudilliere, Enjie Ghorbel, Kassem Al Ismaeil, Marcos Perez, Djamila Aouada. Lspnet: A 2d localization-oriented spacecraft pose estimation neural network. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
Sumant Sharma, Simone D’Amico. Neural network-based pose estimation for noncooperative spacecraft rendezvous. IEEE Transactions on Aerospace and Electronic Systems, 2020.
Thaweerath Phisannupawong, Patcharin Kamsing, Peerapong Torteeka, Sittiporn Channumsin, Utane Sawangwit, Warunyu Hematulin, Tanatthep Jarawan, Thanaporn Somjit, Soemsak Yooyen, Daniel Delahaye, et al.. Vision-based spacecraft pose estimation via a deep convolutional neural network for noncooperative docking operations. Aerospace, 2020.
Shubham Sonawani, Ryan Alimo, Renaud Detry, Daniel Jeong, Andrew Hess, Heni Ben Amor. Assistive relative pose estimation for on-orbit assembly using convolutional neural networks. arXiv preprint arXiv:2001.10673, 2020. arXiv
Tae Ha Park, Simone D’Amico. Robust multi-task learning and online refinement for spacecraft pose estimation across domain gap. Advances in Space Research, 2024.
Zibin Liu, Banglei Guan, Yang Shang, Yifei Bian, Pengju Sun, Qifeng Yu. Stereo event-based, 6-DOF pose tracking for uncooperative spacecraft. IEEE Transactions on Geoscience and Remote Sensing, 2025.
Tae Ha Park, Marcus Märtens, Gurvan Lecuyer, Dario Izzo, Simone D'Amico. SPEED+: Next-generation dataset for spacecraft pose estimation across domain gap. 2022 IEEE aerospace conference (AERO), 2022.
Mate Kisantal, Sumant Sharma, Tae Ha Park, Dario Izzo, Marcus Märtens, Simone D’Amico. Satellite pose estimation challenge: Dataset, competition design, and results. IEEE Transactions on Aerospace and Electronic Systems, 2020.
Mohamed Adel Musallam, Arunkumar Rathinam, Vincent Gaudillière, Miguel Ortiz del Castillo, Djamila Aouada. Cubesat-cdt: a cross-domain dataset for 6-dof trajectory estimation of a symmetric spacecraft. European Conference on Computer Vision, 2022.
Mohamed Adel Musallam, Vincent Gaudilliere, Enjie Ghorbel, Kassem Al Ismaeil, Marcos Damian Perez, Michel Poucet, Djamila Aouada. Spacecraft recognition leveraging knowledge of space environment: Simulator, dataset, competition design and analysis. 2021 IEEE International Conference on Image Processing Challenges (ICIPC), 2021.
Kevin Black, Shrivu Shankar, Daniel Fonseka, Jacob Deutsch, Abhimanyu Dhir, Maruthi R Akella. Real-time, flight-ready, non-cooperative spacecraft pose estimation using monocular imagery. arXiv preprint arXiv:2101.09553, 2021. arXiv
Tae Ha Park, Sumant Sharma, Simone D'Amico. Towards robust learning-based pose estimation of noncooperative spacecraft. arXiv preprint arXiv:1909.00392, 2019. arXiv
Yadong Shao, Aodi Wu, Shengyang Li, Leizheng Shu, Xue Wan, Yuanbin Shao, Junyan Huo. Satellite component semantic segmentation: Video dataset and real-time pyramid attention and decoupled attention network. IEEE Transactions on Aerospace and Electronic Systems, 2023.
Guangyuan Zhao, Xue Wan, Yaolin Tian, Yadong Shao, Shengyang Li. 3D component segmentation network and dataset for non-cooperative spacecraft. Aerospace, 2022.
Zhihao Zhang, Zhaohui Dang. Automatic Segmentation Annotation of Space Target Using Segment Anything Model and Object Detection Prompts. IEEE Transactions on Aerospace and Electronic Systems, 2024.
Fan Li, Zhaoxiang Zhang, Xuan Wang, Xuanbin Wang, Yuelei Xu. Exploiting Diffusion Priors for Generalizable Few-Shot Satellite Image Semantic Segmentation. Remote Sensing, 2025.
Chaoyan Zhang, Baolong Guo, Nannan Liao, Qiuyun Zhong, Hengyan Liu, Cheng Li, Jianglei Gong. STAR-24K: A Public Dataset for Space Common Target Detection.. KSII Transactions on Internet & Information Systems, 2022.
LZ Li, T Zhang. Feature detection and recognition of spatial noncooperative objects based on deep learning. CAAI Trans. Intell. Syst., 2020.
Yi Cao, Jinzhen Mu, Xianghong Cheng, Fengyu Liu. Spacecraft-ds: A spacecraft dataset for key components detection and segmentation via hardware-in-the-loop capture. IEEE Sensors Journal, 2024.
Yunpeng Zhao, Rui Zhong, Linyan Cui. Intelligent recognition of spacecraft components from photorealistic images based on Unreal Engine 4. Advances in Space Research, 2023.
Hoang Anh Dung, Bo Chen, Tat-Jun Chin. A spacecraft dataset for detection, segmentation and parts recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021.
Yuxuan Liu, Chunjiang Bian, Hongbin Nie, Shi Chen, Ziqian Yang. A Large-Scale Synthetic Benchmark Dataset for Non-Cooperative Space Target Perception. Scientific Data, 2025.
Douglas E Bernard, Gregory A Dorais, Chuck Fry, Edward B Gamble, Bob Kanefsky, James Kurien, William Millar, Nicola Muscettola, P Pandurang Nayak, Barney Pell, et al.. Design of the remote agent experiment for spacecraft autonomy. 1998 IEEE Aerospace Conference Proceedings (Cat. No. 98TH8339), 1998.
Barney Pell, Douglas E Bernard, Steve A Chien, Erann Gat, Nicola Muscettola, P Pandurang Nayak, Michael D Wagner, Brian C Williams. An autonomous spacecraft agent prototype. Proceedings of the first international conference on autonomous agents, 1997.
Mitchell Colby, Logan Yliniemi, Kagan Tumer. Autonomous multiagent space exploration with high-level human feedback. Journal of Aerospace Information Systems, 2016.
Victor Rodriguez-Fernandez, Alejandro Carrasco, Jason Cheng, Eli Scharf, Peng Mun Siew, Richard Linares. Language models are spacecraft operators. arXiv preprint arXiv:2404.00413, 2024. arXiv
Alejandro Carrasco, Marco Nedungadi, Victor Rodriguez-Fernandez, Richard Linares. Visual language models as operator agents in the space domain. AIAA SCITECH 2025 Forum, 2025.
Enrico M Zucchelli, Di Wu, Julia Briden, Christian Hofmann, Victor Rodriguez-Fernandez, Richard Linares. Fine-Tuned Language Models as Space Systems Controllers. arXiv preprint arXiv:2501.16588, 2025. arXiv
Alejandro Carrasco, Victor Rodriguez-Fernandez, Richard Linares. Fine-tuning LLMs for Autonomous Spacecraft Control: A Case Study Using Kerbal Space Program. arXiv preprint arXiv:2408.08676, 2024. arXiv
Matthew Foutter, Daniele Gammelli, Justin Kruger, Ethan Foss, Praneet Bhoj, Tommaso Guffanti, Simone D'Amico, Marco Pavone. Space-LLaVA: a Vision-Language Model Adapted to Extraterrestrial Applications. arXiv preprint arXiv:2408.05924, 2024. arXiv
Alejandro Carrasco, Victor Rodriguez-Fernandez, Richard Linares. Large Language Models as Autonomous Spacecraft Operators in Kerbal Space Program. Advances in Space Research, 2025.
Ruben Belo, Cláudia Soares, Marta Guimarães. Language Modeling and Retrieval-Augmented Generation for Integration in Space Operation Decision Support Tools. 58th IAA Symposium on Safety, Quality and Knowledge Management in Space Activities, 2025.
Cheyenne Powell, Annalisa Riccardi. Question answering over knowledge graphs for explainable satellite scheduling. Journal of Aerospace Information Systems, 2025.
Aodi Wu, Haodong Han, Xubo Luo, Xue Wan. SpaceMind: An MCP-based Agent Architecture Fusing Large and Small Models for On-orbit Servicing. Authorea Preprints, 2025.
Ross E Allen, Yaron Rachlin, Jessica Ruprecht, Sean Loughran, Jacob Varey, Herbert Viggh. Spacegym: Discrete and differential games in non-cooperative space operations. 2023 IEEE Aerospace Conference, 2023.
Mark Maimone, Yang Cheng, Larry Matthies. Two years of visual odometry on the Mars Exploration Rovers. Journal of Field Robotics, 2007.
Olivier Toupet, et al.. Enhanced Autonomous Navigation on the Perseverance Mars Rover. IEEE Transactions on Field Robotics, 2025. DOI
Masoud S Bahraini, Abdelhafid Zenati, Nabil Aouf. Autonomous cooperative visual navigation for planetary exploration robots. 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021.
Miguel Leiva Vélez, Victor Rodriguez-Fernandez, Hodei Urrutxua, Nicolas Rozado. A Hierarchical Decision-Making Framework for Autonomous and Adaptive Planetary Robotics. 2025.
Kevin Nickels, Matthew DiCicco, Max Bajracharya, Paul Backes. Vision guided manipulation for planetary robotics—position control. Robotics and Autonomous systems, 2010.
Fausto Milletari, Nassir Navab, Seyed-Ahmad Ahmadi. V-Net: Fully convolutional neural networks for volumetric medical image segmentation. International Conference on 3D Vision (3DV), 2016.
Fabian Isensee, Paul F. Jaeger, Simon A. A. Kohl, Jens Petersen, Klaus H. Maier-Hein. nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nature Methods, 2021.
Ali Hatamizadeh, Yucheng Tang, Vishwesh Nath, Dong Yang, Andriy Myronenko, Bennett Landman, Holger R. Roth, Daguang Xu. UNETR: Transformers for 3D medical image segmentation. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022.
Ali Hatamizadeh, Vishwesh Nath, Yucheng Tang, Dong Yang, Holger R. Roth, Daguang Xu. Swin UNETR: Swin transformers for semantic segmentation of brain tumors in MRI images. International MICCAI Brainlesion Workshop, 2022.
Jakob Wasserthal, Hanns-Christian Breit, Manfred T. Meyer, Maurice Pradella, Daniel Hinck, Alexander W. Sauter, Tobias Heye, Daniel T. Boll, Joshy Cyriac, Shan Yang, Michael Bach, Martin Segeroth. TotalSegmentator: Robust segmentation of 104 anatomic structures in CT images. Radiology: Artificial Intelligence, 2023.
Abdel Aziz Taha, Allan Hanbury. Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Medical Imaging, 2015.
Jun Ma, Yuting He, Feifei Li, Lin Han, Chenyu You, Bo Wang. Segment anything in medical images. Nature Communications, 2024.
Haoyu Wang, Sizheng Guo, Jin Ye, Zhong ying Deng, Junlong Cheng, Tianbin Li, Jianpin Chen, Yanzhou Su, Ziyan Huang, Yiqing Shen, Bin Fu, Shaoting Zhang, Junjun He, Yu Qiao. SAM-Med3D: Towards general-purpose segmentation models for volumetric medical images. arXiv preprint arXiv:2310.15161, 2023. arXiv
Yuxin Du, Fan Bai, Tiejun Huang, Bo Zhao. SegVol: Universal and interactive volumetric medical image segmentation. Advances in Neural Information Processing Systems, 2024.
M. Jorge Cardoso, Wenqi Li, Richard Brown, Nic Ma, Eric Kerfoot, Yiheng Wang, Benjamin Murrey, Andriy Myronenko, Can Zhao, Dong Yang, et al.. MONAI: An open-source framework for deep learning in healthcare. arXiv preprint arXiv:2211.02701, 2022. arXiv
Samuel G. Armato III, Geoffrey McLennan, Luc Bidaut, Michael F. McNitt-Gray, Charles R. Meyer, Anthony P. Reeves, Binsheng Zhao, Denise R. Aberle, Claudia I. Henschke, Eric A. Hoffman, et al.. The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. Medical Physics, 2011.
Arnaud Arindra Adiyoso Setio, Alberto Traverso, Thomas de Bel, Moira S. N. Berens, Cas van den Bogaard, Piergiorgio Cerello, Hao Chen, Qi Dou, Maria Evelina Fantacci, Bram Geurts, et al.. Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Medical Image Analysis, 2017.
Florin C. Ghesu, Bogdan Georgescu, Tommaso Mansi, Dominik Neumann, Joachim Hornegger, Dorin Comaniciu. An artificial agent for anatomical landmark detection in medical images. International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2016.
Guha Balakrishnan, Amy Zhao, Mert R. Sabuncu, John Guttag, Adrian V. Dalca. VoxelMorph: A learning framework for deformable medical image registration. IEEE Transactions on Medical Imaging, 2019.
Junyu Chen, Eric C. Frey, Yufan He, William P. Segars, Ye Li, Yong Du. TransMorph: Transformer for unsupervised medical image registration. Medical Image Analysis, 2022.
Brian B. Avants, Charles L. Epstein, Murray Grossman, James C. Gee. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Medical Image Analysis, 2008.
Stefan Klein, Marius Staring, Keelin Murphy, Max A. Viergever, Josien P. W. Pluim. elastix: a toolbox for intensity-based medical image registration. IEEE Transactions on Medical Imaging, 2010.
Michela Antonelli, Annika Reinke, Spyridon Bakas, Keyvan Farahani, Annette Kopp-Schneider, Bennett A. Landman, Geert Litjens, Bjoern Menze, Olaf Ronneberger, Ronald M. Summers, et al.. The Medical Segmentation Decathlon. Nature Communications, 2022.
Bjoern H. Menze, Andras Jakab, Stefan Bauer, Jayashree Kalpathy-Cramer, Keyvan Farahani, Justin Kirby, Yuliya Burren, Nicole Porz, Johannes Slotboom, Roland Wiest, et al.. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Transactions on Medical Imaging, 2015.
Yuanfeng Ji, Haotian Bai, Chongjian Ge, Jie Yang, Ye Zhu, Ruimao Zhang, Zhen Li, Lingyan Zhanng, Wanling Ma, Xiang Wan, Ping Luo. AMOS: A large-scale abdominal multi-organ benchmark for versatile medical image segmentation. Advances in Neural Information Processing Systems, Datasets and Benchmarks Track, 2022.
Bennett Landman, Zhoubing Xu, J. Igelsias, Martin Styner, Thomas Langerak, Arno Klein. MICCAI multi-atlas labeling beyond the cranial vault--workshop and challenge. Proc. MICCAI Multi-Atlas Labeling Beyond Cranial Vault Workshop Challenge, 2015.
Nicholas Heller, Fabian Isensee, Klaus H. Maier-Hein, Xiaoshuai Hou, Chunmei Xie, Fengyi Li, Yang Nan, Guangrui Mu, Zhiyong Lin, Miofei Han, et al.. The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 challenge. Medical Image Analysis, 2021.
Olivier Bernard, Alain Lalande, Clement Zotti, Frederick Cervenansky, Xin Yang, Pheng-Ann Heng, Irem Cetin, Karim Lekadir, Oscar Camara, Miguel Angel Gonzalez Ballester, et al.. Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved?. IEEE Transactions on Medical Imaging, 2018.
Tobias Heimann, Hans-Peter Meinzer. Statistical shape models for 3D medical image segmentation: a review. Medical Image Analysis, 2009.
Udaranga Wickramasinghe, Edoardo Remelli, Graham Knott, Pascal Fua. Voxel2Mesh: 3D mesh model generation from volumetric data. International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2020.
Fanwei Kong, Nathan Wilson, Shawn Shadden. A deep-learning approach for direct whole-heart mesh reconstruction. Medical Image Analysis, 2021.
Ruyi Zha, Yanhao Zhang, Hongdong Li. NAF: Neural attenuation fields for sparse-view CBCT reconstruction. International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2022.
Steven A. Niederer, Joost Lumens, Natalia A. Trayanova. Computational models in cardiology. Nature Reviews Cardiology, 2019.
Adityo Prakosa, Hermenegild J. Arevalo, Dongdong Deng, Patrick M. Boyle, Plamen P. Nikolov, Hiroshi Ashikaga, Joshua J. E. Blauer, Elyar Ghafoori, Carolyn J. Park, Robert C. Blake, et al.. Personalized virtual-heart technology for guiding the ablation of infarct-related ventricular tachycardia. Nature Biomedical Engineering, 2018.
Charles A. Taylor, Timothy A. Fonte, James K. Min. Computational fluid dynamics applied to cardiac computed tomography for noninvasive quantification of fractional flow reserve: scientific basis. Journal of the American College of Cardiology, 2013.
Huifang E. Wang, Marmaduke Woodman, Paul Triebkorn, Jean-Didier Lemarechal, Jayant Jha, Borana Dollomaja, Anirudh Nihalani Vattikonda, Viktor Sip, Samuel Medina Villalon, Meysam Hashemi, et al.. Virtual brain twins from MRI for personalized epilepsy surgery. Science Translational Medicine, 2023.
Marco Viceconti, Adriano Henney, Edwin Morley-Fletcher. In silico clinical trials: how computer simulation will transform the biomedical industry. International Journal of Clinical Trials, 2016.
Aldo Badano, Christian G. Graff, Andreu Badal, Diksha Sharma, Rongping Zeng, Frank W. Samuelson, Stephen J. Glick, Kyle J. Myers. Evaluation of digital breast tomosynthesis as replacement of full-field digital mammography using an in silico imaging trial. JAMA Network Open, 2018.
Andriy Fedorov, Reinhard Beichel, Jayashree Kalpathy-Cramer, Julien Finet, Jean-Christophe Fillion-Robin, Sonia Pujol, Christian Bauer, Dominique Jennings, Fiona Fennessy, Milan Sonka, et al.. 3D Slicer as an image computing platform for the quantitative imaging network. Magnetic Resonance Imaging, 2012.
François Faure, Christian Duriez, Hervé Delingette, Jérémie Allard, Benjamin Gilles, Stéphanie Marchesseau, Hugo Talbot, Hadrien Courtecuisse, Guillaume Bousquet, Igor Peterlik, Stéphane Cotin. SOFA: A multi-model framework for interactive physical simulation. Soft Tissue Biomechanical Modeling for Computer Assisted Surgery, 2012.
Aaron Babier, Binghao Zhang, Rafid Mahmood, Kevin L. Moore, Thomas G. Purdie, Andrea L. McNiven, Timothy C. Y. Chan. OpenKBP: the open-access knowledge-based planning grand challenge and dataset. Medical Physics, 2021.
Camilo A Molina, Frank M Phillips, Matthew W Colman, Wilson Z Ray, Majid Khan, Kornelis Poelstra, Larry Khoo, et al.. A cadaveric precision and accuracy analysis of augmented reality--mediated percutaneous pedicle implant insertion: presented at the 2020 AANS/CNS joint section on disorders of the spine and peripheral nerves. Journal of Neurosurgery: Spine, 2020.
Andru P. Twinanda, Sherif Shehata, Didier Mutter, Jacques Marescaux, Michel De Mathelin, Nicolas Padoy. EndoNet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Transactions on Medical Imaging, 2017.
Max Allan, Jonathan Mcleod, Congcong Wang, Jean Claude Rosenthal, Zhenglei Hu, Niklas Gard, Peter Eisert, Ke Xue Fu, Trevor Zeffiro, Wenyao Xia, et al.. Stereo correspondence and reconstruction of endoscopic data challenge. arXiv preprint arXiv:2101.01133, 2021. arXiv
Kutsev Bengisu Ozyoruk, Guliz Irem Gokceler, Taylor L. Bobrow, Gulfize Coskun, Kagan Incetan, Yasin Almalioglu, Faisal Mahmood, Eva Curto, Luis Perdigoto, Marina Oliveira, et al.. EndoSLAM dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videos. Medical Image Analysis, 2021.
Yuehao Wang, Yonghao Long, Siu Hin Fan, Qi Dou. Neural rendering for stereo 3D reconstruction of deformable tissues in robotic surgery. International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2022.
Peter Kazanzides, Zihan Chen, Anton Deguet, Gregory S. Fischer, Russell H. Taylor, Simon P. DiMaio. An open-source research kit for the da Vinci surgical system. IEEE International Conference on Robotics and Automation (ICRA), 2014.
Guang-Zhong Yang, James Cambias, Kevin Cleary, Eric Daimler, James Drake, Pierre E. Dupont, Nobuhiko Hata, Peter Kazanzides, Sylvain Martel, Rajni V. Patel, et al.. Medical robotics--regulatory, ethical, and legal considerations for increasing levels of autonomy. Science Robotics, 2017.
Azad Shademan, Ryan S. Decker, Justin D. Opfermann, Simon Leonard, Axel Krieger, Peter C. W. Kim. Supervised autonomous robotic soft tissue surgery. Science Translational Medicine, 2016.
Hamed Saeidi, Justin D. Opfermann, Michael Kam, Shuwen Wei, Simon Leonard, Michael H. Hsieh, Jin U. Kang, Axel Krieger. Autonomous robotic laparoscopic surgery for intestinal anastomosis. Science Robotics, 2022.
Xiahai Zhuang, Lei Li, Christian Payer, Darko Stern, Martin Urschler, Mattias P. Heinrich, Julien Oster, Chunliang Wang, Orjan Smedby, Cheng Bian, et al.. Evaluation of algorithms for multi-modality whole heart segmentation: an open-access grand challenge. Medical Image Analysis, 2019.
Shih-Cheng Huang, Anuj Pareek, Malte Jensen, Matthew P. Lungren, Serena Yeung, Akshay S. Chaudhari. Self-supervised learning for medical image classification: a systematic review and implementation guidelines. npj Digital Medicine, 2023.
Nicola Rieke, Jonny Hancox, Wenqi Li, Fausto Milletari, Holger R. Roth, Shadi Albarqouni, Spyridon Bakas, Mathieu N. Galtier, Bennett A. Landman, Klaus Maier-Hein, et al.. The future of digital health with federated learning. npj Digital Medicine, 2020.
Julian N. Acosta, Guido J. Falcone, Pranav Rajpurkar, Eric J. Topol. Multimodal biomedical AI. Nature Medicine, 2022.
Vincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell, Gordon Wetzstein. Implicit Neural Representations with Periodic Activation Functions. Advances in Neural Information Processing Systems (NeurIPS), 2020.
Xudong Chen, Zhun Wei, Maokun Li, Paolo Rocca. A Review of Deep Learning Approaches for Inverse Scattering Problems (Invited Review). Progress In Electromagnetics Research, 2020.
Zhun Wei, Xudong Chen. Deep-Learning Schemes for Full-Wave Nonlinear Inverse Scattering Problems. IEEE Transactions on Geoscience and Remote Sensing, 2019.
Yuehaw Khoo, Lexing Ying. SwitchNet: a neural network model for forward and inverse scattering problems. SIAM Journal on Scientific Computing, 2019.
Samuel Greydanus, Misko Dzamba, Jason Yosinski. Hamiltonian Neural Networks. Advances in Neural Information Processing Systems (NeurIPS), 2019.
Miles Cranmer, Sam Greydanus, Stephan Hoyer, Peter Battaglia, David Spergel, Shirley Ho. Lagrangian Neural Networks. ICLR 2020 Workshop on Integration of Deep Neural Models and Differential Equations, 2020.
Miles Cranmer, Alvaro Sanchez Gonzalez, Peter Battaglia, Rui Xu, Kyle Cranmer, David Spergel, Shirley Ho. Discovering symbolic models from deep learning with inductive biases. Advances in neural information processing systems, 2020.
Steven L. Brunton, Joshua L. Proctor, J. Nathan Kutz. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the National Academy of Sciences, 2016.
Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew Stuart, Anima Anandkumar. Fourier Neural Operator for Parametric Partial Differential Equations. International Conference on Learning Representations (ICLR), 2021.
Lu Lu, Pengzhan Jin, Guofei Pang, Zhongqiang Zhang, George Em Karniadakis. Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators. Nature Machine Intelligence, 2021.
Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, Peter Battaglia. Learning to Simulate Complex Physics with Graph Networks. International Conference on Machine Learning (ICML), 2020.
Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, Peter W. Battaglia. Learning Mesh-Based Simulation with Graph Networks. International Conference on Learning Representations (ICLR), 2021.
Arvind T. Mohan, Nicholas Lubbers, Daniel Livescu, Michael Chertkov. Spatio-temporal deep learning models of 3D turbulence with physics informed diagnostics. Journal of Turbulence, 2020.
Bethany Lusch, J. Nathan Kutz, Steven L. Brunton. Deep learning for universal linear embeddings of nonlinear dynamics. Nature Communications, 2018.
Ricky T. Q. Chen, Yulia Rubanova, Jesse Bettencourt, David K. Duvenaud. Neural Ordinary Differential Equations. Advances in Neural Information Processing Systems (NeurIPS), 2018.
Yuanming Hu, Jiancheng Liu, Andrew Spielberg, Joshua B. Tenenbaum, William T. Freeman, Jiajun Wu, Daniela Rus, Wojciech Matusik. ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics. IEEE International Conference on Robotics and Automation (ICRA), 2019.
Kristof T. Schütt, Pieter-Jan Kindermans, Huziel E. Sauceda, Stefan Chmiela, Alexandre Tkatchenko, Klaus-Robert Müller. SchNet: A continuous-filter convolutional neural network for modeling quantum interactions. Advances in Neural Information Processing Systems (NeurIPS), 2017.
Johannes Klicpera, Janek Groß, Stephan Günnemann. Directional Message Passing for Molecular Graphs. International Conference on Learning Representations (ICLR), 2020.
Kristof T. Schütt, Oliver T. Unke, Michael Gastegger. Equivariant message passing for the prediction of tensorial properties and molecular spectra. International Conference on Machine Learning (ICML), 2021.
Linfeng Zhang, Jiequn Han, Han Wang, Roberto Car, Weinan E. Deep Potential Molecular Dynamics: A Scalable Model with the Accuracy of Quantum Mechanics. Physical Review Letters, 2018.
Justin S. Smith, Olexandr Isayev, Adrian E. Roitberg. ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost. Chemical Science, 2017.
Albert Musaelian, Simon Batzner, Anders Johansson, Lixin Sun, Cameron J. Owen, Mordechai Kornbluth, Boris Kozinsky. Learning local equivariant representations for large-scale atomistic dynamics. Nature Communications, 2023.
Chi Chen, Shyue Ping Ong. A universal graph deep learning interatomic potential for the periodic table. Nature Computational Science, 2022.
Bowen Deng, Peichen Zhong, KyuJung Jun, Janosh Riebesell, Kevin Han, Christopher J. Bartel, Gerbrand Ceder. CHGNet as a pretrained universal neural network potential for charge-informed atomistic modelling. Nature Machine Intelligence, 2023.
Giuseppe Carleo, Matthias Troyer. Solving the quantum many-body problem with artificial neural networks. Science, 2017.
David Pfau, James S. Spencer, Alexander G. D. G. Matthews, W. M. C. Foulkes. Ab initio solution of the many-electron Schrödinger equation with deep neural networks. Physical Review Research, 2020.
Jan Hermann, Zeno Schätzle, Frank Noé. Deep-neural-network solution of the electronic Schrödinger equation. Nature Chemistry, 2020.
Stefan Chmiela, Alexandre Tkatchenko, Huziel E. Sauceda, Igor Poltavsky, Kristof T. Schütt, Klaus-Robert Müller. Machine learning of accurate energy-conserving molecular force fields. Science Advances, 2017.
Johannes Gasteiger, Muhammed Shuaibi, Anuroop Sriram, Stephan Günnemann, Zachary Ulissi, C Lawrence Zitnick, Abhishek Das. GemNet-OC: developing graph neural networks for large and diverse molecular simulation datasets. arXiv preprint arXiv:2204.02782, 2022. arXiv
Anubhav Jain, Shyue Ping Ong, Geoffroy Hautier, Wei Chen, William Davidson Richards, Stephen Dacek, Shreyas Cholia, Dan Gunter, David Skinner, Gerbrand Ceder, Kristin A. Persson. Commentary: The Materials Project: A materials genome approach to accelerating materials innovation. APL Materials, 2013.
Lowik Chanussot, Abhishek Das, Siddharth Goyal, Thibaut Lavril, Muhammed Shuaibi, Morgane Riviere, Kevin Tran, Javier Heras-Domingo, Caleb Ho, Weihua Hu, Aini Palizhati, Anuroop Sriram, Brandon Wood, Junwoong Yoon, Devi Parikh, C. Lawrence Zitnick, Zachary Ulissi. Open Catalyst 2020 (OC20) Dataset and Community Challenges. ACS Catalysis, 2021.
Zhenqin Wu, Bharath Ramsundar, Evan N. Feinberg, Joseph Gomes, Caleb Geniesse, Aneesh S. Pappu, Karl Leswing, Vijay Pande. MoleculeNet: a benchmark for molecular machine learning. Chemical Science, 2018.
Niklas W. A. Gebauer, Michael Gastegger, Kristof T. Schütt. Symmetry-adapted generation of 3D point sets for the targeted discovery of molecules. Advances in Neural Information Processing Systems (NeurIPS), 2019.
Emiel Hoogeboom, Víctor Garcia Satorras, Clément Vignac, Max Welling. Equivariant Diffusion for Molecule Generation in 3D. International Conference on Machine Learning (ICML), 2022.
Minkai Xu, Lantao Yu, Yang Song, Chence Shi, Stefano Ermon, Jian Tang. GeoDiff: A Geometric Diffusion Model for Molecular Conformation Generation. International Conference on Learning Representations (ICLR), 2022.
Bowen Jing, Gabriele Corso, Jeffrey Chang, Regina Barzilay, Tommi Jaakkola. Torsional Diffusion for Molecular Conformer Generation. Advances in Neural Information Processing Systems (NeurIPS), 2022.
Simon Axelrod, Rafael Gómez-Bombarelli. GEOM, energy-annotated molecular conformations for property prediction and molecular generation. Scientific Data, 2022.
Tian Xie, Xiang Fu, Octavian-Eugen Ganea, Regina Barzilay, Tommi Jaakkola. Crystal Diffusion Variational Autoencoder for Periodic Material Generation. International Conference on Learning Representations (ICLR), 2022.
Rui Jiao, Wenbing Huang, Peijia Lin, Jiaqi Han, Pin Chen, Yutong Lu, Yang Liu. Crystal structure prediction by joint equivariant diffusion. Advances in Neural Information Processing Systems, 2023.
Claudio Zeni, Robert Pinsler, Daniel Zügner, Andrew Fowler, Matthew Horton, Xiang Fu, Zilong Wang, Aliaksandra Shysheya, Jonathan Crabbé, Shoko Ueda, et al.. A generative model for inorganic materials design. Nature, 2025.
Andrew W. Senior, Richard Evans, John Jumper, James Kirkpatrick, Laurent Sifre, Tim Green, Chongli Qin, Augustin Žídek, Alexander W. R. Nelson, Alex Bridgland, et al.. Improved protein structure prediction using potentials from deep learning. Nature, 2020.
John Jumper, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov, Olaf Ronneberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Žídek, Anna Potapenko, et al.. Highly accurate protein structure prediction with AlphaFold. Nature, 2021.
Josh Abramson, Jonas Adler, Jack Dunger, Richard Evans, Tim Green, Alexander Pritzel, Olaf Ronneberger, Lindsay Willmore, Andrew J. Ballard, Joshua Bambrick, et al.. Accurate structure prediction of biomolecular interactions with AlphaFold 3. Nature, 2024.
Minkyung Baek, Frank DiMaio, Ivan Anishchenko, Justas Dauparas, Sergey Ovchinnikov, Gyu Rie Lee, Jue Wang, Qian Cong, Lisa N. Kinch, R. Dustin Schaeffer, et al.. Accurate prediction of protein structures and interactions using a three-track neural network. Science, 2021.
Zeming Lin, Halil Akin, Roshan Rao, Brian Hie, Zhongkai Zhu, Wenting Lu, Nikita Smetanin, Robert Verkuil, Ori Kabeli, Yaniv Shmueli, et al.. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science, 2023.
Sjors H. W. Scheres. RELION: implementation of a Bayesian approach to cryo-EM structure determination. Journal of Structural Biology, 2012.
Ali Punjani, John L. Rubinstein, David J. Fleet, Marcus A. Brubaker. cryoSPARC: algorithms for rapid unsupervised cryo-EM structure determination. Nature Methods, 2017.
Ellen D. Zhong, Tristan Bepler, Bonnie Berger, Joseph H. Davis. CryoDRGN: reconstruction of heterogeneous cryo-EM structures using neural networks. Nature Methods, 2021.
Patrik L. Ståhl, Fredrik Salmén, Sanja Vickovic, Anna Lundmark, José Fernández Navarro, Jens Magnusson, Stefania Giacomello, Michaela Asp, Jakub O. Westholm, Mikael Huss, et al.. Visualization and analysis of gene expression in tissue sections by spatial transcriptomics. Science, 2016.
Tommaso Biancalani, Gabriele Scalia, Lorenzo Buffoni, Raghav Avasthi, Ziqing Lu, Aman Sanger, Neriman Tokcan, Charles R. Vanderburg, Åsa Segerstolpe, Meng Zhang, et al.. Deep learning and alignment of spatially resolved single-cell transcriptomes with Tangram. Nature Methods, 2021.
Michał Januszewski, Jörgen Kornfeld, Peter H. Li, Art Pope, Tim Blakely, Larry Lindsey, Jeremy Maitin-Shepard, Mike Tyka, Winfried Denk, Viren Jain. High-precision automated reconstruction of neurons with flood-filling networks. Nature Methods, 2018.
Gabriele Corso, Hannes Stärk, Bowen Jing, Regina Barzilay, Tommi Jaakkola. DiffDock: Diffusion Steps, Twists, and Turns for Molecular Docking. International Conference on Learning Representations (ICLR), 2023.
Hannes Stärk, Octavian Ganea, Lagnajit Pattanaik, Regina Barzilay, Tommi Jaakkola. EquiBind: Geometric Deep Learning for Drug Binding Structure Prediction. International Conference on Machine Learning (ICML), 2022.
Richard Evans, Michael O'Neill, Alexander Pritzel, Natasha Antropova, Andrew Senior, Tim Green, Augustin Žídek, Russ Bates, Sam Blackwell, Jason Yim, et al.. Protein complex prediction with AlphaFold-Multimer. bioRxiv, 2022.
Joseph L. Watson, David Juergens, Nathaniel R. Bennett, Brian L. Trippe, Jason Yim, Helen E. Eisenach, Woody Ahern, Andrew J. Borst, Robert J. Ragotte, Lukas F. Milles, et al.. De novo design of protein structure and function with RFdiffusion. Nature, 2023.
Justas Dauparas, Ivan Anishchenko, Nathaniel Bennett, Hua Bai, Robert J. Ragotte, Lukas F. Milles, Basile I. M. Wicky, Alexis Courbet, Rob J. de Haas, Neville Bethel, et al.. Robust deep learning-based protein sequence design using ProteinMPNN. Science, 2022.
John B. Ingraham, Max Baranov, Zak Costello, Karl W. Barber, Wujie Wang, Ahmed Ismail, Vincent Frappier, Dana M. Lord, Christopher Ng-Thow-Hing, Erik R. Van Vlack, et al.. Illuminating protein space with a programmable generative model. Nature, 2023.
Andriy Kryshtafovych, Torsten Schwede, Maya Topf, Krzysztof Fidelis, John Moult. Critical assessment of methods of protein structure prediction (CASP)---Round XIV. Proteins: Structure, Function, and Bioinformatics, 2021.
Renxiao Wang, Xueliang Fang, Yipin Lu, Shaomeng Wang. The PDBbind database: collection of binding affinities for protein-ligand complexes with known three-dimensional structures. Journal of Medicinal Chemistry, 2004.
Dongping Li, Tielong Cai, Tianci Tang, Wenhao Chai, Katherine Rose Driggs-Campbell, Gaoang Wang. EMMOE: A Comprehensive Benchmark for Embodied Mobile Manipulation in Open Environments. arXiv preprint arXiv:2503.08604, 2025. arXiv
Krishna Murthy Jatavallabhula, Alihusein Kuwajerwala, Qiao Gu, Mohd Omama, Tao Chen, Alaa Maalouf, Shuang Li, Ganesh Iyer, Soroush Saryazdi, Nikhil Keetha, et al.. ConceptFusion: Open-set Multimodal 3D Mapping. Robotics: Science and Systems (RSS), 2023.
Dhruv Batra, Angel X. Chang, Sonia Chernova, Andrew J. Davison, Jia Deng, Vladlen Koltun, Sergey Levine, Jitendra Malik, Igor Mordatch, Roozbeh Mottaghi, Manolis Savva, Hao Su. Rearrangement: A Challenge for Embodied AI. arXiv preprint arXiv:2011.01975, 2020. arXiv
Luca Weihs, Matt Deitke, Aniruddha Kembhavi, Roozbeh Mottaghi. Visual Room Rearrangement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Yash Kant, Arun Ramachandran, Sriram Yenamandra, Igor Gilitschenski, Dhruv Batra, Andrew Szot, Harsh Agrawal. Housekeep: Tidying Virtual Households Using Commonsense Reasoning. Proceedings of the European Conference on Computer Vision (ECCV), 2022.
Gabriel Sarch, Zhaoyuan Fang, Adam W. Harley, Paul Schydlo, Michael J. Tarr, Saurabh Gupta, Katerina Fragkiadaki. TIDEE: Tidying Up Novel Rooms Using Visuo-Semantic Commonsense Priors. Proceedings of the European Conference on Computer Vision (ECCV), 2022.
Jimmy Wu, Rika Antonova, Adam Kan, Marion Lepert, Andy Zeng, Shuran Song, Jeannette Bohg, Szymon Rusinkiewicz, Thomas Funkhouser. TidyBot: Personalized Robot Assistance with Large Language Models. Autonomous Robots, 2023.
Sriram Yenamandra, Arun Ramachandran, Karmesh Yadav, Austin Wang, Mukul Khanna, Theophile Gervet, Tsung-Yen Yang, Vidhi Jain, Alexander William Clegg, John Turner, et al.. HomeRobot: Open-Vocabulary Mobile Manipulation. Proceedings of the Conference on Robot Learning (CoRL), 2023.
Peiqi Liu, Yaswanth Orru, Jay Vakil, Chris Paxton, Nur Muhammad Mahi Shafiullah, Lerrel Pinto. OK-Robot: What Really Matters in Integrating Open-Knowledge Models for Robotics. Robotics: Science and Systems (RSS), 2024.
Zipeng Fu, Tony Z. Zhao, Chelsea Finn. Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation. Proceedings of the Conference on Robot Learning (CoRL), 2024.
Dirk Helbing, Péter Molnár. Social Force Model for Pedestrian Dynamics. Physical Review E, 1995.
Changan Chen, Yuejiang Liu, Sven Kreiss, Alexandre Alahi. Crowd-Robot Interaction: Crowd-Aware Robot Navigation with Attention-Based Deep Reinforcement Learning. IEEE International Conference on Robotics and Automation (ICRA), 2019.
Peter Trautman, Andreas Krause. Unfreezing the Robot: Navigation in Dense, Interacting Crowds. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2010.
Haresh Karnan, Anirudh Nair, Xuesu Xiao, Garrett Warnell, Sören Pirk, Alexander Toshev, Justin Hart, Joydeep Biswas, Peter Stone. Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation. IEEE Robotics and Automation Letters, 2022.
Shervin Javdani, Henny Admoni, Stefania Pellegrinelli, Siddhartha S. Srinivasa, J. Andrew Bagnell. Shared Autonomy via Hindsight Optimization for Teleoperation and Teaming. The International Journal of Robotics Research, 2018.
Anca D. Dragan, Siddhartha S. Srinivasa. A Policy-Blending Formalism for Shared Control. The International Journal of Robotics Research, 2013.
Kyle Strabala, Min Kyung Lee, Anca Dragan, Jodi Forlizzi, Siddhartha S. Srinivasa, Maya Cakmak, Vincenzo Micelli. Toward Seamless Human-Robot Handovers. Journal of Human-Robot Interaction, 2013.
Hsuan-Kung Yang, Tsu-Ching Hsiao, Ryoichiro Oka, Ryuya Nishino, Satoko Tofukuji, Norimasa Kobori. An Embodied AR Navigation Agent: Integrating BIM with Retrieval-Augmented Generation for Language Guidance. arXiv preprint arXiv:2508.16602, 2025. arXiv
Peter B. L. Meijer. An Experimental System for Auditory Image Representations. IEEE Transactions on Biomedical Engineering, 1992.
Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, Tom Yeh. VizWiz: Nearly Real-Time Answers to Visual Questions. Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (UIST), 2010.
Danna Gurari, Qing Li, Abigale J Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, Jeffrey P Bigham. Vizwiz grand challenge: Answering visual questions from blind people. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
Dragan Ahmetovic, Cole Gleason, Chengxiong Ruan, Kris Kitani, Hironobu Takagi, Chieko Asakawa. NavCog: A Navigational Cognitive Assistant for the Blind. Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI), 2016.
Diane J. Cook, Aaron S. Crandall, Brian L. Thomas, Narayanan C. Krishnan. CASAS: A Smart Home in a Box. Computer, 2013.
Alan K. Bourke, John V. O'Brien, Gerard M. Lyons. Evaluation of a Threshold-Based Tri-Axial Accelerometer Fall Detection Algorithm. Gait & Posture, 2007.
Richard C. Simpson. Smart Wheelchairs: A Literature Review. Journal of Rehabilitation Research and Development, 2005.
Mahmoud Ghorbel, Joelle Pineau, Richard Gourdeau, Shervin Javdani, Siddhartha Srinivasa. A Decision-Theoretic Approach for the Collaborative Control of a Smart Wheelchair. International Journal of Social Robotics, 2018.
Tapomayukh Bhattacharjee, Gilwoo Lee, Hanjun Song, Siddhartha S. Srinivasa. Towards Robotic Feeding: Role of Haptics in Fork-Based Food Manipulation. IEEE Robotics and Automation Letters, 2019.
Tiffany L. Chen, Matei Ciocarlie, Steve Cousins, Phillip M. Grice, Kelsey Hawkins, Kaijen Hsiao, Charles C. Kemp, Chih-Hung King, Daniel A. Lazewatsky, Adam E. Leeper, Hai Nguyen, Andreas Paepcke, Caroline Pantofaru, William D. Smart, Leila Takayama. Robots for Humanity: Using Assistive Robotics to Empower People with Disabilities. IEEE Robotics & Automation Magazine, 2013.
Charles C. Kemp, Aaron Edsinger, Henry M. Clever, Blaine Matulevich. The Design of Stretch: A Compact, Lightweight Mobile Manipulator for Indoor Human Environments. IEEE International Conference on Robotics and Automation (ICRA), 2022.
Zackory Erickson, Vamsee Gangaram, Ariel Kapusta, C. Karen Liu, Charles C. Kemp. Assistive Gym: A Physics Simulation Framework for Assistive Robotics. IEEE International Conference on Robotics and Automation (ICRA), 2020.
Xue Qin, Simin Luan, John See, Cong Yang, Zhijun Li. EmbodiedGovBench: A Benchmark for Governance, Recovery, and Upgrade Safety in Embodied Agent Systems. arXiv preprint arXiv:2604.11174, 2026. arXiv
Yuanwen Yue, Theodora Kontogianni, Konrad Schindler, Francis Engelmann. Connecting the Dots: Floorplan Reconstruction Using Two-Level Queries. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Mani Golparvar-Fard, Feniosky Peña-Mora, Silvio Savarese. Automated Progress Monitoring Using Unordered Daily Construction Photographs and IFC-Based Building Information Models. Journal of Computing in Civil Engineering, 2015.
Markus Giftthaler, Timothy Sandy, Kathrin Dörfler, Ian Brooks, Mark Buckingham, Gonzalo Rey, Matthias Kohler, Fabio Gramazio, Jonas Buchli. Mobile Robotic Fabrication at 1:1 Scale: The In Situ Fabricator. Construction Robotics, 2017.
Young-Jin Cha, Wooram Choi, Oral Büyüköztürk. Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks. Computer-Aided Civil and Infrastructure Engineering, 2017.
Anthony Cioppa, Silvio Giancola, Adrien Deliège, Le Kang, Xin Zhou, Zhiyu Cheng, Bernard Ghanem, Marc Van Droogenbroeck. SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2022.
Yutao Cui, Chenkai Zeng, Xiaoyu Zhao, Yichun Yang, Gangshan Wu, Limin Wang. SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenes. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
Wei Jiang, Juan Camilo Gamboa Higuera, Baptiste Angles, Weiwei Sun, Mehrsan Javan, Kwang Moo Yi. Optimizing Through Learned Errors for Accurate Sports Field Registration. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2020.
Scott D. Uhlrich, Antoine Falisse, Łukasz Kidzi\ʼnski, Julie Muccini, Michael Ko, Akshay S. Chaudhari, Jennifer L. Hicks, Scott L. Delp. OpenCap: Human Movement Dynamics from Smartphone Videos. PLOS Computational Biology, 2023.
Javier Fernández, Luke Bornn, Dan Cervone. Decomposing the Immeasurable Sport: A Deep Learning Expected Possession Value Framework for Soccer. MIT Sloan Sports Analytics Conference, 2019.
Raymond A. Yeh, Alexander G. Schwing, Jonathan Huang, Kevin Murphy. Diverse Generation for Multi-Agent Sports Games. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Marc Levoy, Kari Pulli, Brian Curless, Szymon Rusinkiewicz, David Koller, Lucas Pereira, Matt Ginzton, Sean Anderson, James Davis, Jeremy Ginsberg, Jonathan Shade, Duane Fulk. The Digital Michelangelo Project: 3D Scanning of Large Statues. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), 2000.
Silvia Sellán, Yun-Chun Chen, Ziyi Wu, Animesh Garg, Alec Jacobson. Breaking Bad: A Dataset for Geometric Fracture and Reassembly. Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2022.
Theodore Tsesmelis, Luca Palmieri, Marina Khoroshiltseva, Adeela Islam, Gur Elkin Othman, Ofir Itzhak Zhang, Gianluca Scarpellini, Stefano Fiorini, Yaniv Aslan, Luca Moretti, et al.. Re-assembling the Past: The RePAIR Dataset and Benchmark for Real World 2D and 3D Puzzle Solving. Advances in Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2024.
Arlen F. Chase, Diane Z. Chase, John F. Weishampel, Jason B. Drake, Ramesh L. Shrestha, K. Clint Slatton, Jaime J. Awe, William E. Carter. Airborne LiDAR, Archaeology, and the Ancient Maya Landscape at Caracol, Belize. Journal of Archaeological Science, 2011.
Marcello A. Canuto, Francisco Estrada-Belli, Thomas G. Garrison, Stephen D. Houston, Mary Jane Acuña, Milan Kováč, Damien Marken, Philippe Nondedeo, Luke Auld-Thomas, Cyril Castanet, et al.. Ancient Lowland Maya Complexity as Revealed by Airborne Laser Scanning of Northern Guatemala. Science, 2018.
Liam Paull, Sajad Saeedi, Mae Seto, Howard Li. AUV Navigation and Localization: A Review. IEEE Journal of Oceanic Engineering, 2014.
Ryan Eustice, Hanumant Singh, John Leonard, Matthew Walter, Robert Ballard. Visually Navigating the RMS Titanic with SLAM Information Filters. Robotics: Science and Systems (RSS), 2005.
Maxime Ferrera, Vincent Creuze, Julien Moras, Pauline Trouvé-Peloux. AQUALOC: An Underwater Dataset for Visual-Inertial-Pressure Localization. The International Journal of Robotics Research, 2019.
Derya Akkaynak, Tali Treibitz. Sea-Thru: A Method for Removing Water from Underwater Images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Md Jahidul Islam, Youya Xia, Junaed Sattar. Fast Underwater Image Enhancement for Improved Visual Perception. IEEE Robotics and Automation Letters, 2020.
Chongyi Li, Chunle Guo, Wenqi Ren, Runmin Cong, Junhui Hou, Sam Kwong, Dacheng Tao. An Underwater Image Enhancement Benchmark Dataset and Beyond. IEEE Transactions on Image Processing, 2020.
Kakani Katija, Eric Orenstein, Brian Schlining, Lonny Lundsten, Kevin Barnard, Giovanna Sainz, Oceane Boulais, Megan Cromwell, Erin Butler, Benjamin Woodward, Katherine L. C. Bell. FathomNet: A Global Image Database for Enabling Artificial Intelligence in the Ocean. Scientific Reports, 2022.
Franz S. Hover, Ryan M. Eustice, Ayoung Kim, Brendan Englot, Hordur Johannsson, Michael Kaess, John J. Leonard. Advanced Perception, Navigation and Planning for Autonomous In-Water Ship Hull Inspection. The International Journal of Robotics Research, 2012.
Tatjana Chavdarova, Pierre Baqué, Stéphane Bouquet, Andrii Maksai, Cijo Jose, Timur Bagautdinov, Louis Lettry, Pascal Fua, Luc Van Gool, François Fleuret. WILDTRACK: A Multi-Camera HD Dataset for Dense Unscripted Pedestrian Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Xiaotian Han, Quanzeng You, Chunyu Wang, Zhizheng Zhang, Peng Chu, Houdong Hu, Jiang Wang, Zicheng Liu. MMPTRACK: Large-Scale Densely Annotated Multi-Camera Multiple People Tracking Benchmark. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023.
Yunzhong Hou, Liang Zheng, Stephen Gould. Multiview Detection with Feature Perspective Transformation. Proceedings of the European Conference on Computer Vision (ECCV), 2020.
Eran Goldman, Roei Herzig, Aviv Eisenschtat, Jacob Goldberger, Tal Hassner. Precise Detection in Densely Packed Scenes. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Alessio Tonioni, Luigi Di Stefano. Product Recognition in Store Shelves as a Sub-Graph Isomorphism Problem. International Conference on Image Analysis and Processing (ICIAP), 2017.
Liang Zheng, Liyue Shen, Lu Tian, Shengjin Wang, Jingdong Wang, Qi Tian. Scalable person re-identification: A benchmark. Proceedings of the IEEE International Conference on Computer Vision, 2015.
Wes Gurnee, Max Tegmark. Language Models Represent Space and Time. The Twelfth International Conference on Learning Representations, 2024. Link
Zhongang Cai, Yubo Wang, Qingping Sun, Ruisi Wang, Chenyang Gu, Wanqi Yin, Zhiqian Lin, Zhitao Yang, Chen Wei, Oscar Qian, Hui En Pang, Xuanke Shi, Kewang Deng, Xiaoyang Han, Zukai Chen, Jiaqi Li, Xiangyu Fan, Hanming Deng, Lewei Lu, Bo Li, Ziwei Liu, Quan Wang, Dahua Lin, Lei Yang. Holistic Evaluation of Multimodal LLMs on Spatial Intelligence. arXiv preprint arXiv:2508.13142, 2025. arXiv
Rodrigo Gonzalez Laiz, Steffen Schneider. Understanding the limits of latent world models. 2026. arXiv
Yun wang, Junbin Xiao, Han Lyu, Yifan Wang, Jing Zuo, Zhanjie Zhang, Hong Huang, Dapeng Wu, Angela Yao. Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams. Forty-third International Conference on Machine Learning, 2026. Link
Minqi Wang, Jie Peng, Hejun Dong, Ruchang Yao, Puyi Wang, Siyuan Huang, Jihai Zhang, Yafu Li, Qi Dou, Xiaoye Qu, Yu Cheng. WorldProbe: When Video World Models Fall Apart under Long-Horizon Spatial Exploration. 2026. arXiv
Huizi Cao, Guanyu Xu, Zhixuan Liang, Ming Yin, Jiuxiang Gu, Manling Li, Mengdi Wang, Shilong Liu. Same Space or Not: Benchmarking Spatial Intelligence Through Cross-View Contradictions. arXiv preprint arXiv:2610.23959, 2026. arXiv
Aravindh Mahendran, Michael King, Matthew Koichi Grimes, Antoine Yang, Tyler Zhu, Joseph Heyward, Tengda Han, Shiry Ginosar, Chen Sun, Dima Damen, Simon Osindero, Noah Snavely, Simon Lynen, João Carreira, Viorica Pătrăucean. KilometerVision: A New Frontier for Large-Scale Spatial Intelligence in VLMs. arXiv preprint arXiv:2609.39588, 2026. arXiv
Fang Yu, Xiaoxue Wu, Haiyu Zhang, Yangfu Li, Botong Zhao, Yu Qiao, Tianfan Xue, Yue Lu, Xinyuan Chen. GROME: GROunding Factorized MEmory into Video World Models. 2026. arXiv
Yan Ki Chan, Yanran Zhang, Wenzhao Zheng, Xiaofeng Wang, Zheng Zhu, Lei Chen, Jie Zhou, Jiwen Lu. State World Models: Execute the Rules, Generate the Pixels. arXiv preprint arXiv:2610.26811, 2026. arXiv
Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu. OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs. 2026. arXiv
Yonghao Yu, Lang Huang, Runyi Li, Toshihiko Yamasaki. Vision-Language-Action or World-Action? Just Action Models. arXiv preprint arXiv:2610.37219, 2026. arXiv
Ayush Mittal, Dhruv Gupta. Calibrated for Which Policy? Conformal Uncertainty for Fixed World Models Under Intervention. arXiv preprint arXiv:2610.35877, 2026. arXiv
Jiayi Luo, Yang Zhang, Liliang Chen, Nan Wang, Chen Gao, Boxiang Qiu, Zhuoxuan Li, Baorui Peng, Chuankang Li, Yuxiang Yan, Si Liu, Qingyun Sun, Shuicheng Yan, Maoqing Yao, Jianxin Li, Guanghui Ren. Rollback: Experience Backtracking in World Models for Policy Improvement. arXiv preprint arXiv:2610.36068, 2026. arXiv
Louisa Dahmani, Véronique D Bohbot. Habitual use of GPS negatively impacts spatial memory during self-guided navigation. Scientific reports, 2020.
Haoyuan Li, Qihang Cao, Huanyuan Zhou, Xin Hu, Sijia Chen, Zihan Guo, Kun Xiang, Yunshuang Nie, Tao Tang, Xinlong Zheng, et al.. GeoThinker-$ F $: Endogenous Predictive World Representations for Fast Spatial Intelligence. arXiv preprint arXiv:2610.20592, 2026. arXiv
Zhongbo Wu, Jiakai Huang, Zheng Zhang, Siyu Xu, Kaixiang Chen, Xiaohong Liu, Shan You, Chang Xu, Tao Huang. PASA-KV: Attacking Action-Facing Visual Routes in World Action Models. 2026. arXiv
Guancheng Pan, Qixin Tan, Yang Yuan, Andrew Chi-Chih Yao. Algebraic World Model: From Exploration to Proofs. 2026. arXiv
Yiming Zhang, Ruoxuan Cao, Zhihang Zhong. CoCoSI: Collaborative Cognitive Map Construction for Spatial Intelligence. 2026. arXiv