Skip to content

Spatial Intelligence

Read Explore Team Contribute Awesome list★

PDF

Preface Notation Glossary

IIntroduction and Background

1Spatial Intelligence: A Rising AI Paradigm

1.1Why Spatial Intelligence? Why Now?
1.2Historical Evolution and Milestones

2A Definition in Motion: Revisiting Spatial Intelligence

2.1The Landscape of Spatial Intelligence
2.2Defining A Spatial Intelligence Framework

3Scope and Structure of This Handbook

3.1The Research Pillars of Spatial Intelligence
3.2Goal of the Handbook: Charting a Research Ecosystem
3.3How to Read This Handbook

IISpatial-aware Representation: Building Blocks of Space

4Single-Modal Spatial Representation

4.12D
4.23D
4.34D
4.4Language
4.5Audio
4.6Domain-Specific Representations

5Cross-Modal Spatial Representation

5.1Overview
5.22D-text
5.33D-text
5.4Audio-text
5.5Vision-vision

IIISpatial Intelligence: From Perception to Generation

6Spatial Perception

6.1Spatial Entity Recognition
6.2Spatial Localization and Position Estimation
6.3Spatial Structure Construction
6.4Spatio-Temporal Perception
6.5Multimodal Spatial Perception

7Spatial Reasoning

7.1Rule-based Symbolic Spatial Reasoning
7.2Learning-based Spatial Reasoning
7.3Foundation Model-driven Spatial Reasoning
7.4Hybrid Spatial Reasoning
7.5Spatial Reasoning Benchmarks

8Spatial Reconstruction and Generation

8.12D Spatial Generation
8.23D Spatial Reconstruction and Generation
8.3Video Spatial Generation
8.4Motion Generation
8.54D Spatial Generation
8.6World Modeling
8.7Programmatic and Symbolic Spatial Generation
8.8Summary and Outlook

9Spatial Intelligence for Embodied Systems

9.1Robotic Manipulation
9.2Autonomous Driving
9.3Wearable AI System
9.4Aerial Agents
9.5Warehouse and Industrial Logistics

10Spatial Intelligence for Virtual Realities

10.1AR/VR/XR
10.2Entertainment

11Spatial Intelligence for Geo-spatial Systems

11.1Digital Twins
11.2GeoAI
11.3Aerospace Engineering

12Spatial Intelligence for Biomedicine and Natural Sciences

12.1Medicine and Clinical Healthcare
12.2Natural Science

13Spatial Intelligence for Intelligent Assistance

13.1Assistant

14Spatial Intelligence for Others

14.1Architecture, Engineering, and Construction
14.2Sports Analytics and Performance
14.3Cultural Heritage and Archaeology
14.4Marine and Underwater Systems
14.5Retail and Smart Spaces
14.6Outlook

VDiscussions and Futures

15Foundations: What Spatial Intelligence Requires

15.1Spatial Observability and Identifiability
15.2Representation and State Sufficiency
15.3Persistent World States and Belief Updating
15.4Predictive Validity and Physical Grounding
15.5Situated and Interactive Spatial Intelligence

16Research Gaps and Future Directions

16.1Research Gaps along the Loop
16.2Benchmarking Gaps
16.3Deployment Bottlenecks
16.4Future Directions

Acknowledgements References Author Contributions

Acknowledgements

1 min read

Thanks for the support from xxx.

PreviousChapter 17: Conclusion NextAuthor Contributions

Report an error

Esc