Awesome-Spatial-Intelligence

🏠 About

This repo contains a curative list of Spatial Intelligence for Robotics, inspired by Awesome-Implicit-NeRF-Robotics and awesome-Implicit-NeRF-SLAM.

This is an active repository, you can watch for following the latest advances. If you find this repository useful, please consider STARing ⭐ this list. Feel free to share this list with others!

Awesome Robot Repository

Scene Representation

• [awesome-NeRF]
• [awesome-3D-gaussian-splatting]
• [awesome-dust3r]

General Robotics

• [Awesome-Implicit-NeRF-Robotics]

• [awesome-NeRF-and-3DGS-SLAM]

• [awesome-robotics-libraries]

• [awesome-real-world-rl]

• [Awesome 3D Gaussian Splatting for Robotics]

• [Awesome-Robotics-3D]

• [Awesome_Manipulation]

• [Awesome-Robotics-Manipulation]

• [awesome-robot-descriptions]

• [Awesome6DPoseEstimation]

• [My-Robotic-Grasping]

• [Awesome-Dexterous-Manipulation]

LLM Robotics

• [Awesome-LLM-Robotics]
• [Awesome-Embodied-Agent-with-LLMs]
• [Awesome-vision-language-action-models]
• [Awesome-Robotics-Foundation-Models]
• [Awesome-Generalist-Robots-via-Foundation-Models]
• [Awesome-embodied-world-model-papers]
• [awesome-llm-and-aigc]

Video for Robotics

• [awesome-robot-visual-imitation-learning]

• [Awesome Video4Robot]

• [Awesome-Video-Robotic-Papers]

Whole-Body Robotics

• [mobile_manipulation_papers]
• [bipedal-robot-learning-collection]
• [awesome-mobile-robotics]
• [awesome-ros-mobile-robot]
• [Awesome_Quadrupedal_Robots]
• [awesome-humanoid-learning]
• [awesome-humanoid-robot-learning]
• [awesome-humanoid-manipulation]
• [awesome-loco-manipulation]

Tactile Robotics

• [Awesome Touch]
• [awesome-tactile-sensing]
• [Awesome-Tactile-Perception]
• [AwesomeTactile]
• [Awesome-Tactile-Sensing]

Simulation

• [Awesome-Physics-Inspired-3D-Reconstruction-and-Simulation]

• [awesome-simulation]

• [Awesome-Differentiable-Simulation-Robotics]

• [awesome-isaac-sim]

• [awesome-emulators-simulators]

Navigation

• [Awesome-Vision-and-Language-Navigation]
• [awesome-vision-language-navigation]
• [awesome-vln]
• [awesome-robot-social-navigation]
• [vision-and-language-navigation ]
• [awesome-target-driven-navigation]
• [Awesome-Embodied-Navigation]
• [awesome-embodied-vision]
• [Awesome-ObjectGoal-Navigation]
• [awesome-3d-multimodal-maps]
• [awesome_navigation]
• [awesome-visual-navigation]
• [awesome-robot-navigation]
• [awesome-multi-robot-system]

---

Overview (Personal use)

• Scene Understanding

• Scene Representation: Points, NeRF, 3DGS

• Segmentation

• Multimodal Grouding

• Data Introduction

  • Video Learning

• Large Robot Models

  • Large Manipulation Model
    • LLM/VLM Guidance
    • Structured Instructions
    • Vision-Language-Action
  • Large Navigation Model
    • Vision-Language-Action

• Specific Object Manipulation

  • Transparent Object Manipulation

    • Survey

    • Datasets

    • Robotic Grasping-Manipulation

    • Visual Tactile

    • Pose Estimation

    • Simulation

    • Depth Completion

    • 3D Reconstruction

    • Segmentation

    • Perception

  • Deformable Object Manipulation
    • Robotic Grasping-Manipulation
  • Articulated Object Manipulation
    • Pose Estimation

• Spatial Intelligence

  • Scene Representation
    • 3D Gaussian Splatting
  • Easy 3D

    • Zero Shot 3D Reconstruction

    • Single View 3D Reconstruction

    • Sparse View Reconstruction

    • Point Cloud Completion

  • Spatial Understanding
    • 3D Imagination
    • 3D Understanding
    • Task-Adaptive 3D Part Segmentation

• Vision Tactile Manipulation

  • Grasping and Manipulation
  • Representation and Perception

• Mobile Manipulation

  • Survey
  • Benchmark and Hardware

• Dataset and Hardware

• Classic Manipulation

  • Point Cloud Grasping
  • 3DGS/NeRF Manipulation

• SLAM

• Object Pose Estimation

• Physics and Simulation

---

Ideas are cheap, Execution is expensive

• 2024/12/24: 在目前透明物体的数据集中加上Tactile，主要是Tactile可以很好的用于滑动检测，很契合的点 👍
• 2024/12/24: 使用Gaussian Ray Tracing进行透明物体重建，主要用于机械臂的透明物体抓取
  • 2024/12/25：测试Gaussian Ray Tracing, 效果还行
• 2024/12/24: Single RGB-D的点云补全研究，比如SSD，用于单帧机械臂物体抓取
• 2024/12/25: 利用SplatFormer进行泛化的透明物体重建
• 2025/01/05：将Semantic Diffusion Policy与3D Diffusion Policy进行结合，实现3D语义diffusion policy的泛化
• 2025/1/10: 使用Gaussian-Property结合Gelsight触觉进行机器人操作，比如滑动检测
• 2025/1/10: 将Gaussian Splatting应用在HOV-SG上，基于GS的3D场景图构建，应用于导航等任务
• 2025/1/15: 使用双目feed-forward用于机器臂的操作，比如pixelsplat, LatentSplat, HiSplat
  • 双目机械臂操作的数据集
  • 双目机械臂的benchmark
• 2025/1/16: 复现视触觉传感器, 9DTact 和 3D-ViTac
• 2025/1/22: 将Diff3F的Part Segmentatioin应用于机械臂的操作，比如GAPartNet