7.6 Sensor Data

7.6 Sensor Data

7.6.1 Overview

A3 is equipped with a wide range of sensors, including cameras and IMUs. For the exact sensor locations, refer to the component descriptions in the overview section of this document.

We provide ROS2 topic interfaces for raw frame data from each sensor, all using standard ROS2 message types. Instead of listing each interface individually, this section provides a unified topic description table together with notes on the intrinsic and extrinsic parameter files and their usage.

7.6.2 Sensor Topic Interfaces

Topic NameMessage TypeSensor ModelData StreamResolutionFrame Rate
/hal/head_left_fisheye_camera/streamfoxglove_msgs::msg::CompressedVideoLeft head fisheye H265Color image (color) h265 encoded1920*153610FPS
/hal/head_rear_fisheye_camera/streamfoxglove_msgs::msg::CompressedVideoRear head fisheye H265Color image (color) h265 encoded1920*153610FPS
/hal/head_right_fisheye_camera/streamfoxglove_msgs::msg::CompressedVideoRight head fisheye H265Color image (color) h265 encoded1920*153610FPS
/hal/head_stereo_left_fisheye_camera/streamfoxglove_msgs::msg::CompressedVideoLeft eye of head stereo camera H265Color image (color) h265 encoded1920*153610FPS
/hal/head_stereo_right_fisheye_camera/streamfoxglove_msgs::msg::CompressedVideoRight eye of head stereo camera H265Color image (color) h265 encoded1920*153610FPS
/hal/chest_front_d457_camera/streamfoxglove_msgs::msg::CompressedVideoFront chest depth camera H265Color image (color) h265 encoded1920*153610FPS
/hal/waist_front_d415_camera/streamfoxglove_msgs::msg::CompressedVideoFront waist depth camera H265Color image (color) h265 encoded1920*153610FPS
/hal/wrist_left_d405_camera/streamfoxglove_msgs::msg::CompressedVideoLeft wrist depth camera H265Color image (color) h265 encoded1920*153610FPS
/hal/wrist_right_d405_camera/streamfoxglove_msgs::msg::CompressedVideoRight wrist depth camera H265Color image (color) h265 encoded1920*153610FPS
/hal/head_stereo_left_fisheye_camera/rgbsensor_msgs::msg::ImageLeft slave camera of head stereo pairColor image (color)1920*153630FPS
/hal/head_stereo_right_fisheye_camera/rgbsensor_msgs::msg::ImageRight slave camera of head stereo pairColor image (color)1920*153630FPS
/hal/head_left_fisheye_camera/rgbsensor_msgs::msg::ImageLeft head fisheyeColor image (color)1920*153630FPS
/hal/head_right_fisheye_camera/rgbsensor_msgs::msg::ImageRight head fisheyeColor image (color)1920*153630FPS
/hal/head_rear_fisheye_camera/rgbsensor_msgs::msg::ImageRear head fisheyeColor image (color)1920*153630FPS
/hal/chest_front_d457_camera/rgbsensor_msgs::msg::ImageFront chest depth cameraColor image (color)1920*153630FPS
/hal/waist_front_d415_camera/rgbsensor_msgs::msg::ImageFront waist depth cameraColor image (color)1920*153630FPS
/hal/wrist_left_d405_camera/rgbsensor_msgs::msg::ImageLeft wrist depth cameraColor image (color)1920*153630FPS
/hal/wrist_right_d405_camera/rgbsensor_msgs::msg::ImageRight wrist depth cameraColor image (color)1920*153630FPS
/hal/armpit_right_fisheye_camera/rgbsensor_msgs::msg::ImageRight armpit fisheye cameraColor image (color)1920*153630FPS
/hal/neck_middle_livox_lidar/pointcloudsensor_msgs::msg::PointCloud2LiDAR
/hal/neck_middle_livox_lidar/imufoxglove_msgs::msg::CompressedVideoNeck IMU sensor
/ros2/body_drive/pelvis_imu/datafoxglove_msgs::msg::CompressedVideoWaist IMU sensor
/ros2/body_drive/torso_imu/datafoxglove_msgs::msg::CompressedVideoChest IMU sensor

Depth camera topics are published through the iceoryx backend by default, which can make them inconvenient to access. The following method adds the ros2 backend to their publishing configuration. Using /hal/chest_front_d457_camera/stream as an example:

  1. First, back up the corresponding configuration file on the ADU cp /agibot/software/v0/config/hal_depth_camera/hal_depth_camera_config.yaml /agibot/software/v0/config/hal_depth_camera/hal_depth_camera_config.yaml.bd
  2. Then edit the file and add ros2 to enable_backends for /hal/chest_front_d457_camera/stream under aimrt.channel.pub_topic_options, changing it from [iceoryx] to [iceoryx, ros2]
  3. Restart the robot