# Detecting AprilTags with ROS2 ## Overview {% hint style="danger" %} NOTE: This guide is currently a work in progress. Some details may not be finished. {% endhint %} In this section, we will guide you through the process needed to detect AprilTags on your NavQ. There are a few things that need to be done to accomplish this: 1. Install ROS2 image tools 2. Build and install AprilTag detection nodes 3. Calibrate the camera on your NavQ using a checkerboard pattern 4. Run! ## Prerequisites Before we start, you will need a few things: ### Checkerboard To create a checkerboard for camera calibration, download this PDF: ### Desktop Setup In order to calibrate the camera, you will need to set up your NavQ with a mouse, keyboard, and monitor. Use the included microUSB hub and HDMI connector to do so. ## Installing required ROS2 software Install the following packages with the `apt` package manager by running the commands below: ``` $ sudo apt install ros-foxy-cv-bridge \ ros-foxy-image-tools \ ros-foxy-image-transport \ ros-foxy-image-transport-plugins \ ros-foxy-image-pipeline \ ros-foxy-camera-calibration-parsers \ ros-foxy-camera-info-manager \ ros-foxy-launch-testing-ament-cmake ``` Once that is finished, move on to the next step. ## Calibrating the camera {% hint style="info" %} This section is a consolidation of the specific commands for the NavQ. If you run into any issues with this section of the guide, email and refer to the official guide: {% endhint %} Hook up your NavQ to a monitor with the provided HDMI cord and connect a USB mouse + keyboard through the included microUSB hub. Open the terminal by clicking the icon at the top left of the screen and open the bash shell by running: ``` $ bash ``` Have your printed checkerboard ready in a well lit environment and run the camera calibration software by running the following commands: ``` # Start publishing camera images to ROS2 topic /camera/image_raw $ ros2 run image_tools cam2image --ros-args -p device_id:=0 -p width:=640 -p height:=480 -r /image:=/camera/image_raw > /dev/null 2>&1 & # Start the camera calibration software $ ros2 run camera_calibration cameracalibrator --size 7x9 --square 0.02 ``` Now use the link in the note above to run through calibarating the camera. ## Detecting AprilTags ### Building apriltag\_msgs A prerequisite for the `apriltag_ros` node is `apriltag_msgs`. Clone the repo and build it by running these commands: ``` $ git clone https://github.com/christianrauch/apriltag_msgs $ cd apriltag_msgs $ colcon build ``` Make sure to source the install/setup.bash file so that `apriltag_msgs` can see it when being built. ### Building the apriltag\_ros node First, in order to detect AprilTags, we need to build the `apriltag_ros` node written by christianrauch. You can clone his repository by using this git repo: ``` $ git clone https://github.com/christianrauch/apriltag_ros ``` To make his repo work with ROS2 Foxy, you will need to make a small change in the CMakeLists.txt file. Go to line 26 in that file and delete the `apriltag::` token in the `AprilTagNode apriltag::apriltag` part. Next, you'll want to save that file and run `colcon build` in the apriltag\_ros folder. Once it is done building, you'll want to source the `install/setup.bash` file. Add this line to your `.bashrc`: ``` source /home/navq//install/setup.bash ``` ### Creating a new package to concatenate camera information to each camera frame In order to make the `apriltag_ros` node work, we need to make sure that camera info messages are being sent in sync with each camera frame published by the `cam2image` node. We have written an example node that does just that. You can download it here: {% file src="/files/-MT1NqFVdWO5kYwov\_8h" %} Full Camera Republish Node Workspace {% endfile %} You will need to replace the matrices in the node file to match your camera calibration parameters. The source file is located at `pypysub/py_pysub/publisher_member_function.py`. Once you have done that, make sure to build and install the node and source the `install/setup.bash` file. ### Running the code To run the code, you'll need to run the following ROS nodes: ``` $ ros2 run image_tools cam2image --ros-args -p device_id:=0 -p width:=640 -p height:=480 -r /image:=/camera_image > /dev/null 2>&1 & $ ros2 run py_pysub talker > /dev/null 2>&1 & $ ros2 launch apriltag_ros tag_16h5_all.launch.py --ros-args -p image_transport:=raw > apriltag_log.txt 2>&1 & ``` --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://nxp.gitbook.io/8mmnavq/navq-developer-guide/software-support/installing-ros2-foxy/detecting-apriltags-with-ros2.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.