ANEAR A unitree go1 robot that takes care of a toddler with some protocols
In this project, the robot has two important safety protocols: 1- The robot can be teleoperated from the mobile application we developed. The mapping is also done by this mobile application. After the mapping is done, the danger zones that the parent wants the child to avoid are marked by the parent and these coordinates are sent to the robot. While running using nav2, in the normal use case, robot uses its LiDAR data and constantly looks for the distance between the child and the danger zone and if some conditions are met, the robot moves between the danger zone and the child. It keeps the distance from the child using nav2 and local costmap inflation. 2- Robot has weights of a fine-tuned YOLOv8n. Using this, robot can detect if the child is holding a knife or bleach. In both protocols, a push notification is sent to the parent and it is logged in the database. For the robot to be interactive, there is an AI-powered conversational API integrated into the system, prompted to interact with and engage the child. These conversations are also logged in the database so they can be monitored through the mobile application.
If wanted, robot can be teleoperated by the parent anytime. To deactivate the nav2 navigation, there is a finite state machine implementation behind the scenes, both in the active blocker protocol and manuel control.
Stack: Python, C++, ROS2 Humble, OpenCV, SLAM, Nav2, octomap, Gazebo