This chapter contains a quick start guide for the AIP LLM application.
Please use the GitHub commit status with the tag v1.0.
Disclaimer:
As prerequisites, it requires a running plc for safety , vaccuum system and a running EKI connection on the KUKA SmartPad.
If you require more information, please check out the rest of the documentation.
-
Start the docker container
cd ~/aip_ros2_ws/src/aip_bringup
. start_docker.sh -
Launch the corresponding nodes for aip_bringup
ros2 launch aip_bringup aip.launch.py use_fake_hardware:=false
Note:
- The EKI Hardware interface must be running on the KUKA SmartPad
- If the safety system detects any potential risk and stops the system, the system needs to be acknowledged and restarted (EKI programm on KUKA SmartPad & Terminal for aip_bringup)
- If
use_fake_hardware:=truethen the bosch gripper controller node won't be started. - This can be used if running AIP virtually only in Rviz
- (Optional) Reset the gripper positions
# connect to container docker exec -it aip_bringup bash # reset gripper positions ros2 service call /open_gripper aip_interfaces/srv/MoveGripper "cylinder_ids: {cylinder_ids: [1,2,3,4]}"
- Start the docker container
cd ~/aip_ros2_ws/src/roboception_driver
. start_docker.sh
The driver will be started automatically.
-
Start the docker container
cd ~/aip_ros2_ws/src/object_detector_tensorflow
. start_docker.sh --no-gpusIf you want to use the the GPU hardware performance, please delete the flag
--no-gpusfrom the shell command. -
Launch the detection nodes
ros2 launch object_detector_tensorflow detection.launch.py
To show the odtf result manually, it is possible to use the client with:
ros2 run object_detector_tensorflow client-
Start the docker container
cd ~/aip_ros2_ws/src/aip_grasp_planning
. start_docker.sh -
Launch the grasp_planning nodes
ros2 launch aip_grasp_planning grasp_planning.launch.py
If running the launch file via VS-Code debugging functionality, please additionally use:
ros2 launch point_transformation point_transformation.launch.py
-
Start the docker container with autostart LLM
cd ~/aip_ros2_ws/src/LLM_Scene_Docker
. start_docker.sh -
Launch the website node
ros2 launch pkg_website_llm launch_all_services.launch.py
How to access the website for user interaction?
- Open your desired browser
- Navigate to the following local host URL: http://127.0.0.1:8080/
-
Start the docker container
cd ~/aip_ros2_ws/src/aip_packing_algorithm
. start_docker.sh -
Launch the pack server node
ros2 run pkg_pack_node pack_server
-
Start the docker container
cd ~/aip_ros2_ws/src/aip_coordinator
. start_docker.sh -
Start the Behavior Tree sequence via the launch file
ros2 launch aip_coordinator aip.launch.py
restart of some specific nodes is necessary:
- aip_coordinator
- aip_packing_algorithm
- (in simulation) aip_bosch_gripper