Install

Follow this guide for installing the feature/vlm-recognition branch of butia_vision.

Install dependencies on the Intel NUC with pip

pip install -r requirements.txt

How to Use

Edit config/hf_react_code_agent.yaml and update the parameters if required.

Make sure the arm, navigation stack, object_recognition, image2world, butia_world and doris_face have been launched and are running.

Launch autogen agent node

roslaunch fbot_llm_agent autogen_agent.launch

Then call the /fbot_llm_agent/execute_tasks service, passing a list of tasks for the agent to execute.