Added Multi-agent RAG system recipe 🧑‍🍳️

[sergiopaniego]

What does this PR do?

Fixes #237

Who can review?

@merveenoyan and @stevhliu

cc @aymeric-roucher

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

aymeric-roucher commented on 2024-11-22T15:53:07Z
----------------------------------------------------------------

Great recipe, thanks a lot @sergiopaniego for contributing this 🤗

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

aymeric-roucher commented on 2024-11-22T15:53:08Z
----------------------------------------------------------------

Great graph! 👏

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

aymeric-roucher commented on 2024-11-22T15:53:09Z
----------------------------------------------------------------

Could you use !pip install transformers[agents]? Or maybe you need the latest releases?

sergiopaniego commented on 2024-11-26T17:58:23Z
----------------------------------------------------------------

I'm using the latest changes to incorporate recent updates that haven't yet been included in an official release. For example: huggingface/transformers#34683 && huggingface/transformers#34687 :)

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

aymeric-roucher commented on 2024-11-22T15:53:09Z
----------------------------------------------------------------

Good LLM choice!

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

aymeric-roucher commented on 2024-11-22T15:53:10Z
----------------------------------------------------------------

You can add a mention like "ReactJsonAgent is generally good for web search, since JSON action formulation needs only simple args and is well-suited to sequential chains of single actions, as opposed to Code action formulation being better suited for numerous or parallel tool calls."

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

aymeric-roucher commented on 2024-11-22T15:53:11Z
----------------------------------------------------------------

Here rather than using gradio_tools,you could directly load the space using the new from_space option (read more in the doc):

prompt_generator_tool = Tool.from_space("microsoft/Promptist", **other_args)

sergiopaniego commented on 2024-11-26T18:01:47Z
----------------------------------------------------------------

Thanks for the suggestion!

I tried using the Space you shared but it generates some errors because it uses an old Gradio version. I duplicated the Space, updated the Gradio version and it works. The error is generated in transformers/agents/tools.py in if not parameter["parameter_has_default"]: . If you feel this is something that should be addressed, maybe we can take a deeper look at it in transformers :)

[aymeric-roucher]

Great work @sergiopaniego, thanks a lot. Left a few suggestions!

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

stevhliu commented on 2024-11-26T16:21:46Z
----------------------------------------------------------------

"There is a Manager Agent that orchestrates the system..."

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

stevhliu commented on 2024-11-26T16:21:47Z
----------------------------------------------------------------

"...the orchestrator agent..."

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

stevhliu commented on 2024-11-26T16:21:47Z
----------------------------------------------------------------

"...to tell the central agent that it can manage it."

[stevhliu]

Very nice and comprehensive recipe showcasing the different tasks!

[sergiopaniego]

I'm using the latest changes to incorporate recent updates that haven't yet been included in an official release. For example: huggingface/transformers#34683 && huggingface/transformers#34687 :)

---

View entire conversation on ReviewNB

[sergiopaniego]

Thanks for the suggestion!

I tried using the Space you shared but it generates some errors because it uses an old Gradio version. I duplicated the Space, updated the Gradio version and it works. The error is generated in transformers/agents/tools.py in if not parameter["parameter_has_default"]: . If you feel this is something that should be addressed, maybe we can take a deeper look at it in transformers :)

---

View entire conversation on ReviewNB

[sergiopaniego]

Thanks for the feedback @aymeric-roucher @stevhliu!
I've updated the recipe accordingly 🤗

[stevhliu]

Do you mind getting the latest changes from main to fix the doc-builder issue?

[sergiopaniego]

Thanks for the reminder @stevhliu 😄 done!

[stevhliu]

Thanks again @sergiopaniego! ❤️