Different agent frameworks integration

[hiendaovinh]

Is your feature request related to a problem? Please describe.

All agents in smolagents are based on singular MultiStepAgent class, which is an abstraction of ReAct framework.

Since ReAct is our go-to framework for agents, is there any possibility to make the codebase more flexible by introduction adapters of different frameworks like SayCan, Reflexion, CLIN, etc?

Describe the solution you'd like
It would be great if smoleagents can provide the ability to switch the framework instead of relying solely upon ReAct. I understand it would take huge effort to make it framework agnostic. Just want to put it here for discussion and consideration.

Additional context
Noah Shinn, Federico Cassano, Edward Berman, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao.
2023. Reflexion: Language agents with verbal reinforcement learning. Preprint, arXiv:2303.11366.

Do As I Can, Not As I Say: Grounding Language in Robotic Affordances

CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalization

ScienceWorld: Is your Agent Smarter than a 5th Grader?

[kargarisaac]

I've been thinking of adding LATS to smolagents. Do you mean the ones already available in other frameworks? like LATS in llamaindex? or implementing it from scratch? I fell in love with the CodeAgent in smolagents and thinking of building LATS out of it.