Synthora is a lightweight, extensible framework for LLM-driven agents and ALM research. It provides the essential components to build, test, and evaluate agents, enabling you to assemble an agent with a single configuration file. Our goal is to minimize effort while delivering robust functionality.
Note: This project is in its early stage of development. The APIs are subject to significant changes, which may introduce breaking updates. Use with caution and consider the risks associated with adopting an evolving framework. We welcome your feedback and contributions to improve this project together!
Synthora offers a comprehensive suite of features designed to support your AI development needs:
- Config-Driven Assembly: Assemble agents and conduct chats with simple configurations.
- Agents: Includes various predefined agents (e.g., COT, TOT, ReAct) and supports custom agent creation.
- Tools: A comprehensive tool set is integrated for agents to call, unleashing the full power of agents.
- Task Automation: Employ powerful workflows to automate and streamline diverse tasks.
- Multi-Agent Interactions: Easily combine multiple agents using configuration files or straightforward code.
- Extensibility: Leverage a lightweight and highly extensible framework that integrates seamlessly with additional tools.
- State-of-the-Art Workflows: Align your work with cutting-edge AI research and practices.
Install the Synthora Python Library from PyPI with a single command:
pip install synthora
Engage in a conversation with a prebuilt Vanilla Agent:
from synthora.callbacks import RichOutputHandler
from synthora.agents import VanillaAgent
agent = VanillaAgent.default("You are a Vanilla Agent.", handlers=[RichOutputHandler()])
agent.run("Hi! How are you?")
Create a simple tool to add two numbers using the provided decorator:
from synthora.toolkits.decorators import tool
@tool
def add(a: int, b: int) -> int:
r"""Add two numbers together."""
return a + b
Construct a workflow that chains tasks together:
def add(x: int, y: int) -> int:
return x + y
flow = (BaseTask(add) | BaseTask(add)) >> BaseTask(add)
flow.run(1, 2)
For detailed information on core modules, tutorials, and cookbooks, please visit our Documentation.
Synthora is a core component of the Syntropix Ecosystem, serving as the hub for our tech stack and community engagement.
We also offer a backend API platform, Syntropix, which provides a low-cost, efficient CPU-accelerated inference service—the first of its kind in heterogeneous acceleration. Using Syntropix as your backend API in Synthora unlocks additional benefits:
- Detailed observability, analysis, and evaluation.
- Finer-grain control over inference services, including scheduled jobs.
- More advanced features and functionalities in the pipeline.
For further details, check out:
We’re in the early stages of Synthora’s development, and your contributions are crucial to shaping its future. Whether you're a developer, researcher, or enthusiast, your feedback and code contributions are welcome and highly valued. If you encounter issues, have ideas for enhancements, or want to contribute new features, please get involved! Check our GitHub repository for guidelines on how to contribute, submit issues, and propose pull requests.
Together, we can build a robust and innovative framework that meets the needs of the AI research community. Join us on this journey, and help shape the future of agent-driven AI!