Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more models to Orca #13

Open
santiagomed opened this issue Nov 2, 2023 · 1 comment
Open

Add more models to Orca #13

santiagomed opened this issue Nov 2, 2023 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@santiagomed
Copy link
Owner

santiagomed commented Nov 2, 2023

Right now we only have a small amount of supported models. Let's expand this! A good start would be to look into https://github.com/huggingface/candle/tree/main/candle-examples/examples and port over their examples into Orca.

Note: Copy pasta is not enough, look at how I did for Bert and Quantized for inspiration. These also could be improved to be a cleaner interface.

Edit: I am refactoring to have a models API in a separate crate orca-models. This crate's goal is to provide an API for using models such as those provided by OpenAI as well as providing an API to easily use Candle transformer models. This should be the main point of development and should replace orca-core's models implementations.

@santiagomed santiagomed added enhancement New feature or request good first issue Good for newcomers labels Nov 2, 2023
@Ap3lsin4k
Copy link

What is the vision for Orca?

Learning from experience in another programming language ecosystem, it is good to have two separate libraries.
A) One library is highly beneficial for development and production environments. For each problem, there is one and generally best way to solve it.
B) The alternative is more favored by researchers for its wide range of packages. It includes all known algorithms, even those that are not commonly used.

Do we carefully select what gets included? Do we dump everything out there? Let's discuss it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants