Fallback Support!

[abaileyb]

Description

Yesterday's OpenAI outage had me thinking - it would be awesome if Mirascope had a feature where if the designated provider API returned a code indicating that there was an outage, I could specify another provider to attempt. Maybe this would take the form of a fallback decorator?

Would be pretty killer to have stuff fallback to Anthropic when OpenAI is down etc.

[willbakst]

For a fallback decorator, we first need to finish #729 so that we have a truly provider-agnostic interface. Implementing this should be fairly straightforward once we have the new decorator. Thanks for the suggestion!

[willbakst]

Update, we're making good progress on #729 and should have that in soon. We'll prioritize tackling this feature next.

I've also done a little more thinking on this and have an idea for how we could implement the decorator to support provider-specific call decorators as well.

[willbakst]

Now that #729 is complete, we should be able to implement the fallback decorator.

I've marked this as a good first issue for anyone interested in contributing!

[ionflow]

I love this suggestion! Could we add a list of providers and models in order of first to last to try?

[willbakst]

yeah, likely something like a list of tuples