Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Add /v1/audio/transcriptions and /v1/audio/translations with whisper.cpp #276

Merged
merged 32 commits into from
Jan 28, 2024
Merged

feat: Add /v1/audio/transcriptions and /v1/audio/translations with whisper.cpp #276

merged 32 commits into from
Jan 28, 2024

Conversation

hiro-v
Copy link
Contributor

@hiro-v hiro-v commented Dec 16, 2023 •
edited
Loading

Follow up on #205 - #59

Changes:

  • CI on all platforms for new build with llama.cpp and whisper.cpp with e2e testing
  • OpenAI compatible API - see audio.md
  • Acceleration - Mac silicon with Metal & CoreML
  • Acceleration - Windows/ Linux on CUDA with Cublas
  • Normal x86 support for Mac/ Windows/ Linux
  • Tested with 1 LLM and 1 audio running at once

Reference

@hiro-v hiro-v added P1: important Important feature / fix type: feature request A new feature labels Dec 16, 2023
@hiro-v hiro-v self-assigned this Dec 16, 2023
@hiro-v hiro-v marked this pull request as draft December 16, 2023 05:55
@hiro-v hiro-v changed the title feat: Add /v1/audio/transcriptions with llama.cpp feat: Add /v1/audio/transcriptions and /v1/audio/translations with llama.cpp Dec 17, 2023
@hiro-v hiro-v changed the title feat: Add /v1/audio/transcriptions and /v1/audio/translations with llama.cpp feat: Add /v1/audio/transcriptions and /v1/audio/translations with whisper.cpp Dec 17, 2023
@hiro-v hiro-v added this to the Jan can Hear milestone Dec 20, 2023
@freelerobot freelerobot removed this from the Jan can Hear milestone Jan 15, 2024
@hiro-v hiro-v marked this pull request as ready for review January 26, 2024 17:12
tikikun
tikikun approved these changes Jan 27, 2024
View reviewed changes
Copy link
Contributor

@tikikun tikikun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hiro-v hiro-v merged commit 1d3798d into main Jan 28, 2024
15 checks passed
@hiro-v hiro-v deleted the feat/nitro_whisperccp branch January 30, 2024 16:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@tikikun tikikun tikikun approved these changes

@namchuai namchuai Awaiting requested review from namchuai

@louis-menlo louis-menlo Awaiting requested review from louis-menlo

Assignees

@hiro-v hiro-v

Labels
P1: important Important feature / fix type: feature request A new feature
Projects
Menlo
Archived in project
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@hiro-v @tikikun @freelerobot