Skip to content

Issues: opea-project/GenAIEval

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

24 Open 33 Closed
24 Open 33 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] ChatQnA Mega Service Dashboard doesn't work bug Something isn't working
#247 opened Mar 9, 2025 by louie-tsai
3 of 7 tasks
1
[Feature] HPA Scaling for IaaS feature New feature or request
#246 opened Mar 7, 2025 by joshuayao v1.3
@poussa
[Feature]Chatqna lack of metric collection for vllm feature New feature or request
#245 opened Mar 6, 2025 by leslieluyu
1
[Feature] DocSum and CodeGen (Performance, accuracy and stability) Backlog features in backlog feature New feature or request
#240 opened Feb 25, 2025 by joshuayao v1.3
Support for OpenAPI Model Endpoint's?
#237 opened Feb 17, 2025 by TharunSivamani
1
[Feature] Model Card for Language Model Performance Backlog features in backlog feature New feature or request
#236 opened Feb 15, 2025 by mitalipo v1.3
@ashahba @mitalipo
[Feature] Toxicity Detection Evaluation Backlog features in backlog feature New feature or request
#235 opened Feb 14, 2025 by daniel-de-leon-user293
1 of 2 tasks
v1.3
1
@ashahba @daniel-de-leon-user293
[Task] Test AgentCompany benchmark: reproduce, run on gaudi for Agents. Backlog features in backlog
#232 opened Feb 13, 2025 by joshuayao v1.4
@lkk12014402
[Feature] Enhance the Helm Chart support for 8 examples Backlog features in backlog feature New feature or request
#226 opened Jan 21, 2025 by joshuayao
8 tasks
v1.3
@poussa @yongfengdu
[Feature] refactor HELMET: support vllm-gaudi for agent related benchmark Backlog features in backlog feature New feature or request
#225 opened Jan 21, 2025 by joshuayao
2 tasks
v1.3
@minmin-intel @XinyaoWa
[Feature] add TAG-bench for agent_eval, publish TAG-bench results for sql agent llama Backlog features in backlog feature New feature or request
#224 opened Jan 21, 2025 by joshuayao
1 task
v1.3
1
@minmin-intel
[Feature] Supports Infinity Request Rate for Serving feature New feature or request
#214 opened Dec 13, 2024 by wangkl2
[benchmark] Enhance benchmark.py
#209 opened Nov 29, 2024 by poussa
[Bug] Benchmarking script failing to capture logs in EKS
#207 opened Nov 27, 2024 by srinarayan-srikanthan
@gavinlichn
2
Setup OpenSSF Scorecard (Current Score: 4.4) dev
#197 opened Nov 9, 2024 by zixuan-x
1 task
Grafana dashboard error accessing data source documentation Improvements or additions to documentation
#149 opened Oct 1, 2024 by rowenaal
Help Needed: Collect benchmark chatQnA on your favorite CSP (AWS, GCP, Azure) Hacktoberfest OPEAHack Available for Hackathon use
#130 opened Sep 17, 2024 by Padma3a
benchmark in v0.9 stopped supporting k3s Hacktoberfest OPEAHack Available for Hackathon use
#123 opened Sep 11, 2024 by ksandowi
4
No guide for using benchmark tool behind proxy documentation Improvements or additions to documentation
#101 opened Sep 4, 2024 by joshuayao
Missing dependencies in evals/benchmark/stresscli/requirements.txt Hacktoberfest OPEAHack Available for Hackathon use
#97 opened Sep 3, 2024 by joshuayao
Missing initial instructions in evals/benchmark/README (and others) documentation Improvements or additions to documentation Hacktoberfest OPEAHack Available for Hackathon use
#92 opened Aug 30, 2024 by dbkinder
2
Restructure genAI Eval to address evaluation of multiple categories of metrics feature New feature or request
#75 opened Aug 21, 2024 by Padmaapparao
1
doc: cruft at top of /evals/metrics/bleu/README.md documentation Improvements or additions to documentation Hacktoberfest OPEAHack Available for Hackathon use
#63 opened Aug 14, 2024 by dbkinder
1
K8s Resource Management feature New feature or request
#32 opened Jun 17, 2024 by kevinintel
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.