Skip to content

Generative AI Components v0.7 Release Notes
Compare
Choose a tag to compare
@kevinintel kevinintel released this 28 Jun 16:50
· 450 commits to main since this release
v0.7
6b4bca6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

GenAIComps

  • Cores

    • Add aio orchestrator to boost concurrent serving(db3b4f)
    • Add microservice level perf statistics(597b3c, ba1d11)
    • Add Gateway for Translation(1b654d)

  • LLM

    • Support Qwen2 in LLM Microservice(3f5cde)
    • Fix the vLLM docker compose issues(3d134d)
    • Enable vLLM Gaudi support for LLM service based on officially habana vllm release(0dedc2)
    • Openvino support in vllm(7dbad0)
    • Support Ollama microservice(a00e36)
    • Support vLLM XFT LLM microservice(2a6a29, 309c2d, fe5f39)
    • Add e2e test for llm summarization tgi(e8ebd9)

  • DataPrep

    • Support Dataprep(f7443f), embedding(f37ce2) microservice with Llama Index
    • Fix dataprep microservice path issue(e20acc)
    • Add milvus microservice(e85033)
    • Add Ray version for multi file process(40c1aa)
    • Fix dataprep timeout issue(61ead4)
    • Add e2e test for dataprep redis langchain(6b7bec)
    • Supported image summarization with LVM in dataprep microservice(86412c)
    • Enable conditional splitting for html files(e1dad1)
    • Added support for pyspark in dataprep microservice(a5eb14)
    • DataPrep extract info from table in the docs(953e78)
    • Added support for extracting info from image in the docs(e23745)

  • Other Components

    • Add PGvector support in Vectorstores(1b7001) and Retriever(75eff6), Dataprep(9de3c7)
    • Add Mosec embedding(f76685) and reranking(a58ca4)
    • Add knowledge graph components(4c0afd)
    • Add LVMs LLaVA component(bd385b)
    • Add asr/tts components for xeon and hpu(cef6ea)
    • Add WebSearch Retriever Microservice(900178)
    • Add initial pii detection microservice(e38041)
    • Pinecone support for dataprep and retrieval microservice(8b6486)
    • Support prometheus metrics for opea microservices(758914), (900178)
    • Add no_proxy env for micro services(df0c11)
    • Enable RAGAS(8a670e)
    • Fix RAG performance issues(70c23d)
    • Support rerank and retrieval of RAG OPT(b51675)
    • Reranking using an optimized bi-encoder(574847)
    • Use parameter for retriever(358dbd), reranker(dfdd08)

  • CI

    • CI optimization to support multiple test for single kind of service(38f646)
    • Update CI to support dataprep_redis path level change(5c0773)
    • Enable python coverage(cd91cf)
    • Add codecov(da2689)
    • Enable microservice docker images auto build and push(16c5fd)

Others

Assets 2
Loading