ragflow-0.6.0

Major updates:

• Streaming output.
• Text chunks retrieval API.
• Supports skipping layout recognition for general layout.
• Provide system components status monitoring.

What's Changed

• make sure the error will be recorded. by @KevinHuSh in #672
• make sure to raise exception if redis is not there by @KevinHuSh in #674
• fix coordinate error by @KevinHuSh in #686
• fix: fix uploaded file time error #680 by @cike8899 in #690
• Update faq.md by @guoyuhao2330 in #685
• truncate text to fitin embedding model by @KevinHuSh in #692
• 0509 faq by @writinwaters in #693
• fix disabled doc is still retreivalable by @KevinHuSh in #695
• Minor editorial updates by @writinwaters in #700
• Update README with Detailed WebUI Service Launch Instructions by @cklogic in #694
• feat: delete the added model #503 and display an error message when the requested file fails to parse #684 by @cike8899 in #708
• docs: update README_ja.md by @eltociear in #707
• Make the app name configurable even after the project is built by @cike8899 in #731
• let file in knowledgebases visible in file manager by @KevinHuSh in #714
• let index be batchly. by @KevinHuSh in #733
• Update readme by @JinHai-CN in #741
• fix: typo in user_app.py by @shaoyie in #740
• fix bug of get file by @KevinHuSh in #746
• Create quickstart.md by @writinwaters in #743
• Refactor method name by @JinHai-CN in #760
• fix: hide the add button when the folder is a knowledge base by @cike8899 in #765
• Miscellaneous updates by @writinwaters in #769
• Refactor message output format by @JinHai-CN in #772
• support gpt-4o by @KevinHuSh in #773
• feat: support GPT-4o #771 and hide the add button when the folder is a knowledge base by @cike8899 in #775
• Update README by @JinHai-CN in #779
• Updated document upload method by @guoyuhao2330 in #777
• fix bugs in searching file using keywords by @KevinHuSh in #780
• fix a string format error by @KevinHuSh in #781
• fix: remove Top K in retrieval testing #770 and if the document parsing fails, the error message returned by the backend is displayed by @cike8899 in #782
• fix: .knowledgebase folder can be deleted bug and change "Add file to knowledge base" to "Link file to knowledge base" bug by @cike8899 in #786
• Updated conversation_api.md document/upload by @guoyuhao2330 in #787
• Support for code files parse by @dashi6174 in #789
• Added file management guide by @writinwaters in #788
• Knowledge base search is case sensitive by @KevinHuSh in #797
• fix: can't capitalize file or folder name by @KevinHuSh in #798
• Fix a bug in 'assistant-setting.tsx' that causes the upload button to… by @achilou in #796
• add version by @KevinHuSh in #807
• add stream chat by @KevinHuSh in #811
• feat: Support for conversational streaming by @cike8899 in #809
• Initial draft of configure knowledge base by @writinwaters in #794
• Add 2 embeding models from OpenAI by @KevinHuSh in #812
• use smaller docker images by @KevinHuSh in #813
• fix stream chat for ollama by @KevinHuSh in #816
• feat: add feishu oauth by @yonghuili1 in #815
• fix too large thumbnail issue by @KevinHuSh in #817
• fix: thumbnails are too large in the chat box #818 by @cike8899 in #819
• fix data init error by @KevinHuSh in #820
• fix doc number miss-match issue by @KevinHuSh in #822
• Default language will be given according to the browse setting and also can be configured #801 by @cike8899 in #823
• add api/list_chunks function by @guoyuhao2330 in #821
• fix zhipuAI stream issue by @KevinHuSh in #825
• correct mismatched kb doc number by @KevinHuSh in #826
• add doc ids in API: completion by @KevinHuSh in #827
• refine doc about API: completion by @KevinHuSh in #829
• fix bug of chat without stream by @KevinHuSh in #830
• fix bug about removing KB. by @KevinHuSh in #839
• fix english query bug by @KevinHuSh in #840
• add locally deployed llm by @KevinHuSh in #841
• The default max tokens of 215 is too small, answers are often cut off.I will modify it to 512 to address this issue. by @dashi6174 in #845
• feat: display the version and backend service status on the page by @cike8899 in #848
• Set the number of task_executor processes through the environment variable WS. by @dashi6174 in #846
• Split Excel file into different chunks by @guoyuhao2330 in #847
• fix minio health bug by @KevinHuSh in #850
• Create start_chat.md by @writinwaters in #836
• Updated how to handle stalled file parsing by @writinwaters in #851
• Set the language default value of the language based on the LANG envi… by @dashi6174 in #853
• Update before release by @JinHai-CN in #854

New Contributors

• @guoyuhao2330 made their first contribution in #685
• @cklogic made their first contribution in #694
• @shaoyie made their first contribution in #740
• @dashi6174 made their first contribution in #789
• @achilou made their first contribution in #796
• @yonghuili1 made their first contribution in #815

Full Changelog: v0.5.0...v0.6.0

RAGFlow-0.5.0

RAGFlow v0.5.0 is released. The major updates in this release include improving scheduling mechanisms, a lot of bugs have been fixed, and new models such as DeepSeek-V2, being integrated.

What's Changed

• fix bug about fetching file from minio by @KevinHuSh in #574
• fix: display the current language directly at the top and do not disp… by @cike8899 in #579
• make cites in conversation API configurable by @KevinHuSh in #576
• remove default redis configuration by @KevinHuSh in #582
• refactor code by @KevinHuSh in #583
• fix exception in pdf parser by @KevinHuSh in #584
• refine document by using latest as version number by @KevinHuSh in #588
• Updated FAQ: Range of input length by @writinwaters in #594
• feat: add FlowCanvas by @cike8899 in #593
• refine code by @KevinHuSh in #595
• refine redis connection by @KevinHuSh in #599
• refine document upload by @KevinHuSh in #602
• fix: #567 use modal to upload files in the knowledge base by @cike8899 in #601
• refine docker layers by @KevinHuSh in #606
• fix: omit long file names by @cike8899 in #608
• fix disable and enable llm setting in dialog by @KevinHuSh in #616
• fix: fixed the issue that ModelSetting could not be saved #614 by @cike8899 in #617
• remove PyMuPDF by @KevinHuSh in #618
• Fix: missing 'redis' package in requirements.txt by @huangbaichao in #622
• Fix missing 'ollama' package in requirements.txt by @huangbaichao in #621
• refine code by @KevinHuSh in #626
• fix: filter knowledge list by keywords and clear the selected file list after the file is uploaded successfully and add ellipsis pattern to chunk list by @cike8899 in #628
• docs: Add instructions for launching service from source by @huangbaichao in #619
• remove redis by @KevinHuSh in #629
• Updated faq.md by @writinwaters in #636
• Update README badge by @writinwaters in #639
• fix: add spin to parsing status icon of dataset table by @cike8899 in #649
• Refactor: Use TaskStatus enum for task status handling by @huangbaichao in #646
• fix file encoding detection bug by @KevinHuSh in #653
• optimize srv broker and executor logic by @fkzhao in #630
• refine text decode by @KevinHuSh in #657
• fix bug by @KevinHuSh in #659
• refine doc for v0.5.0 by @KevinHuSh in #660
• fix bugs by @KevinHuSh in #662
• remove unused dependency by @KevinHuSh in #664
• fix task losting isssue by @KevinHuSh in #665
• add support for deepseek by @KevinHuSh in #668
• feat: support DeepSeek by @cike8899 in #667
• update docker file to support low version npm package by @KevinHuSh in #669
• Update README by @JinHai-CN in #670

New Contributors

• @fkzhao made their first contribution in #630

Full Changelog: v0.4.0...v0.5.0

RAGFlow-0.4.0

What's Changed

• add file management feature by @KevinHuSh in #560
• feat: translate FileManager #345 by @cike8899 in #558
• fix rename bug by @KevinHuSh in #562
• feat: add Tooltip to action icon of FileManager by @cike8899 in #561
• fix bug of file management by @KevinHuSh in #565
• Update version info by @JinHai-CN in #564

Full Changelog: v0.3.2...v0.4.0

v0.3.2

What's Changed

• Updated badge link by @writinwaters in #545
• chore: disable Kibana volume storage in Docker Compose by @huangbaichao in #548
• fix youdao bug by @KevinHuSh in #551
• Update version to 0.3.2 by @JinHai-CN in #550

New Contributors

• @huangbaichao made their first contribution in #548

Full Changelog: v0.3.1...v0.3.2

ragflow-0.3.1

What's Changed

• Update format by @JinHai-CN in #467
• fix: 🐛 Fix duplicate ports in docker-compose by @moyueheng in #472
• add redis to accelerate access of minio by @KevinHuSh in #482
• feat: support markdown files by @wrfly in #483
• fix ollama issuet push by @KevinHuSh in #486
• remove doc from supported processing types by @KevinHuSh in #488
• .doc file is not support yet. fix regular expression ，then message can be alert by @Jiafan in #487
• Adjust the structure of FAQ by @yingfeng in #479
• enlarge docker memory usage by @KevinHuSh in #496
• enlarge docker memory usage by @KevinHuSh in #501
• Add .doc file parser. by @chrysanthemum-boy in #497
• fix bug #502 by @KevinHuSh in #504
• fix: cannot save the system model setting #468 by @cike8899 in #508
• fix bug of table in docx by @KevinHuSh in #510
• feat: create folder #345 by @cike8899 in #518
• Add Chinese readme for DeepDoc by @bjliudong in #515
• Update conversation_api.md by @selfuppen in #489
• Add an entry in Debugging section by @zhentg in #481
• editorial updates by @writinwaters in #525
• Add .DS_Store and docker/ragflow-logs to the git ignore list by @oreh in #523
• Updated minimum RAM capacity by @writinwaters in #528
• feat: upload file in FileManager #345 by @cike8899 in #529
• Add docker support for OpenCloudOS 9 by @Edward-Elric233 in #526
• Add disk requirements on the README by @JinHai-CN in #535
• there's no need to connect to Redis in order to use Redis by @writinwaters in #536
• Refactor by @KevinHuSh in #537
• Added release badge by @writinwaters in #538
• Updated badge by @writinwaters in #540
• Add upload file by knowledge base name API. by @chrysanthemum-boy in #539
• feat: add file icon to table of FileManager #345 by @cike8899 in #543
• Update version to v0.3.1 by @JinHai-CN in #544

New Contributors

• @moyueheng made their first contribution in #472
• @wrfly made their first contribution in #483
• @chrysanthemum-boy made their first contribution in #497
• @bjliudong made their first contribution in #515
• @selfuppen made their first contribution in #489
• @zhentg made their first contribution in #481
• @oreh made their first contribution in #523
• @Edward-Elric233 made their first contribution in #526

Full Changelog: v0.3.0...v0.3.1

ragflow-0.3.0

What's Changed

• fix gb2312 encoding issue by @KevinHuSh in #394
• Added FAQs by @writinwaters in #395
• feat: modify the description of qa by @cike8899 in #406
• Add automation scripts to support displaying environment information such as RAGFlow repository version, operating system, Python version, etc. in a Linux environment for users to report issues. by @ysyx2008 in #396
• fix bulk error for table method by @KevinHuSh in #407
• Added some debugging FAQs by @writinwaters in #413
• Update PR template by @JinHai-CN in #415
• Update table.py to convert clmns to string by @yc-huang in #414
• make sure the models will not be load twice by @KevinHuSh in #422
• rm page number exception for pdf parser by @KevinHuSh in #424
• Add env to expose minio port to the host by @BrightXiaoHan in #426
• add lf end-lines in *.sh by @ooooo-create in #425
• fix: replace some pictures of chunk method #437 by @cike8899 in #438
• Bug fix pdf parse index out of range by @Jiafan in #440
• fix divide by zero bug by @KevinHuSh in #447
• feat: translate EmbedModal #345 by @cike8899 in #455
• Fit a lot of encodings for text file. by @KevinHuSh in #458
• change readme for 0.3.0 release by @KevinHuSh in #459
• trivals by @KevinHuSh in #462
• refine docs for chat bot api. by @KevinHuSh in #463
• feat: #345 even if the backend data returns empty, the skeleton of the chart will be displayed. by @cike8899 in #461
• Refine conversaion docs by @KevinHuSh in #465

New Contributors

• @ysyx2008 made their first contribution in #396
• @yc-huang made their first contribution in #414
• @BrightXiaoHan made their first contribution in #426
• @Jiafan made their first contribution in #440

Full Changelog: v0.2.0...v0.3.0

ragflow-0.2.0

What's Changed

• change version number by @KevinHuSh in #368
• make <xxxx> visiable by @ooooo-create in #369
• enlarge max file number per user limit by @KevinHuSh in #373
• build ragflow docker image from scratch by @yangjie407 in #376
• Add bce-embedding and fastembed by @KevinHuSh in #383
• Added FAQ why document parsing gets stuck by @writinwaters in #385
• fix: revert #359 by @ooooo-create in #388
• change version number in readme by @KevinHuSh in #390
• feat: add overview by @cike8899 in #391
• fix bug for FastEmbed by @KevinHuSh in #392
• Fix document bug by @JinHai-CN in #393

New Contributors

• @yangjie407 made their first contribution in #376

Full Changelog: v0.1.0...v0.2.0

ragflow-0.1.0

What's Changed

• use onnx models, new deepdoc by @KevinHuSh in #68
• feat: fetch conversation and delete chat dialog by @cike8899 in #69
• rename vision, add layour and tsr recognizer by @KevinHuSh in #70
• init README of deepdoc, add picture processer. by @KevinHuSh in #71
• refine README by @KevinHuSh in #72
• feat: render message reference and add avatar to MessageItem by @cike8899 in #73
• add ocr and recognizer demo, update README by @KevinHuSh in #74
• refine admin initialization by @KevinHuSh in #75
• fix bug of inserting cites by @KevinHuSh in #76
• feat: add file icon and add message popover content by @cike8899 in #77
• add dockerfile and fix trival bugs by @KevinHuSh in #78
• feat: rename conversation and delete conversation and preview reference image and fetch file thumbnails by @cike8899 in #79
• feat: add nginx.conf by @cike8899 in #80
• feat: fetch parser list for SegmentSetModal by @cike8899 in #81
• docker debugging modification by @KevinHuSh in #82
• feat: set proxy of backend api by @cike8899 in #83
• resolve user login issue, and docker confiuration issue by @KevinHuSh in #84
• fix user login issue by @KevinHuSh in #85
• feat: let the messages I send appear immediately in the chat window and remove rewrite configuration from nginx proxy by @cike8899 in #86
• resolve the issue of naive parser by @KevinHuSh in #87
• feat: display all pdf pages and add DocumentPreview by @cike8899 in #88
• feat: add Preview with react-pdf-highlighter by @cike8899 in #89
• solve task execution issues by @KevinHuSh in #90
• fix table desc bugs, add positions to chunks by @KevinHuSh in #91
• feat: locate the specific location of the document based on the coordinates of the chunk and add Upload to AssistantSetting by @cike8899 in #92
• fix position extraction bug by @KevinHuSh in #93
• feat: set width of chunk text to 100% and add Skeleton to Preview of document and remove react-pdf by @cike8899 in #94
• feat: fixed the issue where chat greetings could not appear by @cike8899 in #95
• change callback strategy, add timezone to docker by @KevinHuSh in #96
• feat: add DocumentPreviewer for chunk of chat reference and remove duplicate \n from record.progress_msg by @cike8899 in #97
• fix task cancling bug by @KevinHuSh in #98
• feat: Add Skeleton to MessageItem before the backend returns a message and fixed the issue where ChatConfigurationModal displays old data when creating a new dialog by @cike8899 in #99
• adjust hierarchical_merge strategy by @KevinHuSh in #100
• feat: set local path of workerSrc to PdfLoader by @cike8899 in #101
• chage tas execution logic by @KevinHuSh in #103
• feat: fetch knowledge detail on KnowledgeUploadFile mount and add category column to chunk table and set initial value for the model field of chat setting by @cike8899 in #104
• feat: fixed the issue that some PDF documents could not be displayed on the chunk list page in small screens and logout by @cike8899 in #105
• feat: login with github and if it is not a pdf file, set the width of chunkContainer to 100% by @cike8899 in #106
• feat: call useLoginWithGithub in useAuth by @cike8899 in #107
• feat: set initial state of auth to null by @cike8899 in #108
• deal with stop reason being length problem by @KevinHuSh in #109
• refine presentation parser by @KevinHuSh in #110
• feat: add UserSetting and set height of MoreIcon to 24px and replace logo by @cike8899 in #111
• refine pdf parser, add time zone to userinfo by @KevinHuSh in #112
• feat: submit new password to backend and submit user information and add Form to UserSettingProfile by @cike8899 in #114
• layout refine by @KevinHuSh in #115
• feat: bind length of conversationList to chat count by @cike8899 in #116
• feat: display chunk token number when category of knowledge as general and unavailable llm models appear disabled and if the backend returns 401, it will jump to the login page and fixed the issue where the greeting would disappear when clicking on a new dialog by @cike8899 in #117
• Refine README by @KevinHuSh in #118
• add local llm implementation by @KevinHuSh in #119
• refine table parser by @KevinHuSh in #120
• feat: submit api key and add language to Configuration and fetch llm factory list on UserSettingModel mount by @cike8899 in #121
• feat: remove loading from document table and fixed the issue where gif images could not be uploaded on the configuration page by @cike8899 in #122
• add dockerfile for cuda envirement. Refine table search strategy, by @KevinHuSh in #123
• feat: fixed an issue where the default value for temperature was not set when creating a new chat and install remark-gfm so that the markdown table can be displayed by @cike8899 in #124
• resolve table issues by @KevinHuSh in #125
• add Moonshot, debug my_llm by @KevinHuSh in #126
• feat: add SystemModelSettingModal by @cike8899 in #127
• feat: generate select options for SystemModelSettingModal grouped by type and add llm icon and add upgrade button to UserSettingTeam and replace the icon in the sidebar of the user settings page by @cike8899 in #128
• feat: add programming language highlighting for markdown syntax by @cike8899 in #129
• feat: add chunkText to messageText to distinguish table rows and when parsing, the delete and other buttons are set to disabled. by @cike8899 in #130
• refine manul parser by @KevinHuSh in #131
• fix github account login issue by @KevinHuSh in #132
• fix: fixed the issue that the prompt word for registering an account is not in English and fixed the issue where the last message would keep loading if the backend reported an error during chat and fixed the issue where the next button would float above the file list on the file upload page by @cike8899 in #133
• fix: disable sending messages if both application and conversation are empty and add loading to all pages by @cike8899 in #134
• refine for English corpus by @KevinHuSh in #135
• feat: add loading to ChatContainer and set font family to inter and add tooltip to Form.Item and download documents on the document list page by @cike8899 in #136
• Add 'One' chunk method by @KevinHuSh in #137
• feat: add image for chunk method by @cike8899 in #139
• refine manual parser by @KevinHuSh in #140
• feat: add hooks for document table and refactor document-related modal by @cike8899 in #141
• add help info by @KevinHuSh in #142
• feat: add pages to ChunkMethodModal by @cike8899 in #143
• add use layout or not option by @KevinHuSh in #145
• feat: when Layout recognize is false, hide pages by @cike8899 in #144
• feat: move layout_recognize to the bottom by @cike8899 in #146
• refine page ranges by @KevinHuSh in #147
• feat: remove disabled from ChunkMethodModal by @c...