PrAIvateSearch is a Gradio application that aims to implement similar features to SearchGPT, but in an open-source, local and private way.
The process of creating and the functioning of PrAIvateSearch is explained in this blog post on HuggingFace.
- Clone the repository:
git clone https://github.com/AstraBert/PrAIvateSearch.git
cd PrAIvateSearch
- Move
.env.example
to.env
...
mv .env.example .env
...and specify PostgreSQL related variables:
# .env file
PG_DB="postgres"
PG_USER="pgql_usr"
PG_PASSWORD="pgql_psw"
- Install necessary dependencies:
- Linux:
python3 -m venv /path/to/SearchPhi
source /path/to/SearchPhi/bin/activate
python3 -m pip install -r requirements.txt
- Windows:
python3 -m venv c:\path\to\SearchPhi
c:\path\to\SearchPhi\Scripts\activate # For Command Prompt
# or
c:\path\to\SearchPhi\Scripts\Activate.ps1 # For PowerShell
# or
source c:\path\to\SearchPhi\Scripts\activate # For Git
python3 -m pip install -r requirements.txt
- Start third-party services:
docker compose up -d
- Run the application:
python3 scripts/app.py
Once the models will be downloaded and loaded on your hardware, you'll see the application on http://localhost:7860
.
PROs: You can customize the application code (change the model, change CPU/GPU settings, change generation kwargs, modify the app interface...)
CONs: Longer and more complex installation process
⚠️ The Gradio application was successfully developed and tested on a Windows 10.0.22631 machine, with 32GB RAM, 16 core CPU and Nvidia GEFORCE RTX4050 GPU (6GB, cuda version 12.3), python version 3.11.9
Although being at a good stage of development, the application is a beta
and might still contain bugs and have OS/hardware/python version incompatibilities.
Here's a video demo of what it can do:
Contributions are more than welcome! See contribution guidelines for more information :)
If you found this project useful, please consider to fund it and make it grow: let's support open-source together!😊
This project is provided under MIT license: it will always be open-source and free to use.
If you use this project, please cite the author: Astra Clelia Bertelli