fcombine is a simple tool built to combine files and remove duplicates in a quick and easy manner.
git clone https://github.com/QSoloX/fcombine.git
This programs that you have python3 installed on your machine
sudo apt install python3
You can add as many files as you want as args, it takes the file path.
python3 fcombine.py file.txt file2.txt > output.txt
Running it without redirecting the output will just print it to the terminal
python3 fcombine.py file.txt file2.txt
site.com
site2.com