Horde is a torrent-based file distribution system, forked from Herd and based on Murder. It allows for quick and easy transfer of small and large files. You can probably use it for other things too.
Horde requires no extra modules on Python and includes everything needed for destinations including its own (lightly modified) copy of BitTornado.
Herd is a command line python client interface that uses eventlet and has to be ran from the command line. This project also has limitations around large file transfers, peer seeding and python integration.
Murder was Twitter's original BitTorrent-based file distribution system. It's pretty dependent on Capistrano and requires that a separate tracker process is started before you run the deploy task.
Horde spawns its own tracker in the background which makes it really trivial to integrate into whatever deployment system you like.
Horde needs Python > 2.5 and argparse. If your using python 2.7+ nothing else is needed as argparse was added to the standard library.
Argparse(if needed) can be installed with easy_install or pip:
pip install argparse
easy_install argparse
Horde also currently requires that key based passwordless authentication is enabled on all of your target destinations.
git clone https://github.com/naterh/Horde
cd Horde && sudo python setup.py install
or
sudo pip install horde
With a hosts file that includes a list of the hosts you want to copy to:
horde myfile.tar.gz /path/to/destination.tar.gz hosts_file
Using a hosts list that is a single string comma separated:
horde myfile.tar.gz /path/to/destination.tar.gz --hostlist "host1,host2,host3"
More options:
horde --help
Horde can also be imported as a python module. This makes integration into existing projects much more bueno. One would simply need to:
import horde.horde as horde
horde.run_with_opts('localfile', 'remotefile', hostlist='server1,server2')