Cloud Filemanager

About

A high-level filemanager utility for cloud services. Currently, only Dropbox is supported. PYPI Package

Table of Contents

• Using the library
  • Installing and using the library
  • Examples of usage
• Manually install the library
  • Prerequisites
  • Install the requirements
  • Run the Unit Tests
• Continuous Integration
• Update PyPI package
• License

Using the library

For a detailed usage example see example.py.

You will need to create an Api key for your Dropbox account. Reference 1, Reference 2

Installing and using the library

First, you need to install the library using pip:

$ pip install cloud_filemanager

Then, import it and initialize it like so:

from cloud_filemanager import DropboxCloudManager

cloud_conf = {'type': 'dropbox', 'config': {'api_key': 'your api key'}}
dbx = DropboxCloudManager(config=cloud_conf)

If you want to use a yml file to load the configuration, you can use the CloudConfig class:

from cloud_filemanager import CloudConfig
import os

config_path = str(os.path.join('confs', 'conf.yml'))
config = CloudConfig(config_src=config_path)
cloud_conf = config.get_cloud_config()

Two example YAML files can be found in the confs folder. For more details on how to use this YAML configuration loader see this Readme.

Examples of usage

The currently supported operations are the following:

• Upload, Download, Delete Files
• List directories

Upload

with open('my_file.txt', 'rb') as fp:
    file_to_upload = fp.read()
dbx.upload_file(file_bytes=file_to_upload, upload_path='/tests/my_file.txt', write_mode='overwrite')

Download

dbx.download_file(frompath='/tests/my_file.txt', tofile='my_file_downloaded.txt')

Delete

dbx.delete_file('/tests/my_file.txt')

List Files

dbx.ls('/tests/')

All of these examples can be found in example.py.

Manually install the library

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.

Prerequisites

You need to have a machine with anaconda installed and any Bash based shell (e.g. zsh) installed.

$ conda -V
conda 4.10.1

$ echo $SHELL
/usr/bin/zsh

Install the requirements

All the installation steps are being handled by the Makefile.

First, modify the python version (min_python) and everything else you need in the settings.ini.

Then, execute the following commands:

$ make create_env
$ conda activate cloud_filemanager
$ make dist

Now you are ready to use and modify the library.

Run the Unit Tests

If you want to run the unit tests, execute the following command:

$ make tests

Continuous Integration

For the continuous integration, the CircleCI service is being used. For more information you can check the setup guide.

For any modifications, edit the circleci config.

Update PyPI package

This is mainly for future reference for the developers of this project. First, create a file called ~/.pypirc with your pypi login details, as follows:

[pypi]
username = your_pypi_username
password = your_pypi_password

Then, modify the python version (min_python), project status (status), release version (version) and everything else you need in the settings.ini.

Finally, execute the following commands:

$ make create_env
$ conda activate cloud_filemanager
$ make release

For a dev release, change the testing_version and instead of make release, run make release_test.

License

This project is licensed under the Apache License - see the LICENSE file for details.