Skip to content

kcondon/data-capture-module

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

data-capture-module

Data Capture Module to recieve uploaded datasets, and validate checksums.

In more general terms, this is an external module designed to allow users to upload large datasets to a repository without going through http. The design is intented to be agnostic to transfer protocol, and currently implements rsync over ssh.

Significant code cleanup (removal of hard-coded information) remains to be done.

system configuration

see [doc/installation.md](installation instructions).

stubs to be made configurable

  • username for upload script generation
  • filesystem paths

TODO

  • revisit the TODO list (and move into github issues)
  • clean up sshd config
  • improve docs
  • lighttpd paths

general organization

  • api/ : external interface that repository software will call
  • gen/ : transfer script generation for rsync+ssh uploads
  • scn/ : scanning for completed uploads, and handling related tasks

documentation

More extensive documentation is in the doc/ directory.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 56.0%
  • Shell 44.0%