Generic Computational cloud backend for NMF

[molikd]

by utilizing:

• https://github.com/cloudyr/aws.ec2
• https://github.com/cloudyr/googleComputeEngineR

We can create a generic computational backend function to submit jobs to the cloud (and later computational clusters like SGE or SLURM).

This would be a sub-function for each computational backend and a function to call them, by keeping them generic the feature can be expanded to optinally compute other pieces of sake.

I suggest:
a function "sake_generic_backend" which can call functions:

• aws_backend
• google_backend

Which in turn will be called by sake_generic_backend will be called by the current NMF Yabi code, even going so far as to utilize the current AMI

The configuration will need to be put someplace (things like secret keys and AMI instances) or made available to the end user.

[naikai]

I agree. Will test it for aws.ec2 first.

[molikd]

I'm around at 1:30 if you want to talk about it, I'll also have to send you config details.

[naikai]

No Problem. See you at 1:30.

Best,

Ray

On Nov 3, 2016, at 11:11 AM, David Molik <[email protected]mailto:[email protected]> wrote:

I'm around at 1:30 if you want to talk about it, I'll also have to send you config details.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com//issues/55#issuecomment-258171025, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AHi_OUeRtcQ6c0XMleanXnvcay7bBENHks5q6fmOgaJpZM4KodLH.

[molikd]

Here's the bit that will have to be rewritten to use the Cloud backend the configuration for AWS and other backends will also have to be stored somewhere.