Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1.4.0 Release #64

Merged
merged 59 commits into from
Dec 14, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
745cc55
Instance shortcuts profile example
bcarr15 Oct 25, 2021
1bcafb8
Merge before pull
bcarr15 Oct 25, 2021
50b8c0d
Bootstrap script - still testing/fixing
bcarr15 Nov 19, 2021
255ee86
Change to wait_for func
bcarr15 Nov 19, 2021
d0269fa
Merge branch 'ksuderman:dev' into dev
bcarr15 Nov 22, 2021
713741b
Fixed history export waiting and loop
bcarr15 Nov 28, 2021
8209159
Issue with collecting export URL
bcarr15 Nov 28, 2021
b045e6e
Resolve merge issue
bcarr15 Dec 1, 2021
bfcfde9
Merge changes
bcarr15 Dec 1, 2021
aee58b8
Fix conflicts
bcarr15 Dec 1, 2021
7a3085a
Use abm as lib instead of subprocess
bcarr15 Dec 1, 2021
c88b554
Fix typo
afgane Dec 3, 2021
7338252
Merge pull request #46 from afgane/patch-2
ksuderman Dec 3, 2021
f2c63b3
abm import adjusted, add folder with test config
bcarr15 Dec 6, 2021
f0ef352
Merge pull request #47 from aTrashPanda/bootstrap
ksuderman Dec 6, 2021
aee5663
Merge branch 'dev' into bootstrap
ksuderman Dec 6, 2021
2525346
Start refactoring
ksuderman Dec 6, 2021
8638d37
Moved abm lib. Refactored abm-bootstrap into stand-alone script
ksuderman Dec 7, 2021
537c62e
Merge pull request #49 from ksuderman/dev
ksuderman Dec 7, 2021
d829244
Refactory abm-bootstrap into bootstrap.py
ksuderman Dec 7, 2021
f905c5b
Merge pull request #50 from ksuderman/benchmark
ksuderman Dec 7, 2021
9a75e8a
Add common.set_active_profile()
ksuderman Dec 7, 2021
94b2819
Merge branch 'dev' into bootstrap
ksuderman Dec 7, 2021
7a0b6cc
Merge branch 'bootstrap' of github.com:ksuderman/bioblend-scripts int…
ksuderman Dec 7, 2021
2a06779
Trying to fix module/library problem
ksuderman Dec 7, 2021
f1f936a
Getting ready for merge
ksuderman Dec 7, 2021
47bd984
Refactor packages and modules
ksuderman Dec 7, 2021
6cc575f
Merge pull request #51 from ksuderman/packages
ksuderman Dec 7, 2021
a523476
Comments and todo items
ksuderman Dec 7, 2021
da98767
Merge pull request #52 from ksuderman/bootstrap
ksuderman Dec 7, 2021
a3ca871
Pre-merge commit
bcarr15 Dec 8, 2021
a316105
Merge file structure changes
bcarr15 Dec 8, 2021
1a41d3d
Fixing modules
ksuderman Dec 9, 2021
c361838
Add some TODO items.
ksuderman Dec 9, 2021
f830f82
Merge branch 'bootstrap' of https://github.com/aTrashPanda/bioblend-s…
bcarr15 Dec 9, 2021
358a409
Load history and workflow ID values from a yaml configuration file
bcarr15 Dec 9, 2021
2b4141f
Merge pull request #55 from aTrashPanda/bootstrap
ksuderman Dec 9, 2021
7081ed0
Merge pull request #57 from ksuderman/benchmark
ksuderman Dec 9, 2021
7fcb7e8
Check validate return code to see if upload needed
bcarr15 Dec 9, 2021
776181c
Merge pull request #58 from ksuderman/dev
ksuderman Dec 9, 2021
df4b87c
Merge branch 'ksuderman:bootstrap' into bootstrap
bcarr15 Dec 9, 2021
87ee8e9
Merge pull request #59 from aTrashPanda/bootstrap
bcarr15 Dec 9, 2021
eccdd68
Return the job id from history.import
ksuderman Dec 9, 2021
e1c821b
Merge branch 'dev' into bootstrap
bcarr15 Dec 9, 2021
9c27f6f
Merge branch 'bootstrap' of https://github.com/aTrashPanda/bioblend-s…
bcarr15 Dec 9, 2021
887faea
Make history._import wait for import job
ksuderman Dec 9, 2021
4a77359
Command line parse adjusted
bcarr15 Dec 9, 2021
9274895
Merge branch 'dev' into bootstrap
bcarr15 Dec 9, 2021
ad0f424
Fixed error message for config yaml not found
bcarr15 Dec 9, 2021
a0d3a7b
Fixed TODO for cmd line parsing
bcarr15 Dec 9, 2021
685c105
Random directory for workflow downloads
bcarr15 Dec 12, 2021
d3ca267
Merge pull request #61 from aTrashPanda/bootstrap
bcarr15 Dec 12, 2021
0d08140
Refactor benchmark config
ksuderman Dec 13, 2021
ee21819
Fix experiment configuration format
ksuderman Dec 14, 2021
9516385
Update wait for script to use abm.py
ksuderman Dec 14, 2021
90409ff
Bump to version 1.4.0
ksuderman Dec 14, 2021
7959474
Code clean up
ksuderman Dec 14, 2021
297c096
Merge pull request #62 from galaxyproject/bootstrap
ksuderman Dec 14, 2021
a2b23a4
Remove stale directory
ksuderman Dec 14, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Empty file removed abm-bootstrap/__init__.py
Empty file.
108 changes: 0 additions & 108 deletions abm-bootstrap/__main__.py

This file was deleted.

31 changes: 12 additions & 19 deletions abm/__main__.py → abm.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,27 +11,16 @@
import sys
import os
import logging
import common
from common import parse_profile
from pprint import pprint
import lib.common

# These imports are required because they need to be added to the symbol table
# so the parse_menu method can find them in globals()
import job
import dataset
import workflow
import history
import library
import folder
import config
import benchmark
import helm
import kubectl
from lib import job, dataset, workflow, history, library, folder, benchmark, helm, kubectl, config

log = logging.getLogger('abm')
log.setLevel(logging.ERROR)

VERSION = '1.3.0'
VERSION = '1.4.0'

BOLD = '\033[1m'
CLEAR = '\033[0m'
Expand Down Expand Up @@ -129,7 +118,7 @@ def alias(shortcut, fullname):

def parse_menu():
log.debug('parse_menu')
menu_config = f'{os.path.dirname(__file__)}/menu.yml'
menu_config = f'{os.path.dirname(__file__)}/lib/menu.yml'
if not os.path.exists(menu_config):
print(f"ERROR: Unable to load the menu configuration from {menu_config}")
sys.exit(1)
Expand Down Expand Up @@ -164,7 +153,7 @@ def version():
print(f" Copyright 2021 The Galaxy Project. All Rights Reserved.\n")


def main():
def entrypoint():
menu_data = parse_menu()

if len(sys.argv) < 2 or sys.argv[1] in help_args:
Expand Down Expand Up @@ -213,8 +202,12 @@ def main():
return

if profile is not None:
common.GALAXY_SERVER, common.API_KEY, common.KUBECONFIG = parse_profile(profile)
if common.GALAXY_SERVER is None:
# common.GALAXY_SERVER, common.API_KEY, common.KUBECONFIG = parse_profile(profile)
if not lib.common.set_active_profile(profile):
print(f"ERROR: Unable to set the active profile. No GALAXY_SERVER defined.")
return
if lib.GALAXY_SERVER is None:
print("ERROR: GALAXY_SERVER was not set in the profile.")
return
if command in all_commands:
subcommands = all_commands[command]
Expand All @@ -230,4 +223,4 @@ def main():


if __name__ == '__main__':
main()
entrypoint()
Empty file removed abm/__init__.py
Empty file.
186 changes: 0 additions & 186 deletions abm/benchmark.py

This file was deleted.

21 changes: 10 additions & 11 deletions benchmarks/dna-single-benchmark.yml
Original file line number Diff line number Diff line change
@@ -1,11 +1,10 @@
- name: Benchmarking DNA
runs: 3
workflow_conf:
- config/dna-named.yml
- config/rna-named.yml
cloud:
- iu1
- iu2
job_configs:
- 4x8
- 8x16
name: Benchmarking DNA
runs: 3
workflow_conf:
- config/dna-named.yml
cloud:
- tacc1
- tacc2
job_configs:
- 4x8
- 8x16
Loading