You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now, the datastructure that pipeline Operators generate from the get_jobs method is not the same as the CWL input for the pipeline. In particular, "file" entries are represented like this in the Operator's datastructure:
However, the actual CWL representation looks like this:
{'class': 'File', 'path': '/path/to/foo.txt'}
Currently, Beagle is automatically converting the former two syntaxes into the latter one after the job is submitted (? @sivkovic please feel free to correct or clarify this). Also, if the user is manually creating the input JSON to pass to the Beagle API to run a pipeline, it must be in the former two syntaxes, and not the latter syntax.
This makes development and manual run creation difficult since the datastructure that you pass to the CWL no longer matches the format used by Beagle, so you cannot verify that your Bealge data is correct by running it against the CWL directly. Similarly, when building a new operator, you cannot manually check that your output JSON format is correct since it will not be accepted by cwltool, etc., due to the format discrepancies.
It would be helpful to be able to somehow output the exact CWL input JSON format that an operator would be creating in order to validate against the CWL pipeline input format.
The text was updated successfully, but these errors were encountered:
Right now, the datastructure that pipeline Operators generate from the
get_jobs
method is not the same as the CWL input for the pipeline. In particular, "file" entries are represented like this in the Operator's datastructure:or like this:
However, the actual CWL representation looks like this:
Currently, Beagle is automatically converting the former two syntaxes into the latter one after the job is submitted (? @sivkovic please feel free to correct or clarify this). Also, if the user is manually creating the input JSON to pass to the Beagle API to run a pipeline, it must be in the former two syntaxes, and not the latter syntax.
This makes development and manual run creation difficult since the datastructure that you pass to the CWL no longer matches the format used by Beagle, so you cannot verify that your Bealge data is correct by running it against the CWL directly. Similarly, when building a new operator, you cannot manually check that your output JSON format is correct since it will not be accepted by
cwltool
, etc., due to the format discrepancies.It would be helpful to be able to somehow output the exact CWL input JSON format that an operator would be creating in order to validate against the CWL pipeline input format.
The text was updated successfully, but these errors were encountered: