Upgrade our argo fork to the latest version (#22)

[decarboxy]

• Updated ARTIFACT_REPO.md (Updated ARTIFACT_REPO.md argoproj/argo-workflows#1049)

• Updated examples/README.md (Updated examples/README.md argoproj/argo-workflows#1051)

• Support for K8s API based Executor (K8sAPI Executor argoproj/argo-workflows#1010)

• Submodules are dirty after checkout -- need to update (Submodules are diry after checkout -- need to update argoproj/argo-workflows#1052)

• Parameter and Argument names should support snake case (Parameter and Argument names should support snake case argoproj/argo-workflows#1048)

• Add namespace explicitly to pod metadata (Add namespace explicitly to pod metadata argoproj/argo-workflows#1059)

• Update dependencies to K8s v1.12 and client-go 9.0

• Adding SAP Hybris in Who uses Argo (Adding SAP Hybris in Who uses Argo argoproj/argo-workflows#1064)

• Add Cratejoy to list of users (Add Cratejoy to list of users argoproj/argo-workflows#1063)

• Raise not implemented error when artifact saving is unsupported (Raise not implemented error argoproj/argo-workflows#1062)

• Adding native GCS support for artifact storage and retrieval

• Support nested steps workflow parallelism (Support nested steps workflow parallelism argoproj/argo-workflows#1046)

• Auto-complete workflow names (Auto-complete workflow names argoproj/argo-workflows#1061)

• Auto-complete workflow names

• Use cobra revision at fe5e611709b0c57fa4a89136deaa8e1d4004d053

• Fix string format arguments in workflow utilities. (Fix string format arguments in workflow utilities. argoproj/argo-workflows#1070)

• fix No Auth Provider found for name “azure” argoproj/argo-workflows#1078 Azure AKS authentication issues (fix #1078 Azure AKS authentication issues argoproj/argo-workflows#1079)

• Issue Proposal: system level workflow parallelism limits & priorities argoproj/argo-workflows#740 - System level workflow parallelism limits & priorities (Issue #740 - System level workflow parallelism limits & priorities argoproj/argo-workflows#1065)

• Issue Proposal: system level workflow parallelism limits & priorities argoproj/argo-workflows#740 - System level workflow parallelism limits & priorities

• Apply reviewer notes

• Add new article and minor edits. (Add new article and minor edits. argoproj/argo-workflows#1083)

• Update docs to outline bare minimum set of privileges for a workflow

• Use relative links on README file (Use relative links on README file argoproj/argo-workflows#1087)

• Fix typo in demo.md (Fix typo in demo.md argoproj/argo-workflows#1089)

Fix a small typo in demo.md that I encounted when reading through the
getting started guide.

• Drop reference to removed argo install command. (Drop reference to removed argo install command. argoproj/argo-workflows#1074)

• Initialize child node before marking phase. Fixes panic on invalid When (Initialize child node before marking phase. argoproj/argo-workflows#1075)

• Failed to load artifacts: 500 Internal Server Error argoproj/argo-workflows#1081 added retry logic to s3 load and save function (#1081 added retry logic to s3 load and save function argoproj/argo-workflows#1082)

• adding logo to be used by the OS Site (adding logo to be used by the OS Site argoproj/argo-workflows#1099)

• Update ROADMAP.md

• Update docs with examples using the K8s REST API

• Issue Unable to load workflows argoproj/argo-workflows#1114 - Set FORCE_NAMESPACE_ISOLATION env variable in namespace install manifests (Issue #1114 - Set FORCE_NAMESPACE_ISOLATION env variable in namespace install manifests argoproj/argo-workflows#1116)

• Fix examples docs of parameters. (Fix examples docs of parameters. argoproj/argo-workflows#1110)

• Remove docker_lib mount volume which is not needed anymore (Remove docker_lib mount volume which is not needed anymore argoproj/argo-workflows#1115)

• Remove docker_lib mount volume which is not needed anymore

• Remove unused hostPathDir

• add support for ppc64le and s390x (add support for ppc64le and s390x argoproj/argo-workflows#1102)

• Install mime-support in argoexec to set proper mime types for S3 artifacts (resolves S3 mime types are not set properly argoproj/argo-workflows#1119)

• Adding Quantibio in Who uses Argo (Adding Quantibio in Who uses Argo argoproj/argo-workflows#1111)

• Adding Quantibio in Who uses Argo

• fix spelling mistake

• Fix output artifact and parameter conflict (Fix output artifact and parameter conflict argoproj/argo-workflows#1125)

SaveArtifacts deletes the files that SaveParameters might still need, so we're calling SaveParameters first.
Fixes argoproj#1124

• Update generated swagger to fix verify-codegen (Update generated swagger to fix verify-codegen argoproj/argo-workflows#1131)

• Allow owner reference to be set in submit util (allow ownerReferences argoproj/argo-workflows#1120)

• Issue argo logs --follow does not wait enough time for the main container to start argoproj/argo-workflows#1104 - Remove container wait timeout from 'argo logs --follow' (Issue #1104 - Remove container wait timeout from 'argo logs --follow' argoproj/argo-workflows#1142)

• Issue panic: interface conversion: interface {} is cache.DeletedFinalStateUnknown, not *unstructured.Unstructured argoproj/argo-workflows#1132 - Fix panic in ttl controller (Issue #1132 - Fix panic in ttl controller argoproj/argo-workflows#1143)

• Issue Daemon pods are not reaped correctly argoproj/argo-workflows#1040 - Kill daemoned step if workflow consist of single daemoned step (Issue #1040 - Kill daemoned step if workflow consist of single daemoned step argoproj/argo-workflows#1144)

• Fix global artifact overwriting in nested workflow (Fix global artifact overwriting in nested workflow argoproj/argo-workflows#1086)

• Fix issue where steps with exhausted retires would not complete (Fix issue where steps with exhausted retires would not complete argoproj/argo-workflows#1148)

• add support for other archs (add support for other archs argoproj/argo-workflows#1137)

• Reflect minio chart changes in documentation (Reflect minio chart changes in documentation argoproj/argo-workflows#1147)

• Issue Argo UI displays DAG in an odd way argoproj/argo-workflows#1136 - Fix metadata for DAG with loops (Issue #1136 - Fix metadata for DAG with loops argoproj/argo-workflows#1149)

• Issue Argo UI displays DAG in an odd way argoproj/argo-workflows#1136 - Fix metadata for DAG with loops

• Add slack badge to README (Add slack badge to README argoproj/argo-workflows#1164)

• Fix failing TestAddGlobalArtifactToScope unit test

• Fix tests compilation error (Fix tests compilation error argoproj/argo-workflows#1157)

• Replace exponential retry with poll (Replace exponential retry with poll argoproj/argo-workflows#1166)

• add support for hostNetwork & dnsPolicy config (add support for hostNetwork & dnsPolicy config argoproj/argo-workflows#1161)

• Support HDFS Artifact (Support HDFS Artifact argoproj/argo-workflows#1159)

Support HDFS Artifact (argoproj#1159)

• Update codegen for network config (Update codegen for network config argoproj/argo-workflows#1168)

• Add GitHub to users in README.md (Update README.md argoproj/argo-workflows#1151)

• Add Preferred Networks to users in README.md (Add Preferred Networks to users in README.md argoproj/argo-workflows#1172)

• Add missing patch in namespace kustomization.yaml (Add missing patch in namespace kustomization.yaml argoproj/argo-workflows#1170)

• Validate ArchiveLocation artifacts (Validate ArchiveLocation Artifacts argoproj/argo-workflows#1167)

• Update README and preview notice in CLA.

• Update README. (Update README and preview notice in CLA. argoproj/argo-workflows#1173) (Update README and preview notice in CLA. (#1173) argoproj/argo-workflows#1176)

• Argo users: Equinor (Argo users: Equinor argoproj/argo-workflows#1175)

• Do not mount unnecessary docker socket (Do not mount unnecessary docker socket argoproj/argo-workflows#1178)

• Issue Daemon step + artifacts don't update workflow metadata argoproj/argo-workflows#1113 - Wait for daemon pods completion to handle annotations (Issue #1113 - Wait for daemon pods completion to handle annotations argoproj/argo-workflows#1177)

• Issue Daemon step + artifacts don't update workflow metadata argoproj/argo-workflows#1113 - Wait for daemon pods completion to handle annotations

• Add output artifacts to influxdb-ci example

• Increased S3 artifact retry time and added log (#1081 increased time and added log argoproj/argo-workflows#1138)

• Issue Resource Template: 'get' action fails, resource not found argoproj/argo-workflows#1123 - Fix 'kubectl get' failure if resource namespace is different from workflow namespace (Issue #1123 - Fix 'kubectl get' failure if resource namespace is different from workflow namespace argoproj/argo-workflows#1171)

• Refactor Makefile/Dockerfile to remove volume binding in favor of build stages (Refactor Makefile/Dockerfile to remove volume binding in favor of build stages argoproj/argo-workflows#1189)

• Add Docker Hub build hooks

• Add documentation how to use parameter-file's (Add documentation how to use parameter-file's argoproj/argo-workflows#1191)

• Issue argo submit --wait writes errors to STDOUT instead of STDERR. argoproj/argo-workflows#988 - Submit should not print logs to stdout unless output is 'wide' (Issue #988 - Submit should not print logs to stdout unless output is 'wide' argoproj/argo-workflows#1192)

• Fix missing docker binary in argoexec image. Improve reuse of image layers

• Fischerjulian adds ruby to rest docs (Fischerjulian adds ruby to rest docs argoproj/argo-workflows#1196)

• Adds link to ruby kubernetes library.

• Links to a ruby example on how to start a workflow

• Updated OWNERS (Updated OWNERS argoproj/argo-workflows#1198)

• Update community/README (Update community/README argoproj/argo-workflows#1197)

• Issue Running workflow results in wait container "no space left on device" argoproj/argo-workflows#1128 - Use polling instead of fs notify to get annotation changes (Issue #1128 - Use polling instead of fs notify to get annotation changes argoproj/argo-workflows#1194)

• Minor spelling, formatting, and style updates. (Minor spelling, formatting, and style updates. argoproj/argo-workflows#1193)

• Dockerfile: argoexec base image correction (fixes Image argoexec is being built without docker and kubectl argoproj/argo-workflows#1209) (Dockerfile: argoexec base image correction (fixes #1209) argoproj/argo-workflows#1213)

• Set executor image pull policy for resource template (Set executor image pull policy for resource templates argoproj/argo-workflows#1174)

• Add schedulerName to workflow and template spec (add schedulerName argoproj/argo-workflows#1184)

• Issue Dag workflow will stay running forever in some long run situation. argoproj/argo-workflows#1190 - Fix incorrect retry node handling (Issue #1190 - Fix incorrect retry node handling argoproj/argo-workflows#1208)

• fix dag retries (minor fix: access dag phase with retries argoproj/argo-workflows#1221)

• Executor can access the k8s apiserver with a out-of-cluster config file (Executor can access the k8s apiserver with a out-of-cluster config file argoproj/argo-workflows#1134)

Executor can access the k8s apiserver with a out-of-cluster config file

• Update README with typo fixes (Update README with typo fixes argoproj/argo-workflows#1220)

• Update README.md (Update README.md argoproj/argo-workflows#1236)

• Remove extra quotes around output parameter value (Remove extra quotes around output parameter value argoproj/argo-workflows#1232)

Ensure we do not insert extra single quotes when using
valueFrom: jsonPath to set the value of an output parameter for
resource templates.

Signed-off-by: Ilias Katsakioris [email protected]

• Update README.md (Update README.md argoproj/argo-workflows#1224)

• Include stderr when retrieving docker logs (Include stderr when retrieving docker logs argoproj/argo-workflows#1225)

• Add Gardener to "Who uses Argo" (Add Gardener to "Who uses Argo" argoproj/argo-workflows#1228)

• Add feature to continue workflow on failed/error steps/tasks (Add ignoreError feature to dag task argoproj/argo-workflows#1205)

• Fix the Prometheus address references (Fix the Prometheus address references argoproj/argo-workflows#1237)

• Fixed Issue#1223 Kubernetes Resource action: patch is not supported (Fixed Issue#1223 Kubernetes Resource action: patch is not supported argoproj/argo-workflows#1245)

• Fixed Issue#1223 Kubernetes Resource action: patch is not supported

This PR is fixed the Issue#1223 reported by @shanesiebken . Argo kubernetes resource workflow failed on patch action. --patch or -p option is required for kubectl patch action.
This PR is including the manifest yaml as patch argument for kubectl. This Fix will support the Patch action in Argo kubernetes resource workflow.

This Fix will support only JSON merge strategic in patch action

• udpated formating

• typo, executo -> executor (typo, executo -> executor argoproj/argo-workflows#1243)

• Issue#1165 fake outputs don't notify and task completes successfully (Issue#1165 fake outputs don't notify and task completes successfully argoproj/argo-workflows#1247)

• Issue#1165 fake outputs don't notify and task completes successfully

This PR is addressing the Issue#1165 reported by @alexfrieden.

Issue/Bug: Argo is finishing the task successfully even artifact /file does exist.

Fix: Validate the created gzip contains artifact or file. if file/artifact doesn't exist, Current step/stage/task will be failed with log message .

Sample Log:
'''
INFO[0029] Updating node artifact-passing-lkvj8[0].generate-artifact (artifact-passing-lkvj8-1949982165) status Running -> Error
INFO[0029] Updating node artifact-passing-lkvj8[0].generate-artifact (artifact-passing-lkvj8-1949982165) message: failed to save outputs: File or Artifact does not exist. /tmp/hello_world.txt
INFO[0029] Step group node artifact-passing-lkvj8[0] (artifact-passing-lkvj8-1067333159) deemed failed: child 'artifact-passing-lkvj8-1949982165' failed namespace=default workflow=artifact-passing-lkvj8
INFO[0029] node artifact-passing-lkvj8[0] (artifact-passing-lkvj8-1067333159) phase Running -> Failed namespace=default workflow=artifact-passing-lkvj8
'''

• fixed gometalinter errcheck issue

• Git cloning via SSH was not verifying host public key (Git cloning via SSH was not verifying host public key argoproj/argo-workflows#1261)

• Update versions (Update versions argoproj/argo-workflows#1218)

• Proxy Priority and PriorityClassName to pods (Support Priority Fields in Workflow Pods argoproj/argo-workflows#1179)

• Error running 1000s of tasks: "etcdserver: request is too large" Error running 1000s of tasks: "etcdserver: request is too large" argoproj/argo-workflows#1186 (Error running 1000s of tasks: "etcdserver: request is too large" #1186 argoproj/argo-workflows#1264)

• Error running 1000s of tasks: "etcdserver: request is too large" Error running 1000s of tasks: "etcdserver: request is too large" argoproj/argo-workflows#1186

This PR is addressing the feature request argoproj#1186.
Issue:
Nodestatus element keeps growing for big workflow. Workflow will fail once the workflow total size reachs 1 MB (maz size limit in ETCD) .
Solution:
Compressing the Nodestatus once size reachs the 1 MB which increasing 60% to 80% more steps to execute in compress mode.

Latest: Argo cli and Argo UI will able to decode and print nodestatus from compressednoode.

Limitation:
Kubectl willl not decode the compressedNode element

• added Operator.go

• revert the testing yaml

• Fixed the lint issue

• fixed

• fixed lint

• Fixed Testcase

• incorporated the review comments

• Reverted the change

• incorporated review comments

• fixing gometalinter checks

• incorporated review comments

• Update pod-limits.yaml

• updated few comments

• updated error message format

• reverted unwanted files

• Reduce redundancy pod label action (Reduce redundancy pod label action argoproj/argo-workflows#1271)

• Add the mergeStrategy option to resource patching (Add the mergeStrategy option to resource patching argoproj/argo-workflows#1269)

• This adds the ability to pass a mergeStrategy to a patch resource.
  this is valuable because the default merge strategy for kubernetes is
  'strategic', which does not work with Custom Resources.

• This also updates the resource example to demonstrate how it is used

• Fix bug with DockerExecutor's CopyFile (Fix bug with DockerExecutor's CopyFile argoproj/argo-workflows#1275)

The check to see if the source path was in the tgz archive was wrong
when source path was a folder, the arguments to strings.Contains were
inverted.

• Add workflow labels and annotations global vars (Add workflow labels and annotations global vars argoproj/argo-workflows#1280)

• Argo CI is current inactive (Argo CI is currently inactive argoproj/argo-workflows#1285)

• Issue#896 Workflow steps with non-existant output artifact path will succeed (Issue#896 Workflow steps with non-existant output artifact path will succeed argoproj/argo-workflows#1277)

• Issue#896 Workflow steps with non-existant output artifact path will succeed

Issue: argoproj#897
Solution: Added new element "optional" in Artifact. The default is false. This flag will make artifact as optional and existence check will be ignored if input/output artifact has optional=true.

Output Artifact ( optional=true ):
Artifact existence check will be ignored during the save artifact in destination and continued workflow

Input Artifact ( optional=true ):
Artifact exist check will be ignored during load artifact from source and continued workflow

• added end of line

• removed unwanted whitespace

• Deleted test code

• go formatted

• added formatting directives

• updated Codegen

• Fixed format on merge conflict

• format fix

• updated comments

• improved error case

• Fix for Resource creation where template has same parameter templating (Fix for Resource creation where template has same parameter templating argoproj/argo-workflows#1283)

• Fix for Resource creation where template has same parameter templating

This PR will enable to support the custom template variable reference.
Soulltion: Workflow variable reference resolve will check the Workflow variable prefix.

• added test

• fixed gofmt issue

• fixed format

• fixed gofmt on common.go

• fixed testcase

• fixed gofmt

• Added unit testcase and documented

• fixed Gofmt format

• updated comments

• Admiralty: add link to blog post, add user (Admiralty: add link to blog post, add user argoproj/argo-workflows#1295)

• Add dns config support (Add dns config support argoproj/argo-workflows#1301)

• Speed up podReconciliation using parallel goroutine (Speed up podReconciliation using parallel goroutine argoproj/argo-workflows#1286)

• Speed up podReconciliation using parallel goroutine

• Fix make lint issue

• put checkandcompress back

• Add community meeting notes link (Add community meeting notes link argoproj/argo-workflows#1304)

• Add Karius to users in README.md (Add Karius to users in README.md argoproj/argo-workflows#1305)

• Added support for artifact path references (Added support for artifact path references argoproj/argo-workflows#1300)

• Added support for artifact path references
  Adds new {{inputs.artifacts.<NAME>.path}} and {{outputs.artifacts.<NAME>.path}} placeholders.

• Add support for init containers (Add init containers argoproj/argo-workflows#1183)

• Secrets should be passed to pods using volumes instead of API calls (Secrets should be passed to pods using volumes instead of API calls argoproj/argo-workflows#1302)

• Secrets should be passed to pods using downward API instead of API calls

• Fixed Gogfmt format

• fixed file close Gofmt

• updated review comments

• fixed gofmt

• updated review comments

• CheckandEstimate implementation to optimize podReconciliation (CheckandEstimate implementation to optimize podReconciliation argoproj/argo-workflows#1308)

• CheckandEstimate implementation

• fixed variable rename

• fixed gofmt

• fixed feedbacks

• Update operator.go

• Update operator.go

• Add alibaba cloud to officially using argo list (Add alibaba cloud to officially using argo list argoproj/argo-workflows#1313)

• Refactor checkandEstimate to optimize podReconciliation (Refactor checkandEstimate to optimize podReconciliation argoproj/argo-workflows#1311)

• Refactor checkandEstimate to optimize podReconciliation

• Move compress function to persistUpdates

• Fix formatting issues in examples documentation (Fix formatting issues in examples documentation argoproj/argo-workflows#1310)

• Fix nil pointer dereference with secret volumes (Fix nil pointer dereference with secret volumes argoproj/argo-workflows#1314)

• Archive location should conditionally be added to template only when needed

• Fix SIGSEGV in watch/CheckAndDecompress. Consolidate duplicate code (resolves Watching workflow can SIGSEGV in CheckAndDecompress() argoproj/argo-workflows#1315)

• Implement support for PNS (Process Namespace Sharing) executor (Implement support for PNS (Process Namespace Sharing) executor argoproj/argo-workflows#1214)

• Implements PNS (Process Namespace Sharing) executor

• Adds limited support for Kubelet/K8s API artifact collection by mirroring volume mounts to wait sidecar

• Adds validation to detect when output artifacts are not supported by the executor

• Adds ability to customize executor from workflow-controller-configmap (e.g. add environment variables, append command line args such as loglevel)

• Fixes an issue where daemon steps were not getting terminated properly

• Reorganize manifests to kustomize 2 and update version to v2.3.0-rc1

• Update v2.3.0 CHANGELOG.md

• Export the methods of KubernetesClientInterface (Export the methods of KubernetesClientInterface argoproj/argo-workflows#1294)

All calls to these methods previously generated a panic at runtime
because the calls resolved to the default, panic-always implementation,
not to the overrides provided by k8sAPIClient and kubeletClient.

Embedding an exported interface with unexported methods into a struct is
the only way to implement that interface in another package. When doing
this, the compiler generates default, panic-always implementations for
all methods from the interface. Implementors can override exported
methods, but it's not possible to override an unexported method from the
interface. All invocations that go through the interface will come to
the default implementation, even if the struct tries to provide an
override.

• Update README.md (Update community/README.md argoproj/argo-workflows#1321)

• Issue1316 Pod creation with secret volumemount (Issue1316 Pod creation with secret volumemount  argoproj/argo-workflows#1318)

• CheckandEstimate implementation

• fixed variable rename

• fixed gofmt

• fixed feedbacks

• Fixed the duplicate mountpath issue

• Support parameter substitution in the volumes attribute (Support parameter substitution in the volumes attribute argoproj/argo-workflows#1238)

• argo list was not displaying non-zero priorities correctly

• Fix regression where argoexec wait would not return when podname was too long

• wait will conditionally become privileged if main/sidecar privileged (resolves PNS executor needs conditional privileged permissions for killing privileged sidecars argoproj/argo-workflows#1323)

• Update version to v2.3.0-rc2. Update changelog

• Add documentation on releasing

• use a secret selector for getting credentials

• fixing build issues

• linter issues

• fixing jenkinsfile(?)

• jenkins

• jenkins

• jenkins

• jenkins

• jenkins?

• jenkins :(

• jenkins :(

• jenkins

• jenkins

• jenkins

• jenkins

• gopkg

• use GetSecretFromVolMount instead of GetSecrets

• actually build argoexec

• Fix 2.3.0-rc2 withParams and withItems inflation is shifted argoproj/argo-workflows#1340 parameter substitution bug

Signed-off-by: Ilias Katsakioris [email protected]