Skip to content
This repository has been archived by the owner on Nov 1, 2022. It is now read-only.

DuplicateKeyError provides no indication of the problematic YAML #1803

Closed
montyz opened this issue Mar 7, 2019 · 4 comments
Closed

DuplicateKeyError provides no indication of the problematic YAML #1803

montyz opened this issue Mar 7, 2019 · 4 comments
Labels
size/small UX In pursuit of a delightful user experience

Comments

@montyz
Copy link
Contributor

montyz commented Mar 7, 2019

This seemed to prevent a pod from updating when a new version appeared on docker. It had worked many times before.

ts=2019-03-07T18:54:37.316303579Z caller=loop.go:118 component=sync-loop jobID=2a259961-1f2b-9c01-fb49-8a773ef025f7 state=done success=false err="applying changes: Traceback (most recent call last):
  File \"kubeyaml.py\", line 226, in <module>
  File \"kubeyaml.py\", line 221, in main
  File \"kubeyaml.py\", line 53, in apply_to_yaml
  File \"kubeyaml.py\", line 59, in update_image
  File \"site-packages/ruamel/yaml/main.py\", line 363, in load_all
  File \"site-packages/ruamel/yaml/constructor.py\", line 101, in get_data
  File \"site-packages/ruamel/yaml/constructor.py\", line 118, in construct_document
  File \"site-packages/ruamel/yaml/constructor.py\", line 1508, in construct_yaml_map
  File \"site-packages/ruamel/yaml/constructor.py\", line 1414, in construct_mapping
  File \"site-packages/ruamel/yaml/constructor.py\", line 279, in check_mapping_key
ruamel.yaml.constructor.DuplicateKeyError: while constructing a mapping
  in \"<stdin>\", line 5, column 3
found duplicate key \"annotations\" with value \"ordereddict([])\" (original value: \"None\")
  in \"<stdin>\", line 8, column 3

To suppress this check see:
    http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys

Duplicate keys will become an error in future releases, and are errors
by default when using the new API.

Failed to execute script kubeyaml"

Here is a longer section of the logs for reference:

ts=2019-03-07T18:54:30.565309315Z caller=loop.go:118 component=sync-loop jobID=f0e24638-82e2-9b27-d8f7-3d88292f98b4 state=done success=false err="applying changes: Traceback (most recent call last):\n  File \"kubeyaml.py\", line 226, in <module>\n  File \"kubeyaml.py\", line 221, in main\n  File \"kubeyaml.py\", line 53, in apply_to_yaml\n  File \"kubeyaml.py\", line 59, in update_image\n  File \"site-packages/ruamel/yaml/main.py\", line 363, in load_all\n  File \"site-packages/ruamel/yaml/constructor.py\", line 101, in get_data\n  File \"site-packages/ruamel/yaml/constructor.py\", line 118, in construct_document\n  File \"site-packages/ruamel/yaml/constructor.py\", line 1508, in construct_yaml_map\n  File \"site-packages/ruamel/yaml/constructor.py\", line 1414, in construct_mapping\n  File \"site-packages/ruamel/yaml/constructor.py\", line 279, in check_mapping_key\nruamel.yaml.constructor.DuplicateKeyError: while constructing a mapping\n  in \"<stdin>\", line 5, column 3\nfound duplicate key \"annotations\" with value \"ordereddict([])\" (original value: \"None\")\n  in \"<stdin>\", line 8, column 3\n\nTo suppress this check see:\n    http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys\n\nDuplicate keys will become an error in future releases, and are errors\nby default when using the new API.\n\nFailed to execute script kubeyaml"
ts=2019-03-07T18:54:30.565375073Z caller=images.go:17 component=sync-loop msg="polling images"
ts=2019-03-07T18:54:32.758670442Z caller=images.go:79 component=sync-loop service=yoni:deployment/yoni-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:32.758817356Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:32.758961102Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:32.760081456Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:32.761410354Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:32.762478074Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:32.765707237Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:32.765916869Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:32.767754937Z caller=images.go:75 component=sync-loop service=mz-hotfix:deployment/mz-hotfix-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:latest warning="current image not in filtered images" action="proceed anyway"
ts=2019-03-07T18:54:32.767789646Z caller=images.go:79 component=sync-loop service=mz-hotfix:deployment/mz-hotfix-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:latest info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current latest (filtered out or missing)"
ts=2019-03-07T18:54:32.768775718Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:32.770424973Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:32.770462095Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:32.770598255Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:32.771596072Z caller=images.go:79 component=sync-loop service=yoni:deployment/yoni-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:32.77237189Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:32.773617701Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:32.773890065Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:32.77408002Z caller=images.go:79 component=sync-loop service=admin:deployment/mysql-util container=mysql-util repo=index.docker.io/larktech/mysql-utilities pattern=glob:master-* current=index.docker.io/larktech/mysql-utilities:master-b5edbd6b info="added update to automation run" new=index.docker.io/larktech/mysql-utilities:master-6d0c5e54 reason="latest master-6d0c5e54 (2019-03-07 18:48:18.537758767 +0000 UTC) > current master-b5edbd6b (2019-02-28 21:28:32.497371521 +0000 UTC)"
ts=2019-03-07T18:54:32.774361649Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:32.776595202Z caller=loop.go:100 component=sync-loop event=refreshed [email protected]:larktech/dev8a-cluster branch=master HEAD=a09906fd35192c5ea5dc9da675ea2983d1cf21a3
ts=2019-03-07T18:54:32.776628563Z caller=loop.go:108 component=sync-loop jobID=5444151a-60a9-4c60-1fef-7618b713406e state=in-progress
ts=2019-03-07T18:54:33.163942323Z caller=releaser.go:58 component=sync-loop jobID=5444151a-60a9-4c60-1fef-7618b713406e type=release updates=19
ts=2019-03-07T18:54:34.282772563Z caller=loop.go:118 component=sync-loop jobID=5444151a-60a9-4c60-1fef-7618b713406e state=done success=false err="applying changes: Traceback (most recent call last):\n  File \"kubeyaml.py\", line 226, in <module>\n  File \"kubeyaml.py\", line 221, in main\n  File \"kubeyaml.py\", line 53, in apply_to_yaml\n  File \"kubeyaml.py\", line 59, in update_image\n  File \"site-packages/ruamel/yaml/main.py\", line 363, in load_all\n  File \"site-packages/ruamel/yaml/constructor.py\", line 101, in get_data\n  File \"site-packages/ruamel/yaml/constructor.py\", line 118, in construct_document\n  File \"site-packages/ruamel/yaml/constructor.py\", line 1508, in construct_yaml_map\n  File \"site-packages/ruamel/yaml/constructor.py\", line 1414, in construct_mapping\n  File \"site-packages/ruamel/yaml/constructor.py\", line 279, in check_mapping_key\nruamel.yaml.constructor.DuplicateKeyError: while constructing a mapping\n  in \"<stdin>\", line 5, column 3\nfound duplicate key \"annotations\" with value \"ordereddict([])\" (original value: \"None\")\n  in \"<stdin>\", line 8, column 3\n\nTo suppress this check see:\n    http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys\n\nDuplicate keys will become an error in future releases, and are errors\nby default when using the new API.\n\nFailed to execute script kubeyaml"
ts=2019-03-07T18:54:34.282838197Z caller=images.go:17 component=sync-loop msg="polling images"
ts=2019-03-07T18:54:35.743257588Z caller=images.go:79 component=sync-loop service=admin:deployment/mysql-util container=mysql-util repo=index.docker.io/larktech/mysql-utilities pattern=glob:master-* current=index.docker.io/larktech/mysql-utilities:master-b5edbd6b info="added update to automation run" new=index.docker.io/larktech/mysql-utilities:master-6d0c5e54 reason="latest master-6d0c5e54 (2019-03-07 18:48:18.537758767 +0000 UTC) > current master-b5edbd6b (2019-02-28 21:28:32.497371521 +0000 UTC)"
ts=2019-03-07T18:54:35.743512064Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:35.744006078Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:35.74404207Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:35.744263076Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:35.745568496Z caller=images.go:75 component=sync-loop service=mz-hotfix:deployment/mz-hotfix-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:latest warning="current image not in filtered images" action="proceed anyway"
ts=2019-03-07T18:54:35.745603699Z caller=images.go:79 component=sync-loop service=mz-hotfix:deployment/mz-hotfix-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:latest info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current latest (filtered out or missing)"
ts=2019-03-07T18:54:35.746853901Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:35.748417001Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:35.749801206Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:35.749916244Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:35.750373786Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:35.751592521Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:35.752575304Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:35.753668257Z caller=images.go:79 component=sync-loop service=yoni:deployment/yoni-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:35.753942798Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:35.755516222Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T18:54:35.755739697Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:35.755834523Z caller=images.go:79 component=sync-loop service=yoni:deployment/yoni-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T18:54:35.755954442Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T18:54:35.756435282Z caller=loop.go:108 component=sync-loop jobID=2a259961-1f2b-9c01-fb49-8a773ef025f7 state=in-progress
ts=2019-03-07T18:54:36.130192689Z caller=releaser.go:58 component=sync-loop jobID=2a259961-1f2b-9c01-fb49-8a773ef025f7 type=release updates=19
ts=2019-03-07T18:54:37.316303579Z caller=loop.go:118 component=sync-loop jobID=2a259961-1f2b-9c01-fb49-8a773ef025f7 state=done success=false err="applying changes: Traceback (most recent call last):\n  File \"kubeyaml.py\", line 226, in <module>\n  File \"kubeyaml.py\", line 221, in main\n  File \"kubeyaml.py\", line 53, in apply_to_yaml\n  File \"kubeyaml.py\", line 59, in update_image\n  File \"site-packages/ruamel/yaml/main.py\", line 363, in load_all\n  File \"site-packages/ruamel/yaml/constructor.py\", line 101, in get_data\n  File \"site-packages/ruamel/yaml/constructor.py\", line 118, in construct_document\n  File \"site-packages/ruamel/yaml/constructor.py\", line 1508, in construct_yaml_map\n  File \"site-packages/ruamel/yaml/constructor.py\", line 1414, in construct_mapping\n  File \"site-packages/ruamel/yaml/constructor.py\", line 279, in check_mapping_key\nruamel.yaml.constructor.DuplicateKeyError: while constructing a mapping\n  in \"<stdin>\", line 5, column 3\nfound duplicate key \"annotations\" with value \"ordereddict([])\" (original value: \"None\")\n  in \"<stdin>\", line 8, column 3\n\nTo suppress this check see:\n    http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys\n\nDuplicate keys will become an error in future releases, and are errors\nby default when using the new API.\n\nFailed to execute script kubeyaml"
ts=2019-03-07T18:54:37.317406983Z caller=loop.go:100 component=sync-loop event=refreshed [email protected]:larktech/dev8a-cluster branch=master HEAD=a09906fd35192c5ea5dc9da675ea2983d1cf21a3
ts=2019-03-07T18:54:41.917846699Z caller=loop.go:100 component=sync-loop event=refreshed [email protected]:larktech/dev8a-cluster branch=master HEAD=a09906fd35192c5ea5dc9da675ea2983d1cf21a3
ts=2019-03-07T18:54:47.127733865Z caller=loop.go:100 component=sync-loop event=refreshed [email protected]:larktech/dev8a-cluster branch=master HEAD=a09906fd35192c5ea5dc9da675ea2983d1cf21a3
@montyz
Copy link
Contributor Author

montyz commented Mar 7, 2019

I was on 1.9.0, I upgrated to 1.10.1 and still have the issue on restart.

ts=2019-03-07T19:03:42.149709528Z caller=main.go:156 version=1.10.1
ts=2019-03-07T19:03:42.167755551Z caller=main.go:247 component=cluster identity=/etc/fluxd/ssh/identity
ts=2019-03-07T19:03:42.167798994Z caller=main.go:248 component=cluster identity.pub="ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0XkebvjCUUJ0EeLUwK/hBFOZ4YHKans9uVoKDEXB8qU6POEqHKbLLGdsRzMA7JQgByrCJaeXzu36eVhDH3oWvQ5QguNflu2W+BKFDY0xuUD03MSDSKBUR0DsFFZFUWhPES65R3VpZ97BzVJAptKL79Cx2JrtjmBAPQygepzK2GIrCTBem/RUvZXCb6uGjBjsVoqqw5VjmQWckZQA/zL2My9/temuWtJgcbfQJpTm2pFaP57rcvtYOggI431lapboGuQQWcCyP7X31COsb8Lx+9yxWHOPVNI/CCkrj4W5NOvgrA6SebuL0HvoAa0oEjVrY0WPQQvYzVLXZv4m1QM3Z"
ts=2019-03-07T19:03:42.167824609Z caller=main.go:249 component=cluster host=https://100.64.0.1:443 version=kubernetes-v1.10.9
ts=2019-03-07T19:03:42.167874069Z caller=main.go:261 component=cluster kubectl=/usr/local/bin/kubectl
ts=2019-03-07T19:03:42.168606652Z caller=main.go:269 component=cluster ping=true
ts=2019-03-07T19:03:42.169608203Z caller=aws.go:74 component=aws info="detected cluster region" region=us-east-1
ts=2019-03-07T19:03:42.169689163Z caller=aws.go:78 component=aws info="restricting ECR registry scans" regions=us-east-1 include-ids= exclude-ids=602401143452
ts=2019-03-07T19:03:42.17368456Z caller=main.go:417 [email protected]:larktech/dev8a-cluster user="Weave Flux" [email protected] sync-tag=flux-sync notes-ref=flux set-author=false
ts=2019-03-07T19:03:42.173748541Z caller=main.go:452 component=upstream URL=ws://127.0.0.1:3031
ts=2019-03-07T19:03:42.174661028Z caller=main.go:501 metrics-addr=:3032
ts=2019-03-07T19:03:42.174841017Z caller=upstream.go:128 component=upstream connecting=true
ts=2019-03-07T19:03:42.174699504Z caller=images.go:17 component=sync-loop msg="polling images"
ts=2019-03-07T19:03:42.175154681Z caller=images.go:27 component=sync-loop msg="no automated services"
ts=2019-03-07T19:03:42.175279875Z caller=loop.go:92 component=sync-loop err="git repo not ready: git repo has not been cloned yet"
ts=2019-03-07T19:03:42.175593192Z caller=upstream.go:113 component=upstream err="executing websocket ws://127.0.0.1:3031/v10/daemon: dial tcp 127.0.0.1:3031: connect: connection refused"
ts=2019-03-07T19:03:42.176569131Z caller=main.go:493 addr=:3030
ts=2019-03-07T19:03:42.680725786Z caller=checkpoint.go:24 component=checkpoint msg="up to date" latest=1.9.0
ts=2019-03-07T19:03:43.744925172Z caller=loop.go:105 component=sync-loop event=refreshed [email protected]:larktech/dev8a-cluster branch=master HEAD=a09906fd35192c5ea5dc9da675ea2983d1cf21a3
ts=2019-03-07T19:03:47.175838048Z caller=upstream.go:128 component=upstream connecting=true
ts=2019-03-07T19:03:47.179173029Z caller=upstream.go:142 component=upstream connected=true
ts=2019-03-07T19:03:48.049728506Z caller=sync.go:122 component=cluster method=Sync cmd=apply args= count=840
ts=2019-03-07T19:03:48.234297584Z caller=images.go:148 component=cluster resource=sftp:deployment/sftp err="getting secret \"myregistrykey\" from namespace \"sftp\": secrets \"myregistrykey\" not found"
ts=2019-03-07T19:03:52.337155801Z caller=sync.go:184 component=cluster method=Sync cmd="kubectl apply -f -" took=4.286725011s err=null output="namespace/admin configured\nnamespace/centralized-login configured\nnamespace/charlie configured\nnamespace/datadog-example configured\nnamespace/editormaster configured\nnamespace/hotfix configured\nnamespace/keryn configured\nnamespace/loadtest configured\nnamespace/marisa configured\nnamespace/mongo configured\nnamespace/mz-hotfix configured\nnamespace/partner configured\nnamespace/perftest configured\nnamespace/private-ingress configured\nnamespace/public-ingress configured\nnamespace/qa configured\nnamespace/sftp configured\nnamespace/testing configured\nnamespace/testlink configured\nnamespace/yoni configured\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/birdfood unchanged\nservice/centralized-login unchanged\nservice/charlie-sftp unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/dashboards unchanged\nservice/default-http-backend unchanged\nservice/default-http-backend unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/device-ordering unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/editor-git-content unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/food unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/functester unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/goldfinch unchanged\nservice/hotfix-sftp unchanged\nservice/ingress-nginx unchanged\nservice/ingress-nginx unchanged\nservice/k8s-mon unchanged\nservice/k8s-mon-links unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-healthpartners unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-highmark unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-non-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-pii unchanged\nservice/larksettings-prohealth unchanged\nservice/larksettings-prohealth unchanged\nservice/larksettings-prohealth unchanged\nservice/larksettings-prohealth unchanged\nservice/larksettings-prohealth unchanged\nservice/loadtest-sftp unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/log4j unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logs unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/logtail unchanged\nservice/marisa-sftp unchanged\nservice/mongo-express unchanged\nservice/mongo-external unchanged\nservice/mysql-util unchanged\nservice/mz-hotfix-sftp unchanged\nrole.rbac.authorization.k8s.io/nginx-ingress-role unchanged\nrole.rbac.authorization.k8s.io/nginx-ingress-role unchanged\nserviceaccount/nginx-ingress-serviceaccount unchanged\nserviceaccount/nginx-ingress-serviceaccount unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/nodebuckets unchanged\nservice/oauthtokenmanager unchanged\nservice/oauthtokenmanager unchanged\nservice/oauthtokenmanager unchanged\nservice/partner-sftp unchanged\nservice/perftest unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nservice/planpusher unchanged\nclusterrole.rbac.authorization.k8s.io/private-ingress-nginx-ingress-clusterrole configured\nclusterrole.rbac.authorization.k8s.io/public-ingress-nginx-ingress-clusterrole configured\npersistentvolume/pv-a configured\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/pwd-reset unchanged\nservice/qa-sftp unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/robin2 unchanged\nservice/sftp unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/sleep unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/solera-tool unchanged\nservice/testing-sftp unchanged\nservice/triggers unchanged\nservice/triggers unchanged\nservice/triggers unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\nservice/user-support-tools unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/birdfood unchanged\ningress.extensions/centralized-login unchanged\npersistentvolumeclaim/charlie-logs-claim unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\ningress.extensions/dashboards unchanged\npersistentvolumeclaim/datadog-example-claim unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\ningress.extensions/device-ordering unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\npersistentvolumeclaim/editor-claim unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\ningress.extensions/editor-git-content unchanged\npersistentvolumeclaim/editormaster-logs-claim unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/food unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/functester unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\ningress.extensions/goldfinch unchanged\npersistentvolumeclaim/hotfix-logs-claim unchanged\ningress.extensions/k8s-mon unchanged\npersistentvolumeclaim/keryn-logs-claim unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-healthpartners unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-highmark unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-non-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-pii unchanged\ningress.extensions/larksettings-prohealth unchanged\ningress.extensions/larksettings-prohealth unchanged\ningress.extensions/larksettings-prohealth unchanged\ningress.extensions/larksettings-prohealth unchanged\ningress.extensions/larksettings-prohealth unchanged\npersistentvolumeclaim/loadtest-logs-claim unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logs unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\ningress.extensions/logtail unchanged\npersistentvolumeclaim/marisa-logs-claim unchanged\ningress.extensions/mongo-express unchanged\npersistentvolumeclaim/mongo-mongodb-replicaset-0 unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\nsecret/myregistrykey unchanged\ningress.extensions/mysql-util unchanged\npersistentvolumeclaim/mysql-util-claim unchanged\npersistentvolumeclaim/mz-hotfix-logs-claim unchanged\nconfigmap/nginx-configuration unchanged\nconfigmap/nginx-configuration unchanged\nrolebinding.rbac.authorization.k8s.io/nginx-ingress-role-nisa-binding unchanged\nrolebinding.rbac.authorization.k8s.io/nginx-ingress-role-nisa-binding unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/nodebuckets unchanged\ningress.extensions/oauthtokenmanager unchanged\ningress.extensions/oauthtokenmanager unchanged\ningress.extensions/oauthtokenmanager unchanged\npersistentvolumeclaim/partner-logs-claim unchanged\ningress.extensions/perftest unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\ningress.extensions/planpusher unchanged\nclusterrolebinding.rbac.authorization.k8s.io/private-ingress-nginx-ingress-clusterrole-nisa-binding configured\nclusterrolebinding.rbac.authorization.k8s.io/public-ingress-nginx-ingress-clusterrole-nisa-binding configured\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\ningress.extensions/pwd-reset unchanged\npersistentvolumeclaim/qa-logs-claim unchanged\npersistentvolumeclaim/reporting-claim unchanged\npersistentvolumeclaim/reporting-claim unchanged\npersistentvolumeclaim/reporting-claim unchanged\npersistentvolumeclaim/reporting-claim unchanged\npersistentvolumeclaim/reporting-claim unchanged\npersistentvolumeclaim/reporting-claim unchanged\npersistentvolumeclaim/reporting-claim unchanged\npersistentvolumeclaim/reporting-claim unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\ningress.extensions/robin2 unchanged\npersistentvolumeclaim/secrets-claim unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/sleep unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\ningress.extensions/solera-tool unchanged\nconfigmap/tcp-services unchanged\nconfigmap/tcp-services unchanged\npersistentvolumeclaim/testing-logs-claim unchanged\ningress.extensions/testlink unchanged\ningress.extensions/triggers unchanged\ningress.extensions/triggers unchanged\ningress.extensions/triggers unchanged\nconfigmap/udp-services unchanged\nconfigmap/udp-services unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\ningress.extensions/user-support-tools unchanged\npersistentvolumeclaim/yoni-logs-claim unchanged\ndeployment.extensions/centralized-login-centralized-login unchanged\ndeployment.extensions/charlie-birdfood configured\ndeployment.extensions/charlie-dashboards unchanged\ndeployment.extensions/charlie-device-ordering unchanged\ndeployment.extensions/charlie-editor-git-content configured\ndeployment.extensions/charlie-food unchanged\ndeployment.extensions/charlie-functester unchanged\ndeployment.extensions/charlie-goldfinch configured\ndeployment.extensions/charlie-larksettings-healthpartners unchanged\ndeployment.extensions/charlie-larksettings-highmark unchanged\ndeployment.extensions/charlie-larksettings-non-pii unchanged\ndeployment.extensions/charlie-larksettings-pii unchanged\ndeployment.extensions/charlie-log4j unchanged\ndeployment.extensions/charlie-nodebuckets configured\ndeployment.extensions/charlie-planpusher configured\ndeployment.extensions/charlie-pwd-reset unchanged\ndeployment.extensions/charlie-reporting configured\ndeployment.extensions/charlie-robin2 configured\ndeployment.extensions/charlie-sftp unchanged\ndeployment.extensions/charlie-sleep configured\ndeployment.extensions/charlie-solera-tool configured\ndeployment.extensions/charlie-user-support-tools unchanged\ndeployment.extensions/datadog-example unchanged\ndeployment.extensions/default-http-backend unchanged\ndeployment.extensions/default-http-backend unchanged\ndeployment.extensions/editormaster-birdfood configured\ndeployment.extensions/editormaster-dashboards unchanged\ndeployment.extensions/editormaster-device-ordering unchanged\ndeployment.extensions/editormaster-editor-git-content configured\ndeployment.extensions/editormaster-food unchanged\ndeployment.extensions/editormaster-functester unchanged\ndeployment.extensions/editormaster-goldfinch configured\ndeployment.extensions/editormaster-larksettings-healthpartners unchanged\ndeployment.extensions/editormaster-larksettings-highmark unchanged\ndeployment.extensions/editormaster-larksettings-non-pii unchanged\ndeployment.extensions/editormaster-larksettings-pii unchanged\ndeployment.extensions/editormaster-log4j unchanged\ndeployment.extensions/editormaster-nodebuckets configured\ndeployment.extensions/editormaster-planpusher configured\ndeployment.extensions/editormaster-pwd-reset unchanged\ndeployment.extensions/editormaster-robin2 configured\ndeployment.extensions/editormaster-sleep configured\ndeployment.extensions/editormaster-solera-tool configured\ndeployment.extensions/editormaster-user-support-tools unchanged\ndeployment.extensions/hotfix-birdfood configured\ndeployment.extensions/hotfix-dashboards unchanged\ndeployment.extensions/hotfix-device-ordering unchanged\ndeployment.extensions/hotfix-editor-git-content configured\ndeployment.extensions/hotfix-food unchanged\ndeployment.extensions/hotfix-functester unchanged\ndeployment.extensions/hotfix-goldfinch configured\ndeployment.extensions/hotfix-larksettings-healthpartners unchanged\ndeployment.extensions/hotfix-larksettings-highmark unchanged\ndeployment.extensions/hotfix-larksettings-non-pii unchanged\ndeployment.extensions/hotfix-larksettings-pii unchanged\ndeployment.extensions/hotfix-larksettings-prohealth unchanged\ndeployment.extensions/hotfix-log4j unchanged\ndeployment.extensions/hotfix-nodebuckets configured\ndeployment.extensions/hotfix-planpusher configured\ndeployment.extensions/hotfix-pwd-reset unchanged\ndeployment.extensions/hotfix-reporting configured\ndeployment.extensions/hotfix-robin2 configured\ndeployment.extensions/hotfix-sftp unchanged\ndeployment.extensions/hotfix-sleep configured\ndeployment.extensions/hotfix-solera-tool configured\ndeployment.extensions/hotfix-user-support-tools unchanged\ndeployment.extensions/k8s-mon configured\ndeployment.extensions/keryn-birdfood configured\ndeployment.extensions/keryn-dashboards unchanged\ndeployment.extensions/keryn-device-ordering unchanged\ndeployment.extensions/keryn-editor-git-content configured\ndeployment.extensions/keryn-food unchanged\ndeployment.extensions/keryn-functester unchanged\ndeployment.extensions/keryn-goldfinch configured\ndeployment.extensions/keryn-larksettings-healthpartners unchanged\ndeployment.extensions/keryn-larksettings-highmark unchanged\ndeployment.extensions/keryn-larksettings-non-pii unchanged\ndeployment.extensions/keryn-larksettings-pii unchanged\ndeployment.extensions/keryn-log4j unchanged\ndeployment.extensions/keryn-nodebuckets configured\ndeployment.extensions/keryn-planpusher configured\ndeployment.extensions/keryn-pwd-reset unchanged\ndeployment.extensions/keryn-robin2 configured\ndeployment.extensions/keryn-sleep configured\ndeployment.extensions/keryn-solera-tool configured\ndeployment.extensions/keryn-user-support-tools unchanged\ndeployment.extensions/loadtest-birdfood configured\ndeployment.extensions/loadtest-dashboards unchanged\ndeployment.extensions/loadtest-device-ordering unchanged\ndeployment.extensions/loadtest-editor-git-content configured\ndeployment.extensions/loadtest-food unchanged\ndeployment.extensions/loadtest-functester unchanged\ndeployment.extensions/loadtest-goldfinch configured\ndeployment.extensions/loadtest-larksettings-healthpartners unchanged\ndeployment.extensions/loadtest-larksettings-highmark unchanged\ndeployment.extensions/loadtest-larksettings-non-pii unchanged\ndeployment.extensions/loadtest-larksettings-pii unchanged\ndeployment.extensions/loadtest-log4j unchanged\ndeployment.extensions/loadtest-nodebuckets configured\ndeployment.extensions/loadtest-planpusher configured\ndeployment.extensions/loadtest-pwd-reset unchanged\ndeployment.extensions/loadtest-reporting configured\ndeployment.extensions/loadtest-robin2 configured\ndeployment.extensions/loadtest-sftp unchanged\ndeployment.extensions/loadtest-sleep configured\ndeployment.extensions/loadtest-solera-tool configured\ndeployment.extensions/loadtest-user-support-tools unchanged\ndeployment.extensions/marisa-birdfood configured\ndeployment.extensions/marisa-dashboards unchanged\ndeployment.extensions/marisa-device-ordering unchanged\ndeployment.extensions/marisa-editor-git-content configured\ndeployment.extensions/marisa-food unchanged\ndeployment.extensions/marisa-functester unchanged\ndeployment.extensions/marisa-goldfinch configured\ndeployment.extensions/marisa-larksettings-healthpartners unchanged\ndeployment.extensions/marisa-larksettings-highmark unchanged\ndeployment.extensions/marisa-larksettings-non-pii unchanged\ndeployment.extensions/marisa-larksettings-pii unchanged\ndeployment.extensions/marisa-log4j unchanged\ndeployment.extensions/marisa-nodebuckets configured\ndeployment.extensions/marisa-planpusher configured\ndeployment.extensions/marisa-pwd-reset unchanged\ndeployment.extensions/marisa-reporting configured\ndeployment.extensions/marisa-robin2 configured\ndeployment.extensions/marisa-sftp unchanged\ndeployment.extensions/marisa-sleep configured\ndeployment.extensions/marisa-solera-tool configured\ndeployment.extensions/marisa-user-support-tools unchanged\ndeployment.extensions/mongo-express unchanged\ndeployment.extensions/mysql-util unchanged\ndeployment.extensions/mz-hotfix-birdfood configured\ndeployment.extensions/mz-hotfix-dashboards unchanged\ndeployment.extensions/mz-hotfix-device-ordering unchanged\ndeployment.extensions/mz-hotfix-editor-git-content configured\ndeployment.extensions/mz-hotfix-food unchanged\ndeployment.extensions/mz-hotfix-functester unchanged\ndeployment.extensions/mz-hotfix-goldfinch configured\ndeployment.extensions/mz-hotfix-larksettings-healthpartners unchanged\ndeployment.extensions/mz-hotfix-larksettings-highmark unchanged\ndeployment.extensions/mz-hotfix-larksettings-non-pii unchanged\ndeployment.extensions/mz-hotfix-larksettings-pii unchanged\ndeployment.extensions/mz-hotfix-larksettings-prohealth unchanged\ndeployment.extensions/mz-hotfix-log4j unchanged\ndeployment.extensions/mz-hotfix-nodebuckets configured\ndeployment.extensions/mz-hotfix-planpusher configured\ndeployment.extensions/mz-hotfix-pwd-reset unchanged\ndeployment.extensions/mz-hotfix-reporting configured\ndeployment.extensions/mz-hotfix-robin2 configured\ndeployment.extensions/mz-hotfix-sftp unchanged\ndeployment.extensions/mz-hotfix-sleep configured\ndeployment.extensions/mz-hotfix-solera-tool configured\ndeployment.extensions/mz-hotfix-user-support-tools unchanged\ndeployment.extensions/nginx-ingress-controller unchanged\ndeployment.extensions/nginx-ingress-controller unchanged\ndeployment.extensions/partner-birdfood configured\ndeployment.extensions/partner-dashboards unchanged\ndeployment.extensions/partner-device-ordering unchanged\ndeployment.extensions/partner-editor-git-content configured\ndeployment.extensions/partner-food unchanged\ndeployment.extensions/partner-functester unchanged\ndeployment.extensions/partner-goldfinch configured\ndeployment.extensions/partner-larksettings-healthpartners unchanged\ndeployment.extensions/partner-larksettings-highmark unchanged\ndeployment.extensions/partner-larksettings-non-pii unchanged\ndeployment.extensions/partner-larksettings-pii unchanged\ndeployment.extensions/partner-larksettings-prohealth unchanged\ndeployment.extensions/partner-log4j unchanged\ndeployment.extensions/partner-nodebuckets configured\ndeployment.extensions/partner-oauthtokenmanager configured\ndeployment.extensions/partner-planpusher configured\ndeployment.extensions/partner-pwd-reset unchanged\ndeployment.extensions/partner-reporting configured\ndeployment.extensions/partner-robin2 configured\ndeployment.extensions/partner-sftp unchanged\ndeployment.extensions/partner-sleep configured\ndeployment.extensions/partner-solera-tool configured\ndeployment.extensions/partner-triggers configured\ndeployment.extensions/partner-user-support-tools unchanged\ndeployment.extensions/perftest unchanged\ndeployment.extensions/qa-birdfood configured\ndeployment.extensions/qa-dashboards unchanged\ndeployment.extensions/qa-device-ordering unchanged\ndeployment.extensions/qa-editor-git-content configured\ndeployment.extensions/qa-food unchanged\ndeployment.extensions/qa-functester unchanged\ndeployment.extensions/qa-goldfinch configured\ndeployment.extensions/qa-larksettings-healthpartners unchanged\ndeployment.extensions/qa-larksettings-highmark unchanged\ndeployment.extensions/qa-larksettings-non-pii unchanged\ndeployment.extensions/qa-larksettings-pii unchanged\ndeployment.extensions/qa-larksettings-prohealth unchanged\ndeployment.extensions/qa-log4j unchanged\ndeployment.extensions/qa-nodebuckets configured\ndeployment.extensions/qa-oauthtokenmanager configured\ndeployment.extensions/qa-planpusher configured\ndeployment.extensions/qa-pwd-reset unchanged\ndeployment.extensions/qa-reporting configured\ndeployment.extensions/qa-robin2 configured\ndeployment.extensions/qa-sftp unchanged\ndeployment.extensions/qa-sleep configured\ndeployment.extensions/qa-solera-tool configured\ndeployment.extensions/qa-triggers unchanged\ndeployment.extensions/qa-user-support-tools unchanged\ndeployment.extensions/secrets configured\ndeployment.extensions/settings-ops-migration-qa-larksettings-healthpartners unchanged\ndeployment.extensions/settings-ops-migration-qa-larksettings-highmark unchanged\ndeployment.extensions/settings-ops-migration-qa-larksettings-non-pii unchanged\ndeployment.extensions/settings-ops-migration-qa-larksettings-pii unchanged\ndeployment.extensions/sftp unchanged\ndeployment.extensions/testing-birdfood configured\ndeployment.extensions/testing-dashboards unchanged\ndeployment.extensions/testing-device-ordering unchanged\ndeployment.extensions/testing-editor-git-content configured\ndeployment.extensions/testing-food unchanged\ndeployment.extensions/testing-functester unchanged\ndeployment.extensions/testing-goldfinch configured\ndeployment.extensions/testing-larksettings-healthpartners unchanged\ndeployment.extensions/testing-larksettings-highmark unchanged\ndeployment.extensions/testing-larksettings-non-pii unchanged\ndeployment.extensions/testing-larksettings-pii unchanged\ndeployment.extensions/testing-larksettings-prohealth unchanged\ndeployment.extensions/testing-log4j unchanged\ndeployment.extensions/testing-nodebuckets configured\ndeployment.extensions/testing-oauthtokenmanager configured\ndeployment.extensions/testing-planpusher configured\ndeployment.extensions/testing-pwd-reset unchanged\ndeployment.extensions/testing-reporting configured\ndeployment.extensions/testing-robin2 configured\ndeployment.extensions/testing-sftp unchanged\ndeployment.extensions/testing-sleep configured\ndeployment.extensions/testing-solera-tool configured\ndeployment.extensions/testing-triggers unchanged\ndeployment.extensions/testing-user-support-tools unchanged\njob.batch/worker unchanged\ndeployment.extensions/yoni-birdfood configured\ndeployment.extensions/yoni-dashboards unchanged\ndeployment.extensions/yoni-device-ordering unchanged\ndeployment.extensions/yoni-editor-git-content configured\ndeployment.extensions/yoni-food unchanged\ndeployment.extensions/yoni-functester unchanged\ndeployment.extensions/yoni-goldfinch configured\ndeployment.extensions/yoni-larksettings-healthpartners unchanged\ndeployment.extensions/yoni-larksettings-highmark unchanged\ndeployment.extensions/yoni-larksettings-non-pii unchanged\ndeployment.extensions/yoni-larksettings-pii unchanged\ndeployment.extensions/yoni-log4j unchanged\ndeployment.extensions/yoni-nodebuckets configured\ndeployment.extensions/yoni-planpusher configured\ndeployment.extensions/yoni-pwd-reset unchanged\ndeployment.extensions/yoni-sleep configured\ndeployment.extensions/yoni-solera-tool configured\ndeployment.extensions/yoni-user-support-tools unchanged\nstorageclass.storage.k8s.io/east1b-xfs configured\nstorageclass.storage.k8s.io/mongo-xfs configured\nstorageclass.storage.k8s.io/standard-xfs configured"
ts=2019-03-07T19:03:52.386477184Z caller=loop.go:105 component=sync-loop event=refreshed [email protected]:larktech/dev8a-cluster branch=master HEAD=a09906fd35192c5ea5dc9da675ea2983d1cf21a3
ts=2019-03-07T19:03:54.184921181Z caller=loop.go:105 component=sync-loop event=refreshed [email protected]:larktech/dev8a-cluster branch=master HEAD=a09906fd35192c5ea5dc9da675ea2983d1cf21a3
ts=2019-03-07T19:03:55.01214549Z caller=images.go:17 component=sync-loop msg="polling images"
ts=2019-03-07T19:03:55.945580813Z caller=images.go:79 component=sync-loop service=yoni:deployment/yoni-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T19:03:55.94663975Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T19:03:55.946685523Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T19:03:55.946766455Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T19:03:55.947049436Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T19:03:55.948266735Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T19:03:55.949744972Z caller=images.go:79 component=sync-loop service=editormaster:deployment/editormaster-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T19:03:55.949824982Z caller=images.go:79 component=sync-loop service=yoni:deployment/yoni-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T19:03:55.950083327Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T19:03:55.951467533Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T19:03:55.95198499Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T19:03:55.952416969Z caller=images.go:79 component=sync-loop service=keryn:deployment/keryn-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T19:03:55.952454437Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T19:03:55.952774162Z caller=images.go:79 component=sync-loop service=marisa:deployment/marisa-robin2 container=robin2 repo=index.docker.io/larktech/robin2 pattern=glob:* current=index.docker.io/larktech/robin2:2.7.0 info="added update to automation run" new=index.docker.io/larktech/robin2:2.7.0a reason="latest 2.7.0a (2019-03-05 21:54:43.140916239 +0000 UTC) > current 2.7.0 (2019-02-20 19:21:14.973639762 +0000 UTC)"
ts=2019-03-07T19:03:55.953436919Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T19:03:55.956895111Z caller=images.go:79 component=sync-loop service=charlie:deployment/charlie-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:bd745d7_master info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current bd745d7_master (2019-02-28 23:26:09.44553343 +0000 UTC)"
ts=2019-03-07T19:03:55.95741638Z caller=images.go:79 component=sync-loop service=admin:deployment/mysql-util container=mysql-util repo=index.docker.io/larktech/mysql-utilities pattern=glob:master-* current=index.docker.io/larktech/mysql-utilities:master-b5edbd6b info="added update to automation run" new=index.docker.io/larktech/mysql-utilities:master-6d0c5e54 reason="latest master-6d0c5e54 (2019-03-07 18:48:18.537758767 +0000 UTC) > current master-b5edbd6b (2019-02-28 21:28:32.497371521 +0000 UTC)"
ts=2019-03-07T19:03:55.95801183Z caller=images.go:79 component=sync-loop service=testing:deployment/testing-device-ordering container=device-ordering repo=index.docker.io/larktech/device-ordering pattern=glob:*_master current=index.docker.io/larktech/device-ordering:2892e78_master info="added update to automation run" new=index.docker.io/larktech/device-ordering:2a982e6_master reason="latest 2a982e6_master (2019-03-05 20:03:23.505757913 +0000 UTC) > current 2892e78_master (2019-02-25 20:51:07.067781892 +0000 UTC)"
ts=2019-03-07T19:03:55.95935496Z caller=images.go:75 component=sync-loop service=mz-hotfix:deployment/mz-hotfix-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:latest warning="current image not in filtered images" action="proceed anyway"
ts=2019-03-07T19:03:55.959386945Z caller=images.go:79 component=sync-loop service=mz-hotfix:deployment/mz-hotfix-goldfinch container=goldfinch repo=index.docker.io/larktech/goldfinch pattern=glob:*_master current=index.docker.io/larktech/goldfinch:latest info="added update to automation run" new=index.docker.io/larktech/goldfinch:ebedbfd_master reason="latest ebedbfd_master (2019-03-06 22:11:52.812072264 +0000 UTC) > current latest (filtered out or missing)"
ts=2019-03-07T19:03:55.95991617Z caller=loop.go:113 component=sync-loop jobID=6f718e45-4382-52fd-8e21-08f4ce1d75a0 state=in-progress
ts=2019-03-07T19:03:56.355684434Z caller=releaser.go:58 component=sync-loop jobID=6f718e45-4382-52fd-8e21-08f4ce1d75a0 type=release updates=19
ts=2019-03-07T19:03:57.193051662Z caller=loop.go:123 component=sync-loop jobID=6f718e45-4382-52fd-8e21-08f4ce1d75a0 state=done success=false err="applying changes: Traceback (most recent call last):\n  File \"kubeyaml.py\", line 226, in <module>\n  File \"kubeyaml.py\", line 221, in main\n  File \"kubeyaml.py\", line 53, in apply_to_yaml\n  File \"kubeyaml.py\", line 59, in update_image\n  File \"site-packages/ruamel/yaml/main.py\", line 363, in load_all\n  File \"site-packages/ruamel/yaml/constructor.py\", line 101, in get_data\n  File \"site-packages/ruamel/yaml/constructor.py\", line 118, in construct_document\n  File \"site-packages/ruamel/yaml/constructor.py\", line 1508, in construct_yaml_map\n  File \"site-packages/ruamel/yaml/constructor.py\", line 1414, in construct_mapping\n  File \"site-packages/ruamel/yaml/constructor.py\", line 279, in check_mapping_key\nruamel.yaml.constructor.DuplicateKeyError: while constructing a mapping\n  in \"<stdin>\", line 5, column 3\nfound duplicate key \"annotations\" with value \"ordereddict([])\" (original value: \"None\")\n  in \"<stdin>\", line 8, column 3\n\nTo suppress this check see:\n    http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys\n\nDuplicate keys will become an error in future releases, and are errors\nby default when using the new API.\n\nFailed to execute script kubeyaml"
ts=2019-03-07T19:03:57.215223209Z caller=images.go:17 component=sync-loop msg="polling images"

@jrryjcksn
Copy link

Though the error indicates a duplicate key (and the attribute), there is no other indication of where to look for the problem.

@jrryjcksn jrryjcksn changed the title DuplicateKeyError DuplicateKeyError provides no indication of the problematic YAML Mar 7, 2019
@montyz
Copy link
Contributor Author

montyz commented Mar 7, 2019

I was able to log in to the container, move kubeyaml to kubeyaml.old, and make the kubeyaml be this script:

#!/bin/sh
echo $1 $2 $3 $4 $5 $6 $7 $8 $9 $10 $11 $12 $13 $14 $15 $16 $17 $18 $19 $20 > /tmp/hey.txt
/usr/lib/kubeyaml/kubeyaml.old $1 $2 $3 $4 $5 $6 $7 $8 $9 $10 $11 $12 $13 $14 $15 $16 $17 $18 $19 $20

By doing that I was able to find my yaml error which was a copy/paste error. This showed me the file that had the problem:

# cat /tmp/hey.txt
image --namespace mz-hotfix --kind deployment --name mz-hotfix-goldfinch --container goldfinch --image index.docker.io/larktech/goldfinch:ebedbfd_master

It still would be nice to have the filename given when kubeyaml throws and error.

@squaremo
Copy link
Member

It still would be nice to have the filename given when kubeyaml throws and error.

Absolutely -- sorry you had to hack the container to get that info.

@squaremo squaremo added size/small UX In pursuit of a delightful user experience labels Mar 12, 2019
@squaremo squaremo mentioned this issue Mar 12, 2019
Merged
squaremo referenced this issue Mar 13, 2019
@squaremo
Merge pull request #1815 from weaveworks/issues/1803-report-problem-f…
14ec34c 
…iles

Include source file in errors from kubeyaml
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
size/small UX In pursuit of a delightful user experience
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@squaremo @montyz @jrryjcksn