v11.0.0-PI12 #401

mdebarros · 2020-11-18T08:46:58Z

Helm release changes

1. Maintenance updates

GitHub issue: Helm Release v11.0.0: Updates to helm, Supporting QA, Fixes, Releases [old] project#1617
FSP Interoperability API v1.1 Swagger file used from here: https://github.com/mojaloop/mojaloop-specification/tree/master/documents/v1.1-document-set
For breaking changes, please review the "Breaking Changes" section below for for Mojaloop Helm v11.0.0
Notes on simulators
- Mojaloop-Simulator is enabled by default (six instances used).
- Ensure that correct Postman Scripts are used if you wish to test against the Mojaloop-Simulators:
  - A single MojaSim collection is now available after reconciliation between two collections that existed previously.
  - Setup Mojaloop Hub : MojaloopHub_Setup
  - Setup Mojaloop Simulators for testing : MojaloopSims_Onboarding
  - Golden path tests: Golden_Path_Mojaloop
- Legacy Simulators are still required and deployed by default; disabling this will cause issues since there is Account Lookup directory mocking functionality in this service. To run Golden path tests using the Legacy simulator:
  - Setup Mojaloop Hub, test FSPs : ML_OSS_Setup_LegacySim
  - Golden path tests: ML_OSS_Golden_Path_LegacySim
- In order to run the Legacy Simulator postman collection or the Mojaloop-Simulator collection, their corresponding setup collection needs to be run first; this can be done without redeployment.
Upgrades to all core and supporting services to support 11.0.0 release (see Application versions and release notes below)
The current Golden Path collection expects
quoting-service.config.simple_routing_mode_enabled to be set to false to get 100% pass-rate, if this flag is disabled, there will be failures in several quoting-service tests (7 expected failures). This command can be used to override the default config: helm install moja ./mojaloop/ -n demo --set quoting-service.config.simple_routing_mode_enabled=false
Along with this configuration for on-us transfers is disabled on both default deployments and postman (ON_US_TRANSFERS_ENABLED on postman) collections.
Moving to SemVer as the standard is now adopted. This will start with v11.0.0 and follow the general semantic versioning guidance after that.
Updated Promfana chart with "Prometheus: v2.20.1; Grafana: v7.1.1"
Updated EFK chart with “appVersion: "elasticsearch: 7.7.1; kibana: 7.7.1; apm-server: 7.7.1; fluentd-elasticsearch: 3.0.4"
Charts now support deployments on Kubernetes v1.16.x onwards - Fix for issue Helm charts incompatible with Kubernetes v1.16.x #219
Removed deprecated ingress-nginx chart (ingress-nginx chart from upstream instead of mojaloop/helm/kube-public/ingress-nginx #350). Please use Nginx official chart.
Updated official Helm repo URIs for stable & incubator dependencies and documentation:
- Stable: https://kubernetes-charts.storage.googleapis.com/ --> https://charts.helm.sh/stable
- Incubator: http://storage.googleapis.com/kubernetes-charts-incubator --> https://charts.helm.sh/incubator
Updated innodb_flush_log_at_trx_commit to the value of 1 for MySQL servers to ensure ACID compliance (ref: https://dev.mysql.com/doc/refman/5.7/en/innodb-parameters.html#sysvar_innodb_flush_log_at_trx_commit)
Renamed Central-Event-Processor's (CEP) MongoDB instance dependency to: nameOverride: cep-mongodb. This will ensure that the CEP has its own MongoDB instance.
Renamed Mojaloop-Self-Testing-Toolkit's (TTK) MongoDB instance dependency to: nameOverride: ttk-mongodb. This will ensure that the TTK has its own MongoDB instance.

2. New Features

Along with changes from v10.4.0 related to the version v1.1 of the Mojaloop FSP Interoperability API, additional follow-up changes are implemented and a few fixes made. The changes are listed in the tracking issue of the specification and there is additional context offered here. Epic: Epic: ML FSPIOP API v1.1 changes [PI-10] project#1333
Added TTK CLI chart to ml-testing-toolkit (Added TTK CLI chart to ml-testing-toolkit #380).
Added the option to pass a template as the rules.json (Added the option to pass a template as the rules.json #353) in quoting service
Updates for bulk transfers support in MojaSims/Scheme-Adapter (Bulk transfers support in sdk-scheme-adapter (mojaloop-simulator) - Part 2 project#1386)
Added charts for bulk-get-handler: Investigate and resolve issue with GET /bulkTransfers in Mojadev2 project#1496
Package development versions (Package development versions #354)
Update helm charts to support kubernetes deployments1.15 and later versions: Update Helm charts to support Kubernetes deployments 1.15 and later versions project#1463 (PR#349)
Added TTK CLI chart to ml-testing-toolkit (Added TTK CLI chart to ml-testing-toolkit #380)
Modified the testing toolkit CLI chart to enabled scheduling (Modified the testing toolkit CLI chart to enabled scheduling #381)

3. Bug Fixes

Incorrect error behaviour on transfer fulfilment with future timestamp 1708
ACCEPT header returned in the PUT from switch for the timeout scenario 1710
Date header missing from the Switch signature in timeout scenario 1709
Valid transactionRequests callback in SDK responding with error response 1647
Support test currencies XXX, XTS in ml-api-adapter 1652

4. Application versions

Application versions that are supported for this update:

ml-api-adapter: v10.5.0 -> v11.1.2
central-ledger: v10.5.1 -> v11.3.1
account-lookup-service: v10.4.2 -> v11.1.2
quoting-service: v10.5.5 -> v11.1.4
central-settlement: v10.5.0 (no change)
central-event-processor: v10.5.0 (no change)
bulk-api-adapter: v10.5.0 -> v11.0.2
email-notifier: v9.5.0 (no change)
als-oracle-pathfinder: v9.4.0 --> v10.2.0
transaction-requests-service: v10.4.0 -> v11.1.2
finance-portal-ui: v10.4.0 (no change)
finance-portal-backend-service: v10.4.0 (no change)
settlement-management: v8.8.2 (no change)
operator-settlement: v9.2.1 (no change)
event-sidecar: v9.5.1 (no change)
event-stream-processor: v9.5.0-snapshot
simulator: v10.5.3 -> v11.0.2
mojaloop-simulator: v10.4.1 -> v11.2.1
sdk-scheme-adapter: v10.5.0 -> v11.8.0
ml-testing-toolkit: v10.4.1 -> v11.5.0
ml-testing-toolkit-ui: v10.4.1 -> v11.5.0
ml-testing-toolkit-cli: v11.3.0 (new)

5. Application release notes

ml-api-adapter - https://github.com/mojaloop/ml-api-adapter/releases/tag/v11.1.2
central-ledger - https://github.com/mojaloop/central-ledger/releases/tag/v11.3.1
account-lookup-service - https://github.com/mojaloop/account-lookup-service/releases/tag/v11.1.2
quoting-service - https://github.com/mojaloop/quoting-service/releases/tag/v11.1.4
central-settlement- https://github.com/mojaloop/central-settlement/releases/tag/v10.5.0
central-event-processor - https://github.com/mojaloop/central-event-processor/releases/tag/v10.5.0
bulk-api-adapter - https://github.com/mojaloop/bulk-api-adapter/releases/tag/v11.0.2
email-notifier - https://github.com/mojaloop/email-notifier/releases/tag/v9.5.0
als-oracle-pathfinder - https://github.com/mojaloop/als-oracle-pathfinder/releases/tag/v10.2.0
transaction-requests-service - https://github.com/mojaloop/transaction-requests-service/releases/tag/v11.1.2
finance-portal-ui - https://github.com/mojaloop/finance-portal-ui/releases/tag/v10.4.0
finance-portal-backend-service - https://github.com/mojaloop/finance-portal-backend-service/releases/tag/v10.4.0
settlement-management - https://github.com/mojaloop/settlement-management/releases/tag/v8.8.2
operator-settlement - https://github.com/mojaloop/operator-settlement/releases/tag/v9.2.1
event-sidecar - https://github.com/mojaloop/event-sidecar/releases/tag/v9.5.1
event-stream-processor - https://github.com/mojaloop/event-stream-processor/releases/v9.5.0-snapshot
simulator - https://github.com/mojaloop/simulator/releases/tag/v11.0.2
mojaloop-simulator - https://github.com/mojaloop/mojaloop-simulator/releases/tag/v11.2.1
sdk-scheme-adapter - https://github.com/mojaloop/sdk-scheme-adapter/releases/tag/v11.8.0
ml-testing-toolkit - https://github.com/mojaloop/ml-testing-toolkit/releases/tag/v11.5.0
ml-testing-toolkit-ui - https://github.com/mojaloop/ml-testing-toolkit-ui/releases/tag/v11.5.0
ml-testing-toolkit-cli - https://github.com/mojaloop/ml-testing-toolkit-ui/releases/tag/v11.3.0

6. Operational Chart versions

EFK: v7.1.0 -> v11.0.0
Promfana: v8.4.0 -> v11.0.0

7. Breaking changes

Helm release v10.4.0 is not upgradable to v11.0.0 - Helm upgrade v10.4.0 -> v11.0.0 upgrade issues project#1759

8. Known Issues

Proposal to remove external dependencies from Mojaloop Helm Charts - Proposal: Remove external dependencies that are tightly integrated into the Mojaloop Helm Chart design-authority-project#69 (Note: this will be a breaking change in the next major release)
Testing Toolkit Post-Hook Install tests are not compatible with Postman (Note: this will not impact default installations) - TTK Post-hook tests are not compatible with existing Postman tests project#1864

9. Contributors:

Contributing organizations: BMGF, CrossLake, MBX
Crosslake: @lewisdaly
ModusBox: @amarmodus, @elnyry-sam-k , @mdebarros, @oderayi, @rmothilal , @vgenev , @vijayg10, @msk-, @vbarzokas, @aaronreynoza, @KamuelaFranco
Individuals: @vorburger
Note: companies in alphabetical order

PR Dependencies

Stable: https://kubernetes-charts.storage.googleapis.com/ --> https://charts.helm.sh/stable Incubator: http://storage.googleapis.com/kubernetes-charts-incubator --> https://charts.helm.sh/incubator

Please use the official chart --> https://docs.nginx.com/nginx-ingress-controller/installation/installation-with-helm/

…ator config in main mojaloop values config

…d, and rather added as a comment. In most cases annotations are not necessary.

mdebarros · 2020-11-19T20:11:40Z

GoldenPath results for the following version: mojaloop/postman#188

┌─────────────────────────┬────────────────────┬────────────────────┐
│                         │           executed │             failed │
├─────────────────────────┼────────────────────┼────────────────────┤
│              iterations │                  1 │                  0 │
├─────────────────────────┼────────────────────┼────────────────────┤
│                requests │                483 │                  0 │
├─────────────────────────┼────────────────────┼────────────────────┤
│            test-scripts │                842 │                  0 │
├─────────────────────────┼────────────────────┼────────────────────┤
│      prerequest-scripts │                755 │                  0 │
├─────────────────────────┼────────────────────┼────────────────────┤
│              assertions │               1760 │                  0 │
├─────────────────────────┴────────────────────┴────────────────────┤
│ total run duration: 13m 47.6s                                     │
├───────────────────────────────────────────────────────────────────┤
│ total data received: 537.29KB (approx)                            │
├───────────────────────────────────────────────────────────────────┤
│ average response time: 250ms [min: 178ms, max: 3.6s, s.d.: 186ms] │
└───────────────────────────────────────────────────────────────────┘

elnyry-sam-k · 2020-11-23T09:24:18Z

Deployed this on dev1 and it looks ok..

mdebarros · 2020-11-23T15:30:10Z

After merging @vijayg10's changes to TTK.

Post-Hook Install:

┌─────────────────────────┬────────────────────┬────────────────────┐
│                         │           executed │             failed │
├─────────────────────────┼────────────────────┼────────────────────┤
│              iterations │                  1 │                  0 │
├─────────────────────────┼────────────────────┼────────────────────┤
│                requests │                482 │                  0 │
├─────────────────────────┼────────────────────┼────────────────────┤
│            test-scripts │                842 │                  0 │
├─────────────────────────┼────────────────────┼────────────────────┤
│      prerequest-scripts │                755 │                  0 │
├─────────────────────────┼────────────────────┼────────────────────┤
│              assertions │               1760 │                 12 │
├─────────────────────────┴────────────────────┴────────────────────┤
│ total run duration: 13m 48.6s                                     │
├───────────────────────────────────────────────────────────────────┤
│ total data received: 541.44KB (approx)                            │
├───────────────────────────────────────────────────────────────────┤
│ average response time: 252ms [min: 180ms, max: 3.7s, s.d.: 241ms] │
└───────────────────────────────────────────────────────────────────┘

GoldenPath:

┌─────────────────────────┬─────────────────────┬─────────────────────┐
│                         │            executed │              failed │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│              iterations │                   1 │                   0 │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│                requests │                 482 │                   0 │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│            test-scripts │                 842 │                   0 │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│      prerequest-scripts │                 755 │                   0 │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│              assertions │                1760 │                   0 │
├─────────────────────────┴─────────────────────┴─────────────────────┤
│ total run duration: 13m 41s                                         │
├─────────────────────────────────────────────────────────────────────┤
│ total data received: 538.62KB (approx)                              │
├─────────────────────────────────────────────────────────────────────┤
│ average response time: 236ms [min: 178ms, max: 1595ms, s.d.: 111ms] │
└─────────────────────────────────────────────────────────────────────┘

…cache deployment.

…o ensure strict acid compliance. Also changed the "nameOverride" for CEP's mongodb instance.

mdebarros · 2020-11-25T10:53:23Z

Post-hook install tests via TTK:

--------------------TEST CASES--------------------
Test Suite:Test run after deployment
Environment:DEV2
┌───────────────────────────────────────────────────┐
│                      SUMMARY                      │
├───────────────────┬───────────────────────────────┤
│ Total assertions  │ 264                           │
├───────────────────┼───────────────────────────────┤
│ Passed assertions │ 264                           │
├───────────────────┼───────────────────────────────┤
│ Failed assertions │ 0                             │
├───────────────────┼───────────────────────────────┤
│ Total requests    │ 61                            │
├───────────────────┼───────────────────────────────┤
│ Total test cases  │ 28                            │
├───────────────────┼───────────────────────────────┤
│ Passed percentage │ 100.00%                       │
├───────────────────┼───────────────────────────────┤
│ Started time      │ Wed, 25 Nov 2020 10:32:58 GMT │
├───────────────────┼───────────────────────────────┤
│ Completed time    │ Wed, 25 Nov 2020 10:33:17 GMT │
├───────────────────┼───────────────────────────────┤
│ Runtime duration  │ 18647 ms                      │
└───────────────────┴───────────────────────────────┘
TTK-Assertion-Report-multi-2020-11-25T10:33:17.028Z.html was generated
Terminate with exit code 0
Done

GoldenPath Test results:

┌─────────────────────────┬─────────────────────┬─────────────────────┐
│                         │            executed │              failed │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│              iterations │                   1 │                   0 │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│                requests │                 497 │                   0 │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│            test-scripts │                 842 │                   0 │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│      prerequest-scripts │                 755 │                   0 │
├─────────────────────────┼─────────────────────┼─────────────────────┤
│              assertions │                1767 │                   0 │
├─────────────────────────┴─────────────────────┴─────────────────────┤
│ total run duration: 11m 11.7s                                       │
├─────────────────────────────────────────────────────────────────────┤
│ total data received: 540KB (approx)                                 │
├─────────────────────────────────────────────────────────────────────┤
│ average response time: 224ms [min: 170ms, max: 1240ms, s.d.: 111ms] │
└─────────────────────────────────────────────────────────────────────┘

elnyry-sam-k · 2020-11-25T13:49:05Z

Great work, Miguel!

Thanks!

mdebarros added 2 commits November 18, 2020 10:33

Updated helm repos as they will be deprecated end of Nov 2020

85a90f6

Stable: https://kubernetes-charts.storage.googleapis.com/ --> https://charts.helm.sh/stable Incubator: http://storage.googleapis.com/kubernetes-charts-incubator --> https://charts.helm.sh/incubator

Removing nginx chart - mojaloop#350

f5629d7

Please use the official chart --> https://docs.nginx.com/nginx-ingress-controller/installation/installation-with-helm/

mdebarros self-assigned this Nov 18, 2020

This was referenced Nov 18, 2020

Kubernetes Version constraint (kubeVersion) #347

Closed

ingress-nginx chart from upstream instead of mojaloop/helm/kube-public/ingress-nginx #350

Closed

mdebarros added 10 commits November 18, 2020 15:10

Added missing stable repo from CI script

2d8bcce

Reverted mojaloop version to v11.0.0, and also fix for mojaloop-simul…

844b5d9

…ator config in main mojaloop values config

Merge remote-tracking branch 'origin/master' into release/v11.0.0-PI12

ba9617c

Updated central-ledger to v11.3.0

68486d8

Updated all annotations for ingress. By default they have been remove…

7b2c56b

…d, and rather added as a comment. In most cases annotations are not necessary.

reverted mojaloop-simulator annotations

3926309

defaulting mojaloop-simulator ingress annotations and rewrites

1575c06

upgraded central-ledger to v11.3.1

92d75e5

Added testing-toolkit to appVersion on main mojaloop helm chart

58c26e7

updated appVersion for mojaloop-simulator

cfd8c26

mdebarros mentioned this pull request Nov 20, 2020

Helm Release v11.0.0: Updates to helm, Supporting QA, Fixes, Releases mojaloop/project#1851

Closed

40 tasks

vijayg10 and others added 2 commits November 20, 2020 16:07

Updated the TTK versions (#5)

a49e669

Updated testing toolkit frontend-backend

09c0324

mdebarros marked this pull request as ready for review November 23, 2020 09:03

mdebarros requested a review from elnyry-sam-k as a code owner November 23, 2020 09:03

elnyry-sam-k previously approved these changes Nov 23, 2020

View reviewed changes

mdebarros added 5 commits November 24, 2020 13:18

Added nodeSelector, affinity and tolerations to mojaloop-simulator's …

208702f

…cache deployment.

Updated mysql config for innodb_flush_log_at_trx_commit from 0 to 1 t…

1c55ddf

…o ensure strict acid compliance. Also changed the "nameOverride" for CEP's mongodb instance.

Fixed missing configs for mogodb renames

5da8011

fix for rules.json on mojaloop-simulator config

7209963

Fixed missing "cep-mongodb" renaming config

40abecc

mdebarros dismissed elnyry-sam-k’s stale review via 40abecc November 25, 2020 10:14

mdebarros requested a review from elnyry-sam-k November 25, 2020 13:34

elnyry-sam-k approved these changes Nov 25, 2020

View reviewed changes

mdebarros merged commit 87373ca into mojaloop:master Nov 25, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

v11.0.0-PI12 #401

v11.0.0-PI12 #401

mdebarros commented Nov 18, 2020 •

edited

Loading

mdebarros commented Nov 19, 2020 •

edited

Loading

elnyry-sam-k commented Nov 23, 2020

mdebarros commented Nov 23, 2020 •

edited

Loading

mdebarros commented Nov 25, 2020 •

edited

Loading

elnyry-sam-k commented Nov 25, 2020

v11.0.0-PI12 #401

v11.0.0-PI12 #401

Conversation

mdebarros commented Nov 18, 2020 • edited Loading

Helm release changes

1. Maintenance updates

2. New Features

3. Bug Fixes

4. Application versions

5. Application release notes

6. Operational Chart versions

7. Breaking changes

8. Known Issues

9. Contributors:

PR Dependencies

mdebarros commented Nov 19, 2020 • edited Loading

elnyry-sam-k commented Nov 23, 2020

mdebarros commented Nov 23, 2020 • edited Loading

mdebarros commented Nov 25, 2020 • edited Loading

elnyry-sam-k commented Nov 25, 2020

mdebarros commented Nov 18, 2020 •

edited

Loading

mdebarros commented Nov 19, 2020 •

edited

Loading

mdebarros commented Nov 23, 2020 •

edited

Loading

mdebarros commented Nov 25, 2020 •

edited

Loading