Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Kubernetes e2e tests using kind #3449

Closed
wants to merge 146 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
146 commits
Select commit Hold shift + click to select a range
e39a18f
Build basic setup for k8s kind e2e tests.
busma13 Oct 12, 2023
7754984
update buildDevDockerImage to take node version.
busma13 Oct 13, 2023
1804317
test that elasticsearch and teraslice are running.
busma13 Oct 13, 2023
a143ecb
update testReaderFile & testJob for k8s e2e
sotojn Oct 13, 2023
b273a9c
add setAlias and registerElasticsearch method to k8e2e tests. Update …
sotojn Oct 16, 2023
abb0c13
Rework waitForElasticsearch and waitForTeraslice
busma13 Oct 16, 2023
51f4ac8
Fix merge error in setAlias function. Use shell.
busma13 Oct 16, 2023
18914ba
Remove k8se2e directory and all its files
busma13 Oct 17, 2023
5ab754e
Add k8se2e to top level package.json's workspaces
busma13 Oct 17, 2023
d370c69
Add k8s directory and kind files to e2e
busma13 Oct 17, 2023
d618b14
revert changes to root dockerfile
busma13 Oct 17, 2023
ae9383a
modify k8s yaml file ports
busma13 Oct 17, 2023
9e39381
update port in masterDeployment yaml file
busma13 Oct 17, 2023
1b01319
Add checks for k8s test environment
busma13 Oct 17, 2023
1ddf937
Add deployKafka, and kindLoadServiceImage functions.
busma13 Oct 17, 2023
0fbf4b7
remove unneeded K8S E2E variable
busma13 Oct 17, 2023
6703b79
rename function that gets e2e directory
busma13 Oct 17, 2023
82f01f1
Check test platform to call service in proper env
busma13 Oct 17, 2023
70aef33
check test platform before starting docker or kind
busma13 Oct 17, 2023
70702ca
create script to run k8s e2e tests
busma13 Oct 17, 2023
d7187cb
Add kafka to teraslice.yaml files
busma13 Oct 18, 2023
a7ac896
Add kafkaDeployment.yaml file
busma13 Oct 18, 2023
c849388
finally get ports forwarded correctly
busma13 Oct 18, 2023
689b9cf
remove unneeeded dockerfile
busma13 Oct 18, 2023
535c531
wip: update global.setup to be k8s aware
busma13 Oct 18, 2023
9785571
update ES port, rename variables
busma13 Oct 18, 2023
4612a4a
Bump fs-extra and @types/fs-extra
dependabot[bot] Oct 12, 2023
994daa3
Merge branch 'master' into k8s-e2e
busma13 Oct 18, 2023
4117a26
Update images for kafka and master deployments
busma13 Oct 18, 2023
67d70e8
fix kubernetes image tag
busma13 Oct 19, 2023
3672386
add env variables and change image used
busma13 Oct 19, 2023
edd611d
change cluster name to k8se2e
busma13 Oct 19, 2023
36c2b42
changes to test setup just to get things running
busma13 Oct 19, 2023
81b5813
new functions: kindStopService, takeDownTeraslice
busma13 Oct 19, 2023
cb0e1ab
temp change to get k8s tests running
busma13 Oct 19, 2023
fd402ab
deploy kafka assets
busma13 Oct 19, 2023
4fe3bfe
Merge branch 'master' into k8s-e2e
busma13 Oct 19, 2023
ce71c3b
Merge pull request #3442 from terascope/master
busma13 Oct 20, 2023
2e1216c
update kafka connections for k8s
sotojn Oct 20, 2023
ba51407
Add ignore pattern for testing in k8s
busma13 Oct 20, 2023
83f9915
Add version variables for kafka and elasticsearch
busma13 Oct 20, 2023
a1c09e7
Refactoring and cleanup.
busma13 Oct 21, 2023
02639ef
update docker compose yaml to use cp-kafka and cp-zookeeper images
sotojn Oct 24, 2023
7d04252
update k8s tests to use cp-kafka and cp-zkeeper
sotojn Oct 24, 2023
d81451d
Refactoring, add error handling, add comments.
busma13 Oct 23, 2023
cb0a430
update to latest esm module for streaming redirects in teraslice
jsnoble Oct 20, 2023
0a45731
remove node 14 from build and test as we migrate away from it
jsnoble Oct 20, 2023
212ca01
release: (minor) [email protected]
jsnoble Oct 20, 2023
31483f3
change node engine version to drop supoprt for node 14
jsnoble Oct 20, 2023
bee9136
update eslint to use latest parser
jsnoble Oct 20, 2023
918032a
bump: (minor) @terascope/[email protected]
jsnoble Oct 20, 2023
b05e1f5
fix test
jsnoble Oct 20, 2023
85e0ac6
change default node version
jsnoble Oct 23, 2023
93421d6
bump: (minor) @terascope/[email protected]
jsnoble Oct 23, 2023
7509d0b
Bump @babel/traverse from 7.22.5 to 7.23.2
dependabot[bot] Oct 16, 2023
b54e702
Build basic setup for k8s kind e2e tests.
busma13 Oct 12, 2023
7e7617d
update buildDevDockerImage to take node version.
busma13 Oct 13, 2023
869caf9
test that elasticsearch and teraslice are running.
busma13 Oct 13, 2023
4f811f4
update testReaderFile & testJob for k8s e2e
sotojn Oct 13, 2023
e3673a9
add setAlias and registerElasticsearch method to k8e2e tests. Update …
sotojn Oct 16, 2023
5431ddc
Rework waitForElasticsearch and waitForTeraslice
busma13 Oct 16, 2023
41c3754
Fix merge error in setAlias function. Use shell.
busma13 Oct 16, 2023
5de2808
Remove k8se2e directory and all its files
busma13 Oct 17, 2023
eb92ecc
Add k8se2e to top level package.json's workspaces
busma13 Oct 17, 2023
c76a180
Add k8s directory and kind files to e2e
busma13 Oct 17, 2023
382bb68
revert changes to root dockerfile
busma13 Oct 17, 2023
db45254
modify k8s yaml file ports
busma13 Oct 17, 2023
dc2f19c
update port in masterDeployment yaml file
busma13 Oct 17, 2023
d063cca
Add checks for k8s test environment
busma13 Oct 17, 2023
a0a6bd1
Add deployKafka, and kindLoadServiceImage functions.
busma13 Oct 17, 2023
678f1d5
remove unneeded K8S E2E variable
busma13 Oct 17, 2023
ce1e719
rename function that gets e2e directory
busma13 Oct 17, 2023
ca9727e
Check test platform to call service in proper env
busma13 Oct 17, 2023
5b2cd0f
check test platform before starting docker or kind
busma13 Oct 17, 2023
55f3b1c
create script to run k8s e2e tests
busma13 Oct 17, 2023
209c458
Add kafka to teraslice.yaml files
busma13 Oct 18, 2023
370008c
Add kafkaDeployment.yaml file
busma13 Oct 18, 2023
6896607
finally get ports forwarded correctly
busma13 Oct 18, 2023
ca71869
remove unneeeded dockerfile
busma13 Oct 18, 2023
0b5f67d
wip: update global.setup to be k8s aware
busma13 Oct 18, 2023
4012f10
update ES port, rename variables
busma13 Oct 18, 2023
02ff69e
Update images for kafka and master deployments
busma13 Oct 18, 2023
1d63144
fix kubernetes image tag
busma13 Oct 19, 2023
276cec8
add env variables and change image used
busma13 Oct 19, 2023
6acf34b
change cluster name to k8se2e
busma13 Oct 19, 2023
48dbf71
changes to test setup just to get things running
busma13 Oct 19, 2023
8193f92
new functions: kindStopService, takeDownTeraslice
busma13 Oct 19, 2023
d94b60c
temp change to get k8s tests running
busma13 Oct 19, 2023
60fcc3d
deploy kafka assets
busma13 Oct 19, 2023
c632b3d
update kafka connections for k8s
sotojn Oct 20, 2023
0c72f9d
Add ignore pattern for testing in k8s
busma13 Oct 20, 2023
af23eea
Add version variables for kafka and elasticsearch
busma13 Oct 20, 2023
5a3b680
Refactoring and cleanup.
busma13 Oct 21, 2023
e9ca68d
update docker compose yaml to use cp-kafka and cp-zookeeper images
sotojn Oct 24, 2023
b18d8d4
update k8s tests to use cp-kafka and cp-zkeeper
sotojn Oct 24, 2023
cd96a20
Refactoring, add error handling, add comments.
busma13 Oct 23, 2023
fb37658
Refactoring, typo fixes, remove logs.
busma13 Oct 24, 2023
392ed6d
Refactor kindLoadServiceImage
busma13 Oct 24, 2023
5553042
Add testPlatform to options and config. Refactor
busma13 Oct 26, 2023
573cdac
Update yaml files with proper labels and hostnames
busma13 Oct 26, 2023
7c5ba7d
Fix label used to test kafka
busma13 Oct 26, 2023
9ed219e
Refactor so teraslice only starts once
busma13 Oct 26, 2023
8de6358
rename function that starts services
busma13 Oct 26, 2023
4bcec6c
implement kindLoadServiceImage function
busma13 Oct 27, 2023
547a60a
Add keep open variable to e2e config
busma13 Oct 27, 2023
c4865af
add cp kafka & zkeeper images to e2e tests
sotojn Oct 27, 2023
ebe5351
Merge branch 'k8s-e2e' of github.com:terascope/teraslice into k8s-e2e…
sotojn Oct 27, 2023
63ce8c3
fix bug that duplicates e2e logs
sotojn Oct 27, 2023
5a8b2a8
merge error fix, don't load zookeeper separately
busma13 Oct 27, 2023
162638c
Use cpkafka images that match with kafka 3.1
busma13 Oct 27, 2023
ee11c1c
Hard code kafka and ES versions for k8s e2e
busma13 Oct 27, 2023
2758c41
Remove unneeded namespace file
busma13 Oct 27, 2023
3eeffda
Add comments, delete logs.
busma13 Oct 27, 2023
2915835
Add comments.
busma13 Oct 30, 2023
86e789f
Add e2e-k8s-tests to github workflows test.yml
busma13 Oct 31, 2023
21a915f
Update test to destroy kind cluster after tests
busma13 Oct 31, 2023
ea42b23
Fix e2e k8s test wirkflow to install kind first.
busma13 Oct 31, 2023
204c40d
Trying an older version of kind-action
busma13 Oct 31, 2023
cf682b8
Remove console logs
busma13 Oct 31, 2023
97510fd
Fix typo causing error in github action
busma13 Oct 31, 2023
3263a55
Change expected ES cluster_name.
busma13 Oct 31, 2023
182b8f3
Add CI check to kind and kubectl install tests.
busma13 Oct 31, 2023
f8645aa
sync e2e package.json file
busma13 Oct 31, 2023
85e9d2c
Get keep-open variable from options.
busma13 Oct 31, 2023
7ef0ac3
Adding debug of HOST_IP
busma13 Oct 31, 2023
8b74f59
Add delays
busma13 Oct 31, 2023
05a2893
Remove keep-open from test script
busma13 Oct 31, 2023
6b54826
Add more debugs
busma13 Oct 31, 2023
82e39b7
Add host ip to setAlias function.
busma13 Oct 31, 2023
91b9404
Add extra logging and debugging
busma13 Nov 1, 2023
06d5c0b
Add more logs
busma13 Nov 1, 2023
bbd2724
More log fixes
busma13 Nov 1, 2023
bcb2f4f
more logging
busma13 Nov 1, 2023
32e82d8
more logs
busma13 Nov 1, 2023
aa5155b
log es data
busma13 Nov 1, 2023
f3df257
show master logs
busma13 Nov 1, 2023
05b3be5
Add worker and ex logs
busma13 Nov 1, 2023
131ca88
fix typo
busma13 Nov 1, 2023
ecf3cbe
change log length to 1000
busma13 Nov 1, 2023
fdbbf9f
Print out kubectl describe for worker
busma13 Nov 1, 2023
ceafc80
typo in command
busma13 Nov 1, 2023
74103aa
more logs
busma13 Nov 1, 2023
07b44ef
Update resource requests and limits for e2e jobs
busma13 Nov 2, 2023
2da4fa4
update resource requests for data generator jobs
busma13 Nov 2, 2023
afb04f9
Add logging functions
busma13 Nov 2, 2023
8ce6270
Remove all logs and testing env changes.
busma13 Nov 2, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove keep-open from test script
busma13 committed Oct 31, 2023
commit 05a2893d7773c0d47b18d8205bc2f846281ddd26
2 changes: 1 addition & 1 deletion e2e/package.json
Original file line number Diff line number Diff line change
@@ -24,7 +24,7 @@
"logs": "./scripts/logs.sh",
"logs-follow": "./scripts/logs.sh -f",
"setup": "yarn --silent",
"test": "TEST_ELASTICSEARCH='true' TEST_KAFKA='true' ts-scripts test --keep-open='true' --suite e2e --",
"test": "TEST_ELASTICSEARCH='true' TEST_KAFKA='true' ts-scripts test --suite e2e --",
"test:debug": "TEST_ELASTICSEARCH='true' TEST_KAFKA='true' ts-scripts test --suite e2e --debug --",
"test:elasticsearch6": "TEST_ELASTICSEARCH='true' TEST_KAFKA='true' ts-scripts test --suite e2e --",
"test:elasticsearch7": "TEST_ELASTICSEARCH='true' ELASTICSEARCH_VERSION='7.9.3' TEST_KAFKA='true' ts-scripts test --suite e2e --",