[deb/rpm] Build aarch64 distributions #84364

jbudz · 2020-11-25T19:22:37Z

Release note:
Adds deb and rpm packages for ARM64

elasticmachine · 2020-11-25T20:05:13Z

Pinging @elastic/kibana-operations (Team:Operations)

jbudz · 2020-11-25T20:52:23Z

https://s3-us-west-1.amazonaws.com/kibana.budzenski.com/84364/a3282d0/kibana-8.0.0-SNAPSHOT-arm64.deb
https://s3-us-west-1.amazonaws.com/kibana.budzenski.com/84364/a3282d0/kibana-8.0.0-SNAPSHOT-aarch64.rpm

Closes elastic#72885

mistic · 2020-11-30T13:22:05Z

@elasticmachine merge upstream

jbudz · 2020-12-02T15:06:49Z

@elasticmachine merge upstream

tylersmalley · 2020-12-03T00:19:53Z

I am running into issues getting reporting to work on deb.

I have installed sudo apt install libnss3 fonts-liberation libfontconfig1

{"type":"log","@timestamp":"2020-12-03T00:14:42+00:00","tags":["error","plugins","reporting","PNG","execute","ki837bpq1wudbdd7eab01e2r"],"pid":89221,"message":"Error: Protocol error (Runtime.callFunctionOn): Target closed.\n    at /usr/share/kibana/node_modules/puppeteer-core/lib/Connection.js:183:56\n    at new Promise (<anonymous>)\n    at CDPSession.send (/usr/share/kibana/node_modules/puppeteer-core/lib/Connection.js:182:12)\n    at ExecutionContext._evaluateInternal (/usr/share/kibana/node_modules/puppeteer-core/lib/ExecutionContext.js:107:44)\n    at ExecutionContext.evaluateHandle (/usr/share/kibana/node_modules/puppeteer-core/lib/ExecutionContext.js:57:17)\n    at ExecutionContext.<anonymous> (/usr/share/kibana/node_modules/puppeteer-core/lib/helper.js:112:23)\n    at WaitTask.rerun (/usr/share/kibana/node_modules/puppeteer-core/lib/DOMWorld.js:582:65)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:97:5)\n  -- ASYNC --\n    at Frame.<anonymous> (/usr/share/kibana/node_modules/puppeteer-core/lib/helper.js:111:15)\n    at Frame.waitFor (/usr/share/kibana/node_modules/puppeteer-core/lib/FrameManager.js:613:19)\n    at Page.waitFor (/usr/share/kibana/node_modules/puppeteer-core/lib/Page.js:1080:29)\n    at HeadlessChromiumDriver.waitForSelector (/usr/share/kibana/x-pack/plugins/reporting/server/browsers/chromium/driver/chromium_driver.js:146:34)\n    at getNumberOfItems (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/get_number_of_items.js:38:19)\n    at MergeMapSubscriber.project (/usr/share/kibana/x-pack/plugins/reporting/server/lib/screenshots/observable.js:128:86)\n    at MergeMapSubscriber._tryNext (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:67:27)\n    at MergeMapSubscriber._next (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:57:18)\n    at MergeMapSubscriber.Subscriber.next (/usr/share/kibana/node_modules/rxjs/internal/Subscriber.js:66:18)\n    at MergeMapSubscriber.notifyNext (/usr/share/kibana/node_modules/rxjs/internal/operators/mergeMap.js:93:26)\n    at SimpleInnerSubscriber._next (/usr/share/kibana/node_modules/rxjs/internal/innerSubscribe.js:27:21)\n    at SimpleInnerSubscriber.Subscriber.next (/usr/share/kibana/node_modules/rxjs/internal/Subscriber.js:66:18)\n    at /usr/share/kibana/node_modules/rxjs/internal/util/subscribeToPromise.js:7:24\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:97:5)"}
{"type":"log","@timestamp":"2020-12-03T00:14:42+00:00","tags":["info","plugins","reporting","esqueue","queue-worker"],"pid":89221,"message":"ki833un51wudbdd7ea9grp1a - Job marked as failed: /.reporting-2020-11-29/ki837bpq1wudbdd7eab01e2r"}

Sounds like the page crashed?

However, I am able to run chromium directly against google:

:/usr/share/kibana/x-pack/plugins/reporting/chromium/headless_shell-linux_arm64$ ./headless_shell --disable-translate --disable-extensions --disable-background-networking --safebrowsing-disable-auto-update --disable-sync --metrics-recording-only --disable-default-apps --mute-audio --no-first-run --disable-gpu --no-sandbox --headless --hide-scrollbars --window-size=400,400 --remote-debugging-port=9221 https://google.com/

$ curl http://localhost:9221/json/list
[ {
   "description": "",
   "devtoolsFrontendUrl": "/devtools/inspector.html?ws=localhost:9221/devtools/page/392EE068BD5B5DA11466EEBA8D0259F1",
   "id": "392EE068BD5B5DA11466EEBA8D0259F1",
   "title": "Google",
   "type": "page",
   "url": "https://www.google.com/",
   "webSocketDebuggerUrl": "ws://localhost:9221/devtools/page/392EE068BD5B5DA11466EEBA8D0259F1"
} ]

@elastic/kibana-reporting-services any ideas here?

jbudz · 2020-12-03T16:32:56Z

Hmm - debug logs:

{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["debug","plugins","reporting","printab
le_pdf","execute-job","ki91vkgk13f7e70b7ce4qant","ki91vkgk13f7e70b7ce4qant"],"pid":51091,"message":"U
sing custom headers for http://0.0.0.0:5601/38409/bundles/plugin/maps/e3b1bd3256c6e2785c1c7786bf60a1a
7.js"}
{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["error","plugins","reporting","printable_pdf","execute-job","ki91vkgk13f7e70b7ce4qant","ki91vkgk13f7e70b7ce4qant"],"pid":51091,"message":"Reporting encountered an error: Error: Page crashed!"}
{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["debug","plugins","reporting","printable_pdf","execute-job","ki91vkgk13f7e70b7ce4qant","ki91vkgk13f7e70b7ce4qant","browser-driver"],"pid":51091,"message":"The browser process observer has unsubscribed. Closing the browser..."}
{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["debug","plugins","reporting","printable_pdf","execute-job","ki91vkgk13f7e70b7ce4qant","ki91vkgk13f7e70b7ce4qant","browser-driver"],"pid":51091,"message":"deleting chromium user data directory at [/tmp/chromium-hw3fBu]"}
{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["error","plugins","reporting","esqueue","queue-worker","error"],"pid":51091,"message":"ki91v5ex13f7e70b7c5w125a - Failure occurred on job ki91vkgk13f7e70b7ce4qant: Reporting encountered an error: Error: Page crashed!"}
{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["debug","plugins","reporting"],"pid":51091,"message":"Worker error: (ki91vkgk13f7e70b7ce4qant)"}
{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["warning","plugins","reporting","esqueue","queue-worker"],"pid":51091,"message":"ki91v5ex13f7e70b7c5w125a - Failing job ki91vkgk13f7e70b7ce4qant"}
{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["info","plugins","reporting","esqueue","queue-worker"],"pid":51091,"message":"ki91v5ex13f7e70b7c5w125a - Job marked as failed: /.reporting-2020-11-29/ki91vkgk13f7e70b7ce4qant"}
{"type":"log","@timestamp":"2020-12-03T16:25:19+00:00","tags":["debug","plugins","reporting","printable_pdf","execute-job","ki91vkgk13f7e70b7ce4qant","ki91vkgk13f7e70b7ce4qant","browser-driver","headless-browser-process"],"pid":51091,"message":"child process closed"}

The self diagnosis tool was functioning.

jbudz · 2020-12-03T16:35:58Z

I was able to successfully generate a Canvas report, so it seems limited to dashboard for now. I'm going to try on x86 to see if that's limited to ARM.

jbudz · 2020-12-03T17:03:19Z

It's something to do with the maps visualization. The sample ecommerce dashboard had the same error on x86, and after removing maps it was fine.

jbudz · 2020-12-03T17:27:27Z

I opened #84930 with the details here.

tylersmalley

LGTM - the reporting error doesn't appear to be related to the changes here.

jbudz · 2020-12-04T15:13:06Z

@elasticmachine merge upstream

jbudz · 2020-12-04T17:02:12Z

7.x/7.11: 448dcca

jbudz · 2020-12-04T17:08:44Z

@mgreau does the release manager need any changes to pick this up? The file names are kibana-8.0.0-SNAPSHOT-arm64.deb and kibana-8.0.0-SNAPSHOT-aarch64.rpm and there's no dependency changes.

Co-authored-by: Kibana Machine <[email protected]>

kibanamachine · 2020-12-04T18:51:32Z

💚 Build Succeeded

continuous-integration/kibana-ci/pull-request
Commit: 47e18f6

Metrics [docs]

✅ unchanged

History

💚 Build #92001 succeeded 47e18f6
💚 Build #91372 succeeded b10b1df
💚 Build #90692 succeeded 602f948
💚 Build #90325 succeeded 6f89c1e
💚 Build #90310 succeeded 5f2a3f6

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

mgreau · 2020-12-04T23:29:58Z

@mgreau does the release manager need any changes to pick this up? The file names are kibana-8.0.0-SNAPSHOT-arm64.deb and kibana-8.0.0-SNAPSHOT-aarch64.rpm and there's no dependency changes.

Yes I will open an internal issue to talk about it

jbudz added release_note:enhancement Team:Operations Team label for Operations Team v8.0.0 v7.11.0 labels Nov 25, 2020

jbudz marked this pull request as ready for review November 25, 2020 20:05

jbudz requested a review from a team as a code owner November 25, 2020 20:05

jbudz added 3 commits November 25, 2020 19:19

[deb/rpm] Build aarch64 distributions

5f2a3f6

Closes elastic#72885

keep filename the same

a3282d0

spacing

6f89c1e

Merge branch 'master' into build/os-arm64

602f948

Merge branch 'master' into build/os-arm64

b10b1df

tylersmalley approved these changes Dec 3, 2020

View reviewed changes

Merge branch 'master' into build/os-arm64

47e18f6

jbudz merged commit 0dbe1cd into elastic:master Dec 4, 2020

jbudz deleted the build/os-arm64 branch December 4, 2020 16:59

jbudz added the backported label Dec 4, 2020

jbudz added a commit that referenced this pull request Dec 4, 2020

[deb/rpm] Build aarch64 distributions (#84364)

448dcca

Co-authored-by: Kibana Machine <[email protected]>

jbudz mentioned this pull request Dec 18, 2020

awlinux2/arm64 yum repo missing kibana #86385

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[deb/rpm] Build aarch64 distributions #84364

[deb/rpm] Build aarch64 distributions #84364

jbudz commented Nov 25, 2020 •

edited

Loading

elasticmachine commented Nov 25, 2020

jbudz commented Nov 25, 2020

mistic commented Nov 30, 2020

jbudz commented Dec 2, 2020

tylersmalley commented Dec 3, 2020

jbudz commented Dec 3, 2020 •

edited

Loading

jbudz commented Dec 3, 2020

jbudz commented Dec 3, 2020

jbudz commented Dec 3, 2020

tylersmalley left a comment

jbudz commented Dec 4, 2020

jbudz commented Dec 4, 2020 •

edited

Loading

jbudz commented Dec 4, 2020

kibanamachine commented Dec 4, 2020

mgreau commented Dec 4, 2020

[deb/rpm] Build aarch64 distributions #84364

[deb/rpm] Build aarch64 distributions #84364

Conversation

jbudz commented Nov 25, 2020 • edited Loading

elasticmachine commented Nov 25, 2020

jbudz commented Nov 25, 2020

mistic commented Nov 30, 2020

jbudz commented Dec 2, 2020

tylersmalley commented Dec 3, 2020

jbudz commented Dec 3, 2020 • edited Loading

jbudz commented Dec 3, 2020

jbudz commented Dec 3, 2020

jbudz commented Dec 3, 2020

tylersmalley left a comment

Choose a reason for hiding this comment

jbudz commented Dec 4, 2020

jbudz commented Dec 4, 2020 • edited Loading

jbudz commented Dec 4, 2020

kibanamachine commented Dec 4, 2020

💚 Build Succeeded

Metrics [docs]

History

mgreau commented Dec 4, 2020

jbudz commented Nov 25, 2020 •

edited

Loading

jbudz commented Dec 3, 2020 •

edited

Loading

jbudz commented Dec 4, 2020 •

edited

Loading