Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

building from source failed (using Podman, not sure it's related) #5858

Closed
mykaul opened this issue Jan 6, 2020 · 10 comments
Closed

building from source failed (using Podman, not sure it's related) #5858

mykaul opened this issue Jan 6, 2020 · 10 comments
Assignees
@liranmauda

Comments

@mykaul
Copy link

mykaul commented Jan 6, 2020

Replaced all 'docker ...' with 'podman ...' (since I don't have Docker working on my Fedora 31, but Podman seems fine).

Failed to build:

[15:39:58] Starting 'bundleDebug'...
npm WARN deprecated [email protected]: 🙌  Thanks for using Babel: we recommend using babel-preset-env now: please read https://babeljs.io/env to update!
npm WARN deprecated [email protected]: The package has been renamed to `open`
npm WARN deprecated [email protected]: Please use the native JSON object instead of JSON 3
npm WARN deprecated [email protected]: core-js@<3 is no longer maintained and not recommended for usage due to the number of issues. Please, upgrade your dependencies to the actual version of core-js@3.
[15:40:07] Finished 'bundleDebug' after 8.89 solveWithNewModule [email protected] ch
[15:40:08] Finished 'generateSVGIcons' after 12 snerateActionsToTake
[15:40:08] Finished 'buildAPI' after 12 s
[15:40:10] Finished 'copy' after 14 s: sill extract babel-plugin-transform-rege
[15:40:12] Finished 'compileStyles' after 17 stract [email protected]

> [email protected] postinstall /noobaa/frontend/src/lib/shifty/node_modules/core-js
> node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js on Open Collective or Patreon: 
> https://opencollective.com/core-js 
> https://www.patreon.com/zloirock 

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)


> [email protected] postinstall /noobaa/frontend/src/lib/shifty/node_modules/nodemon
> node bin/postinstall || exit 0

Love nodemon? You can now support the project via the open collective:
 > https://opencollective.com/nodemon/donate

[15:40:19] Finished 'lintApp' after 22 s lifecycle [email protected]~pos
[15:40:19] Starting 'bundleApp'...
npm notice created a lockfile as package-lock.json. You should commit this file.
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: [email protected] (node_modules/fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for [email protected]: wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})

added 754 packages from 712 contributors and audited 10856 packages in 21.158s
found 5 vulnerabilities (3 low, 1 high, 1 critical)
  run `npm audit fix` to fix them, or `npm audit` for details

> [email protected] build /noobaa/frontend/src/lib/shifty
> webpack

Hash: 3d0076bc18113d56ddbc
Version: webpack 2.5.1
Time: 1876ms
        Asset     Size  Chunks             Chunk Names
    shifty.js  14.8 kB       0  [emitted]  main
shifty.js.map   128 kB       0  [emitted]  main
   [0] ./src/tweenable.js 18.6 kB {0} [built]
   [1] ./~/object-assign/index.js 2.1 kB {0} [built]
   [2] ./src/bezier.js 6.47 kB {0} [built]
   [3] ./src/interpolate.js 2.81 kB {0} [built]
   [4] (webpack)/buildin/global.js 823 bytes {0} [built]
   [5] ./src/easing-functions.js 7.3 kB {0} [built]
   [6] ./src/main.js 889 bytes {0} [built]
   [7] ./src/token.js 10.4 kB {0} [built]

WARNING in shifty.js from UglifyJs
Side effects in initialization of unused variable setBezierFunction [./src/bezier.js:159,13]
Side effects in initialization of unused variable unsetBezierFunction [./src/bezier.js:177,13]
Side effects in initialization of unused variable interpolate [./src/interpolate.js:48,13]
Side effects in initialization of unused variable linear [./src/easing-functions.js:39,13]
Side effects in initialization of unused variable easeInQuad [./src/easing-functions.js:41,13]
Side effects in initialization of unused variable easeOutQuad [./src/easing-functions.js:43,13]
Side effects in initialization of unused variable easeInOutQuad [./src/easing-functions.js:45,13]
Side effects in initialization of unused variable easeInCubic [./src/easing-functions.js:50,13]
Side effects in initialization of unused variable easeOutCubic [./src/easing-functions.js:52,13]
Side effects in initialization of unused variable easeInOutCubic [./src/easing-functions.js:54,13]
Side effects in initialization of unused variable easeInQuart [./src/easing-functions.js:59,13]
Side effects in initialization of unused variable easeOutQuart [./src/easing-functions.js:61,13]
Side effects in initialization of unused variable easeInOutQuart [./src/easing-functions.js:63,13]
Side effects in initialization of unused variable easeInQuint [./src/easing-functions.js:68,13]
Side effects in initialization of unused variable easeOutQuint [./src/easing-functions.js:70,13]
Side effects in initialization of unused variable easeInOutQuint [./src/easing-functions.js:72,13]
Side effects in initialization of unused variable easeInSine [./src/easing-functions.js:77,13]
Side effects in initialization of unused variable easeOutSine [./src/easing-functions.js:79,13]
Side effects in initialization of unused variable easeInOutSine [./src/easing-functions.js:81,13]
Side effects in initialization of unused variable easeInExpo [./src/easing-functions.js:83,13]
Side effects in initialization of unused variable easeOutExpo [./src/easing-functions.js:85,13]
Side effects in initialization of unused variable easeInOutExpo [./src/easing-functions.js:87,13]
Side effects in initialization of unused variable easeInCirc [./src/easing-functions.js:103,13]
Side effects in initialization of unused variable easeOutCirc [./src/easing-functions.js:105,13]
Side effects in initialization of unused variable easeInOutCirc [./src/easing-functions.js:107,13]
Side effects in initialization of unused variable easeOutBounce [./src/easing-functions.js:112,13]
Side effects in initialization of unused variable easeInBack [./src/easing-functions.js:124,13]
Side effects in initialization of unused variable easeOutBack [./src/easing-functions.js:129,13]
Side effects in initialization of unused variable easeInOutBack [./src/easing-functions.js:134,13]
Side effects in initialization of unused variable elastic [./src/easing-functions.js:142,13]
Side effects in initialization of unused variable swingFromTo [./src/easing-functions.js:145,13]
Side effects in initialization of unused variable swingFrom [./src/easing-functions.js:152,13]
Side effects in initialization of unused variable swingTo [./src/easing-functions.js:157,13]
Side effects in initialization of unused variable bounce [./src/easing-functions.js:162,13]
Side effects in initialization of unused variable bouncePast [./src/easing-functions.js:174,13]
Side effects in initialization of unused variable easeFromTo [./src/easing-functions.js:186,13]
Side effects in initialization of unused variable easeFrom [./src/easing-functions.js:191,13]
Side effects in initialization of unused variable easeTo [./src/easing-functions.js:193,13]
Side effects in initialization of unused variable length [./src/token.js:343,12]
[15:40:22] Finished 'buildDeps' after 26 s
[15:40:22] Starting 'bundleLib'...
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
[15:40:27] Finished 'bundleApp' after 8.82 s
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
....
Error: EMFILE: too many open files, open '/noobaa/frontend/node_modules/readable-stream/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/node_modules/readable-stream/package.json' 
[15:40:32] Finished 'bundleLib' after 10 s
[15:40:32] Starting 'verifyBuild'...
[15:40:32] Build encountered 526 build errors
[15:40:32] The following tasks did not complete: build, verifyBuild
[15:40:32] Did you forget to signal async completion?
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build: `gulp build`
npm ERR! Exit status 1
npm ERR! 
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2020-01-06T15_40_32_978Z-debug.log
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build:fe: `cd frontend && npm install && npm run build`
npm ERR! Exit status 1
npm ERR! 
npm ERR! Failed at the [email protected] build:fe script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

Any ideas?
@mykaul
Copy link
Author

mykaul commented Jan 6, 2020

Answer to self:

docker build --ulimit nofile=10240:10240 ...

Helped.
Since I used podman, it almost worked - I had to use 'sudo' to get it set properly.
But it did the trick.
Now the question - should we add it to the Makefile?

@liranmauda liranmauda mentioned this issue Apr 26, 2020
Closed
@liranmauda
Copy link
Contributor

Hi @mykaul can you try again from master?
We have made a small change #6002 that might effect here.

@mykaul
Copy link
Author

mykaul commented Apr 30, 2020

Something is complete broken for me now:

[ykaul@ykaul noobaa-core]$ time make

real	0m0.227s
user	0m0.126s
sys	0m0.114s

It doesn't build at all.
'make base' did run, failing eventually with:

[14:42:55] Finished 'buildDeps' after 56 s
[14:42:55] Starting 'bundleLib'...
[14:42:56] Finished 'bundleLib' after 1.13 s
[14:42:56] Starting 'verifyBuild'...
[14:42:56] Build encountered 558 build errors
[14:42:56] The following tasks did not complete: build, verifyBuild
[14:42:56] Did you forget to signal async completion?
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build: `gulp build`
npm ERR! Exit status 1
npm ERR! 
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2020-04-30T14_42_56_865Z-debug.log
Error: error building at STEP "RUN cd frontend &&     npm run build": error while running runtime: exit status 1
make: *** [Makefile:50: base] Error 125

Eventually, tried 'sudo make base' which failed with the same issue :(

Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Hash: 3d0076bc18113d56ddbc
Version: webpack 2.5.1
Time: 1794ms
        Asset     Size  Chunks             Chunk Names
    shifty.js  14.8 kB       0  [emitted]  main
shifty.js.map   128 kB       0  [emitted]  main
   [0] ./src/tweenable.js 18.6 kB {0} [built]
   [1] ./~/object-assign/index.js 2.1 kB {0} [built]
   [2] ./src/bezier.js 6.47 kB {0} [built]
   [3] ./src/interpolate.js 2.81 kB {0} [built]
   [4] (webpack)/buildin/global.js 823 bytes {0} [built]
   [5] ./src/easing-functions.js 7.3 kB {0} [built]
   [6] ./src/main.js 889 bytes {0} [built]
   [7] ./src/token.js 10.4 kB {0} [built]

WARNING in shifty.js from UglifyJs
Side effects in initialization of unused variable setBezierFunction [./src/bezier.js:159,13]
Side effects in initialization of unused variable unsetBezierFunction [./src/bezier.js:177,13]
Side effects in initialization of unused variable interpolate [./src/interpolate.js:48,13]
Side effects in initialization of unused variable linear [./src/easing-functions.js:39,13]
Side effects in initialization of unused variable easeInQuad [./src/easing-functions.js:41,13]
Side effects in initialization of unused variable easeOutQuad [./src/easing-functions.js:43,13]
Side effects in initialization of unused variable easeInOutQuad [./src/easing-functions.js:45,13]
Side effects in initialization of unused variable easeInCubic [./src/easing-functions.js:50,13]
Side effects in initialization of unused variable easeOutCubic [./src/easing-functions.js:52,13]
Side effects in initialization of unused variable easeInOutCubic [./src/easing-functions.js:54,13]
Side effects in initialization of unused variable easeInQuart [./src/easing-functions.js:59,13]
Side effects in initialization of unused variable easeOutQuart [./src/easing-functions.js:61,13]
Side effects in initialization of unused variable easeInOutQuart [./src/easing-functions.js:63,13]
Side effects in initialization of unused variable easeInQuint [./src/easing-functions.js:68,13]
Side effects in initialization of unused variable easeOutQuint [./src/easing-functions.js:70,13]
Side effects in initialization of unused variable easeInOutQuint [./src/easing-functions.js:72,13]
Side effects in initialization of unused variable easeInSine [./src/easing-functions.js:77,13]
Side effects in initialization of unused variable easeOutSine [./src/easing-functions.js:79,13]
Side effects in initialization of unused variable easeInOutSine [./src/easing-functions.js:81,13]
Side effects in initialization of unused variable easeInExpo [./src/easing-functions.js:83,13]
Side effects in initialization of unused variable easeOutExpo [./src/easing-functions.js:85,13]
Side effects in initialization of unused variable easeInOutExpo [./src/easing-functions.js:87,13]
Side effects in initialization of unused variable easeInCirc [./src/easing-functions.js:103,13]
Side effects in initialization of unused variable easeOutCirc [./src/easing-functions.js:105,13]
Side effects in initialization of unused variable easeInOutCirc [./src/easing-functions.js:107,13]
Side effects in initialization of unused variable easeOutBounce [./src/easing-functions.js:112,13]
Side effects in initialization of unused variable easeInBack [./src/easing-functions.js:124,13]
Side effects in initialization of unused variable easeOutBack [./src/easing-functions.js:129,13]
Side effects in initialization of unused variable easeInOutBack [./src/easing-functions.js:134,13]
Side effects in initialization of unused variable elastic [./src/easing-functions.js:142,13]
Side effects in initialization of unused variable swingFromTo [./src/easing-functions.js:145,13]
Side effects in initialization of unused variable swingFrom [./src/easing-functions.js:152,13]
Side effects in initialization of unused variable swingTo [./src/easing-functions.js:157,13]
Side effects in initialization of unused variable bounce [./src/easing-functions.js:162,13]
Side effects in initialization of unused variable bouncePast [./src/easing-functions.js:174,13]
Side effects in initialization of unused variable easeFromTo [./src/easing-functions.js:186,13]
Side effects in initialization of unused variable easeFrom [./src/easing-functions.js:191,13]
Side effects in initialization of unused variable easeTo [./src/easing-functions.js:193,13]
Side effects in initialization of unused variable length [./src/token.js:343,12]
[14:54:57] Finished 'buildDeps' after 40 s
[14:54:57] Starting 'bundleLib'...
[14:55:02] Finished 'bundleLib' after 5.06 s
[14:55:02] Starting 'verifyBuild'...
[14:55:02] Build encountered 555 build errors
[14:55:02] The following tasks did not complete: build, verifyBuild
[14:55:02] Did you forget to signal async completion?
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build: `gulp build`
npm ERR! Exit status 1
npm ERR! 
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2020-04-30T14_55_02_886Z-debug.log
Error: error building at STEP "RUN cd frontend &&     npm run build": error while running runtime: exit status 1
make: *** [Makefile:50: base] Error 125

(note - I have no idea where this /root/.npm/_logs is - I don't have it on my computer).

@liranmauda
Copy link
Contributor

@mykaul
/root/.npm/_logs are in the layer that run (because it failed it does not exist...)
the layer that fails will look something like this (with a different hash):

Step 18/18 : RUN cd frontend &&     npm run build
 ---> Running in 0beecebdf704

the easiest way of getting that logs are running:
docker run -it --name <name > <hash> bash
then running it manually and copying the logs out and deleting the container afterward.

@mykaul
Copy link
Author

mykaul commented May 5, 2020

@liranmauda - might be a podman issue (the limits) - see containers/podman#6004

@liranmauda
Copy link
Contributor

@mykaul we might want to retest on podman v2 and up, according to this: containers/podman#6093 (comment)

@liranmauda liranmauda self-assigned this Aug 10, 2020
@mykaul
Copy link
Author

mykaul commented Aug 11, 2020 

ykaul@ykaul noobaa-core]$ sudo podman version
[sudo] password for ykaul: 
Version:      2.0.4
API Version:  1
Go Version:   go1.14.6
Built:        Thu Jan  1 02:00:00 1970
OS/Arch:      linux/amd64

Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json' 
[06:35:42] Finished 'bundleLib' after 8.96 s
[06:35:42] Starting 'verifyBuild'...
[06:35:42] Build encountered 575 build errors
[06:35:42] The following tasks did not complete: build, verifyBuild
[06:35:42] Did you forget to signal async completion?
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build: `gulp build`
npm ERR! Exit status 1
npm ERR! 
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2020-08-11T06_35_42_905Z-debug.log
Error: error building at STEP "RUN cd frontend &&     npm run build": error while running runtime: exit status 1
make: *** [Makefile:50: base] Error 125

And:

ykaul@ykaul noobaa-core]$ sudo podman run alpine grep open /proc/self/limits
Trying to pull registry.fedoraproject.org/alpine...
  manifest unknown: manifest unknown
Trying to pull registry.access.redhat.com/alpine...
  name unknown: Repo not found
Trying to pull registry.centos.org/alpine...
  manifest unknown: manifest unknown
Trying to pull docker.io/library/alpine...
Getting image source signatures
Copying blob df20fa9351a1 done  
Copying config a24bb40132 done  
Writing manifest to image destination
Storing signatures
Max open files            1048576              1048576              files

@liranmauda
Copy link
Contributor

Thanks @mykaul I will keep an eye on it.

@nimrod-becker
Copy link
Contributor

d/s builds are working, u/s uses docker

@mykaul
Copy link
Author

mykaul commented Apr 18, 2023

Haven't tested it in a while, but I expected upstream to use Podman as well (for rootless build - can Docker do it? - unsure)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@liranmauda liranmauda

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mykaul @nimrod-becker @liranmauda