Add self hosting

[rauchg]

• New build process

  ▲  ncc/ (self-host) npm run build
  
  > @zeit/[email protected] build /Users/rauchg/Projects/ncc
  > node scripts/build
  
  ncc: Skipping bundling "./index.js" per config
  ncc: Skipping bundling "chokidar" per config
  ✓ dist/cli.js (7.13KB)
  ✓ dist/index.js (4.67MB)
  

• Only dist files are published to npm
• Added -e option to provide module exclusions (passed to webpack as externals)
• Move all deps to dev deps
• Removed bundled dependencies
• Make tests run against built dist
• Improve stderr output to follow the unix convention of prefixing with the the program (ncc: )

[rauchg]

Tests bizarrely fail with
Error: Cannot find module './../../../../../../buildin/module.js'

Here's a simple reproduction:

▲  ncc/ (self-host) npm run build

> @zeit/[email protected] build /Users/rauchg/Projects/ncc
> node scripts/build

ncc: Skipping bundling "./index.js" per config
ncc: Skipping bundling "chokidar" per config
✓ dist/cli.js (7.13KB)
✓ dist/index.js (4.67MB)
▲  ncc/ (self-host) node src/cli.js test/integration/twilio.js -o twilio.js
▲  ncc/ (self-host) node twilio.js
▲  ncc/ (self-host) node dist/cli.js test/integration/twilio.js -o twilio.js
ncc: Module directory "/Users/rauchg/Projects/ncc/node_modules/lodash" attempted to require "./../../../../../../buildin/module.js" but could not be resolved, assuming external.
ncc: Module directory "/Users/rauchg/Projects/ncc/node_modules/moment" attempted to require "./../../../../../../buildin/module.js" but could not be resolved, assuming external.
▲  ncc/ (self-host) node twilio.js
internal/modules/cjs/loader.js:589
    throw err;
    ^

Error: Cannot find module './../../../../../../buildin/module.js'
    at Function.Module._resolveFilename (internal/modules/cjs/loader.js:587:15)
    at Function.Module._load (internal/modules/cjs/loader.js:513:25)
    at Module.require (internal/modules/cjs/loader.js:643:17)
    at require (internal/modules/cjs/helpers.js:22:18)
    at Object.<anonymous> (/Users/rauchg/Projects/ncc/twilio.js:36808:18)
    at __webpack_require__ (/Users/rauchg/Projects/ncc/twilio.js:21:30)
    at Object.<anonymous> (/Users/rauchg/Projects/ncc/twilio.js:17192:41)
    at __webpack_require__ (/Users/rauchg/Projects/ncc/twilio.js:21:30)
    at Object.<anonymous> (/Users/rauchg/Projects/ncc/twilio.js:54085:9)
    at __webpack_require__ (/Users/rauchg/Projects/ncc/twilio.js:21:30)

[sokra]

Looks great.

I was able to fix the problem with this:

• add node: false to the webpack config.
• copy the buildin folder from webpack into ncc.

Without this option webpack changes __dirname to "/". Now it leave it untouched.

webpack now expected its builtin modules at ../buildin relative to the bundle => ncc/buildin.

I would recommend to move the result dist/index.js to dist/something/index.js. This would make it expect the builtins at dist/buildin where you can copy them during the build process.

I looks into ways finding a better solution for webpack, considering that these are not many modules and we could inline the source as string into the webpack codebase.

Anyway this would be a solution for now.

[sokra]

@@ -47,6 +47,7 @@ module.exports = async (entry, { externals = [], minify = true } = {}) => {
     resolve: {
       extensions: SUPPORTED_EXTENSIONS
     },
+    node: false,
     externals: (...args) => resolveModule(...[...args, externals]),
     plugins: [
       {

[rauchg]

Good to merge. The only failing tests are the known ones:

  ✓ should evaluate apollo.js without errors (8041ms)
  ✓ should evaluate auth0.js without errors (2595ms)
  ✓ should evaluate aws-sdk.js without errors (1335ms)
  ✓ should evaluate axios.js without errors (415ms)
  ✓ should evaluate core-js.js without errors (599ms)
  ✓ should evaluate cowsay.js without errors (46ms)
  ✓ should evaluate env-var.js without errors (13ms)
  ✓ should evaluate express.js without errors (607ms)
  ✓ should evaluate firebase.js without errors (138ms)
  ✕ should evaluate google-datastore.js without errors (5231ms)
  ✓ should evaluate ioredis.js without errors (305ms)
  ✓ should evaluate jimp.js without errors (780ms)
  ✓ should evaluate json-without-ext.js without errors (14ms)
  ✓ should evaluate koa.js without errors (238ms)
  ✓ should evaluate mailgun.js without errors (19ms)
  ✓ should evaluate mariadb.js without errors (290ms)
  ✓ should evaluate memcached.js without errors (54ms)
  ✓ should evaluate mongoose.js without errors (1364ms)
  ✓ should evaluate mysql.js without errors (252ms)
  ✕ should evaluate pdfkit.js without errors (1077ms)
  ✓ should evaluate pg.js without errors (1506ms)
  ✓ should evaluate react.js without errors (148ms)
  ✓ should evaluate redis.js without errors (1388ms)
  ✓ should evaluate request.js without errors (1007ms)
  ✓ should evaluate rxjs.js without errors (737ms)
  ✕ should evaluate saslprep.js without errors (35ms)
  ✓ should evaluate sentry.js without errors (397ms)
  ✓ should evaluate stripe.js without errors (140ms)
  ✓ should evaluate twilio.js without errors (3521ms)