Yarn installation fails as dependencies cannot be fetched

[niclashedam]

Hi -- long time no see! 😄

I hope you are well. I am trying to download a fresh installation of Alfa and build it.
I, however, fail to install some or all dependencies. My yarn issues are constrained to the Alfa repository.

~/Development/alfa main
❯ node -v
v17.0.1

~/Development/alfa main
❯ yarn -v
3.0.2

~/Development/alfa main
❯ yarn install
➤ YN0000: ┌ Resolution step
➤ YN0060: │ @siteimprove/alfa-angular@workspace:packages/alfa-angular provides rxjs (p5a2b8) with version 7.3.0, which doesn't satisfy what @angular/core requests
➤ YN0002: │ @siteimprove/alfa-vue@workspace:packages/alfa-vue doesn't provide jsdom (pbb029), requested by jsdom-global
➤ YN0000: │ Some peer dependencies are incorrectly met; run yarn explain peer-requirements <hash> for details, where <hash> is the six-letter p-prefixed code
➤ YN0000: └ Completed
➤ YN0000: ┌ Fetch step
➤ YN0013: │ @babel/plugin-syntax-logical-assignment-operators@npm:7.10.4 can't be found in the cache and will be fetched from the remote registry
➤ YN0013: │ @babel/plugin-syntax-nullish-coalescing-operator@npm:7.8.3 can't be found in the cache and will be fetched from the remote registry
➤ YN0013: │ @babel/plugin-syntax-numeric-separator@npm:7.10.4 can't be found in the cache and will be fetched from the remote registry
➤ YN0013: │ @babel/plugin-syntax-object-rest-spread@npm:7.8.3 can't be found in the cache and will be fetched from the remote registry
➤ YN0013: │ @babel/plugin-syntax-optional-catch-binding@npm:7.8.3 can't be found in the cache and will be fetched from the remote registry
➤ YN0001: │ Error [ERR_STREAM_PREMATURE_CLOSE]: Premature close
    at new NodeError (node:internal/errors:371:5)
    at PassThrough.onclose (node:internal/streams/end-of-stream:122:30)
    at PassThrough.emit (node:events:390:28)
    at emitCloseNT (node:internal/streams/destroy:145:10)
    at processTicksAndRejections (node:internal/process/task_queues:82:21)
➤ YN0013: │ @babel/plugin-syntax-optional-chaining@npm:7.8.3 can't be found in the cache and will be fetched from the remote registry
➤ YN0001: │ Error [ERR_STREAM_PREMATURE_CLOSE]: Premature close
    at new NodeError (node:internal/errors:371:5)
    at PassThrough.onclose (node:internal/streams/end-of-stream:122:30)
    at PassThrough.emit (node:events:390:28)
    at emitCloseNT (node:internal/streams/destroy:145:10)
    at processTicksAndRejections (node:internal/process/task_queues:82:21)
➤ YN0013: │ @babel/plugin-syntax-top-level-await@npm:7.12.13 can't be found in the cache and will be fetched from the remote registry
➤ YN0001: │ Error [ERR_STREAM_PREMATURE_CLOSE]: Premature close
    at new NodeError (node:internal/errors:371:5)
    at PassThrough.onclose (node:internal/streams/end-of-stream:122:30)
    at PassThrough.emit (node:events:390:28)
    at emitCloseNT (node:internal/streams/destroy:145:10)
    at processTicksAndRejections (node:internal/process/task_queues:82:21)
➤ YN0013: │ @babel/plugin-syntax-typescript@npm:7.14.5 can't be found in the cache and will be fetched from the remote registry
➤ YN0001: │ Error [ERR_STREAM_PREMATURE_CLOSE]: Premature close
    at new NodeError (node:internal/errors:371:5)
    at PassThrough.onclose (node:internal/streams/end-of-stream:122:30)
    at PassThrough.emit (node:events:390:28)
    at emitCloseNT (node:internal/streams/destroy:145:10)
    at processTicksAndRejections (node:internal/process/task_queues:82:21)

[Jym77]

Hi 👋
Just tried with a fresh clone of Alfa and had no problem installing dependencies. (node v14.18.3, yarn v3.0.2)

Might be a node 17 issue: yarnpkg/berry#3597

[Jym77]

@niclashedam I'm seeing the same issue happen quite a lot with node v18, but the install work fine with yarn v16.
I am not sure what is causing this. For now, the workaround is to use node v16.

[Jym77]

@niclashedam We did some update in #1430 to support Node v18 and 20 (essentially updating some indirect dependency).

Can you try again and see if things are working now?

[niclashedam]

Still not there yet.

node -v
v19.4.0

yarn -v
1.22.18

yarn install
➤ YN0065: Yarn will periodically gather anonymous telemetry: https://yarnpkg.com/advanced/telemetry
➤ YN0065: Run yarn config set --home enableTelemetry 0 to disable

➤ YN0000: ┌ Resolution step
➤ YN0002: │ package-dependency-graph@npm:1.14.4 doesn't provide @types/node (p98d70), requested by ts-node
➤ YN0060: │ package-dependency-graph@npm:1.14.4 provides canvas (p219bf) with version 2.11.2, which doesn't satisfy what graphviz-cli requests
➤ YN0002: │ package-dependency-graph@npm:1.14.4 doesn't provide typescript (p8ddc7), requested by ts-node
➤ YN0000: │ Some peer dependencies are incorrectly met; run yarn explain peer-requirements <hash> for details, where <hash> is the six-letter p-prefixed code
➤ YN0000: └ Completed
➤ YN0000: ┌ Fetch step
➤ YN0013: │ yn@npm:3.1.1 can't be found in the cache and will be fetched from the remote registry
➤ YN0013: │ yocto-queue@npm:0.1.0 can't be found in the cache and will be fetched from the remote reg
➤ YN0013: │ z-schema@npm:5.0.2 can't be found in the cache and will be fetched from the remote regist
➤ YN0013: │ zod-validation-error@npm:1.3.1 can't be found in the cache and will be fetched from the r
➤ YN0013: │ zod@npm:3.21.4 can't be found in the cache and will be fetched from the remote registry
➤ YN0066: │ typescript@patch:typescript@npm%3A5.1.5#~builtin<compat/typescript>::version=5.1.5&hash=85af82: Cannot apply hunk #1
➤ YN0000: └ Completed in 28s 541ms
➤ YN0000: ┌ Link step
➤ YN0007: │ canvas@npm:2.11.2 must be built because it never has been before or the last one failed
➤ YN0007: │ puppeteer@npm:19.9.1 must be built because it never has been before or the last one failed
➤ YN0009: │ canvas@npm:2.11.2 couldn't be built successfully (exit code 1, logs can be found here: /private/var/folders/jv/tg1h44fj775c526bxj6zhzqm0000gn/T/xfs-2e696456/build.log)
➤ YN0000: └ Completed in 16s 399ms
➤ YN0000: Failed with errors in 45s 128ms

Completely clean repository by the way.

[Jym77]

Interesting. The CI runs with node 18 and 20 without problems.

This may be a problem with odd node versions (only the even ones are LTS, use of odd ones is discouraged in production builds, nodeJS itself recommend 18.16 for most users, and 19 is already past maintenance in Node's release schedule), and/or an issue with yarn classic (try using yarn berry or more recent, Alfa's package manager is currently yarn 3.5.0)

[niclashedam]

Sorry to disappoint!

node -v
v20.4.0

yarn -v
3.5.0

yarn install
➤ YN0000: ┌ Resolution step
➤ YN0002: │ package-dependency-graph@npm:1.14.4 doesn't provide @types/node (p98d70), requested by ts-node
➤ YN0060: │ package-dependency-graph@npm:1.14.4 provides canvas (p219bf) with version 2.11.2, which doesn't satisfy what graphviz-cli requests
➤ YN0002: │ package-dependency-graph@npm:1.14.4 doesn't provide typescript (p8ddc7), requested by ts-node
➤ YN0000: │ Some peer dependencies are incorrectly met; run yarn explain peer-requirements <hash> for details, where <hash> is the six-letter p-prefixed code
➤ YN0000: └ Completed
➤ YN0000: ┌ Fetch step
➤ YN0013: │ @changesets/get-release-plan@npm:3.0.17 can't be found in the cache and will be fetched f
➤ YN0013: │ @types/semver@npm:7.5.0 can't be found in the cache and will be fetched from the remote r
➤ YN0013: │ semver@npm:7.5.4 can't be found in the cache and will be fetched from the remote registry
➤ YN0013: │ typescript@npm:5.1.6 can't be found in the cache and will be fetched from the remote regi
➤ YN0013: │ typescript@patch:typescript@npm%3A5.1.6#~builtin<compat/typescript>::version=5.1.6&hash=8
➤ YN0066: │ typescript@patch:typescript@npm%3A5.1.6#~builtin<compat/typescript>::version=5.1.6&hash=85af82: Cannot apply hunk #1
➤ YN0019: │ @changesets-get-dependents-graph-npm-1.3.5-054d68707f-d7abb1da21.zip appears to be unused
➤ YN0019: │ @changesets-get-release-plan-npm-3.0.16-ceea7e56c3-ab8360c17f.zip appears to be unused -
➤ YN0019: │ @types-semver-npm-6.2.3-26e438d21e-83c86d7005.zip appears to be unused - removing
➤ YN0019: │ typescript-npm-5.1.5-bf4fdd8cdc-0eef8699e0.zip appears to be unused - removing
➤ YN0019: │ typescript-patch-8758d9b8da-33020c886b.zip appears to be unused - removing
➤ YN0000: └ Completed in 9s 509ms
➤ YN0000: ┌ Link step
➤ YN0007: │ canvas@npm:2.11.2 must be built because it never has been before or the last one failed
➤ YN0007: │ puppeteer@npm:19.9.1 must be built because it never has been before or the last one failed
➤ YN0009: │ canvas@npm:2.11.2 couldn't be built successfully (exit code 1, logs can be found here: /private/var/folders/jv/tg1h44fj775c526bxj6zhzqm0000gn/T/xfs-c9a6f646/build.log)
➤ YN0000: └ Completed in 3s 653ms
➤ YN0000: Failed with errors in 13s 342ms

[niclashedam]

I'm running this on M1 Mac (ARM, not Intel) if that could be the culprit. Has Alfa been tested on ARM?

[niclashedam]

Testing on c309a11 by the way.

[Jym77]

🤔 This seems to be the same problem as #1356 with canvas not distributing its binaries.

• Can you try, from an empty directory, to yarn add canvas (may need to yarn init first). If this also fails at canvas build time, then this is not really something we can fix Alfa side.
• canvas is only a devDependency of Alfa. I'm not sure about your use case. Do you really need to clone the repo, or can you just use the packages? Using the packages should avoid the problem with devDependencies.
• If you really need to clone the repo, you can also try to just remove the devDependencies to package-dependency-graph (in the toplevel package.json). This will prevent you from rebuilding the dependency graph, but I assume this is not something you'll directly need.
• Investigate problem with node v18 #1356 (comment) has some extra links into the problem. Notably some added stuff that is required to compile canvas locally (that should also show in the logfile reported by yarn install, third to last line in your logs). Installing these should let you compile it locally and make it work (yes, it is a bit messed up that canvas depends on external stuff…)