chore: pin the internal dependency tree and audit the production one (#570)

A library that gets installed into someone else's backend is judged partly on
what its own install pulls down. Three changes tighten that, and two questions
turned out to need no change at all.

The line this draws is what ships. Every dependency that stays inside the
repository is now pinned to the exact version the lockfile already resolved:
all 27 devDependencies across the four workspaces, plus the private release
bot's own zod. The lockfile change is 28 spec lines with no
resolution moved, no entry added or removed, and all 61 platform-specific
entries intact. A new root .npmrc sets save-exact=true so the next one arrives
pinned rather than as a range nobody notices.

What a consumer installs keeps its range: `dependencies` in packages/core, the
only published runtime block here, every `peerDependencies`, and otel's core
compatibility range. An exact version in those blocks overrides the consumer's
own resolution and stops their `npm audit fix` from reaching a patched build
until we cut a release, which is a worse trade than the install-time drift it
prevents. save-exact will still pin a new dependency added to one of them, so
the package job now asserts all three published manifests and fails when one
is left exact, next to the assertion that already covers otel's range.

min-release-age is deliberately not set. It first shipped in npm 11.10.0, and
the CI matrix runs Node 20 and 22, which bundle npm 10.8.2 and 10.9.8. Those
two accept the key, echo it back from `npm config get`, and never act on it,
so a quarantine window would hold on one leg of the matrix while silently
doing nothing on the other two. It also has no effect on `npm ci`, which
installs the lockfile verbatim.

Every `npm ci` that installs this repository's own tree now passes
--ignore-scripts, so a compromised dependency cannot run an install hook on a
runner that holds release credentials. Only three dependencies declare a
postinstall at all, and the full lint, test, build, scaffold, and example
suites pass on a tree installed that way. The `npm install` calls that stand
in for a real consumer are deliberately left alone: their job is to reproduce
what a user's install actually does, and hardening them would make the smoke
tests prove less than they claim.

A new scheduled Supply chain audit workflow asks two questions about the
dependencies that reach a consumer, an hour before the weekly release bot so a
finding lands before the release PR is drafted. --omit=dev is the point of
running it separately: auditing the full tree reports eighteen advisories,
every one of them in test and fixture tooling that never ships, and a
permanently red job is one nobody reads. The two steps fail differently.
`npm audit` reports into the run summary, because a new upstream advisory is
not this repository misbehaving and may have no fixed version yet.
`npm audit signatures` fails, because it compares served bytes against the
registry's own signature, so a mismatch is tampering rather than churn; all
27 production packages verify today.

Two things needed no change. npm provenance is already live: publish.yml
publishes through npm trusted publishing with id-token: write, which attaches
SLSA attestations on its own, and every version since core 1.16.0, otel 0.1.2,
and create-oma-app 0.8.1 carries one. And .npmrc left .gitignore in #198
because it only restated the default registry; it comes back tracked, with the
ignore rule narrowed so a contributor's own nested .npmrc stays out.
This commit is contained in:
Jack Chen authored and GitHub committed 2026-09-04 01:01:09 +08:00
1 parent 72af1c5661
commit 98516cedfc
16 files changed
+220 -65

No files matched your search

+27 -5
View File
@@ -23,7 +23,7 @@ jobs:
with:
node-version: 22
cache: npm
- run: npm ci
- run: npm ci --ignore-scripts
- run: npm run lint
test:
@@ -38,7 +38,7 @@ jobs:
with:
node-version: ${{ matrix.node-version }}
cache: npm
- run: npm ci
- run: npm ci --ignore-scripts
- run: npm test
coverage:
@@ -53,7 +53,7 @@ jobs:
with:
node-version: 22
cache: npm
- run: npm ci
- run: npm ci --ignore-scripts
- run: npm run test:coverage
- uses: codecov/codecov-action@v5
with:
@@ -70,7 +70,7 @@ jobs:
with:
node-version: 22
cache: npm
- run: npm ci
- run: npm ci --ignore-scripts
- run: npm run build
- name: Smoke-test that the built entry points import and the CLI runs
working-directory: packages/core
@@ -112,6 +112,28 @@ jobs:
exit 1
fi
done
- name: Assert the published dependency blocks stay semver ranges
run: |
set -euo pipefail
# save-exact=true in the root .npmrc pins whatever `npm install`
# saves. That is right for the tree that never leaves this
# repository and wrong for the blocks a consumer installs: an exact
# version there overrides their own resolution and stops their
# `npm audit fix` from reaching a patched build until we cut a
# release. A new dependency added to one of these has to be widened
# by hand, so assert it rather than trusting the habit.
fail=0
for manifest in packages/core/package.json packages/otel/package.json packages/create-oma-app/package.json; do
for block in dependencies peerDependencies; do
pinned=$(jq -r --arg b "$block" '(.[$b] // {}) | to_entries[] | select(.value | test("^[0-9]")) | "\(.key)@\(.value)"' "$manifest" | tr '\n' ' ')
if [ -n "$pinned" ]; then
echo "::error::$manifest .$block ships to consumers and must stay semver ranges, but these are exact: $pinned"
fail=1
fi
done
done
test "$fail" -eq 0
- name: Typecheck the create-oma-app template against core
run: npm run typecheck:template -w create-oma-app
- name: Assert the npm tarball ships exactly the expected files
@@ -232,6 +254,6 @@ jobs:
with:
node-version: 22
cache: npm
- run: npm ci
- run: npm ci --ignore-scripts
- name: End-to-end scaffold smoke test (pack -> generate -> install -> run gate)
run: npm run test:scaffold
+1 -1
View File
@@ -22,7 +22,7 @@ jobs:
with:
node-version: 22
cache: npm
- run: npm ci
- run: npm ci --ignore-scripts
- name: Require the DeepSeek canary credential
env:
DEEPSEEK_API_KEY: ${{ secrets.DEEPSEEK_API_KEY }}
+1 -1
View File
@@ -103,7 +103,7 @@ jobs:
node-version: 24
registry-url: https://registry.npmjs.org
- run: npm ci
- run: npm ci --ignore-scripts
- run: npm run build
- name: Publish missing packages, tag, and create the GitHub Release
+1 -1
View File
@@ -56,7 +56,7 @@ jobs:
node-version: 24
cache: npm
- run: npm ci
- run: npm ci --ignore-scripts
- name: Configure auditable bot commit identity
env:
+98
View File
@@ -0,0 +1,98 @@
name: Supply chain audit
# Two questions about the dependencies that actually reach a consumer of the
# published packages, asked on a schedule rather than on every pull request.
#
# `--omit=dev` is the whole point of running this separately. A full audit of
# this repository reports well over a dozen advisories, every one of them in
# the development tree (test runner, provider SDK fixtures, scaffolder
# tooling) where nothing ships to npm. Auditing that tree on a schedule would
# produce a permanently red job that everyone learns to ignore. The production
# tree is small enough that a finding in it is worth reading.
#
# The two steps fail differently on purpose:
#
# - `npm audit` REPORTS. A new advisory upstream is not this repository
# misbehaving, and there may be no fixed version to move to yet. The
# finding lands in the run summary; a maintainer decides what it means.
# - `npm audit signatures` FAILS. It compares the bytes npm served against
# the registry's own signature, so a mismatch is a tampering or corruption
# signal rather than upstream churn. Every production package verifies
# today, so this starts green and only turns red when something is wrong.
#
# Neither step gates a pull request. Scheduling this an hour before the weekly
# release bot means a finding is on the record before the release PR is drafted.
on:
workflow_dispatch:
schedule:
# Friday 09:41 UTC, an hour ahead of the release bot's 10:23. Off the top
# of the hour for the same reason release-bot.yml documents: the most
# contended slot is the one GitHub is most likely to drop.
- cron: '41 9 * * 5'
permissions:
contents: read
concurrency:
group: supply-chain-audit-${{ github.ref }}
cancel-in-progress: false
jobs:
audit:
runs-on: ubuntu-latest
timeout-minutes: 15
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with:
node-version: 22
cache: npm
- run: npm ci --ignore-scripts
- name: Report advisories against the production dependency tree
run: |
set -uo pipefail
npm audit --omit=dev --json > "$RUNNER_TEMP/audit.json"
audit_exit=$?
npm audit --omit=dev > "$RUNNER_TEMP/audit.txt" 2>&1 || true
cat "$RUNNER_TEMP/audit.txt"
# A non-zero exit means either "advisories found" or "the audit could
# not run", and only the second one is this workflow's problem. A
# registry failure still writes well-formed JSON, so check for the
# metadata block rather than trusting the exit code or the parse.
if ! node -e 'const r = JSON.parse(require("node:fs").readFileSync(process.argv[1], "utf8")); if (r.error || !r.metadata?.vulnerabilities) process.exit(1)' "$RUNNER_TEMP/audit.json"; then
echo "::error::npm audit did not produce a report (exit $audit_exit); the production tree was not actually checked"
exit 1
fi
node - "$RUNNER_TEMP/audit.json" "$RUNNER_TEMP/audit.txt" <<'REPORT' >> "$GITHUB_STEP_SUMMARY"
const fs = require('node:fs')
const report = JSON.parse(fs.readFileSync(process.argv[2], 'utf8'))
const counts = report.metadata?.vulnerabilities ?? {}
const total = counts.total ?? 0
console.log('## Production dependency advisories\n')
console.log(`Audited \`${report.metadata?.dependencies?.prod ?? '?'}\` production dependencies with \`npm audit --omit=dev\`.\n`)
if (total === 0) {
console.log('No advisories against the dependencies that reach a consumer of the published packages.')
} else {
console.log('| Severity | Count |')
console.log('|---|---|')
for (const level of ['critical', 'high', 'moderate', 'low', 'info']) {
if (counts[level]) console.log(`| ${level} | ${counts[level]} |`)
}
console.log('')
console.log('<details><summary>Full report</summary>\n')
console.log('```')
console.log(fs.readFileSync(process.argv[3], 'utf8').trimEnd())
console.log('```\n')
console.log('</details>\n')
console.log('This step reports rather than fails. Decide whether the advisory reaches a caller of the published packages before acting on it.')
}
REPORT
- name: Verify registry signatures and provenance attestations
run: npm audit signatures --omit=dev