openclaw-parallels-smoke

name openclaw-parallels-smoke description Prepare, snapshot, run, rerun, debug, or interpret OpenClaw Parallels guest install, onboarding, gateway smoke, and upgrade checks across macOS, Windows, and Linux. OpenClaw Parallels Smoke Use this skill for Parallels guest workflows and smoke interpretation. Do not load it for normal repo work. Global rules Parallels is postpublish-confidence coverage by default, not a prerequisite for the bounded beta-publish phase. Run it against one exact published package version and record the Validation SHA + Tooling SHA run tuple that authorized that package. Validation SHA maps to its Code SHA or Release SHA; it is not a third release identity. A failed postpublish Parallels lane does not retroactively unpublish a beta. Classify it as product, harness/tooling/provenance, infrastructure/credential, or wrapper failure. Only a confirmed product defect enters the next beta. Use one coordinator and one lane per independent guest family. Diagnose and retry one failed family once, then reassess; do not restart the aggregate matrix automatically. Inventory existing VMs and snapshots before provisioning anything. When a preconfigured pristine snapshot matches the requested baseline, switch to it and reuse its user, tools, and base setup. Do not create a new VM, reinstall macOS, or rebuild the guest baseline for a "fresh" run. "Fresh" means restoring the closest existing pristine snapshot, not creating another snapshot. Do not create ad-hoc snapshots unless the user explicitly asks or no suitable baseline exists; restore the original snapshot and leave the guest stopped after an ad-hoc run. Inspect the snapshot state before restoring it. A pristine poweron snapshot can contain the preconfigured logged-in session; switch to it normally so Parallels resumes that session. Do not pass --skip-resume at test entry unless the run intentionally needs to discard the saved session and boot from the login window. --skip-resume is acceptable for final cleanup that must leave the restored source guest stopped. Gateway verification in smoke runs should use openclaw gateway status --deep --require-rpc unless the stable version being checked does not support it yet. Stable 2026.3.12 pre-upgrade diagnostics may require a plain gateway status --deep fallback. Treat precheck=latest-ref-fail on that stable pre-upgrade lane as baseline, not automatically a regression. Pass --json for machine-readable summaries. Per-phase logs land under .artifacts/parallels/openclaw-parallels-* by default. Override with OPENCLAW_PARALLELS_ARTIFACT_ROOT when a run needs another artifact volume. Do not run local and gateway agent turns in parallel on the same fresh workspace or session. Hard-cap every top-level Parallels lane with host timeout --foreground (or gtimeout --foreground if that is the available binary) so a stalled install, snapshot switch, or prlctl exec transport cannot consume the rest of the testing window. Defaults: macOS: 75m Linux: 75m Windows: 90m aggregate npm-update wrapper: 150m If a lane hits the cap, stop there, inspect the newest /tmp/openclaw-parallels-* run directory and phase log, then fix or rerun the smallest affected lane. Do not keep waiting on a capped lane. Actual OpenClaw npm install/update phases are a stricter signal than whole-lane caps: install phases should normally finish within 7 minutes, and update phases should normally show meaningful progress within 5 minutes. If a phase named install-main , install-latest , install-baseline , or install-baseline-package exceeds 420s, or a phase named update-dev / same-guest openclaw update exceeds 300s without new markers, start diagnosis from that phase log and guest process state. Current Windows update phases can still pass after roughly 10-15 minutes because doctor --fix may install bundled plugin runtime deps; keep the script hard cap near 20 minutes unless the log is truly stale. For a full OS matrix, prefer running independent guest-family lanes in parallel when host capacity allows: timeout --foreground 75m pnpm test:parallels:macos -- --json timeout --foreground 90m pnpm test:parallels:windows -- --json timeout --foreground 75m pnpm test:parallels:linux -- --json Keep each lane in its own shell/session and track the run directory for each one. Before starting the matrix, run any required host build/package gate to completion. When current-main tgz packaging is needed, the smoke scripts hold a shared package lock through pnpm build , inventory/staging, and npm pack ; if that lock is missing or broken, serialize the matrix instead of accepting concurrent dist mutation. Do not run multiple smoke lanes against the same guest family at once. Tahoe lanes share the host HTTP port, and Windows/Linux lanes can collide on snapshot restore/start state if two jobs touch the same VM concurrently. Do not run the aggregate pnpm test:parallels:npm-update wrapper in parallel with individual macOS/Windows/Linux smoke lanes; it touches the same guest families and snapshots. Do not start Parallels lanes while any unrelated host command may rebuild, clean, or restage dist ( pnpm build , pnpm ui:build , pnpm release:check , pnpm test:install:smoke , npm pack/install smoke, or Docker lanes that run package/build prep). Run unrelated build/package gates first, let them finish, then start the VM matrix. Concurrent dist mutation can make host npm pack fail with missing files and wastes a full VM cycle. While running or optimizing the matrix, record wall-clock duration per lane and the slowest phase from /tmp/openclaw-parallels-* logs. Use that timing before changing smoke order, timeouts, or helper behavior. If a host build changes tracked generated files such as src/canvas-host/a2ui/.bundle.hash , stop before spending VM time. Commit the generated artifact separately or fix the generator drift, then rerun the smallest affected lane. If main is moving under active multi-agent work, prefer a detached worktree pinned to one commit for long Parallels suites. The smoke scripts now verify the packed tgz commit instead of live git rev-parse HEAD , but a pinned worktree still avoids noisy rebuild/version drift during reruns. For openclaw update --channel dev lanes, remember the guest clones GitHub main , not your local worktree. If a local fix exists but the rerun still fails inside the cloned dev checkout, do not treat that as disproof of the fix until the branch has been pushed. For prlctl exec , pass the VM name before --current-user ( prlctl exec "$VM" --current-user ... ), not the other way around. If the workflow installs OpenClaw from a repo checkout instead of the site installer/npm release, finish by installing a real guest CLI shim and verifying it in a fresh guest shell. pnpm openclaw ... inside the repo is not enough for handoff parity. On macOS guests, prefer a user-global install plus a stable PATH-visible shim: install with NPM_CONFIG_PREFIX="$HOME/.npm-global" npm install -g . make sure ~/.local/bin/openclaw exists or ~/.npm-global/bin is on PATH verify from a brand-new guest shell with which openclaw and openclaw --version npm install then update Preferred entrypoint: pnpm test:parallels:npm-update For a macOS-only published release update check, use: timeout --foreground 75m pnpm test:parallels:npm-update -- --platform macos --package-spec openclaw@<old-version> --update-target <target-version-or-tag> --json This keeps the same-guest openclaw update --tag ... coverage and uses the shared macOS current-user/sudo fallback without starting Windows/Linux lanes. Required coverage: every release/update regression run must include both lanes: fresh snapshot -> install requested package/baseline -> smoke same guest baseline -> run the guest's installed openclaw update ... command -> smoke again The update lane must exercise OpenClaw's internal updater. Do not count a direct npm install -g <tgz-or-spec> or harness-side package swap as update-flow coverage; those are install smokes only. For published targets, install the old baseline package first (for example openclaw@2026.4.9 ), then run the installed guest CLI with the intended channel/tag (for example openclaw update --channel beta --yes --json ) and verify openclaw --version , openclaw update status --json , gateway RPC, and an agent turn after the command. For unpublished targets, pack the candidate on the host, serve the .tgz over the harness HTTP server, and point the guest updater at that served package. Prefer openclaw update --tag http://<host-ip>:<port>/openclaw-<version>.tgz --yes --json ; when channel persistence also matters, pass --channel <stable|beta> and set OPENCLAW_UPDATE_PACKAGE_SPEC to the same served URL in the guest update environment. The command under test must still be openclaw update , not direct npm. For unpublished local-fix validation, remember the old baseline updater code still controls the first hop. A fix that lives only in the new updater code cannot change that already-running old process; the served candidate must either keep package/plugin metadata compatible with the baseline host or the baseline itself must include the updater fix. For beta/stable verification, resolve the tag immediately before the run ( npm view openclaw@beta version dist.tarball or npm view openclaw@latest ... ). Tags can move while a long VM matrix is already running; restart the matrix when the intended prerelease appears after an earlier registry 404/tag-lag check. Use the configured secret workflow to inject only the provider keys needed by OpenAI/Anthropic lanes. Do not print secrets or env dumps; pass provider secrets through the guest exec environment. Same-guest update verification should set the default model explicitly to openai/gpt-5.4 before the agent turn and use a fresh explicit --session-id so old session model state does not leak into the check. The aggregate npm-update wrapper must resolve the Linux VM with the same Ubuntu fallback policy as parallels-linux-smoke.sh before both fresh and update lanes. Treat any Ubuntu guest with major version >= 24 as acceptable when the exact default VM is missing, preferring the newest versioned Ubuntu guest with a fresh poweroff snapshot. On Peter's current host today, use Ubuntu 26.04 . On macOS same-guest update checks, restart the gateway after the npm upgrade before gateway status / agent ; launchd can otherwise report a loaded service while the old process has exited and the fresh process is not RPC-ready yet. The npm-update aggregate's macOS update leg writes the guest update script as root, then runs it as the desktop user. If prlctl exec "$MACOS_VM" --current-user ... cannot authenticate, retry through plain root prlctl exec plus sudo -u <desktop-user> /usr/bin/env HOME=/Users/<desktop-user> USER=<desktop-user> LOGNAME=<desktop-user> PATH=/opt/homebrew/bin:/opt/homebrew/opt/node/bin:/usr/bin:/bin:/usr/sbin:/sbin ... . That is a Parallels transport fallback; still verify openclaw --version , gateway RPC, and an agent turn after the update. On Windows same-guest update checks, restart the gateway after the npm upgrade before gateway status / agent ; in-place global npm updates can otherwise leave stale hashed dist/* module imports alive in the running service. In those Windows same-guest update checks, do not treat one nonzero openclaw gateway restart as definitive failure. Current login-item restarts can report failure before the background service becomes observable again; follow with a longer RPC-ready wait and use gateway start only as a recovery step if readiness still never returns. After that Windows restart, do not trust one gateway status --deep --require-rpc call after a fixed sleep. Retry the RPC-ready probe for roughly 30 seconds and log each attempt; current guests can keep port 18789 bound while the fresh RPC endpoint is still coming up. For Windows same-guest update checks, prefer the done-file/log-drain PowerShell runner pattern over one long-lived prlctl exec ... powershell -EncodedCommand ... transport. The guest can finish successfully while the outer prlctl exec still hangs. The Windows same-guest update helper should write stage markers to its log before long steps like tgz download and npm install -g so the outer progress monitor does not sit on waiting for first log line during healthy but quiet installs. Linux same-guest update verification should also export HOME=/root , pass OPENAI_API_KEY via prlctl exec ... /usr/bin/env , and use openclaw agent --local ; the fresh Linux baseline does not rely on persisted gateway credentials. The npm-update wrapper now prints per-lane progress from the nested log files. If a lane still looks stuck, inspect the nested logs in runDir first ( macos-fresh.log , windows-fresh.log , linux-fresh.log , macos-update.log , windows-update.log , linux-update.log ) instead of assuming the outer wrapper hung. Each run writes both summary.json and summary.md ; read the markdown first for quick human triage, then the JSON/timings for automation. For full beta validation after a tag is published, prefer one command: timeout --foreground 150m pnpm test:parallels:npm-update -- --beta-validation beta3 --json This resolves beta3 to the latest *-beta.3 version, runs latest->that-version same-guest update coverage, and then runs fresh install smoke for that exact published target on the same selected OS matrix. Use --platform macos|windows|linux to narrow reruns. For beta 4 npm validation with agent turns, the known-good shape is: gtimeout --foreground 150m pnpm test:parallels:npm-update -- --beta-validation beta4 --model openai/gpt-5.4 --json Prefer the explicit beta4 alias over openclaw@beta when validating a specific prerelease number; npm tags can move. If the wrapper fails a lane, read the auto-dumped tail first, then the full nested lane log under .artifacts/parallels/openclaw-parallels-npm-update.* . Current known macOS update-lane transport signature when the fallback is missing or bypassed: Unable to authenticate the user. Make sure that the specified credentials are correct and try again. Treat that as Parallels current-user authentication before blaming npm or OpenClaw. A macOS packaged fresh install with global package directories or bundled files mode 0777 usually means the harness used the root prlctl exec fallback under a permissive umask. The POSIX guest transports should prepend umask 022 ; verify the phase preflight line before blaming npm. CLI invocation footgun The Parallels smoke shell scripts should tolerate a literal bare -- arg so pnpm test:parallels:* -- --json and similar forwarded invocations work without needing to call bash scripts/e2e/... directly. macOS flow Preferred entrypoint: pnpm test:parallels:macos parallels-macos-smoke.sh --mode fresh --target-package-spec openclaw@<version> is an install smoke only. For published old-version -> new-version update coverage on macOS, prefer the npm-update wrapper with --platform macos ; parallels-macos-smoke.sh --mode upgrade --target-package-spec ... installs the target package and does not exercise the baseline CLI's updater. Default upgrade coverage on macOS should now include: fresh snapshot -> site installer pinned to the latest stable tag -> openclaw update --channel dev on the guest. Treat this as part of the default Tahoe regression plan, not an optional side quest. parallels-macos-smoke.sh --mode upgrade should run that release-to-dev lane by default. Keep the older host-tgz upgrade path only when the caller explicitly passes --target-package-spec . Because the default upgrade lane no longer needs a host tgz, skip npm pack + host HTTP server startup for --mode upgrade unless --target-package-spec is set. Keep the pack/server path for fresh and both . If that release-to-dev lane fails with reason=preflight-no-good-commit and repeated sh: pnpm: command not found tails from preflight build , treat it as an updater regression first. The fix belongs in the git/dev updater bootstrap path, not in Parallels retry logic. Until the public stable train includes that updater bootstrap fix, the macOS release-to-dev lane may seed a temporary guest-local pnpm shim immediately before openclaw update --channel dev . Keep that workaround scoped to the smoke harness and remove it once the latest stable no longer needs it. In Tahoe prlctl exec --current-user runs, prefer explicit node .../openclaw.mjs ... invocations for the release->dev handoff itself and for post-update verification. The shebanged global openclaw wrapper can fail with env: node: No such file or directory , and self-updating through the wrapper is a weaker lane than invoking the entrypoint under a fixed node . Default to the snapshot closest to macOS 26.5 latest . On Peter's Tahoe VM, fresh-latest-march-2026 can hang in prlctl snapshot-switch ; if restore times out there, rerun with --snapshot-hint 'macOS 26.5 latest' before blaming auth or the harness. parallels-macos-smoke.sh now retries snapshot-switch once after force-stopping a stuck running/suspended guest. If Tahoe still times out after that recovery path, then treat it as a real Parallels/host issue and rerun manually. The macOS smoke should include a dashboard load phase after gateway health: resolve the tokenized URL with openclaw dashboard --no-open , verify the served HTML contains the Control UI title/root shell, then open Safari and require an established localhost TCP connection from Safari to the gateway port. For Tahoe fresh.gateway-status , prefer non-TTY prlctl exec --current-user ... openclaw gateway status ... plus a few short retries. prlctl enter can spam TTY control bytes and hang the phase log even when the CLI itself is healthy. If a Tahoe lane times out in fresh.first-agent-turn and the phase log stops right after __OPENCLAW_RC__:0 from models set , suspect the prlctl enter / expect wrapper before blaming auth or the model lane. That pattern means the first guest command finished but the transport never released for the next guest_current_user_cli call. If a packaged install regresses with 500 on / , /healthz , or __openclaw/control-ui-config.json after fresh.install-main or upgrade.install-main , suspect bundled plugin runtime deps resolving from the package root node_modules rather than dist/extensions/*/node_modules . Repro quickly with a real npm pack /global install lane before blaming dashboard auth or Safari. prlctl exec is fine for deterministic repo commands, but use the guest Terminal or prlctl enter when installer parity or shell-sensitive behavior matters. Multi-word openclaw agent --message ... checks should go through a guest shell wrapper ( guest_current_user_sh / guest_current_user_cli or /bin/sh -lc ... ), not raw prlctl exec ... node openclaw.mjs ... , or the message can be split into extra argv tokens and Commander reports too many arguments for 'agent' . The same wrapper rule applies when bypassing --current-user : write a tiny /tmp/*.sh on the guest and execute /bin/bash /tmp/*.sh through the sudo desktop-user environment. Do not pass openclaw agent --message '...' directly as one raw prlctl exec command. When ref-mode onboarding stores OPENAI_API_KEY as an env secret ref, the post-onboard agent verification should also export OPENAI_API_KEY for the guest command. The gateway can still reject with pairing-required and fall back to embedded execution, and that fallback needs the env-backed credential available in the shell. On the fresh Tahoe snapshot, brew exists but node may be missing from PATH in noninteractive exec. Use /opt/homebrew/bin/node when needed. Fresh host-served tgz installs should install as guest root with HOME=/var/root , then run onboarding as the desktop user via prlctl exec --current-user . Root-installed tgz smoke can log plugin blocks for world-writable extensions/* ; do not treat that as an onboarding or gateway failure unless plugin loading is the task. Windows flow This repo owns the general Windows VM lifecycle: remote prlctl management, clean-state checks, WSL 2, Git/Node, snapshot creation/restoration, and OpenClaw smoke. Assume Parallels Desktop is installed/activated and a Windows 11 VM has been downloaded, then run: pnpm test :parallels:windows:prepare -- inventory pnpm test :parallels:windows:prepare -- prepare pnpm test :parallels:windows:prepare -- verify prepare inventories before mutation, requires Parallels Tools and a logged-in desktop session, rejects OpenClaw CLI/app/tray/process state and WSL distros, creates a dated power-off clean-OS snapshot only on an unprepared guest, enables WSL/Virtual Machine Platform, installs the signed Microsoft WSL package, sets WSL 2 as default, installs Git and Node/npm, verifies the Windows hypervisor is active and no reboot is pending, and creates a power-off pre-openclaw-native-e2e-<date> snapshot. When today's E2E snapshot already exists, prepare restores and verifies that snapshot instead of trusting its name. Treat prepare as destructive to post-snapshot guest changes, just like an explicit restore. Package elevation resolves the exact version and SHA-256 from Microsoft's official WinGet manifests, validates the expected Authenticode publisher, and copies into a freshly ACL-restricted SYSTEM directory before execution. Keep this generic mechanism here; companion-specific package choices stay in the Windows app repo. Restore clean , e2e , an exact name, or an id: pnpm test :parallels:windows:prepare -- restore --snapshot e2e Restoring discards all post-snapshot changes. Inventory first and do not restore while another developer or lane owns the VM. e2e selects the newest pre-openclaw-native-e2e-* ; use an exact snapshot for historical reproduction. For native companion work, read ../../../../openclaw-windows-node/.agents/skills/openclaw-proof-validation/PARALLELS.md . That optional macOS sidecar reuses this controller and adds only .NET, Windows SDK, WebView2, the app checkout, app-layer snapshots, build/tests, and native proof. Preferred entrypoint: pnpm test:parallels:windows Use the newest verified pre-openclaw-native-e2e-* snapshot and pass its exact name with --snapshot-hint . Default upgrade coverage on Windows should now include: fresh snapshot -> site installer pinned to the requested stable tag -> openclaw update --channel dev on the guest. Keep the older host-tgz upgrade path only when the caller explicitly passes --target-package-spec . Optional exact npm-tag baseline on Windows: bash scripts/e2e/parallels-windows-smoke.sh --mode upgrade --target-package-spec openclaw@<tag> --json . That lane installs the published npm tarball as baseline, then runs openclaw update --channel dev . Optional forward-fix Windows validation: bash scripts/e2e/parallels-windows-smoke.sh --mode upgrade --upgrade-from-packed-main --json . That lane installs the packed current-main npm tgz as baseline, then runs openclaw update --channel dev . Always use prlctl exec --current-user ; plain prlctl exec lands in NT AUTHORITY\\SYSTEM . Prefer explicit npm.cmd and openclaw.cmd . Use PowerShell only as the transport with -ExecutionPolicy Bypass , then call the .cmd shims from inside it. Current Windows Node installs expose corepack as a .cmd shim. If a release-to-dev lane sees corepack on PATH but openclaw update --channel dev still behaves as if corepack is missing, treat that as an exec-shim regression first. If an exact published-tag Windows lane fails during preflight with npm run build and 'pnpm' is not recognized , remember that the guest is still executing the old published updater. Validate the fix with --upgrade-from-packed-main , then wait for the next tagged npm release before expecting the historical tag lane to pass.