Skip to content

Centralize chain provider ownership#97

Draft
pgherveou wants to merge 47 commits into
mainfrom
codex/centralize-chain-provider-ownership
Draft

Centralize chain provider ownership#97
pgherveou wants to merge 47 commits into
mainfrom
codex/centralize-chain-provider-ownership

Conversation

@pgherveou

@pgherveou pgherveou commented Jul 22, 2026

Copy link
Copy Markdown
Collaborator

Depends on #70.

Summary

  • add one canonical asynchronous chain connection API for Rust Core and host consumers
  • keep physical smoldot and RPC providers inside the protocol runtime
  • retain one thin PAPI adapter over the canonical connection
  • preserve gateway Bulletin support without changing product feature reporting
  • route People through the protocol iframe in SharedWorker mode because Statement Store discovery needs browser WebRTC
  • add typed connection failures, lifecycle cleanup, broker routing coverage, import restrictions, and quieter smoldot logging

Why

Rust Core chain calls bypassed the protocol broker and could create competing smoldot wrappers over the same destructive response queue. Responses and subscription acknowledgements could be consumed by the wrong wrapper, leaving Statement Store calls waiting indefinitely.

This change makes the protocol runtime the only physical provider owner and gives each runtime one upstream response consumer per genesis hash.

Follow-up

Connection, subscription acknowledgement, and submit acknowledgement deadlines plus cancellation propagation during subscription setup remain out of scope.

pgherveou added 30 commits July 15, 2026 11:03
Replace the Nova host-container, auth, and signing path with the worker-backed Rust core. Keep dotli responsible only for browser policy, persistence, UI, and physical chain transports.
Notification grants do not alter iframe Permissions Policy. Reloading disposed the in-flight Rust request before its response reached the product.
The pending-message flush drops send failures silently, matching the
pre-port behavior. Surfacing them as JSON-RPC errors moves to a
follow-up PR with test coverage.
…follow-up

Keep @polkadot-api/signer and @polkadot-labs/hdkd{,-helpers} declared
(unused since before the port) and limit rpc-chain tests to the new
core gateway provider surface. Removing the dead deps and adding
coverage for pre-existing chain checks moves to a follow-up PR.
Keep the base panel top offset and suffix-based terminator matching
(minus the removed host-papp events). The offset correction, the
exact-match terminator set, and the @dotli/config dependency
declaration move to a follow-up PR.
Prompts always reach the modal, matching the pre-port behavior. The
sliding-window limiter returns in a follow-up PR together with the
denied-path semantics and a test that trips the window.
AllowanceKeys persist as plain hex through the same path as every
other core storage key. The at-rest cipher moves to a follow-up PR
where the scheme (per-write nonce, plain-hex read fallback) can get a
focused security review.
The bridge emits only the first_inbound/first_outbound lifecycle
events. The per-frame TrUAPI tap that feeds the debug panel timeline
returns in a follow-up PR; the panel's truapi event handling stays in
place and receives no events until then.
… follow-up

Login failures fall back to the raw reason except for the base
OriginPersonProviderError mapping, and the permissions popover renders
last-write-wins without a staleness guard or unavailable-state hint.
The failure-message pack and popover hardening move to a follow-up PR.
…i-host 0.1.0

The published packages replace the temporary personal-scope npm
aliases used while the port was in review.
bun run link:truapi replaces the two installed TrUAPI npm packages with
symlinks to a sibling TrUAPI checkout, and bun run unlink:truapi runs a
forced frozen install to restore the declared packages. Package
resolution is validated after linking so local E2E cannot silently
exercise a stale npm build. The parent truapi repo's make e2e-dotli
target depends on this script via make dotli-link.
getActiveGatewayChains and its doc comment match the pre-port source;
only the core gateway set is new.
Nova exposes synthetic follow ids to legacy products, while the Rust core requires the subscription wire request id. Translate only at the legacy window boundary so existing product-sdk apps keep working without weakening core validation.
All OpenUrl requests are normalized and scheme-validated by the Rust core before they reach this browser callback, so duplicating that policy in TypeScript would create a second allowlist that can drift.

Add the noopener window feature to every routing branch instead. This prevents an allowed destination from retaining window.opener access to the dotli host while preserving the existing dot-domain, localhost, and external URL routing behavior.

Cover all three branches with a regression test that verifies each new tab is opened with noopener.
Changing a permission dispatched a synchronous permission-changed event whose listener started rendering the open popover, then the dropdown success path started a second render directly. Both asynchronous renders appended their rows after the same clear, doubling every entry.

Remove only the redundant success-path render and keep the catch-path render for recovery. The permission event remains the single successful refresh trigger for both device and non-device permissions.

Add a regression test that changes a dropdown and asserts the popover still contains exactly one row per permission.
The topbar login promise previously listened only for response frames. If the core provider closed during pairing, no response could arrive and the pending promise retained its message subscription indefinitely.

Subscribe to provider close events and reject with the transport error. Centralize settlement and cleanup so message responses, malformed frames, send failures, and provider closure all unsubscribe both listeners exactly once.

The cleanup also handles the provider contract where an already-closed provider invokes the close callback during subscription. Add a regression test that closes a pending provider and verifies rejection plus listener cleanup.
The confirmation adapter already rendered and resolved the newer review variants, but its suite exercised only legacy payload signing and omitted transaction creation and the dedicated preimage flow.

Add product-account payload and transaction assertions so account formatting and transaction fields are locked down. Add both allow and cancel cases for preimage submission to verify that the dedicated modal maps user intent to the boolean host response.

This intentionally changes tests only: the existing production behavior satisfies the review request once these untested branches are covered.
The legacy window transport accepted inbound frames based only on Window identity and sent outbound frames with a wildcard target. The iframe keeps its real origin because its sandbox includes allow-same-origin; credentialless mode does not make that origin opaque.

Require the resolved product origin for inbound provider frames, use it as the outbound postMessage target, and enforce it on the initial modern-versus-legacy probe before replaying the first frame. This closes the wildcard path without changing the legacy Nova wire compatibility layer.

Add coverage for the exact outbound target and for rejecting both wrong-origin and wrong-source inbound messages.
Preimage lookup trusted non-empty bytes returned by both the IPFS gateway and Bitswap and cached them under the requested key. A faulty or hostile backend could therefore poison the process-wide cache and serve mismatched bytes to later subscribers.

Recompute the requested Blake2b-256 content hash with the existing content verification utility before either cache write. Verification failures follow the existing backend-error stream path and never populate the cache.

Cover successful verified caching and corrupt responses from both backend modes. The corruption cases subscribe twice to prove that rejected bytes are fetched again rather than retained.
Link one TrUAPI client across dotli and the product so local runs exercise the same runtime end to end. Surface authentication progress while pairing finalizes.
pgherveou added 14 commits July 20, 2026 11:54
PAPI registers Function.prototype as a WebSocket no-op. Sentry's BrowserApiErrors wrapper then marks the prototype and makes later event listeners resolve to that no-op.
Resolve the dependency audit advisories by locking patched fast-uri and brace-expansion releases within existing dependency ranges.
Independent providers drained the same smoldot response queue, allowing
concurrent Statement Store calls to steal replies.
Override AJV's transitive fast-uri to 3.1.4 to address
GHSA-v2hh-gcrm-f6hx.
Route Rust Core and host RPC through logical protocol connections so each runtime has one upstream response consumer per genesis hash.

Keep People in the protocol iframe under SharedWorker mode because statement discovery requires browser WebRTC unavailable in SharedWorkerGlobalScope.
@github-actions

Copy link
Copy Markdown
Contributor

⚡ Performance Report

⚠️ No baseline found on main. This PR's results are recorded but cannot be compared.
Merge to main to establish a baseline.

@github-actions

github-actions Bot commented Jul 22, 2026

Copy link
Copy Markdown
Contributor

Bundle Size Report

Chunks over 500 KB:

File Raw Brotli Gzip
host/assets/wasm/web/truapi_server_bg.wasm 1.96 MB 617.3 KB 812.7 KB
Total 2.85 MB (+2.15 MB) 930.5 KB (+688.0 KB) (-68%) 1.13 MB (+889.8 KB)
All files
File Raw Brotli Gzip
host/.well-known/apple-app-site-association 738 B 738 B 738 B
host/.well-known/assetlinks.json 1.3 KB 317 B 391 B
host/assets/access-raw-storage.js 18.0 KB 6.0 KB 6.6 KB
host/assets/blake2.js 16.1 KB (+6.0 KB) 5.3 KB (+2.1 KB) 6.0 KB (+2.3 KB)
host/assets/bridge.js 54.2 KB (+48.8 KB) 15.5 KB (+13.7 KB) 17.7 KB (+15.6 KB)
host/assets/browser.js 22.9 KB (-10 B) 7.6 KB (+19 B) 8.6 KB (-9 B)
host/assets/client.js 100.1 KB (+6.9 KB) 29.4 KB (+2.0 KB) 32.4 KB (+2.2 KB)
host/assets/dist.js 23.0 KB (-1.9 KB) 8.2 KB (+496 B) 9.2 KB (+589 B)
host/assets/dotli-debug-bus.js 646 B (+151 B) 646 B (+151 B) 646 B (+151 B)
host/assets/hex.js 153 B 153 B 153 B
host/assets/index.css 44.8 KB (-3.1 KB) 7.1 KB (-382 B) 7.9 KB (-423 B)
host/assets/index.js 139.2 KB (+32.6 KB) 38.1 KB (+9.0 KB) 44.5 KB (+10.6 KB)
host/assets/panel.js 72.5 KB (-12.3 KB) 19.7 KB (-3.3 KB) 22.3 KB (-4.0 KB)
host/assets/rpc-resolve.js 32.7 KB (+30.2 KB) 10.4 KB (+9.3 KB) 11.4 KB (+10.2 KB)
host/assets/shared-mode.js 1.8 KB (-82 B) 746 B (-47 B) 848 B (-47 B)
host/assets/src.js 1.8 KB (-119 B) 849 B (-41 B) 947 B (-54 B)
host/assets/styles.css 15.1 KB 3.2 KB 3.8 KB
host/assets/wasm/web/README.md 10.9 KB 10.9 KB 10.9 KB
host/assets/wasm/web/package.json 371 B 371 B 371 B
host/assets/wasm/web/truapi_server.d.ts 6.9 KB 6.9 KB 6.9 KB
host/assets/wasm/web/truapi_server.js 35.6 KB 6.2 KB 7.2 KB
host/assets/wasm/web/truapi_server_bg.wasm 1.96 MB 617.3 KB 812.7 KB
host/assets/wasm/web/truapi_server_bg.wasm.d.ts 2.5 KB 2.5 KB 2.5 KB
host/assets/web.js 13.2 KB 3.6 KB 4.0 KB
host/assets/worker-runtime.js 6.3 KB 1.6 KB 1.8 KB
host/assets/worker-runtime.js 106 B 106 B 106 B
host/dotli.png 11.5 KB 11.5 KB 11.5 KB
host/favicon.svg 1.8 KB 1.8 KB 1.8 KB
host/host-sw.js 2.5 KB (-309 B) 1.0 KB (-52 B) 1.2 KB (-62 B)
host/icon-192.png 12.5 KB 12.5 KB 12.5 KB
host/icon-512.png 42.8 KB 42.8 KB 42.8 KB
host/index.html 19.6 KB (-605 B) 4.3 KB (-187 B) 5.2 KB (-210 B)
host/manifest.webmanifest 441 B 441 B 441 B
host/workbox.js 14.8 KB 4.6 KB 5.1 KB
sandbox/app-sw.js 9.6 KB 3.1 KB (+4 B) 3.5 KB (-3 B)
sandbox/assets/bitswap-bridge.js 840 B 840 B 840 B
sandbox/assets/fetch.js 3.4 KB 1.2 KB (-1 B) 1.4 KB
sandbox/assets/index.css 44.8 KB (-3.1 KB) 7.1 KB (-382 B) 7.9 KB (-423 B)
sandbox/assets/index.js 118.0 KB 33.7 KB (+16 B) 39.6 KB
sandbox/favicon.svg 1.8 KB 1.8 KB 1.8 KB
sandbox/index.html 1.7 KB 579 B (-5 B) 784 B (-3 B)
Total 2.85 MB (+2.15 MB) 930.5 KB (+688.0 KB) (-68%) 1.13 MB (+889.8 KB)

Commit: ace4b5e

@pgherveou pgherveou mentioned this pull request Jul 22, 2026
2 tasks
@dotli/protocol/errors now imports @dotli/shared/errors, which put a
@dotli/shared module into the functional specs' import chain for the
first time (loading.spec.ts -> apps/host/src/errors.ts ->
@dotli/protocol/errors). The extensionless exports target (./src/*)
resolves under Vite/Vitest but not under Playwright-on-Bun, so every
spec failed to load and the Functional job collected 0 tests. Match
the .ts-qualified pattern the other workspace packages use.
isChainConnectionErrorCode had no callers, and no producer emits a
chain-halt message, so validate-on-arrival and the halt reason field
were dead wire surface. Re-add them with the halt emitter follow-up.
Moving the host's statusToPhase import off @dotli/resolver/resolve means
a blocked resolve chunk no longer fails host-side first. It now surfaces
through the protocol iframe's vite:preloadError relay, which reports
kind: fatal, and describeError mapped every ProtocolFatalError to the
smoldot-crash copy before looking at the message. Match the chunk-load
message first so users get the reload prompt instead of a light-client
crash report (caught by loading.spec.ts:371).
@github-actions

Copy link
Copy Markdown
Contributor

E2E Product suite failed on ae4112bf93ec8e0c5d9fc7f843c279fdd54f4e15 — 28 passed, 33 failed, 1 skipped.

Failed tests:

  • Product is ready
  • Get Product Account
  • Product Signer
  • Account Connection Status
  • Product Account Alias
  • Request Login
  • Get User Identity
  • Subscribe Theme
  • Derive Entropy
  • Well-Known Chains
  • StatementStore Allowance
  • Bulletin Allowance
  • Smart-Contract Allowance
  • All Allowances
  • String Write & Read
  • Bytes Write & Read
  • JSON Write & Read
  • Clear
  • Factory
  • Feature Check
  • Remote: HTTP/WS
  • Remote: WebRTC
  • Remote: Chain Submit
  • Remote: Preimage Submit
  • Remote: Statement Submit
  • As a product user, I can create an authorized statement proof
  • As a product user, I can submit a statement
  • Subscribe Match All
  • Subscribe Match Any
  • HTTP URL
  • Polkadot URL
  • As a product user, I can navigate within the current product
  • Chain Spec: Genesis Hash

Logs: https://github.com/paritytech/dotli-community/actions/runs/29993014529
Artifacts: e2e-product-results (uploaded above) — open the failed test's trace.zip with npx playwright show-trace.

Base automatically changed from codex/bulletin-preimage-in-core-dotli to main July 24, 2026 01:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant