Skip to content

Public Sequencer: Merge main into feature branch - #7705

Merged
pasindutennage-da merged 45 commits into
feature-public-sequencer-and-scanfrom
pasindutennage-da-merge-2026-october-9-13-50
Oct 9, 2026
Merged

pasindutennage-da merged 45 commits into
feature-public-sequencer-and-scanfrom
pasindutennage-da-merge-2026-october-9-13-50

Conversation

@pasindutennage-da

Copy link
Copy Markdown
Contributor

Related to #3596

isegall-da and others added 30 commits October 2, 2026 15:22
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
---------

Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
[static]

matches DACH-NY/canton-network-internal#7378

Signed-off-by: moritz.kiefer@digitalasset.com <moritz.kiefer@purelyfunctional.org>
Co-authored-by: moritz.kiefer@digitalasset.com <moritz.kiefer@purelyfunctional.org>
…he ghcr mirror (#7631)

---------

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
Assisted-by: Claude:claude-5.5-opus
Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
Assisted-by: Claude:claude-5.5-opus
Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
Part of work needed for DACH-NY/canton-network-internal#3794

---------

Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com>
Signed-off-by: Julien Tinguely <julien.tinguely@digitalasset.com>
[static]

Signed-off-by: Julien Tinguely <julien.tinguely@digitalasset.com>
…7539)

Bumps [brace-expansion](https://github.com/juliangruber/brace-expansion) from 1.1.16 to 1.1.21.
- [Release notes](https://github.com/juliangruber/brace-expansion/releases)
- [Commits](juliangruber/brace-expansion@v1.1.16...v1.1.21)

---
updated-dependencies:
- dependency-name: brace-expansion
  dependency-version: 1.1.21
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Julien Tinguely <julien.tinguely@digitalasset.com>
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
…rep-release-notes.py (#7642)

Follow-up to #7640.

- checklist in PR template link fixed
- `docs/src/release_notes.rst`: refer to the real process (maybe we should just delete this file)
- `build-tools/prep-release-notes.py`:
  - now requires `--cf-docs DIR`
  - assumes format from #7640
  - opens two PRs, one in cf-docs with the notes and one in splice emptying the notes
  - uses `getpass.getuser()` instead of `os.getlogin()` (see [upstream recommendation](https://docs.python.org/3.13/library/os.html#os.getlogin))
- remove unused `pypandoc`
- add `*.mdx` to `notify_readme_changes` GHA

---------

Assisted-by: Claude:claude-5.5-sonnet
Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
…ed (#7641)

- Scan App

  - The following request fields now have a maxItems bound of 1000;
    requests exceeding it are rejected with 400:

    - /v0/open-and-issuing-mining-rounds:
      cached_open_mining_round_contract_ids,
      cached_issuing_round_contract_ids
    - /v2/state/acs: party_ids, templates
    - /v2/holdings/state: owner_party_ids
    - /v0/holdings/summary, /v1/holdings/summary: owner_party_ids
    - /v0/voterequest: vote_request_contract_ids

- SV App

  - The following request fields now have a maxItems bound of 1000;
    requests exceeding it are rejected with 400:

    - /v0/admin/sv/voterequest: vote_request_contract_ids

---------

Assisted-by: Claude:claude-5-opus
Assisted-by: Claude:claude-5.5-opus
Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
---------

Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
* add retries and failure notifications

Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com>

* add checkout

Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com>

---------

Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com>
---------

Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
---------

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
Deal with NixOS/nixpkgs#541367 on MacOS 27:

    $ gcloud --version
    Assertion failed: (trampoline_handle), function ffi_trampoline_table_alloc_block_invoke, file closures.c, line 258.
    Abort trap: 6

- update to NixOS/nixpkgs@f45c6f0
  - NixOS/nixpkgs@b6c8664, the latest
    nixpkgs-unstable ref there at time of writing, is broken on
    aarch64-linux (firefox issue)
    
        error: output '/nix/store/9n53j9xnff4l259qm822a31qbh9qdzhb-firefox-157.0' is not allowed to refer to the following paths:
                 /nix/store/99zij8qfs8wzbb2njrj18ys8hpnrcj3p-gcc-wrapper-16.2.0
- remove #6102 workaround for helm-unittest
- use `stdenv.hostPlatform.is*` instead of `stdenv.is*`, avoiding
  warnings added in NixOS/nixpkgs#518407
- adapt to Firefox 156: new `userContext` field, scheme required
- solve npm warnings with new `allowScripts` field

scripts/nixpkgs-version-changes.sh output:

    system aarch64-darwin
    nixpkgs b3c092d3c36d91e2f61f3dfb39a159f180a56659 -> f45c6f04c2f013f004bf94e284e95d72898d9393
    auth0-cli: 1.31.0 -> 1.32.0
    circleci-cli: 0.1.38646 -> 1.0.48571
    curl: 8.20.0 -> 8.22.0
    deno: 2.8.3 -> 2.9.6
    docker: 29.5.3 -> 29.8.1
    gh: 2.95.0 -> 2.101.0
    git: 2.54.0 -> 2.55.0
    google-cloud-sdk: 570.0.0 -> 583.0.0
    grpcurl: 1.9.3 -> 1.9.4
    helm: 4.2.1 -> 4.3.0
    hub: - -> 2.14.2-unstable-2022-12-01
    hub-unstable: 2022-12-01 -> -
    istioctl: 1.30.1 -> 1.30.3
    jq: 1.8.1 -> 1.8.2
    k6: 2.0.0 -> 2.2.0
    kubectl: 1.36.2 -> 1.37.1
    nix: 2.34.7+1 -> 2.34.8
    nodejs: 24.15.0 -> 24.20.0
    postgresql: 14.23 -> 14.24
    pre-commit: 4.5.1 -> 4.6.2
    pulumi: 3.246.0 -> 3.261.0
    python3: 3.13.13 -> 3.14.7
    python3-aiohttp: 3.13.5 -> 3.14.3
    python3-colorlog: 6.10.1 -> 6.12.0
    python3-datadog: 0.52.1 -> 0.54.0
    python3-flask: 3.1.2 -> 3.1.3
    python3-gitpython: 3.1.50 -> 3.1.58
    python3-google-cloud-bigquery: 3.40.0 -> 3.41.0
    python3-google-cloud-storage: 3.10.1 -> 3.12.0
    python3-junit2html: 31.1.3 -> 31.1.4
    python3-pip: 25.3 -> 26.1.2
    python3-pulumi: 3.192.0 -> 3.263.0
    python3-pydantic: 2.12.5 -> 2.13.4
    python3-pyjwt: 2.12.1 -> 2.13.0
    python3-regex: 2026.4.4 -> 2026.7.11
    python3-requests: 2.33.1 -> 2.34.2
    python3-rich: 14.3.3 -> 15.0.0
    ripgrep: 15.1.0 -> 15.2.0
    rsync: 3.4.1 -> 3.5.0
    ruff: 0.15.17 -> 0.16.8
    sbt: 1.12.11 -> 2.0.9
    skopeo: 1.23.0 -> 1.24.1
    tmux: 3.6a -> 3.7c
    which: 2.23 -> 2.25
    xxd-tinyxxd: 1.3.15 -> 1.3.16

---------

Assisted-by: Copilot:gpt-6-astra
Assisted-by: Claude:claude-5.5-opus
Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
---------

Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
Bumps [@grpc/grpc-js](https://github.com/grpc/grpc-node) from 1.14.4 to 1.14.5.
- [Release notes](https://github.com/grpc/grpc-node/releases)
- [Commits](https://github.com/grpc/grpc-node/compare/@grpc/grpc-js@1.14.4...@grpc/grpc-js@1.14.5)

---
updated-dependencies:
- dependency-name: "@grpc/grpc-js"
  dependency-version: 1.14.5
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
[ci]

Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
Signed-off-by: Paweł Perek <pawel.perek@digitalasset.com>
Bumps [shell-quote](https://github.com/ljharb/shell-quote) from 1.8.4 to 1.12.0.
- [Changelog](https://github.com/ljharb/shell-quote/blob/main/CHANGELOG.md)
- [Commits](ljharb/shell-quote@v1.8.4...v1.12.0)

---
updated-dependencies:
- dependency-name: shell-quote
  dependency-version: 1.12.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Pass the store's defaultLimit from the handler and order by
event_number, so that an unexpectedly large number of FeaturedAppRights
for one provider logs a warning instead of growing the response
unboundedly.

Assisted-by: Claude:claude-5.5-opus
Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
…ly on clusters that deploy the gha stack, so expected files no longer depend on the environment they are generated in (#7672)

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
JYC11 and others added 15 commits October 8, 2026 11:31
Signed-off-by: JYC11 <jaeyoon.c@gmail.com>
Signed-off-by: Jaeyoon Cho <jaeyoon.c@gmail.com>
Co-authored-by: Simon Meier <simon@digitalasset.com>
Needed for caching to work in internal, specifically needed for: DACH-NY/canton-network-internal#6897

---------

Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com>
Signed-off-by: Divam <dfordivam@gmail.com>
…and `listBulkUpdateHistoryObjects` (#6786)

* Add `daml_value_encoding` parameters to `listBulkAcsSnapshotObjects` and `listBulkUpdateHistoryObjects`.

Follow-up to #6602

This adds an optional `daml_value_encoding` query parameter to `listBulkAcsSnapshotObjects` and field to `ListBulkUpdateHistoryObjectsRequest` (used in `listBulkUpdateHistoryObjects`) so users can list bulk storage objects with either encoding type (compact or protobuf-encoded JSON). If the parameter is not given, the current default behavior is preserved -- the endpoints will list objects with the compact encoding.

Signed-off-by: Matt Dziuban <mrdziuban@gmail.com>

* Add helper to dedupe pattern of getting storage encodings.

Signed-off-by: Matt Dziuban <mrdziuban@gmail.com>

* Test that protobuf snapshots align with compact ones.

Signed-off-by: Matt Dziuban <mrdziuban@gmail.com>

---------

Signed-off-by: Matt Dziuban <mrdziuban@gmail.com>
* [ci] Bulk storage backfilling service: copy everything before the first own segment from peers, behind a flag

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Bulk storage backfilling: find the first segment with the configured page size, since a single folder never fits in a page of one object

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Bulk storage backfilling: check whether the backfill is already complete with an if

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Bulk storage backfilling: name the step from object key to segment folder, next to the other folder helpers in ScanStorageConfig

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Bulk storage: stop the services before closing the peer scan connection they use

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Bulk storage backfilling: the backfill end lives with the service, and its test listing takes functions instead of by-name parameters

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

---------

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
…passing the encoding the listing endpoints now take (#7692)

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
…ing (#7656)

* [ci] Bulk storage progress answers available, not yet or never, for staging or committed, and the checksum check accepts never

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Two-phase BFT call reports that no scan will ever have the data as its own outcome, and the staging commit then commits on its own checksums

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Two-phase BFT call doc lists its three failure outcomes: not yet, no scan will ever have the data, disagreement

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Bulk storage progress: an older Scan's answer counts as not yet for the committed bucket, and never is described as not produced and not held now

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] Bulk storage progress: availability is available, processing or backfilling, bucket and availability are required, no fallback for older Scans

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

---------

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
* [static] Add Scan Database Size Grafana dashboard: size per database, per table family and per table, growth rates, bulk export lag

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [static] Update expected files for the Scan Database Size dashboard

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

---------

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
This reverts commit d7b25f7.

[ci]

Signed-off-by: Simon Meier <simon@digitalasset.com>
---------

Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
…e update history sanity check (#7693)

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
Co-authored-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
…ose (#7699)

Fixes DACH-NY/cn-test-failures#10319
[ci]

Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
[ci]
already ignored in LSU tests

Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
#7441)

* [ci] Let ResetDecentralizedNamespace tolerate an owner whose proposal is no longer needed once the other owners have authorized the reset

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

* [ci] ResetDecentralizedNamespace: skip an owner's proposal only when its errors are the known rejections of an unneeded proposal, otherwise retry the reset

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>

---------

Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
[static]

Signed-off-by: Pasindu Tennage <pasindu.tennage@digitalasset.com>
Signed-off-by: pasindutennage-da <pasindu.tennage@digitalasset.com>
@canton-network-da

Copy link
Copy Markdown
Contributor

[backport] Reminder

Please consider backporting to the following branches:

  • main
  • release-line-0.8.x
  • release-line-0.9.0
  • release-line-0.8.4
  • release-line-0.8.3
  • release-line-0.8.1

▶️ Please check the boxes for branches that you wish to backport to and backport PRs will
automatically be created when you merge this PR.

And your PR is currently against base branch: feature-public-sequencer-and-scan.

Note: Any PR comment containing [backport] will be considered for auto-backporting upon merge,
you can always add those manually for PRs that did not get these reminders. You can also edit
this comment manually and add more branches that this should be backported to.

@github-actions

github-actions Bot commented Oct 9, 2026

Copy link
Copy Markdown

Deploy upgrade pipeline triggered for Commit e86442f0b235efbb35cc831d05f985a335a762e1 in , please contact a Contributor to approve it in CircleCI: https://app.circleci.com/pipelines/github/DACH-NY/canton-network-internal/85550

@martinflorian-da martinflorian-da left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thx, don't forget to use a merge commit (sorry for being so ocd, I just mess this up every other time myself)

@julientinguely-da

Copy link
Copy Markdown
Contributor

thx, don't forget to use a merge commit (sorry for being so ocd, I just mess this up every other time myself)

good point !! forgot that part

@pasindutennage-da
pasindutennage-da merged commit e86442f into feature-public-sequencer-and-scan Oct 9, 2026
58 checks passed
@pasindutennage-da
pasindutennage-da deleted the pasindutennage-da-merge-2026-october-9-13-50 branch October 9, 2026 12:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.