Repository navigation
Public Sequencer: Merge main into feature branch - #7705
pasindutennage-da merged 45 commits into
Conversation
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
--------- Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
[static] matches DACH-NY/canton-network-internal#7378 Signed-off-by: moritz.kiefer@digitalasset.com <moritz.kiefer@purelyfunctional.org> Co-authored-by: moritz.kiefer@digitalasset.com <moritz.kiefer@purelyfunctional.org>
…he ghcr mirror (#7631) --------- Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
Assisted-by: Claude:claude-5.5-opus Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
Assisted-by: Claude:claude-5.5-opus Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
Part of work needed for DACH-NY/canton-network-internal#3794 --------- Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com>
Signed-off-by: Julien Tinguely <julien.tinguely@digitalasset.com>
[static] Signed-off-by: Julien Tinguely <julien.tinguely@digitalasset.com>
…7539) Bumps [brace-expansion](https://github.com/juliangruber/brace-expansion) from 1.1.16 to 1.1.21. - [Release notes](https://github.com/juliangruber/brace-expansion/releases) - [Commits](juliangruber/brace-expansion@v1.1.16...v1.1.21) --- updated-dependencies: - dependency-name: brace-expansion dependency-version: 1.1.21 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Julien Tinguely <julien.tinguely@digitalasset.com>
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
…rep-release-notes.py (#7642) Follow-up to #7640. - checklist in PR template link fixed - `docs/src/release_notes.rst`: refer to the real process (maybe we should just delete this file) - `build-tools/prep-release-notes.py`: - now requires `--cf-docs DIR` - assumes format from #7640 - opens two PRs, one in cf-docs with the notes and one in splice emptying the notes - uses `getpass.getuser()` instead of `os.getlogin()` (see [upstream recommendation](https://docs.python.org/3.13/library/os.html#os.getlogin)) - remove unused `pypandoc` - add `*.mdx` to `notify_readme_changes` GHA --------- Assisted-by: Claude:claude-5.5-sonnet Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
…ed (#7641) - Scan App - The following request fields now have a maxItems bound of 1000; requests exceeding it are rejected with 400: - /v0/open-and-issuing-mining-rounds: cached_open_mining_round_contract_ids, cached_issuing_round_contract_ids - /v2/state/acs: party_ids, templates - /v2/holdings/state: owner_party_ids - /v0/holdings/summary, /v1/holdings/summary: owner_party_ids - /v0/voterequest: vote_request_contract_ids - SV App - The following request fields now have a maxItems bound of 1000; requests exceeding it are rejected with 400: - /v0/admin/sv/voterequest: vote_request_contract_ids --------- Assisted-by: Claude:claude-5-opus Assisted-by: Claude:claude-5.5-opus Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
--------- Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
* add retries and failure notifications Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com> * add checkout Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com> --------- Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com>
--------- Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
--------- Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
Deal with NixOS/nixpkgs#541367 on MacOS 27: $ gcloud --version Assertion failed: (trampoline_handle), function ffi_trampoline_table_alloc_block_invoke, file closures.c, line 258. Abort trap: 6 - update to NixOS/nixpkgs@f45c6f0 - NixOS/nixpkgs@b6c8664, the latest nixpkgs-unstable ref there at time of writing, is broken on aarch64-linux (firefox issue) error: output '/nix/store/9n53j9xnff4l259qm822a31qbh9qdzhb-firefox-157.0' is not allowed to refer to the following paths: /nix/store/99zij8qfs8wzbb2njrj18ys8hpnrcj3p-gcc-wrapper-16.2.0 - remove #6102 workaround for helm-unittest - use `stdenv.hostPlatform.is*` instead of `stdenv.is*`, avoiding warnings added in NixOS/nixpkgs#518407 - adapt to Firefox 156: new `userContext` field, scheme required - solve npm warnings with new `allowScripts` field scripts/nixpkgs-version-changes.sh output: system aarch64-darwin nixpkgs b3c092d3c36d91e2f61f3dfb39a159f180a56659 -> f45c6f04c2f013f004bf94e284e95d72898d9393 auth0-cli: 1.31.0 -> 1.32.0 circleci-cli: 0.1.38646 -> 1.0.48571 curl: 8.20.0 -> 8.22.0 deno: 2.8.3 -> 2.9.6 docker: 29.5.3 -> 29.8.1 gh: 2.95.0 -> 2.101.0 git: 2.54.0 -> 2.55.0 google-cloud-sdk: 570.0.0 -> 583.0.0 grpcurl: 1.9.3 -> 1.9.4 helm: 4.2.1 -> 4.3.0 hub: - -> 2.14.2-unstable-2022-12-01 hub-unstable: 2022-12-01 -> - istioctl: 1.30.1 -> 1.30.3 jq: 1.8.1 -> 1.8.2 k6: 2.0.0 -> 2.2.0 kubectl: 1.36.2 -> 1.37.1 nix: 2.34.7+1 -> 2.34.8 nodejs: 24.15.0 -> 24.20.0 postgresql: 14.23 -> 14.24 pre-commit: 4.5.1 -> 4.6.2 pulumi: 3.246.0 -> 3.261.0 python3: 3.13.13 -> 3.14.7 python3-aiohttp: 3.13.5 -> 3.14.3 python3-colorlog: 6.10.1 -> 6.12.0 python3-datadog: 0.52.1 -> 0.54.0 python3-flask: 3.1.2 -> 3.1.3 python3-gitpython: 3.1.50 -> 3.1.58 python3-google-cloud-bigquery: 3.40.0 -> 3.41.0 python3-google-cloud-storage: 3.10.1 -> 3.12.0 python3-junit2html: 31.1.3 -> 31.1.4 python3-pip: 25.3 -> 26.1.2 python3-pulumi: 3.192.0 -> 3.263.0 python3-pydantic: 2.12.5 -> 2.13.4 python3-pyjwt: 2.12.1 -> 2.13.0 python3-regex: 2026.4.4 -> 2026.7.11 python3-requests: 2.33.1 -> 2.34.2 python3-rich: 14.3.3 -> 15.0.0 ripgrep: 15.1.0 -> 15.2.0 rsync: 3.4.1 -> 3.5.0 ruff: 0.15.17 -> 0.16.8 sbt: 1.12.11 -> 2.0.9 skopeo: 1.23.0 -> 1.24.1 tmux: 3.6a -> 3.7c which: 2.23 -> 2.25 xxd-tinyxxd: 1.3.15 -> 1.3.16 --------- Assisted-by: Copilot:gpt-6-astra Assisted-by: Claude:claude-5.5-opus Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
--------- Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
Bumps [@grpc/grpc-js](https://github.com/grpc/grpc-node) from 1.14.4 to 1.14.5. - [Release notes](https://github.com/grpc/grpc-node/releases) - [Commits](https://github.com/grpc/grpc-node/compare/@grpc/grpc-js@1.14.4...@grpc/grpc-js@1.14.5) --- updated-dependencies: - dependency-name: "@grpc/grpc-js" dependency-version: 1.14.5 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
[ci] Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
Signed-off-by: Paweł Perek <pawel.perek@digitalasset.com>
Bumps [shell-quote](https://github.com/ljharb/shell-quote) from 1.8.4 to 1.12.0. - [Changelog](https://github.com/ljharb/shell-quote/blob/main/CHANGELOG.md) - [Commits](ljharb/shell-quote@v1.8.4...v1.12.0) --- updated-dependencies: - dependency-name: shell-quote dependency-version: 1.12.0 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Pass the store's defaultLimit from the handler and order by event_number, so that an unexpectedly large number of FeaturedAppRights for one provider logs a warning instead of growing the response unboundedly. Assisted-by: Claude:claude-5.5-opus Signed-off-by: Stephen Compall <stephen.compall@digitalasset.com>
…ly on clusters that deploy the gha stack, so expected files no longer depend on the environment they are generated in (#7672) Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
Signed-off-by: Itai Segall <itai.segall@digitalasset.com>
Signed-off-by: JYC11 <jaeyoon.c@gmail.com> Signed-off-by: Jaeyoon Cho <jaeyoon.c@gmail.com> Co-authored-by: Simon Meier <simon@digitalasset.com>
Needed for caching to work in internal, specifically needed for: DACH-NY/canton-network-internal#6897 --------- Signed-off-by: krzysztofczyz-da <krzysztof.czyz@digitalasset.com>
…and `listBulkUpdateHistoryObjects` (#6786) * Add `daml_value_encoding` parameters to `listBulkAcsSnapshotObjects` and `listBulkUpdateHistoryObjects`. Follow-up to #6602 This adds an optional `daml_value_encoding` query parameter to `listBulkAcsSnapshotObjects` and field to `ListBulkUpdateHistoryObjectsRequest` (used in `listBulkUpdateHistoryObjects`) so users can list bulk storage objects with either encoding type (compact or protobuf-encoded JSON). If the parameter is not given, the current default behavior is preserved -- the endpoints will list objects with the compact encoding. Signed-off-by: Matt Dziuban <mrdziuban@gmail.com> * Add helper to dedupe pattern of getting storage encodings. Signed-off-by: Matt Dziuban <mrdziuban@gmail.com> * Test that protobuf snapshots align with compact ones. Signed-off-by: Matt Dziuban <mrdziuban@gmail.com> --------- Signed-off-by: Matt Dziuban <mrdziuban@gmail.com>
* [ci] Bulk storage backfilling service: copy everything before the first own segment from peers, behind a flag Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Bulk storage backfilling: find the first segment with the configured page size, since a single folder never fits in a page of one object Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Bulk storage backfilling: check whether the backfill is already complete with an if Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Bulk storage backfilling: name the step from object key to segment folder, next to the other folder helpers in ScanStorageConfig Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Bulk storage: stop the services before closing the peer scan connection they use Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Bulk storage backfilling: the backfill end lives with the service, and its test listing takes functions instead of by-name parameters Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> --------- Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
…passing the encoding the listing endpoints now take (#7692) Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
…ing (#7656) * [ci] Bulk storage progress answers available, not yet or never, for staging or committed, and the checksum check accepts never Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Two-phase BFT call reports that no scan will ever have the data as its own outcome, and the staging commit then commits on its own checksums Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Two-phase BFT call doc lists its three failure outcomes: not yet, no scan will ever have the data, disagreement Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Bulk storage progress: an older Scan's answer counts as not yet for the committed bucket, and never is described as not produced and not held now Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] Bulk storage progress: availability is available, processing or backfilling, bucket and availability are required, no fallback for older Scans Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> --------- Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
* [static] Add Scan Database Size Grafana dashboard: size per database, per table family and per table, growth rates, bulk export lag Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [static] Update expected files for the Scan Database Size dashboard Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> --------- Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
--------- Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
…e update history sanity check (#7693) Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> Co-authored-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
…ose (#7699) Fixes DACH-NY/cn-test-failures#10319 [ci] Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
[ci] already ignored in LSU tests Signed-off-by: Oriol Muñoz <oriol.munoz@digitalasset.com>
#7441) * [ci] Let ResetDecentralizedNamespace tolerate an owner whose proposal is no longer needed once the other owners have authorized the reset Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> * [ci] ResetDecentralizedNamespace: skip an owner's proposal only when its errors are the known rejections of an unneeded proposal, otherwise retry the reset Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com> --------- Signed-off-by: Raymond Roestenburg <raymond.roestenburg@digitalasset.com>
[static] Signed-off-by: Pasindu Tennage <pasindu.tennage@digitalasset.com> Signed-off-by: pasindutennage-da <pasindu.tennage@digitalasset.com>
[backport] ReminderPlease consider backporting to the following branches:
And your PR is currently against base branch: feature-public-sequencer-and-scan. Note: Any PR comment containing [backport] will be considered for auto-backporting upon merge, |
|
Deploy upgrade pipeline triggered for Commit e86442f0b235efbb35cc831d05f985a335a762e1 in , please contact a Contributor to approve it in CircleCI: https://app.circleci.com/pipelines/github/DACH-NY/canton-network-internal/85550 |
martinflorian-da
left a comment
There was a problem hiding this comment.
thx, don't forget to use a merge commit (sorry for being so ocd, I just mess this up every other time myself)
good point !! forgot that part |
e86442f
into
feature-public-sequencer-and-scan
Related to #3596