Skip to main content

60 posts tagged with "sre"

View All Tags

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node and cardano-cli release versions are now set to 10.4.1 and 10.8.0.0, respectively, in cardano-parts release v2025-05-22.

  • The upcoming node 10.5 [pre-]release is being configured to use genesis mode by default on preview and preprod environments.

  • SRE is collaborating with IT Sec team to further harden our infra and clusters.

Repository Work -- Merged​

Cardano-parts​

  • Sets node release to 10.4.1, cardano-cli release to 10.8.0.0 and mithril to v2517.1. Adds mithril ancillary key support for signed volatile and ledger state. Switches to a blockPerf fork which can be used without publishing metrics to CF, ex: for testnet usage. Includes additional misc fixes and improvements described in the PR/release header. cardano-parts-release-v2025-05-22

Cardano-mainnet​

  • Sets node release to 10.4.1, cardano-cli release to 10.8.0.0 and mithril release v2517.1. Includes various improvements with cardano-parts release v2025-05-22. Deploys all machines to 10.4.1. cardano-mainnet-pr-34

Cardano-node​

  • Bumps iohkNix for 10.5 network param changes, preview/preprod default GenesisMode consensus config, per env useLedgerAfter and peer-snapshot updates. Updates CI for the iohkNix config changes. In the cardano-node nixos service, sets preview and preprod environments to use peer-snapshots. Enables genesis mode to work OOTB for preview/preprod on: docker images, binary artifacts, nixos built machines. cardano-node-pr-6225

Cardano-playground​

  • Sets node release to 10.4.1, cardano-cli release to 10.8.0.0 and mithril release v2517.1. Deploys blockPerf to all testnet machines without publishing metrics to CF. Includes various improvements with cardano-parts release v2025-05-22. Deploys all machines to 10.4.1. cardano-playground-pr-46

Iohk-nix​

  • Adds mithril network ancillary verification keys: the ancillary verification keys are a breaking change required to pull ancillary mithril state (ie: ledger and volatile state) in addition to immutable state. In earlier mithril releases, the ancillary state was bundled together with the immutable state. iohk-nix-pr-598

  • Node 10.5 updates: set GenesisMode for ConsensusMode as default on preview and preprod; tunes TargetNumberOfEstablishedPeers, and SyncTargetNumberOfEstablishedBigLedgerPeers per network team request; updates peer-snapshots per environment; updates useLedgerAfterSlot per environment. iohk-nix-pr-599

Repository Work In Progress -- PRs and Branches​

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node and cardano-cli pre-release versions are now set to 10.4.1 and 10.8.0.0, respectively, in cardano-parts release v2025-05-01.

  • In cardano-node, support for GHC 8.10 has been removed in master reducing CI eval times to < ~3 min. The next tagged pre-release or release after node 10.4.1 will support only GHC 9.6.

Repository Work -- Merged​

Cardano-parts​

Cardano-node​

  • Auto ghcr latest tagging currently occurs on full releases. Promotion of pre-release to release, however, doesn't trigger a published event, and instead requires a manual workflow dispatch off the newly promoted release tag. This PR adds ghcr latest tagging to the manual workflow dispatch pre-release to release use case. cardano-node-pr-6200

  • Drops support for haskellNix ghc 8.10.x which also reduces eval time to ~3 min with the removal of 249 variant packages. cardano-node-pr-6206

  • Removes the eventlogged package as ghc >= 9.4 includes unconditional -eventlog support in RTS. cardano-node-pr-6208

Cardano-playground​

  • Sets node pre-release to 10.4.1 and cardano-cli pre-release to 10.8.0.0 with cardano-parts release v2025-05-01. Updates and deploys cardano-book configuration for node pre-release 10.4.1. Adds preview1-test-a-1 machine, sops updates and secrets for test forging across legacy and new tracing. cardano-playground-pr-44

Repository Work In Progress -- PRs and Branches​

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node and cardano-cli versions are now set to 10.3.1 and 10.7.0.0, respectively, in cardano-parts release v2025-04-28.

Repository Work -- Merged​

Cardano-parts​

  • Sets node pre-release (ng) to 10.3.1 and cardano-cli pre-release (ng) to 10.7.0.0 and updates nix jobs and ci to accommodate cardano-cli pre-release breaking changes. Improves a show_current_forging prepared psql query and makes other miscellaneous improvements. cardano-parts-release-v2025-04-17

  • Sets node release to 10.3.1, cardano-cli release to 10.7.0.0. cardano-parts-release-v2025-04-28

Cardano-mainnet​

  • Sets node release to 10.3.1 and cardano-cli release to 10.7.0.0. Removes prometheus key uid in the dashboards, adds trace-verbose debugging for tofu cluster builds, improves license notice attribution, bumps ci nix to 2.28.1. cardano-mainnet-pr-33

Cardano-node​

  • Adds checkpoint and peer snapshot files to the binary artifact context. Bumps node version to 10.3.1. Adds a cardano-node artifact test using nixosTests. cardano-node-pr-6177

  • Adds the consensus snapshot-converter to pkgs and the release bins. Fixes the ci artifact nixosTest for the larger tarball size. Removes a local haskellNix windows override that has been upstreamed. Bumps iohkNix for LedgerDB cfg and make corresponding ci adjustments. cardano-node-pr-6195

Cardano-playground​

  • Sets node pre-release (ng) to 10.3.1 and cardano-cli pre-release (ng) to 10.7.0.0. Improves a show_current_forging prepared psql query and makes other miscellaneous improvements. Improvements made in cardano-parts release v2025-04-17 are included in this PR. cardano-playground-pr-42

  • Sets node release to 10.3.1 and cardano-cli release to 10.7.0.0. Rotates KES for all environments, addresses IPFS occasional OOM, scales preview for RAM, updates the book configuration. cardano-playground-pr-43

Iohk-nix​

  • Adds explicit per environment LedgerDB default config for node 10.4.x. iohk-nix-pr-597

Repository Work In Progress -- PRs and Branches​

· 3 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node, cardano-cli, and db-sync versions are now set to 10.2.1 and 10.4.0.0, 13.6.0.5, respectively, in cardano-parts release v2025-04-03.

  • The blockfrost-platform is now in capkgs and cardano-parts default devShell, pkgs and cluster flakeModules.

  • ConsensusMode cardano-node configuration and supporting files were added to the baseline node configurations in iohk-nix and integrated into cardano-node for the 10.3.x [pre-]release. This will make experimenting with GenesisMode easier. Relevant files and info will be published to the Cardano Book soon.

Repository Work -- Merged​

Capkgs:​

  • Adds the blockfrost platform to capkgs capkgs-pr-4

  • Refactors and expands ci to support fork PRs gracefully. Adds a manual workflow dispatch option with pr_number input for maintainers to authorize a privileged ci run on a forked PR. Utilizes composite actions for easy re-use elsewhere. capkgs-pr-6

Cardano-parts​

  • Sets node release to 10.2.1, cardano-cli release to 10.4.0.0, cardano-db-sync to 13.6.0.5 and mithril-cli to v2513.0. Adds profile-cardano-node-topology SRV record support for cardano-node producers. Fixes a process-compose node health check broken in newer versions of cardano-cli and adds node binary to the nixosCfgs system path. cardano-parts-release-v2025-04-03

  • Adds the blockfrost platform to shell, pkgs, and cluster cardano-parts flakeModules. Futures PRs will extend that to a blockfrost process-compose nix run job as well as dashboard for blockfrost deployments. cardano-parts-pr-62

  • Refactors and expands ci to support fork PRs gracefully. Adds a manual workflow dispatch option with pr_number input for maintainers to authorize a privileged ci run on a forked PR. Utilizes composite actions for easy re-use elsewhere. cardano-parts-pr-63

Cardano-mainnet​

  • Rotates KES, adds bootstrap and stakepool resource specific tags for cost analysis, improves the demo recipes to dynamic waits to avoid brittle time delay failures. Includes the version bumps from cardano-parts release v2025-04-03. cardano-mainnet-pr-32

Cardano-node​

  • Node 10.3.x release branch preparation: SRE contribution for iohk-nix PR#596 integration, CI tests fixup and docker cli arg bug fixup. cardano-node-pr-6143

Iohk-nix​

  • Adds support for genesis mode in node with: node config for genesis mode and related options, checkpoint file for mainnet and updated peer snapshot files for all envs, checkpoint and peer snapshot files are now included in mkConfigHtml output iohk-nix-pr-596

Repository Work In Progress -- PRs and Branches​

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • After upgrading hydra to new hardware and increasing eval concurrency for better ci throughput, an upstream hydra bug caused builds to frequently block in hydra's queue runner. The root caused was investigated and resolved with the fix to the issue pushed upstream.

  • A sizeable chunk of effort for this biweekly was invested in cardano-node's new tracing system, in particular between cardano-node, iohk-nix and cardano-parts repositories. Test machines were built and deployed using the latest tracing system changes intended for node 10.3 with comparisons between new tracing and legacy tracing metrics made and the few remaining discrepancies addressed by the performance and tracing team. New tracing system dashboards and alerts were prepared with recent changes. Configurations in each repo were prepared for a switch to the new tracing system as default. Readiness to migrate cardano-parts clusters to the new tracing system is close!

Repository Work -- Merged​

Cardano-node​

Repository Work In Progress -- PRs and Branches​