Skip to main content

49 posts tagged with "sre"

View All Tags

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node and cardano-cli pre-release versions are now set to 10.4.1 and 10.8.0.0, respectively, in cardano-parts release v2025-05-01.

  • In cardano-node, support for GHC 8.10 has been removed in master reducing CI eval times to < ~3 min. The next tagged pre-release or release after node 10.4.1 will support only GHC 9.6.

Repository Work -- Merged​

Cardano-parts​

Cardano-node​

  • Auto ghcr latest tagging currently occurs on full releases. Promotion of pre-release to release, however, doesn't trigger a published event, and instead requires a manual workflow dispatch off the newly promoted release tag. This PR adds ghcr latest tagging to the manual workflow dispatch pre-release to release use case. cardano-node-pr-6200

  • Drops support for haskellNix ghc 8.10.x which also reduces eval time to ~3 min with the removal of 249 variant packages. cardano-node-pr-6206

  • Removes the eventlogged package as ghc >= 9.4 includes unconditional -eventlog support in RTS. cardano-node-pr-6208

Cardano-playground​

  • Sets node pre-release to 10.4.1 and cardano-cli pre-release to 10.8.0.0 with cardano-parts release v2025-05-01. Updates and deploys cardano-book configuration for node pre-release 10.4.1. Adds preview1-test-a-1 machine, sops updates and secrets for test forging across legacy and new tracing. cardano-playground-pr-44

Repository Work In Progress -- PRs and Branches​

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node and cardano-cli versions are now set to 10.3.1 and 10.7.0.0, respectively, in cardano-parts release v2025-04-28.

Repository Work -- Merged​

Cardano-parts​

  • Sets node pre-release (ng) to 10.3.1 and cardano-cli pre-release (ng) to 10.7.0.0 and updates nix jobs and ci to accommodate cardano-cli pre-release breaking changes. Improves a show_current_forging prepared psql query and makes other miscellaneous improvements. cardano-parts-release-v2025-04-17

  • Sets node release to 10.3.1, cardano-cli release to 10.7.0.0. cardano-parts-release-v2025-04-28

Cardano-mainnet​

  • Sets node release to 10.3.1 and cardano-cli release to 10.7.0.0. Removes prometheus key uid in the dashboards, adds trace-verbose debugging for tofu cluster builds, improves license notice attribution, bumps ci nix to 2.28.1. cardano-mainnet-pr-33

Cardano-node​

  • Adds checkpoint and peer snapshot files to the binary artifact context. Bumps node version to 10.3.1. Adds a cardano-node artifact test using nixosTests. cardano-node-pr-6177

  • Adds the consensus snapshot-converter to pkgs and the release bins. Fixes the ci artifact nixosTest for the larger tarball size. Removes a local haskellNix windows override that has been upstreamed. Bumps iohkNix for LedgerDB cfg and make corresponding ci adjustments. cardano-node-pr-6195

Cardano-playground​

  • Sets node pre-release (ng) to 10.3.1 and cardano-cli pre-release (ng) to 10.7.0.0. Improves a show_current_forging prepared psql query and makes other miscellaneous improvements. Improvements made in cardano-parts release v2025-04-17 are included in this PR. cardano-playground-pr-42

  • Sets node release to 10.3.1 and cardano-cli release to 10.7.0.0. Rotates KES for all environments, addresses IPFS occasional OOM, scales preview for RAM, updates the book configuration. cardano-playground-pr-43

Iohk-nix​

  • Adds explicit per environment LedgerDB default config for node 10.4.x. iohk-nix-pr-597

Repository Work In Progress -- PRs and Branches​

· 3 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node, cardano-cli, and db-sync versions are now set to 10.2.1 and 10.4.0.0, 13.6.0.5, respectively, in cardano-parts release v2025-04-03.

  • The blockfrost-platform is now in capkgs and cardano-parts default devShell, pkgs and cluster flakeModules.

  • ConsensusMode cardano-node configuration and supporting files were added to the baseline node configurations in iohk-nix and integrated into cardano-node for the 10.3.x [pre-]release. This will make experimenting with GenesisMode easier. Relevant files and info will be published to the Cardano Book soon.

Repository Work -- Merged​

Capkgs:​

  • Adds the blockfrost platform to capkgs capkgs-pr-4

  • Refactors and expands ci to support fork PRs gracefully. Adds a manual workflow dispatch option with pr_number input for maintainers to authorize a privileged ci run on a forked PR. Utilizes composite actions for easy re-use elsewhere. capkgs-pr-6

Cardano-parts​

  • Sets node release to 10.2.1, cardano-cli release to 10.4.0.0, cardano-db-sync to 13.6.0.5 and mithril-cli to v2513.0. Adds profile-cardano-node-topology SRV record support for cardano-node producers. Fixes a process-compose node health check broken in newer versions of cardano-cli and adds node binary to the nixosCfgs system path. cardano-parts-release-v2025-04-03

  • Adds the blockfrost platform to shell, pkgs, and cluster cardano-parts flakeModules. Futures PRs will extend that to a blockfrost process-compose nix run job as well as dashboard for blockfrost deployments. cardano-parts-pr-62

  • Refactors and expands ci to support fork PRs gracefully. Adds a manual workflow dispatch option with pr_number input for maintainers to authorize a privileged ci run on a forked PR. Utilizes composite actions for easy re-use elsewhere. cardano-parts-pr-63

Cardano-mainnet​

  • Rotates KES, adds bootstrap and stakepool resource specific tags for cost analysis, improves the demo recipes to dynamic waits to avoid brittle time delay failures. Includes the version bumps from cardano-parts release v2025-04-03. cardano-mainnet-pr-32

Cardano-node​

  • Node 10.3.x release branch preparation: SRE contribution for iohk-nix PR#596 integration, CI tests fixup and docker cli arg bug fixup. cardano-node-pr-6143

Iohk-nix​

  • Adds support for genesis mode in node with: node config for genesis mode and related options, checkpoint file for mainnet and updated peer snapshot files for all envs, checkpoint and peer snapshot files are now included in mkConfigHtml output iohk-nix-pr-596

Repository Work In Progress -- PRs and Branches​

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • After upgrading hydra to new hardware and increasing eval concurrency for better ci throughput, an upstream hydra bug caused builds to frequently block in hydra's queue runner. The root caused was investigated and resolved with the fix to the issue pushed upstream.

  • A sizeable chunk of effort for this biweekly was invested in cardano-node's new tracing system, in particular between cardano-node, iohk-nix and cardano-parts repositories. Test machines were built and deployed using the latest tracing system changes intended for node 10.3 with comparisons between new tracing and legacy tracing metrics made and the few remaining discrepancies addressed by the performance and tracing team. New tracing system dashboards and alerts were prepared with recent changes. Configurations in each repo were prepared for a switch to the new tracing system as default. Readiness to migrate cardano-parts clusters to the new tracing system is close!

Repository Work -- Merged​

Cardano-node​

Repository Work In Progress -- PRs and Branches​

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • The cardano-node flake closure was cleaned up and optimized for an ~18% size reduction.

  • Cardano-node oci image improvements were merged and should be available with the next cardano-node release image; see the PR details below.

  • The nix hydra machine used for cardano-node builds was migrated to upgraded hardware allowing for better evaluation concurrency and therefore an enhanced dev ci experience.

  • Long cardano-node nix ci eval times were preliminarily investigated and it appears this can likely be improved significantly in the near future.

Repository Work -- Merged​

Cardano-automation​

  • Removes deprecated flake inputs for optimization purposes and adds ci via GHA. The flake optimization here is also passed to cardano-node. cardano-automation-pr-7

Cardano-node​

  • OCI improvements: adds symlinked configuration files for cardano environments, adds a new cardano-node oci image "merge" mode, improves documentation, reduces path inconsistencies between images modes (cardano-node oci script, merge, custom modes) and oci-images (cardano-node and cardano-submit-api). More detail is available in the PR description. cardano-node-pr-6110

  • Byron-to-Alonzo scripts and env clean up: removes deprecated environments and dependencies, adds testnet template support, improves the byron to alonzo script set and documents. More detail is available in the PR description. cardano-node-pr-6123

  • Flake clean up and optimization: removes uneeded inputs and overlay, applies alejandra fmt, adds alejandra to dev/devops devShell, reduces overall flake closure size by ~18%. More detail is available in the PR description. cardano-node-pr-6144

Devx-ci​

  • The nix hydra build machine was migrated to new hardware with more memory. Deprecated ziti code was cleaned up. devx-ci-commit-compare

Inputs-check​

  • The inputs-check tool was improved to make usage easier in non-flake-parts flakes, fix a top level duplicate inputs bug, improve docs with better instructions and more example usage, and add minimal ci. inputs-check-pr-1

Repository Work In Progress -- PRs and Branches​