Skip to main content

42 posts tagged with "sre"

View All Tags

· One min read
John Lotoski

High level summary

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • An ephemeral support module for AWS EC2 ephemeral block devices was added to cardano-parts.

Repository Work

Cardano-parts

  • A nixosModule, profile-aws-ec2-ephemeral, has been added to support ec2 instances with ephemeral storage block devices, offering auto-format and mount with RAID0 creation for multiple devices. The aws ec2 spec file was updated. A number of small fixes and improvements were added with details available in the release notes: cardano-parts-release-v2025-02-04

Cardano-playground

  • Applies ephemeral module support, adds network icc secrets, KES rotates network forgers, and applies misc fixes and improvements. More detail is available in the PR description: cardano-playground-pull-40

Cardano-mainnet

  • Applies ephemeral module support, and applies misc fixes and improvements. More detail is available in the PR description: cardano-mainnet-pull-29

Cardano-node

· 2 min read
John Lotoski

High level summary

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Sanchonet was respun after a community scheduled test hardfork to PV11

  • Buildkite agent modules were added to cardano-playground

  • Adds a latest tag GHA action to cardano-node upon new release publication

Repository Work

Cardano-parts

  • Cardano-node has been updated to 10.1.4, cardano-cli and the -ng variant to 10.1.1.0 and 10.2.0.0 respectively, and mithril to v2450. Colmena has been updated to utilize a new pure flake evaluation approach. New nix jobs were added for a new "next-gen" network spin up method, which supports network creation with a fork directly to Conway and then retirement of the genesis bootstrap pool in favor of on-chain registered backbone pools. CI tests to support these new jobs were added. The recipe to query governance actions was updated with the latest voting calculations and the output was improved with color and additional reporting totals. A psql prepared statement for voting activity over time was added to the postgres module. Other small miscellaneous improvements and clean up were made with details available in the release notes: cardano-parts-release-v2025-01-17

Cardano-playground

  • Cardano-node has been updated to 10.1.4, mithril to v2450 and all envs deployed. Buildkite modules were added to support fast buildkite agent scaling in any AWS region. Sanchonet was respun after a planned community hard fork test. The recipe to query governance actions was updated with the latest voting calculations. A new start-demo-ng recipe was added to utilize a new "next-gen" spin up method. More detail is available in the PR description: cardano-playground-pull-39

Cardano-mainnet

  • Cardano-node has been updated to 10.1.4 and mithril to v2450 and all machines deployed. The mainnet canary dashboard was updated with a governance voting analysis panel. The recipe to query governance actions was updated with the latest voting calculations. More detail is available in the PR description: cardano-mainnet-pull-29

Cardano-node

  • Adds GHA steps to push a latest tag for node and api containers on release events where the tag is the latest release. Updates the docker-compose to default to the latest tag and bumps iohk-nix for an updated target number of established peers. Fixes related configs to pass CI checks. cardano-node-pull-6057

· 2 min read
John Lotoski

High level summary

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Nixpkgs has been updated to 24.11 across all environments

  • Nix has been updated to 2.25.3 across all environments

  • TCP tuning was applied on one relay per pool group across all environments to minimize round-tripping across long distances.

  • This is the last SRE update for 2024. Hello 2025!

Repository Work

Cardano-parts

  • Nixpkgs has been updated to 24.11 and nix to 2.25.3. NixosModules and template just recipes with breaking changes from those updates were fixed. A nix jobs GHA CI test was added to verify environment spin up procedure. Template scripts were updated for compatibility with latest cardano-node protocol version and recent cardano-cli breaking changes. More details are available in the release notes: cardano-parts-release-v2024-12-19

Cardano-playground

  • Nixpkgs has been updated to 24.11 and nix to 2.25.3 and all machines deployed along with breaking changes fixes. A fund-transfer recipe was added along with other miscellaneous improvements. More detail is available in the PR description: cardano-playground-pull-38

Cardano-mainnet

  • Nixpkgs has been updated to 24.11 and nix to 2.25.3 and all machines deployed along with breaking changes fixes. Bootstrap scaling servers were disabled and block producer auto scheduled restarts were stopped. TCP transmission optimization for long distances was applied to one relay per pool group. More detail is available in the PR description: cardano-mainnet-pull-28

Iohk-nix

· One min read
John Lotoski

High level summary

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node release 10.1.3 was deployed to all environments

  • Dbsync release 13.6.0.2 and then 13.6.0.4 was deployed to all environments

  • Mainnet bootstraps have been configured for Cardano Foundation scrape, enabling a shared dashboard

Repository Work

Cardano-node

  • Ensures legacy tracing is default via config when the node default itself changes to new tracing system. Fixes default OCI mainnet topology p2p json. Updates some OCI legacy cmds and repo references. cardano-node-pull-6042

Cardano-parts

  • Sets cardano-node to 10.1.3, dbsync to 13.6.0.4. Updates the default cardano-node nixos service to maintain legacy tracing when the default tracing system changes in the next node release. cardano-parts-release-v2024-12-02

Cardano-playground

Cardano-mainnet

  • Deploys cardano-node to 10.1.3, dbsync to 13.6.0.4. Adjust bootstraps for CF metrics scrape. cardano-mainnet-pull-27

Iohk-nix

  • Ensure the use of legacy tracing for iohk-nix generated configs when the node binary defaults to new tracing. iohk-nix-pull-590

· 2 min read
John Lotoski

High level summary

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node release 10.1.2 was deployed to all environments

  • Dbsync release 13.6.0.1 was deployed to all environments

  • Just recipe query-gov-action-status was added to aid in live voting analysis of governance actions

  • The mainnet bootstrap cluster was scaled temporarily to accommodate a significant increase in client load which developed during the past week

  • With scheduled end of year vacation time and holidays starting, the cadence of work is expected to slow a bit in the following few node SRE updates

Repository Work

Capkgs

Cardano-parts

  • Sets cardano-node to 10.1.2, dbsync to 13.6.0.1, mithril to v2445.0, faucet to 10.1. Governance recipes were moved to their own governance recipe file and a query-gov-action-status recipe for live vote analysis was added. New tracing system module improvements were made to prevent unexpected metrics export stoppage along with other miscellaneous improvements. More detail is available in the release notes: cardano-parts-release-v2024-11-18

Cardano-playground

  • Sets cardano-node to 10.1.2, dbsync to 13.6.0.1, mithril to v2445.0, faucet to 10.1. Governance recipes were moved to their own governance recipe file and a query-gov-action-status recipe for live vote analysis was added. KES rotations were done for multiple environments. More detail is available in the PR description: cardano-playground-pull-36

Cardano-mainnet

  • Sets cardano-node to 10.1.2, dbsync to 13.6.0.1, mithril to v2445.0. Governance recipes were moved to their own governance recipe file and a query-gov-action-status recipe for live vote analysis was added. Bootstrap threshold alerts were adjusted and blockperf was added to temporary bootstrap scaling machines. More detail is available in the PR description: cardano-mainnet-pull-26