Skip to main content

40 posts tagged with "sre"

View All Tags

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Nixpkgs has been updated to 24.11 across all environments

  • Nix has been updated to 2.25.3 across all environments

  • TCP tuning was applied on one relay per pool group across all environments to minimize round-tripping across long distances.

  • This is the last SRE update for 2024. Hello 2025!

Repository Work​

Cardano-parts​

  • Nixpkgs has been updated to 24.11 and nix to 2.25.3. NixosModules and template just recipes with breaking changes from those updates were fixed. A nix jobs GHA CI test was added to verify environment spin up procedure. Template scripts were updated for compatibility with latest cardano-node protocol version and recent cardano-cli breaking changes. More details are available in the release notes: cardano-parts-release-v2024-12-19

Cardano-playground​

  • Nixpkgs has been updated to 24.11 and nix to 2.25.3 and all machines deployed along with breaking changes fixes. A fund-transfer recipe was added along with other miscellaneous improvements. More detail is available in the PR description: cardano-playground-pull-38

Cardano-mainnet​

  • Nixpkgs has been updated to 24.11 and nix to 2.25.3 and all machines deployed along with breaking changes fixes. Bootstrap scaling servers were disabled and block producer auto scheduled restarts were stopped. TCP transmission optimization for long distances was applied to one relay per pool group. More detail is available in the PR description: cardano-mainnet-pull-28

Iohk-nix​

· One min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node release 10.1.3 was deployed to all environments

  • Dbsync release 13.6.0.2 and then 13.6.0.4 was deployed to all environments

  • Mainnet bootstraps have been configured for Cardano Foundation scrape, enabling a shared dashboard

Repository Work​

Cardano-node​

  • Ensures legacy tracing is default via config when the node default itself changes to new tracing system. Fixes default OCI mainnet topology p2p json. Updates some OCI legacy cmds and repo references. cardano-node-pull-6042

Cardano-parts​

  • Sets cardano-node to 10.1.3, dbsync to 13.6.0.4. Updates the default cardano-node nixos service to maintain legacy tracing when the default tracing system changes in the next node release. cardano-parts-release-v2024-12-02

Cardano-playground​

Cardano-mainnet​

  • Deploys cardano-node to 10.1.3, dbsync to 13.6.0.4. Adjust bootstraps for CF metrics scrape. cardano-mainnet-pull-27

Iohk-nix​

  • Ensure the use of legacy tracing for iohk-nix generated configs when the node binary defaults to new tracing. iohk-nix-pull-590

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node release 10.1.2 was deployed to all environments

  • Dbsync release 13.6.0.1 was deployed to all environments

  • Just recipe query-gov-action-status was added to aid in live voting analysis of governance actions

  • The mainnet bootstrap cluster was scaled temporarily to accommodate a significant increase in client load which developed during the past week

  • With scheduled end of year vacation time and holidays starting, the cadence of work is expected to slow a bit in the following few node SRE updates

Repository Work​

Capkgs​

Cardano-parts​

  • Sets cardano-node to 10.1.2, dbsync to 13.6.0.1, mithril to v2445.0, faucet to 10.1. Governance recipes were moved to their own governance recipe file and a query-gov-action-status recipe for live vote analysis was added. New tracing system module improvements were made to prevent unexpected metrics export stoppage along with other miscellaneous improvements. More detail is available in the release notes: cardano-parts-release-v2024-11-18

Cardano-playground​

  • Sets cardano-node to 10.1.2, dbsync to 13.6.0.1, mithril to v2445.0, faucet to 10.1. Governance recipes were moved to their own governance recipe file and a query-gov-action-status recipe for live vote analysis was added. KES rotations were done for multiple environments. More detail is available in the PR description: cardano-playground-pull-36

Cardano-mainnet​

  • Sets cardano-node to 10.1.2, dbsync to 13.6.0.1, mithril to v2445.0. Governance recipes were moved to their own governance recipe file and a query-gov-action-status recipe for live vote analysis was added. Bootstrap threshold alerts were adjusted and blockperf was added to temporary bootstrap scaling machines. More detail is available in the PR description: cardano-mainnet-pull-26

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • Cardano-node [pre-]releases from 10.0.0-pre, 10.1.0-pre and 10.1.1 were deployed to appropriate environments

  • Sanchonet was respun on 2024-10-21 for cardano-node >= 10.0.0-pre

  • Private and shelley-qa chains were retired for now

  • Remaining cardano-world legacy resources have now been terminated

  • Some ci-world legacy resources were migrated in prep for termination of the remainder

Repository Work​

Cardano-faucet​

Cardano-parts​

  • Sets cardano-node to 10.1.1, mithril to v2442.0 and updates iohk-nix-ng for the recent sanchonet respin. Updates for cardano-cli breaking changes were incorporated into nix jobs, justfile recipes, bash and python scripts, process-compose processes. New template just recipes and psql prepared statements were added for ease of governance action pool voting and follow up vote analysis. Some nixosModule options were refactored for consistency across the module set. More detail is available in the release notes: cardano-parts-release-v2024-11-06

Cardano-playground​

  • Sets cardano-node to 10.1.1, mithril to v2442.0. Sanchonet was respun on 2024-10-21 and private and shelley-qa chains were retired. Breaking change fixes for cardano-cli were applied and new just recipes added. More detail is available in the PR description: cardano-playground-pull-35

Cardano-mainnet​

  • Sets cardano-node to 10.1.1, mithril to v2442.0. Kes was rotated for block producers. Breaking change fixes for cardano-cli were applied and new just recipes added. More detail is available in the PR description: cardano-mainnet-pull-25

Iohk-nix​

· 2 min read
John Lotoski

High level summary​

The SRE team continues work on Cardano environment improvements and general maintenance.

Some notable recent changes, updates or improvements include:

  • All environments have been upgraded to cardano-node 9.2.1.

  • Cardano-faucet 9.2 is available and deployed which is compatible with node 9.2.x and has fixed ipv6 functionality.

  • All deployed machines now default to nix 2.24-maint after an upstream bug causing a hash miscalculation in submodules has been fixed. Nix 2.21 forward required some rework of the colmena deployment recipes as dirty git trees now force an impure colmena deployment.

  • To ease the process of upgrading cardano-parts, releases will now be made instead of only PR merges with migration notes.

Repository Work​

Cardano-faucet​

  • Binds ipv6 interface in addition to ipv4, parses and logs all ips to a unified ipv6 format and applies hlint and fmt updates. cardano-faucet-pull-14

  • Makes required changes for cardano-api 9.2.0.0 and 9.3.0.0, removes void type sig constraints, bumps haskellNix, CHaP, cardano-api -> 9.3.0.0 for node 9.2.x compatibility. Disables mingw32 builds until alex in current haskellNix pin is updated. cardano-faucet-pull-15

Cardano-parts​

  • Sets cardano-node to 9.2.1, cardano-faucet to 9.2. Bumps nix to 2.24-maint and adds ipv6 and nix versioning fixes and other improvements. Begins cardano-parts date-based releases for an improved upgrade process. Adds misc fixes and improvements. More detail is available in the release notes: cardano-parts-release-v2024-10-07

Cardano-playground​

  • Deploys cardano-node to 9.2.1, cardano-faucet to 9.2. Bumps nix to 2.24-maint and adds ipv6 and nix versioning fixes and other improvements. Adds a wip node pparams api server. More detail is available in the PR description: cardano-playground-pull-33

Cardano-mainnet​

  • Deploys cardano-node to 9.2.1, bumps nix to 2.24-maint and adds ipv6 and nix versioning fixes and other improvements. Converts bootstraps to a new cached-index-patch branch and upgrades CF canary sql queries. More detail is available in the PR description: cardano-mainnet-pull-23