High level summary​

The SRE team continues work on cardano environment improvements and general environment maintenance.

Some notable recent changes, updates or improvements include:

• Cardano-world testnets of preprod, preview, sanchonet and some private test chains have largely completed their migration to the cardano-playground stack

Lower level summary​

Capkgs​

• Minor bug fix and db-sync sanchonet package update: capkgs-compare

Cardano-parts​

• General migration support PR for cardano-world to cardano-playground cardano-parts-pull-18
  • Iohk-nix and iohk-nix-ng were updated support the migration of cardano-world networks to cardano-playground
  • Sops-secrets dependent systemd services were fixed to ensure restart upon sops secrets changes
  • Db chain utilities (db-{analyser,synthesizer,truncater}) had -ng variants created to operate on both release and pre-release network chains
  • The profile-cardano-postgres nixos module received preset variables and prepared statements via pgsqlrc for faster and easier analysis of network state
  • The flakeModule jobs now has support for the cardano-cli era command in each of the job scripts by passing the $ERA_CMD variable
  • Default cardano-node-ng package is now 8.6.0-pre, dbsync on sanchonet is now sancho-2-2-0
  • For scripts using a nix-shell shebang, the cardano-parts devShell menu can be disabled from injecting itself into stdout by passing NOMENU=true
  • Template updates include:
    • Adds optional TF AZ declaration on ec2 resources
    • Adds a cardano node p2p dashboard to the grafana cloud stack
    • Adds a dbsync pool performance analysis query
    • Updates python distribute and delegation scripts from world for playground compatibility
    • Starts a python script lib to reduce shared code among the python scripts
    • Several justfile improvements and new recipes
  • More detail is available in the PR description
• Update submit action script for 8.6 cardano-parts-pull-19
• Update scripts for 8.6.0-pre cardano-parts-pull-21
  • Fixes subcommand names based on ERA_CMD
  • Adds deposits to some commands
  • Separates CC cold/hot key generation as host authorization has to occur after action is approved
  • CC voting enabled in vote job

Cardano-playground​

• Migration PR to largely complete the network migration from cardano-world to cardano-playground: cardano-playground-pull-5
  • Adds re-spun private chain network
  • Migrates shelley-qa chain network from world
  • Justfile improvements and new recipes
  • Improve concurrent environment chain support
  • More detail is available in the PR description

Iohk-nix​

• Migration to play: iohk-nix-pull-561
  • Migrate cardano-lib networks from world.dev.cardano.org to play.dev.cardano.org
  • Remove deprecated cardano-lib p2p network environment
  • Update sanchonet chain with respin changes
  • Update private chain with respin changes
  • Bump private and shelley-qa chains to sanchonet equivalent conway genesis
  • Bump preview, preprod chains to sanchonet equivalent conway genesis for node 8.6.0-pre pre-release testing

Sanchonet-demo​

• Update for cardano-node 8.6.0-pre demo: sanchonet-demo-commit

High level summary​

We have created new tag sancho-2-2-0, which integrates missing Conway feautures and some minor fix tags sancho-2-1-0, sancho-2-0-1. We have completed the initial implementation for the bootstrap instance objective.

Lower level summary​

• Add a new --disable-gov flag which disabled Conway ferautures #1558
• Fix of the committee key size #1544
• Workaround a ledger issue with unregistered pools #1542
• Implemented a mechanism that loads the UTxO from the ledger resulting is way faster syncs #1539
• Rename offline to offchain #1533
• Transfer existing tests to Conway era #1529#1547

High level summary​

This update contains mostly improvements to quality of Conway era implementation and tooling that we use for testing Ledger. Major Conway bugs that were discovered and squashed are:

• PParamsUpdate proposals will now correctly use DRep thresholds for ratification
• Treasury withdrawals are now properly enacted.
• Corrected snapshotting and DRep Stake Distribution Pulser initialization
• Delegation to non-existent Stake pool is no longer possible

Other important quality of life improvements are addition of reusable interfaces for an ordered set OSet and ordered map OMap. Which allowed us to disable duplicate certificates and proposals in a transaction. As a precursor to PlutusV3 integration, a serious reorganization of Plutus related functionality was performed.

Conway related additions that are noteworthy: Conway Ledger events, disallowing voting on expired proposals, addition of Anchor to Constitutional Committee resignation proposals.

Significant improvements have been made to a specialized "Imp" test library that allows us writing concise stateful unit tests for verifying the Ledger logic. Serious progress has been made on the conformance testing, where we can now interface with Haskell generated code from the Agda specification. Serialization testing has been extended to increase binary conformance coverage.

Low level summary​

Conway​

• pull-3808 - Enhance CommitteeMembersState query to return quorum and NoConfidence
• pull-3801 - Fix epoch rule and tests
• pull-3803 - Fix delegation validation
• pull-3759 - Reshuffle things to the DRepPulser incorporates some snap shot things
• pull-3779 - Prevent duplicate certs and proposals
• pull-3794 - Added anchor to resign certs
• pull-3797 - Cleanup JSON instances for Conway governance
• pull-3848 - Plutus modules restructure
• pull-3840 - Fix anomalies in Deposits in the Conway Era
• pull-3856 - Add governance related ledger events
• pull-3825 - Prevent voting on expired GovActions
• pull-3831 - Treasury withdrawal fix
• pull-3791 - Use a Data.OMap.Strict to replace ProposalsSnapshot
• pull-3836 - PParamsUpdate enactment fix
• pull-3846 - Revert argument order swap.

Testing​

• pull-3782 - Move ImpTest to Shelley testlib
• pull-3842 - Imp improvements
• pull-3844 - Add mappings to Agda types
• pull-3853 - Fix strange assertion failure, which hides real Block too big problem.
• pull-3809 - CDDL roundtrip testing
• pull-3832 - Treasury withdrawals tests
• pull-3839 - Added cardano-ledger-conformance
• pull-3841 - Add sha256 to cardano-ledger-executable-spec

Improvements and releasing​

• pull-3843 - Add ...WithLogs versions of evalScripts and friends
• pull-3795 - Bump plutus to 1.15
• pull-3798 - Bump urllib3 from 1.26.17 to 1.26.18 in /doc
• pull-3799 - Changes needed for 8.6 release
• pull-3807 - Add invalidBeforeL and invalidHereAfterL functions
• pull-3819 - Fixups needed for a release
• pull-3829 - Post release CHANGELOG version bumps
• pull-3830 - Bump aeson to 2.2
• pull-3833 - Backport release cardano-ledger-conway-1.10.1.0
• pull-3828 - Add changelog for node release 8.6

High level overview​

This week, the Mithril team continued working on completing the adaptation of the Mithril client as a library. They progressed in decentralizing the Mithril networks with the peer-to-peer (P2P) networking proof of concept, achieving the implementation of a very basic working demo with a peer-to-peer publish-subscribe (pub-sub) mechanism. Additionally, the team continued working on the deterministic computation of the UTXO/transactions set from the immutable files.

Finally, they resolved the naming issue of the Docker package responsible for storing images of the new Mithril client CLI, and continued addressing a performance issue associated with the 'release-mainnet' aggregator.

Low level overview​

• Worked on the issue Prototype a P2P relay with libp2p #1300
• Worked on the issue Light Wallet: Release mithril-client library #1311
• Worked on the issue Light Wallet: Compute deterministic Cardano UTxO/transactions set PoC #1283
• Worked on the issue release-mainnet aggregator is unreachable #1310
• Completed the issue Client Docker package is incorrect #1322

High level summary​

This week the Consensus team made progress on two fronts: the question of survivable eclipse duration, which is part of our work supporting Genesis delivery, and how to improve the handling of blocks from the future. Regarding the UTxO-HD branch, we managed to run a node with legacy blocks, which is syncing with mainnet, up to including Alonzo. We also investigated a regression in mempool snapshotting, which was ultimately solved by a Ledger update, and will be fixed in the upcoming Node 8.6 release.