High level summary​

The SRE team continues work on cardano environment improvements and general environment maintenance.

Some notable recent changes, updates or improvements include:

• Sanchonet was respun for cardano-node 8.11.0-pre

• Private chain was respun twice for pre-sancho respin testing and short epoch testing with cardano-node 8.11.0-pre

• Shelley-qa, two-thirds of preview and one-third of preprod networks were deployed to cardano-node 8.11.0-pre

• Sanchonet, private chain and shelley-qa networks had dbsync sancho-4-3-0 deployed

• A dbsync show_current_forging prepared statement was added to the cardano-parts profile-cardano-postgres nixosModule to aid with debugging chain quality issues

• Three documents were added to cardano-playground to better explain some operations procedures: KES rotation, chain quality debugging and new network creation. Found at: docs/explain

• A new mithril dashboard template is available in cardano-parts

Lower level summary​

Capkgs:​

• Avoid git API rate limit errors on update github action via netrc usage and corresponding secret: capkgs-commit

Cardano-parts​

• Sets cardano-node-ng to 8.11.0-pre and cardano-db-sync-ng to sancho-4-3-0. Adds a dbsync prepared statement, mithril dashboard template, updates the node application dashboard template, improves justfile recipe templates and tunes some systemd dependencies. Iohk-nix-ng was updated for sanchonet and private chain respins. More detail is available in the PR description: cardano-parts-pull-41

Cardano-mainnet​

• Rotates KES, pins iogp4 as -ng, adds a mithril dashboard, updates the node application dashboard, improves justfile recipes and tunes systemd node and mithril services to avoid some edge case errors. See the PR description for more details: cardano-mainnet-pull-15

Cardano-ogmios​

• Build ogmios v6.3.0 with nix: cardano-ogmios-branch-compare

Cardano-playground​

• Respins sancho and private chains and deploys cardano-node 8.11.0-pre and cardano-db-sync sancho-4-3-0 to appropriate envs and machines. Adds a mithril dashboard template, updates the node application dashboard template, improves justfile recipe templates. Adds three new explainer readme documents. See the PR description for more details: cardano-playground-pull-24

High level summary​

Most of the focus was on the conformance testing this time around. We had completed conformance tests for CERT and RATIFY rules and progressed on some of the others. This also resulted in some improvements to the constraint-generators framework. Besides that we've also fixed Stake Pool Operator stake distribution calculation that is used for voting by including proposal deposits that are currently locked in the system. One of the Ledger team members was also performing duties of a release engineer, so we also facilitated the latest cardano-node-8.11 release.

Low level summary​

Features and fixes​

• pull-4324 - Proposal deposits in SPO voting stake
• pull-4316 - Complete EraScript hierarchy with missing classes
• pull-4287 - Fix various minor issues in the Shelley & Babbage specs

Testing​

• pull-4320 - CERT conformance
• pull-4334 - RATIFY conformance
• pull-4337 - Fix RATIFY conformance
• pull-4325 - constrained-generators: soundness tests and bugfixes
• pull-4323 - constrained-generators: clean up interface
• pull-4336 - constrained-generators: Introduce fromList_ :: (HasSpec fn a, Ord a) => Term fn [a] -> Term fn (Set a)

Infrastructure and releasing​

• pull-4333 - Fix babbage-test and conway-test versions
• pull-4332 - Update CHANGELOGs
• pull-4343 - Bump requests from 2.31.0 to 2.32.0 in /doc

High level overview​

This week, the Mithril team continued implementing the certification of Cardano transactions in Mithril networks. They worked on scaling proof generation for mainnet by prototyping optimizations and benchmarking performance improvements. They also made progress on low-latency certification by completing the retrieval of the chain tip and importing transactions from the Cardano mini-protocol with Pallas. Additionally, they worked on a new explorer page to display in/out SPOs for the latest Cardano epochs.

Finally, the team upgraded the testing-sanchonet network following the SanchoNet network respin, created a module for building test transactions, and began removing the deprecated snapshot command from the client CLI.

Low level overview​

• Completed the issue Aggregator stress test crashes during signer registration #1676
• Completed the issue Prune Cardano transactions stored on signer #1645
• Completed the issue ChainObserver supports retrieving the Chain Point of the tip of the chain #1589
• Completed the issue Prepare testing-sanchonet for respin with Cardano 8.11-pre #1694
• Completed the issue MacOS Rust tests are flaky in CI #1556
• Worked on the issue Prototype optimizations for increasing Cardano transactions proof generation throughput #1687
• Worked on the issue Retrieve Cardano blocks with chainsync in pallas PoC #1590
• Worked on the issue Explorer display in/out SPOs in registered signers page #1686
• Worked on the issue Create a test Cardano transactions builder #1667
• Worked on the issue Cardano signatures are not produced on testing-sanchonet and testing-mainnet #1681
• Worked on the issue Remove snapshot command in client CLI #1690
• Worked on the issue Mithril Signer Local Error Policy : Error 182 - MuxError #1632

High level summary​

• Released Consensus for Node 8.11 (#1101)
• Improved the Praos chain order:
  • Restricted VRF tiebreaker based on slot distance (#1047)
  • Small tweak to the issue number tiebreaker (#1086)
• Wrote overview on the statistics on the leader schedule (#1096)
• Integrated robustness refinement for concluding that a node is caught up in the context of bootstrap peers (#1031)
• The P&T team managed to complete the UTXO-HD benchmarks using the LMDB backend and the results are promising.
• We're working on setting up the Consensus Technical Working Group within Intersect, so if you'd like to participate please reach out to Damian Nadales.

High level overview​

This week, the Mithril team released the new distribution 2418.1, which includes broader CPU support for pre-built binaries and a new memory allocator for the signer and aggregator nodes aimed at preventing memory fragmentation. They also continued implementing the certification of Cardano transactions in Mithril networks and worked on scaling the signature and proof generation for mainnet. Specifically, they completed the implementation of compressing the transaction Merkle tree using sub-Merkle trees based on transaction block ranges and initiated testing and assessing performance on mainnet in a test Mithril network. Additionally, they started working on minimizing the extra disk space requirements for the signer on the SPO infrastructure.

Finally, the team implemented some optimizations for the aggregator, fixed some bugs on the client, and introduced new documentation for compiling the Mithril relay from source.

Low level overview​

• Released the new distribution 2418.1
• Completed the issue Use Block Range Merkle roots to sign Cardano transactions #1634
• Completed the issue Use Block Range Merkle roots to prove Cardano transactions #1635
• Completed the issue Deploy Cardano transactions to testing-mainnet #1647
• Completed the issue Consistent sorting of transactions from GetCardanoTransactionProvider in signer and aggregator #1657
• Completed the issue Use SQLite transactions when inserting Cardano Transactions and Block Range Roots #1656
• Completed the issue Implement Ord on SignedEntityTypeDiscriminants #1648
• Completed the issue Merkle roots don't have fixed size in the block_range_root table #1668
• Completed the issue Refactor Cardano transactions database layer in persistence for signer and aggregator #1677
• Completed the issue Some timing tests fail on ARM #1466
• Completed the issue Add Mithril networks configurations in networks.json #1638
• Completed the issue Add section for manual setup of squid in SPO guide #1610
• Worked on the issue Aggregator stress test crashes during signer registration #1676
• Worked on the issue Prune Cardano transactions stored on signer #1645
• Worked on the issue ChainObserver supports retrieving the Chain Point of the tip of the chain #1589
• Worked on the issue Retrieves Cardano blocks with chainsync in pallas PoC #1590
• Worked on the issue Mithril Signer Local Error Policy : Error 182 - MuxError #1632