What did the team achieve?​

• Continued progress on partial fanout, including KZG trusted setup with G1 accumulator commitments #2582, #2324
• Potential performance improvement: switched from list to Seq for faster benchmark runs at higher tx counts #2597
• Fixed file-handle explosion ("Too many open files") by closing connections properly #2588
• Upgraded mithril compatibility and added a fallback so nix develop works on aarch64-darwin #2596, #2598
• Updated the pumba flake so it builds on modern mac hardware #2602

What's next?​

• Continue work on partial fanout, set up a secure CRS and perform final code-review! #2573
• Work on reducing disk usage #2601, #2600
• Support the upcoming Dijkstra Era #2495
• User-friendly hydra-node configuration via config file #2581
• Accept PaymentExtendedKey (HD wallet keys) #2583

High level overview​

This week, the Mithril team completed the data encoding and state transition tests for the recursive SNARK circuit prototype, as well as the detection of SNARK circuit modifications in the STM library. They continued work on implementing a SNARK-friendly protocol message, the trusted setup validation for the SNARK circuit in the STM library, the implementation of Schnorr signatures in the STM library, and the in-circuit verification tests for the recursive SNARK circuit prototype.

The team also continued work on robust support for unknown and in-progress signed entity types, as well as enforcement of the DMQ message ID format. They completed the ledger state snapshot conversion tests in end-to-end tests and added support for stable and unstable versions of the OpenAPI specification.

Finally, they accelerated SNARK circuit tests in CI, upgraded Node.js 20 GitHub Actions, and fixed flaky nightly tests and circuit golden tests.

Low level overview​

Features​

• Completed the issue Add data encoding and state transition tests for recursive SNARK circuit prototype #3191
• Completed the issue Detect SNARK circuit modifications in STM #3216
• Worked on the issue Implement SNARK-friendly protocol message #3146
• Worked on the issue Trusted setup validation for SNARK circuit in STM #2944
• Worked on the issue Implement support for Schnorr signatures in STM #3136
• Worked on the issue Add in-circuit verification tests for recursive SNARK circuit prototype #3192
• Worked on the issue Enforcement of DMQ message id format #3251

Protocol maintenance​

• Completed the issue Accelerate SNARK circuit tests in CI #3162
• Completed the issue Upgrade Node.js 20 GitHub actions #3173
• Completed the issue Nightly tests are flaky #3210
• Completed the issue Test the ledger snapshot conversion in the e2e test #3213
• Completed the issue Circuit golden tests are flaky in STM #3231
• Completed the issue Client retrieves an artifact which is not of the expected type #3244
• Completed the issue Support for stable/unstable versions of Open API #3211
• Worked on the issue Robust support for unknown and in progress signed entity types #3172
• Worked on the issue Update all GitHub runners to Ubuntu 24.04 #3246

High level summary​

• Leios prototype development (Treasury Funding Initiative 4: Ouroboros Leios Implementation):
  • Completed the migration of endorser-block announcements and certification flags from the Ledger Block into the Praos Header, aligning the prototype with the original Leios design (#1978, ouroboros-leios#874, cardano-node#6537).
  • Fixed several bugs in the Leios prototype (#2017).
  • Helped the SRE team stand up a Leios testnet that is now running the prototype (ouroboros-leios#879).
  • Working on the voting prototype (#1963).
  • Continuing to investigate and fix in-memory LeiosDb performance issues observed during the March demo (ouroboros-leios#844, cardano-node#6554).
  • Working on applying Certified Endorser Blocks to the Mempool (ouroboros-leios#838).
• Ledger-HD (Treasury Funding Initiative 11: Ledger-HD):
  • Refactored consensus type variables so that ledger tables, transaction inputs, and transaction outputs are indexed by the block type rather than the ledger-state shape, collapsing duplicate type-class instances and simplifying the codebase ahead of Ledger-HD integration (#2016, #2019).
• Releases and integration (Treasury Funding Initiative 17: Maintenance and Support):
  • Released cardano-node-11.0 (cardano-node#6541).
• Documentation (Treasury Funding Initiative 17: Maintenance and Support):
  • Added an explanation page covering the Ticking mechanism used by the consensus layer (#2011).

High level summary​

Ledger team has made significant progress on Ledger rules for Nested Transactions as well as translation of newer features to Plutus context. We've also introduced a major change to how Plutus context is prepared for each transaction entering a mempool, which when fully integrated will result in significant performance improvements. On the efforts of expanding Ledger we have transferred all of the ledger state queries from Consensus component to the Ledger component, as well as introduced an initial stage of streaming injection functionality that we'll be needed for testing and benchmarking, especially for on disk storage where huge amount of data needs to be injected into ledger state without any impact on the operating memory.

Aside from features we have fixed a few more cddl bugs that we discovered with our new AntiGen and cuddle tools. Improved examples for golden tests and golden tests facilities.

Low level summary​

Features​

• PR-5692 - Adjust Dijkstra UTXOW rule to subtransactions
• PR-5684 - Remove unused FromCBOR/ToCBOR instances
• PR-5572 - Add streaming interface to era transition for initial funds injection
• PR-5737 - Fix treasury donations handling for SubTransactions
• PR-5755 - Clean up CddlSpec, fix Datum and AccountBalanceIntervals generators
• PR-5736 - Fix DecCBOR instances to reject ProtVer values exceeding the era maximum
• PR-5636 - Memoize Plutus related parts of transaction validation
• PR-5764 - Bring all remaining queries from consensus over to ledger
• PR-5767 - [Leios Prototype] Backwards compat fix
• PR-5757 - Remove allowLeftOver flag from binaryGetDecoder and simplify IP address decoders
• PR-5754 - Fail PlutusV1-V3 translation for direct deposits and balance intervals
• PR-5770 - Simplify Dijkstra constraints
• PR-5751 - UTXO with subtransactions
• PR-5747 - Add gov/proposals/roots/v0 namespace
• PR-5742 - Add entities/stake_pools/v0 namespace

Testing​

• PR-5749 - Fix and re-enable BbodysSec
• PR-5687 - Convert pool related CHAINExamples to ImpTests
• PR-5732 - Expand transaction content in examples in Test.Cardano.Ledger.[era].Examples
• PR-5753 - Use hspec-golden for Alonzo golden tests
• PR-5760 - Golden testing facilities for JSON and CBOR
• PR-5731 - Add negative tests for Metadatum int decoding range
• PR-5765 - Add a custom generator to cost_models, create Huddle.Gen module

Infrastructure and releasing​

• PR-5750 - Run tests for ghc 9.6.7 only
• PR-5756 - Bump actions/upload-pages-artifact from 4 to 5 in the actions group
• PR-5766 - Drop x86_64-darwin from Hydra builds
• PR-5768 - Bump slackapi/slack-github-action from 3.0.1 to 3.0.2 in the actions group
• PR-5594 - Test failure summaries in CI
• PR-5774 - Handle single failing suite case in CI test failure summaries

High level overview​

This week, the Mithril team released the 2617.0 distribution. This version bumps the Mithril signer to 1.0.0, marking it as production-ready on the release-mainnet network, adds support for Cardano node v.10.7.1, and includes statically built binaries as well as various bug fixes and improvements.

The team also completed the golden tests for the recursive SNARK circuit prototype and enhanced witness preparation for the non-recursive prover in the STM library. They continued work on implementing a SNARK-friendly protocol message, the data encoding and state-transition tests for the recursive SNARK circuit prototype, and detecting SNARK circuit modifications in the STM library. Additionally, they completed the extraction of the Merkle tree modules into a new crate.

Finally, the team implemented support for multiple tiers of tests in CI, refactored the crates publication, and investigated test flakiness.

Low level overview​

Features​

• Completed the issue Add golden tests for recursive SNARK circuit prototype #3125
• Completed the issue Enhance preparation of witness for the non-recursive prover in STM #3178
• Completed the issue Extract Merkle tree modules in new crate #2897
• Worked on the issue Implement SNARK-friendly protocol message #3146
• Worked on the issue Add data encoding and state transition tests for recursive SNARK circuit prototype #3191
• Worked on the issue Detect SNARK circuit modifications in STM #3216

Protocol maintenance​

• Released the new distribution 2617.0
• Published a dev blog post Distribution 2617 is now available
• Published a dev blog post Mithril signer 1.0.0 stable release
• Published a dev blog post Statically built Mithril binaries
• Completed the issue Upgrade to Cardano 10.7 #2894
• Completed the issue Release 2617 distribution #2967
• Completed the issue SNARK aggregator certification stopped on dev-follower-preview #3183
• Completed the issue End to end tests are flaky #3205
• Completed the issue Support multiple tiers for tests in CI #3206
• Completed the issue Signer version is not recorded in the aggregator monitoring store #3227
• Completed the issue Refactor the crates publication #3230
• Worked on the issue Accelerate SNARK circuit tests in CI #3162
• Worked on the issue Nightly tests are flaky #3210
• Worked on the issue Test the ledger snapshot conversion in the e2e test #3213
• Worked on the issue Circuit golden tests are flaky in STM #3231