High level overview​

This week, the Mithril team kept implementing a new data type for certifying Cardano transactions within Mithril networks. They completed the aggregator routes responsible for generating proofs of membership for a list of Cardano transactions and for listing produced artifacts. Additionally, they worked on extending the Mithril client library to support the verification of Cardano transactions, and on the creation of the new Mithril network running on SanchoNet.

Finally, the team kept working on the threat modeling and risk analysis for the Mithril network and investigated some flakiness occurring in the end-to-end tests in the CI.

Low level overview​

• Completed the issue Implement proof generation route in the aggregator #1467
• Completed the issue Implement artifact routes in the aggregator #1478
• Completed the issue Enhance ImmutableFile list computation resilience #1450
• Completed the issue Add WASM client step in Mithril Client multi-platform test #1408
• Completed the issue Enhance end to end test for Cardano hard forks #1464
• Worked on the issue Implement transactions verification in client library #1468
• Worked on the issue P2P threat modeling and risk analysis #1350
• Worked on the issue Create a test network on SanchoNet #1173
• Worked on the issue Enhance Mithril/Cardano node communication #1315
• Worked on the issue Some end to end tests are flaky in the CI #1147
• Worked on the issue Handle cancellation of certificate verification in WASM client #1480
• Worked on the issue Upgrade http dependency #1474
• Worked on the issue Generate automatic documentation for CLIs #1471

High-level overview of sprint 54​

In this sprint, we merged the bootstrap peers (aka weak genesis) changes to the ouroboros-network repository (ouroboros-network#4615). We continued working on integration & testing it using an early development version of cardano-node (cardano-node#5485).

Andrew Westberg (DripDropz) noticed and fixed a mistake in the cddl spec which resulted in misleading documentation; ouroboros-network#4790. The Handshake protocol flag should be called initiatorOnlyDiffusionMode. Library authors providing connectivity with other nodes via the node-to-node protocol are advised to review their implementation.

We continued working on the tx-submission decision logic; ouroboros-network#3311.

Karl Knutsson (CF) implemented:

• a debugging feature which dumps outbound governor state on the SIGUSR1 event (supported on POSIX compatible OSes); ouroboros-network#4730, ouroboros-network#4789.
• limited the rate at which one can discover nodes through peer sharing; ouroboros-network#4778.

Open Source Contributions​

IOSim​

We released a new version of io-sim to Hackage:

• Sebastian Nagel (IOG) fixed a bug in the flushTQueue implementation; io-sim#135
• We fixed the underflow error in threadDelay in the si-timers library (io-sim#129) reported by Nick Frisby (Tweag)

NoThunks​

We released a new version of nothunks to Hackage:

• wherefrom support; nothunks#46
• added Solo instance; nothunks#45
• added instances for Monoid and Semigroup newtype wrappers; nothunks#43

Low-level summary​

• We started using the ImportQualifiedPost extension, hence a large (autogenerated) syntax change; ouroboros-network#4715.
• Code cleanup; ouroboros-network#4792

High level summary​

The SRE team continues work on cardano environment improvements and general environment maintenance.

Some notable recent changes, updates or improvements include:

• Cardano explorer is being sunset and will soon be replaced by a new Cardano Foundation explorer
• IOG mainnet pools are now participating in propagation time reporting using Cardano Foundation's blockperf tool
• Cardano-parts node nixosConfigurations, node entrypoint and process-compose node jobs now utilize mithril client automatically on preview and preprod networks for faster synchronization of first start up. Mainnet mithril client use as well as signer modules will be available soon.

Lower level summary​

Cardano-mainnet​

• Adds a blockperf reporting module to the bootstrap nodes and block producer relays: cardano-mainnet-pull-7

Cardano-parts​

• Adds a block performance module which utilizes cardano-foundation's blockperf for aggregate block propagation reporting: cardano-parts-pull-29
• Adds a mithril client for nixosConfigurations, process-compose cardano-node processes and cardano-node entrypoint: cardano-parts-pull-30

Iohk-nix​

• Adds required mithril client environment information for preview, preprod, mainnet: iohk-nix-pull-570

Cardano-world​

• Add the sunset banner to explorer: cardano-world-commit

Upstream Contributions​

Blockperf​

• Add a nix flake with blockperf package and ci action: blockperf-pull-22

High-level Summary​

This week, the Hydra team authored and published the monthly report for January 2024, enhanced user feedback for failed commands, updated cardano-api dependency and GHC to newer versions, re-opened their persistent head in preparation for the hard-fork, extended the model-based testing suite to cover the closing of heads, fixed a bug in io-sim, and contributed to cardano-node.

What did the team achieve this week​

• Wrote and published the monthly report for January 2024
• Improved user feedback when a command failed #1251
• Update cardano-api dependency and ghc to newer versions #1269 and #1232
• Re-opened our persistent head using latest versions and ready for the hard-fork #1256
• Extended model-based testing suite to cover closing of heads #1276
• Fixed a bug in io-sim#133
• Contributed a PR to cardano-node#5657

What are the goals of next week​

• Fix the fanout after contest bug #1260
• Run Hydra smoke tests on sanchonet #1257
• Specify the on-chain validators for incremental decommits #1057
• Have the explorer hosted #696
• Prepare PRs for dropped JSON instances from API #1213

High level summary​

One very important Conway feature that became available since last report is the ability for Stake Pool Operators to vote on some of the security relevant protocol parameter updates. We organized proposal hierarchy into a cohesive implementation, which together with good tests gives us confidence in its correctness.

We also fixed a few important bugs:

• Preventing Constitutional Committee Members from voting on governance actions that they should not be allowed to vote on.
• Prevent deposits from appearing in orphaned reward accounts after the staking credential has been unregistered, but before the proposal procedure deposit has been returned.
• Ensure Sets are encoded in CBOR with tag 258 by default

Further improvements in testing tools and addition of more tests.

Low level summary​

Conway​

• pull-3982 - Added SPO voting thresholds for security relevant parameters
• pull-3978 - Proposals pruning rewrite
• pull-4003 - Prefix Set encoding with tag 258
• pull-3999 - Add PParamUpdates to the plutus context, by transforming them to Plutus Data
• pull-4008 - Fixed a bug in GOV rule
• pull-4013 - Remove EnactState from ConwayGovState
• pull-4025 - Further improvements to Proposals
• pull-4021 - Move unclaimed rewards from proposals to treasury

Testing​

• pull-3997 - Added DRep delegation injections to Conway
• pull-4023 - Add a function registerInState to EraTransition
• pull-4005 - Fixes in Shelley Imp framework and other small things
• pull-4004 - Verify that enacted gov action is removed
• pull-4016 - Fix Arbitrary instance and invariant checking for Proposals

Improvements​

• pull-4002 - Rename Acnt to Account

Releasing​

• pull-4020 - Remove usages of decommissioned zw3rk nix substituter
• pull-4014 - Update CHaP to fix nix develop
• pull-4011 - Prepare ledger release
• pull-4012 - Updates for Plutus 1.21