High level summary
The SRE team continues work on Cardano environment improvements and general maintenance.
Some notable recent changes, updates or improvements include:
After upgrading hydra to new hardware and increasing eval concurrency for better ci throughput, an upstream hydra bug caused builds to frequently block in hydra's queue runner. The root caused was investigated and resolved with the fix to the issue pushed upstream.
A sizeable chunk of effort for this biweekly was invested in cardano-node's new tracing system, in particular between cardano-node, iohk-nix and cardano-parts repositories. Test machines were built and deployed using the latest tracing system changes intended for node
10.3with comparisons between new tracing and legacy tracing metrics made and the few remaining discrepancies addressed by the performance and tracing team. New tracing system dashboards and alerts were prepared with recent changes. Configurations in each repo were prepared for a switch to the new tracing system as default. Readiness to migrate cardano-parts clusters to the new tracing system is close!
Repository Work -- Merged
Cardano-node
- Add GHA github api pagination handling to avoid edge case failures cardano-node-pr-6159
Repository Work In Progress -- PRs and Branches
- Cardano-node: https://github.com/IntersectMBO/cardano-node/pull/6133
- Cardano-parts: https://github.com/input-output-hk/cardano-parts/pull/59
- Cardano-playground: https://github.com/input-output-hk/cardano-playground/pull/42
- Cardano-mainnet: https://github.com/input-output-hk/cardano-mainnet/pull/32
- Iohk-nix: https://github.com/input-output-hk/iohk-nix/pull/594