59 posts tagged with "network"

High-level overview of sprint 48​

Bootstrap Peers​

We continued reviewing bootstrap peers, ouroboros-network#4555.

IOClasses / IOSim​

We prepared slides for a Haskell meetup were we presented a talk on IOSimPOR. The recording will be availble on YouTube.

We also used the opportunity to do some refactoring of the IOSim code base: io-sim#117. We released io-sim-1.3.0.0 on Hackage: io-sim#119.

We also added forkFinally to MonadFork (not included in 1.3.0.0 release): io-sim#123.

Tech debt​

We refactored Resource used by the DNS subsystem: ouroboros-network#4707. We continued reviewing the ouroboros-network#4625 PR, which refactors RootPeersDNS module.

High-level overview of sprint 47​

Bootstrap Peers​

We continued to review the process of bootstrap peers, see ouroboros-network#4555

CI / Tests​

We investigated our CI issues. We found a memory leak in typed-protocols function used for testing codecs which triggered out of memory manager (OOM) on some platforms (typed-protocols#43); we also found a bug in the connection manager which resulted in CI timeouts (see connection-manager-fix).

KeepAlive client​

We found two small issues with the keep-alive client, which were addressed by Karl Knutsson (Cardano Foundation), ouroboros-network#4689.

Galois​

We merged two large PRs prepared by Galois:

• inspect error call sites
• implement micro benchmarks for PeerMetrics

Cardano Network Service Assurance (CNSA)​

Galois made the following progress on CNSA:

• a simple [InfuxDB] database backend has been added;
• the documentation has been updated;
• internal improvements to the code;
• progress on a new "CSNA analysis" that provides, for each sampler node, the block download throughput in bytes over time.

New CHaP Release​

We cut a new release of ouroboros-netowrk packages to CHaP: chap#547

More details​

CI / Tests​

We improved the memory footprint of some of our tests by analysing a stream of IOSim traces without retaining them, see ouroboros-network#4696

As a safety measure, we introduced an upper bound for heap memory used by test artefacts in our nix tests. We use 200MB limit for all tests except for network-mux tests which use 350MB limit, see ouroboros-network#4702.

We refactored one of our tests to use ephemeral ports thus allowing it to run concurrently, see ouroboros-network#4702.

We merged ouroboros-network#4623 which fixes a bunch of test failures.

• inbound-governor: connection leak
• connection-manager: assertion failure
• not released connection

All of them were due to a bug in test logic rather than a bug in production code.

Release Process​

We updated our release process & associated scripts, see ouroboros-network#4705.

High-level overview of sprint 46​

Bootstrap Peers​

We continued reviewing of bootstrap peers, see ouroboros-network#4555.

Towards Typed Protocols 0.2.0.0​

We diagnosed the performance regression of the new design. The work on typed-protocols will be postponed. For more details see the typed-protocols#3. As an outcome of the performance debugging we prepared PR which updates the demo-ping-pong and demo-chain-sync applications.

Peer Sharing​

We made progress in review of ouroboros-network#4644, which simplifies the peer sharing and fixes the ouroboros-network#4642 issue.

Tech Debt​

We reviewed the ouroboros-network#3836 PR which inspects all the uses of error in ouroboros-network. The PR was prepared by Galois.

High-level overview of sprint 45​

Bootstrap Peers​

We started reviewing the bootstrap peers PR, ouroboros-network#4615.

Towards Typed Protocols 0.2.0.0​

We discovered a performance regression when using typed-protocols-0.2.0.0, and we started investigating where it comes from. Currently, we see that typed-protocols-0.2.0.0 can outperform typed-protocols-0.1.0.0 when running in isolation with a simple ping-pong protocol, so the regression might be in the new block fetch implementation which comes with typed-protocols-0.2.0.0 See typed-protocols#3.

Tech Debt​

We merged two PRs written by Galois engineers:

• a pull request which refactors the main entry function for P2P, see ouroboros-network#3834;
• a pull request which reviews usage of unsafe function in the network code based.

Galois also made progress with the following two issues:

• add microbenchmarks to some of our tests: ouroboros-network#3832
• inspect use of error in ouroboros-network repository: ouroboros-network#3836

IO-Sim​

IOSimPOR​

We found and fixed a bug in IOSimPOR. We'd like to thank Prof. John Hughes (Quviq AB) for helping us with debugging the issue.

We also provided a more uniform API for IOSimPOR, and added ways to make the debugging similar problems in the future easier.

IOSim​

To prepare for the next release, we consolidate packages taking advantage of the public sublibraries supported now both by cabal and Hackage. This is a work in progress, io-sim#114.

Cardano Newtork Service Assurance​

Galois made the following progress:

• A test run of spinning up a CNSA instance was done, as a result documentation was updated.
• Based on the IOG code review of the CNSA code, updates to the CNSA code were made.
• Galois has started the design for adding a CNSA analysis for "fetched bytes over time while node is syncing".

P2P adoption​

In the last two weeks, we've seen increase in P2P adoption.

The following graphs show several different versions of relays running on the mainnet. The green line NodeToNodeVersionV10.True denotes P2P relays.

Open Source​

We upstreamed our FFI bindings to Windows named pipes to Win32 package, the PR was accepted and merged.

We also received an external contribution which enhanced our documentation, see ouroboros-network#4676.

High-level overview of sprint 44​

Bootstrap Peers​

In this sprint, we focused on developing bootstrap peers.

Thanks to the input from Samuel Leathers (IOG) and John Lotoski (IOG), we identified a possible improvement to bootstrap peers. A more detailed description is available here.

Cardano-Node-8.4.0 Release​

We also were responsible for the cardano-node-8.4.0-pre release. A final integration PR is currently being merged. We published new versions of ouroboros-consensus, cardano-api and cardano-cli.

Towards Typed Protocols 0.2.0.0​

We also updated the future typed-protocols-0.2.0.0 and its integration with cardano-node. This is towards our goal which we planned for the next quarter. The identified tasks are to fix breaking tests, and then measure and address possible performance regressions.

Tech Debt​

Mark Tullsen (Galois) submitted two more PRs: ouroboros-network-#4663, ouroboros-network-#4664. We provided feedback on their other pull requests: ouroboros-network-#4661 and ouroboros-network-#4660.

P2P adoption​

In the last two weeks, there was a regression in P2P adoption concerning the number of SPOs or stakes, although the number of overall P2P relays has increased. Karl Knutsson (Cardano Foundation) is investigating this issue.

The following graphs show several different versions of relays running on the mainnet. The green line NodeToNodeVersionV10.True denotes P2P relays, which slowly increase over time. The V9 and earlier versions of the node-to-node the protocol indicates nodes version 1.35.x or earlier.

Data has been kindly provided by Cardano Foundation and their mainnet monitoring infrastructure.

Open Source​

We are in the process of upstreaming our ffi to Windows Named Pipes API to the Win32 package, see [win32-220].