Meeting Summary:
The testing team discussed changes to test fixture releases and updates on BlobNet environment configurations, including decisions about network testing on Goerli. The team reviewed progress on client implementations and benchmarking efforts for DevNet 2 and DevNet 3, with most clients expected to complete required changes by Wednesday. Various client implementations for ePBS devnet were discussed, including payload attestation concerns and state management deployment plans, with teams working to resolve syncing issues and prepare for interop testing.
Click to expand detailed summary
The testing team led by Dan announced changes to their test fixture releases, reorganizing the fixture directory layout to include only fixtures for one fork in a single JSON file. Barnabas provided an update on BlobNet, noting that CL teams can now enable a hidden flag for stable releases and testing will occur on a controlled network environment, particularly on Sepolia and Goerli. The team agreed to test on Goerli rather than spending resources on a devnet, pending updates from Nimbus and Teku teams.
The team discussed progress on client implementations and benchmarking efforts for DevNet 2 and DevNet 3. Marc reported progress on parallel execution and StateRoot implementation, while Stefan mentioned plans to start work on Shadow Fork benchmarking once three clients are available. Jochem provided an update on stateful testing capabilities, noting that Vega is integrating these benchmarks. The team also discussed the need to merge two PRs related to execution APIs and agreed to proceed with adding metadata fields to test fixtures, pending approval from the STEEL Discord server.
The team discussed the status of Ethereum Foundation DevNet 3, with clients like Nethermind, Besu, and Erigon reporting progress on required changes. Most clients are expected to complete their updates by Wednesday, with the exception of PR 8037 which needs review and testing. The team confirmed that the state creation cost increase and maximum contract size changes are optional and not blockers for the DevNet 3 launch. The group also briefly touched on ePBS DevNet Zero, which is planned for Wednesday pending updates from client teams.
The team discussed the status of various clientsâ implementations for the ePBS devnet. Potuz reported that Prysm is passing kurtosis tests and is robust, but faces sync issues that are being worked on. Barnabas suggested focusing on stability for the first few weeks before introducing malicious testing. Other clients like Teku, Lighthouse, and Lodestar are also working on their implementations, with some facing specific issues like handling early payloads and storing finalized payloads. The team agreed to aim for interop testing later in the week, with Barnabas suggesting a stable genesis block for all clients to start with.
The team discussed payload attestation concerns, with Potuz clarifying that clients should not be broken by payload attestation issues, though there might be client bugs causing down-scoring of peers. They confirmed that both Besu and Reth are ready for EIP-870 implementation, with Barnabas planning to include both clients in testing on the NFT devnet-10. The team also noted that while Besu is already running on the development branch, Reth needs to be merged into main before it can be fully tested.
The team discussed the deployment of the latest scenario for state management, which will be completed today, resulting in a state size of 1.5-2TB. They plan to extract all snapshots and move towards 4TB, after which they will run analysis. The slow block tracing for Nethermind is being handled by Ben, while other teams have merged or have PRs ready. There are ongoing issues with Nethermind and Reth nodes syncing on DevNet 3, with Barnabas investigating the host and Jen following up with the Reth team. Toni presented a new tool for creating state outside the network, which could be useful for benchmarking and is already implemented for Geth and Erigon.
Next Steps:
- Client teams: Drop comments on the fixture directory layout change thread in EFR&D if there are objections (this week)
- CL teams (Nimbus and Teku): Provide update on BlobNet readiness (by Thursday or on previous call)
- Nethermind: Complete state creation go-kos increased implementation (by Wednesday)
- Ĺukasz (Nethermind): Implement increased maximum contract size (today)
- Daniel (Besu): Review and merge PR for 8037 with fixed cost per statewide (by Wednesday)
- Daniel (Besu): Run new execution spec tests for 8037 implementation
- Execution APIs team: Merge block-level access list JSON RPC methods PR (today)
- Execution APIs team: Merge max used gas field on eth_simulateV1 PR (today)
- Client teams: Provide feedback on metadata field addition to fixture format (this week, async on STEEL Discord)
- Stefan Starflinger: Start Kurtosis testing for DevNet 3 when clients are ready
- Terrence (Prysm): Push sync changes to ePBS devnet 0 branch (today or tomorrow)
- Parithosh/Testing team: Rebase malicious Prysm node on top of ePBS devnet 0 branch for additional test scenarios (next day or two)
- Stefan Bratanov (Teku): Run more tests on payload timing issue and finalized payloads storage
- Caleb (Nimbus): Push fix for networking/peer scoring issue (by today)
- Jen: Follow up with Reth team on State Bloods Discord about crash loop/out of memory issue
- Barnabas: Roll out Besu master branch to NFT dev at 10 when ready
- Barnabas: Request ME test on physical host for Nethermind issue investigation
Recording Access: