Skip to content

test: batch 2 conformity tests #4110

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Conversation

arianejasuwienas
Copy link
Contributor

@arianejasuwienas arianejasuwienas commented Aug 4, 2025

Description

Batch 2 conformity tests - brought back.

Related issue(s)

Fixes #3823

Testing Guide

Changes from original design (optional)

Additional work needed (optional)

Checklist

@arianejasuwienas arianejasuwienas added this to the 0.71.0 milestone Aug 4, 2025
@arianejasuwienas arianejasuwienas self-assigned this Aug 4, 2025
@arianejasuwienas arianejasuwienas requested a review from a team as a code owner August 4, 2025 10:16
@arianejasuwienas arianejasuwienas added the ArianeLabs Items ArianeLabs is contributing to label Aug 4, 2025
@arianejasuwienas arianejasuwienas requested a review from a team as a code owner August 4, 2025 10:16
Copy link

github-actions bot commented Aug 4, 2025

Test Results

 20 files  ±0  265 suites  ±0   18m 21s ⏱️ +7s
712 tests  - 1  706 ✅ ±0  5 💤 ±0  1 ❌  - 1 
728 runs  ±0  722 ✅ +1  5 💤 ±0  1 ❌  - 1 

For more details on these failures, see this check.

Results for commit d922ece. ± Comparison against base commit a96d54d.

This pull request removes 1 test.
"after all" hook in "@web-socket-batch-2 eth_newFilter" ‑ RPC Server Acceptance Tests Acceptance tests @web-socket-batch-2 eth_newFilter "after all" hook in "@web-socket-batch-2 eth_newFilter"

♻️ This comment has been updated with latest results.

@arianejasuwienas arianejasuwienas marked this pull request as draft August 4, 2025 13:06
@arianejasuwienas arianejasuwienas force-pushed the 3823-conformity-batch-2 branch 2 times, most recently from fc27453 to c418d07 Compare August 5, 2025 08:33
@arianejasuwienas arianejasuwienas marked this pull request as ready for review August 5, 2025 14:17
simzzz
simzzz previously approved these changes Aug 6, 2025
@quiet-node
Copy link
Contributor

Looks like there's a lint issue.

Signed-off-by: Mariusz Jasuwienas <mariusz.jasuwienas@arianelabs.com>
@arianejasuwienas arianejasuwienas force-pushed the 3823-conformity-batch-2 branch 3 times, most recently from 3ca251a to 13e8db2 Compare August 12, 2025 07:54
Copy link
Contributor

@acuarica acuarica left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lg, left one question

@@ -254,7 +240,7 @@ describe('@api-conformity', async function () {

synthesizeTestCases(TEST_CASES_BATCH_3['server'], updateParamIfNeeded);

describe('ws related rpc methods', async function () {
/* describe('ws related rpc methods', async function () {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this supposed to be commented out? If yes, do we have an issue or PR to capture that some tests are skipped?

Maybe it's better to include .skip instead of commenting them,

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I’ll make sure they work correctly as well.

@acuarica acuarica changed the title test: batch 2 conformity tests (#3823) test: batch 2 conformity tests Aug 12, 2025
@arianejasuwienas arianejasuwienas marked this pull request as draft August 13, 2025 09:16
@arianejasuwienas
Copy link
Contributor Author

Looks like there's a lint issue.

Yes, I just uncommented some previously commented code, but it’s a good chance to clean it up as well.

Signed-off-by: Mariusz Jasuwienas <mariusz.jasuwienas@arianelabs.com>
Signed-off-by: Mariusz Jasuwienas <mariusz.jasuwienas@arianelabs.com>
Copy link

codecov bot commented Aug 13, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.

@@            Coverage Diff             @@
##             main    #4110      +/-   ##
==========================================
+ Coverage   95.39%   95.54%   +0.14%     
==========================================
  Files         122      121       -1     
  Lines       20996    20163     -833     
  Branches     1750     1733      -17     
==========================================
- Hits        20030    19265     -765     
+ Misses        944      873      -71     
- Partials       22       25       +3     
Flag Coverage Δ
config-service 98.80% <ø> (ø)
relay 90.54% <ø> (-0.04%) ⬇️
server 89.35% <ø> (+1.05%) ⬆️
ws-server 53.73% <ø> (-1.28%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 46 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ArianeLabs Items ArianeLabs is contributing to
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enable previously skipped conformity test case scenarios
4 participants