Skip to content

[release-3.4] Cleanup functional tests #20021

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

joshjms
Copy link
Member

@joshjms joshjms commented May 25, 2025

Adds the test-functional Makefile target.

Previously in .github/workflows/tests.yaml:

...
          linux-amd64-functional)
            ./build && GOARCH=amd64 PASSES='functional' ./test
            ;;
...

This is to standardize the commands used in the Prow job, we aim to simplify jobs to a single make [something] as much as possible.

/cc @ivanvc

Please read https://github.com/etcd-io/etcd/blob/main/CONTRIBUTING.md#contribution-flow.

@k8s-ci-robot k8s-ci-robot requested a review from ivanvc May 25, 2025 09:06
@joshjms joshjms force-pushed the makefile-test-functional-release-3.4 branch 2 times, most recently from 1345404 to 08e535b Compare May 25, 2025 09:46
@joshjms
Copy link
Member Author

joshjms commented May 25, 2025

/hold

@joshjms
Copy link
Member Author

joshjms commented May 26, 2025

/unhold

@joshjms
Copy link
Member Author

joshjms commented May 26, 2025

/hold

@joshjms joshjms force-pushed the makefile-test-functional-release-3.4 branch 2 times, most recently from f3d3aba to f986fcc Compare May 26, 2025 18:12
@joshjms
Copy link
Member Author

joshjms commented May 26, 2025

/unhold

Copy link
Member

@ivanvc ivanvc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks, @joshjms.

@k8s-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fuweid, ivanvc, joshjms
Once this PR has been reviewed and has the lgtm label, please assign jmhbnz for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ivanvc
Copy link
Member

ivanvc commented May 27, 2025

Link to kubernetes/test-infra#32754

@serathius
Copy link
Member

Note; functional tests were abandoned and removed because they didn't work and we didn't want to invest in them. They were replaced by robustness tests.

@serathius
Copy link
Member

#15102

@joshjms
Copy link
Member Author

joshjms commented May 28, 2025

Note; functional tests were abandoned and removed because they didn't work and we didn't want to invest in them. They were replaced by robustness tests.

Ah got it, then I think we can close this as we don't want any unnecessary tests in our CI? @ivanvc

@ivanvc
Copy link
Member

ivanvc commented May 28, 2025

Note; functional tests were abandoned and removed because they didn't work and we didn't want to invest in them. They were replaced by robustness tests.

@serathius, we're just closing the migration from GitHub workflows to Prow jobs. Note that this is for release-3.4. Do you suggest dropping these tests for release-3.4 (and release-3.5)?

@joshjms
Copy link
Member Author

joshjms commented May 29, 2025

/test

@k8s-ci-robot
Copy link

@joshjms: The /test command needs one or more targets.
The following commands are available to trigger required jobs:

/test pull-etcd-govulncheck
/test pull-etcd-integration-4-cpu-amd64
/test pull-etcd-release-tests
/test pull-etcd-verify

Use /test all to run all jobs.

In response to this:

/test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@joshjms
Copy link
Member Author

joshjms commented May 29, 2025

/test x

@k8s-ci-robot
Copy link

@joshjms: The specified target(s) for /test were not found.
The following commands are available to trigger required jobs:

/test pull-etcd-govulncheck
/test pull-etcd-integration-4-cpu-amd64
/test pull-etcd-release-tests
/test pull-etcd-verify

Use /test all to run all jobs.

In response to this:

/test x

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@joshjms
Copy link
Member Author

joshjms commented May 29, 2025

/test pull-etcd-integration-4-cpu-amd64

@serathius
Copy link
Member

Note; functional tests were abandoned and removed because they didn't work and we didn't want to invest in them. They were replaced by robustness tests.

@serathius, we're just closing the migration from GitHub workflows to Prow jobs. Note that this is for release-3.4. Do you suggest dropping these tests for release-3.4 (and release-3.5)?

Functional tests were abandoned after v3.5 release as they were no bringing any value, we just forgot to remove them in older branches. Robustness tests on the main branch run against older etcd branches including release-3.4 and release-3.5. Therefore I think it's ok to remove them.

@ivanvc
Copy link
Member

ivanvc commented May 29, 2025

Functional tests were abandoned after v3.5 release as they were no bringing any value, we just forgot to remove them in older branches. Robustness tests on the main branch run against older etcd branches including release-3.4 and release-3.5. Therefore I think it's ok to remove them.

Thanks for the input. @joshjms, let's clean up instead, then.

@joshjms
Copy link
Member Author

joshjms commented May 29, 2025

Got it will do @ivanvc

@joshjms joshjms changed the title [release-3.4] Add test-functional Makefile target [release-3.4] Cleanup functional tests May 29, 2025
@joshjms joshjms force-pushed the makefile-test-functional-release-3.4 branch from f986fcc to 6b3a9e4 Compare May 29, 2025 16:09
@joshjms
Copy link
Member Author

joshjms commented May 29, 2025

Should we do a cleanup of this scale for a released branch or should we just remove the running of tests (without removing functional testing related things like the functional/ directory for example)

@ivanvc
Copy link
Member

ivanvc commented May 29, 2025

@joshjms, please only delete the GitHub workflow. Thanks.

Signed-off-by: joshjms <joshjms1607@gmail.com>
@joshjms joshjms force-pushed the makefile-test-functional-release-3.4 branch from 6b3a9e4 to ed8b0a2 Compare May 29, 2025 18:41
@joshjms
Copy link
Member Author

joshjms commented May 29, 2025

Got it, my bad

@ivanvc
Copy link
Member

ivanvc commented May 29, 2025

Ah, the workflow is shared with all the other tests. Let's delete them altogether then, when we finish the migration. Sorry about the confusion, and thanks, @joshjms.

@ivanvc ivanvc closed this May 29, 2025
@joshjms joshjms reopened this Jun 3, 2025
@joshjms
Copy link
Member Author

joshjms commented Jun 3, 2025

/retest

@joshjms
Copy link
Member Author

joshjms commented Jun 3, 2025

Opening just to verify a presubmit

@ivanvc
Copy link
Member

ivanvc commented Jun 3, 2025

They work! Let's close this pull request. Thanks, @joshjms.

/close

@joshjms joshjms closed this Jun 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Development

Successfully merging this pull request may close these issues.

5 participants