Skip to content

Conversation

topepo
Copy link
Member

@topepo topepo commented Jul 23, 2025

No description provided.

@topepo topepo requested a review from hfrick July 23, 2025 11:46
@topepo topepo marked this pull request as ready for review July 23, 2025 17:13
Copy link
Member

@hfrick hfrick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This would mean that we skip quite a lot of tests, and not "just" in the GHA run with the GH/dev version of the various packages but also in the CRAN run.

We want to keep an eye on any failures un-related to melodie-switch, and we want to resolve issues with melodie-switch.

For working through any issues with melodie-switch, I think it would be helpful to have extratests run with that code base. Yes, it would yell for a while, but at least we'd be sure we're done when everything is quiet. Then we don't have to remember to unskip all those tests.

I assume that if we can separate issues related to melodie-switch from those unrelated to it, we can compartmentalize the yelling sufficiently, similar to how we are dealing with the spark failures atm.

So, what about we add a third GHA workflow that does basically what the GH-R-CMD-check workflow does, but with the melodie-switch branch of tune?

@hfrick
Copy link
Member

hfrick commented Jul 25, 2025

Key points from our discussion in the team meeting

  • We prefer to have the tests fail, i.e., a bunch of yelling, to potentially forgetting to unskip.
  • For the cases where old and new tune are simply different, we are okay with skipping the CRAN tests until new tune is on CRAN.

I gathered cases where we need to update the tests and will skip in this issue for the .config changes: #243.

My impression from making those issues is that the majority of the failing tests should pass as they are now and thus need changes in the new tune codebase rather than a skip.

Based on this, I suggest we close this PR and add the skips where necessary when tackling the failures and closing the extratest issues re melodie-switch.

Do you want to be able to distinguish failures due to melodie-switch from other changes in the dev versions? If so, I'm happy to add that additional workflow to run with that branch (and we don't merge melodie-switch into main yet). If that's not so important, we leave things as they are here and merge in tune.

@EmilHvitfeldt
Copy link
Member

we talked about this in our meeting, and decided not to do this as it was "easier" to have all the failures happen

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants