[feat] Log all tests in perfloggers, not only performance tests

[ekouts]

Fixes #3460 .

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 91.26%. Comparing base (e3c4b30) to head (6c37513).

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #3516      +/-   ##
===========================================
- Coverage    91.27%   91.26%   -0.01%     
===========================================
  Files           62       62              
  Lines        13358    13367       +9     
===========================================
+ Hits         12193    12200       +7     
- Misses        1165     1167       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[vkarak]

lI think it should be even simpler. Since log_performance() is already called in sanity failures for performance tests, what if we simply rename it to log_result() and remove the check is_performance_check() from the log_performance()?

I think this should pretty much get us to what we want.

[ekouts]

lI think it should be even simpler. Since log_performance() is already called in sanity failures for performance tests, what if we simply rename it to log_result() and remove the check is_performance_check() from the log_performance()?

I think this should pretty much get us to what we want.

But could it be an issue for users if we add more entries in their logging, without giving the option to disable? For CSCS it's of course fine, but I added the option so that we keep compatibility.

[vkarak]

lI think it should be even simpler. Since log_performance() is already called in sanity failures for performance tests, what if we simply rename it to log_result() and remove the check is_performance_check() from the log_performance()?
I think this should pretty much get us to what we want.

But could it be an issue for users if we add more entries in their logging, without giving the option to disable? For CSCS it's of course fine, but I added the option so that we keep compatibility.

I don't it's such a big issue as it is not breaking anything. Besides, the perflogs are per test, so there will not be new entries in existing files. So I'd rather go with this change than adding yet another configuration parameter.

[ekouts]

lI think it should be even simpler. Since log_performance() is already called in sanity failures for performance tests, what if we simply rename it to log_result() and remove the check is_performance_check() from the log_performance()?
I think this should pretty much get us to what we want.

But could it be an issue for users if we add more entries in their logging, without giving the option to disable? For CSCS it's of course fine, but I added the option so that we keep compatibility.

I don't it's such a big issue as it is not breaking anything. Besides, the perflogs are per test, so there will not be new entries in existing files. So I'd rather go with this change than adding yet another configuration parameter.

Ok! will make the change :)