Add details about running GitHub actions tests locally #9363

cecile75 · 2025-08-14T12:03:10Z

What Does This Do

In the README file of the github actions:

clarify what is needed to run the tests locally.
add an example so it's clearer that running the tests locally can have consequences on the repository

Motivation

Be sure nobody runs the tests locally thinking they are just tests and won't affect the current repository

Additional Notes

.github/workflows/README.md

PerfectSlayer · 2025-08-14T12:16:18Z

.github/workflows/README.md

-> Locally running workflows will still query GitHub backend and will update the GitHub project accordingly.
-> Pay extra attention to the workflow jobs you trigger to not create development disruption.
+> Locally running workflows will still query GitHub backend and will update the GitHub project accordingly.  
+> For example, running 'tests/add-milestone-to-pull-requests/test-pull-request.sh' locally will add a milestone, on this github repository, to the PR whose ID is written in 'tests/add-milestone-to-pull-requests/payload-pull-request.json' as 'pull_request.number', if it hasn't one already.  


💭 thought: ‏I would not give a specific test scenario as example as it will increase the extra work maintaining it.
But having an explicit notice about "tests will run against the repository and will potentially alter existing issues, milestones and releases."

I wanted to write a concrete example as it's more meaningful to me but I agree that it's not great for maintenance.
Talking about "existing issues, milestones and releases" is already an improvement, let's go with that.

Co-authored-by: Bruce Bujon <PerfectSlayer@users.noreply.github.com>

pr-commenter · 2025-08-14T13:13:36Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cecile/githubactions
git_commit_date	1755127609	1755175019
git_commit_sha	`0f3ab90`	`30becd8`
release_version	1.53.0-SNAPSHOT~0f3ab90a6f	1.53.0-SNAPSHOT~30becd8b1a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755176890	1755176890
ci_job_id	1080326417	1080326417
ci_pipeline_id	73673757	73673757
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-q90m0azl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-q90m0azl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~30becd8b1a, baseline=1.53.0-SNAPSHOT~0f3ab90a6f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051072
Total [baseline] (10.729 s) : 0, 10728557
Agent [candidate] (1.044 s) : 0, 1044298
Total [candidate] (10.709 s) : 0, 10709273
section appsec
Agent [baseline] (1.23 s) : 0, 1229641
Total [baseline] (10.831 s) : 0, 10831306
Agent [candidate] (1.218 s) : 0, 1217781
Total [candidate] (10.723 s) : 0, 10722673
section iast
Agent [baseline] (1.175 s) : 0, 1174623
Total [baseline] (11.015 s) : 0, 11015031
Agent [candidate] (1.179 s) : 0, 1179242
Total [candidate] (10.922 s) : 0, 10921634
section profiling
Agent [baseline] (1.193 s) : 0, 1192703
Total [baseline] (10.889 s) : 0, 10888985
Agent [candidate] (1.193 s) : 0, 1193052
Total [candidate] (10.88 s) : 0, 10880381

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	appsec	1.23 s	178.569 ms (17.0%)
Agent	iast	1.175 s	123.552 ms (11.8%)
Agent	profiling	1.193 s	141.631 ms (13.5%)
Total	tracing	10.729 s	-
Total	appsec	10.831 s	102.749 ms (1.0%)
Total	iast	11.015 s	286.474 ms (2.7%)
Total	profiling	10.889 s	160.428 ms (1.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	appsec	1.218 s	173.483 ms (16.6%)
Agent	iast	1.179 s	134.944 ms (12.9%)
Agent	profiling	1.193 s	148.754 ms (14.2%)
Total	tracing	10.709 s	-
Total	appsec	10.723 s	13.401 ms (0.1%)
Total	iast	10.922 s	212.361 ms (2.0%)
Total	profiling	10.88 s	171.109 ms (1.6%)

gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~30becd8b1a, baseline=1.53.0-SNAPSHOT~0f3ab90a6f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.438 ms) : 0, 1438
crashtracking [candidate] (1.431 ms) : 0, 1431
BytebuddyAgent [baseline] (735.555 ms) : 0, 735555
BytebuddyAgent [candidate] (731.027 ms) : 0, 731027
GlobalTracer [baseline] (242.906 ms) : 0, 242906
GlobalTracer [candidate] (241.666 ms) : 0, 241666
AppSec [baseline] (30.314 ms) : 0, 30314
AppSec [candidate] (29.977 ms) : 0, 29977
Debugger [baseline] (6.075 ms) : 0, 6075
Debugger [candidate] (6.019 ms) : 0, 6019
Remote Config [baseline] (646.669 µs) : 0, 647
Remote Config [candidate] (654.785 µs) : 0, 655
Telemetry [baseline] (13.063 ms) : 0, 13063
Telemetry [candidate] (12.58 ms) : 0, 12580
section appsec
crashtracking [baseline] (1.434 ms) : 0, 1434
crashtracking [candidate] (1.427 ms) : 0, 1427
BytebuddyAgent [baseline] (758.885 ms) : 0, 758885
BytebuddyAgent [candidate] (752.651 ms) : 0, 752651
GlobalTracer [baseline] (237.077 ms) : 0, 237077
GlobalTracer [candidate] (234.13 ms) : 0, 234130
IAST [baseline] (23.996 ms) : 0, 23996
IAST [candidate] (23.544 ms) : 0, 23544
AppSec [baseline] (168.447 ms) : 0, 168447
AppSec [candidate] (168.214 ms) : 0, 168214
Debugger [baseline] (8.05 ms) : 0, 8050
Debugger [candidate] (7.196 ms) : 0, 7196
Remote Config [baseline] (635.498 µs) : 0, 635
Remote Config [candidate] (607.58 µs) : 0, 608
Telemetry [baseline] (9.987 ms) : 0, 9987
Telemetry [candidate] (9.101 ms) : 0, 9101
section iast
crashtracking [baseline] (1.423 ms) : 0, 1423
crashtracking [candidate] (1.437 ms) : 0, 1437
BytebuddyAgent [baseline] (847.657 ms) : 0, 847657
BytebuddyAgent [candidate] (850.835 ms) : 0, 850835
GlobalTracer [baseline] (232.406 ms) : 0, 232406
GlobalTracer [candidate] (233.44 ms) : 0, 233440
IAST [baseline] (28.475 ms) : 0, 28475
IAST [candidate] (26.756 ms) : 0, 26756
AppSec [baseline] (28.962 ms) : 0, 28962
AppSec [candidate] (28.484 ms) : 0, 28484
Debugger [baseline] (5.752 ms) : 0, 5752
Debugger [candidate] (8.313 ms) : 0, 8313
Remote Config [baseline] (572.863 µs) : 0, 573
Remote Config [candidate] (569.373 µs) : 0, 569
Telemetry [baseline] (8.389 ms) : 0, 8389
Telemetry [candidate] (8.284 ms) : 0, 8284
section profiling
crashtracking [baseline] (1.39 ms) : 0, 1390
crashtracking [candidate] (1.392 ms) : 0, 1392
BytebuddyAgent [baseline] (760.29 ms) : 0, 760290
BytebuddyAgent [candidate] (760.332 ms) : 0, 760332
GlobalTracer [baseline] (221.377 ms) : 0, 221377
GlobalTracer [candidate] (221.43 ms) : 0, 221430
AppSec [baseline] (29.906 ms) : 0, 29906
AppSec [candidate] (29.995 ms) : 0, 29995
Debugger [baseline] (6.307 ms) : 0, 6307
Debugger [candidate] (6.366 ms) : 0, 6366
Remote Config [baseline] (675.189 µs) : 0, 675
Remote Config [candidate] (674.425 µs) : 0, 674
Telemetry [baseline] (16.035 ms) : 0, 16035
Telemetry [candidate] (16.24 ms) : 0, 16240
ProfilingAgent [baseline] (107.373 ms) : 0, 107373
ProfilingAgent [candidate] (107.344 ms) : 0, 107344
Profiling [baseline] (108.02 ms) : 0, 108020
Profiling [candidate] (107.975 ms) : 0, 107975

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~30becd8b1a, baseline=1.53.0-SNAPSHOT~0f3ab90a6f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048950
Total [baseline] (8.593 s) : 0, 8593043
Agent [candidate] (1.047 s) : 0, 1046847
Total [candidate] (8.607 s) : 0, 8606870
section iast
Agent [baseline] (1.176 s) : 0, 1175896
Total [baseline] (9.329 s) : 0, 9329005
Agent [candidate] (1.175 s) : 0, 1174619
Total [candidate] (9.358 s) : 0, 9358183

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.049 s	-
Agent	iast	1.176 s	126.945 ms (12.1%)
Total	tracing	8.593 s	-
Total	iast	9.329 s	735.962 ms (8.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.047 s	-
Agent	iast	1.175 s	127.772 ms (12.2%)
Total	tracing	8.607 s	-
Total	iast	9.358 s	751.313 ms (8.7%)

gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~30becd8b1a, baseline=1.53.0-SNAPSHOT~0f3ab90a6f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.423 ms) : 0, 1423
BytebuddyAgent [baseline] (734.823 ms) : 0, 734823
BytebuddyAgent [candidate] (734.117 ms) : 0, 734117
GlobalTracer [baseline] (241.573 ms) : 0, 241573
GlobalTracer [candidate] (242.204 ms) : 0, 242204
AppSec [baseline] (30.04 ms) : 0, 30040
AppSec [candidate] (30.078 ms) : 0, 30078
Debugger [baseline] (5.986 ms) : 0, 5986
Debugger [candidate] (6.081 ms) : 0, 6081
Remote Config [baseline] (648.884 µs) : 0, 649
Remote Config [candidate] (649.401 µs) : 0, 649
Telemetry [baseline] (13.458 ms) : 0, 13458
Telemetry [candidate] (11.406 ms) : 0, 11406
section iast
crashtracking [baseline] (1.421 ms) : 0, 1421
crashtracking [candidate] (1.421 ms) : 0, 1421
BytebuddyAgent [baseline] (849.364 ms) : 0, 849364
BytebuddyAgent [candidate] (848.27 ms) : 0, 848270
GlobalTracer [baseline] (232.193 ms) : 0, 232193
GlobalTracer [candidate] (232.06 ms) : 0, 232060
IAST [baseline] (28.243 ms) : 0, 28243
IAST [candidate] (28.25 ms) : 0, 28250
AppSec [baseline] (27.558 ms) : 0, 27558
AppSec [candidate] (27.509 ms) : 0, 27509
Debugger [baseline] (7.407 ms) : 0, 7407
Debugger [candidate] (7.321 ms) : 0, 7321
Remote Config [baseline] (580.159 µs) : 0, 580
Remote Config [candidate] (574.913 µs) : 0, 575
Telemetry [baseline] (8.214 ms) : 0, 8214
Telemetry [candidate] (8.323 ms) : 0, 8323

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cecile/githubactions
git_commit_date	1755127609	1755175019
git_commit_sha	`0f3ab90`	`30becd8`
release_version	1.53.0-SNAPSHOT~0f3ab90a6f	1.53.0-SNAPSHOT~30becd8b1a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755176586	1755176586
ci_job_id	1080326418	1080326418
ci_pipeline_id	73673757	73673757
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ra5rhw7i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ra5rhw7i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 11 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:tracing:high_load	worse [+2.117ms; +2.977ms] or [+4.867%; +6.843%]	unstable [-13.597op/s; +1.722op/s] or [-12.642%; +1.601%]	46.048ms	101.612op/s	43.500ms	107.550op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~30becd8b1a, baseline=1.53.0-SNAPSHOT~0f3ab90a6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.419 ms) : 4363, 4475
.   : milestone, 4419,
iast (9.202 ms) : 9050, 9354
.   : milestone, 9202,
iast_FULL (14.155 ms) : 13873, 14437
.   : milestone, 14155,
iast_GLOBAL (10.111 ms) : 9919, 10303
.   : milestone, 10111,
profiling (8.958 ms) : 8820, 9096
.   : milestone, 8958,
tracing (7.373 ms) : 7271, 7475
.   : milestone, 7373,
section candidate
no_agent (4.297 ms) : 4240, 4354
.   : milestone, 4297,
iast (9.378 ms) : 9215, 9541
.   : milestone, 9378,
iast_FULL (14.588 ms) : 14293, 14882
.   : milestone, 14588,
iast_GLOBAL (10.223 ms) : 10046, 10401
.   : milestone, 10223,
profiling (8.889 ms) : 8752, 9026
.   : milestone, 8889,
tracing (7.321 ms) : 7220, 7421
.   : milestone, 7321,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.419 ms [4.363 ms, 4.475 ms]	-
iast	9.202 ms [9.05 ms, 9.354 ms]	4.783 ms (108.2%)
iast_FULL	14.155 ms [13.873 ms, 14.437 ms]	9.736 ms (220.3%)
iast_GLOBAL	10.111 ms [9.919 ms, 10.303 ms]	5.692 ms (128.8%)
profiling	8.958 ms [8.82 ms, 9.096 ms]	4.539 ms (102.7%)
tracing	7.373 ms [7.271 ms, 7.475 ms]	2.954 ms (66.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.297 ms [4.24 ms, 4.354 ms]	-
iast	9.378 ms [9.215 ms, 9.541 ms]	5.081 ms (118.2%)
iast_FULL	14.588 ms [14.293 ms, 14.882 ms]	10.291 ms (239.5%)
iast_GLOBAL	10.223 ms [10.046 ms, 10.401 ms]	5.926 ms (137.9%)
profiling	8.889 ms [8.752 ms, 9.026 ms]	4.592 ms (106.9%)
tracing	7.321 ms [7.22 ms, 7.421 ms]	3.023 ms (70.4%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~30becd8b1a, baseline=1.53.0-SNAPSHOT~0f3ab90a6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.988 ms) : 36691, 37285
.   : milestone, 36988,
appsec (46.746 ms) : 46351, 47142
.   : milestone, 46746,
code_origins (45.741 ms) : 45338, 46144
.   : milestone, 45741,
iast (44.654 ms) : 44259, 45048
.   : milestone, 44654,
profiling (48.462 ms) : 48038, 48886
.   : milestone, 48462,
tracing (43.5 ms) : 43129, 43872
.   : milestone, 43500,
section candidate
no_agent (37.122 ms) : 36812, 37432
.   : milestone, 37122,
appsec (45.933 ms) : 45520, 46345
.   : milestone, 45933,
code_origins (44.717 ms) : 44342, 45091
.   : milestone, 44717,
iast (44.187 ms) : 43807, 44567
.   : milestone, 44187,
profiling (48.566 ms) : 48121, 49010
.   : milestone, 48566,
tracing (46.048 ms) : 45622, 46473
.   : milestone, 46048,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.988 ms [36.691 ms, 37.285 ms]	-
appsec	46.746 ms [46.351 ms, 47.142 ms]	9.758 ms (26.4%)
code_origins	45.741 ms [45.338 ms, 46.144 ms]	8.753 ms (23.7%)
iast	44.654 ms [44.259 ms, 45.048 ms]	7.665 ms (20.7%)
profiling	48.462 ms [48.038 ms, 48.886 ms]	11.474 ms (31.0%)
tracing	43.5 ms [43.129 ms, 43.872 ms]	6.512 ms (17.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.122 ms [36.812 ms, 37.432 ms]	-
appsec	45.933 ms [45.52 ms, 46.345 ms]	8.811 ms (23.7%)
code_origins	44.717 ms [44.342 ms, 45.091 ms]	7.595 ms (20.5%)
iast	44.187 ms [43.807 ms, 44.567 ms]	7.065 ms (19.0%)
profiling	48.566 ms [48.121 ms, 49.01 ms]	11.444 ms (30.8%)
tracing	46.048 ms [45.622 ms, 46.473 ms]	8.926 ms (24.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cecile/githubactions
git_commit_date	1755127609	1755175019
git_commit_sha	`0f3ab90`	`30becd8`
release_version	1.53.0-SNAPSHOT~0f3ab90a6f	1.53.0-SNAPSHOT~30becd8b1a

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1755177118	1755177118
ci_job_id	1080326419	1080326419
ci_pipeline_id	73673757	73673757
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-t9dee571 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-t9dee571 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~30becd8b1a, baseline=1.53.0-SNAPSHOT~0f3ab90a6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.837 s) : 14837000, 14837000
.   : milestone, 14837000,
appsec (15.011 s) : 15011000, 15011000
.   : milestone, 15011000,
iast (18.372 s) : 18372000, 18372000
.   : milestone, 18372000,
iast_GLOBAL (18.149 s) : 18149000, 18149000
.   : milestone, 18149000,
profiling (15.709 s) : 15709000, 15709000
.   : milestone, 15709000,
tracing (14.784 s) : 14784000, 14784000
.   : milestone, 14784000,
section candidate
no_agent (15.392 s) : 15392000, 15392000
.   : milestone, 15392000,
appsec (14.861 s) : 14861000, 14861000
.   : milestone, 14861000,
iast (18.414 s) : 18414000, 18414000
.   : milestone, 18414000,
iast_GLOBAL (18.058 s) : 18058000, 18058000
.   : milestone, 18058000,
profiling (15.688 s) : 15688000, 15688000
.   : milestone, 15688000,
tracing (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.837 s [14.837 s, 14.837 s]	-
appsec	15.011 s [15.011 s, 15.011 s]	174.0 ms (1.2%)
iast	18.372 s [18.372 s, 18.372 s]	3.535 s (23.8%)
iast_GLOBAL	18.149 s [18.149 s, 18.149 s]	3.312 s (22.3%)
profiling	15.709 s [15.709 s, 15.709 s]	872.0 ms (5.9%)
tracing	14.784 s [14.784 s, 14.784 s]	-53.0 ms (-0.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.392 s [15.392 s, 15.392 s]	-
appsec	14.861 s [14.861 s, 14.861 s]	-531.0 ms (-3.4%)
iast	18.414 s [18.414 s, 18.414 s]	3.022 s (19.6%)
iast_GLOBAL	18.058 s [18.058 s, 18.058 s]	2.666 s (17.3%)
profiling	15.688 s [15.688 s, 15.688 s]	296.0 ms (1.9%)
tracing	15.028 s [15.028 s, 15.028 s]	-364.0 ms (-2.4%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~30becd8b1a, baseline=1.53.0-SNAPSHOT~0f3ab90a6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1486
.   : milestone, 1474,
appsec (3.624 ms) : 3410, 3837
.   : milestone, 3624,
iast (2.204 ms) : 2141, 2267
.   : milestone, 2204,
iast_GLOBAL (2.241 ms) : 2178, 2304
.   : milestone, 2241,
profiling (2.056 ms) : 2005, 2108
.   : milestone, 2056,
tracing (2.007 ms) : 1958, 2055
.   : milestone, 2007,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.661 ms) : 3444, 3877
.   : milestone, 3661,
iast (2.2 ms) : 2137, 2263
.   : milestone, 2200,
iast_GLOBAL (2.242 ms) : 2179, 2305
.   : milestone, 2242,
profiling (2.063 ms) : 2011, 2115
.   : milestone, 2063,
tracing (2.015 ms) : 1967, 2064
.   : milestone, 2015,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.486 ms]	-
appsec	3.624 ms [3.41 ms, 3.837 ms]	2.15 ms (145.8%)
iast	2.204 ms [2.141 ms, 2.267 ms]	729.673 µs (49.5%)
iast_GLOBAL	2.241 ms [2.178 ms, 2.304 ms]	767.136 µs (52.0%)
profiling	2.056 ms [2.005 ms, 2.108 ms]	582.325 µs (39.5%)
tracing	2.007 ms [1.958 ms, 2.055 ms]	532.736 µs (36.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	3.661 ms [3.444 ms, 3.877 ms]	2.188 ms (148.6%)
iast	2.2 ms [2.137 ms, 2.263 ms]	727.433 µs (49.4%)
iast_GLOBAL	2.242 ms [2.179 ms, 2.305 ms]	769.393 µs (52.3%)
profiling	2.063 ms [2.011 ms, 2.115 ms]	590.671 µs (40.1%)
tracing	2.015 ms [1.967 ms, 2.064 ms]	543.032 µs (36.9%)

Add details to the README about GitHub actions tests

75d69de

PerfectSlayer reviewed Aug 14, 2025

View reviewed changes

cecile75 and others added 2 commits August 14, 2025 14:17

Update .github/workflows/README.md

5815f4c

Co-authored-by: Bruce Bujon <PerfectSlayer@users.noreply.github.com>

Remove concrete example

30becd8

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add details about running GitHub actions tests locally #9363

Add details about running GitHub actions tests locally #9363

Uh oh!

cecile75 commented Aug 14, 2025

Uh oh!

Uh oh!

PerfectSlayer Aug 14, 2025

Uh oh!

cecile75 Aug 14, 2025

Uh oh!

pr-commenter bot commented Aug 14, 2025

Uh oh!

Uh oh!

Add details about running GitHub actions tests locally #9363

Are you sure you want to change the base?

Add details about running GitHub actions tests locally #9363

Uh oh!

Conversation

cecile75 commented Aug 14, 2025

What Does This Do

Motivation

Additional Notes

Uh oh!

Uh oh!

PerfectSlayer Aug 14, 2025

Choose a reason for hiding this comment

Uh oh!

cecile75 Aug 14, 2025

Choose a reason for hiding this comment

Uh oh!

pr-commenter bot commented Aug 14, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!