Rewrite test-suites in kotlin #9587

sarahchen6 · 2025-09-22T19:54:56Z

What Does This Do

This PR creates a new file test-suites.gradle.kts, written in Kotlin. However, this Kotlin file cannot be easily used yet because it needs to replace the original test-suites.gradle file. BUT, this file is called from the broader Groovy https://github.com/DataDog/dd-trace-java/blob/master/gradle/java_no_deps.gradle#L15 file, where the apply from: mechanism only works for other Groovy files. Thus, we would need to convert all of these transitively dependent build files to Kotlin first, which is a massive undertaking...

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

datadog-datadog-prod-us1 · 2025-09-22T20:16:15Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.77% (-0.06%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 4081713 | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-09-22T20:26:56Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/rewrite-test-suites-in-kotlin
git_commit_date	1758570639	1758570099
git_commit_sha	`b91074c`	`4081713`
release_version	1.54.0-SNAPSHOT~b91074c79a	1.54.0-SNAPSHOT~4081713026

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758572725	1758572725
ci_job_id	1141980745	1141980745
ci_pipeline_id	77217641	77217641
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-rgbqr861 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-rgbqr861 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 10 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.022 s) : 0, 1021678
Total [baseline] (8.683 s) : 0, 8682764
Agent [candidate] (1.019 s) : 0, 1018529
Total [candidate] (8.649 s) : 0, 8649166
section iast
Agent [baseline] (1.156 s) : 0, 1156379
Total [baseline] (9.317 s) : 0, 9317443
Agent [candidate] (1.161 s) : 0, 1160707
Total [candidate] (9.404 s) : 0, 9403986

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.022 s	-
Agent	iast	1.156 s	134.701 ms (13.2%)
Total	tracing	8.683 s	-
Total	iast	9.317 s	634.679 ms (7.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.019 s	-
Agent	iast	1.161 s	142.178 ms (14.0%)
Total	tracing	8.649 s	-
Total	iast	9.404 s	754.82 ms (8.7%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (689.748 ms) : 0, 689748
BytebuddyAgent [candidate] (687.36 ms) : 0, 687360
GlobalTracer [baseline] (257.929 ms) : 0, 257929
GlobalTracer [candidate] (258.299 ms) : 0, 258299
AppSec [baseline] (31.707 ms) : 0, 31707
AppSec [candidate] (31.633 ms) : 0, 31633
Debugger [baseline] (6.34 ms) : 0, 6340
Debugger [candidate] (6.359 ms) : 0, 6359
Remote Config [baseline] (685.842 µs) : 0, 686
Remote Config [candidate] (678.825 µs) : 0, 679
Telemetry [baseline] (12.829 ms) : 0, 12829
Telemetry [candidate] (11.772 ms) : 0, 11772
section iast
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (811.592 ms) : 0, 811592
BytebuddyAgent [candidate] (813.355 ms) : 0, 813355
GlobalTracer [baseline] (248.281 ms) : 0, 248281
GlobalTracer [candidate] (250.604 ms) : 0, 250604
AppSec [baseline] (29.091 ms) : 0, 29091
AppSec [candidate] (26.619 ms) : 0, 26619
Debugger [baseline] (6.136 ms) : 0, 6136
Debugger [candidate] (6.137 ms) : 0, 6137
Remote Config [baseline] (598.359 µs) : 0, 598
Remote Config [candidate] (599.73 µs) : 0, 600
Telemetry [baseline] (8.203 ms) : 0, 8203
Telemetry [candidate] (8.096 ms) : 0, 8096
IAST [baseline] (30.079 ms) : 0, 30079
IAST [candidate] (32.769 ms) : 0, 32769

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1027548
Total [baseline] (10.723 s) : 0, 10723242
Agent [candidate] (1.026 s) : 0, 1025724
Total [candidate] (10.691 s) : 0, 10691169
section appsec
Agent [baseline] (1.203 s) : 0, 1203144
Total [baseline] (10.96 s) : 0, 10960310
Agent [candidate] (1.196 s) : 0, 1195531
Total [candidate] (10.976 s) : 0, 10976263
section iast
Agent [baseline] (1.154 s) : 0, 1153810
Total [baseline] (11.033 s) : 0, 11033013
Agent [candidate] (1.161 s) : 0, 1160892
Total [candidate] (11.116 s) : 0, 11115566
section profiling
Agent [baseline] (1.171 s) : 0, 1171124
Total [baseline] (11.031 s) : 0, 11030574
Agent [candidate] (1.165 s) : 0, 1164966
Total [candidate] (11.063 s) : 0, 11062806

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.028 s	-
Agent	appsec	1.203 s	175.596 ms (17.1%)
Agent	iast	1.154 s	126.262 ms (12.3%)
Agent	profiling	1.171 s	143.576 ms (14.0%)
Total	tracing	10.723 s	-
Total	appsec	10.96 s	237.068 ms (2.2%)
Total	iast	11.033 s	309.771 ms (2.9%)
Total	profiling	11.031 s	307.331 ms (2.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.026 s	-
Agent	appsec	1.196 s	169.807 ms (16.6%)
Agent	iast	1.161 s	135.168 ms (13.2%)
Agent	profiling	1.165 s	139.242 ms (13.6%)
Total	tracing	10.691 s	-
Total	appsec	10.976 s	285.094 ms (2.7%)
Total	iast	11.116 s	424.396 ms (4.0%)
Total	profiling	11.063 s	371.636 ms (3.5%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (692.353 ms) : 0, 692353
BytebuddyAgent [candidate] (691.537 ms) : 0, 691537
GlobalTracer [baseline] (259.258 ms) : 0, 259258
GlobalTracer [candidate] (259.895 ms) : 0, 259895
AppSec [baseline] (32.002 ms) : 0, 32002
AppSec [candidate] (32.069 ms) : 0, 32069
Debugger [baseline] (6.41 ms) : 0, 6410
Debugger [candidate] (6.381 ms) : 0, 6381
Remote Config [baseline] (685.225 µs) : 0, 685
Remote Config [candidate] (679.441 µs) : 0, 679
Telemetry [baseline] (14.229 ms) : 0, 14229
Telemetry [candidate] (12.563 ms) : 0, 12563
section appsec
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (715.727 ms) : 0, 715727
BytebuddyAgent [candidate] (710.15 ms) : 0, 710150
GlobalTracer [baseline] (251.164 ms) : 0, 251164
GlobalTracer [candidate] (250.973 ms) : 0, 250973
AppSec [baseline] (172.485 ms) : 0, 172485
AppSec [candidate] (170.236 ms) : 0, 170236
Debugger [baseline] (6.091 ms) : 0, 6091
Debugger [candidate] (5.989 ms) : 0, 5989
Remote Config [baseline] (620.981 µs) : 0, 621
Remote Config [candidate] (602.972 µs) : 0, 603
Telemetry [baseline] (9.253 ms) : 0, 9253
Telemetry [candidate] (9.987 ms) : 0, 9987
IAST [baseline] (25.17 ms) : 0, 25170
IAST [candidate] (25.09 ms) : 0, 25090
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (809.015 ms) : 0, 809015
BytebuddyAgent [candidate] (813.584 ms) : 0, 813584
GlobalTracer [baseline] (248.194 ms) : 0, 248194
GlobalTracer [candidate] (250.809 ms) : 0, 250809
AppSec [baseline] (29.111 ms) : 0, 29111
AppSec [candidate] (27.265 ms) : 0, 27265
Debugger [baseline] (6.152 ms) : 0, 6152
Debugger [candidate] (6.178 ms) : 0, 6178
Remote Config [baseline] (602.294 µs) : 0, 602
Remote Config [candidate] (626.834 µs) : 0, 627
Telemetry [baseline] (8.277 ms) : 0, 8277
Telemetry [candidate] (8.142 ms) : 0, 8142
IAST [baseline] (30.04 ms) : 0, 30040
IAST [candidate] (31.798 ms) : 0, 31798
section profiling
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (724.79 ms) : 0, 724790
BytebuddyAgent [candidate] (720.031 ms) : 0, 720031
GlobalTracer [baseline] (236.433 ms) : 0, 236433
GlobalTracer [candidate] (236.285 ms) : 0, 236285
AppSec [baseline] (31.386 ms) : 0, 31386
AppSec [candidate] (30.99 ms) : 0, 30990
Debugger [baseline] (6.518 ms) : 0, 6518
Debugger [candidate] (6.479 ms) : 0, 6479
Remote Config [baseline] (721.726 µs) : 0, 722
Remote Config [candidate] (696.656 µs) : 0, 697
Telemetry [baseline] (16.522 ms) : 0, 16522
Telemetry [candidate] (15.756 ms) : 0, 15756
ProfilingAgent [baseline] (101.8 ms) : 0, 101800
ProfilingAgent [candidate] (101.36 ms) : 0, 101360
Profiling [baseline] (102.391 ms) : 0, 102391
Profiling [candidate] (101.959 ms) : 0, 101959

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/rewrite-test-suites-in-kotlin
git_commit_date	1758570639	1758570099
git_commit_sha	`b91074c`	`4081713`
release_version	1.54.0-SNAPSHOT~b91074c79a	1.54.0-SNAPSHOT~4081713026

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758572354	1758572354
ci_job_id	1141980746	1141980746
ci_pipeline_id	77217641	77217641
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-8o13bfxu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-8o13bfxu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 5 performance regressions! Performance is the same for 5 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+321.490µs; +561.275µs] or [+4.285%; +7.481%]	unstable [-107.526op/s; +40.026op/s] or [-17.428%; +6.488%]	7.945ms	583.219op/s	7.503ms	616.969op/s
scenario:load:insecure-bank:profiling:high_load	better [-680.527µs; -335.985µs] or [-7.015%; -3.463%]	unstable [-36.136op/s; +86.386op/s] or [-7.533%; +18.008%]	9.193ms	504.844op/s	9.701ms	479.719op/s
scenario:load:insecure-bank:iast_FULL:high_load	better [-1101.736µs; -480.898µs] or [-7.489%; -3.269%]	unstable [-17.163op/s; +52.975op/s] or [-5.418%; +16.723%]	13.919ms	334.688op/s	14.711ms	316.781op/s
scenario:load:insecure-bank:iast:high_load	worse [+216.868µs; +551.125µs] or [+2.348%; +5.967%]	unstable [-74.923op/s; +35.548op/s] or [-14.913%; +7.076%]	9.620ms	482.719op/s	9.236ms	502.406op/s
scenario:load:petclinic:iast:high_load	worse [+1.277ms; +2.111ms] or [+2.914%; +4.815%]	unstable [-11.346op/s; +3.371op/s] or [-10.630%; +3.158%]	45.528ms	102.750op/s	43.834ms	106.737op/s
scenario:load:petclinic:code_origins:high_load	worse [+1.609ms; +2.426ms] or [+3.747%; +5.652%]	unstable [-12.275op/s; +2.625op/s] or [-11.267%; +2.410%]	44.942ms	104.125op/s	42.925ms	108.950op/s
scenario:load:petclinic:profiling:high_load	worse [+2.520ms; +3.513ms] or [+5.361%; +7.475%]	unstable [-11.656op/s; +1.975op/s] or [-11.706%; +1.983%]	50.022ms	94.734op/s	47.005ms	99.575op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.426 ms) : 4369, 4483
.   : milestone, 4426,
iast (9.236 ms) : 9085, 9386
.   : milestone, 9236,
iast_FULL (14.711 ms) : 14410, 15011
.   : milestone, 14711,
iast_GLOBAL (10.537 ms) : 10346, 10728
.   : milestone, 10537,
profiling (9.701 ms) : 9533, 9869
.   : milestone, 9701,
tracing (7.503 ms) : 7401, 7605
.   : milestone, 7503,
section candidate
no_agent (4.543 ms) : 4484, 4602
.   : milestone, 4543,
iast (9.62 ms) : 9460, 9780
.   : milestone, 9620,
iast_FULL (13.919 ms) : 13643, 14195
.   : milestone, 13919,
iast_GLOBAL (10.572 ms) : 10386, 10757
.   : milestone, 10572,
profiling (9.193 ms) : 9041, 9345
.   : milestone, 9193,
tracing (7.945 ms) : 7825, 8065
.   : milestone, 7945,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.426 ms [4.369 ms, 4.483 ms]	-
iast	9.236 ms [9.085 ms, 9.386 ms]	4.81 ms (108.7%)
iast_FULL	14.711 ms [14.41 ms, 15.011 ms]	10.285 ms (232.4%)
iast_GLOBAL	10.537 ms [10.346 ms, 10.728 ms]	6.112 ms (138.1%)
profiling	9.701 ms [9.533 ms, 9.869 ms]	5.276 ms (119.2%)
tracing	7.503 ms [7.401 ms, 7.605 ms]	3.077 ms (69.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.543 ms [4.484 ms, 4.602 ms]	-
iast	9.62 ms [9.46 ms, 9.78 ms]	5.077 ms (111.7%)
iast_FULL	13.919 ms [13.643 ms, 14.195 ms]	9.376 ms (206.4%)
iast_GLOBAL	10.572 ms [10.386 ms, 10.757 ms]	6.028 ms (132.7%)
profiling	9.193 ms [9.041 ms, 9.345 ms]	4.65 ms (102.4%)
tracing	7.945 ms [7.825 ms, 8.065 ms]	3.401 ms (74.9%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.293 ms) : 36001, 36584
.   : milestone, 36293,
appsec (47.981 ms) : 47548, 48415
.   : milestone, 47981,
code_origins (42.925 ms) : 42550, 43299
.   : milestone, 42925,
iast (43.834 ms) : 43465, 44204
.   : milestone, 43834,
profiling (47.005 ms) : 46559, 47452
.   : milestone, 47005,
tracing (43.218 ms) : 42854, 43582
.   : milestone, 43218,
section candidate
no_agent (35.945 ms) : 35665, 36225
.   : milestone, 35945,
appsec (47.631 ms) : 47196, 48065
.   : milestone, 47631,
code_origins (44.942 ms) : 44557, 45327
.   : milestone, 44942,
iast (45.528 ms) : 45124, 45933
.   : milestone, 45528,
profiling (50.022 ms) : 49546, 50498
.   : milestone, 50022,
tracing (43.865 ms) : 43493, 44237
.   : milestone, 43865,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.293 ms [36.001 ms, 36.584 ms]	-
appsec	47.981 ms [47.548 ms, 48.415 ms]	11.689 ms (32.2%)
code_origins	42.925 ms [42.55 ms, 43.299 ms]	6.632 ms (18.3%)
iast	43.834 ms [43.465 ms, 44.204 ms]	7.542 ms (20.8%)
profiling	47.005 ms [46.559 ms, 47.452 ms]	10.713 ms (29.5%)
tracing	43.218 ms [42.854 ms, 43.582 ms]	6.925 ms (19.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.945 ms [35.665 ms, 36.225 ms]	-
appsec	47.631 ms [47.196 ms, 48.065 ms]	11.686 ms (32.5%)
code_origins	44.942 ms [44.557 ms, 45.327 ms]	8.997 ms (25.0%)
iast	45.528 ms [45.124 ms, 45.933 ms]	9.583 ms (26.7%)
profiling	50.022 ms [49.546 ms, 50.498 ms]	14.077 ms (39.2%)
tracing	43.865 ms [43.493 ms, 44.237 ms]	7.92 ms (22.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/rewrite-test-suites-in-kotlin
git_commit_date	1758570639	1758570099
git_commit_sha	`b91074c`	`4081713`
release_version	1.54.0-SNAPSHOT~b91074c79a	1.54.0-SNAPSHOT~4081713026

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1758572731	1758572731
ci_job_id	1141980747	1141980747
ci_pipeline_id	77217641	77217641
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-exfu601u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-exfu601u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.433ms; -1.091ms] or [-38.656%; -29.448%]	2.444ms	3.706ms

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.495 s) : 15495000, 15495000
.   : milestone, 15495000,
appsec (15.071 s) : 15071000, 15071000
.   : milestone, 15071000,
iast (18.588 s) : 18588000, 18588000
.   : milestone, 18588000,
iast_GLOBAL (18.479 s) : 18479000, 18479000
.   : milestone, 18479000,
profiling (15.859 s) : 15859000, 15859000
.   : milestone, 15859000,
tracing (14.854 s) : 14854000, 14854000
.   : milestone, 14854000,
section candidate
no_agent (14.802 s) : 14802000, 14802000
.   : milestone, 14802000,
appsec (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
iast (18.356 s) : 18356000, 18356000
.   : milestone, 18356000,
iast_GLOBAL (18.314 s) : 18314000, 18314000
.   : milestone, 18314000,
profiling (15.982 s) : 15982000, 15982000
.   : milestone, 15982000,
tracing (15.21 s) : 15210000, 15210000
.   : milestone, 15210000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.495 s [15.495 s, 15.495 s]	-
appsec	15.071 s [15.071 s, 15.071 s]	-424.0 ms (-2.7%)
iast	18.588 s [18.588 s, 18.588 s]	3.093 s (20.0%)
iast_GLOBAL	18.479 s [18.479 s, 18.479 s]	2.984 s (19.3%)
profiling	15.859 s [15.859 s, 15.859 s]	364.0 ms (2.3%)
tracing	14.854 s [14.854 s, 14.854 s]	-641.0 ms (-4.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.802 s [14.802 s, 14.802 s]	-
appsec	14.945 s [14.945 s, 14.945 s]	143.0 ms (1.0%)
iast	18.356 s [18.356 s, 18.356 s]	3.554 s (24.0%)
iast_GLOBAL	18.314 s [18.314 s, 18.314 s]	3.512 s (23.7%)
profiling	15.982 s [15.982 s, 15.982 s]	1.18 s (8.0%)
tracing	15.21 s [15.21 s, 15.21 s]	408.0 ms (2.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.706 ms) : 3487, 3924
.   : milestone, 3706,
iast (2.201 ms) : 2138, 2264
.   : milestone, 2201,
iast_GLOBAL (2.236 ms) : 2173, 2299
.   : milestone, 2236,
profiling (2.048 ms) : 1997, 2099
.   : milestone, 2048,
tracing (2.032 ms) : 1983, 2081
.   : milestone, 2032,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.444 ms) : 2394, 2494
.   : milestone, 2444,
iast (2.197 ms) : 2135, 2259
.   : milestone, 2197,
iast_GLOBAL (2.236 ms) : 2173, 2299
.   : milestone, 2236,
profiling (2.059 ms) : 2008, 2109
.   : milestone, 2059,
tracing (2.023 ms) : 1974, 2072
.   : milestone, 2023,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	3.706 ms [3.487 ms, 3.924 ms]	2.232 ms (151.5%)
iast	2.201 ms [2.138 ms, 2.264 ms]	726.978 µs (49.3%)
iast_GLOBAL	2.236 ms [2.173 ms, 2.299 ms]	761.869 µs (51.7%)
profiling	2.048 ms [1.997 ms, 2.099 ms]	574.373 µs (39.0%)
tracing	2.032 ms [1.983 ms, 2.081 ms]	558.242 µs (37.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.461 ms, 1.484 ms]	-
appsec	2.444 ms [2.394 ms, 2.494 ms]	971.155 µs (65.9%)
iast	2.197 ms [2.135 ms, 2.259 ms]	724.104 µs (49.2%)
iast_GLOBAL	2.236 ms [2.173 ms, 2.299 ms]	763.178 µs (51.8%)
profiling	2.059 ms [2.008 ms, 2.109 ms]	585.953 µs (39.8%)
tracing	2.023 ms [1.974 ms, 2.072 ms]	549.857 µs (37.3%)

bric3

Nice, thanks for that !

Thinking ahead... : I wonder if we could make this a convention plugin immediately 🤔.

And, apply the plugin like this in java_no_deps.gradle :

apply plugin = 'datadog.test-suites'

That being said, build.gradle (so using groovy DSL) are unlikely be able to use the real methods like addTestSuiteExtendingForDir, unless some compatibility code is added. Unsure at this time how to work around that.

bric3 · 2025-09-23T09:57:32Z

gradle/test-suites.gradle.kts

+fun Project.addTestSuiteExtendingForDir(testSuiteName: String, parentSuiteName: String, dirName: String) {
+  testing {
+    suites {
+      create(testSuiteName, JvmTestSuite::class) {


Prefer use register instead

Rewrite test-suites in kotlin

4081713

sarahchen6 added the tag: do not merge Do not merge changes label Sep 22, 2025

bric3 reviewed Sep 23, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Rewrite test-suites in kotlin #9587

Rewrite test-suites in kotlin #9587

Uh oh!

sarahchen6 commented Sep 22, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 22, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Sep 22, 2025

Uh oh!

bric3 left a comment

Uh oh!

bric3 Sep 23, 2025

Uh oh!

Uh oh!

Rewrite test-suites in kotlin #9587

Are you sure you want to change the base?

Rewrite test-suites in kotlin #9587

Uh oh!

Conversation

sarahchen6 commented Sep 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Sep 22, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

bric3 left a comment

Choose a reason for hiding this comment

Uh oh!

bric3 Sep 23, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

sarahchen6 commented Sep 22, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Sep 22, 2025 •

edited

Loading