Skip to content

Add Profiling Specific Handling for Config Inversion Linter#11066

Open
mhlidd wants to merge 9 commits intomasterfrom
mhlidd/add_profiling_gradle_task
Open

Add Profiling Specific Handling for Config Inversion Linter#11066
mhlidd wants to merge 9 commits intomasterfrom
mhlidd/add_profiling_gradle_task

Conversation

@mhlidd
Copy link
Copy Markdown
Contributor

@mhlidd mhlidd commented Apr 8, 2026

What Does This Do

This PR adds Profiling-specific handling for ConfigInversionLinter. Profiling calls individual helper functions to query configurations by potentially normalizing ddprof -> async as an alternative configuration. This means that static checks to ProfilingConfig.java is not sufficient to ensure that all Profiling configs are documented - we need to add static checks in DatadogProfilerConfig.java as well.

Only calls to getString, getBoolean, getLong, and getInteger when ConfigProvider is the first parameter passed in perform the normalization mentioned above. The added Gradle task is only concerned about these cases, as they cannot be caught from the existing static checks.

This Gradle task also has some repeated components with the existing registerCheckConfigStringsTask and pulls out shared logic to be used by both tasks.

This PR also adds the new Gradle task to the config-inversion-linter CI job.

Motivation

Profiling does not test all of its configs at runtime, making runtime checks ineffective for determining all Profiling configs are documented. Additionally, the special handling of async configs in Profiling require a new Gradle task to account for this edge case.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@mhlidd mhlidd force-pushed the mhlidd/add_profiling_gradle_task branch from d6bc4c0 to cca00b9 Compare April 8, 2026 20:14
@mhlidd mhlidd changed the title updating config inversion linter to include profiling specific handling Add Profiling Specific Handling for Config Inversion Linter Apr 8, 2026
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 8, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/add_profiling_gradle_task
git_commit_date 1775834061 1776087179
git_commit_sha 5ab378f 71e46e8
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~71e46e8acf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776088838 1776088838
ci_job_id 1589558209 1589558209
ci_pipeline_id 107365091 107365091
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-1wogm2rg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-1wogm2rg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~71e46e8acf, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055956
Total [baseline] (11.125 s) : 0, 11124507
Agent [candidate] (1.065 s) : 0, 1064984
Total [candidate] (11.262 s) : 0, 11261739
section appsec
Agent [baseline] (1.252 s) : 0, 1252196
Total [baseline] (7.866 s) : 0, 7866132
Agent [candidate] (1.266 s) : 0, 1265950
Total [candidate] (11.324 s) : 0, 11324440
section iast
Agent [baseline] (1.234 s) : 0, 1234469
Total [baseline] (11.42 s) : 0, 11420194
Agent [candidate] (1.23 s) : 0, 1230360
Total [candidate] (11.442 s) : 0, 11441598
section profiling
Agent [baseline] (1.185 s) : 0, 1185474
Total [baseline] (11.216 s) : 0, 11215615
Agent [candidate] (1.199 s) : 0, 1198534
Total [candidate] (11.365 s) : 0, 11364607
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.252 s 196.24 ms (18.6%)
Agent iast 1.234 s 178.513 ms (16.9%)
Agent profiling 1.185 s 129.518 ms (12.3%)
Total tracing 11.125 s -
Total appsec 7.866 s -3.258 s (-29.3%)
Total iast 11.42 s 295.688 ms (2.7%)
Total profiling 11.216 s 91.108 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.266 s 200.965 ms (18.9%)
Agent iast 1.23 s 165.376 ms (15.5%)
Agent profiling 1.199 s 133.55 ms (12.5%)
Total tracing 11.262 s -
Total appsec 11.324 s 62.7 ms (0.6%)
Total iast 11.442 s 179.859 ms (1.6%)
Total profiling 11.365 s 102.868 ms (0.9%)
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~71e46e8acf, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.226 ms) : 0, 1226
crashtracking [candidate] (1.242 ms) : 0, 1242
BytebuddyAgent [baseline] (631.127 ms) : 0, 631127
BytebuddyAgent [candidate] (636.658 ms) : 0, 636658
AgentMeter [baseline] (29.457 ms) : 0, 29457
AgentMeter [candidate] (29.589 ms) : 0, 29589
GlobalTracer [baseline] (248.78 ms) : 0, 248780
GlobalTracer [candidate] (250.716 ms) : 0, 250716
AppSec [baseline] (32.051 ms) : 0, 32051
AppSec [candidate] (32.14 ms) : 0, 32140
Debugger [baseline] (60.166 ms) : 0, 60166
Debugger [candidate] (60.387 ms) : 0, 60387
Remote Config [baseline] (599.862 µs) : 0, 600
Remote Config [candidate] (591.944 µs) : 0, 592
Telemetry [baseline] (8.122 ms) : 0, 8122
Telemetry [candidate] (8.121 ms) : 0, 8121
Flare Poller [baseline] (8.292 ms) : 0, 8292
Flare Poller [candidate] (8.917 ms) : 0, 8917
section appsec
crashtracking [baseline] (1.231 ms) : 0, 1231
crashtracking [candidate] (1.254 ms) : 0, 1254
BytebuddyAgent [baseline] (662.93 ms) : 0, 662930
BytebuddyAgent [candidate] (673.727 ms) : 0, 673727
AgentMeter [baseline] (12.13 ms) : 0, 12130
AgentMeter [candidate] (12.274 ms) : 0, 12274
GlobalTracer [baseline] (249.165 ms) : 0, 249165
GlobalTracer [candidate] (251.91 ms) : 0, 251910
IAST [baseline] (24.759 ms) : 0, 24759
IAST [candidate] (24.75 ms) : 0, 24750
AppSec [baseline] (186.737 ms) : 0, 186737
AppSec [candidate] (185.95 ms) : 0, 185950
Debugger [baseline] (66.109 ms) : 0, 66109
Debugger [candidate] (66.308 ms) : 0, 66308
Remote Config [baseline] (588.795 µs) : 0, 589
Remote Config [candidate] (618.421 µs) : 0, 618
Telemetry [baseline] (8.503 ms) : 0, 8503
Telemetry [candidate] (8.645 ms) : 0, 8645
Flare Poller [baseline] (3.591 ms) : 0, 3591
Flare Poller [candidate] (3.6 ms) : 0, 3600
section iast
crashtracking [baseline] (1.256 ms) : 0, 1256
crashtracking [candidate] (1.236 ms) : 0, 1236
BytebuddyAgent [baseline] (807.654 ms) : 0, 807654
BytebuddyAgent [candidate] (804.691 ms) : 0, 804691
AgentMeter [baseline] (11.514 ms) : 0, 11514
AgentMeter [candidate] (11.447 ms) : 0, 11447
GlobalTracer [baseline] (241.585 ms) : 0, 241585
GlobalTracer [candidate] (240.522 ms) : 0, 240522
IAST [baseline] (26.017 ms) : 0, 26017
IAST [candidate] (25.982 ms) : 0, 25982
AppSec [baseline] (33.339 ms) : 0, 33339
AppSec [candidate] (31.237 ms) : 0, 31237
Debugger [baseline] (58.663 ms) : 0, 58663
Debugger [candidate] (60.418 ms) : 0, 60418
Remote Config [baseline] (537.023 µs) : 0, 537
Remote Config [candidate] (1.758 ms) : 0, 1758
Telemetry [baseline] (13.739 ms) : 0, 13739
Telemetry [candidate] (13.105 ms) : 0, 13105
Flare Poller [baseline] (3.452 ms) : 0, 3452
Flare Poller [candidate] (3.458 ms) : 0, 3458
section profiling
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (692.235 ms) : 0, 692235
BytebuddyAgent [candidate] (700.946 ms) : 0, 700946
AgentMeter [baseline] (9.19 ms) : 0, 9190
AgentMeter [candidate] (9.148 ms) : 0, 9148
GlobalTracer [baseline] (207.386 ms) : 0, 207386
GlobalTracer [candidate] (209.329 ms) : 0, 209329
AppSec [baseline] (32.479 ms) : 0, 32479
AppSec [candidate] (32.688 ms) : 0, 32688
Debugger [baseline] (65.579 ms) : 0, 65579
Debugger [candidate] (66.249 ms) : 0, 66249
Remote Config [baseline] (576.422 µs) : 0, 576
Remote Config [candidate] (570.671 µs) : 0, 571
Telemetry [baseline] (7.881 ms) : 0, 7881
Telemetry [candidate] (7.896 ms) : 0, 7896
Flare Poller [baseline] (3.598 ms) : 0, 3598
Flare Poller [candidate] (3.585 ms) : 0, 3585
ProfilingAgent [baseline] (94.012 ms) : 0, 94012
ProfilingAgent [candidate] (94.74 ms) : 0, 94740
Profiling [baseline] (94.582 ms) : 0, 94582
Profiling [candidate] (95.312 ms) : 0, 95312
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~71e46e8acf, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058996
Total [baseline] (8.897 s) : 0, 8897462
Agent [candidate] (1.074 s) : 0, 1074255
Total [candidate] (8.91 s) : 0, 8910329
section iast
Agent [baseline] (1.232 s) : 0, 1231551
Total [baseline] (9.587 s) : 0, 9587494
Agent [candidate] (1.231 s) : 0, 1230627
Total [candidate] (9.598 s) : 0, 9598179
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.232 s 172.555 ms (16.3%)
Total tracing 8.897 s -
Total iast 9.587 s 690.032 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.231 s 156.372 ms (14.6%)
Total tracing 8.91 s -
Total iast 9.598 s 687.849 ms (7.7%)
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~71e46e8acf, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.244 ms) : 0, 1244
crashtracking [candidate] (1.255 ms) : 0, 1255
BytebuddyAgent [baseline] (634.57 ms) : 0, 634570
BytebuddyAgent [candidate] (645.062 ms) : 0, 645062
AgentMeter [baseline] (29.528 ms) : 0, 29528
AgentMeter [candidate] (30.156 ms) : 0, 30156
GlobalTracer [baseline] (249.648 ms) : 0, 249648
GlobalTracer [candidate] (253.183 ms) : 0, 253183
AppSec [baseline] (32.121 ms) : 0, 32121
AppSec [candidate] (32.54 ms) : 0, 32540
Debugger [baseline] (59.387 ms) : 0, 59387
Debugger [candidate] (60.537 ms) : 0, 60537
Remote Config [baseline] (607.834 µs) : 0, 608
Remote Config [candidate] (623.881 µs) : 0, 624
Telemetry [baseline] (8.066 ms) : 0, 8066
Telemetry [candidate] (8.303 ms) : 0, 8303
Flare Poller [baseline] (7.389 ms) : 0, 7389
Flare Poller [candidate] (5.897 ms) : 0, 5897
section iast
crashtracking [baseline] (1.256 ms) : 0, 1256
crashtracking [candidate] (1.234 ms) : 0, 1234
BytebuddyAgent [baseline] (807.435 ms) : 0, 807435
BytebuddyAgent [candidate] (804.786 ms) : 0, 804786
AgentMeter [baseline] (11.653 ms) : 0, 11653
AgentMeter [candidate] (11.43 ms) : 0, 11430
GlobalTracer [baseline] (240.208 ms) : 0, 240208
GlobalTracer [candidate] (241.091 ms) : 0, 241091
IAST [baseline] (25.846 ms) : 0, 25846
IAST [candidate] (26.701 ms) : 0, 26701
AppSec [baseline] (31.074 ms) : 0, 31074
AppSec [candidate] (30.447 ms) : 0, 30447
Debugger [baseline] (59.421 ms) : 0, 59421
Debugger [candidate] (60.721 ms) : 0, 60721
Remote Config [baseline] (1.75 ms) : 0, 1750
Remote Config [candidate] (533.689 µs) : 0, 534
Telemetry [baseline] (12.84 ms) : 0, 12840
Telemetry [candidate] (13.191 ms) : 0, 13191
Flare Poller [baseline] (3.441 ms) : 0, 3441
Flare Poller [candidate] (3.963 ms) : 0, 3963
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/add_profiling_gradle_task
git_commit_date 1775834061 1776087179
git_commit_sha 5ab378f 71e46e8
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~71e46e8acf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776089489 1776089489
ci_job_id 1589558211 1589558211
ci_pipeline_id 107365091 107365091
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-0n7fhilm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-0n7fhilm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 1 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load worse
[+154.179µs; +471.874µs] or [+2.981%; +9.122%]
unsure
[+15.039µs; +886.415µs] or [+0.119%; +7.039%]
unstable
[-117.197op/s; +55.135op/s] or [-14.934%; +7.026%]
5.486ms 13.043ms 753.750op/s 5.173ms 12.593ms 784.781op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-256.443µs; -132.287µs] or [-8.669%; -4.472%]
better
[-674.789µs; -243.210µs] or [-8.143%; -2.935%]
unstable
[-56.991op/s; +236.616op/s] or [-4.662%; +19.355%]
2.764ms 7.827ms 1312.312op/s 2.958ms 8.286ms 1222.500op/s
scenario:load:petclinic:profiling:high_load better
[-2.174ms; -1.098ms] or [-11.266%; -5.689%]
better
[-2.658ms; -1.172ms] or [-8.571%; -3.778%]
unstable
[-8.140op/s; +44.265op/s] or [-3.400%; +18.490%]
17.658ms 29.096ms 257.469op/s 19.293ms 31.011ms 239.406op/s
scenario:load:petclinic:tracing:high_load better
[-1.467ms; -0.565ms] or [-8.026%; -3.092%]
unsure
[-1672.440µs; -239.720µs] or [-5.729%; -0.821%]
unstable
[-16.800op/s; +38.612op/s] or [-6.619%; +15.213%]
17.257ms 28.237ms 264.719op/s 18.273ms 29.193ms 253.812op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~71e46e8acf, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.392 ms) : 19194, 19590
.   : milestone, 19392,
appsec (19.029 ms) : 18837, 19221
.   : milestone, 19029,
code_origins (17.998 ms) : 17821, 18175
.   : milestone, 17998,
iast (17.866 ms) : 17690, 18041
.   : milestone, 17866,
profiling (19.5 ms) : 19302, 19698
.   : milestone, 19500,
tracing (18.383 ms) : 18205, 18561
.   : milestone, 18383,
section candidate
no_agent (18.757 ms) : 18560, 18953
.   : milestone, 18757,
appsec (19.052 ms) : 18858, 19246
.   : milestone, 19052,
code_origins (17.705 ms) : 17536, 17875
.   : milestone, 17705,
iast (18.169 ms) : 17990, 18348
.   : milestone, 18169,
profiling (18.124 ms) : 17944, 18303
.   : milestone, 18124,
tracing (17.626 ms) : 17455, 17798
.   : milestone, 17626,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.392 ms [19.194 ms, 19.59 ms] -
appsec 19.029 ms [18.837 ms, 19.221 ms] -362.899 µs (-1.9%)
code_origins 17.998 ms [17.821 ms, 18.175 ms] -1.394 ms (-7.2%)
iast 17.866 ms [17.69 ms, 18.041 ms] -1.526 ms (-7.9%)
profiling 19.5 ms [19.302 ms, 19.698 ms] 108.086 µs (0.6%)
tracing 18.383 ms [18.205 ms, 18.561 ms] -1.009 ms (-5.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.757 ms [18.56 ms, 18.953 ms] -
appsec 19.052 ms [18.858 ms, 19.246 ms] 295.206 µs (1.6%)
code_origins 17.705 ms [17.536 ms, 17.875 ms] -1.051 ms (-5.6%)
iast 18.169 ms [17.99 ms, 18.348 ms] -587.311 µs (-3.1%)
profiling 18.124 ms [17.944 ms, 18.303 ms] -632.948 µs (-3.4%)
tracing 17.626 ms [17.455 ms, 17.798 ms] -1.13 ms (-6.0%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~71e46e8acf, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.244 ms) : 1232, 1256
.   : milestone, 1244,
iast (3.452 ms) : 3401, 3502
.   : milestone, 3452,
iast_FULL (5.891 ms) : 5830, 5951
.   : milestone, 5891,
iast_GLOBAL (3.754 ms) : 3689, 3818
.   : milestone, 3754,
profiling (2.171 ms) : 2151, 2190
.   : milestone, 2171,
tracing (1.91 ms) : 1894, 1926
.   : milestone, 1910,
section candidate
no_agent (1.245 ms) : 1234, 1257
.   : milestone, 1245,
iast (3.33 ms) : 3286, 3375
.   : milestone, 3330,
iast_FULL (6.136 ms) : 6073, 6199
.   : milestone, 6136,
iast_GLOBAL (3.492 ms) : 3443, 3541
.   : milestone, 3492,
profiling (2.397 ms) : 2376, 2419
.   : milestone, 2397,
tracing (1.993 ms) : 1974, 2012
.   : milestone, 1993,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.244 ms [1.232 ms, 1.256 ms] -
iast 3.452 ms [3.401 ms, 3.502 ms] 2.208 ms (177.5%)
iast_FULL 5.891 ms [5.83 ms, 5.951 ms] 4.647 ms (373.5%)
iast_GLOBAL 3.754 ms [3.689 ms, 3.818 ms] 2.51 ms (201.7%)
profiling 2.171 ms [2.151 ms, 2.19 ms] 926.515 µs (74.5%)
tracing 1.91 ms [1.894 ms, 1.926 ms] 665.887 µs (53.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.245 ms [1.234 ms, 1.257 ms] -
iast 3.33 ms [3.286 ms, 3.375 ms] 2.085 ms (167.5%)
iast_FULL 6.136 ms [6.073 ms, 6.199 ms] 4.89 ms (392.7%)
iast_GLOBAL 3.492 ms [3.443 ms, 3.541 ms] 2.247 ms (180.4%)
profiling 2.397 ms [2.376 ms, 2.419 ms] 1.152 ms (92.5%)
tracing 1.993 ms [1.974 ms, 2.012 ms] 748.118 µs (60.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/add_profiling_gradle_task
git_commit_date 1775834061 1776087179
git_commit_sha 5ab378f 71e46e8
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~71e46e8acf
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776089183 1776089183
ci_job_id 1589558213 1589558213
ci_pipeline_id 107365091 107365091
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-w6fhapeh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-w6fhapeh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~71e46e8acf, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.493 ms) : 1481, 1505
.   : milestone, 1493,
appsec (3.828 ms) : 3605, 4051
.   : milestone, 3828,
iast (2.277 ms) : 2207, 2346
.   : milestone, 2277,
iast_GLOBAL (2.335 ms) : 2265, 2405
.   : milestone, 2335,
profiling (2.123 ms) : 2068, 2179
.   : milestone, 2123,
tracing (2.088 ms) : 2034, 2141
.   : milestone, 2088,
section candidate
no_agent (1.496 ms) : 1485, 1508
.   : milestone, 1496,
appsec (3.845 ms) : 3623, 4067
.   : milestone, 3845,
iast (2.277 ms) : 2208, 2346
.   : milestone, 2277,
iast_GLOBAL (2.325 ms) : 2255, 2395
.   : milestone, 2325,
profiling (2.099 ms) : 2044, 2154
.   : milestone, 2099,
tracing (2.091 ms) : 2037, 2145
.   : milestone, 2091,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.493 ms [1.481 ms, 1.505 ms] -
appsec 3.828 ms [3.605 ms, 4.051 ms] 2.335 ms (156.4%)
iast 2.277 ms [2.207 ms, 2.346 ms] 783.73 µs (52.5%)
iast_GLOBAL 2.335 ms [2.265 ms, 2.405 ms] 841.948 µs (56.4%)
profiling 2.123 ms [2.068 ms, 2.179 ms] 630.083 µs (42.2%)
tracing 2.088 ms [2.034 ms, 2.141 ms] 594.544 µs (39.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.496 ms [1.485 ms, 1.508 ms] -
appsec 3.845 ms [3.623 ms, 4.067 ms] 2.349 ms (157.0%)
iast 2.277 ms [2.208 ms, 2.346 ms] 780.489 µs (52.2%)
iast_GLOBAL 2.325 ms [2.255 ms, 2.395 ms] 828.465 µs (55.4%)
profiling 2.099 ms [2.044 ms, 2.154 ms] 602.729 µs (40.3%)
tracing 2.091 ms [2.037 ms, 2.145 ms] 594.323 µs (39.7%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~71e46e8acf, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.535 s) : 15535000, 15535000
.   : milestone, 15535000,
appsec (14.835 s) : 14835000, 14835000
.   : milestone, 14835000,
iast (18.55 s) : 18550000, 18550000
.   : milestone, 18550000,
iast_GLOBAL (18.164 s) : 18164000, 18164000
.   : milestone, 18164000,
profiling (15.367 s) : 15367000, 15367000
.   : milestone, 15367000,
tracing (14.9 s) : 14900000, 14900000
.   : milestone, 14900000,
section candidate
no_agent (15.29 s) : 15290000, 15290000
.   : milestone, 15290000,
appsec (14.584 s) : 14584000, 14584000
.   : milestone, 14584000,
iast (18.236 s) : 18236000, 18236000
.   : milestone, 18236000,
iast_GLOBAL (18.32 s) : 18320000, 18320000
.   : milestone, 18320000,
profiling (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
tracing (14.967 s) : 14967000, 14967000
.   : milestone, 14967000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.535 s [15.535 s, 15.535 s] -
appsec 14.835 s [14.835 s, 14.835 s] -700.0 ms (-4.5%)
iast 18.55 s [18.55 s, 18.55 s] 3.015 s (19.4%)
iast_GLOBAL 18.164 s [18.164 s, 18.164 s] 2.629 s (16.9%)
profiling 15.367 s [15.367 s, 15.367 s] -168.0 ms (-1.1%)
tracing 14.9 s [14.9 s, 14.9 s] -635.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.29 s [15.29 s, 15.29 s] -
appsec 14.584 s [14.584 s, 14.584 s] -706.0 ms (-4.6%)
iast 18.236 s [18.236 s, 18.236 s] 2.946 s (19.3%)
iast_GLOBAL 18.32 s [18.32 s, 18.32 s] 3.03 s (19.8%)
profiling 15.145 s [15.145 s, 15.145 s] -145.0 ms (-0.9%)
tracing 14.967 s [14.967 s, 14.967 s] -323.0 ms (-2.1%)

@mhlidd mhlidd changed the base branch from master to mhlidd/add_logback_config April 9, 2026 17:53
@mhlidd mhlidd added type: enhancement Enhancements and improvements comp: tooling Build & Tooling comp: config Configuration labels Apr 9, 2026
@mhlidd mhlidd marked this pull request as ready for review April 9, 2026 19:48
@mhlidd mhlidd requested review from a team as code owners April 9, 2026 19:48
@mhlidd mhlidd requested review from amarziali and colin-higgins and removed request for a team April 9, 2026 19:48
Base automatically changed from mhlidd/add_logback_config to master April 9, 2026 20:31
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot requested a review from a team as a code owner April 9, 2026 20:31
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this is part of this PR?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These were added as part of #11060. Rebasing w/ master will remove the code changes from this PR.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same for this, should it be done in another PR?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These were added as part of #11060. Rebasing w/ master will remove the code changes from this PR.

@mhlidd mhlidd requested a review from amarziali April 13, 2026 13:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: config Configuration comp: tooling Build & Tooling type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants