Skip to content

Fix unevaluatedItems semantic canonicalisation bugs#704

Merged
jviotti merged 3 commits intomainfrom
bug-3
Apr 10, 2026
Merged

Fix unevaluatedItems semantic canonicalisation bugs#704
jviotti merged 3 commits intomainfrom
bug-3

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented Apr 10, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode
Copy link
Copy Markdown

augmentcode bot commented Apr 10, 2026

🤖 Augment PR Summary

Summary: This PR fixes semantic canonicalization around unevaluatedItems by preventing the canonicalizer from introducing implicit items in contexts where it would change evaluation annotations.

Changes:

  • Updates `ItemsImplicit::condition` to accept full schema-walk context (root/frame/location/walker/resolver).
  • Skips the `items_implicit` transform when an in-place applicator ancestor defines `unevaluatedItems`.
  • Adds draft 2019-09 tests verifying `items_implicit` is skipped when `unevaluatedItems` exists at the parent schema (including a `contains` example and an `anyOf` example).
  • Adds draft 2020-12 tests covering analogous `anyOf` cases with `items` and `prefixItems` under `unevaluatedItems`.

Technical Notes: Uses WALK_UP_IN_PLACE_APPLICATORS to detect only ancestors that share the same instance location (i.e., in-place applicator chains).

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 3 suggestions posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

schema.is_object() && schema.defines("type") &&
schema.at("type").is_string() &&
schema.at("type").to_string() == "array" && !schema.defines("items"));
ONLY_CONTINUE_IF(!WALK_UP_IN_PLACE_APPLICATORS(
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

WALK_UP_IN_PLACE_APPLICATORS(...) only checks parent schemas, so an array schema that directly defines unevaluatedItems can still be rewritten to add implicit items: true, which can change unevaluatedItems behavior.

Severity: high

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

ONLY_CONTINUE_IF(!WALK_UP_IN_PLACE_APPLICATORS(
root, frame, location, walker, resolver,
[](const JSON &ancestor) {
return ancestor.defines("unevaluatedItems");
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This guard triggers purely on ancestor.defines("unevaluatedItems"), even if the active vocabularies/dialect treat unevaluatedItems as an unknown keyword (e.g., 2020-12 without the Unevaluated vocabulary, or older drafts), which could unnecessarily skip canonicalization.

Severity: medium

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

}

TEST(AlterSchema_canonicalize_2019_09,
items_implicit_skipped_with_unevaluated_items) {
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These regressions cover unevaluatedItems on an ancestor of the array schema; it may also be worth exercising the case where the array schema itself defines unevaluatedItems with no in-place-applicator parent, since WALK_UP_IN_PLACE_APPLICATORS won’t detect that.

Severity: low

Other Locations
  • test/alterschema/alterschema_canonicalize_2020_12_test.cc:1701

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 issues found across 3 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="test/alterschema/alterschema_canonicalize_2020_12_test.cc">

<violation number="1" location="test/alterschema/alterschema_canonicalize_2020_12_test.cc:1720">
P2: Preserve `prefixItems` here; removing it changes how `unevaluatedItems: false` validates non-empty arrays.</violation>
</file>

<file name="test/alterschema/alterschema_canonicalize_2019_09_test.cc">

<violation number="1" location="test/alterschema/alterschema_canonicalize_2019_09_test.cc:715">
P1: Preserve the explicit `items` schema in this expected output; removing it changes the array semantics.</violation>
</file>

Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.

},
{
"type": "array",
"minItems": 0,
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai bot Apr 10, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1: Preserve the explicit items schema in this expected output; removing it changes the array semantics.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/alterschema/alterschema_canonicalize_2019_09_test.cc, line 715:

<comment>Preserve the explicit `items` schema in this expected output; removing it changes the array semantics.</comment>

<file context>
@@ -687,3 +687,85 @@ TEST(AlterSchema_canonicalize_2019_09, items_implicit_1) {
+      },
+      {
+        "type": "array",
+        "minItems": 0,
+        "contains": {
+          "enum": [ false, true ]
</file context>
Suggested change
"minItems": 0,
"minItems": 0,
"items": {
"enum": [ false, true ]
},
Fix with Cubic

"anyOf": [
{ "enum": [ null ] },
{ "enum": [ false, true ] },
{
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai bot Apr 10, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2: Preserve prefixItems here; removing it changes how unevaluatedItems: false validates non-empty arrays.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/alterschema/alterschema_canonicalize_2020_12_test.cc, line 1720:

<comment>Preserve `prefixItems` here; removing it changes how `unevaluatedItems: false` validates non-empty arrays.</comment>

<file context>
@@ -1697,6 +1697,88 @@ TEST(AlterSchema_canonicalize_2020_12,
+    "anyOf": [
+      { "enum": [ null ] },
+      { "enum": [ false, true ] },
+      {
+        "type": "object",
+        "minProperties": 0,
</file context>
Fix with Cubic

jviotti added 2 commits April 10, 2026 16:20
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: d39b8b7 Previous: 9e80b70 Ratio
E2E_Compiler_adaptivecard 64062161.66666607 ns/iter 69316295.62500064 ns/iter 0.92
E2E_Compiler_ansible_meta 29520324.173913453 ns/iter 29952981.173914354 ns/iter 0.99
E2E_Compiler_aws_cdk 365731.44548774004 ns/iter 359626.269032931 ns/iter 1.02
E2E_Compiler_babelrc 2578463.9114390705 ns/iter 2559520.8905109507 ns/iter 1.01
E2E_Compiler_clang_format 18480522.28947351 ns/iter 18782484.0263153 ns/iter 0.98
E2E_Compiler_cmake_presets 25775900.51851917 ns/iter 26648530.346154056 ns/iter 0.97
E2E_Compiler_code_climate 2600632.4460966727 ns/iter 2577235.8124999576 ns/iter 1.01
E2E_Compiler_cql2 12855547.872726966 ns/iter 13026594.425926734 ns/iter 0.99
E2E_Compiler_cspell 22826425.35484016 ns/iter 23237374.53333289 ns/iter 0.98
E2E_Compiler_cypress 3951786.9055556627 ns/iter 3913576.709496979 ns/iter 1.01
E2E_Compiler_deno 7788672.233332743 ns/iter 7937220.322222376 ns/iter 0.98
E2E_Compiler_dependabot 3931572.687150879 ns/iter 3911179.435754245 ns/iter 1.01
E2E_Compiler_draft_04 2698532.792307709 ns/iter 2659074.632575844 ns/iter 1.01
E2E_Compiler_fabric_mod 4783884.068493155 ns/iter 4747477.000000108 ns/iter 1.01
E2E_Compiler_geojson 22460452.58064647 ns/iter 22661516.322581258 ns/iter 0.99
E2E_Compiler_gitpod_configuration 4921077.239436765 ns/iter 4885978.062937163 ns/iter 1.01
E2E_Compiler_helm_chart_lock 685212.3362744809 ns/iter 669056.4200956698 ns/iter 1.02
E2E_Compiler_importmap 275373.7672040991 ns/iter 271636.03053731145 ns/iter 1.01
E2E_Compiler_jasmine 1339428.4291187858 ns/iter 1334136.5863377706 ns/iter 1.00
E2E_Compiler_jshintrc 4314819.376543115 ns/iter 4368653.865030642 ns/iter 0.99
E2E_Compiler_jsconfig 21767064.999998808 ns/iter 21742689.483870994 ns/iter 1.00
E2E_Compiler_krakend 137211550.20000425 ns/iter 139898256.00000358 ns/iter 0.98
E2E_Compiler_lazygit 34278996.190477885 ns/iter 34144650.57142836 ns/iter 1.00
E2E_Compiler_lerna 1572717.804494301 ns/iter 1574269.1517856806 ns/iter 1.00
E2E_Compiler_nest_cli 7483042.4468087405 ns/iter 7480932.861701628 ns/iter 1.00
E2E_Compiler_omc 158209627.2500024 ns/iter 160866630.50000992 ns/iter 0.98
E2E_Compiler_omnisharp 6728352.451923151 ns/iter 6691044.304761818 ns/iter 1.01
E2E_Compiler_openapi 25278384.714285705 ns/iter 25244056.321428485 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 5391823.763358725 ns/iter 5376588.091603012 ns/iter 1.00
E2E_Compiler_pulumi 4044976.433526292 ns/iter 4041927.2658960847 ns/iter 1.00
E2E_Compiler_semantic_release 1579204.5665913245 ns/iter 1561917.2999999542 ns/iter 1.01
E2E_Compiler_stale 1558347.7928731313 ns/iter 1543524.5518763675 ns/iter 1.01
E2E_Compiler_stylecop 6271020.169642887 ns/iter 6254763.982143275 ns/iter 1.00
E2E_Compiler_tmuxinator 1914199.5219780046 ns/iter 1922592.0328767332 ns/iter 1.00
E2E_Compiler_ui5 49277832.600000694 ns/iter 49379470.35714631 ns/iter 1.00
E2E_Compiler_ui5_manifest 309453997.00001985 ns/iter 326242210.00000376 ns/iter 0.95
E2E_Compiler_unreal_engine_uproject 4601879.421052502 ns/iter 4603854.842105342 ns/iter 1.00
E2E_Compiler_vercel 12357920.912280492 ns/iter 12346518.789474646 ns/iter 1.00
E2E_Compiler_yamllint 335752.1294343174 ns/iter 335958.2401913846 ns/iter 1.00
E2E_Evaluator_adaptivecard 23986.442075555173 ns/iter 23986.014653534967 ns/iter 1.00
E2E_Evaluator_ansible_meta 202393.64902587762 ns/iter 206951.4022523815 ns/iter 0.98
E2E_Evaluator_aws_cdk 42333.60177421125 ns/iter 42739.41562125683 ns/iter 0.99
E2E_Evaluator_babelrc 86367.68677209596 ns/iter 85928.50574570203 ns/iter 1.01
E2E_Evaluator_cerebrum_criminal_case 1254471.7246377235 ns/iter 1274921.1560798525 ns/iter 0.98
E2E_Evaluator_clang_format 117042.74087774988 ns/iter 117150.17528541987 ns/iter 1.00
E2E_Evaluator_cmake_presets 4200979.102409358 ns/iter 4341213.071856198 ns/iter 0.97
E2E_Evaluator_code_climate 147398.6415656197 ns/iter 149593.564864277 ns/iter 0.99
E2E_Evaluator_cql2 178499.4816713671 ns/iter 181264.06448285445 ns/iter 0.98
E2E_Evaluator_cspell 545206.9952494238 ns/iter 544458.5352112702 ns/iter 1.00
E2E_Evaluator_cypress 167062.41494473178 ns/iter 165035.57601150355 ns/iter 1.01
E2E_Evaluator_deno 246589.53248587664 ns/iter 246262.0454065591 ns/iter 1.00
E2E_Evaluator_dependabot 398870.445267965 ns/iter 402375.8696668653 ns/iter 0.99
E2E_Evaluator_draft_04 7314379.266666214 ns/iter 8685302.525000082 ns/iter 0.84
E2E_Evaluator_fabric_mod 650323.3058161384 ns/iter 650114.9007420987 ns/iter 1.00
E2E_Evaluator_geojson 15912544.130434694 ns/iter 16503136.348836336 ns/iter 0.96
E2E_Evaluator_gitpod_configuration 203244.49269548978 ns/iter 199259.3078236184 ns/iter 1.02
E2E_Evaluator_helm_chart_lock 248164.7262969567 ns/iter 246857.9108595709 ns/iter 1.01
E2E_Evaluator_importmap 43530.84724623578 ns/iter 42912.986214536315 ns/iter 1.01
E2E_Evaluator_jasmine 95851.51437525758 ns/iter 97332.84025157371 ns/iter 0.98
E2E_Evaluator_jshintrc 1147655.98029558 ns/iter 1147279.8270180956 ns/iter 1.00
E2E_Evaluator_jsconfig 407079.0000000012 ns/iter 412356.81723538524 ns/iter 0.99
E2E_Evaluator_krakend 179252.41288844307 ns/iter 178025.43344447622 ns/iter 1.01
E2E_Evaluator_lazygit 120974.38945725898 ns/iter 121810.28773092052 ns/iter 0.99
E2E_Evaluator_lerna 108676.87937500037 ns/iter 111109.8645849868 ns/iter 0.98
E2E_Evaluator_nest_cli 167701.09329514837 ns/iter 167832.20628447266 ns/iter 1.00
E2E_Evaluator_omc 18617.29084116147 ns/iter 18373.421899213918 ns/iter 1.01
E2E_Evaluator_omnisharp 561124.1166936513 ns/iter 569944.5272136492 ns/iter 0.98
E2E_Evaluator_openapi 17613059.18181868 ns/iter 16515729.534883702 ns/iter 1.07
E2E_Evaluator_pre_commit_hooks 473689.805423758 ns/iter 467101.42323097377 ns/iter 1.01
E2E_Evaluator_pulumi 709225.450049487 ns/iter 688284.258638743 ns/iter 1.03
E2E_Evaluator_semantic_release 78676.13237295847 ns/iter 80068.18651529159 ns/iter 0.98
E2E_Evaluator_stale 143137.06666666875 ns/iter 148583.6261354283 ns/iter 0.96
E2E_Evaluator_stylecop 260016.751403983 ns/iter 258971.68191963123 ns/iter 1.00
E2E_Evaluator_tmuxinator 83319.53045715057 ns/iter 82100.86209294574 ns/iter 1.01
E2E_Evaluator_ui5 465997.22661396203 ns/iter 470428.9144173889 ns/iter 0.99
E2E_Evaluator_ui5_manifest 2365036.9624573947 ns/iter 2405701.2516778978 ns/iter 0.98
E2E_Evaluator_unreal_engine_uproject 408498.0455607505 ns/iter 408621.84918793093 ns/iter 1.00
E2E_Evaluator_vercel 251129.8624683177 ns/iter 252319.9141926139 ns/iter 1.00
E2E_Evaluator_yamllint 8149.604455816074 ns/iter 8181.795386322259 ns/iter 1.00
Micro_Draft4_Meta_1_No_Callback 192.59855454925392 ns/iter 190.8761206264741 ns/iter 1.01
Micro_Draft4_Required_Properties 856.4272712894489 ns/iter 861.8121326680161 ns/iter 0.99
Micro_Draft4_Many_Optional_Properties_Minimal_Match 23.80845087799868 ns/iter 25.391051570517835 ns/iter 0.94
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.628092061145862 ns/iter 10.640781513310055 ns/iter 1.00
Micro_Draft4_Items_Schema 299.73373318103313 ns/iter 273.51366339103413 ns/iter 1.10
Micro_Draft4_Nested_Object 1.4067838493306208 ns/iter 1.4123742631451546 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 319.34838527490734 ns/iter 319.2827849662753 ns/iter 1.00
Micro_Draft4_Properties_Triad_Closed 264.3639469675225 ns/iter 263.8436859241448 ns/iter 1.00
Micro_Draft4_Properties_Triad_Required 331.805604502193 ns/iter 332.87034499342934 ns/iter 1.00
Micro_Draft4_Properties_Closed 59.26831002657516 ns/iter 59.247398136330276 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 12.28336096130387 ns/iter 12.217212495997646 ns/iter 1.01
Micro_Draft4_Pattern_Properties_True 153.58225311205544 ns/iter 153.39924117635402 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 10.64846412494844 ns/iter 10.629152767908279 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 23.589209395165227 ns/iter 23.450616999032473 ns/iter 1.01
Micro_Draft4_Nested_Oneof 54.283521937813624 ns/iter 54.26904019089024 ns/iter 1.00
Micro_Draft4_Short_Enum 13.720412797192074 ns/iter 13.70693338447348 ns/iter 1.00
Micro_Draft4_Long_Enum 13.36922481957124 ns/iter 13.808349754168518 ns/iter 0.97
Micro_Draft4_Long_Enum_Short_Strings 13.718428175820877 ns/iter 13.714299803547837 ns/iter 1.00
Micro_Draft4_Type_Object 3.5181852115679453 ns/iter 3.516163813002052 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2334530.3033333193 ns/iter 2319283.310231056 ns/iter 1.01
Micro_Draft4_Compile_Ref_Many_Nested 1714129.6210269064 ns/iter 1704168.7688562728 ns/iter 1.01
Micro_Draft4_Compile_Wrap 2414347.7655170816 ns/iter 2378808.7142855325 ns/iter 1.01
Micro_Draft6_Property_Names 114.74987922012353 ns/iter 117.38913025766506 ns/iter 0.98
Micro_Draft6_Compile_FHIR 15948749317.999954 ns/iter 15533662901.999947 ns/iter 1.03
Micro_Draft7_If_Then_Else 23.662878792907694 ns/iter 23.628513187193956 ns/iter 1.00
Micro_2019_09_Unevaluated_Properties 26.30919764091128 ns/iter 25.834554130721983 ns/iter 1.02
Micro_2019_09_Compile_Wrap 299313438.50000757 ns/iter 306783018.4999707 ns/iter 0.98
Micro_2020_12_Dynamic_Ref 233.50098734980614 ns/iter 230.90275509867953 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 3.523185588264197 ns/iter 3.517300911214063 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 64185.40437208892 ns/iter 62989.89741286012 ns/iter 1.02
Micro_2020_12_Simple_Output_Annotations 95410.56808540388 ns/iter 95442.02857905954 ns/iter 1.00
Micro_2020_12_Compile_NonCircular_Shared_Refs 1094569.500780172 ns/iter 1081871.6009174923 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric 8442.434928904622 ns/iter 8592.189461540334 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 172998.5749325677 ns/iter 176193.14637682223 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22776.590996575116 ns/iter 22759.67378476313 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 148.40882855028374 ns/iter 148.43264931526525 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 3996.821280137728 ns/iter 4014.0578971186155 ns/iter 1.00
Alterschema_Check_Readibility_ISO_Language_Set_3 338865798.0000289 ns/iter 347279413.49996173 ns/iter 0.98
Alterschema_Check_Readibility_OMC 89284580.24999486 ns/iter 89912032.87499161 ns/iter 0.99
Alterschema_Check_Readibility_KrakenD 1300667680.9999363 ns/iter 1313244722.0000358 ns/iter 0.99
Alterschema_Apply_Readibility_KrakenD 17012193993.999971 ns/iter 17301950281.00002 ns/iter 0.98
Alterschema_Check_Invalid_External_Refs 278581001.0000205 ns/iter 283438072.9999945 ns/iter 0.98

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: d39b8b7 Previous: 9e80b70 Ratio
E2E_Evaluator_adaptivecard 116407 ns 120652 ns 0.96
E2E_Evaluator_ansible-meta 602683 ns 641700 ns 0.94
E2E_Evaluator_aws-cdk 130912 ns 135962 ns 0.96
E2E_Evaluator_babelrc 313899 ns 342021 ns 0.92
E2E_Evaluator_cerebrum-criminal-case 2851340 ns 3392282 ns 0.84
E2E_Evaluator_clang-format 280949 ns 285117 ns 0.99
E2E_Evaluator_cmake-presets 21887474 ns 21471749 ns 1.02
E2E_Evaluator_code-climate 426740 ns 448344 ns 0.95
E2E_Evaluator_cql2 1207662 ns 1203503 ns 1.00
E2E_Evaluator_cspell 1679051 ns 2016271 ns 0.83
E2E_Evaluator_cypress 913581 ns 1082461 ns 0.84
E2E_Evaluator_deno 1131341 ns 1212410 ns 0.93
E2E_Evaluator_dependabot 1150493 ns 1203370 ns 0.96
E2E_Evaluator_draft-04 22618329 ns 24266425 ns 0.93
E2E_Evaluator_fabric-mod 2703251 ns 2996497 ns 0.90
E2E_Evaluator_geojson 21933954 ns 22889835 ns 0.96
E2E_Evaluator_gitpod-configuration 804413 ns 847311 ns 0.95
E2E_Evaluator_helm-chart-lock 1032443 ns 1084158 ns 0.95
E2E_Evaluator_importmap 287949 ns 286601 ns 1.00
E2E_Evaluator_jasmine 305294 ns 319413 ns 0.96
E2E_Evaluator_jsconfig 1531621 ns 1590032 ns 0.96
E2E_Evaluator_jshintrc 3365541 ns 3466769 ns 0.97
E2E_Evaluator_krakend 727514 ns 730783 ns 1.00
E2E_Evaluator_lazygit 503151 ns 583184 ns 0.86
E2E_Evaluator_lerna 457280 ns 507973 ns 0.90
E2E_Evaluator_nest-cli 667612 ns 711014 ns 0.94
E2E_Evaluator_omc 88638 ns 88522 ns 1.00
E2E_Evaluator_omnisharp 1673575 ns 1849841 ns 0.90
E2E_Evaluator_openapi 37793524 ns 39550333 ns 0.96
E2E_Evaluator_pre-commit-hooks 2245784 ns 2322914 ns 0.97
E2E_Evaluator_pulumi 2206459 ns 2395457 ns 0.92
E2E_Evaluator_semantic-release 248911 ns 255855 ns 0.97
E2E_Evaluator_stale 442219 ns 452963 ns 0.98
E2E_Evaluator_stylecop 1290293 ns 1339158 ns 0.96
E2E_Evaluator_tmuxinator 228598 ns 238458 ns 0.96
E2E_Evaluator_ui5 2233061 ns 2266639 ns 0.99
E2E_Evaluator_ui5-manifest 10446754 ns 11240998 ns 0.93
E2E_Evaluator_unreal-engine-uproject 1658756 ns 1691916 ns 0.98
E2E_Evaluator_vercel 1156072 ns 1125914 ns 1.03
E2E_Evaluator_yamllint 24850 ns 24249 ns 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: d39b8b7 Previous: 9e80b70 Ratio
E2E_Compiler_adaptivecard 78771767.8571523 ns/iter 54124965.24998763 ns/iter 1.46
E2E_Compiler_ansible_meta 40379671.052631386 ns/iter 22049481.781252213 ns/iter 1.83
E2E_Compiler_aws_cdk 366812.5232044448 ns/iter 272888.97883030714 ns/iter 1.34
E2E_Compiler_babelrc 3034677.211618104 ns/iter 2107397.5909086005 ns/iter 1.44
E2E_Compiler_clang_format 20689704.861110967 ns/iter 13461040.076921247 ns/iter 1.54
E2E_Compiler_cmake_presets 36356626.952380925 ns/iter 22777977.129034035 ns/iter 1.60
E2E_Compiler_code_climate 2976599.2406639373 ns/iter 1966080.861581687 ns/iter 1.51
E2E_Compiler_cql2 17404316.13043454 ns/iter 10252336.956521016 ns/iter 1.70
E2E_Compiler_cspell 28288229.1538464 ns/iter 17333785.400001034 ns/iter 1.63
E2E_Compiler_cypress 4836566.606060745 ns/iter 3183281.00913223 ns/iter 1.52
E2E_Compiler_deno 10424961.89024416 ns/iter 6250326.508620674 ns/iter 1.67
E2E_Compiler_dependabot 4828303.977273084 ns/iter 3257900.3456215225 ns/iter 1.48
E2E_Compiler_draft_04 2928811.9012347464 ns/iter 1794426.5535714629 ns/iter 1.63
E2E_Compiler_fabric_mod 5442221.670000435 ns/iter 3294582.4742260887 ns/iter 1.65
E2E_Compiler_geojson 36718920.80000134 ns/iter 23465558.31428694 ns/iter 1.56
E2E_Compiler_gitpod_configuration 6902978.211009205 ns/iter 3755855.4107144056 ns/iter 1.84
E2E_Compiler_helm_chart_lock 813673.6897621101 ns/iter 485582.7063654856 ns/iter 1.68
E2E_Compiler_importmap 301567.3719376401 ns/iter 186685.76996550825 ns/iter 1.62
E2E_Compiler_jasmine 1521997.6403941116 ns/iter 957655.3236112457 ns/iter 1.59
E2E_Compiler_jshintrc 4715139.980392159 ns/iter 2881816.115701846 ns/iter 1.64
E2E_Compiler_jsconfig 26211103.40741055 ns/iter 17552526.43902611 ns/iter 1.49
E2E_Compiler_krakend 196589666.75001466 ns/iter 124422525.00004542 ns/iter 1.58
E2E_Compiler_lazygit 56359877.73333302 ns/iter 28838693.320003584 ns/iter 1.95
E2E_Compiler_lerna 2317741.4550560936 ns/iter 1196119.3918227414 ns/iter 1.94
E2E_Compiler_nest_cli 10835187.50000015 ns/iter 5560830.35714242 ns/iter 1.95
E2E_Compiler_omc 251519694.6666644 ns/iter 151587466.79999238 ns/iter 1.66
E2E_Compiler_omnisharp 7619037.397435663 ns/iter 7388000.000000282 ns/iter 1.03
E2E_Compiler_openapi 29614407.958334252 ns/iter 21009765.79310617 ns/iter 1.41
E2E_Compiler_pre_commit_hooks 5982964.578570967 ns/iter 3821235.661291055 ns/iter 1.57
E2E_Compiler_pulumi 4595792.916168098 ns/iter 3243418.058578206 ns/iter 1.42
E2E_Compiler_semantic_release 1742528.3163266631 ns/iter 1206360.8719724303 ns/iter 1.44
E2E_Compiler_stale 1853692.8586957194 ns/iter 1113663.7633711137 ns/iter 1.66
E2E_Compiler_stylecop 7955756.3131315 ns/iter 5266286.249998302 ns/iter 1.51
E2E_Compiler_tmuxinator 2434020.2534725266 ns/iter 1367024.982421583 ns/iter 1.78
E2E_Compiler_ui5 74416258.39999233 ns/iter 46888880.53333358 ns/iter 1.59
E2E_Compiler_ui5_manifest 460089479.50002724 ns/iter 267744235.99999866 ns/iter 1.72
E2E_Compiler_unreal_engine_uproject 6591123.242105823 ns/iter 3330479.366666493 ns/iter 1.98
E2E_Compiler_vercel 20653562.04444571 ns/iter 10728104.166666912 ns/iter 1.93
E2E_Compiler_yamllint 394086.60575911094 ns/iter 261076.19670902676 ns/iter 1.51
E2E_Evaluator_adaptivecard 29835.972632213336 ns/iter 16987.728593919768 ns/iter 1.76
E2E_Evaluator_ansible_meta 236143.32561730806 ns/iter 148501.92219386855 ns/iter 1.59
E2E_Evaluator_aws_cdk 50358.44579999775 ns/iter 30549.44602473738 ns/iter 1.65
E2E_Evaluator_babelrc 107227.06003210634 ns/iter 73195.19071719791 ns/iter 1.46
E2E_Evaluator_cerebrum_criminal_case 1390869.237588588 ns/iter 797312.3598654055 ns/iter 1.74
E2E_Evaluator_clang_format 133080.98874565167 ns/iter 89695.2168367144 ns/iter 1.48
E2E_Evaluator_cmake_presets 4692211.584415713 ns/iter 2831966.768595025 ns/iter 1.66
E2E_Evaluator_code_climate 193232.4273071956 ns/iter 113162.85262660852 ns/iter 1.71
E2E_Evaluator_cql2 219826.6030267891 ns/iter 140761.9606003694 ns/iter 1.56
E2E_Evaluator_cspell 504718.06640617346 ns/iter 356558.30434786336 ns/iter 1.42
E2E_Evaluator_cypress 173355.68500418006 ns/iter 131061.78526047291 ns/iter 1.32
E2E_Evaluator_deno 403389.2175176387 ns/iter 227393.35585842596 ns/iter 1.77
E2E_Evaluator_dependabot 402512.97858537023 ns/iter 287284.4583669755 ns/iter 1.40
E2E_Evaluator_draft_04 6873278.418604672 ns/iter 4500558.329032027 ns/iter 1.53
E2E_Evaluator_fabric_mod 785671.6820460377 ns/iter 426914.9326806197 ns/iter 1.84
E2E_Evaluator_geojson 16795426.81080961 ns/iter 10084537.362068847 ns/iter 1.67
E2E_Evaluator_gitpod_configuration 266324.2649359835 ns/iter 148510.1600000065 ns/iter 1.79
E2E_Evaluator_helm_chart_lock 236978.66605056328 ns/iter 190577.9734237734 ns/iter 1.24
E2E_Evaluator_importmap 33947.92277504084 ns/iter 27646.56151711404 ns/iter 1.23
E2E_Evaluator_jasmine 92420.90815863293 ns/iter 73114.8937867482 ns/iter 1.26
E2E_Evaluator_jshintrc 1137774.9152045094 ns/iter 854922.2791261236 ns/iter 1.33
E2E_Evaluator_jsconfig 358163.43430068047 ns/iter 275074.57173453365 ns/iter 1.30
E2E_Evaluator_krakend 133435.41923576884 ns/iter 117521.86836265166 ns/iter 1.14
E2E_Evaluator_lazygit 105994.37184116904 ns/iter 89588.6336183842 ns/iter 1.18
E2E_Evaluator_lerna 145684.89678477927 ns/iter 111031.90141539274 ns/iter 1.31
E2E_Evaluator_nest_cli 166482.37894501013 ns/iter 121300.65158071405 ns/iter 1.37
E2E_Evaluator_omc 17697.49079815305 ns/iter 12836.570965064802 ns/iter 1.38
E2E_Evaluator_omnisharp 566276.2080000902 ns/iter 390947.5806452068 ns/iter 1.45
E2E_Evaluator_openapi 11242650.602408031 ns/iter 7173926.123709627 ns/iter 1.57
E2E_Evaluator_pre_commit_hooks 380184.01902312675 ns/iter 315269.01204282016 ns/iter 1.21
E2E_Evaluator_pulumi 677969.1623474543 ns/iter 461389.18205791694 ns/iter 1.47
E2E_Evaluator_semantic_release 95820.91780821553 ns/iter 63306.841295545586 ns/iter 1.51
E2E_Evaluator_stale 148297.10701489405 ns/iter 100724.4692263525 ns/iter 1.47
E2E_Evaluator_stylecop 234478.53863991657 ns/iter 170810.97487318842 ns/iter 1.37
E2E_Evaluator_tmuxinator 92219.3045221226 ns/iter 69288.07508244007 ns/iter 1.33
E2E_Evaluator_ui5 371218.5505188892 ns/iter 300550.02550800703 ns/iter 1.24
E2E_Evaluator_ui5_manifest 1910809.7507331213 ns/iter 1381836.9999999048 ns/iter 1.38
E2E_Evaluator_unreal_engine_uproject 398686.5322508257 ns/iter 286603.59450596815 ns/iter 1.39
E2E_Evaluator_vercel 257290.67448574788 ns/iter 206732.46575772046 ns/iter 1.24
E2E_Evaluator_yamllint 6049.176866067741 ns/iter 5375.816881193702 ns/iter 1.13
Micro_Draft4_Meta_1_No_Callback 129.75151294024053 ns/iter 117.05330412052473 ns/iter 1.11
Micro_Draft4_Required_Properties 652.0035799512026 ns/iter 570.3296681077661 ns/iter 1.14
Micro_Draft4_Many_Optional_Properties_Minimal_Match 16.342814744450667 ns/iter 14.823057800571796 ns/iter 1.10
Micro_Draft4_Few_Optional_Properties_Minimal_Match 7.656906608570765 ns/iter 6.756048480801394 ns/iter 1.13
Micro_Draft4_Items_Schema 282.48268168115237 ns/iter 235.9144494585444 ns/iter 1.20
Micro_Draft4_Nested_Object 0.7294094623469193 ns/iter 0.6468257436783806 ns/iter 1.13
Micro_Draft4_Properties_Triad_Optional 209.111450503162 ns/iter 185.36841955173648 ns/iter 1.13
Micro_Draft4_Properties_Triad_Closed 177.42665586288314 ns/iter 160.0477562683447 ns/iter 1.11
Micro_Draft4_Properties_Triad_Required 230.48834056245175 ns/iter 201.9964265887984 ns/iter 1.14
Micro_Draft4_Properties_Closed 41.09755236329041 ns/iter 34.07758777941257 ns/iter 1.21
Micro_Draft4_Non_Recursive_Ref 13.475245098053925 ns/iter 11.681639252203016 ns/iter 1.15
Micro_Draft4_Pattern_Properties_True 145.5691260755246 ns/iter 134.89160827542088 ns/iter 1.08
Micro_Draft4_Ref_To_Single_Property 7.47229428974611 ns/iter 6.491707460123847 ns/iter 1.15
Micro_Draft4_Additional_Properties_Type 28.998737600949692 ns/iter 23.784377668685778 ns/iter 1.22
Micro_Draft4_Nested_Oneof 43.37186569699719 ns/iter 37.39127683248712 ns/iter 1.16
Micro_Draft4_Short_Enum 5.261132239867264 ns/iter 4.483616110800908 ns/iter 1.17
Micro_Draft4_Long_Enum 12.432654652092376 ns/iter 9.449187991303459 ns/iter 1.32
Micro_Draft4_Long_Enum_Short_Strings 7.460900145995461 ns/iter 5.6854983985013 ns/iter 1.31
Micro_Draft4_Type_Object 2.5154844669732235 ns/iter 1.9998578580001531 ns/iter 1.26
Micro_Draft4_Ref_Single_100 2065702.7439025978 ns/iter 1732971.0198021412 ns/iter 1.19
Micro_Draft4_Compile_Ref_Many_Nested 1574574.3346303564 ns/iter 1175871.7818532495 ns/iter 1.34
Micro_Draft4_Compile_Wrap 2761291.5095785214 ns/iter 1818928.929687639 ns/iter 1.52
Micro_Draft6_Property_Names 113.38031430766118 ns/iter 87.50115761084783 ns/iter 1.30
Micro_Draft6_Compile_FHIR 12909819083.999992 ns/iter 6858630416.000096 ns/iter 1.88
Micro_Draft7_If_Then_Else 18.44138981834348 ns/iter 18.94341062410659 ns/iter 0.97
Micro_2019_09_Unevaluated_Properties 27.347740197427175 ns/iter 26.07085638606516 ns/iter 1.05
Micro_2019_09_Compile_Wrap 341120958.00003314 ns/iter 302232645.9999931 ns/iter 1.13
Micro_2020_12_Dynamic_Ref 198.95267328842505 ns/iter 169.81872584127748 ns/iter 1.17
Micro_2020_12_Dynamic_Ref_Single 2.238894020903844 ns/iter 2.0016110800689417 ns/iter 1.12
Micro_2020_12_Simple_Output_Mask 66788.13671974844 ns/iter 56870.465203571126 ns/iter 1.17
Micro_2020_12_Simple_Output_Annotations 91784.25065010703 ns/iter 79266.87215685302 ns/iter 1.16
Micro_2020_12_Compile_NonCircular_Shared_Refs 939127.9227110253 ns/iter 740462.5407164765 ns/iter 1.27
Micro_2020_12_Exhaustive_Deep_Numeric 5480.289730937198 ns/iter 4862.299325510834 ns/iter 1.13
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 128863.13394017617 ns/iter 108722.14162377121 ns/iter 1.19
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 15623.571174212178 ns/iter 13399.67964727741 ns/iter 1.17
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 106.70939864836431 ns/iter 85.98584130008605 ns/iter 1.24
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 5089.592919998722 ns/iter 4840.449175392619 ns/iter 1.05
Alterschema_Check_Readibility_ISO_Language_Set_3 279165152.6666404 ns/iter 224553528.0000392 ns/iter 1.24
Alterschema_Check_Readibility_OMC 79392384.22222337 ns/iter 51729461.28571506 ns/iter 1.53
Alterschema_Check_Readibility_KrakenD 776501833.9998733 ns/iter 547776417.0000228 ns/iter 1.42
Alterschema_Apply_Readibility_KrakenD 10279500249.999956 ns/iter 7488307041.000325 ns/iter 1.37
Alterschema_Check_Invalid_External_Refs 178061208.50002572 ns/iter 165519600.000016 ns/iter 1.08

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: d39b8b7 Previous: 9e80b70 Ratio
E2E_Evaluator_adaptivecard 105246 ns 83463 ns 1.26
E2E_Evaluator_ansible-meta 558013 ns 382963 ns 1.46
E2E_Evaluator_aws-cdk 144489 ns 120875 ns 1.20
E2E_Evaluator_babelrc 427984 ns 320694 ns 1.33
E2E_Evaluator_cerebrum-criminal-case 2362237 ns 1897840 ns 1.24
E2E_Evaluator_clang-format 305923 ns 212093 ns 1.44
E2E_Evaluator_cmake-presets 17257241 ns 12865480 ns 1.34
E2E_Evaluator_code-climate 465605 ns 347363 ns 1.34
E2E_Evaluator_cql2 1084931 ns 839063 ns 1.29
E2E_Evaluator_cspell 1890820 ns 1196739 ns 1.58
E2E_Evaluator_cypress 922575 ns 735338 ns 1.25
E2E_Evaluator_deno 1116223 ns 726613 ns 1.54
E2E_Evaluator_dependabot 1184417 ns 812227 ns 1.46
E2E_Evaluator_draft-04 18552218 ns 14853216 ns 1.25
E2E_Evaluator_fabric-mod 2281720 ns 1673722 ns 1.36
E2E_Evaluator_geojson 26452534 ns 20768606 ns 1.27
E2E_Evaluator_gitpod-configuration 830159 ns 595350 ns 1.39
E2E_Evaluator_helm-chart-lock 1173274 ns 1176651 ns 1.00
E2E_Evaluator_importmap 334917 ns 215741 ns 1.55
E2E_Evaluator_jasmine 366751 ns 254844 ns 1.44
E2E_Evaluator_jsconfig 1633258 ns 1475061 ns 1.11
E2E_Evaluator_jshintrc 3178950 ns 2387456 ns 1.33
E2E_Evaluator_krakend 608118 ns 448458 ns 1.36
E2E_Evaluator_lazygit 752886 ns 325976 ns 2.31
E2E_Evaluator_lerna 479542 ns 391911 ns 1.22
E2E_Evaluator_nest-cli 761284 ns 529566 ns 1.44
E2E_Evaluator_omc 85625 ns 65725 ns 1.30
E2E_Evaluator_omnisharp 1556578 ns 1285465 ns 1.21
E2E_Evaluator_openapi 30131304 ns 23099426 ns 1.30
E2E_Evaluator_pre-commit-hooks 1984620 ns 1520619 ns 1.31
E2E_Evaluator_pulumi 2127970 ns 1709936 ns 1.24
E2E_Evaluator_semantic-release 291167 ns 224953 ns 1.29
E2E_Evaluator_stale 469388 ns 351263 ns 1.34
E2E_Evaluator_stylecop 1064717 ns 796071 ns 1.34
E2E_Evaluator_tmuxinator 268396 ns 215309 ns 1.25
E2E_Evaluator_ui5 1857925 ns 1451861 ns 1.28
E2E_Evaluator_ui5-manifest 9738520 ns 7501065 ns 1.30
E2E_Evaluator_unreal-engine-uproject 1650316 ns 1350596 ns 1.22
E2E_Evaluator_vercel 1105707 ns 824085 ns 1.34
E2E_Evaluator_yamllint 32119 ns 29167 ns 1.10

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit f01e314 into main Apr 10, 2026
14 checks passed
@jviotti jviotti deleted the bug-3 branch April 10, 2026 20:35
Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: d39b8b7 Previous: 9e80b70 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 366398875.0000158 ns/iter 340170047.5000098 ns/iter 1.08
Alterschema_Check_Readibility_OMC 102125126.28571144 ns/iter 94349610.99998417 ns/iter 1.08
Alterschema_Check_Readibility_KrakenD 1509219710.0000248 ns/iter 1313013928.0000322 ns/iter 1.15
Alterschema_Apply_Readibility_KrakenD 19845000058.999973 ns/iter 16528559867.999887 ns/iter 1.20
Alterschema_Check_Invalid_External_Refs 322651726.0000037 ns/iter 326613337.499964 ns/iter 0.99
Micro_2020_12_Dynamic_Ref 260.15701723082054 ns/iter 261.284791970358 ns/iter 1.00
Micro_2020_12_Dynamic_Ref_Single 4.5966062002022445 ns/iter 5.145849920870295 ns/iter 0.89
Micro_2020_12_Simple_Output_Mask 72041.82516123196 ns/iter 72406.4931550116 ns/iter 0.99
Micro_2020_12_Simple_Output_Annotations 103646.37989073375 ns/iter 112296.92854821935 ns/iter 0.92
Micro_2020_12_Compile_NonCircular_Shared_Refs 1217150.862847226 ns/iter 1191946.1908005213 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric 7964.821879398509 ns/iter 8406.075263887158 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 169922.5896501305 ns/iter 164660.5409836096 ns/iter 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 26842.00698811923 ns/iter 25092.90425113144 ns/iter 1.07
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 132.4189254823946 ns/iter 131.3761089901394 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4484.210106262363 ns/iter 4681.724279065239 ns/iter 0.96
Micro_2019_09_Unevaluated_Properties 28.97995309062012 ns/iter 28.683659248911997 ns/iter 1.01
Micro_2019_09_Compile_Wrap 337943725.0000024 ns/iter 303044207.00002766 ns/iter 1.12
Micro_Draft7_If_Then_Else 25.12958466052905 ns/iter 25.150241875825902 ns/iter 1.00
Micro_Draft6_Property_Names 143.12581530489732 ns/iter 164.73766669176007 ns/iter 0.87
Micro_Draft6_Compile_FHIR 16426274958.999897 ns/iter 14004326587.000036 ns/iter 1.17
Micro_Draft4_Meta_1_No_Callback 182.66749695383575 ns/iter 167.3410897009287 ns/iter 1.09
Micro_Draft4_Required_Properties 799.1140980945063 ns/iter 813.1901959551525 ns/iter 0.98
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.075889956813445 ns/iter 21.200826989347053 ns/iter 0.99
Micro_Draft4_Few_Optional_Properties_Minimal_Match 13.020240568897568 ns/iter 12.787406895602706 ns/iter 1.02
Micro_Draft4_Items_Schema 315.6871484644782 ns/iter 323.9804023496672 ns/iter 0.97
Micro_Draft4_Nested_Object 2.1111821666480894 ns/iter 2.1827747884636866 ns/iter 0.97
Micro_Draft4_Properties_Triad_Optional 431.33916165967895 ns/iter 364.14734022475335 ns/iter 1.18
Micro_Draft4_Properties_Triad_Closed 357.06214090238916 ns/iter 294.9678089400547 ns/iter 1.21
Micro_Draft4_Properties_Triad_Required 449.71093508837384 ns/iter 405.917187430226 ns/iter 1.11
Micro_Draft4_Properties_Closed 62.22275980599688 ns/iter 60.80760965982131 ns/iter 1.02
Micro_Draft4_Non_Recursive_Ref 8.820441339353094 ns/iter 9.962630652687055 ns/iter 0.89
Micro_Draft4_Pattern_Properties_True 210.0661181324724 ns/iter 215.40539919462327 ns/iter 0.98
Micro_Draft4_Ref_To_Single_Property 12.705488510101636 ns/iter 13.435768756689804 ns/iter 0.95
Micro_Draft4_Additional_Properties_Type 14.916267101604854 ns/iter 14.632258351578173 ns/iter 1.02
Micro_Draft4_Nested_Oneof 65.84143459258863 ns/iter 67.57324750920246 ns/iter 0.97
Micro_Draft4_Short_Enum 14.769868672903497 ns/iter 14.70117878938366 ns/iter 1.00
Micro_Draft4_Long_Enum 14.082603577190524 ns/iter 14.110704510113424 ns/iter 1.00
Micro_Draft4_Long_Enum_Short_Strings 14.787933176417525 ns/iter 14.67070162677298 ns/iter 1.01
Micro_Draft4_Type_Object 4.5747035515249035 ns/iter 4.665024144372892 ns/iter 0.98
Micro_Draft4_Ref_Single_100 2551961.5036232346 ns/iter 2486547.8362990217 ns/iter 1.03
Micro_Draft4_Compile_Ref_Many_Nested 1871403.7139039051 ns/iter 1806277.7429305385 ns/iter 1.04
Micro_Draft4_Compile_Wrap 2672530.475285882 ns/iter 2561145.341912031 ns/iter 1.04
E2E_Compiler_adaptivecard 72817248.22221096 ns/iter 66130912.79999708 ns/iter 1.10
E2E_Compiler_ansible_meta 32500482.227274835 ns/iter 29962031.217391796 ns/iter 1.08
E2E_Compiler_aws_cdk 407951.273204984 ns/iter 409890.4459380213 ns/iter 1.00
E2E_Compiler_babelrc 2874238.757201351 ns/iter 2889970.815686313 ns/iter 0.99
E2E_Compiler_clang_format 20553342.352941934 ns/iter 19488664.63888837 ns/iter 1.05
E2E_Compiler_cmake_presets 28682128.28000651 ns/iter 26915368.153844647 ns/iter 1.07
E2E_Compiler_code_climate 2903685.7250000974 ns/iter 2765183.762845722 ns/iter 1.05
E2E_Compiler_cql2 14402484.510202734 ns/iter 13966368.400001558 ns/iter 1.03
E2E_Compiler_cspell 25212412.571428496 ns/iter 23809004.62068878 ns/iter 1.06
E2E_Compiler_cypress 4314783.296296001 ns/iter 4096680.6823529196 ns/iter 1.05
E2E_Compiler_deno 8555211.691356346 ns/iter 8097232.896551728 ns/iter 1.06
E2E_Compiler_dependabot 4443721.088049722 ns/iter 4129103.6941181445 ns/iter 1.08
E2E_Compiler_draft_04 2999949.2094014925 ns/iter 2909717.000000331 ns/iter 1.03
E2E_Compiler_fabric_mod 5298193.323308015 ns/iter 5076264.079709778 ns/iter 1.04
E2E_Compiler_geojson 25345382.07407456 ns/iter 23566234.433330163 ns/iter 1.08
E2E_Compiler_gitpod_configuration 5468575.6640626695 ns/iter 5219449.644445612 ns/iter 1.05
E2E_Compiler_helm_chart_lock 746131.5893617715 ns/iter 740626.049840904 ns/iter 1.01
E2E_Compiler_importmap 310966.9415700132 ns/iter 306869.88178630423 ns/iter 1.01
E2E_Compiler_jasmine 1504620.2267820274 ns/iter 1455296.394190864 ns/iter 1.03
E2E_Compiler_jshintrc 4838752.434482652 ns/iter 4747062.373332179 ns/iter 1.02
E2E_Compiler_jsconfig 24529714.51724148 ns/iter 23122948.599999897 ns/iter 1.06
E2E_Compiler_krakend 151942444.60003573 ns/iter 146318862.4000395 ns/iter 1.04
E2E_Compiler_lazygit 37714354.94444278 ns/iter 35134761.250003524 ns/iter 1.07
E2E_Compiler_lerna 1792202.99492333 ns/iter 1725849.6284284773 ns/iter 1.04
E2E_Compiler_nest_cli 8402087.939758936 ns/iter 7891612.179775436 ns/iter 1.06
E2E_Compiler_omc 180551962.25003555 ns/iter 165669735.50004604 ns/iter 1.09
E2E_Compiler_omnisharp 7511973.913979482 ns/iter 7084652.666667399 ns/iter 1.06
E2E_Compiler_openapi 28098414.440000854 ns/iter 26679245.961540453 ns/iter 1.05
E2E_Compiler_pre_commit_hooks 5983276.568966191 ns/iter 5621422.919353614 ns/iter 1.06
E2E_Compiler_pulumi 4548585.519480432 ns/iter 4316289.956790693 ns/iter 1.05
E2E_Compiler_semantic_release 1750778.5563911123 ns/iter 1677185.7122304665 ns/iter 1.04
E2E_Compiler_stale 1724856.9828009703 ns/iter 1653407.6752941473 ns/iter 1.04
E2E_Compiler_stylecop 6712624.771428939 ns/iter 6229670.017857204 ns/iter 1.08
E2E_Compiler_tmuxinator 2159266.3907694467 ns/iter 2075590.9554895947 ns/iter 1.04
E2E_Compiler_ui5 54576600.84614592 ns/iter 48936071.14286169 ns/iter 1.12
E2E_Compiler_ui5_manifest 353517850.4999976 ns/iter 325344698.9999702 ns/iter 1.09
E2E_Compiler_unreal_engine_uproject 5139354.262772787 ns/iter 4887832.669013938 ns/iter 1.05
E2E_Compiler_vercel 13836797.333334628 ns/iter 13083020.833332907 ns/iter 1.06
E2E_Compiler_yamllint 377682.8108544765 ns/iter 374687.0951612368 ns/iter 1.01
E2E_Evaluator_adaptivecard 24375.340687131156 ns/iter 22949.548876109187 ns/iter 1.06
E2E_Evaluator_ansible_meta 239003.95357508442 ns/iter 248743.00323626088 ns/iter 0.96
E2E_Evaluator_aws_cdk 44286.01207396062 ns/iter 51282.35426236738 ns/iter 0.86
E2E_Evaluator_babelrc 85390.46416797301 ns/iter 104022.79180592916 ns/iter 0.82
E2E_Evaluator_cerebrum_criminal_case 1346429.9999998985 ns/iter 1265610.473684565 ns/iter 1.06
E2E_Evaluator_clang_format 102123.45334302432 ns/iter 104628.73239011482 ns/iter 0.98
E2E_Evaluator_cmake_presets 5516454.592919467 ns/iter 4637289.05921064 ns/iter 1.19
E2E_Evaluator_code_climate 163337.49777463527 ns/iter 185612.1972609886 ns/iter 0.88
E2E_Evaluator_cql2 210005.13022558068 ns/iter 218070.98347881774 ns/iter 0.96
E2E_Evaluator_cspell 516776.77187744126 ns/iter 527442.7868480773 ns/iter 0.98
E2E_Evaluator_cypress 143943.4401983238 ns/iter 170088.83325281597 ns/iter 0.85
E2E_Evaluator_deno 275137.53609049466 ns/iter 327640.98931715684 ns/iter 0.84
E2E_Evaluator_dependabot 460097.0632996317 ns/iter 456756.6275544068 ns/iter 1.01
E2E_Evaluator_draft_04 8654572.045452885 ns/iter 7665468.459770468 ns/iter 1.13
E2E_Evaluator_fabric_mod 712537.7642855525 ns/iter 724861.0073298807 ns/iter 0.98
E2E_Evaluator_geojson 17947201.874994792 ns/iter 16250285.767444776 ns/iter 1.10
E2E_Evaluator_gitpod_configuration 221856.2514195577 ns/iter 250048.60021286146 ns/iter 0.89
E2E_Evaluator_helm_chart_lock 216909.02652932086 ns/iter 318259.34319529496 ns/iter 0.68
E2E_Evaluator_importmap 41461.51777882635 ns/iter 48015.61808797253 ns/iter 0.86
E2E_Evaluator_jasmine 101731.57777776849 ns/iter 115352.26764864163 ns/iter 0.88
E2E_Evaluator_jshintrc 1014877.7394466164 ns/iter 1023271.6302766178 ns/iter 0.99
E2E_Evaluator_jsconfig 373629.6555379276 ns/iter 398623.7868106102 ns/iter 0.94
E2E_Evaluator_krakend 185082.14278119997 ns/iter 206020.19913542236 ns/iter 0.90
E2E_Evaluator_lazygit 121501.36699335916 ns/iter 132272.559315494 ns/iter 0.92
E2E_Evaluator_lerna 122126.4864577866 ns/iter 150980.1784322425 ns/iter 0.81
E2E_Evaluator_nest_cli 177252.57978725672 ns/iter 192993.83062516592 ns/iter 0.92
E2E_Evaluator_omc 19265.298308295605 ns/iter 18808.236288059546 ns/iter 1.02
E2E_Evaluator_omnisharp 535633.0940630743 ns/iter 545102.8644201057 ns/iter 0.98
E2E_Evaluator_openapi 16802182.634148445 ns/iter 12940974.313724997 ns/iter 1.30
E2E_Evaluator_pre_commit_hooks 473240.6178862179 ns/iter 510514.5626843548 ns/iter 0.93
E2E_Evaluator_pulumi 731632.634819495 ns/iter 712435.5035823766 ns/iter 1.03
E2E_Evaluator_semantic_release 86633.21630513782 ns/iter 100165.0460470467 ns/iter 0.86
E2E_Evaluator_stale 151665.1430114895 ns/iter 153895.64881854833 ns/iter 0.99
E2E_Evaluator_stylecop 285605.8310615711 ns/iter 293292.4368931965 ns/iter 0.97
E2E_Evaluator_tmuxinator 87326.3366065714 ns/iter 98981.27876599212 ns/iter 0.88
E2E_Evaluator_ui5 502100.6308138857 ns/iter 525569.2291045117 ns/iter 0.96
E2E_Evaluator_ui5_manifest 2663542.8674239847 ns/iter 2630176.7660371764 ns/iter 1.01
E2E_Evaluator_unreal_engine_uproject 433198.9049773357 ns/iter 454291.5671162756 ns/iter 0.95
E2E_Evaluator_vercel 265601.32524083165 ns/iter 309824.064171143 ns/iter 0.86
E2E_Evaluator_yamllint 9855.553683624392 ns/iter 10322.008855702812 ns/iter 0.95

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: d39b8b7 Previous: 9e80b70 Ratio
E2E_Evaluator_adaptivecard 119272 ns 116667 ns 1.02
E2E_Evaluator_ansible-meta 628360 ns 572454 ns 1.10
E2E_Evaluator_aws-cdk 136121 ns 133820 ns 1.02
E2E_Evaluator_babelrc 335070 ns 320571 ns 1.05
E2E_Evaluator_cerebrum-criminal-case 3251388 ns 2667997 ns 1.22
E2E_Evaluator_clang-format 309118 ns 274236 ns 1.13
E2E_Evaluator_cmake-presets 22582058 ns 18725862 ns 1.21
E2E_Evaluator_code-climate 447535 ns 434082 ns 1.03
E2E_Evaluator_cql2 1203106 ns 1205275 ns 1.00
E2E_Evaluator_cspell 1850307 ns 1551492 ns 1.19
E2E_Evaluator_cypress 1012562 ns 852748 ns 1.19
E2E_Evaluator_deno 1213078 ns 1097123 ns 1.11
E2E_Evaluator_dependabot 1183665 ns 1102617 ns 1.07
E2E_Evaluator_draft-04 25051120 ns 20200282 ns 1.24
E2E_Evaluator_fabric-mod 2956265 ns 2485733 ns 1.19
E2E_Evaluator_geojson 23281972 ns 22700655 ns 1.03
E2E_Evaluator_gitpod-configuration 869341 ns 769659 ns 1.13
E2E_Evaluator_helm-chart-lock 1047805 ns 1002551 ns 1.05
E2E_Evaluator_importmap 285851 ns 290349 ns 0.98
E2E_Evaluator_jasmine 304438 ns 304740 ns 1.00
E2E_Evaluator_jsconfig 1528383 ns 1328906 ns 1.15
E2E_Evaluator_jshintrc 3408636 ns 3139377 ns 1.09
E2E_Evaluator_krakend 713882 ns 798144 ns 0.89
E2E_Evaluator_lazygit 491168 ns 564921 ns 0.87
E2E_Evaluator_lerna 452312 ns 469841 ns 0.96
E2E_Evaluator_nest-cli 655050 ns 642117 ns 1.02
E2E_Evaluator_omc 87102 ns 87306 ns 1.00
E2E_Evaluator_omnisharp 1731648 ns 1590237 ns 1.09
E2E_Evaluator_openapi 37381497 ns 35734927 ns 1.05
E2E_Evaluator_pre-commit-hooks 2089755 ns 1960645 ns 1.07
E2E_Evaluator_pulumi 2211338 ns 1966406 ns 1.12
E2E_Evaluator_semantic-release 243838 ns 265210 ns 0.92
E2E_Evaluator_stale 442458 ns 436661 ns 1.01
E2E_Evaluator_stylecop 1243182 ns 1204085 ns 1.03
E2E_Evaluator_tmuxinator 239045 ns 228941 ns 1.04
E2E_Evaluator_ui5 2250507 ns 2250585 ns 1.00
E2E_Evaluator_ui5-manifest 10225680 ns 11098173 ns 0.92
E2E_Evaluator_unreal-engine-uproject 1698299 ns 1497125 ns 1.13
E2E_Evaluator_vercel 1125533 ns 1059041 ns 1.06
E2E_Evaluator_yamllint 25281 ns 24728 ns 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant