Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
🤖 Augment PR SummarySummary: This PR fixes semantic canonicalization around Changes:
Technical Notes: Uses 🤖 Was this summary useful? React with 👍 or 👎 |
| schema.is_object() && schema.defines("type") && | ||
| schema.at("type").is_string() && | ||
| schema.at("type").to_string() == "array" && !schema.defines("items")); | ||
| ONLY_CONTINUE_IF(!WALK_UP_IN_PLACE_APPLICATORS( |
There was a problem hiding this comment.
WALK_UP_IN_PLACE_APPLICATORS(...) only checks parent schemas, so an array schema that directly defines unevaluatedItems can still be rewritten to add implicit items: true, which can change unevaluatedItems behavior.
Severity: high
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| ONLY_CONTINUE_IF(!WALK_UP_IN_PLACE_APPLICATORS( | ||
| root, frame, location, walker, resolver, | ||
| [](const JSON &ancestor) { | ||
| return ancestor.defines("unevaluatedItems"); |
There was a problem hiding this comment.
This guard triggers purely on ancestor.defines("unevaluatedItems"), even if the active vocabularies/dialect treat unevaluatedItems as an unknown keyword (e.g., 2020-12 without the Unevaluated vocabulary, or older drafts), which could unnecessarily skip canonicalization.
Severity: medium
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| } | ||
|
|
||
| TEST(AlterSchema_canonicalize_2019_09, | ||
| items_implicit_skipped_with_unevaluated_items) { |
There was a problem hiding this comment.
These regressions cover unevaluatedItems on an ancestor of the array schema; it may also be worth exercising the case where the array schema itself defines unevaluatedItems with no in-place-applicator parent, since WALK_UP_IN_PLACE_APPLICATORS won’t detect that.
Severity: low
Other Locations
test/alterschema/alterschema_canonicalize_2020_12_test.cc:1701
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
There was a problem hiding this comment.
2 issues found across 3 files
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="test/alterschema/alterschema_canonicalize_2020_12_test.cc">
<violation number="1" location="test/alterschema/alterschema_canonicalize_2020_12_test.cc:1720">
P2: Preserve `prefixItems` here; removing it changes how `unevaluatedItems: false` validates non-empty arrays.</violation>
</file>
<file name="test/alterschema/alterschema_canonicalize_2019_09_test.cc">
<violation number="1" location="test/alterschema/alterschema_canonicalize_2019_09_test.cc:715">
P1: Preserve the explicit `items` schema in this expected output; removing it changes the array semantics.</violation>
</file>
Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.
| }, | ||
| { | ||
| "type": "array", | ||
| "minItems": 0, |
There was a problem hiding this comment.
P1: Preserve the explicit items schema in this expected output; removing it changes the array semantics.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/alterschema/alterschema_canonicalize_2019_09_test.cc, line 715:
<comment>Preserve the explicit `items` schema in this expected output; removing it changes the array semantics.</comment>
<file context>
@@ -687,3 +687,85 @@ TEST(AlterSchema_canonicalize_2019_09, items_implicit_1) {
+ },
+ {
+ "type": "array",
+ "minItems": 0,
+ "contains": {
+ "enum": [ false, true ]
</file context>
| "minItems": 0, | |
| "minItems": 0, | |
| "items": { | |
| "enum": [ false, true ] | |
| }, |
| "anyOf": [ | ||
| { "enum": [ null ] }, | ||
| { "enum": [ false, true ] }, | ||
| { |
There was a problem hiding this comment.
P2: Preserve prefixItems here; removing it changes how unevaluatedItems: false validates non-empty arrays.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/alterschema/alterschema_canonicalize_2020_12_test.cc, line 1720:
<comment>Preserve `prefixItems` here; removing it changes how `unevaluatedItems: false` validates non-empty arrays.</comment>
<file context>
@@ -1697,6 +1697,88 @@ TEST(AlterSchema_canonicalize_2020_12,
+ "anyOf": [
+ { "enum": [ null ] },
+ { "enum": [ false, true ] },
+ {
+ "type": "object",
+ "minProperties": 0,
</file context>
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: d39b8b7 | Previous: 9e80b70 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
64062161.66666607 ns/iter |
69316295.62500064 ns/iter |
0.92 |
E2E_Compiler_ansible_meta |
29520324.173913453 ns/iter |
29952981.173914354 ns/iter |
0.99 |
E2E_Compiler_aws_cdk |
365731.44548774004 ns/iter |
359626.269032931 ns/iter |
1.02 |
E2E_Compiler_babelrc |
2578463.9114390705 ns/iter |
2559520.8905109507 ns/iter |
1.01 |
E2E_Compiler_clang_format |
18480522.28947351 ns/iter |
18782484.0263153 ns/iter |
0.98 |
E2E_Compiler_cmake_presets |
25775900.51851917 ns/iter |
26648530.346154056 ns/iter |
0.97 |
E2E_Compiler_code_climate |
2600632.4460966727 ns/iter |
2577235.8124999576 ns/iter |
1.01 |
E2E_Compiler_cql2 |
12855547.872726966 ns/iter |
13026594.425926734 ns/iter |
0.99 |
E2E_Compiler_cspell |
22826425.35484016 ns/iter |
23237374.53333289 ns/iter |
0.98 |
E2E_Compiler_cypress |
3951786.9055556627 ns/iter |
3913576.709496979 ns/iter |
1.01 |
E2E_Compiler_deno |
7788672.233332743 ns/iter |
7937220.322222376 ns/iter |
0.98 |
E2E_Compiler_dependabot |
3931572.687150879 ns/iter |
3911179.435754245 ns/iter |
1.01 |
E2E_Compiler_draft_04 |
2698532.792307709 ns/iter |
2659074.632575844 ns/iter |
1.01 |
E2E_Compiler_fabric_mod |
4783884.068493155 ns/iter |
4747477.000000108 ns/iter |
1.01 |
E2E_Compiler_geojson |
22460452.58064647 ns/iter |
22661516.322581258 ns/iter |
0.99 |
E2E_Compiler_gitpod_configuration |
4921077.239436765 ns/iter |
4885978.062937163 ns/iter |
1.01 |
E2E_Compiler_helm_chart_lock |
685212.3362744809 ns/iter |
669056.4200956698 ns/iter |
1.02 |
E2E_Compiler_importmap |
275373.7672040991 ns/iter |
271636.03053731145 ns/iter |
1.01 |
E2E_Compiler_jasmine |
1339428.4291187858 ns/iter |
1334136.5863377706 ns/iter |
1.00 |
E2E_Compiler_jshintrc |
4314819.376543115 ns/iter |
4368653.865030642 ns/iter |
0.99 |
E2E_Compiler_jsconfig |
21767064.999998808 ns/iter |
21742689.483870994 ns/iter |
1.00 |
E2E_Compiler_krakend |
137211550.20000425 ns/iter |
139898256.00000358 ns/iter |
0.98 |
E2E_Compiler_lazygit |
34278996.190477885 ns/iter |
34144650.57142836 ns/iter |
1.00 |
E2E_Compiler_lerna |
1572717.804494301 ns/iter |
1574269.1517856806 ns/iter |
1.00 |
E2E_Compiler_nest_cli |
7483042.4468087405 ns/iter |
7480932.861701628 ns/iter |
1.00 |
E2E_Compiler_omc |
158209627.2500024 ns/iter |
160866630.50000992 ns/iter |
0.98 |
E2E_Compiler_omnisharp |
6728352.451923151 ns/iter |
6691044.304761818 ns/iter |
1.01 |
E2E_Compiler_openapi |
25278384.714285705 ns/iter |
25244056.321428485 ns/iter |
1.00 |
E2E_Compiler_pre_commit_hooks |
5391823.763358725 ns/iter |
5376588.091603012 ns/iter |
1.00 |
E2E_Compiler_pulumi |
4044976.433526292 ns/iter |
4041927.2658960847 ns/iter |
1.00 |
E2E_Compiler_semantic_release |
1579204.5665913245 ns/iter |
1561917.2999999542 ns/iter |
1.01 |
E2E_Compiler_stale |
1558347.7928731313 ns/iter |
1543524.5518763675 ns/iter |
1.01 |
E2E_Compiler_stylecop |
6271020.169642887 ns/iter |
6254763.982143275 ns/iter |
1.00 |
E2E_Compiler_tmuxinator |
1914199.5219780046 ns/iter |
1922592.0328767332 ns/iter |
1.00 |
E2E_Compiler_ui5 |
49277832.600000694 ns/iter |
49379470.35714631 ns/iter |
1.00 |
E2E_Compiler_ui5_manifest |
309453997.00001985 ns/iter |
326242210.00000376 ns/iter |
0.95 |
E2E_Compiler_unreal_engine_uproject |
4601879.421052502 ns/iter |
4603854.842105342 ns/iter |
1.00 |
E2E_Compiler_vercel |
12357920.912280492 ns/iter |
12346518.789474646 ns/iter |
1.00 |
E2E_Compiler_yamllint |
335752.1294343174 ns/iter |
335958.2401913846 ns/iter |
1.00 |
E2E_Evaluator_adaptivecard |
23986.442075555173 ns/iter |
23986.014653534967 ns/iter |
1.00 |
E2E_Evaluator_ansible_meta |
202393.64902587762 ns/iter |
206951.4022523815 ns/iter |
0.98 |
E2E_Evaluator_aws_cdk |
42333.60177421125 ns/iter |
42739.41562125683 ns/iter |
0.99 |
E2E_Evaluator_babelrc |
86367.68677209596 ns/iter |
85928.50574570203 ns/iter |
1.01 |
E2E_Evaluator_cerebrum_criminal_case |
1254471.7246377235 ns/iter |
1274921.1560798525 ns/iter |
0.98 |
E2E_Evaluator_clang_format |
117042.74087774988 ns/iter |
117150.17528541987 ns/iter |
1.00 |
E2E_Evaluator_cmake_presets |
4200979.102409358 ns/iter |
4341213.071856198 ns/iter |
0.97 |
E2E_Evaluator_code_climate |
147398.6415656197 ns/iter |
149593.564864277 ns/iter |
0.99 |
E2E_Evaluator_cql2 |
178499.4816713671 ns/iter |
181264.06448285445 ns/iter |
0.98 |
E2E_Evaluator_cspell |
545206.9952494238 ns/iter |
544458.5352112702 ns/iter |
1.00 |
E2E_Evaluator_cypress |
167062.41494473178 ns/iter |
165035.57601150355 ns/iter |
1.01 |
E2E_Evaluator_deno |
246589.53248587664 ns/iter |
246262.0454065591 ns/iter |
1.00 |
E2E_Evaluator_dependabot |
398870.445267965 ns/iter |
402375.8696668653 ns/iter |
0.99 |
E2E_Evaluator_draft_04 |
7314379.266666214 ns/iter |
8685302.525000082 ns/iter |
0.84 |
E2E_Evaluator_fabric_mod |
650323.3058161384 ns/iter |
650114.9007420987 ns/iter |
1.00 |
E2E_Evaluator_geojson |
15912544.130434694 ns/iter |
16503136.348836336 ns/iter |
0.96 |
E2E_Evaluator_gitpod_configuration |
203244.49269548978 ns/iter |
199259.3078236184 ns/iter |
1.02 |
E2E_Evaluator_helm_chart_lock |
248164.7262969567 ns/iter |
246857.9108595709 ns/iter |
1.01 |
E2E_Evaluator_importmap |
43530.84724623578 ns/iter |
42912.986214536315 ns/iter |
1.01 |
E2E_Evaluator_jasmine |
95851.51437525758 ns/iter |
97332.84025157371 ns/iter |
0.98 |
E2E_Evaluator_jshintrc |
1147655.98029558 ns/iter |
1147279.8270180956 ns/iter |
1.00 |
E2E_Evaluator_jsconfig |
407079.0000000012 ns/iter |
412356.81723538524 ns/iter |
0.99 |
E2E_Evaluator_krakend |
179252.41288844307 ns/iter |
178025.43344447622 ns/iter |
1.01 |
E2E_Evaluator_lazygit |
120974.38945725898 ns/iter |
121810.28773092052 ns/iter |
0.99 |
E2E_Evaluator_lerna |
108676.87937500037 ns/iter |
111109.8645849868 ns/iter |
0.98 |
E2E_Evaluator_nest_cli |
167701.09329514837 ns/iter |
167832.20628447266 ns/iter |
1.00 |
E2E_Evaluator_omc |
18617.29084116147 ns/iter |
18373.421899213918 ns/iter |
1.01 |
E2E_Evaluator_omnisharp |
561124.1166936513 ns/iter |
569944.5272136492 ns/iter |
0.98 |
E2E_Evaluator_openapi |
17613059.18181868 ns/iter |
16515729.534883702 ns/iter |
1.07 |
E2E_Evaluator_pre_commit_hooks |
473689.805423758 ns/iter |
467101.42323097377 ns/iter |
1.01 |
E2E_Evaluator_pulumi |
709225.450049487 ns/iter |
688284.258638743 ns/iter |
1.03 |
E2E_Evaluator_semantic_release |
78676.13237295847 ns/iter |
80068.18651529159 ns/iter |
0.98 |
E2E_Evaluator_stale |
143137.06666666875 ns/iter |
148583.6261354283 ns/iter |
0.96 |
E2E_Evaluator_stylecop |
260016.751403983 ns/iter |
258971.68191963123 ns/iter |
1.00 |
E2E_Evaluator_tmuxinator |
83319.53045715057 ns/iter |
82100.86209294574 ns/iter |
1.01 |
E2E_Evaluator_ui5 |
465997.22661396203 ns/iter |
470428.9144173889 ns/iter |
0.99 |
E2E_Evaluator_ui5_manifest |
2365036.9624573947 ns/iter |
2405701.2516778978 ns/iter |
0.98 |
E2E_Evaluator_unreal_engine_uproject |
408498.0455607505 ns/iter |
408621.84918793093 ns/iter |
1.00 |
E2E_Evaluator_vercel |
251129.8624683177 ns/iter |
252319.9141926139 ns/iter |
1.00 |
E2E_Evaluator_yamllint |
8149.604455816074 ns/iter |
8181.795386322259 ns/iter |
1.00 |
Micro_Draft4_Meta_1_No_Callback |
192.59855454925392 ns/iter |
190.8761206264741 ns/iter |
1.01 |
Micro_Draft4_Required_Properties |
856.4272712894489 ns/iter |
861.8121326680161 ns/iter |
0.99 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
23.80845087799868 ns/iter |
25.391051570517835 ns/iter |
0.94 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
10.628092061145862 ns/iter |
10.640781513310055 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
299.73373318103313 ns/iter |
273.51366339103413 ns/iter |
1.10 |
Micro_Draft4_Nested_Object |
1.4067838493306208 ns/iter |
1.4123742631451546 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Optional |
319.34838527490734 ns/iter |
319.2827849662753 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Closed |
264.3639469675225 ns/iter |
263.8436859241448 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Required |
331.805604502193 ns/iter |
332.87034499342934 ns/iter |
1.00 |
Micro_Draft4_Properties_Closed |
59.26831002657516 ns/iter |
59.247398136330276 ns/iter |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
12.28336096130387 ns/iter |
12.217212495997646 ns/iter |
1.01 |
Micro_Draft4_Pattern_Properties_True |
153.58225311205544 ns/iter |
153.39924117635402 ns/iter |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
10.64846412494844 ns/iter |
10.629152767908279 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
23.589209395165227 ns/iter |
23.450616999032473 ns/iter |
1.01 |
Micro_Draft4_Nested_Oneof |
54.283521937813624 ns/iter |
54.26904019089024 ns/iter |
1.00 |
Micro_Draft4_Short_Enum |
13.720412797192074 ns/iter |
13.70693338447348 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
13.36922481957124 ns/iter |
13.808349754168518 ns/iter |
0.97 |
Micro_Draft4_Long_Enum_Short_Strings |
13.718428175820877 ns/iter |
13.714299803547837 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
3.5181852115679453 ns/iter |
3.516163813002052 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
2334530.3033333193 ns/iter |
2319283.310231056 ns/iter |
1.01 |
Micro_Draft4_Compile_Ref_Many_Nested |
1714129.6210269064 ns/iter |
1704168.7688562728 ns/iter |
1.01 |
Micro_Draft4_Compile_Wrap |
2414347.7655170816 ns/iter |
2378808.7142855325 ns/iter |
1.01 |
Micro_Draft6_Property_Names |
114.74987922012353 ns/iter |
117.38913025766506 ns/iter |
0.98 |
Micro_Draft6_Compile_FHIR |
15948749317.999954 ns/iter |
15533662901.999947 ns/iter |
1.03 |
Micro_Draft7_If_Then_Else |
23.662878792907694 ns/iter |
23.628513187193956 ns/iter |
1.00 |
Micro_2019_09_Unevaluated_Properties |
26.30919764091128 ns/iter |
25.834554130721983 ns/iter |
1.02 |
Micro_2019_09_Compile_Wrap |
299313438.50000757 ns/iter |
306783018.4999707 ns/iter |
0.98 |
Micro_2020_12_Dynamic_Ref |
233.50098734980614 ns/iter |
230.90275509867953 ns/iter |
1.01 |
Micro_2020_12_Dynamic_Ref_Single |
3.523185588264197 ns/iter |
3.517300911214063 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
64185.40437208892 ns/iter |
62989.89741286012 ns/iter |
1.02 |
Micro_2020_12_Simple_Output_Annotations |
95410.56808540388 ns/iter |
95442.02857905954 ns/iter |
1.00 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1094569.500780172 ns/iter |
1081871.6009174923 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8442.434928904622 ns/iter |
8592.189461540334 ns/iter |
0.98 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
172998.5749325677 ns/iter |
176193.14637682223 ns/iter |
0.98 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
22776.590996575116 ns/iter |
22759.67378476313 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
148.40882855028374 ns/iter |
148.43264931526525 ns/iter |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
3996.821280137728 ns/iter |
4014.0578971186155 ns/iter |
1.00 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
338865798.0000289 ns/iter |
347279413.49996173 ns/iter |
0.98 |
Alterschema_Check_Readibility_OMC |
89284580.24999486 ns/iter |
89912032.87499161 ns/iter |
0.99 |
Alterschema_Check_Readibility_KrakenD |
1300667680.9999363 ns/iter |
1313244722.0000358 ns/iter |
0.99 |
Alterschema_Apply_Readibility_KrakenD |
17012193993.999971 ns/iter |
17301950281.00002 ns/iter |
0.98 |
Alterschema_Check_Invalid_External_Refs |
278581001.0000205 ns/iter |
283438072.9999945 ns/iter |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: d39b8b7 | Previous: 9e80b70 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
116407 ns |
120652 ns |
0.96 |
E2E_Evaluator_ansible-meta |
602683 ns |
641700 ns |
0.94 |
E2E_Evaluator_aws-cdk |
130912 ns |
135962 ns |
0.96 |
E2E_Evaluator_babelrc |
313899 ns |
342021 ns |
0.92 |
E2E_Evaluator_cerebrum-criminal-case |
2851340 ns |
3392282 ns |
0.84 |
E2E_Evaluator_clang-format |
280949 ns |
285117 ns |
0.99 |
E2E_Evaluator_cmake-presets |
21887474 ns |
21471749 ns |
1.02 |
E2E_Evaluator_code-climate |
426740 ns |
448344 ns |
0.95 |
E2E_Evaluator_cql2 |
1207662 ns |
1203503 ns |
1.00 |
E2E_Evaluator_cspell |
1679051 ns |
2016271 ns |
0.83 |
E2E_Evaluator_cypress |
913581 ns |
1082461 ns |
0.84 |
E2E_Evaluator_deno |
1131341 ns |
1212410 ns |
0.93 |
E2E_Evaluator_dependabot |
1150493 ns |
1203370 ns |
0.96 |
E2E_Evaluator_draft-04 |
22618329 ns |
24266425 ns |
0.93 |
E2E_Evaluator_fabric-mod |
2703251 ns |
2996497 ns |
0.90 |
E2E_Evaluator_geojson |
21933954 ns |
22889835 ns |
0.96 |
E2E_Evaluator_gitpod-configuration |
804413 ns |
847311 ns |
0.95 |
E2E_Evaluator_helm-chart-lock |
1032443 ns |
1084158 ns |
0.95 |
E2E_Evaluator_importmap |
287949 ns |
286601 ns |
1.00 |
E2E_Evaluator_jasmine |
305294 ns |
319413 ns |
0.96 |
E2E_Evaluator_jsconfig |
1531621 ns |
1590032 ns |
0.96 |
E2E_Evaluator_jshintrc |
3365541 ns |
3466769 ns |
0.97 |
E2E_Evaluator_krakend |
727514 ns |
730783 ns |
1.00 |
E2E_Evaluator_lazygit |
503151 ns |
583184 ns |
0.86 |
E2E_Evaluator_lerna |
457280 ns |
507973 ns |
0.90 |
E2E_Evaluator_nest-cli |
667612 ns |
711014 ns |
0.94 |
E2E_Evaluator_omc |
88638 ns |
88522 ns |
1.00 |
E2E_Evaluator_omnisharp |
1673575 ns |
1849841 ns |
0.90 |
E2E_Evaluator_openapi |
37793524 ns |
39550333 ns |
0.96 |
E2E_Evaluator_pre-commit-hooks |
2245784 ns |
2322914 ns |
0.97 |
E2E_Evaluator_pulumi |
2206459 ns |
2395457 ns |
0.92 |
E2E_Evaluator_semantic-release |
248911 ns |
255855 ns |
0.97 |
E2E_Evaluator_stale |
442219 ns |
452963 ns |
0.98 |
E2E_Evaluator_stylecop |
1290293 ns |
1339158 ns |
0.96 |
E2E_Evaluator_tmuxinator |
228598 ns |
238458 ns |
0.96 |
E2E_Evaluator_ui5 |
2233061 ns |
2266639 ns |
0.99 |
E2E_Evaluator_ui5-manifest |
10446754 ns |
11240998 ns |
0.93 |
E2E_Evaluator_unreal-engine-uproject |
1658756 ns |
1691916 ns |
0.98 |
E2E_Evaluator_vercel |
1156072 ns |
1125914 ns |
1.03 |
E2E_Evaluator_yamllint |
24850 ns |
24249 ns |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: d39b8b7 | Previous: 9e80b70 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
78771767.8571523 ns/iter |
54124965.24998763 ns/iter |
1.46 |
E2E_Compiler_ansible_meta |
40379671.052631386 ns/iter |
22049481.781252213 ns/iter |
1.83 |
E2E_Compiler_aws_cdk |
366812.5232044448 ns/iter |
272888.97883030714 ns/iter |
1.34 |
E2E_Compiler_babelrc |
3034677.211618104 ns/iter |
2107397.5909086005 ns/iter |
1.44 |
E2E_Compiler_clang_format |
20689704.861110967 ns/iter |
13461040.076921247 ns/iter |
1.54 |
E2E_Compiler_cmake_presets |
36356626.952380925 ns/iter |
22777977.129034035 ns/iter |
1.60 |
E2E_Compiler_code_climate |
2976599.2406639373 ns/iter |
1966080.861581687 ns/iter |
1.51 |
E2E_Compiler_cql2 |
17404316.13043454 ns/iter |
10252336.956521016 ns/iter |
1.70 |
E2E_Compiler_cspell |
28288229.1538464 ns/iter |
17333785.400001034 ns/iter |
1.63 |
E2E_Compiler_cypress |
4836566.606060745 ns/iter |
3183281.00913223 ns/iter |
1.52 |
E2E_Compiler_deno |
10424961.89024416 ns/iter |
6250326.508620674 ns/iter |
1.67 |
E2E_Compiler_dependabot |
4828303.977273084 ns/iter |
3257900.3456215225 ns/iter |
1.48 |
E2E_Compiler_draft_04 |
2928811.9012347464 ns/iter |
1794426.5535714629 ns/iter |
1.63 |
E2E_Compiler_fabric_mod |
5442221.670000435 ns/iter |
3294582.4742260887 ns/iter |
1.65 |
E2E_Compiler_geojson |
36718920.80000134 ns/iter |
23465558.31428694 ns/iter |
1.56 |
E2E_Compiler_gitpod_configuration |
6902978.211009205 ns/iter |
3755855.4107144056 ns/iter |
1.84 |
E2E_Compiler_helm_chart_lock |
813673.6897621101 ns/iter |
485582.7063654856 ns/iter |
1.68 |
E2E_Compiler_importmap |
301567.3719376401 ns/iter |
186685.76996550825 ns/iter |
1.62 |
E2E_Compiler_jasmine |
1521997.6403941116 ns/iter |
957655.3236112457 ns/iter |
1.59 |
E2E_Compiler_jshintrc |
4715139.980392159 ns/iter |
2881816.115701846 ns/iter |
1.64 |
E2E_Compiler_jsconfig |
26211103.40741055 ns/iter |
17552526.43902611 ns/iter |
1.49 |
E2E_Compiler_krakend |
196589666.75001466 ns/iter |
124422525.00004542 ns/iter |
1.58 |
E2E_Compiler_lazygit |
56359877.73333302 ns/iter |
28838693.320003584 ns/iter |
1.95 |
E2E_Compiler_lerna |
2317741.4550560936 ns/iter |
1196119.3918227414 ns/iter |
1.94 |
E2E_Compiler_nest_cli |
10835187.50000015 ns/iter |
5560830.35714242 ns/iter |
1.95 |
E2E_Compiler_omc |
251519694.6666644 ns/iter |
151587466.79999238 ns/iter |
1.66 |
E2E_Compiler_omnisharp |
7619037.397435663 ns/iter |
7388000.000000282 ns/iter |
1.03 |
E2E_Compiler_openapi |
29614407.958334252 ns/iter |
21009765.79310617 ns/iter |
1.41 |
E2E_Compiler_pre_commit_hooks |
5982964.578570967 ns/iter |
3821235.661291055 ns/iter |
1.57 |
E2E_Compiler_pulumi |
4595792.916168098 ns/iter |
3243418.058578206 ns/iter |
1.42 |
E2E_Compiler_semantic_release |
1742528.3163266631 ns/iter |
1206360.8719724303 ns/iter |
1.44 |
E2E_Compiler_stale |
1853692.8586957194 ns/iter |
1113663.7633711137 ns/iter |
1.66 |
E2E_Compiler_stylecop |
7955756.3131315 ns/iter |
5266286.249998302 ns/iter |
1.51 |
E2E_Compiler_tmuxinator |
2434020.2534725266 ns/iter |
1367024.982421583 ns/iter |
1.78 |
E2E_Compiler_ui5 |
74416258.39999233 ns/iter |
46888880.53333358 ns/iter |
1.59 |
E2E_Compiler_ui5_manifest |
460089479.50002724 ns/iter |
267744235.99999866 ns/iter |
1.72 |
E2E_Compiler_unreal_engine_uproject |
6591123.242105823 ns/iter |
3330479.366666493 ns/iter |
1.98 |
E2E_Compiler_vercel |
20653562.04444571 ns/iter |
10728104.166666912 ns/iter |
1.93 |
E2E_Compiler_yamllint |
394086.60575911094 ns/iter |
261076.19670902676 ns/iter |
1.51 |
E2E_Evaluator_adaptivecard |
29835.972632213336 ns/iter |
16987.728593919768 ns/iter |
1.76 |
E2E_Evaluator_ansible_meta |
236143.32561730806 ns/iter |
148501.92219386855 ns/iter |
1.59 |
E2E_Evaluator_aws_cdk |
50358.44579999775 ns/iter |
30549.44602473738 ns/iter |
1.65 |
E2E_Evaluator_babelrc |
107227.06003210634 ns/iter |
73195.19071719791 ns/iter |
1.46 |
E2E_Evaluator_cerebrum_criminal_case |
1390869.237588588 ns/iter |
797312.3598654055 ns/iter |
1.74 |
E2E_Evaluator_clang_format |
133080.98874565167 ns/iter |
89695.2168367144 ns/iter |
1.48 |
E2E_Evaluator_cmake_presets |
4692211.584415713 ns/iter |
2831966.768595025 ns/iter |
1.66 |
E2E_Evaluator_code_climate |
193232.4273071956 ns/iter |
113162.85262660852 ns/iter |
1.71 |
E2E_Evaluator_cql2 |
219826.6030267891 ns/iter |
140761.9606003694 ns/iter |
1.56 |
E2E_Evaluator_cspell |
504718.06640617346 ns/iter |
356558.30434786336 ns/iter |
1.42 |
E2E_Evaluator_cypress |
173355.68500418006 ns/iter |
131061.78526047291 ns/iter |
1.32 |
E2E_Evaluator_deno |
403389.2175176387 ns/iter |
227393.35585842596 ns/iter |
1.77 |
E2E_Evaluator_dependabot |
402512.97858537023 ns/iter |
287284.4583669755 ns/iter |
1.40 |
E2E_Evaluator_draft_04 |
6873278.418604672 ns/iter |
4500558.329032027 ns/iter |
1.53 |
E2E_Evaluator_fabric_mod |
785671.6820460377 ns/iter |
426914.9326806197 ns/iter |
1.84 |
E2E_Evaluator_geojson |
16795426.81080961 ns/iter |
10084537.362068847 ns/iter |
1.67 |
E2E_Evaluator_gitpod_configuration |
266324.2649359835 ns/iter |
148510.1600000065 ns/iter |
1.79 |
E2E_Evaluator_helm_chart_lock |
236978.66605056328 ns/iter |
190577.9734237734 ns/iter |
1.24 |
E2E_Evaluator_importmap |
33947.92277504084 ns/iter |
27646.56151711404 ns/iter |
1.23 |
E2E_Evaluator_jasmine |
92420.90815863293 ns/iter |
73114.8937867482 ns/iter |
1.26 |
E2E_Evaluator_jshintrc |
1137774.9152045094 ns/iter |
854922.2791261236 ns/iter |
1.33 |
E2E_Evaluator_jsconfig |
358163.43430068047 ns/iter |
275074.57173453365 ns/iter |
1.30 |
E2E_Evaluator_krakend |
133435.41923576884 ns/iter |
117521.86836265166 ns/iter |
1.14 |
E2E_Evaluator_lazygit |
105994.37184116904 ns/iter |
89588.6336183842 ns/iter |
1.18 |
E2E_Evaluator_lerna |
145684.89678477927 ns/iter |
111031.90141539274 ns/iter |
1.31 |
E2E_Evaluator_nest_cli |
166482.37894501013 ns/iter |
121300.65158071405 ns/iter |
1.37 |
E2E_Evaluator_omc |
17697.49079815305 ns/iter |
12836.570965064802 ns/iter |
1.38 |
E2E_Evaluator_omnisharp |
566276.2080000902 ns/iter |
390947.5806452068 ns/iter |
1.45 |
E2E_Evaluator_openapi |
11242650.602408031 ns/iter |
7173926.123709627 ns/iter |
1.57 |
E2E_Evaluator_pre_commit_hooks |
380184.01902312675 ns/iter |
315269.01204282016 ns/iter |
1.21 |
E2E_Evaluator_pulumi |
677969.1623474543 ns/iter |
461389.18205791694 ns/iter |
1.47 |
E2E_Evaluator_semantic_release |
95820.91780821553 ns/iter |
63306.841295545586 ns/iter |
1.51 |
E2E_Evaluator_stale |
148297.10701489405 ns/iter |
100724.4692263525 ns/iter |
1.47 |
E2E_Evaluator_stylecop |
234478.53863991657 ns/iter |
170810.97487318842 ns/iter |
1.37 |
E2E_Evaluator_tmuxinator |
92219.3045221226 ns/iter |
69288.07508244007 ns/iter |
1.33 |
E2E_Evaluator_ui5 |
371218.5505188892 ns/iter |
300550.02550800703 ns/iter |
1.24 |
E2E_Evaluator_ui5_manifest |
1910809.7507331213 ns/iter |
1381836.9999999048 ns/iter |
1.38 |
E2E_Evaluator_unreal_engine_uproject |
398686.5322508257 ns/iter |
286603.59450596815 ns/iter |
1.39 |
E2E_Evaluator_vercel |
257290.67448574788 ns/iter |
206732.46575772046 ns/iter |
1.24 |
E2E_Evaluator_yamllint |
6049.176866067741 ns/iter |
5375.816881193702 ns/iter |
1.13 |
Micro_Draft4_Meta_1_No_Callback |
129.75151294024053 ns/iter |
117.05330412052473 ns/iter |
1.11 |
Micro_Draft4_Required_Properties |
652.0035799512026 ns/iter |
570.3296681077661 ns/iter |
1.14 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
16.342814744450667 ns/iter |
14.823057800571796 ns/iter |
1.10 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
7.656906608570765 ns/iter |
6.756048480801394 ns/iter |
1.13 |
Micro_Draft4_Items_Schema |
282.48268168115237 ns/iter |
235.9144494585444 ns/iter |
1.20 |
Micro_Draft4_Nested_Object |
0.7294094623469193 ns/iter |
0.6468257436783806 ns/iter |
1.13 |
Micro_Draft4_Properties_Triad_Optional |
209.111450503162 ns/iter |
185.36841955173648 ns/iter |
1.13 |
Micro_Draft4_Properties_Triad_Closed |
177.42665586288314 ns/iter |
160.0477562683447 ns/iter |
1.11 |
Micro_Draft4_Properties_Triad_Required |
230.48834056245175 ns/iter |
201.9964265887984 ns/iter |
1.14 |
Micro_Draft4_Properties_Closed |
41.09755236329041 ns/iter |
34.07758777941257 ns/iter |
1.21 |
Micro_Draft4_Non_Recursive_Ref |
13.475245098053925 ns/iter |
11.681639252203016 ns/iter |
1.15 |
Micro_Draft4_Pattern_Properties_True |
145.5691260755246 ns/iter |
134.89160827542088 ns/iter |
1.08 |
Micro_Draft4_Ref_To_Single_Property |
7.47229428974611 ns/iter |
6.491707460123847 ns/iter |
1.15 |
Micro_Draft4_Additional_Properties_Type |
28.998737600949692 ns/iter |
23.784377668685778 ns/iter |
1.22 |
Micro_Draft4_Nested_Oneof |
43.37186569699719 ns/iter |
37.39127683248712 ns/iter |
1.16 |
Micro_Draft4_Short_Enum |
5.261132239867264 ns/iter |
4.483616110800908 ns/iter |
1.17 |
Micro_Draft4_Long_Enum |
12.432654652092376 ns/iter |
9.449187991303459 ns/iter |
1.32 |
Micro_Draft4_Long_Enum_Short_Strings |
7.460900145995461 ns/iter |
5.6854983985013 ns/iter |
1.31 |
Micro_Draft4_Type_Object |
2.5154844669732235 ns/iter |
1.9998578580001531 ns/iter |
1.26 |
Micro_Draft4_Ref_Single_100 |
2065702.7439025978 ns/iter |
1732971.0198021412 ns/iter |
1.19 |
Micro_Draft4_Compile_Ref_Many_Nested |
1574574.3346303564 ns/iter |
1175871.7818532495 ns/iter |
1.34 |
Micro_Draft4_Compile_Wrap |
2761291.5095785214 ns/iter |
1818928.929687639 ns/iter |
1.52 |
Micro_Draft6_Property_Names |
113.38031430766118 ns/iter |
87.50115761084783 ns/iter |
1.30 |
Micro_Draft6_Compile_FHIR |
12909819083.999992 ns/iter |
6858630416.000096 ns/iter |
1.88 |
Micro_Draft7_If_Then_Else |
18.44138981834348 ns/iter |
18.94341062410659 ns/iter |
0.97 |
Micro_2019_09_Unevaluated_Properties |
27.347740197427175 ns/iter |
26.07085638606516 ns/iter |
1.05 |
Micro_2019_09_Compile_Wrap |
341120958.00003314 ns/iter |
302232645.9999931 ns/iter |
1.13 |
Micro_2020_12_Dynamic_Ref |
198.95267328842505 ns/iter |
169.81872584127748 ns/iter |
1.17 |
Micro_2020_12_Dynamic_Ref_Single |
2.238894020903844 ns/iter |
2.0016110800689417 ns/iter |
1.12 |
Micro_2020_12_Simple_Output_Mask |
66788.13671974844 ns/iter |
56870.465203571126 ns/iter |
1.17 |
Micro_2020_12_Simple_Output_Annotations |
91784.25065010703 ns/iter |
79266.87215685302 ns/iter |
1.16 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
939127.9227110253 ns/iter |
740462.5407164765 ns/iter |
1.27 |
Micro_2020_12_Exhaustive_Deep_Numeric |
5480.289730937198 ns/iter |
4862.299325510834 ns/iter |
1.13 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
128863.13394017617 ns/iter |
108722.14162377121 ns/iter |
1.19 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
15623.571174212178 ns/iter |
13399.67964727741 ns/iter |
1.17 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
106.70939864836431 ns/iter |
85.98584130008605 ns/iter |
1.24 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
5089.592919998722 ns/iter |
4840.449175392619 ns/iter |
1.05 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
279165152.6666404 ns/iter |
224553528.0000392 ns/iter |
1.24 |
Alterschema_Check_Readibility_OMC |
79392384.22222337 ns/iter |
51729461.28571506 ns/iter |
1.53 |
Alterschema_Check_Readibility_KrakenD |
776501833.9998733 ns/iter |
547776417.0000228 ns/iter |
1.42 |
Alterschema_Apply_Readibility_KrakenD |
10279500249.999956 ns/iter |
7488307041.000325 ns/iter |
1.37 |
Alterschema_Check_Invalid_External_Refs |
178061208.50002572 ns/iter |
165519600.000016 ns/iter |
1.08 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: d39b8b7 | Previous: 9e80b70 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
105246 ns |
83463 ns |
1.26 |
E2E_Evaluator_ansible-meta |
558013 ns |
382963 ns |
1.46 |
E2E_Evaluator_aws-cdk |
144489 ns |
120875 ns |
1.20 |
E2E_Evaluator_babelrc |
427984 ns |
320694 ns |
1.33 |
E2E_Evaluator_cerebrum-criminal-case |
2362237 ns |
1897840 ns |
1.24 |
E2E_Evaluator_clang-format |
305923 ns |
212093 ns |
1.44 |
E2E_Evaluator_cmake-presets |
17257241 ns |
12865480 ns |
1.34 |
E2E_Evaluator_code-climate |
465605 ns |
347363 ns |
1.34 |
E2E_Evaluator_cql2 |
1084931 ns |
839063 ns |
1.29 |
E2E_Evaluator_cspell |
1890820 ns |
1196739 ns |
1.58 |
E2E_Evaluator_cypress |
922575 ns |
735338 ns |
1.25 |
E2E_Evaluator_deno |
1116223 ns |
726613 ns |
1.54 |
E2E_Evaluator_dependabot |
1184417 ns |
812227 ns |
1.46 |
E2E_Evaluator_draft-04 |
18552218 ns |
14853216 ns |
1.25 |
E2E_Evaluator_fabric-mod |
2281720 ns |
1673722 ns |
1.36 |
E2E_Evaluator_geojson |
26452534 ns |
20768606 ns |
1.27 |
E2E_Evaluator_gitpod-configuration |
830159 ns |
595350 ns |
1.39 |
E2E_Evaluator_helm-chart-lock |
1173274 ns |
1176651 ns |
1.00 |
E2E_Evaluator_importmap |
334917 ns |
215741 ns |
1.55 |
E2E_Evaluator_jasmine |
366751 ns |
254844 ns |
1.44 |
E2E_Evaluator_jsconfig |
1633258 ns |
1475061 ns |
1.11 |
E2E_Evaluator_jshintrc |
3178950 ns |
2387456 ns |
1.33 |
E2E_Evaluator_krakend |
608118 ns |
448458 ns |
1.36 |
E2E_Evaluator_lazygit |
752886 ns |
325976 ns |
2.31 |
E2E_Evaluator_lerna |
479542 ns |
391911 ns |
1.22 |
E2E_Evaluator_nest-cli |
761284 ns |
529566 ns |
1.44 |
E2E_Evaluator_omc |
85625 ns |
65725 ns |
1.30 |
E2E_Evaluator_omnisharp |
1556578 ns |
1285465 ns |
1.21 |
E2E_Evaluator_openapi |
30131304 ns |
23099426 ns |
1.30 |
E2E_Evaluator_pre-commit-hooks |
1984620 ns |
1520619 ns |
1.31 |
E2E_Evaluator_pulumi |
2127970 ns |
1709936 ns |
1.24 |
E2E_Evaluator_semantic-release |
291167 ns |
224953 ns |
1.29 |
E2E_Evaluator_stale |
469388 ns |
351263 ns |
1.34 |
E2E_Evaluator_stylecop |
1064717 ns |
796071 ns |
1.34 |
E2E_Evaluator_tmuxinator |
268396 ns |
215309 ns |
1.25 |
E2E_Evaluator_ui5 |
1857925 ns |
1451861 ns |
1.28 |
E2E_Evaluator_ui5-manifest |
9738520 ns |
7501065 ns |
1.30 |
E2E_Evaluator_unreal-engine-uproject |
1650316 ns |
1350596 ns |
1.22 |
E2E_Evaluator_vercel |
1105707 ns |
824085 ns |
1.34 |
E2E_Evaluator_yamllint |
32119 ns |
29167 ns |
1.10 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: d39b8b7 | Previous: 9e80b70 | Ratio |
|---|---|---|---|
Alterschema_Check_Readibility_ISO_Language_Set_3 |
366398875.0000158 ns/iter |
340170047.5000098 ns/iter |
1.08 |
Alterschema_Check_Readibility_OMC |
102125126.28571144 ns/iter |
94349610.99998417 ns/iter |
1.08 |
Alterschema_Check_Readibility_KrakenD |
1509219710.0000248 ns/iter |
1313013928.0000322 ns/iter |
1.15 |
Alterschema_Apply_Readibility_KrakenD |
19845000058.999973 ns/iter |
16528559867.999887 ns/iter |
1.20 |
Alterschema_Check_Invalid_External_Refs |
322651726.0000037 ns/iter |
326613337.499964 ns/iter |
0.99 |
Micro_2020_12_Dynamic_Ref |
260.15701723082054 ns/iter |
261.284791970358 ns/iter |
1.00 |
Micro_2020_12_Dynamic_Ref_Single |
4.5966062002022445 ns/iter |
5.145849920870295 ns/iter |
0.89 |
Micro_2020_12_Simple_Output_Mask |
72041.82516123196 ns/iter |
72406.4931550116 ns/iter |
0.99 |
Micro_2020_12_Simple_Output_Annotations |
103646.37989073375 ns/iter |
112296.92854821935 ns/iter |
0.92 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
1217150.862847226 ns/iter |
1191946.1908005213 ns/iter |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric |
7964.821879398509 ns/iter |
8406.075263887158 ns/iter |
0.95 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
169922.5896501305 ns/iter |
164660.5409836096 ns/iter |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
26842.00698811923 ns/iter |
25092.90425113144 ns/iter |
1.07 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
132.4189254823946 ns/iter |
131.3761089901394 ns/iter |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
4484.210106262363 ns/iter |
4681.724279065239 ns/iter |
0.96 |
Micro_2019_09_Unevaluated_Properties |
28.97995309062012 ns/iter |
28.683659248911997 ns/iter |
1.01 |
Micro_2019_09_Compile_Wrap |
337943725.0000024 ns/iter |
303044207.00002766 ns/iter |
1.12 |
Micro_Draft7_If_Then_Else |
25.12958466052905 ns/iter |
25.150241875825902 ns/iter |
1.00 |
Micro_Draft6_Property_Names |
143.12581530489732 ns/iter |
164.73766669176007 ns/iter |
0.87 |
Micro_Draft6_Compile_FHIR |
16426274958.999897 ns/iter |
14004326587.000036 ns/iter |
1.17 |
Micro_Draft4_Meta_1_No_Callback |
182.66749695383575 ns/iter |
167.3410897009287 ns/iter |
1.09 |
Micro_Draft4_Required_Properties |
799.1140980945063 ns/iter |
813.1901959551525 ns/iter |
0.98 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
21.075889956813445 ns/iter |
21.200826989347053 ns/iter |
0.99 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
13.020240568897568 ns/iter |
12.787406895602706 ns/iter |
1.02 |
Micro_Draft4_Items_Schema |
315.6871484644782 ns/iter |
323.9804023496672 ns/iter |
0.97 |
Micro_Draft4_Nested_Object |
2.1111821666480894 ns/iter |
2.1827747884636866 ns/iter |
0.97 |
Micro_Draft4_Properties_Triad_Optional |
431.33916165967895 ns/iter |
364.14734022475335 ns/iter |
1.18 |
Micro_Draft4_Properties_Triad_Closed |
357.06214090238916 ns/iter |
294.9678089400547 ns/iter |
1.21 |
Micro_Draft4_Properties_Triad_Required |
449.71093508837384 ns/iter |
405.917187430226 ns/iter |
1.11 |
Micro_Draft4_Properties_Closed |
62.22275980599688 ns/iter |
60.80760965982131 ns/iter |
1.02 |
Micro_Draft4_Non_Recursive_Ref |
8.820441339353094 ns/iter |
9.962630652687055 ns/iter |
0.89 |
Micro_Draft4_Pattern_Properties_True |
210.0661181324724 ns/iter |
215.40539919462327 ns/iter |
0.98 |
Micro_Draft4_Ref_To_Single_Property |
12.705488510101636 ns/iter |
13.435768756689804 ns/iter |
0.95 |
Micro_Draft4_Additional_Properties_Type |
14.916267101604854 ns/iter |
14.632258351578173 ns/iter |
1.02 |
Micro_Draft4_Nested_Oneof |
65.84143459258863 ns/iter |
67.57324750920246 ns/iter |
0.97 |
Micro_Draft4_Short_Enum |
14.769868672903497 ns/iter |
14.70117878938366 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
14.082603577190524 ns/iter |
14.110704510113424 ns/iter |
1.00 |
Micro_Draft4_Long_Enum_Short_Strings |
14.787933176417525 ns/iter |
14.67070162677298 ns/iter |
1.01 |
Micro_Draft4_Type_Object |
4.5747035515249035 ns/iter |
4.665024144372892 ns/iter |
0.98 |
Micro_Draft4_Ref_Single_100 |
2551961.5036232346 ns/iter |
2486547.8362990217 ns/iter |
1.03 |
Micro_Draft4_Compile_Ref_Many_Nested |
1871403.7139039051 ns/iter |
1806277.7429305385 ns/iter |
1.04 |
Micro_Draft4_Compile_Wrap |
2672530.475285882 ns/iter |
2561145.341912031 ns/iter |
1.04 |
E2E_Compiler_adaptivecard |
72817248.22221096 ns/iter |
66130912.79999708 ns/iter |
1.10 |
E2E_Compiler_ansible_meta |
32500482.227274835 ns/iter |
29962031.217391796 ns/iter |
1.08 |
E2E_Compiler_aws_cdk |
407951.273204984 ns/iter |
409890.4459380213 ns/iter |
1.00 |
E2E_Compiler_babelrc |
2874238.757201351 ns/iter |
2889970.815686313 ns/iter |
0.99 |
E2E_Compiler_clang_format |
20553342.352941934 ns/iter |
19488664.63888837 ns/iter |
1.05 |
E2E_Compiler_cmake_presets |
28682128.28000651 ns/iter |
26915368.153844647 ns/iter |
1.07 |
E2E_Compiler_code_climate |
2903685.7250000974 ns/iter |
2765183.762845722 ns/iter |
1.05 |
E2E_Compiler_cql2 |
14402484.510202734 ns/iter |
13966368.400001558 ns/iter |
1.03 |
E2E_Compiler_cspell |
25212412.571428496 ns/iter |
23809004.62068878 ns/iter |
1.06 |
E2E_Compiler_cypress |
4314783.296296001 ns/iter |
4096680.6823529196 ns/iter |
1.05 |
E2E_Compiler_deno |
8555211.691356346 ns/iter |
8097232.896551728 ns/iter |
1.06 |
E2E_Compiler_dependabot |
4443721.088049722 ns/iter |
4129103.6941181445 ns/iter |
1.08 |
E2E_Compiler_draft_04 |
2999949.2094014925 ns/iter |
2909717.000000331 ns/iter |
1.03 |
E2E_Compiler_fabric_mod |
5298193.323308015 ns/iter |
5076264.079709778 ns/iter |
1.04 |
E2E_Compiler_geojson |
25345382.07407456 ns/iter |
23566234.433330163 ns/iter |
1.08 |
E2E_Compiler_gitpod_configuration |
5468575.6640626695 ns/iter |
5219449.644445612 ns/iter |
1.05 |
E2E_Compiler_helm_chart_lock |
746131.5893617715 ns/iter |
740626.049840904 ns/iter |
1.01 |
E2E_Compiler_importmap |
310966.9415700132 ns/iter |
306869.88178630423 ns/iter |
1.01 |
E2E_Compiler_jasmine |
1504620.2267820274 ns/iter |
1455296.394190864 ns/iter |
1.03 |
E2E_Compiler_jshintrc |
4838752.434482652 ns/iter |
4747062.373332179 ns/iter |
1.02 |
E2E_Compiler_jsconfig |
24529714.51724148 ns/iter |
23122948.599999897 ns/iter |
1.06 |
E2E_Compiler_krakend |
151942444.60003573 ns/iter |
146318862.4000395 ns/iter |
1.04 |
E2E_Compiler_lazygit |
37714354.94444278 ns/iter |
35134761.250003524 ns/iter |
1.07 |
E2E_Compiler_lerna |
1792202.99492333 ns/iter |
1725849.6284284773 ns/iter |
1.04 |
E2E_Compiler_nest_cli |
8402087.939758936 ns/iter |
7891612.179775436 ns/iter |
1.06 |
E2E_Compiler_omc |
180551962.25003555 ns/iter |
165669735.50004604 ns/iter |
1.09 |
E2E_Compiler_omnisharp |
7511973.913979482 ns/iter |
7084652.666667399 ns/iter |
1.06 |
E2E_Compiler_openapi |
28098414.440000854 ns/iter |
26679245.961540453 ns/iter |
1.05 |
E2E_Compiler_pre_commit_hooks |
5983276.568966191 ns/iter |
5621422.919353614 ns/iter |
1.06 |
E2E_Compiler_pulumi |
4548585.519480432 ns/iter |
4316289.956790693 ns/iter |
1.05 |
E2E_Compiler_semantic_release |
1750778.5563911123 ns/iter |
1677185.7122304665 ns/iter |
1.04 |
E2E_Compiler_stale |
1724856.9828009703 ns/iter |
1653407.6752941473 ns/iter |
1.04 |
E2E_Compiler_stylecop |
6712624.771428939 ns/iter |
6229670.017857204 ns/iter |
1.08 |
E2E_Compiler_tmuxinator |
2159266.3907694467 ns/iter |
2075590.9554895947 ns/iter |
1.04 |
E2E_Compiler_ui5 |
54576600.84614592 ns/iter |
48936071.14286169 ns/iter |
1.12 |
E2E_Compiler_ui5_manifest |
353517850.4999976 ns/iter |
325344698.9999702 ns/iter |
1.09 |
E2E_Compiler_unreal_engine_uproject |
5139354.262772787 ns/iter |
4887832.669013938 ns/iter |
1.05 |
E2E_Compiler_vercel |
13836797.333334628 ns/iter |
13083020.833332907 ns/iter |
1.06 |
E2E_Compiler_yamllint |
377682.8108544765 ns/iter |
374687.0951612368 ns/iter |
1.01 |
E2E_Evaluator_adaptivecard |
24375.340687131156 ns/iter |
22949.548876109187 ns/iter |
1.06 |
E2E_Evaluator_ansible_meta |
239003.95357508442 ns/iter |
248743.00323626088 ns/iter |
0.96 |
E2E_Evaluator_aws_cdk |
44286.01207396062 ns/iter |
51282.35426236738 ns/iter |
0.86 |
E2E_Evaluator_babelrc |
85390.46416797301 ns/iter |
104022.79180592916 ns/iter |
0.82 |
E2E_Evaluator_cerebrum_criminal_case |
1346429.9999998985 ns/iter |
1265610.473684565 ns/iter |
1.06 |
E2E_Evaluator_clang_format |
102123.45334302432 ns/iter |
104628.73239011482 ns/iter |
0.98 |
E2E_Evaluator_cmake_presets |
5516454.592919467 ns/iter |
4637289.05921064 ns/iter |
1.19 |
E2E_Evaluator_code_climate |
163337.49777463527 ns/iter |
185612.1972609886 ns/iter |
0.88 |
E2E_Evaluator_cql2 |
210005.13022558068 ns/iter |
218070.98347881774 ns/iter |
0.96 |
E2E_Evaluator_cspell |
516776.77187744126 ns/iter |
527442.7868480773 ns/iter |
0.98 |
E2E_Evaluator_cypress |
143943.4401983238 ns/iter |
170088.83325281597 ns/iter |
0.85 |
E2E_Evaluator_deno |
275137.53609049466 ns/iter |
327640.98931715684 ns/iter |
0.84 |
E2E_Evaluator_dependabot |
460097.0632996317 ns/iter |
456756.6275544068 ns/iter |
1.01 |
E2E_Evaluator_draft_04 |
8654572.045452885 ns/iter |
7665468.459770468 ns/iter |
1.13 |
E2E_Evaluator_fabric_mod |
712537.7642855525 ns/iter |
724861.0073298807 ns/iter |
0.98 |
E2E_Evaluator_geojson |
17947201.874994792 ns/iter |
16250285.767444776 ns/iter |
1.10 |
E2E_Evaluator_gitpod_configuration |
221856.2514195577 ns/iter |
250048.60021286146 ns/iter |
0.89 |
E2E_Evaluator_helm_chart_lock |
216909.02652932086 ns/iter |
318259.34319529496 ns/iter |
0.68 |
E2E_Evaluator_importmap |
41461.51777882635 ns/iter |
48015.61808797253 ns/iter |
0.86 |
E2E_Evaluator_jasmine |
101731.57777776849 ns/iter |
115352.26764864163 ns/iter |
0.88 |
E2E_Evaluator_jshintrc |
1014877.7394466164 ns/iter |
1023271.6302766178 ns/iter |
0.99 |
E2E_Evaluator_jsconfig |
373629.6555379276 ns/iter |
398623.7868106102 ns/iter |
0.94 |
E2E_Evaluator_krakend |
185082.14278119997 ns/iter |
206020.19913542236 ns/iter |
0.90 |
E2E_Evaluator_lazygit |
121501.36699335916 ns/iter |
132272.559315494 ns/iter |
0.92 |
E2E_Evaluator_lerna |
122126.4864577866 ns/iter |
150980.1784322425 ns/iter |
0.81 |
E2E_Evaluator_nest_cli |
177252.57978725672 ns/iter |
192993.83062516592 ns/iter |
0.92 |
E2E_Evaluator_omc |
19265.298308295605 ns/iter |
18808.236288059546 ns/iter |
1.02 |
E2E_Evaluator_omnisharp |
535633.0940630743 ns/iter |
545102.8644201057 ns/iter |
0.98 |
E2E_Evaluator_openapi |
16802182.634148445 ns/iter |
12940974.313724997 ns/iter |
1.30 |
E2E_Evaluator_pre_commit_hooks |
473240.6178862179 ns/iter |
510514.5626843548 ns/iter |
0.93 |
E2E_Evaluator_pulumi |
731632.634819495 ns/iter |
712435.5035823766 ns/iter |
1.03 |
E2E_Evaluator_semantic_release |
86633.21630513782 ns/iter |
100165.0460470467 ns/iter |
0.86 |
E2E_Evaluator_stale |
151665.1430114895 ns/iter |
153895.64881854833 ns/iter |
0.99 |
E2E_Evaluator_stylecop |
285605.8310615711 ns/iter |
293292.4368931965 ns/iter |
0.97 |
E2E_Evaluator_tmuxinator |
87326.3366065714 ns/iter |
98981.27876599212 ns/iter |
0.88 |
E2E_Evaluator_ui5 |
502100.6308138857 ns/iter |
525569.2291045117 ns/iter |
0.96 |
E2E_Evaluator_ui5_manifest |
2663542.8674239847 ns/iter |
2630176.7660371764 ns/iter |
1.01 |
E2E_Evaluator_unreal_engine_uproject |
433198.9049773357 ns/iter |
454291.5671162756 ns/iter |
0.95 |
E2E_Evaluator_vercel |
265601.32524083165 ns/iter |
309824.064171143 ns/iter |
0.86 |
E2E_Evaluator_yamllint |
9855.553683624392 ns/iter |
10322.008855702812 ns/iter |
0.95 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: d39b8b7 | Previous: 9e80b70 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
119272 ns |
116667 ns |
1.02 |
E2E_Evaluator_ansible-meta |
628360 ns |
572454 ns |
1.10 |
E2E_Evaluator_aws-cdk |
136121 ns |
133820 ns |
1.02 |
E2E_Evaluator_babelrc |
335070 ns |
320571 ns |
1.05 |
E2E_Evaluator_cerebrum-criminal-case |
3251388 ns |
2667997 ns |
1.22 |
E2E_Evaluator_clang-format |
309118 ns |
274236 ns |
1.13 |
E2E_Evaluator_cmake-presets |
22582058 ns |
18725862 ns |
1.21 |
E2E_Evaluator_code-climate |
447535 ns |
434082 ns |
1.03 |
E2E_Evaluator_cql2 |
1203106 ns |
1205275 ns |
1.00 |
E2E_Evaluator_cspell |
1850307 ns |
1551492 ns |
1.19 |
E2E_Evaluator_cypress |
1012562 ns |
852748 ns |
1.19 |
E2E_Evaluator_deno |
1213078 ns |
1097123 ns |
1.11 |
E2E_Evaluator_dependabot |
1183665 ns |
1102617 ns |
1.07 |
E2E_Evaluator_draft-04 |
25051120 ns |
20200282 ns |
1.24 |
E2E_Evaluator_fabric-mod |
2956265 ns |
2485733 ns |
1.19 |
E2E_Evaluator_geojson |
23281972 ns |
22700655 ns |
1.03 |
E2E_Evaluator_gitpod-configuration |
869341 ns |
769659 ns |
1.13 |
E2E_Evaluator_helm-chart-lock |
1047805 ns |
1002551 ns |
1.05 |
E2E_Evaluator_importmap |
285851 ns |
290349 ns |
0.98 |
E2E_Evaluator_jasmine |
304438 ns |
304740 ns |
1.00 |
E2E_Evaluator_jsconfig |
1528383 ns |
1328906 ns |
1.15 |
E2E_Evaluator_jshintrc |
3408636 ns |
3139377 ns |
1.09 |
E2E_Evaluator_krakend |
713882 ns |
798144 ns |
0.89 |
E2E_Evaluator_lazygit |
491168 ns |
564921 ns |
0.87 |
E2E_Evaluator_lerna |
452312 ns |
469841 ns |
0.96 |
E2E_Evaluator_nest-cli |
655050 ns |
642117 ns |
1.02 |
E2E_Evaluator_omc |
87102 ns |
87306 ns |
1.00 |
E2E_Evaluator_omnisharp |
1731648 ns |
1590237 ns |
1.09 |
E2E_Evaluator_openapi |
37381497 ns |
35734927 ns |
1.05 |
E2E_Evaluator_pre-commit-hooks |
2089755 ns |
1960645 ns |
1.07 |
E2E_Evaluator_pulumi |
2211338 ns |
1966406 ns |
1.12 |
E2E_Evaluator_semantic-release |
243838 ns |
265210 ns |
0.92 |
E2E_Evaluator_stale |
442458 ns |
436661 ns |
1.01 |
E2E_Evaluator_stylecop |
1243182 ns |
1204085 ns |
1.03 |
E2E_Evaluator_tmuxinator |
239045 ns |
228941 ns |
1.04 |
E2E_Evaluator_ui5 |
2250507 ns |
2250585 ns |
1.00 |
E2E_Evaluator_ui5-manifest |
10225680 ns |
11098173 ns |
0.92 |
E2E_Evaluator_unreal-engine-uproject |
1698299 ns |
1497125 ns |
1.13 |
E2E_Evaluator_vercel |
1125533 ns |
1059041 ns |
1.06 |
E2E_Evaluator_yamllint |
25281 ns |
24728 ns |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com