Skip to content

Benchmark drift on master #395

Open
Open

Description

@github-actions

Counts on master grew by more than 3% between 65f7a31 and d2a4838 (10 recorded merges; latest: Merge pull request #390 from jinja2cpp/claude/project-thread-w7wy7z).

Benchmark Metric Before Now Change
Load/dict_ops instructions 79,389 81,867 +3.12%

Commits in the window: 6e82ae9, a24f887, 098d156, 29c6c73, cf927ef, b7eacec, b31499d, f081f25, 5a42640, d2a4838.

A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

Activity

  1. github-actions commented on Oct 5, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between b7eacec and 698f881 (10 recorded merges; latest: Merge pull request #400 from jinja2cpp/claude/project-thread-sfzfdx).

    Benchmark Metric Before Now Change
    Render/large_static instructions 30,994 32,106 +3.59%

    Commits in the window: b31499d, f081f25, 5a42640, d2a4838, bfbc174, 579b378, 580fcbf, 35200ad, 150a5e0, 698f881.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  2. github-actions commented on Oct 5, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between f081f25 and c2b626f (10 recorded merges; latest: Merge pull request #401 from jinja2cpp/claude/project-thread-5x85qg).

    Benchmark Metric Before Now Change
    Render/plain_text instructions 2,656 2,746 +3.39%

    Commits in the window: 5a42640, d2a4838, bfbc174, 579b378, 580fcbf, 35200ad, 150a5e0, 698f881, f3af5dc, c2b626f.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  3. github-actions commented on Oct 6, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between f3af5dc and c05ee13 (10 recorded merges; latest: Merge pull request #414 from jinja2cpp/claude/project-thread-fkqkk8).

    Benchmark Metric Before Now Change
    Load/strings allocations 102 106 +3.92%

    Commits in the window: c2b626f, c66ee9a, 52d4543, 60febdc, 1906439, 448bb7c, 449e8c6, 8bd9d1f, 04c111d, c05ee13.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  4. github-actions commented on Oct 6, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 60febdc and 260ab16 (10 recorded merges; latest: Merge pull request #418 from jinja2cpp/claude/project-thread-tsheuk).

    Benchmark Metric Before Now Change
    Load/many_tags allocations 9,658 10,238 +6.01%

    Commits in the window: 1906439, 448bb7c, 449e8c6, 8bd9d1f, 04c111d, c05ee13, b23c319, 0990e3a, a9ef179, 260ab16.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  5. github-actions commented on Oct 7, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between a9ef179 and 16f3f3b (10 recorded merges; latest: Merge pull request #432 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).

    Benchmark Metric Before Now Change
    Load/plain_text instructions 4,275 4,572 +6.94%

    Commits in the window: 260ab16, 85fd9a2, 0892811, 9736456, 20bd8ae, 1ad80c3, d47d436, 8a2018d, d333c43, 16f3f3b.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  6. github-actions commented on Oct 7, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 260ab16 and 3cc8e7d (10 recorded merges; latest: Merge pull request #433 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).

    Benchmark Metric Before Now Change
    Load/dict_ops instructions 52,090 54,169 +3.99%
    Load/for_filter_if instructions 42,557 44,417 +4.37%
    Load/for_range instructions 20,691 21,787 +5.29%
    Load/substitute instructions 11,312 11,656 +3.04%

    Commits in the window: 85fd9a2, 0892811, 9736456, 20bd8ae, 1ad80c3, d47d436, 8a2018d, d333c43, 16f3f3b, 3cc8e7d.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  7. github-actions commented on Oct 8, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 85fd9a2 and 5a037d0 (10 recorded merges; latest: Merge pull request #434 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).

    Benchmark Metric Before Now Change
    Render/inheritance instructions 202,716 213,313 +5.23%

    Commits in the window: 0892811, 9736456, 20bd8ae, 1ad80c3, d47d436, 8a2018d, d333c43, 16f3f3b, 3cc8e7d, 5a037d0.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  8. github-actions commented on Oct 8, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 20bd8ae and f3cc856 (10 recorded merges; latest: Merge pull request #437 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).

    Benchmark Metric Before Now Change
    Load/chat_llama instructions 528,078 581,664 +10.15%
    Load/chat_mistral instructions 600,488 682,751 +13.70%
    Load/chat_qwen instructions 387,534 436,328 +12.59%
    Load/config_file instructions 130,357 150,366 +15.35%
    Load/expressions instructions 61,615 71,640 +16.27%
    Load/filters instructions 92,341 99,605 +7.87%
    Load/for_loop_vars instructions 49,970 58,440 +16.95%
    Load/html_autoescape instructions 254,838 297,191 +16.62%
    Load/inheritance instructions 33,992 36,146 +6.33%
    Load/large_static instructions 218,623 240,857 +10.17%
    Load/macros instructions 72,844 83,845 +15.10%
    Load/many_tags instructions 12,045,926 13,741,982 +14.08%
    Load/mitsuhiko_table instructions 74,437 83,519 +12.20%
    Load/mitsuhiko_table_wide instructions 93,936 102,897 +9.54%
    Load/strings instructions 95,574 107,570 +12.55%
    Load/substitute instructions 10,226 10,952 +7.10%

    Commits in the window: 1ad80c3, d47d436, 8a2018d, d333c43, 16f3f3b, 3cc8e7d, 5a037d0, 6039634, 425822a, f3cc856.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  9. github-actions commented on Oct 8, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 1ad80c3 and 6388fc9 (10 recorded merges; latest: Merge pull request #439 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).

    Benchmark Metric Before Now Change
    Render/large_static instructions 26,629 27,520 +3.35%

    Commits in the window: d47d436, 8a2018d, d333c43, 16f3f3b, 3cc8e7d, 5a037d0, 6039634, 425822a, f3cc856, 6388fc9.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  10. github-actions commented on Oct 10, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between f3cc856 and 08bce40 (10 recorded merges; latest: robin_hood allocates through operator new, so the bench counts its blocks (0154 part A) (#454)).

    Benchmark Metric Before Now Change
    Render/inheritance allocations 76 81 +6.58%
    Render/many_tags allocations 2 15 +650.00%

    Commits in the window: 6388fc9, d509a09, 50dec81, 1734c9b, 0b1bf2f, 2486c22, ec9e7b4, 0aa521d, 2a844f9, 08bce40.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  11. github-actions commented on Oct 11, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 2a844f9 and ce547f1 (10 recorded merges; latest: docs/tasks/0151: P2 allocation counts as its targets).

    Benchmark Metric Before Now Change
    Render/chat_llama allocations 348 421 +20.98%
    Render/chat_mistral allocations 426 491 +15.26%
    Render/chat_qwen allocations 337 395 +17.21%
    Render/config_file allocations 1,169 1,281 +9.58%
    Render/filters allocations 35 51 +45.71%
    Render/html_autoescape allocations 1,003 1,094 +9.07%
    Render/strings allocations 975 1,285 +31.79%

    Commits in the window: 08bce40, 5219f69, 0ae6057, 84f2ea0, 523d59e, 66c143e, 2fc6371, 6471f17, 89aa3b7, ce547f1.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  12. github-actions commented on Oct 13, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 8f13350 and f4e312c (10 recorded merges; latest: Train 8: #501 #503 #504 #505 #506 #507 (#510)).

    Benchmark Metric Before Now Change
    Render/chat_mistral allocations 360 450 +25.00%
    Render/chat_mistral instructions 496,908 514,959 +3.63%

    Commits in the window: c37bbf5, 51a0cdd, 0dd90bb, 663b393, 5806e40, dff716f, d7418e5, dd9dd3d, 4cbbb8e, f4e312c.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  13. github-actions commented on Oct 16, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between dd9dd3d and f03e435 (10 recorded merges; latest: Merge pull request #523 from jinja2cpp/claude/project-thread-h25y5r).

    Benchmark Metric Before Now Change
    Render/expressions instructions 445,924 460,560 +3.28%

    Commits in the window: 4cbbb8e, f4e312c, a6e9573, a69c07b, 13a4720, 2b63d2d, 2c45ff2, 72e7e8e, e28e3d8, f03e435.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  14. github-actions commented on Oct 16, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between a6e9573 and bde921f (10 recorded merges; latest: Merge pull request #533 from jinja2cpp/claude/project-thread-53pwid).

    Benchmark Metric Before Now Change
    Load/chat_llama allocations 59 64 +8.47%
    Load/config_file allocations 27 30 +11.11%
    Load/large_static allocations 18 21 +16.67%

    Commits in the window: a69c07b, 13a4720, 2b63d2d, 2c45ff2, 72e7e8e, e28e3d8, f03e435, e9c839b, 84a70a4, bde921f.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  15. github-actions commented on Oct 16, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between a69c07b and f11b3d2 (10 recorded merges; latest: Merge pull request #534 from jinja2cpp/claude/project-thread-53pwid).

    Benchmark Metric Before Now Change
    Load/inheritance instructions 23,281 24,017 +3.16%
    Load/plain_text instructions 3,695 3,842 +3.98%

    Commits in the window: 13a4720, 2b63d2d, 2c45ff2, 72e7e8e, e28e3d8, f03e435, e9c839b, 84a70a4, bde921f, f11b3d2.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  16. github-actions commented on Oct 17, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between bde921f and 66b9096 (10 recorded merges; latest: Merge pull request #558 from jinja2cpp/claude/project-thread-53pwid).

    Benchmark Metric Before Now Change
    Render/strings instructions 602,013 621,472 +3.23%

    Commits in the window: f11b3d2, 364e749, 65b7194, 7f4b20b, 45f79af, 4f4e1ab, 35553a1, 498c671, 21f311d, 66b9096.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  17. github-actions commented on Oct 18, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between f11b3d2 and 9ec94e3 (10 recorded merges; latest: Merge pull request #559 from jinja2cpp/claude/project-thread-53pwid).

    Benchmark Metric Before Now Change
    Render/inheritance instructions 131,084 136,476 +4.11%
    Render/plain_text instructions 1,000 1,030 +3.00%

    Commits in the window: 364e749, 65b7194, 7f4b20b, 45f79af, 4f4e1ab, 35553a1, 498c671, 21f311d, 66b9096, 9ec94e3.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  18. github-actions commented on Oct 19, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 35553a1 and 3985100 (10 recorded merges; latest: Merge train 25: header layout, autoescape selector, Markup and parity fixes (#598)).

    Benchmark Metric Before Now Change
    Render/plain_text instructions 1,016 1,051 +3.47%

    Commits in the window: 498c671, 21f311d, 66b9096, 9ec94e3, e69c8ad, db4d96c, 7c838c0, 523f7ab, f0bb0cf, 3985100.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  19. github-actions commented on Oct 19, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 66b9096 and 8030f97 (10 recorded merges; latest: Merge pull request #606 from jinja2cpp/claude/project-thread-53pwid).

    Benchmark Metric Before Now Change
    Load/inheritance instructions 23,301 24,072 +3.31%

    Commits in the window: 9ec94e3, e69c8ad, db4d96c, 7c838c0, 523f7ab, f0bb0cf, 3985100, 941c91c, 9cf8586, 8030f97.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

  20. github-actions commented on Oct 19, 2026

    @github-actions
    Author

    Counts on master grew by more than 3% between 9ec94e3 and 5fe00b9 (10 recorded merges; latest: Merge pull request #610 from jinja2cpp/claude/project-thread-53pwid).

    Benchmark Metric Before Now Change
    Load/plain_text instructions 3,720 3,844 +3.33%

    Commits in the window: e69c8ad, db4d96c, 7c838c0, 523f7ab, f0bb0cf, 3985100, 941c91c, 9cf8586, 8030f97, 5fe00b9.

    A benchmark case that was edited in the window also shows here; check git log bench/cases before bisecting. Charts: the bench-data branch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions