chore(deps): bump tornado from 6.5.4 to 6.5.5#353
Open
dependabot[bot] wants to merge 1 commit into
Open
Conversation
dependabot
Bot
added
dependencies
dependabot
Bot
added
dependencies
Code Coverage Linux 3.11
Results for commit b9d81a1. |
Test Results Linux 3.11587 tests 576 ✅ 2m 7s ⏱️ Results for commit c26d57e. ♻️ This comment has been updated with latest results. |
dependabot
Bot
force-pushed
the
dependabot/uv/tornado-6.5.5
branch
from
f355c4c to
0790a11
Compare
Bumps [tornado](https://github.com/tornadoweb/tornado) from 6.5.4 to 6.5.5. - [Changelog](https://github.com/tornadoweb/tornado/blob/master/docs/releases.rst) - [Commits](tornadoweb/tornado@v6.5.4...v6.5.5) --- updated-dependencies: - dependency-name: tornado dependency-version: 6.5.5 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com>
dependabot
Bot
force-pushed
the
dependabot/uv/tornado-6.5.5
branch
from
0790a11 to
c26d57e
Compare
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Benchmark Results
============================= test session starts ==============================
platform linux -- Python 3.11.15, pytest-9.0.3, pluggy-1.6.0
benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/runner/work/pytorchcocotools/pytorchcocotools
configfile: pyproject.toml
testpaths: tests
plugins: cases-3.10.1, cov-7.1.0, benchmark-5.2.3, mock-3.15.1, park-0.3.2, aspectlib-2.0.0, github-actions-annotate-failures-0.4.0, anyio-4.12.1
collected 587 items
tests/coco/test_ann_to_mask.py ..s [ 0%]
tests/coco/test_ann_to_rle.py ..s [ 1%]
tests/coco/test_class.py s [ 1%]
tests/coco/test_get_ann_ids.py ..s [ 1%]
tests/coco/test_get_cat_ids.py ..s [ 2%]
tests/coco/test_get_img_ids.py ....ss [ 3%]
tests/coco/test_load_anns.py ..s [ 3%]
tests/coco/test_load_cats.py ..s [ 4%]
tests/coco/test_load_imgs.py ..s [ 4%]
tests/coco/test_load_pytorch_annotations.py ..s [ 5%]
tests/cocoeval/test_accumulate_iou.py ....ss [ 6%]
tests/cocoeval/test_compute_iou.py ..................sssssssss [ 10%]
tests/cocoeval/test_compute_oks.py ..s [ 11%]
tests/cocoeval/test_evaluate_img.py ..........sssss [ 13%]
tests/cocoeval/test_evaluate_iou.py ....ss [ 14%]
tests/cocoeval/test_evaluate_oks.py ..s [ 15%]
tests/lightning/mean_ap/test_benchmark.py sssssss............ [ 18%]
tests/lightning/mean_ap/test_coco_stats_tensor_dict.py ssss [ 19%]
tests/lightning/mean_ap/test_compute_bbox.py sss......s..s..s..s..s..s.. [ 24%]
s..s.. [ 25%]
tests/lightning/mean_ap/test_compute_edge_cases.py s..s..s..s..s..s.. [ 28%]
tests/lightning/mean_ap/test_compute_fixtures.py s..s..s.. [ 29%]
tests/lightning/mean_ap/test_compute_internal.py ssss [ 30%]
tests/lightning/mean_ap/test_get_classes.py sss [ 30%]
tests/lightning/mean_ap/test_stress_compute.py sss....s..s.. [ 33%]
tests/lightning/mean_ap/test_stress_update.py sssssssssssss [ 35%]
tests/lightning/mean_ap/test_update.py sssssssssssss [ 37%]
tests/lightning/mean_ap/test_update_validation.py sssssssssssss [ 39%]
tests/lightning/test_datamodule.py sssssssssssssssss [ 42%]
tests/mask/test_area.py ........ssss [ 44%]
tests/mask/test_decode.py ................ssssssss [ 48%]
tests/mask/test_encode.py ................ssssssss [ 52%]
tests/mask/test_fr_py_objects.py .ss.s....ss.s...ssssssss [ 56%]
tests/mask/test_iou.py ............................ssssssssssssss [ 64%]
tests/mask/test_merge.py ..............................sssssssssssssss [ 71%]
tests/mask/test_to_bbox.py ..........sssss [ 74%]
tests/profiling/test_bb_iou.py .....ssssssssss [ 76%]
tests/profiling/test_bb_nms.py .....ssssssssss [ 79%]
tests/profiling/test_fr_bbox.py ....ssssssss [ 81%]
tests/profiling/test_fr_poly.py ......ssssssssssss [ 84%]
tests/profiling/test_fr_string.py .....ssssssssss [ 87%]
tests/profiling/test_nms.py .....ssssssssss [ 89%]
tests/profiling/test_rle_merge.py ...ssss [ 90%]
tests/profiling/test_to_string.py .....ssssssssss [ 93%]
tests/test_base.py s [ 93%]
tests/original/test_special_maskutil.py ssss [ 94%]
tests/original/test_special_toBbox.py ssss [ 94%]
tests/test_base.py s [ 95%]
tests/test_benchmark_grouping.py ssss [ 95%]
tests/test_structure_results.py ssssssssss [ 97%]
tests/torch/test_dataset.py ..s [ 97%]
tests/utils/test_callable.py ssss [ 98%]
tests/utils/test_coco_download.py ssssssss [100%]
================================ tests coverage ================================
_______________ coverage: platform linux, python 3.11.15-final-0 _______________
Name Stmts Miss Branch BrPart Cover
-------------------------------------------------------------------------------------------
src/pytorchcocotools/__about__.py 1 0 0 0 100%
src/pytorchcocotools/__init__.py 1 0 0 0 100%
src/pytorchcocotools/_mask.py 113 25 36 9 72%
src/pytorchcocotools/coco.py 267 123 88 9 49%
src/pytorchcocotools/cocoeval.py 381 84 88 17 75%
src/pytorchcocotools/internal/__init__.py 0 0 0 0 100%
src/pytorchcocotools/internal/cocoeval_types.py 64 1 4 1 97%
src/pytorchcocotools/internal/entities.py 28 0 0 0 100%
src/pytorchcocotools/internal/mask_api/__init__.py 14 0 0 0 100%
src/pytorchcocotools/internal/mask_api/bb_iou.py 22 1 2 1 92%
src/pytorchcocotools/internal/mask_api/bb_nms.py 15 1 2 1 88%
src/pytorchcocotools/internal/mask_api/rle_area.py 6 0 0 0 100%
src/pytorchcocotools/internal/mask_api/rle_decode.py 37 12 4 1 68%
src/pytorchcocotools/internal/mask_api/rle_encode.py 33 2 6 2 90%
src/pytorchcocotools/internal/mask_api/rle_fr_bbox.py 40 3 8 2 90%
src/pytorchcocotools/internal/mask_api/rle_fr_poly.py 52 31 0 0 40%
src/pytorchcocotools/internal/mask_api/rle_fr_string.py 27 0 8 0 100%
src/pytorchcocotools/internal/mask_api/rle_iou.py 72 19 8 4 71%
src/pytorchcocotools/internal/mask_api/rle_merge.py 89 46 16 3 53%
src/pytorchcocotools/internal/mask_api/rle_nms.py 14 0 6 0 100%
src/pytorchcocotools/internal/mask_api/rle_to_bbox.py 57 34 6 2 43%
src/pytorchcocotools/internal/mask_api/rle_to_string.py 38 18 18 0 50%
src/pytorchcocotools/internal/structure/__init__.py 2 0 0 0 100%
src/pytorchcocotools/internal/structure/additional.py 71 12 0 0 83%
src/pytorchcocotools/internal/structure/annotations.py 36 0 0 0 100%
src/pytorchcocotools/internal/structure/base.py 5 0 0 0 100%
src/pytorchcocotools/internal/structure/categories.py 22 2 0 0 91%
src/pytorchcocotools/internal/structure/coco.py 51 5 4 1 89%
src/pytorchcocotools/internal/structure/images.py 25 5 0 0 80%
src/pytorchcocotools/internal/structure/info.py 23 5 0 0 78%
src/pytorchcocotools/internal/structure/licenses.py 12 0 0 0 100%
src/pytorchcocotools/internal/structure/results.py 44 0 0 0 100%
src/pytorchcocotools/internal/structure/rle.py 14 0 0 0 100%
src/pytorchcocotools/lightning/datamodule.py 50 28 10 0 37%
src/pytorchcocotools/lightning/metrics/mean_ap.py 331 109 140 21 62%
src/pytorchcocotools/mask.py 33 3 12 4 84%
src/pytorchcocotools/torch/dataset.py 61 6 8 4 86%
src/pytorchcocotools/torch/transform.py 4 1 0 0 75%
src/pytorchcocotools/utils/callable.py 19 13 6 0 24%
src/pytorchcocotools/utils/coco/download.py 76 52 14 0 27%
src/pytorchcocotools/utils/coco/files.py 50 0 0 0 100%
src/pytorchcocotools/utils/dataclass.py 19 0 0 0 100%
src/pytorchcocotools/utils/list.py 3 0 0 0 100%
src/pytorchcocotools/utils/logging.py 8 0 0 0 100%
src/pytorchcocotools/utils/stage.py 9 0 0 0 100%
-------------------------------------------------------------------------------------------
TOTAL 2339 641 494 82 69%
-------------------------------------------------------------------------------- benchmark 'test_accumulate': 4 tests -------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_accumulate_pt[eval_segm-test_1] 2.4869 (1.0) 3.0152 (1.04) 2.5619 (1.00) 0.0468 (1.54) 2.5570 (1.01) 0.0394 (1.47) 58;20 390.3346 (1.00) 402 1
test_accumulate_pt[eval_bbox-test_1] 2.5034 (1.01) 2.9022 (1.0) 2.5514 (1.0) 0.0406 (1.33) 2.5439 (1.0) 0.0270 (1.01) 41;33 391.9414 (1.0) 402 1
test_accumulate_np[eval_bbox-test_1] 2.6047 (1.05) 2.9132 (1.00) 2.6565 (1.04) 0.0316 (1.04) 2.6505 (1.04) 0.0268 (1.0) 48;20 376.4397 (0.96) 381 1
test_accumulate_np[eval_segm-test_1] 3.0453 (1.22) 3.3463 (1.15) 3.1006 (1.22) 0.0304 (1.0) 3.0956 (1.22) 0.0323 (1.20) 58;14 322.5156 (0.82) 328 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------ benchmark 'test_annToMask': 2 tests -------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_annToMask_np[test_1] 168.0640 (1.0) 440.2250 (1.0) 171.1313 (1.0) 6.8715 (1.0) 169.0060 (1.0) 1.5730 (1.0) 410;1134 5,843.4674 (1.0) 5951 1
test_annToMask_pt[test_1] 1,765.0560 (10.50) 2,232.6970 (5.07) 1,835.4827 (10.73) 46.9831 (6.84) 1,825.6225 (10.80) 44.7280 (28.43) 119;24 544.8158 (0.09) 614 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------- benchmark 'test_annToRLE': 2 tests --------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_annToRLE_np[test_1] 8.9140 (1.0) 141.0940 (1.0) 9.2748 (1.0) 1.0326 (1.0) 9.1440 (1.0) 0.0910 (1.0) 2632;7035 107,819.5268 (1.0) 112575 1
test_annToRLE_pt[test_1] 1,042.2250 (116.92) 1,316.5900 (9.33) 1,077.2714 (116.15) 21.9764 (21.28) 1,073.3120 (117.38) 19.8177 (217.78) 141;41 928.2711 (0.01) 817 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------- benchmark 'test_area': 8 tests -----------------------------------------------------------------------------------------------
Name (time in ns) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_area_np[cpu-full_area] 849.3000 (1.0) 6,138.3000 (1.51) 892.9259 (1.0) 78.4606 (1.01) 883.3000 (1.0) 13.0000 (1.0) 2267;5025 1,119.9137 (1.0) 117620 10
test_area_np[cpu-end_area] 862.3000 (1.02) 4,288.4000 (1.06) 908.9819 (1.02) 79.0550 (1.02) 899.3000 (1.02) 13.0000 (1.00) 2296;5259 1,100.1319 (0.98) 115301 10
test_area_np[cpu-start_area] 866.3000 (1.02) 15,769.8000 (3.88) 911.3464 (1.02) 91.5600 (1.18) 901.3000 (1.02) 13.0000 (1.00) 2178;5195 1,097.2776 (0.98) 115168 10
test_area_np[cpu-center_area] 868.3000 (1.02) 4,063.1000 (1.0) 912.7526 (1.02) 77.8547 (1.0) 902.4000 (1.02) 13.0000 (1.00) 2311;5145 1,095.5871 (0.98) 114509 10
test_area_pt[cpu-full_area] 10,676.0000 (12.57) 50,206.0000 (12.36) 11,305.9689 (12.66) 977.6798 (12.56) 11,166.9999 (12.64) 170.9999 (13.15) 2049;5805 88.4489 (0.08) 93406 1
test_area_pt[cpu-end_area] 13,691.0000 (16.12) 46,730.0000 (11.50) 14,332.9002 (16.05) 1,070.8541 (13.75) 14,171.0000 (16.04) 209.9999 (16.15) 1823;4324 69.7696 (0.06) 73965 1
test_area_pt[cpu-center_area] 13,740.0000 (16.18) 59,170.0000 (14.56) 14,437.5916 (16.17) 1,116.6139 (14.34) 14,262.0000 (16.15) 219.9999 (16.92) 1789;4256 69.2636 (0.06) 72250 1
test_area_pt[cpu-start_area] 13,831.0000 (16.29) 547,628.0000 (134.78) 14,618.7457 (16.37) 2,303.7404 (29.59) 14,432.0001 (16.34) 230.0000 (17.69) 1319;4026 68.4053 (0.06) 72617 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------- benchmark 'test_bb_iou': 5 tests -----------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bb_iou_pt[cpu-partial_overlap] 25.3580 (1.0) 72.3190 (1.0) 26.7059 (1.0) 1.9955 (1.06) 26.2890 (1.0) 0.4710 (1.0) 1790;3286 37.4449 (1.0) 39281 1
test_bb_iou_pt[cpu-non_overlapping_boxes] 25.5190 (1.01) 775.1310 (10.72) 27.0257 (1.01) 4.3876 (2.34) 26.5510 (1.01) 0.4820 (1.02) 1256;3336 37.0018 (0.99) 39065 1
test_bb_iou_pt[cpu-identical_boxes] 25.6190 (1.01) 82.1640 (1.14) 26.9465 (1.01) 1.8773 (1.0) 26.5400 (1.01) 0.5000 (1.06) 1813;3181 37.1106 (0.99) 38747 1
test_bb_iou_pt[cpu-crowd_annotation] 29.4240 (1.16) 851.5360 (11.77) 31.1851 (1.17) 5.1136 (2.72) 30.6260 (1.16) 0.6510 (1.38) 1165;2976 32.0665 (0.86) 34056 1
test_bb_iou_pt[cpu-multiple_boxes] 29.7640 (1.17) 86.6210 (1.20) 31.3434 (1.17) 2.2869 (1.22) 30.8270 (1.17) 0.6100 (1.30) 1690;2940 31.9046 (0.85) 33384 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------- benchmark 'test_bb_nms': 5 tests ---------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bb_nms_pt[cpu-single_box] 41.3120 (1.0) 655.4900 (1.04) 44.3725 (1.0) 8.7815 (1.37) 42.9950 (1.0) 0.9810 (1.0) 1189;3029 22.5365 (1.0) 23934 1
test_bb_nms_pt[cpu-non_overlapping_boxes] 49.1340 (1.19) 635.1790 (1.01) 52.5573 (1.18) 6.5483 (1.02) 50.9670 (1.19) 1.1220 (1.14) 1481;2771 19.0269 (0.84) 20139 1
test_bb_nms_pt[cpu-suppress_overlapping] 49.2540 (1.19) 632.1650 (1.00) 52.4628 (1.18) 6.4062 (1.0) 50.9170 (1.18) 1.0320 (1.05) 1450;2803 19.0611 (0.85) 20238 1
test_bb_nms_pt[cpu-no_suppression_high_threshold] 49.4640 (1.20) 761.6700 (1.21) 52.7872 (1.19) 8.5297 (1.33) 51.1570 (1.19) 1.0720 (1.09) 1233;2854 18.9440 (0.84) 20131 1
test_bb_nms_pt[cpu-low_threshold_suppress_all] 49.5140 (1.20) 631.9250 (1.0) 52.7067 (1.19) 6.4428 (1.01) 51.1270 (1.19) 1.0620 (1.08) 1477;2838 18.9729 (0.84) 20258 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_bbox_class_metrics': 2 tests --------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bbox_class_metrics_tm 11.7297 (1.0) 12.6254 (1.0) 11.9217 (1.0) 0.1575 (1.0) 11.8763 (1.0) 0.1732 (1.0) 21;3 83.8809 (1.0) 86 1
test_bbox_class_metrics_pt 193.6209 (16.51) 197.4558 (15.64) 195.6115 (16.41) 1.3667 (8.68) 195.4127 (16.45) 1.8002 (10.39) 2;0 5.1122 (0.06) 6 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------- benchmark 'test_bbox_custom_iou_thresholds': 2 tests ------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bbox_custom_iou_thresholds_tm 1.9136 (1.0) 2.4763 (1.0) 1.9757 (1.0) 0.0795 (1.0) 1.9485 (1.0) 0.0226 (1.0) 72;82 506.1521 (1.0) 522 1
test_bbox_custom_iou_thresholds_pt 80.3539 (41.99) 81.9315 (33.09) 80.9277 (40.96) 0.4754 (5.98) 80.8837 (41.51) 0.6014 (26.64) 5;0 12.3567 (0.02) 13 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------- benchmark 'test_bbox_custom_rec_thresholds': 2 tests ------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bbox_custom_rec_thresholds_tm 2.1000 (1.0) 3.1614 (1.0) 2.1734 (1.0) 0.0927 (1.0) 2.1441 (1.0) 0.0326 (1.0) 69;75 460.1094 (1.0) 477 1
test_bbox_custom_rec_thresholds_pt 84.1292 (40.06) 85.9033 (27.17) 84.8993 (39.06) 0.5877 (6.34) 84.8433 (39.57) 0.9224 (28.31) 5;0 11.7787 (0.03) 13 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------- benchmark 'test_bbox_micro_average': 2 tests ------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bbox_micro_average_tm 4.1166 (1.0) 4.8396 (1.0) 4.2330 (1.0) 0.1019 (1.0) 4.1980 (1.0) 0.0653 (1.0) 39;37 236.2393 (1.0) 244 1
test_bbox_micro_average_pt 78.8109 (19.14) 80.1927 (16.57) 79.6078 (18.81) 0.4166 (4.09) 79.6529 (18.97) 0.5796 (8.87) 4;0 12.5616 (0.05) 13 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------- benchmark 'test_bbox_multi_image': 2 tests ------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bbox_multi_image_tm 5.8710 (1.0) 6.5727 (1.0) 5.9970 (1.0) 0.1120 (1.0) 5.9592 (1.0) 0.0837 (1.0) 27;23 166.7490 (1.0) 171 1
test_bbox_multi_image_pt 72.8405 (12.41) 75.2379 (11.45) 74.0084 (12.34) 0.5914 (5.28) 74.0564 (12.43) 0.7050 (8.42) 3;0 13.5120 (0.08) 15 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_bbox_realistic_inputs': 2 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bbox_realistic_inputs_tm 9.3414 (1.0) 10.1523 (1.0) 9.5199 (1.0) 0.1309 (1.0) 9.4977 (1.0) 0.1202 (1.0) 21;6 105.0437 (1.0) 108 1
test_bbox_realistic_inputs_pt 102.6082 (10.98) 104.2498 (10.27) 103.3293 (10.85) 0.4644 (3.55) 103.2379 (10.87) 0.5727 (4.76) 2;0 9.6778 (0.09) 10 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_bbox_single_image': 2 tests -------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_bbox_single_image_tm 2.8189 (1.0) 3.4994 (1.0) 2.8995 (1.0) 0.0879 (1.0) 2.8696 (1.0) 0.0384 (1.0) 50;55 344.8917 (1.0) 354 1
test_bbox_single_image_pt 64.2099 (22.78) 66.5324 (19.01) 65.2249 (22.50) 0.5970 (6.79) 65.2914 (22.75) 0.7736 (20.13) 4;0 15.3316 (0.04) 17 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------- benchmark 'test_computeIoU': 18 tests ----------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_computeIoU_np[eval_inputs_bbox-img101_cat4] 14.3410 (1.0) 66.1100 (1.36) 15.0510 (1.0) 1.2180 (1.05) 14.8620 (1.0) 0.2100 (1.0) 1904;4849 66.4406 (1.0) 69970 1
test_computeIoU_np[eval_bbox-test_1] 14.5620 (1.02) 77.3770 (1.59) 15.3669 (1.02) 1.3977 (1.20) 15.1430 (1.02) 0.2210 (1.05) 1894;4681 65.0749 (0.98) 67926 1
test_computeIoU_np[eval_inputs_bbox-img103_cat4] 14.5620 (1.02) 49.6050 (1.02) 15.2400 (1.01) 1.1986 (1.03) 15.0530 (1.01) 0.2100 (1.0) 1843;4678 65.6168 (0.99) 68767 1
test_computeIoU_np[eval_bbox-test_2] 14.6420 (1.02) 152.8510 (3.13) 15.2809 (1.02) 1.2298 (1.06) 15.1020 (1.02) 0.2100 (1.00) 1796;4622 65.4411 (0.98) 69291 1
test_computeIoU_np[eval_segm-test_1] 14.8320 (1.03) 99.6710 (2.04) 15.5040 (1.03) 1.2167 (1.04) 15.3130 (1.03) 0.2110 (1.00) 1804;4624 64.4994 (0.97) 67286 1
test_computeIoU_np[eval_segm-test_2] 14.9220 (1.04) 48.7730 (1.0) 15.5885 (1.04) 1.1646 (1.0) 15.3930 (1.04) 0.2200 (1.05) 1930;4663 64.1499 (0.97) 67106 1
test_computeIoU_np[eval_inputs_bbox-img102_cat2] 14.9730 (1.04) 58.7590 (1.20) 15.7330 (1.05) 1.3039 (1.12) 15.5230 (1.04) 0.2300 (1.10) 1865;4609 63.5607 (0.96) 66698 1
test_computeIoU_np[eval_inputs_bbox-img103_cat0] 17.9370 (1.25) 63.1360 (1.29) 18.6781 (1.24) 1.2927 (1.11) 18.4480 (1.24) 0.2300 (1.10) 1725;4356 53.5385 (0.81) 56571 1
test_computeIoU_np[eval_inputs_bbox-img104_cat49] 21.7030 (1.51) 77.8280 (1.60) 22.5601 (1.50) 1.4743 (1.27) 22.2830 (1.50) 0.2700 (1.29) 1603;3782 44.3261 (0.67) 45887 1
test_computeIoU_pt[eval_inputs_bbox-img103_cat4] 95.1830 (6.64) 247.9840 (5.08) 102.4000 (6.80) 7.8942 (6.78) 99.6910 (6.71) 3.6560 (17.41) 1219;1441 9.7656 (0.15) 10454 1
test_computeIoU_pt[eval_inputs_bbox-img101_cat4] 95.6450 (6.67) 247.9040 (5.08) 102.8698 (6.83) 7.9452 (6.82) 100.0810 (6.73) 4.0885 (19.47) 1229;1369 9.7210 (0.15) 10445 1
test_computeIoU_pt[eval_bbox-test_2] 96.7660 (6.75) 216.1170 (4.43) 103.8854 (6.90) 7.6147 (6.54) 101.1220 (6.80) 3.9160 (18.65) 1269;1418 9.6260 (0.14) 10309 1
test_computeIoU_pt[eval_bbox-test_1] 96.8770 (6.76) 200.0620 (4.10) 103.7983 (6.90) 8.2999 (7.13) 100.8420 (6.79) 3.8960 (18.55) 1237;1456 9.6341 (0.15) 10379 1
test_computeIoU_pt[eval_inputs_bbox-img102_cat2] 103.0360 (7.18) 234.2940 (4.80) 110.4076 (7.34) 8.5430 (7.34) 107.3375 (7.22) 4.3270 (20.60) 1190;1361 9.0574 (0.14) 9730 1
test_computeIoU_pt[eval_inputs_bbox-img103_cat0] 110.6670 (7.72) 1,004.2870 (20.59) 119.0232 (7.91) 17.1849 (14.76) 115.7350 (7.79) 4.5895 (21.85) 451;1283 8.4017 (0.13) 9157 1
test_computeIoU_pt[eval_inputs_bbox-img104_cat49] 112.4600 (7.84) 281.1850 (5.77) 120.5338 (8.01) 8.7710 (7.53) 117.3270 (7.89) 4.7195 (22.47) 1174;1264 8.2964 (0.12) 8889 1
test_computeIoU_pt[eval_segm-test_1] 491.1520 (34.25) 1,425.1630 (29.22) 520.1764 (34.56) 26.4926 (22.75) 519.5600 (34.96) 21.9430 (104.49) 99;50 1.9224 (0.03) 2022 1
test_computeIoU_pt[eval_segm-test_2] 493.8360 (34.44) 816.0620 (16.73) 520.0077 (34.55) 17.7759 (15.26) 520.1460 (35.00) 22.6313 (107.77) 375;41 1.9230 (0.03) 2033 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------- benchmark 'test_computeOks': 2 tests ---------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_computeOks_np[eval_keypoints-test_1] 17.6770 (1.0) 77.3070 (1.0) 18.5325 (1.0) 1.4052 (1.0) 18.2880 (1.0) 0.2933 (1.0) 1734;3741 53.9592 (1.0) 56285 1
test_computeOks_pt[eval_keypoints-test_1] 32.5190 (1.84) 822.1810 (10.64) 34.8644 (1.88) 13.1979 (9.39) 34.0810 (1.86) 0.8210 (2.80) 123;2073 28.6825 (0.53) 30536 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_compute_25_50_boxes': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compute_25_50_boxes_tm[25] 22.7422 (1.0) 23.9766 (1.0) 23.0691 (1.0) 0.2521 (1.0) 23.0368 (1.0) 0.2438 (1.0) 7;4 43.3480 (1.0) 45 1
test_compute_25_50_boxes_tm[50] 33.5526 (1.48) 35.0039 (1.46) 34.3071 (1.49) 0.3923 (1.56) 34.2417 (1.49) 0.5601 (2.30) 13;0 29.1485 (0.67) 30 1
test_compute_25_50_boxes_pt[25] 188.6206 (8.29) 190.7029 (7.95) 189.9346 (8.23) 0.7192 (2.85) 190.0868 (8.25) 0.5433 (2.23) 2;1 5.2650 (0.12) 6 1
test_compute_25_50_boxes_pt[50] 223.6087 (9.83) 224.8284 (9.38) 224.3148 (9.72) 0.4969 (1.97) 224.3383 (9.74) 0.7915 (3.25) 2;0 4.4580 (0.10) 5 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_compute_class_metrics_large': 2 tests --------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compute_class_metrics_large_tm 53.1536 (1.0) 53.8249 (1.0) 53.4207 (1.0) 0.2193 (1.0) 53.3266 (1.0) 0.3871 (1.0) 9;0 18.7193 (1.0) 19 1
test_compute_class_metrics_large_pt 670.0672 (12.61) 676.8316 (12.57) 673.5245 (12.61) 2.7698 (12.63) 673.7506 (12.63) 4.6428 (11.99) 2;0 1.4847 (0.08) 5 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_compute_many_images': 2 tests --------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compute_many_images_tm 37.0001 (1.0) 39.9275 (1.0) 37.7074 (1.0) 0.6494 (1.0) 37.5090 (1.0) 0.6531 (1.0) 5;2 26.5200 (1.0) 27 1
test_compute_many_images_pt 263.0834 (7.11) 267.1193 (6.69) 264.7015 (7.02) 1.5661 (2.41) 264.0084 (7.04) 1.9934 (3.05) 2;0 3.7778 (0.14) 5 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------- benchmark 'test_custom_iou_thresholds_map50_absent': 2 tests ------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_custom_iou_thresholds_map50_absent_tm 1.9068 (1.0) 2.5432 (1.0) 1.9761 (1.0) 0.0843 (1.0) 1.9471 (1.0) 0.0265 (1.0) 74;85 506.0563 (1.0) 528 1
test_custom_iou_thresholds_map50_absent_pt 59.1439 (31.02) 61.6041 (24.22) 60.4579 (30.60) 0.6916 (8.20) 60.6450 (31.15) 0.7765 (29.35) 6;0 16.5404 (0.03) 19 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_dataset': 2 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_dataset_np[example] 2.2176 (1.0) 2.6545 (1.0) 2.2903 (1.0) 0.1130 (2.92) 2.2374 (1.0) 0.0243 (1.0) 84;86 436.6240 (1.0) 451 1
test_dataset_pt[example] 4.3954 (1.98) 4.6929 (1.77) 4.4672 (1.95) 0.0387 (1.0) 4.4585 (1.99) 0.0396 (1.63) 44;11 223.8555 (0.51) 228 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------- benchmark 'test_decode': 16 tests --------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_decode_np[cpu-full_area] 3.1745 (1.0) 25.5035 (1.03) 3.3103 (1.0) 0.3368 (1.0) 3.2700 (1.0) 0.0345 (1.15) 2541;8530 302.0903 (1.0) 157506 2
test_decode_np[cpu-center_area] 3.1945 (1.01) 24.6625 (1.0) 3.3491 (1.01) 0.3425 (1.02) 3.3100 (1.01) 0.0300 (1.0) 2674;10164 298.5901 (0.99) 156495 2
test_decode_np[cpu-end_area] 3.2095 (1.01) 27.1310 (1.10) 3.3512 (1.01) 0.3382 (1.00) 3.3150 (1.01) 0.0350 (1.17) 2558;8737 298.3988 (0.99) 156031 2
test_decode_np[cpu-start_area] 3.2150 (1.01) 53.4505 (2.17) 3.3543 (1.01) 0.3530 (1.05) 3.3150 (1.01) 0.0350 (1.17) 2435;8478 298.1270 (0.99) 156031 2
test_decode_pt[cpu-full_area] 82.1640 (25.88) 184.6990 (7.49) 88.5218 (26.74) 7.6650 (22.76) 85.8000 (26.24) 2.6250 (87.50) 1314;1942 11.2967 (0.04) 12015 1
test_decode_pt[cpu-center_area] 93.1310 (29.34) 215.1450 (8.72) 99.2607 (29.99) 6.8787 (20.42) 96.8260 (29.61) 2.8515 (95.05) 1229;1595 10.0745 (0.03) 10783 1
test_decode_pt[cpu-start_area] 93.6510 (29.50) 232.6120 (9.43) 99.7870 (30.14) 6.9380 (20.60) 97.2970 (29.75) 2.7950 (93.17) 1245;1647 10.0213 (0.03) 10759 1
test_decode_pt[cpu-end_area] 94.1320 (29.65) 223.5780 (9.07) 100.8188 (30.46) 7.8718 (23.37) 97.8570 (29.93) 3.2425 (108.08) 1266;1650 9.9188 (0.03) 10627 1
test_decode_np[cpu-complex_2_np] 156.8670 (49.41) 292.4820 (11.86) 159.1593 (48.08) 4.5340 (13.46) 157.4280 (48.14) 1.0020 (33.40) 1065;1250 6.2830 (0.02) 6372 1
test_decode_np[cpu-complex_1_np] 157.0970 (49.49) 236.0670 (9.57) 159.4979 (48.18) 4.0744 (12.10) 157.9090 (48.29) 0.9610 (32.03) 1046;1184 6.2697 (0.02) 6366 1
test_decode_np[cpu-complex_2_pt] 157.3170 (49.56) 240.1930 (9.74) 159.4434 (48.17) 3.7173 (11.04) 157.8780 (48.28) 0.8710 (29.03) 1054;1226 6.2718 (0.02) 6355 1
test_decode_np[cpu-complex_1_pt] 157.4070 (49.58) 232.4710 (9.43) 159.5819 (48.21) 3.9841 (11.83) 157.9680 (48.31) 0.9010 (30.03) 1055;1184 6.2664 (0.02) 6357 1
test_decode_pt[cpu-complex_2_np] 391.6120 (123.36) 542.3490 (21.99) 406.9296 (122.93) 10.1330 (30.09) 404.8010 (123.79) 11.9982 (399.94) 375;55 2.4574 (0.01) 2553 1
test_decode_pt[cpu-complex_2_pt] 391.7720 (123.41) 565.7340 (22.94) 406.9667 (122.94) 9.7861 (29.06) 404.7915 (123.79) 11.7930 (393.10) 371;42 2.4572 (0.01) 2556 1
test_decode_pt[cpu-complex_1_np] 397.2700 (125.14) 582.4590 (23.62) 415.6934 (125.58) 11.2948 (33.54) 413.7450 (126.53) 11.9230 (397.43) 262;56 2.4056 (0.01) 2497 1
test_decode_pt[cpu-complex_1_pt] 400.8460 (126.27) 611.2030 (24.78) 416.1739 (125.72) 10.6822 (31.72) 414.6460 (126.80) 11.6830 (389.43) 294;40 2.4028 (0.01) 2501 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_empty_ground_truths': 2 tests -------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_empty_ground_truths_tm 1.3927 (1.0) 1.9098 (1.0) 1.4545 (1.0) 0.0757 (1.0) 1.4292 (1.0) 0.0261 (1.0) 99;107 687.5124 (1.0) 720 1
test_empty_ground_truths_pt 92.2318 (66.23) 94.0050 (49.22) 92.9171 (63.88) 0.5102 (6.74) 92.9647 (65.04) 0.7517 (28.76) 3;0 10.7623 (0.02) 12 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_empty_preds': 2 tests -------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_empty_preds_tm 2.1681 (1.0) 2.7257 (1.0) 2.2367 (1.0) 0.0789 (1.0) 2.2094 (1.0) 0.0306 (1.0) 62;67 447.0947 (1.0) 462 1
test_empty_preds_pt 90.0039 (41.51) 93.2733 (34.22) 91.4291 (40.88) 1.0861 (13.76) 91.0197 (41.20) 1.4746 (48.18) 3;0 10.9374 (0.02) 12 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------- benchmark 'test_encode': 16 tests ---------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_encode_np[cpu-full_area] 1.5032 (1.0) 5.2128 (1.0) 1.5645 (1.0) 0.1069 (1.04) 1.5483 (1.0) 0.0161 (1.01) 1833;3943 639.1693 (1.0) 66481 10
test_encode_np[cpu-end_area] 1.5323 (1.02) 6.2275 (1.19) 1.5940 (1.02) 0.1040 (1.01) 1.5783 (1.02) 0.0160 (1.0) 1762;3855 627.3446 (0.98) 65007 10
test_encode_np[cpu-start_area] 1.5334 (1.02) 17.0437 (3.27) 1.6046 (1.03) 0.1278 (1.24) 1.5874 (1.03) 0.0170 (1.06) 1654;3890 623.2022 (0.98) 64881 10
test_encode_np[cpu-center_area] 1.5394 (1.02) 5.8619 (1.12) 1.6074 (1.03) 0.1028 (1.0) 1.5914 (1.03) 0.0180 (1.12) 1817;3689 622.1049 (0.97) 65177 10
test_encode_pt[cpu-full_area] 68.8940 (45.83) 154.5630 (29.65) 73.3401 (46.88) 6.1713 (60.02) 71.2270 (46.00) 1.7630 (110.19) 1413;2307 13.6351 (0.02) 14537 1
test_encode_pt[cpu-end_area] 69.8760 (46.48) 170.2270 (32.66) 74.5660 (47.66) 6.1811 (60.12) 72.4690 (46.81) 1.7820 (111.37) 1422;2265 13.4109 (0.02) 14248 1
test_encode_pt[cpu-start_area] 70.2060 (46.70) 1,558.1030 (298.90) 74.6806 (47.73) 13.8909 (135.10) 72.4990 (46.82) 1.7120 (107.00) 812;2205 13.3904 (0.02) 14168 1
test_encode_pt[cpu-center_area] 70.6770 (47.02) 162.2250 (31.12) 75.3286 (48.15) 6.3730 (61.98) 73.2310 (47.30) 1.8430 (115.19) 1406;2131 13.2752 (0.02) 14115 1
test_encode_np[cpu-complex_2_np] 75.7940 (50.42) 159.5610 (30.61) 77.0174 (49.23) 3.4440 (33.50) 76.2550 (49.25) 0.3200 (20.00) 1114;1584 12.9841 (0.02) 13187 1
test_encode_np[cpu-complex_2_pt] 75.9050 (50.50) 133.6520 (25.64) 77.0090 (49.22) 2.4606 (23.93) 76.3650 (49.32) 0.3900 (24.37) 1110;1474 12.9855 (0.02) 13170 1
test_encode_np[cpu-complex_1_np] 75.9550 (50.53) 137.7280 (26.42) 77.1030 (49.28) 2.9102 (28.30) 76.4150 (49.35) 0.3410 (21.31) 1059;1440 12.9697 (0.02) 13161 1
test_encode_np[cpu-complex_1_pt] 75.9640 (50.53) 158.5790 (30.42) 77.0778 (49.27) 2.7942 (27.18) 76.4150 (49.35) 0.4310 (26.94) 1109;1460 12.9739 (0.02) 13156 1
test_encode_pt[cpu-complex_2_np] 198.7110 (132.19) 391.5210 (75.11) 212.1240 (135.58) 11.5492 (112.33) 207.8690 (134.26) 11.9680 (748.00) 852;169 4.7142 (0.01) 5040 1
test_encode_pt[cpu-complex_1_np] 204.6990 (136.18) 375.4770 (72.03) 218.9216 (139.93) 11.8043 (114.81) 214.4740 (138.52) 12.4330 (777.06) 750;171 4.5678 (0.01) 4900 1
test_encode_pt[cpu-complex_2_pt] 280.4040 (186.54) 468.8480 (89.94) 296.9163 (189.78) 12.7406 (123.91) 292.4620 (188.89) 16.1682 (>1000.0) 538;77 3.3680 (0.01) 3561 1
test_encode_pt[cpu-complex_1_pt] 285.3710 (189.84) 500.3850 (95.99) 302.4202 (193.30) 12.2861 (119.49) 298.2510 (192.63) 14.7198 (919.98) 416;99 3.3067 (0.01) 3483 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------- benchmark 'test_evaluate': 6 tests --------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_evaluate_np[eval_keypoints-test_1] 389.0980 (1.0) 839.0470 (1.38) 417.8014 (1.02) 60.6502 (4.87) 406.3990 (1.0) 15.6940 (1.09) 85;128 2,393.4814 (0.98) 2546 1
test_evaluate_np[eval_bbox-test_1] 390.6100 (1.00) 607.8580 (1.0) 409.4221 (1.0) 12.4464 (1.0) 407.5460 (1.00) 14.5920 (1.01) 386;55 2,442.4672 (1.0) 2530 1
test_evaluate_np[eval_segm-test_1] 416.4590 (1.07) 628.7290 (1.03) 434.4644 (1.06) 13.1660 (1.06) 432.9540 (1.07) 14.3885 (1.0) 316;50 2,301.6847 (0.94) 2367 1
test_evaluate_pt[eval_bbox-test_1] 3,988.0040 (10.25) 5,106.5730 (8.40) 4,066.1103 (9.93) 101.7878 (8.18) 4,049.7770 (9.97) 32.6740 (2.27) 9;14 245.9353 (0.10) 251 1
test_evaluate_pt[eval_keypoints-test_1] 3,991.6800 (10.26) 4,952.9920 (8.15) 4,050.8820 (9.89) 70.1786 (5.64) 4,039.1810 (9.94) 33.7658 (2.35) 14;17 246.8598 (0.10) 251 1
test_evaluate_pt[eval_segm-test_1] 5,278.2030 (13.57) 7,758.5500 (12.76) 5,504.9261 (13.45) 430.5436 (34.59) 5,381.7490 (13.24) 57.4272 (3.99) 15;19 181.6555 (0.07) 189 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------- benchmark 'test_evaluateImg': 10 tests ----------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_evaluateImg_np[eval_bbox-test_2] 19.7100 (1.0) 191.1790 (1.92) 21.0428 (1.0) 2.6765 (1.53) 20.5610 (1.0) 0.3400 (1.09) 1890;5000 47.5221 (1.0) 49926 1
test_evaluateImg_np[eval_segm-test_2] 22.8240 (1.16) 99.8060 (1.0) 23.8113 (1.13) 1.7494 (1.0) 23.4850 (1.14) 0.3210 (1.03) 1593;3402 41.9969 (0.88) 44280 1
test_evaluateImg_np[eval_keypoints-test_1] 23.2960 (1.18) 167.2030 (1.68) 24.6702 (1.17) 2.9324 (1.68) 23.9370 (1.16) 0.3110 (1.00) 2084;5403 40.5347 (0.85) 42873 1
test_evaluateImg_np[eval_segm-test_1] 23.9160 (1.21) 119.7560 (1.20) 25.0459 (1.19) 1.7713 (1.01) 24.7470 (1.20) 0.3810 (1.23) 1542;2919 39.9266 (0.84) 41726 1
test_evaluateImg_np[eval_bbox-test_1] 24.2360 (1.23) 219.8220 (2.20) 25.1357 (1.19) 1.8672 (1.07) 24.8080 (1.21) 0.3110 (1.0) 1435;3336 39.7840 (0.84) 41553 1
test_evaluateImg_pt[eval_segm-test_1] 256.3270 (13.00) 897.3060 (8.99) 273.3745 (12.99) 22.4484 (12.83) 265.6520 (12.92) 19.4840 (62.65) 384;99 3.6580 (0.08) 3913 1
test_evaluateImg_pt[eval_bbox-test_2] 256.5570 (13.02) 889.9540 (8.92) 272.2658 (12.94) 20.1575 (11.52) 265.9210 (12.93) 17.9587 (57.75) 375;75 3.6729 (0.08) 3915 1
test_evaluateImg_pt[eval_segm-test_2] 256.8180 (13.03) 875.8830 (8.78) 272.4993 (12.95) 19.4367 (11.11) 266.1720 (12.95) 17.5260 (56.35) 360;58 3.6697 (0.08) 3934 1
test_evaluateImg_pt[eval_bbox-test_1] 257.6290 (13.07) 945.1580 (9.47) 274.4559 (13.04) 25.4027 (14.52) 267.3430 (13.00) 18.1220 (58.27) 289;79 3.6436 (0.08) 3904 1
test_evaluateImg_pt[eval_keypoints-test_1] 257.8590 (13.08) 478.2830 (4.79) 274.3283 (13.04) 14.4418 (8.26) 267.9550 (13.03) 18.2370 (58.64) 585;53 3.6453 (0.08) 3899 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_for_box_format': 6 tests ------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_for_box_format_tm[xywh-0.0] 3.0981 (1.0) 3.9901 (1.02) 3.1995 (1.0) 0.0980 (1.0) 3.1694 (1.0) 0.0596 (1.13) 43;42 312.5500 (1.0) 322 1
test_for_box_format_tm[xyxy-1.0] 3.1337 (1.01) 4.5872 (1.18) 3.2207 (1.01) 0.1230 (1.26) 3.1819 (1.00) 0.0528 (1.0) 38;48 310.4885 (0.99) 320 1
test_for_box_format_tm[cxcywh-0.0] 3.1966 (1.03) 3.8971 (1.0) 3.2930 (1.03) 0.1025 (1.05) 3.2568 (1.03) 0.0550 (1.04) 43;43 303.6750 (0.97) 312 1
test_for_box_format_pt[xyxy-1.0] 39.0369 (12.60) 42.2155 (10.83) 40.6781 (12.71) 0.8862 (9.05) 40.6044 (12.81) 1.3571 (25.70) 12;0 24.5832 (0.08) 30 1
test_for_box_format_pt[xywh-0.0] 46.3543 (14.96) 48.8197 (12.53) 47.7161 (14.91) 0.7098 (7.25) 47.8218 (15.09) 1.1969 (22.67) 9;0 20.9573 (0.07) 24 1
test_for_box_format_pt[cxcywh-0.0] 53.0420 (17.12) 54.8383 (14.07) 54.0032 (16.88) 0.5383 (5.49) 53.9532 (17.02) 0.7603 (14.40) 7;0 18.5174 (0.06) 21 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------- benchmark 'test_frPyObjects': 10 tests ---------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_frPyObjects_np[cpu-uncompr] 1.5113 (1.0) 8.4367 (1.30) 1.5803 (1.0) 0.1131 (1.03) 1.5614 (1.0) 0.0179 (1.38) 2231;4364 632.8041 (1.0) 65561 10
test_frPyObjects_np[cpu-uncompr_list] 1.5213 (1.01) 7.5994 (1.17) 1.5871 (1.00) 0.1101 (1.0) 1.5684 (1.00) 0.0161 (1.24) 2228;4554 630.0904 (1.00) 65347 10
test_frPyObjects_np[cpu-bbox_tensor] 1.6094 (1.06) 6.5128 (1.0) 1.6636 (1.05) 0.1107 (1.01) 1.6455 (1.05) 0.0130 (1.0) 1995;4102 601.0886 (0.95) 62135 10
test_frPyObjects_np[cpu-poly_list] 2.3716 (1.57) 9.6476 (1.48) 2.4430 (1.55) 0.1454 (1.32) 2.4156 (1.55) 0.0171 (1.32) 1706;3746 409.3392 (0.65) 42079 10
test_frPyObjects_np[cpu-complex] 7.0600 (4.67) 43.5660 (6.69) 7.2817 (4.61) 0.7154 (6.50) 7.1910 (4.61) 0.0500 (3.85) 2900;9153 137.3313 (0.22) 141623 1
test_frPyObjects_pt[cpu-uncompr_list] 11.8380 (7.83) 180.7730 (27.76) 12.5424 (7.94) 1.2624 (11.47) 12.3590 (7.92) 0.2010 (15.46) 2453;5458 79.7295 (0.13) 83837 1
test_frPyObjects_pt[cpu-uncompr] 11.8480 (7.84) 144.7290 (22.22) 12.5306 (7.93) 1.2083 (10.98) 12.3490 (7.91) 0.2010 (15.46) 2430;5537 79.8048 (0.13) 84119 1
test_frPyObjects_pt[cpu-bbox_tensor] 110.0160 (72.80) 269.2870 (41.35) 116.9992 (74.04) 8.4958 (77.17) 113.7520 (72.85) 4.6670 (359.00) 1188;1270 8.5471 (0.01) 9103 1
test_frPyObjects_pt[cpu-poly_list] 376.9500 (249.42) 687.5880 (105.57) 403.4248 (255.29) 23.5980 (214.34) 397.6810 (254.70) 21.8805 (>1000.0) 301;165 2.4788 (0.00) 2747 1
test_frPyObjects_pt[cpu-complex] 755.9910 (500.23) 1,002.1940 (153.88) 800.7256 (506.70) 26.9794 (245.06) 795.2015 (509.29) 24.7330 (>1000.0) 296;118 1.2489 (0.00) 1372 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------- benchmark 'test_getAnnIds': 2 tests --------------------------------------------------------------------------------------
Name (time in ns) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_getAnnIds_pt[test_1] 869.3000 (1.0) 12,946.5000 (1.0) 936.7958 (1.0) 119.3491 (1.0) 919.4000 (1.0) 23.0000 (1.20) 3567;4881 1,067.4685 (1.0) 113714 10
test_getAnnIds_np[test_1] 989.5000 (1.14) 27,556.6000 (2.13) 1,053.2087 (1.12) 138.0065 (1.16) 1,038.6000 (1.13) 19.1000 (1.0) 2557;4716 949.4794 (0.89) 100655 10
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------ benchmark 'test_getCatIds': 2 tests ------------------------------------------------------------------------------------
Name (time in ns) Min Max Mean StdDev Median IQR Outliers OPS (Mops/s) Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_getCatIds_pt[test_1] 638.9000 (1.0) 14,752.3000 (1.0) 702.1025 (1.0) 96.3740 (1.0) 690.0000 (1.0) 31.1000 (1.72) 3310;3859 1.4243 (1.0) 149926 10
test_getCatIds_np[test_1] 852.3000 (1.33) 27,510.6000 (1.86) 903.7075 (1.29) 119.7367 (1.24) 891.3000 (1.29) 18.1000 (1.0) 2643;4556 1.1066 (0.78) 116388 10
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------- benchmark 'test_getImgIds': 4 tests ----------------------------------------------------------------------------------------
Name (time in ns) Min Max Mean StdDev Median IQR Outliers OPS (Mops/s) Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_getImgIds_pt[test_all_cats] 519.7000 (1.0) 3,346.0000 (1.0) 550.8612 (1.0) 61.6705 (1.0) 544.8000 (1.0) 10.1000 (1.12) 2365;5241 1.8153 (1.0) 190187 10
test_getImgIds_np[test_all_cats] 621.9000 (1.20) 4,848.3000 (1.45) 651.1183 (1.18) 71.7282 (1.16) 643.9000 (1.18) 9.0000 (1.0) 2233;5404 1.5358 (0.85) 158504 10
test_getImgIds_pt[test_itself] 667.1000 (1.28) 39,664.0000 (11.85) 700.4677 (1.27) 133.4721 (2.16) 691.1000 (1.27) 10.9000 (1.21) 1970;4471 1.4276 (0.79) 148788 10
test_getImgIds_np[test_itself] 669.0000 (1.29) 4,405.7000 (1.32) 702.8072 (1.28) 76.6852 (1.24) 694.0000 (1.27) 9.0000 (1.00) 2351;5527 1.4229 (0.78) 147276 10
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_inputs2_empty_target': 2 tests --------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_inputs2_empty_target_tm 2.9775 (1.0) 3.6411 (1.0) 3.0602 (1.0) 0.0894 (1.0) 3.0261 (1.0) 0.0594 (1.0) 51;49 326.7797 (1.0) 337 1
test_inputs2_empty_target_pt 111.1439 (37.33) 112.7976 (30.98) 111.9934 (36.60) 0.5388 (6.03) 112.0557 (37.03) 0.8789 (14.80) 4;0 8.9291 (0.03) 10 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_inputs3_empty_preds': 2 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_inputs3_empty_preds_tm 3.7493 (1.0) 4.3985 (1.0) 3.8774 (1.0) 0.1038 (1.0) 3.8416 (1.0) 0.0696 (1.0) 38;30 257.9038 (1.0) 266 1
test_inputs3_empty_preds_pt 114.7972 (30.62) 116.4422 (26.47) 115.2304 (29.72) 0.5108 (4.92) 115.0168 (29.94) 0.5002 (7.18) 1;1 8.6783 (0.03) 9 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------- benchmark 'test_iou': 28 tests ---------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_iou_np[cpu-bbox_center_area_same] 2.7195 (1.0) 22.3185 (1.27) 2.8456 (1.00) 0.3006 (1.03) 2.8140 (1.00) 0.0350 (1.15) 2632;7931 351.4201 (1.00) 183554 2
test_iou_np[cpu-bbox_center_area_none] 2.7240 (1.00) 18.5030 (1.05) 2.8402 (1.0) 0.2942 (1.01) 2.8090 (1.0) 0.0350 (1.15) 2560;7865 352.0935 (1.0) 184230 2
test_iou_np[cpu-bbox_center_area_overlap] 2.7245 (1.00) 17.8770 (1.02) 2.8510 (1.00) 0.2959 (1.01) 2.8195 (1.00) 0.0350 (1.15) 2564;7869 350.7506 (1.00) 182883 2
test_iou_np[cpu-bbox_start_area_same] 2.7290 (1.00) 33.4605 (1.91) 2.8556 (1.01) 0.3276 (1.12) 2.8240 (1.01) 0.0350 (1.15) 2568;8529 350.1918 (0.99) 182216 2
test_iou_np[cpu-bbox_full_area_same] 2.7340 (1.01) 24.1115 (1.37) 2.8586 (1.01) 0.2941 (1.01) 2.8290 (1.01) 0.0350 (1.15) 2634;8208 349.8249 (0.99) 181555 2
test_iou_np[cpu-bbox_end_area_same] 2.7490 (1.01) 17.5415 (1.0) 2.8741 (1.01) 0.2925 (1.0) 2.8440 (1.01) 0.0350 (1.15) 2663;8350 347.9381 (0.99) 181885 2
test_iou_np[cpu-bbox_center_area_partial] 2.7490 (1.01) 19.2040 (1.09) 2.8649 (1.01) 0.3006 (1.03) 2.8340 (1.01) 0.0305 (1.0) 2500;9302 349.0502 (0.99) 183218 2
test_iou_np[cpu-full_area_same] 10.5160 (3.87) 163.7780 (9.34) 11.0571 (3.89) 1.1382 (3.89) 10.8960 (3.88) 0.1600 (5.25) 2836;6391 90.4395 (0.26) 94376 1
test_iou_np[cpu-center_area_same] 10.6760 (3.93) 104.2880 (5.95) 11.2168 (3.95) 0.9970 (3.41) 11.0670 (3.94) 0.1500 (4.92) 2759;6482 89.1519 (0.25) 93844 1
test_iou_np[cpu-start_area_same] 10.7160 (3.94) 266.6330 (15.20) 11.2181 (3.95) 1.3084 (4.47) 11.0570 (3.94) 0.1600 (5.25) 2469;6112 89.1419 (0.25) 93319 1
test_iou_np[cpu-end_area_same] 10.7260 (3.94) 234.3540 (13.36) 11.2407 (3.96) 1.1935 (4.08) 11.0870 (3.95) 0.1500 (4.92) 2534;6359 88.9620 (0.25) 93669 1
test_iou_np[cpu-center_area_overlap] 10.7260 (3.94) 149.8660 (8.54) 11.2183 (3.95) 1.1210 (3.83) 11.0660 (3.94) 0.1510 (4.95) 2607;6325 89.1397 (0.25) 92627 1
test_iou_np[cpu-center_area_none] 10.7370 (3.95) 145.2800 (8.28) 11.3618 (4.00) 1.0931 (3.74) 11.2170 (3.99) 0.1510 (4.95) 2603;6547 88.0145 (0.25) 92886 1
test_iou_np[cpu-center_area_partial] 10.7560 (3.96) 99.0200 (5.64) 11.2655 (3.97) 1.0259 (3.51) 11.1070 (3.95) 0.1600 (5.25) 2769;6167 88.7668 (0.25) 92713 1
test_iou_pt[cpu-bbox_start_area_same] 49.8860 (18.34) 1,089.9170 (62.13) 52.9846 (18.66) 8.5387 (29.19) 51.6980 (18.40) 1.1510 (37.74) 1113;2441 18.8734 (0.05) 19781 1
test_iou_pt[cpu-bbox_center_area_same] 50.3660 (18.52) 1,088.5250 (62.05) 53.7277 (18.92) 8.6705 (29.64) 52.3690 (18.64) 1.2020 (39.41) 1142;2434 18.6124 (0.05) 19784 1
test_iou_pt[cpu-bbox_full_area_same] 50.4660 (18.56) 995.2030 (56.73) 53.5005 (18.84) 8.1206 (27.76) 52.2090 (18.59) 1.2320 (40.39) 1135;2374 18.6914 (0.05) 19745 1
test_iou_pt[cpu-bbox_center_area_none] 50.7060 (18.65) 1,043.9660 (59.51) 53.7319 (18.92) 8.4865 (29.01) 52.3690 (18.64) 1.1820 (38.75) 1123;2482 18.6109 (0.05) 19499 1
test_iou_pt[cpu-bbox_center_area_partial] 50.8070 (18.68) 130.0570 (7.41) 53.9153 (18.98) 4.4794 (15.31) 52.6100 (18.73) 1.1510 (37.74) 1474;2471 18.5476 (0.05) 19525 1
test_iou_pt[cpu-bbox_center_area_overlap] 50.8570 (18.70) 1,031.1970 (58.79) 53.7173 (18.91) 8.3415 (28.51) 52.4090 (18.66) 1.0810 (35.44) 1126;2510 18.6160 (0.05) 19590 1
test_iou_pt[cpu-bbox_end_area_same] 50.9670 (18.74) 1,072.7000 (61.15) 54.0475 (19.03) 8.5790 (29.33) 52.7000 (18.76) 1.1520 (37.77) 1143;2424 18.5022 (0.05) 19714 1
test_iou_pt[cpu-full_area_same] 420.5550 (154.64) 699.8070 (39.89) 445.9251 (157.01) 16.4214 (56.13) 443.6700 (157.95) 22.5368 (738.91) 466;25 2.2425 (0.01) 2385 1
test_iou_pt[cpu-center_area_none] 430.9610 (158.47) 646.8270 (36.87) 458.8433 (161.56) 16.1411 (55.18) 456.4590 (162.50) 22.7315 (745.29) 472;30 2.1794 (0.01) 2315 1
test_iou_pt[cpu-start_area_same] 431.5510 (158.69) 1,822.0820 (103.87) 458.1713 (161.32) 32.9456 (112.62) 455.1375 (162.03) 22.2030 (727.97) 53;39 2.1826 (0.01) 2310 1
test_iou_pt[cpu-end_area_same] 432.1630 (158.91) 768.0400 (43.78) 457.4883 (161.08) 17.5240 (59.90) 455.4280 (162.13) 22.3982 (734.37) 378;34 2.1858 (0.01) 2307 1
test_iou_pt[cpu-center_area_same] 432.4430 (159.02) 735.3310 (41.92) 461.2877 (162.42) 17.1192 (58.52) 459.7040 (163.65) 22.6250 (741.80) 399;32 2.1678 (0.01) 2310 1
test_iou_pt[cpu-center_area_overlap] 435.1270 (160.00) 701.0790 (39.97) 461.3412 (162.44) 18.3158 (62.61) 458.8330 (163.34) 22.4230 (735.18) 343;41 2.1676 (0.01) 2294 1
test_iou_pt[cpu-center_area_partial] 441.9070 (162.50) 768.2410 (43.80) 467.0153 (164.43) 18.2173 (62.27) 465.3130 (165.65) 22.7617 (746.29) 335;41 2.1413 (0.01) 2283 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------- benchmark 'test_loadAnns': 2 tests ---------------------------------------------------------------------------------
Name (time in ns) Min Max Mean StdDev Median IQR Outliers OPS (Mops/s) Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_loadAnns_pt[test_1] 174.7600 (1.0) 578.2700 (1.0) 179.2249 (1.0) 11.5451 (1.0) 177.4600 (1.0) 1.1000 (1.0) 1423;3752 5.5796 (1.0) 56764 100
test_loadAnns_np[test_1] 178.5700 (1.02) 953.5400 (1.65) 183.9464 (1.03) 12.4528 (1.08) 182.0700 (1.03) 1.6000 (1.45) 1457;2980 5.4364 (0.97) 55565 100
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------- benchmark 'test_loadCats': 2 tests ----------------------------------------------------------------------------------
Name (time in ns) Min Max Mean StdDev Median IQR Outliers OPS (Mops/s) Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_loadCats_pt[test_1] 164.5500 (1.0) 908.8800 (1.0) 168.9633 (1.0) 13.0418 (1.0) 167.0500 (1.0) 1.3000 (1.0) 1493;3611 5.9184 (1.0) 59967 100
test_loadCats_np[test_1] 169.0600 (1.03) 1,709.3800 (1.88) 175.1822 (1.04) 15.3581 (1.18) 172.9600 (1.04) 1.5100 (1.16) 1609;3373 5.7083 (0.96) 58361 100
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------- benchmark 'test_loadImgs': 2 tests ---------------------------------------------------------------------------------
Name (time in ns) Min Max Mean StdDev Median IQR Outliers OPS (Mops/s) Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_loadImgs_pt[test_1] 174.1600 (1.0) 923.3000 (1.02) 180.1297 (1.0) 12.5122 (1.0) 178.1700 (1.0) 2.0000 (1.11) 1495;2761 5.5516 (1.0) 56507 100
test_loadImgs_np[test_1] 176.3600 (1.01) 904.0700 (1.0) 182.5111 (1.01) 12.5293 (1.00) 180.6700 (1.01) 1.8000 (1.0) 1462;2897 5.4791 (0.99) 55197 100
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_loadPyTorchAnnotations': 2 tests ---------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_loadPyTorchAnnotations_np[test_1] 11.0270 (1.0) 80.2310 (1.0) 11.4408 (1.0) 1.0407 (1.0) 11.2770 (1.0) 0.1000 (1.0) 2810;6925 87.4065 (1.0) 90852 1
test_loadPyTorchAnnotations_pt[test_1] 64.2370 (5.83) 8,738.1300 (108.91) 71.3057 (6.23) 72.9637 (70.11) 68.5730 (6.08) 3.3650 (33.65) 22;1493 14.0241 (0.16) 15661 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_mean_ap_class_metrics': 2 tests --------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_mean_ap_class_metrics_tm 36.2404 (1.0) 37.4196 (1.0) 36.6494 (1.0) 0.2658 (1.0) 36.5542 (1.0) 0.2606 (1.0) 7;2 27.2856 (1.0) 28 1
test_mean_ap_class_metrics_pt 239.5271 (6.61) 243.7385 (6.51) 241.1896 (6.58) 1.6394 (6.17) 241.2529 (6.60) 2.1320 (8.18) 2;0 4.1461 (0.15) 5 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_mean_ap_realistic': 2 tests ------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_mean_ap_realistic_tm 11.1169 (1.0) 13.8730 (1.0) 11.4815 (1.0) 0.4653 (1.0) 11.3269 (1.0) 0.2078 (1.0) 9;9 87.0969 (1.0) 90 1
test_mean_ap_realistic_pt 33.2342 (2.99) 37.1523 (2.68) 35.1254 (3.06) 1.2054 (2.59) 35.1040 (3.10) 2.1206 (10.20) 17;0 28.4695 (0.33) 40 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------ benchmark 'test_mean_ap_stress': 8 tests ------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_mean_ap_stress_tm[4-10] 16.0389 (1.0) 18.6501 (1.0) 16.5120 (1.0) 0.4407 (1.67) 16.3806 (1.0) 0.4385 (1.87) 12;3 60.5619 (1.0) 63 1
test_mean_ap_stress_tm[4-25] 22.9260 (1.43) 24.3215 (1.30) 23.2464 (1.41) 0.2651 (1.01) 23.1790 (1.42) 0.2730 (1.16) 9;2 43.0175 (0.71) 44 1
test_mean_ap_stress_tm[8-25] 33.1728 (2.07) 34.4893 (1.85) 33.5907 (2.03) 0.3039 (1.15) 33.4701 (2.04) 0.2344 (1.0) 9;5 29.7701 (0.49) 31 1
test_mean_ap_stress_tm[4-50] 33.4171 (2.08) 34.5602 (1.85) 33.9442 (2.06) 0.2635 (1.0) 33.9129 (2.07) 0.3438 (1.47) 7;0 29.4601 (0.49) 30 1
test_mean_ap_stress_pt[4-10] 61.0659 (3.81) 63.6482 (3.41) 62.0075 (3.76) 0.6755 (2.56) 61.9287 (3.78) 0.7045 (3.01) 5;1 16.1271 (0.27) 18 1
test_mean_ap_stress_pt[4-25] 95.0905 (5.93) 96.6837 (5.18) 95.7167 (5.80) 0.5369 (2.04) 95.4943 (5.83) 0.8016 (3.42) 4;0 10.4475 (0.17) 11 1
test_mean_ap_stress_pt[4-50] 129.6016 (8.08) 131.1617 (7.03) 130.1708 (7.88) 0.4996 (1.90) 130.0893 (7.94) 0.5996 (2.56) 2;0 7.6822 (0.13) 8 1
test_mean_ap_stress_pt[8-25] 155.7628 (9.71) 571.4044 (30.64) 217.1581 (13.15) 156.2225 (592.82) 158.5907 (9.68) 4.8746 (20.79) 1;1 4.6049 (0.08) 7 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------ benchmark 'test_merge': 30 tests -----------------------------------------------------------------------------------------------------------
Name (time in ns) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_merge_np[cpu-full_area_same] 978.5000 (1.0) 4,561.9000 (1.18) 1,031.7207 (1.00) 90.3728 (1.01) 1,018.5000 (1.00) 12.0000 (1.0) 2753;5372 969.2546 (1.00) 100251 10
test_merge_np[cpu-full_area_same_intersect] 980.5000 (1.00) 9,219.9000 (2.38) 1,028.7350 (1.0) 90.9604 (1.01) 1,016.5000 (1.0) 12.1000 (1.01) 2648;5333 972.0676 (1.0) 100858 10
test_merge_np[cpu-center_area_none_intersect] 1,052.6000 (1.08) 3,879.9000 (1.0) 1,104.7974 (1.07) 91.1790 (1.02) 1,091.6000 (1.07) 12.1000 (1.01) 2608;5195 905.1433 (0.93) 94287 10
test_merge_np[cpu-center_area_same_intersect] 1,056.6000 (1.08) 9,925.0000 (2.56) 1,108.6149 (1.08) 93.4033 (1.04) 1,095.6000 (1.08) 12.1000 (1.01) 2553;5060 902.0265 (0.93) 93844 10
test_merge_np[cpu-end_area_same] 1,058.6000 (1.08) 6,347.6000 (1.64) 1,111.9426 (1.08) 93.2242 (1.04) 1,098.7000 (1.08) 14.0000 (1.17) 2623;4906 899.3270 (0.93) 94913 10
test_merge_np[cpu-end_area_same_intersect] 1,058.6000 (1.08) 4,419.7000 (1.14) 1,106.4802 (1.08) 89.8527 (1.00) 1,093.6000 (1.08) 12.1000 (1.01) 2526;4985 903.7668 (0.93) 93406 10
test_merge_np[cpu-center_area_same] 1,060.6000 (1.08) 10,755.2000 (2.77) 1,119.7230 (1.09) 100.2617 (1.12) 1,104.7000 (1.09) 23.1000 (1.92) 2513;3580 893.0780 (0.92) 93050 10
test_merge_np[cpu-start_area_same] 1,060.6000 (1.08) 17,406.3000 (4.49) 1,114.2540 (1.08) 110.9535 (1.24) 1,100.6000 (1.08) 13.0000 (1.08) 2508;5220 897.4614 (0.92) 94287 10
test_merge_np[cpu-start_area_same_intersect] 1,066.6000 (1.09) 4,679.1000 (1.21) 1,115.1962 (1.08) 89.6386 (1.0) 1,101.7000 (1.08) 13.0000 (1.08) 2574;4993 896.7032 (0.92) 93145 10
test_merge_np[cpu-center_area_overlap_intersect] 1,072.6000 (1.10) 7,133.8000 (1.84) 1,127.6914 (1.10) 96.8003 (1.08) 1,113.7000 (1.10) 13.0000 (1.08) 2587;4955 886.7674 (0.91) 91693 10
test_merge_np[cpu-center_area_none] 1,097.7000 (1.12) 5,271.9000 (1.36) 1,148.8642 (1.12) 91.7015 (1.02) 1,135.7000 (1.12) 14.0000 (1.17) 2537;4795 870.4249 (0.90) 90778 10
test_merge_np[cpu-center_area_partial_intersect] 1,122.7000 (1.15) 9,075.7000 (2.34) 1,171.9150 (1.14) 94.8259 (1.06) 1,157.8000 (1.14) 12.0000 (1.0) 2336;4908 853.3042 (0.88) 83071 10
test_merge_np[cpu-center_area_overlap] 1,145.7000 (1.17) 5,891.9000 (1.52) 1,217.4889 (1.18) 150.4132 (1.68) 1,191.8000 (1.17) 15.1000 (1.26) 3077;5743 821.3627 (0.84) 86453 10
test_merge_np[cpu-center_area_partial] 1,181.8000 (1.21) 6,563.0000 (1.69) 1,246.6115 (1.21) 100.8874 (1.13) 1,231.8000 (1.21) 16.1000 (1.34) 2479;5006 802.1746 (0.83) 84546 10
test_merge_np[cpu-complex] 1,649.5000 (1.69) 7,054.6000 (1.82) 1,725.7540 (1.68) 120.3423 (1.34) 1,705.6000 (1.68) 18.1000 (1.51) 2069;3874 579.4569 (0.60) 60405 10
test_merge_pt[cpu-full_area_same_intersect] 131,930.0001 (134.83) 400,986.0000 (103.35) 141,022.4555 (137.08) 9,598.5659 (107.08) 137,327.9999 (135.10) 6,320.0000 (526.67) 1098;1049 7.0911 (0.01) 7530 1
test_merge_pt[cpu-full_area_same] 132,339.9999 (135.25) 336,609.0000 (86.76) 142,210.3379 (138.24) 9,225.4481 (102.92) 138,630.0000 (136.38) 6,282.2500 (523.52) 1119;1059 7.0318 (0.01) 7505 1
test_merge_pt[cpu-center_area_none_intersect] 141,974.0000 (145.09) 380,094.0000 (97.96) 152,187.2653 (147.94) 9,835.1537 (109.72) 148,324.0001 (145.92) 7,411.7499 (617.65) 1075;832 6.5709 (0.01) 6995 1
test_merge_pt[cpu-end_area_same_intersect] 142,626.0001 (145.76) 292,222.0000 (75.32) 152,459.8838 (148.20) 9,554.4617 (106.59) 148,725.0000 (146.31) 6,952.5000 (579.38) 1075;932 6.5591 (0.01) 6973 1
test_merge_pt[cpu-center_area_overlap_intersect] 143,927.9999 (147.09) 1,099,000.0001 (283.25) 154,089.4095 (149.79) 14,717.1694 (164.18) 150,187.0000 (147.75) 6,997.5000 (583.13) 681;911 6.4897 (0.01) 6931 1
test_merge_pt[cpu-end_area_same] 143,987.0000 (147.15) 328,065.0001 (84.56) 154,201.1542 (149.89) 10,827.3561 (120.79) 150,167.0000 (147.73) 7,178.5001 (598.21) 991;907 6.4850 (0.01) 6879 1
test_merge_pt[cpu-center_area_same_intersect] 144,388.0001 (147.56) 303,508.0000 (78.23) 154,513.4830 (150.20) 9,579.8402 (106.87) 150,808.0001 (148.36) 6,760.0000 (563.33) 1082;976 6.4719 (0.01) 6857 1
test_merge_pt[cpu-start_area_same] 144,549.0000 (147.73) 256,177.0000 (66.03) 155,371.8739 (151.03) 9,505.6287 (106.04) 151,589.0001 (149.13) 7,366.5000 (613.88) 1071;860 6.4362 (0.01) 6836 1
test_merge_pt[cpu-start_area_same_intersect] 144,718.0000 (147.90) 258,591.0000 (66.65) 154,693.9225 (150.37) 9,112.1657 (101.65) 151,048.5000 (148.60) 6,730.0000 (560.83) 1070;931 6.4644 (0.01) 6790 1
test_merge_pt[cpu-center_area_same] 145,690.0000 (148.89) 255,456.0000 (65.84) 154,632.6495 (150.31) 8,985.0693 (100.24) 150,868.0000 (148.42) 6,520.2501 (543.35) 1074;970 6.4669 (0.01) 6793 1
test_merge_pt[cpu-center_area_none] 146,612.0001 (149.83) 338,982.0000 (87.37) 156,829.2535 (152.45) 9,648.6439 (107.64) 152,941.0000 (150.46) 7,376.0000 (614.67) 1070;824 6.3764 (0.01) 6816 1
test_merge_pt[cpu-center_area_overlap] 147,513.0000 (150.75) 334,776.0000 (86.28) 158,082.5213 (153.67) 9,755.6081 (108.83) 154,302.9999 (151.80) 7,361.0000 (613.42) 1072;865 6.3258 (0.01) 6870 1
test_merge_pt[cpu-center_area_partial_intersect] 148,354.0000 (151.61) 339,193.0001 (87.42) 159,083.5934 (154.64) 9,802.9906 (109.36) 155,124.0000 (152.61) 7,572.0000 (631.00) 1041;806 6.2860 (0.01) 6685 1
test_merge_pt[cpu-center_area_partial] 150,818.0001 (154.13) 312,512.0001 (80.55) 160,694.6830 (156.21) 9,173.8097 (102.34) 157,007.0000 (154.46) 7,316.0001 (609.67) 1045;823 6.2230 (0.01) 6628 1
test_merge_pt[cpu-complex] 204,989.0001 (209.49) 354,746.0000 (91.43) 218,695.0614 (212.59) 11,601.7176 (129.43) 214,214.0000 (210.74) 12,228.9999 (>1000.0) 830;127 4.5726 (0.00) 4866 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_missing_gt': 2 tests --------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_missing_gt_tm 1.3922 (1.0) 1.9243 (1.0) 1.4511 (1.0) 0.0714 (1.0) 1.4276 (1.0) 0.0275 (1.0) 95;98 689.1413 (1.0) 719 1
test_missing_gt_pt 99.2748 (71.31) 102.1188 (53.07) 100.2813 (69.11) 0.7818 (10.94) 100.0765 (70.10) 0.3804 (13.81) 3;3 9.9719 (0.01) 11 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------- benchmark 'test_missing_pred': 2 tests ------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_missing_pred_tm 2.1795 (1.0) 2.7847 (1.0) 2.2453 (1.0) 0.0857 (1.0) 2.2149 (1.0) 0.0338 (1.0) 65;74 445.3759 (1.0) 461 1
test_missing_pred_pt 95.6411 (43.88) 97.4500 (34.99) 96.7566 (43.09) 0.5712 (6.66) 96.8253 (43.72) 0.7979 (23.60) 4;0 10.3352 (0.02) 11 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_no_predictions': 2 tests --------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_no_predictions_tm 2.1713 (1.0) 2.7436 (1.0) 2.2435 (1.0) 0.0815 (1.0) 2.2145 (1.0) 0.0345 (1.0) 67;71 445.7292 (1.0) 461 1
test_no_predictions_pt 102.6600 (47.28) 104.4772 (38.08) 103.3970 (46.09) 0.5795 (7.11) 103.3463 (46.67) 0.9432 (27.33) 4;0 9.6715 (0.02) 10 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_perfect_predictions': 2 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_perfect_predictions_tm 3.1350 (1.0) 3.7278 (1.0) 3.2116 (1.0) 0.0855 (1.0) 3.1832 (1.0) 0.0385 (1.0) 44;47 311.3720 (1.0) 320 1
test_perfect_predictions_pt 108.0329 (34.46) 109.8477 (29.47) 108.6392 (33.83) 0.6580 (7.69) 108.4540 (34.07) 0.6759 (17.58) 2;1 9.2048 (0.03) 10 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------- benchmark 'test_rle_fr_bbox': 4 tests ---------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_rle_fr_bbox_pt[cpu-corner_box] 89.7450 (1.0) 778.0760 (1.07) 95.6822 (1.0) 11.6589 (1.07) 92.9610 (1.0) 3.1650 (1.0) 1003;1498 10.4513 (1.0) 11092 1
test_rle_fr_bbox_pt[cpu-single_box] 91.6690 (1.02) 774.2700 (1.07) 97.9784 (1.02) 16.4078 (1.51) 95.0130 (1.02) 3.4782 (1.10) 465;1448 10.2063 (0.98) 11065 1
test_rle_fr_bbox_pt[cpu-multiple_boxes] 94.3230 (1.05) 723.8530 (1.0) 100.7104 (1.05) 10.8791 (1.0) 97.9080 (1.05) 3.7627 (1.19) 1062;1395 9.9295 (0.95) 10631 1
test_rle_fr_bbox_pt[cpu-full_box] 130.4470 (1.45) 893.9900 (1.24) 138.9862 (1.45) 16.9543 (1.56) 135.3340 (1.46) 5.7190 (1.81) 431;1098 7.1950 (0.69) 7676 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------- benchmark 'test_rle_fr_poly': 6 tests ------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_rle_fr_poly_pt[cpu-triangle] 291.4610 (1.0) 507.9680 (1.07) 314.9417 (1.00) 21.5605 (1.16) 307.4600 (1.00) 20.2400 (1.04) 412;273 3.1752 (1.00) 3806 1
test_rle_fr_poly_pt[cpu-rectangle_polygon] 292.1310 (1.00) 626.8070 (1.32) 314.0433 (1.0) 22.0864 (1.19) 306.7740 (1.0) 19.6500 (1.01) 361;189 3.1843 (1.0) 3794 1
test_rle_fr_poly_pt[cpu-simple_polygon] 294.9060 (1.01) 493.1950 (1.04) 316.3433 (1.01) 20.8390 (1.12) 309.3725 (1.01) 19.4800 (1.0) 370;187 3.1611 (0.99) 3738 1
test_rle_fr_poly_pt[cpu-real_small_polygon] 300.5540 (1.03) 476.4710 (1.0) 323.3486 (1.03) 21.9659 (1.18) 315.9280 (1.03) 20.3085 (1.04) 352;184 3.0926 (0.97) 3675 1
test_rle_fr_poly_pt[cpu-complex_polygon] 322.6170 (1.11) 478.0620 (1.00) 346.2451 (1.10) 20.4474 (1.10) 339.8880 (1.11) 20.6615 (1.06) 401;163 2.8881 (0.91) 3412 1
test_rle_fr_poly_pt[cpu-real_large_polygon] 542.7600 (1.86) 867.6920 (1.82) 570.9530 (1.82) 18.5609 (1.0) 570.7030 (1.86) 21.6697 (1.11) 315;40 1.7515 (0.55) 1951 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------- benchmark 'test_rle_fr_string': 5 tests --------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_rle_fr_string_pt[cpu-full_area] 5.6880 (1.0) 365.6020 (5.85) 6.2226 (1.0) 2.7818 (2.62) 6.0900 (1.0) 0.1700 (1.0) 1735;8012 160.7045 (1.0) 176430 1
test_rle_fr_string_pt[cpu-center_area] 8.4720 (1.49) 268.3350 (4.30) 9.0557 (1.46) 2.7712 (2.61) 8.9040 (1.46) 0.2000 (1.18) 1418;5640 110.4279 (0.69) 117606 1
test_rle_fr_string_pt[cpu-simple_rle] 11.0870 (1.95) 62.4750 (1.0) 11.7723 (1.89) 1.0607 (1.0) 11.6180 (1.91) 0.2810 (1.65) 2460;3651 84.9452 (0.53) 89230 1
test_rle_fr_string_pt[cpu-another_complex] 18.5080 (3.25) 69.7050 (1.12) 19.7231 (3.17) 1.2935 (1.22) 19.5090 (3.20) 0.3600 (2.12) 1974;2893 50.7021 (0.32) 54413 1
test_rle_fr_string_pt[cpu-complex_rle] 26.9710 (4.74) 76.9760 (1.23) 29.0151 (4.66) 1.6440 (1.55) 28.7630 (4.72) 0.8220 (4.84) 1999;1837 34.4649 (0.21) 36968 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------ benchmark 'test_rle_merge': 3 tests ------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_rle_merge_pt[cpu-overlap_intersection] 109.5550 (1.0) 738.6350 (2.88) 116.7516 (1.0) 11.3205 (1.36) 113.4310 (1.0) 4.4220 (1.0) 1026;1284 8.5652 (1.0) 9084 1
test_rle_merge_pt[cpu-complex_pair_union] 114.8330 (1.05) 256.4680 (1.0) 122.4182 (1.05) 8.3164 (1.0) 119.2000 (1.05) 4.9680 (1.12) 1179;1194 8.1687 (0.95) 8691 1
test_rle_merge_pt[cpu-complex_multi_union] 148.7750 (1.36) 298.3410 (1.16) 157.9432 (1.35) 10.4923 (1.26) 153.8520 (1.36) 6.9100 (1.56) 983;882 6.3314 (0.74) 6670 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------ benchmark 'test_rle_nms': 5 tests ------------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_rle_nms_pt[cpu-single_mask] 2.0541 (1.0) 7.0015 (1.0) 2.1479 (1.0) 0.1374 (1.0) 2.1242 (1.0) 0.0279 (1.0) 1599;2923 465.5607 (1.0) 48471 10
test_rle_nms_pt[cpu-top_n_only] 525.3830 (255.77) 881.1910 (125.86) 555.2829 (258.52) 19.3794 (141.09) 556.3505 (261.91) 24.3125 (872.20) 376;44 1.8009 (0.00) 1904 1
test_rle_nms_pt[cpu-no_suppression_high_threshold] 534.4780 (260.20) 713.0970 (101.85) 564.0558 (262.60) 17.8574 (130.01) 564.1920 (265.60) 22.7615 (816.56) 403;43 1.7729 (0.00) 1851 1
test_rle_nms_pt[cpu-low_threshold_suppress_many] 541.0970 (263.42) 1,031.0080 (147.26) 568.3051 (264.58) 22.9692 (167.22) 568.0380 (267.41) 19.7640 (709.02) 107;53 1.7596 (0.00) 1857 1
test_rle_nms_pt[cpu-suppress_overlapping] 544.4530 (265.06) 839.3370 (119.88) 570.8151 (265.75) 16.9036 (123.06) 571.3425 (268.97) 19.7200 (707.44) 324;38 1.7519 (0.00) 1834 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------- benchmark 'test_rle_to_string': 5 tests -----------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_rle_to_string_pt[cpu-full_area] 3.1595 (1.0) 68.5835 (3.81) 3.3735 (1.0) 0.3889 (1.0) 3.3300 (1.0) 0.0700 (1.0) 3490;6778 296.4303 (1.0) 157978 2
test_rle_to_string_pt[cpu-end_area] 4.3115 (1.36) 29.4545 (1.64) 4.6367 (1.37) 0.4286 (1.10) 4.5815 (1.38) 0.1005 (1.44) 2959;5087 215.6687 (0.73) 115567 2
test_rle_to_string_pt[cpu-corner_area] 4.3965 (1.39) 18.0070 (1.0) 4.7028 (1.39) 0.4143 (1.07) 4.6470 (1.40) 0.1005 (1.44) 2896;4881 212.6415 (0.72) 112322 2
test_rle_to_string_pt[cpu-from_rle_obj] 5.4680 (1.73) 45.2280 (2.51) 5.9328 (1.76) 0.6637 (1.71) 5.8490 (1.76) 0.1700 (2.43) 3679;6382 168.5552 (0.57) 182883 1
test_rle_to_string_pt[cpu-center_area] 5.5590 (1.76) 152.5910 (8.47) 6.0439 (1.79) 0.7697 (1.98) 5.9590 (1.79) 0.1800 (2.57) 3678;6421 165.4559 (0.56) 178955 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_segm_single_image': 2 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_segm_single_image_tm 2.4719 (1.0) 3.0957 (1.0) 2.5622 (1.0) 0.0864 (1.0) 2.5340 (1.0) 0.0367 (1.0) 54;57 390.2882 (1.0) 404 1
test_segm_single_image_pt 118.0305 (47.75) 119.8703 (38.72) 118.6928 (46.32) 0.5756 (6.66) 118.6349 (46.82) 0.8015 (21.85) 2;0 8.4251 (0.02) 9 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------ benchmark 'test_toBbox': 10 tests -------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_toBbox_np[cpu-full_area] 1.5103 (1.0) 8.0031 (1.30) 1.5795 (1.0) 0.1135 (1.02) 1.5624 (1.0) 0.0181 (1.06) 1789;3982 633.0965 (1.0) 65951 10
test_toBbox_np[cpu-end_area] 1.5524 (1.03) 17.5575 (2.84) 1.6267 (1.03) 0.1307 (1.18) 1.6094 (1.03) 0.0210 (1.24) 1663;3562 614.7368 (0.97) 63480 10
test_toBbox_np[cpu-center_area] 1.5603 (1.03) 6.3546 (1.03) 1.6308 (1.03) 0.1115 (1.01) 1.6144 (1.03) 0.0220 (1.29) 1798;3504 613.2068 (0.97) 63440 10
test_toBbox_np[cpu-start_area] 1.5624 (1.03) 6.1743 (1.0) 1.6381 (1.04) 0.1109 (1.0) 1.6205 (1.04) 0.0170 (1.0) 1793;4086 610.4698 (0.96) 63396 10
test_toBbox_np[cpu-rect_area] 1.6905 (1.12) 7.4372 (1.20) 1.7670 (1.12) 0.1161 (1.05) 1.7486 (1.12) 0.0200 (1.18) 1691;3635 565.9378 (0.89) 58019 10
test_toBbox_pt[cpu-full_area] 59.7300 (39.55) 1,047.1720 (169.60) 64.5670 (40.88) 13.8908 (125.20) 62.5350 (40.02) 1.9120 (112.47) 782;2395 15.4878 (0.02) 16734 1
test_toBbox_pt[cpu-end_area] 61.9530 (41.02) 1,218.3910 (197.33) 67.2683 (42.59) 15.4977 (139.68) 65.0490 (41.63) 2.1030 (123.71) 693;2219 14.8659 (0.02) 15897 1
test_toBbox_pt[cpu-center_area] 62.8150 (41.59) 1,097.8480 (177.81) 67.6798 (42.85) 10.1269 (91.27) 65.6900 (42.04) 2.0130 (118.41) 1145;2243 14.7754 (0.02) 15875 1
test_toBbox_pt[cpu-start_area] 62.8550 (41.62) 1,119.9320 (181.39) 68.0792 (43.10) 10.4647 (94.32) 66.0390 (42.27) 2.1340 (125.53) 1119;2315 14.6888 (0.02) 15787 1
test_toBbox_pt[cpu-rect_area] 71.4180 (47.29) 1,023.2060 (165.72) 76.7054 (48.56) 13.0223 (117.37) 74.4220 (47.63) 2.2335 (131.38) 913;2015 13.0369 (0.02) 13928 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
================================= pytest-park ==================================
debug: benchmark storage: /home/runner/work/pytorchcocotools/pytorchcocotools/.benchmarks
debug: reference file: none (no saved benchmark file found)
debug: candidate payloads collected: 278
debug: candidate run_id: current cases: 278
debug: original_postfixes: ['_np', '_tm'] (conftest.py)
debug: reference_postfixes: ['_pt'] (conftest.py)
debug: group_by: ['custom', 'group']
debug: benchmark_compare: []
debug: benchmark_save: current
Warning: No reference benchmark file found. Run with --benchmark-save or --benchmark-autosave first to enable regression comparison.
Postfix Comparison: _np,_tm vs _pt
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Method ┃ Original (_np,_tm) ┃ Reference (_pt) ┃ Args ┃ Avg Time ┃ Avg % ┃ Median Time ┃ Median % ┃ Min Time ┃ Min % ┃ Max Time ┃ Max % ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ test_accumulate │ test_accumulate_np │ test_accumulate_pt │ 2/2 │ -0.0003s │ -11.1825% │ -0.0003s │ -11.2285% │ -0.0003s │ -11.6763% │ -0.0002s │ -5.4649% │
│ test_annToMask │ test_annToMask_np │ test_annToMask_pt │ 1/1 │ +0.0017s │ +972.5583% │ +0.0017s │ +980.2116% │ +0.0016s │ +950.2285% │ +0.0018s │ +407.1718% │
│ test_annToRLE │ test_annToRLE_np │ test_annToRLE_pt │ 1/1 │ +0.0011s │ +11515.0898% │ +0.0011s │ +11637.8828% │ +0.0010s │ +11592.0014% │ +0.0012s │ +833.1297% │
│ test_area │ test_area_np │ test_area_pt │ 4/4 │ +0.0000s │ +1408.4143% │ +0.0000s │ +1479.0848% │ +0.0000s │ +1407.1093% │ +0.0002s │ +2225.6553% │
│ test_bb_iou │ N/A │ test_bb_iou_pt │ 0/5 │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │
│ test_bb_nms │ N/A │ test_bb_nms_pt │ 0/5 │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │
│ test_bbox_class_metrics │ test_bbox_class_metrics_tm │ test_bbox_class_metrics_pt │ 1/1 │ +0.1837s │ +1540.8062% │ +0.1835s │ +1545.4025% │ +0.1819s │ +1550.6922% │ +0.1848s │ +1463.9520% │
│ test_bbox_custom_iou_thresholds │ test_bbox_custom_iou_threshold… │ test_bbox_custom_iou_thresholds… │ 1/1 │ +0.0790s │ +3996.1745% │ +0.0789s │ +4051.0485% │ +0.0784s │ +4099.2028% │ +0.0795s │ +3208.6675% │
│ test_bbox_custom_rec_thresholds │ test_bbox_custom_rec_threshold… │ test_bbox_custom_rec_thresholds… │ 1/1 │ +0.0827s │ +3806.2958% │ +0.0827s │ +3857.0428% │ +0.0820s │ +3906.1477% │ +0.0827s │ +2617.2582% │
│ test_bbox_micro_average │ test_bbox_micro_average_tm │ test_bbox_micro_average_pt │ 1/1 │ +0.0754s │ +1780.6492% │ +0.0755s │ +1797.4174% │ +0.0747s │ +1814.4674% │ +0.0754s │ +1557.0217% │
│ test_bbox_multi_image │ test_bbox_multi_image_tm │ test_bbox_multi_image_pt │ 1/1 │ +0.0680s │ +1134.0818% │ +0.0681s │ +1142.7178% │ +0.0670s │ +1140.6814% │ +0.0687s │ +1044.7013% │
│ test_bbox_realistic_inputs │ test_bbox_realistic_inputs_tm │ test_bbox_realistic_inputs_pt │ 1/1 │ +0.0938s │ +985.4091% │ +0.0937s │ +986.9736% │ +0.0933s │ +998.4186% │ +0.0941s │ +926.8640% │
│ test_bbox_single_image │ test_bbox_single_image_tm │ test_bbox_single_image_pt │ 1/1 │ +0.0623s │ +2149.5532% │ +0.0624s │ +2175.2640% │ +0.0614s │ +2177.8533% │ +0.0630s │ +1801.2373% │
│ test_computeIoU │ test_computeIoU_np │ test_computeIoU_pt │ 9/9 │ +0.0002s │ +1110.1143% │ +0.0001s │ +600.9567% │ +0.0002s │ +1090.1273% │ +0.0004s │ +573.2446% │
│ test_computeOks │ test_computeOks_np │ test_computeOks_pt │ 1/1 │ +0.0000s │ +88.1255% │ +0.0000s │ +86.3572% │ +0.0000s │ +83.9622% │ +0.0007s │ +963.5272% │
│ test_compute_25_50_boxes │ test_compute_25_50_boxes_tm │ test_compute_25_50_boxes_pt │ 2/2 │ +0.1784s │ +621.9880% │ +0.1786s │ +623.5261% │ +0.1780s │ +632.2695% │ +0.1783s │ +604.5235% │
│ test_compute_class_metrics_large │ test_compute_class_metrics_lar… │ test_compute_class_metrics_larg… │ 1/1 │ +0.6201s │ +1160.7919% │ +0.6204s │ +1163.4413% │ +0.6169s │ +1160.6247% │ +0.6230s │ +1157.4697% │
│ test_compute_many_images │ test_compute_many_images_tm │ test_compute_many_images_pt │ 1/1 │ +0.2270s │ +601.9874% │ +0.2265s │ +603.8530% │ +0.2261s │ +611.0346% │ +0.2272s │ +569.0105% │
│ test_custom_iou_thresholds_map5… │ test_custom_iou_thresholds_map… │ test_custom_iou_thresholds_map5… │ 1/1 │ +0.0585s │ +2959.5117% │ +0.0587s │ +3014.5981% │ +0.0572s │ +3001.7381% │ +0.0591s │ +2322.2855% │
│ test_dataset │ test_dataset_np │ test_dataset_pt │ 1/1 │ +0.0022s │ +95.0472% │ +0.0022s │ +99.2700% │ +0.0022s │ +98.2070% │ +0.0020s │ +76.7905% │
│ test_decode │ test_decode_np │ test_decode_pt │ 8/8 │ +0.0002s │ +212.4430% │ +0.0002s │ +212.7032% │ +0.0002s │ +203.1386% │ +0.0003s │ +178.9655% │
│ test_empty_ground_truths │ test_empty_ground_truths_tm │ test_empty_ground_truths_pt │ 1/1 │ +0.0915s │ +6288.1645% │ +0.0915s │ +6404.4412% │ +0.0908s │ +6522.5934% │ +0.0921s │ +4822.1575% │
│ test_empty_preds │ test_empty_preds_tm │ test_empty_preds_pt │ 1/1 │ +0.0892s │ +3987.7478% │ +0.0888s │ +4019.6040% │ +0.0878s │ +4051.1953% │ +0.0905s │ +3321.9480% │
│ test_encode │ test_encode_np │ test_encode_pt │ 8/8 │ +0.0001s │ +322.2475% │ +0.0001s │ +261.0957% │ +0.0001s │ +303.2070% │ +0.0004s │ +506.1157% │
│ test_evaluate │ test_evaluate_np │ test_evaluate_pt │ 3/3 │ +0.0041s │ +979.6583% │ +0.0036s │ +893.6981% │ +0.0040s │ +1008.3642% │ +0.0052s │ +758.4420% │
│ test_evaluateImg │ test_evaluateImg_np │ test_evaluateImg_pt │ 5/5 │ +0.0002s │ +1041.9010% │ +0.0002s │ +1011.9689% │ +0.0002s │ +1027.5377% │ +0.0007s │ +412.2535% │
│ test_for_box_format │ test_for_box_format_tm │ test_for_box_format_pt │ 3/3 │ +0.0442s │ +1366.0175% │ +0.0446s │ +1402.9154% │ +0.0430s │ +1368.2527% │ +0.0445s │ +1069.3747% │
│ test_frPyObjects │ test_frPyObjects_np │ test_frPyObjects_pt │ 5/5 │ +0.0003s │ +9148.8230% │ +0.0001s │ +6812.9140% │ +0.0003s │ +8900.1350% │ +0.0004s │ +2915.4377% │
│ test_getAnnIds │ test_getAnnIds_np │ test_getAnnIds_pt │ 1/1 │ -0.0000s │ -11.0532% │ -0.0000s │ -11.4770% │ -0.0000s │ -12.1475% │ -0.0000s │ -53.0185% │
│ test_getCatIds │ test_getCatIds_np │ test_getCatIds_pt │ 1/1 │ -0.0000s │ -22.3087% │ -0.0000s │ -22.5850% │ -0.0000s │ -25.0381% │ -0.0000s │ -46.3759% │
│ test_getImgIds │ test_getImgIds_np │ test_getImgIds_pt │ 2/2 │ -0.0000s │ -7.5777% │ -0.0000s │ -7.6239% │ -0.0000s │ -8.0641% │ +0.0000s │ +364.7720% │
│ test_inputs2_empty_target │ test_inputs2_empty_target_tm │ test_inputs2_empty_target_pt │ 1/1 │ +0.1089s │ +3559.7177% │ +0.1090s │ +3602.9744% │ +0.1082s │ +3632.8090% │ +0.1092s │ +2997.8560% │
│ test_inputs3_empty_preds │ test_inputs3_empty_preds_tm │ test_inputs3_empty_preds_pt │ 1/1 │ +0.1114s │ +2871.8350% │ +0.1112s │ +2893.9575% │ +0.1110s │ +2961.8283% │ +0.1120s │ +2547.2904% │
│ test_iou │ test_iou_np │ test_iou_pt │ 14/14 │ +0.0002s │ +3537.7811% │ +0.0002s │ +3512.5910% │ +0.0002s │ +3495.1161% │ +0.0008s │ +856.7419% │
│ test_loadAnns │ test_loadAnns_np │ test_loadAnns_pt │ 1/1 │ -0.0000s │ -2.5668% │ -0.0000s │ -2.5320% │ -0.0000s │ -2.1336% │ -0.0000s │ -39.3555% │
│ test_loadCats │ test_loadCats_np │ test_loadCats_pt │ 1/1 │ -0.0000s │ -3.5500% │ -0.0000s │ -3.4170% │ -0.0000s │ -2.6677% │ -0.0000s │ -46.8298% │
│ test_loadImgs │ test_loadImgs_np │ test_loadImgs_pt │ 1/1 │ -0.0000s │ -1.3048% │ -0.0000s │ -1.3837% │ -0.0000s │ -1.2474% │ +0.0000s │ +2.1270% │
│ test_loadPyTorchAnnotations │ test_loadPyTorchAnnotations_np │ test_loadPyTorchAnnotations_pt │ 1/1 │ +0.0001s │ +523.2580% │ +0.0001s │ +508.0784% │ +0.0001s │ +482.5428% │ +0.0087s │ +10791.2141% │
│ test_mean_ap_class_metrics │ test_mean_ap_class_metrics_tm │ test_mean_ap_class_metrics_pt │ 1/1 │ +0.2045s │ +558.0995% │ +0.2047s │ +559.9874% │ +0.2033s │ +560.9403% │ +0.2063s │ +551.3658% │
│ test_mean_ap_realistic │ test_mean_ap_realistic_tm │ test_mean_ap_realistic_pt │ 1/1 │ +0.0236s │ +205.9308% │ +0.0238s │ +209.9160% │ +0.0221s │ +198.9526% │ +0.0233s │ +167.8036% │
│ test_mean_ap_stress │ test_mean_ap_stress_tm │ test_mean_ap_stress_pt │ 4/4 │ +0.0994s │ +370.7219% │ +0.0845s │ +298.2123% │ +0.0840s │ +318.2859% │ +0.1877s │ +670.2995% │
│ test_merge │ test_merge_np │ test_merge_pt │ 15/15 │ +0.0002s │ +13451.4653% │ +0.0001s │ +13594.1091% │ +0.0001s │ +13205.2298% │ +0.0004s │ +4883.6360% │
│ test_missing_gt │ test_missing_gt_tm │ test_missing_gt_pt │ 1/1 │ +0.0988s │ +6810.8011% │ +0.0986s │ +6910.2402% │ +0.0979s │ +7030.9721% │ +0.1002s │ +5206.8670% │
│ test_missing_pred │ test_missing_pred_tm │ test_missing_pred_pt │ 1/1 │ +0.0945s │ +4209.3054% │ +0.0946s │ +4271.5936% │ +0.0935s │ +4288.2278% │ +0.0947s │ +3399.4348% │
│ test_no_predictions │ test_no_predictions_tm │ test_no_predictions_pt │ 1/1 │ +0.1012s │ +4508.7076% │ +0.1011s │ +4566.7287% │ +0.1005s │ +4628.1335% │ +0.1017s │ +3707.9710% │
│ test_perfect_predictions │ test_perfect_predictions_tm │ test_perfect_predictions_pt │ 1/1 │ +0.1054s │ +3282.7194% │ +0.1053s │ +3307.0893% │ +0.1049s │ +3346.0305% │ +0.1061s │ +2846.7254% │
│ test_rle_fr_bbox │ N/A │ test_rle_fr_bbox_pt │ 0/4 │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │
│ test_rle_fr_poly │ N/A │ test_rle_fr_poly_pt │ 0/6 │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │
│ test_rle_fr_string │ N/A │ test_rle_fr_string_pt │ 0/5 │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │
│ test_rle_merge │ N/A │ test_rle_merge_pt │ 0/3 │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │
│ test_rle_nms │ N/A │ test_rle_nms_pt │ 0/5 │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │
│ test_rle_to_string │ N/A │ test_rle_to_string_pt │ 0/5 │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │ N/A │
│ test_segm_single_image │ test_segm_single_image_tm │ test_segm_single_image_pt │ 1/1 │ +0.1161s │ +4532.4416% │ +0.1161s │ +4581.7953% │ +0.1156s │ +4674.9403% │ +0.1168s │ +3772.1730% │
│ test_toBbox │ test_toBbox_np │ test_toBbox_pt │ 5/5 │ +0.0001s │ +4077.3384% │ +0.0001s │ +3969.0040% │ +0.0001s │ +3947.4232% │ +0.0011s │ +11995.2079% │
├──────────────────────────────────┼─────────────────────────────────┼──────────────────────────────────┼───────┼──────────┼──────────────┼─────────────┼──────────────┼──────────┼──────────────┼──────────┼──────────────┤
│ Overall │ - │ - │ - │ +0.0658s │ +2428.5691% │ +0.0342s │ +1153.0796% │ +0.0650s │ +2443.6445% │ +0.0684s │ +1976.2532% │
└──────────────────────────────────┴─────────────────────────────────┴──────────────────────────────────┴───────┴──────────┴──────────────┴─────────────┴──────────────┴──────────┴──────────────┴──────────┴──────────────┘
================= 278 passed, 309 skipped in 893.02s (0:14:53) =================
Results for commit b9d81a1.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Bumps tornado from 6.5.4 to 6.5.5.
Changelog
Sourced from tornado's changelog.
... (truncated)
Commits
7d64650Merge pull request #3586 from bdarnell/update-cibwd05d59bbuild: Bump cibuildwheel to 3.4.0c2f4673Merge pull request #3585 from bdarnell/release-655e5f1aa4Release notes and version bump for v6.5.578a046fhttputil: Add CRLF to _FORBIDDEN_HEADER_CHARS_RE24a2d96web: Validate characters in all cookie attributes.119a195httputil: Add limits on multipart form data parsing