67 KiB
67 KiB
| 1 | Network model | Release | IE-Type | Platform name | Throughput-INT8 | ThroughputFP16 | ThroughputFP32 | Value | Efficiency | Price | TDP | Sockets | Price/socket | TDP/socket | Latency | UOM_T | UOM_V | UOM_E | UOM_L |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 3 | bert-base-cased | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 11.35 | 4.27 | 0.106093669 | 0.756801503 | 107 | 15 | 1 | 107 | 15 | 88.11 | FPS | FPS/$ | FPS/TDP | msec. | |
| 4 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 21.38 | 15.11 | 0.182727309 | 0.328909156 | 117 | 65 | 1 | 117 | 65 | 48.47 | FPS | FPS/$ | FPS/TDP | msec. | |
| 5 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 32.23 | 20.26 | 0.15061144 | 0.495859202 | 214 | 65 | 1 | 214 | 65 | 36.18 | FPS | FPS/$ | FPS/TDP | msec. | |
| 6 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 113.18 | 45.08 | 0.344024364 | 0.905472125 | 329 | 125 | 1 | 329 | 125 | 17.43 | FPS | FPS/$ | FPS/TDP | msec. | |
| 7 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 34.34 | 24.04 | 0.178867029 | 0.528345686 | 192 | 65 | 1 | 192 | 65 | 30.88 | FPS | FPS/$ | FPS/TDP | msec. | |
| 8 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 51.27 | 18.44 | 0.120345681 | 1.830973571 | 426 | 28 | 1 | 426 | 28 | 23.31 | FPS | FPS/$ | FPS/TDP | msec. | |
| 9 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 37.98 | 13.59 | 0.077518083 | 1.356566444 | 490 | 28 | 1 | 490 | 28 | 29.22 | FPS | FPS/$ | FPS/TDP | msec. | |
| 10 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 27.60 | 17.56 | 0.091086845 | 0.788551831 | 303 | 35 | 1 | 303 | 35 | 42.83 | FPS | FPS/$ | FPS/TDP | msec. | |
| 11 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 34.12 | 20.30 | 0.069915909 | 0.974827538 | 488 | 35 | 1 | 488 | 35 | 37.09 | FPS | FPS/$ | FPS/TDP | msec. | |
| 12 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 53.08 | 19.48 | 0.097575059 | 1.516595204 | 544 | 35 | 1 | 544 | 35 | 23.07 | FPS | FPS/$ | FPS/TDP | msec. | |
| 13 | bert-base-cased | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 163.20 | 66.23 | 0.272459575 | 1.305626285 | 599 | 125 | 1 | 599 | 125 | 13.68 | FPS | FPS/$ | FPS/TDP | msec. | |
| 14 | bert-base-cased | OV-2023.1 | atom | Intel® Processor N-200 | 1.65 | 0.83 | 0.008529061 | 0.274351466 | 193 | 6 | 1 | 193 | 6 | 641.46 | FPS | FPS/$ | FPS/TDP | msec. | |
| 15 | bert-base-cased | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 51.01 | 29.43 | 0.08587761 | 0.408090401 | 594 | 125 | 1 | 594 | 125 | 28.93 | FPS | FPS/$ | FPS/TDP | msec. | |
| 16 | bert-base-cased | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 20.86 | 14.80 | 0.068171185 | 0.293808206 | 306 | 71 | 1 | 306 | 71 | 49.41 | FPS | FPS/$ | FPS/TDP | msec. | |
| 17 | bert-base-cased | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 217.83 | 80.66 | 0.069284052 | 1.037281242 | 3144 | 210 | 2 | 1572 | 105 | 13.64 | FPS | FPS/$ | FPS/TDP | msec. | |
| 18 | bert-base-cased | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 572.10 | 224.73 | 0.033744047 | 1.395357512 | 16954 | 410 | 2 | 8477 | 205 | 7.81 | FPS | FPS/$ | FPS/TDP | msec. | |
| 19 | bert-base-cased | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 872.62 | 338.47 | 0.04661922 | 1.61596031 | 18718 | 540 | 2 | 9359 | 270 | 43.32 | FPS | FPS/$ | FPS/TDP | msec. | |
| 20 | bert-base-cased | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 3255.60 | 505.88 | 0.095752851 | 4.650852741 | 34000 | 700 | 2 | 17000 | 350 | 4.08 | FPS | FPS/$ | FPS/TDP | msec. | |
| 21 | bert-base-cased | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 204.84 | 76.40 | 0.101307066 | 1.024214437 | 2022 | 200 | 2 | 1011 | 100 | 14.24 | FPS | FPS/$ | FPS/TDP | msec. | |
| 22 | bert-base-cased | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 426.78 | 167.54 | 0.187678462 | 1.422602743 | 2274 | 300 | 2 | 1137 | 150 | 8.09 | FPS | FPS/$ | FPS/TDP | msec. | |
| 23 | bert-base-cased | OV-2023.1 | accel | Intel® Flex-170 | 842.00 | 683.21 | 1 | 18.63 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 24 | bert-base-cased | OV-2023.1 | accel | Intel® Flex-140 | 174.28 | 123.71 | 1 | 91.68 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 25 | bert-base-cased | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 45.83 | 31.96 | 0.428279604 | 3.055061174 | 107 | 15 | 1 | 107 | 15 | 87.12 | FPS | FPS/$ | FPS/TDP | msec. | |
| 26 | bert-base-cased | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 73.09 | 55.44 | 0.149162436 | 2.610342624 | 490 | 28 | 1 | 490 | 28 | 54.56 | FPS | FPS/$ | FPS/TDP | msec. | |
| 27 | bert-base-cased | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 3.37 | 2.36 | 0.017448724 | 0.561267278 | 193 | 6 | 1 | 193 | 6 | 1185.78 | FPS | FPS/$ | FPS/TDP | msec. | |
| 28 | bert-base-cased | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 84.42 | 60.51 | 0.198161663 | 3.014888156 | 426 | 28 | 1 | 426 | 28 | 46.90 | FPS | FPS/$ | FPS/TDP | msec. | |
| 29 | bert-base-cased | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 46.67 | 23.26 | 0.436174206 | 3.111376 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 30 | bert-base-cased | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 73.20 | 31.70 | 0.149385536 | 2.614246884 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 31 | bert-base-cased | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 4.43 | 2.03 | 0.022934748 | 0.7377344 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 32 | bert-base-cased | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 83.69 | 37.23 | 0.196445915 | 2.988784286 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 33 | end_rec | ||||||||||||||||||
| 34 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 35 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 1.18 | 0.38 | 0.011017319 | 0.078590206 | 107 | 15 | 1 | 107 | 15 | 863.34 | FPS | FPS/$ | FPS/TDP | msec. | |
| 36 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 2.09 | 1.33 | 0.017880344 | 0.032184618 | 117 | 65 | 1 | 117 | 65 | 492.10 | FPS | FPS/$ | FPS/TDP | msec. | |
| 37 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 2.97 | 1.87 | 0.013882493 | 0.045705439 | 214 | 65 | 1 | 214 | 65 | 347.78 | FPS | FPS/$ | FPS/TDP | msec. | |
| 38 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 9.93 | 3.74 | 0.030176091 | 0.079423471 | 329 | 125 | 1 | 329 | 125 | 155.72 | FPS | FPS/$ | FPS/TDP | msec. | |
| 39 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 3.36 | 2.13 | 0.017518449 | 0.051746803 | 192 | 65 | 1 | 192 | 65 | 302.24 | FPS | FPS/$ | FPS/TDP | msec. | |
| 40 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 5.09 | 1.63 | 0.011951214 | 0.181829179 | 426 | 28 | 1 | 426 | 28 | 219.77 | FPS | FPS/$ | FPS/TDP | msec. | |
| 41 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 3.79 | 1.22 | 0.007726669 | 0.135216715 | 490 | 28 | 1 | 490 | 28 | 266.14 | FPS | FPS/$ | FPS/TDP | msec. | |
| 42 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 2.71 | 1.61 | 0.008936965 | 0.077368581 | 303 | 35 | 1 | 303 | 35 | 412.44 | FPS | FPS/$ | FPS/TDP | msec. | |
| 43 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 3.35 | 1.83 | 0.006861724 | 0.095672042 | 488 | 35 | 1 | 488 | 35 | 327.59 | FPS | FPS/$ | FPS/TDP | msec. | |
| 44 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 5.06 | 1.75 | 0.009296462 | 0.144493584 | 544 | 35 | 1 | 544 | 35 | 210.96 | FPS | FPS/$ | FPS/TDP | msec. | |
| 45 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 15.19 | 5.91 | 0.025358635 | 0.12151858 | 599 | 125 | 1 | 599 | 125 | 113.61 | FPS | FPS/$ | FPS/TDP | msec. | |
| 46 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | atom | Intel® Processor N-200 | 0.16 | 0.08 | 0.000828224 | 0.0266412 | 193 | 6 | 1 | 193 | 6 | 6367.32 | FPS | FPS/$ | FPS/TDP | msec. | |
| 47 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 4.66 | 2.88 | 0.007842661 | 0.037268324 | 594 | 125 | 1 | 594 | 125 | 224.55 | FPS | FPS/$ | FPS/TDP | msec. | |
| 48 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 2.11 | 1.34 | 0.006898006 | 0.029729433 | 306 | 71 | 1 | 306 | 71 | 486.76 | FPS | FPS/$ | FPS/TDP | msec. | |
| 49 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 21.27 | 6.90 | 0.006764356 | 0.101272067 | 3144 | 210 | 2 | 1572 | 105 | 103.38 | FPS | FPS/$ | FPS/TDP | msec. | |
| 50 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 50.91 | 17.71 | 0.003002727 | 0.124166415 | 16954 | 410 | 2 | 8477 | 205 | 63.45 | FPS | FPS/$ | FPS/TDP | msec. | |
| 51 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 67.03 | 27.69 | 0.003581195 | 0.124134843 | 18718 | 540 | 2 | 9359 | 270 | 253.77 | FPS | FPS/$ | FPS/TDP | msec. | |
| 52 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 251.10 | 47.69 | 0.007385431 | 0.358720946 | 34000 | 700 | 2 | 17000 | 350 | 36.69 | FPS | FPS/$ | FPS/TDP | msec. | |
| 53 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 20.81 | 6.64 | 0.010291168 | 0.104043704 | 2022 | 200 | 2 | 1011 | 100 | 106.83 | FPS | FPS/$ | FPS/TDP | msec. | |
| 54 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 38.76 | 14.75 | 0.017046987 | 0.129216158 | 2274 | 300 | 2 | 1137 | 150 | 237.83 | FPS | FPS/$ | FPS/TDP | msec. | |
| 55 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | accel | Intel® Flex-170 | 144.12 | 101.13 | 1 | 110.90 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 56 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | accel | Intel® Flex-140 | 29.97 | 20.57 | 1 | 534.35 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 57 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 4.66 | 3.35 | 0.043581125 | 0.31087869 | 107 | 15 | 1 | 107 | 15 | 820.82 | FPS | FPS/$ | FPS/TDP | msec. | |
| 58 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 5.11 | 5.77 | 0.010428379 | 0.182496635 | 490 | 28 | 1 | 490 | 28 | 745.40 | FPS | FPS/$ | FPS/TDP | msec. | |
| 59 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 0.34 | 0.23 | 0.00174067 | 0.055991537 | 193 | 6 | 1 | 193 | 6 | 11899.92 | FPS | FPS/$ | FPS/TDP | msec. | |
| 60 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 9.13 | 6.65 | 0.021425568 | 0.325974707 | 426 | 28 | 1 | 426 | 28 | 449.68 | FPS | FPS/$ | FPS/TDP | msec. | |
| 61 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 5.20 | 2.33 | 0.048610495 | 0.346754867 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 62 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 3.87 | 2.23 | 0.007899318 | 0.138238071 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 63 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 0.44 | 0.17 | 0.002288653 | 0.073618327 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 64 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 8.63 | 3.52 | 0.02025661 | 0.308189857 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 65 | end_rec | ||||||||||||||||||
| 66 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 67 | deeplabv3 | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 11.86 | 4.61 | 0.11084032 | 0.79066095 | 107 | 15 | 1 | 107 | 15 | 85.88 | FPS | FPS/$ | FPS/TDP | msec. | |
| 68 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 22.85 | 14.48 | 0.195256904 | 0.351462427 | 117 | 65 | 1 | 117 | 65 | 43.93 | FPS | FPS/$ | FPS/TDP | msec. | |
| 69 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 34.47 | 16.42 | 0.161068212 | 0.530286114 | 214 | 65 | 1 | 214 | 65 | 33.07 | FPS | FPS/$ | FPS/TDP | msec. | |
| 70 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 94.13 | 42.32 | 0.286105004 | 0.753028371 | 329 | 125 | 1 | 329 | 125 | 16.23 | FPS | FPS/$ | FPS/TDP | msec. | |
| 71 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 37.18 | 21.16 | 0.193650962 | 0.572015148 | 192 | 65 | 1 | 192 | 65 | 27.36 | FPS | FPS/$ | FPS/TDP | msec. | |
| 72 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 52.88 | 16.51 | 0.124135164 | 1.888627857 | 426 | 28 | 1 | 426 | 28 | 19.87 | FPS | FPS/$ | FPS/TDP | msec. | |
| 73 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 30.78 | 9.65 | 0.062807791 | 1.099136335 | 490 | 28 | 1 | 490 | 28 | 31.13 | FPS | FPS/$ | FPS/TDP | msec. | |
| 74 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 32.02 | 18.34 | 0.105688204 | 0.914957883 | 303 | 35 | 1 | 303 | 35 | 37.47 | FPS | FPS/$ | FPS/TDP | msec. | |
| 75 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 40.36 | 18.54 | 0.082712269 | 1.153245355 | 488 | 35 | 1 | 488 | 35 | 27.15 | FPS | FPS/$ | FPS/TDP | msec. | |
| 76 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 57.69 | 22.51 | 0.106053446 | 1.648373567 | 544 | 35 | 1 | 544 | 35 | 21.75 | FPS | FPS/$ | FPS/TDP | msec. | |
| 77 | deeplabv3 | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 148.87 | 57.81 | 0.248526818 | 1.190940511 | 599 | 125 | 1 | 599 | 125 | 12.44 | FPS | FPS/$ | FPS/TDP | msec. | |
| 78 | deeplabv3 | OV-2023.1 | atom | Intel® Processor N-200 | 1.72 | 1.01 | 0.008897382 | 0.286199128 | 193 | 6 | 1 | 193 | 6 | 595.26 | FPS | FPS/$ | FPS/TDP | msec. | |
| 79 | deeplabv3 | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 51.51 | 19.39 | 0.086713894 | 0.412064422 | 594 | 125 | 1 | 594 | 125 | 21.10 | FPS | FPS/$ | FPS/TDP | msec. | |
| 80 | deeplabv3 | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 22.69 | 15.40 | 0.074145796 | 0.319557937 | 306 | 71 | 1 | 306 | 71 | 43.78 | FPS | FPS/$ | FPS/TDP | msec. | |
| 81 | deeplabv3 | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 190.40 | 77.08 | 0.060561308 | 0.906689304 | 3144 | 210 | 2 | 1572 | 105 | 11.76 | FPS | FPS/$ | FPS/TDP | msec. | |
| 82 | deeplabv3 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 416.77 | 155.13 | 0.024582207 | 1.016504228 | 16954 | 410 | 2 | 8477 | 205 | 5.66 | FPS | FPS/$ | FPS/TDP | msec. | |
| 83 | deeplabv3 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 584.92 | 227.30 | 0.031248866 | 1.083178298 | 18718 | 540 | 2 | 9359 | 270 | 3.70 | FPS | FPS/$ | FPS/TDP | msec. | |
| 84 | deeplabv3 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 999.22 | 380.82 | 0.029388758 | 1.427453957 | 34000 | 700 | 2 | 17000 | 350 | 3.55 | FPS | FPS/$ | FPS/TDP | msec. | |
| 85 | deeplabv3 | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 184.31 | 74.61 | 0.091151132 | 0.921537946 | 2022 | 200 | 2 | 1011 | 100 | 12.07 | FPS | FPS/$ | FPS/TDP | msec. | |
| 86 | deeplabv3 | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 370.93 | 139.96 | 0.163117657 | 1.236431838 | 2274 | 300 | 2 | 1137 | 150 | 6.87 | FPS | FPS/$ | FPS/TDP | msec. | |
| 87 | deeplabv3 | OV-2023.1 | accel | Intel® Flex-170 | 803.58 | 560.76 | 1 | 19.59 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 88 | deeplabv3 | OV-2023.1 | accel | Intel® Flex-140 | 148.01 | 97.06 | 1 | 108.12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 89 | deeplabv3 | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 60.17 | 27.60 | 0.562349486 | 4.011426332 | 107 | 15 | 1 | 107 | 15 | 66.33 | FPS | FPS/$ | FPS/TDP | msec. | |
| 90 | deeplabv3 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 76.40 | 36.69 | 0.155928067 | 2.728741167 | 490 | 28 | 1 | 490 | 28 | 51.90 | FPS | FPS/$ | FPS/TDP | msec. | |
| 91 | deeplabv3 | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 3.65 | 1.92 | 0.018917206 | 0.608503456 | 193 | 6 | 1 | 193 | 6 | 1094.30 | FPS | FPS/$ | FPS/TDP | msec. | |
| 92 | deeplabv3 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 105.14 | 48.76 | 0.24680943 | 3.755029182 | 426 | 28 | 1 | 426 | 28 | 37.64 | FPS | FPS/$ | FPS/TDP | msec. | |
| 93 | deeplabv3 | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 61.90 | 17.22 | 0.578511308 | 4.126714 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 94 | deeplabv3 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 49.44 | 9.02 | 0.100894422 | 1.765652381 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 95 | deeplabv3 | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 4.81 | 2.03 | 0.024920889 | 0.801621937 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 96 | deeplabv3 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 89.16 | 24.78 | 0.209304953 | 3.184425357 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 97 | end_rec | ||||||||||||||||||
| 98 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 99 | mobilenet-v2 | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 272.36 | 133.20 | 2.545454771 | 18.15757736 | 107 | 15 | 1 | 107 | 15 | 3.60 | FPS | FPS/$ | FPS/TDP | msec. | |
| 100 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 542.97 | 451.26 | 4.640733479 | 8.353320262 | 117 | 65 | 1 | 117 | 65 | 1.99 | FPS | FPS/$ | FPS/TDP | msec. | |
| 101 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 899.54 | 499.68 | 4.203451742 | 13.8390565 | 214 | 65 | 1 | 214 | 65 | 1.58 | FPS | FPS/$ | FPS/TDP | msec. | |
| 102 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 2804.17 | 1285.76 | 8.523326054 | 22.43339417 | 329 | 125 | 1 | 329 | 125 | 0.88 | FPS | FPS/$ | FPS/TDP | msec. | |
| 103 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 868.27 | 679.32 | 4.522249945 | 13.35803061 | 192 | 65 | 1 | 192 | 65 | 1.35 | FPS | FPS/$ | FPS/TDP | msec. | |
| 104 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 1372.54 | 531.48 | 3.221931925 | 49.01939286 | 426 | 28 | 1 | 426 | 28 | 0.96 | FPS | FPS/$ | FPS/TDP | msec. | |
| 105 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 990.18 | 318.31 | 2.020773404 | 35.36353457 | 490 | 28 | 1 | 490 | 28 | 1.18 | FPS | FPS/$ | FPS/TDP | msec. | |
| 106 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 741.91 | 511.96 | 2.448553162 | 21.19747452 | 303 | 35 | 1 | 303 | 35 | 1.84 | FPS | FPS/$ | FPS/TDP | msec. | |
| 107 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 960.08 | 614.86 | 1.967381666 | 27.43092151 | 488 | 35 | 1 | 488 | 35 | 1.49 | FPS | FPS/$ | FPS/TDP | msec. | |
| 108 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 1296.04 | 651.56 | 2.382432184 | 37.02980308 | 544 | 35 | 1 | 544 | 35 | 1.31 | FPS | FPS/$ | FPS/TDP | msec. | |
| 109 | mobilenet-v2 | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 4078.62 | 2016.89 | 6.809056345 | 32.628998 | 599 | 125 | 1 | 599 | 125 | 0.73 | FPS | FPS/$ | FPS/TDP | msec. | |
| 110 | mobilenet-v2 | OV-2023.1 | atom | Intel® Processor N-200 | 39.61 | 29.85 | 0.205210747 | 6.600945698 | 193 | 6 | 1 | 193 | 6 | 26.82 | FPS | FPS/$ | FPS/TDP | msec. | |
| 111 | mobilenet-v2 | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 1458.83 | 554.06 | 2.455950239 | 11.67067553 | 594 | 125 | 1 | 594 | 125 | 1.29 | FPS | FPS/$ | FPS/TDP | msec. | |
| 112 | mobilenet-v2 | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 527.91 | 453.23 | 1.725211318 | 7.435417792 | 306 | 71 | 1 | 306 | 71 | 2.04 | FPS | FPS/$ | FPS/TDP | msec. | |
| 113 | mobilenet-v2 | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 5479.84 | 1921.88 | 1.742952604 | 26.09449042 | 3144 | 210 | 2 | 1572 | 105 | 1.43 | FPS | FPS/$ | FPS/TDP | msec. | |
| 114 | mobilenet-v2 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 14421.48 | 4410.27 | 0.850624065 | 35.17434244 | 16954 | 410 | 2 | 8477 | 205 | 0.92 | FPS | FPS/$ | FPS/TDP | msec. | |
| 115 | mobilenet-v2 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 22622.04 | 6912.71 | 1.208571487 | 41.89266868 | 18718 | 540 | 2 | 9359 | 270 | 0.56 | FPS | FPS/$ | FPS/TDP | msec. | |
| 116 | mobilenet-v2 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 38771.76 | 10993.76 | 1.140345798 | 55.3882245 | 34000 | 700 | 2 | 17000 | 350 | 0.66 | FPS | FPS/$ | FPS/TDP | msec. | |
| 117 | mobilenet-v2 | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 5229.87 | 1856.59 | 2.586481754 | 26.14933053 | 2022 | 200 | 2 | 1011 | 100 | 1.44 | FPS | FPS/$ | FPS/TDP | msec. | |
| 118 | mobilenet-v2 | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 12359.26 | 3615.96 | 5.435030176 | 41.19752874 | 2274 | 300 | 2 | 1137 | 150 | 0.55 | FPS | FPS/$ | FPS/TDP | msec. | |
| 119 | mobilenet-v2 | OV-2023.1 | accel | Intel® Flex-170 | 7195.50 | 6410.60 | 1 | 1.97 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 120 | mobilenet-v2 | OV-2023.1 | accel | Intel® Flex-140 | 1219.84 | 1149.89 | 1 | 13.07 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 121 | mobilenet-v2 | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 692.73 | 509.86 | 6.474119544 | 46.18205274 | 107 | 15 | 1 | 107 | 15 | 5.58 | FPS | FPS/$ | FPS/TDP | msec. | |
| 122 | mobilenet-v2 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 903.44 | 556.69 | 1.84375582 | 32.26572686 | 490 | 28 | 1 | 490 | 28 | 4.30 | FPS | FPS/$ | FPS/TDP | msec. | |
| 123 | mobilenet-v2 | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 57.93 | 40.13 | 0.300129792 | 9.65417499 | 193 | 6 | 1 | 193 | 6 | 68.05 | FPS | FPS/$ | FPS/TDP | msec. | |
| 124 | mobilenet-v2 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 1008.77 | 740.13 | 2.36801077 | 36.02759243 | 426 | 28 | 1 | 426 | 28 | 3.82 | FPS | FPS/$ | FPS/TDP | msec. | |
| 125 | mobilenet-v2 | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 514.94 | 313.82 | 4.812519626 | 34.32930667 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 126 | mobilenet-v2 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 1114.75 | 268.28 | 2.275002757 | 39.81254825 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 127 | mobilenet-v2 | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 73.89 | 44.62 | 0.38286464 | 12.31547925 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 128 | mobilenet-v2 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 1497.43 | 605.84 | 3.515084507 | 53.4795 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 129 | end_rec | ||||||||||||||||||
| 130 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 131 | resnet-50 | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 49.96 | 14.45 | 0.466891776 | 3.330494671 | 107 | 15 | 1 | 107 | 15 | 19.80 | FPS | FPS/$ | FPS/TDP | msec. | |
| 132 | resnet-50 | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 97.49 | 51.23 | 0.833227829 | 1.499810092 | 117 | 65 | 1 | 117 | 65 | 10.67 | FPS | FPS/$ | FPS/TDP | msec. | |
| 133 | resnet-50 | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 145.23 | 74.40 | 0.678644387 | 2.234306135 | 214 | 65 | 1 | 214 | 65 | 8.18 | FPS | FPS/$ | FPS/TDP | msec. | |
| 134 | resnet-50 | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 515.94 | 140.29 | 1.568210731 | 4.127530643 | 329 | 125 | 1 | 329 | 125 | 3.87 | FPS | FPS/$ | FPS/TDP | msec. | |
| 135 | resnet-50 | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 158.18 | 82.33 | 0.823856129 | 2.433544259 | 192 | 65 | 1 | 192 | 65 | 7.04 | FPS | FPS/$ | FPS/TDP | msec. | |
| 136 | resnet-50 | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 229.98 | 61.97 | 0.539855399 | 8.213514286 | 426 | 28 | 1 | 426 | 28 | 5.09 | FPS | FPS/$ | FPS/TDP | msec. | |
| 137 | resnet-50 | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 173.03 | 44.88 | 0.353117963 | 6.179564359 | 490 | 28 | 1 | 490 | 28 | 6.59 | FPS | FPS/$ | FPS/TDP | msec. | |
| 138 | resnet-50 | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 122.85 | 61.90 | 0.405448145 | 3.510022512 | 303 | 35 | 1 | 303 | 35 | 9.95 | FPS | FPS/$ | FPS/TDP | msec. | |
| 139 | resnet-50 | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 158.96 | 76.32 | 0.325734087 | 4.541663835 | 488 | 35 | 1 | 488 | 35 | 7.54 | FPS | FPS/$ | FPS/TDP | msec. | |
| 140 | resnet-50 | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 270.04 | 72.19 | 0.496399722 | 7.715469968 | 544 | 35 | 1 | 544 | 35 | 4.89 | FPS | FPS/$ | FPS/TDP | msec. | |
| 141 | resnet-50 | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 749.50 | 228.07 | 1.251250835 | 5.995994004 | 599 | 125 | 1 | 599 | 125 | 2.93 | FPS | FPS/$ | FPS/TDP | msec. | |
| 142 | resnet-50 | OV-2023.1 | atom | Intel® Processor N-200 | 6.55 | 3.16 | 0.03395277 | 1.092147419 | 193 | 6 | 1 | 193 | 6 | 159.41 | FPS | FPS/$ | FPS/TDP | msec. | |
| 143 | resnet-50 | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 242.15 | 98.01 | 0.407662044 | 1.937210033 | 594 | 125 | 1 | 594 | 125 | 5.41 | FPS | FPS/$ | FPS/TDP | msec. | |
| 144 | resnet-50 | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 93.12 | 50.42 | 0.30430895 | 1.311528714 | 306 | 71 | 1 | 306 | 71 | 11.07 | FPS | FPS/$ | FPS/TDP | msec. | |
| 145 | resnet-50 | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 967.51 | 269.32 | 0.307731475 | 4.607179803 | 3144 | 210 | 2 | 1572 | 105 | 2.90 | FPS | FPS/$ | FPS/TDP | msec. | |
| 146 | resnet-50 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 2904.14 | 747.72 | 0.171295011 | 7.083257598 | 16954 | 410 | 2 | 8477 | 205 | 1.53 | FPS | FPS/$ | FPS/TDP | msec. | |
| 147 | resnet-50 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 4995.38 | 1161.61 | 0.266875909 | 9.250709751 | 18718 | 540 | 2 | 9359 | 270 | 1.02 | FPS | FPS/$ | FPS/TDP | msec. | |
| 148 | resnet-50 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 20106.68 | 1683.03 | 0.591372933 | 28.72382815 | 34000 | 700 | 2 | 17000 | 350 | 1.01 | FPS | FPS/$ | FPS/TDP | msec. | |
| 149 | resnet-50 | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 930.86 | 255.73 | 0.46036761 | 4.654316532 | 2022 | 200 | 2 | 1011 | 100 | 3.01 | FPS | FPS/$ | FPS/TDP | msec. | |
| 150 | resnet-50 | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 2277.89 | 566.74 | 1.001712531 | 7.592980986 | 2274 | 300 | 2 | 1137 | 150 | 1.47 | FPS | FPS/$ | FPS/TDP | msec. | |
| 151 | resnet-50 | OV-2023.1 | accel | Intel® Flex-170 | 3587.03 | 2207.96 | 1 | 4.17 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 152 | resnet-50 | OV-2023.1 | accel | Intel® Flex-140 | 681.39 | 441.41 | 1 | 23.43 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 153 | resnet-50 | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 211.61 | 117.01 | 1.977639185 | 14.10715952 | 107 | 15 | 1 | 107 | 15 | 18.79 | FPS | FPS/$ | FPS/TDP | msec. | |
| 154 | resnet-50 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 289.48 | 170.46 | 0.590782847 | 10.33869983 | 490 | 28 | 1 | 490 | 28 | 13.64 | FPS | FPS/$ | FPS/TDP | msec. | |
| 155 | resnet-50 | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 14.62 | 7.80 | 0.075769949 | 2.437266688 | 193 | 6 | 1 | 193 | 6 | 272.49 | FPS | FPS/$ | FPS/TDP | msec. | |
| 156 | resnet-50 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 352.09 | 211.39 | 0.826510493 | 12.57476679 | 426 | 28 | 1 | 426 | 28 | 11.09 | FPS | FPS/$ | FPS/TDP | msec. | |
| 157 | resnet-50 | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 201.96 | 71.44 | 1.887469159 | 13.46394667 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 158 | resnet-50 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 307.08 | 88.49 | 0.626686058 | 10.96700601 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 159 | resnet-50 | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 18.58 | 6.49 | 0.09624999 | 3.096041335 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 160 | resnet-50 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 358.14 | 114.23 | 0.840715023 | 12.79087857 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 161 | end_rec | ||||||||||||||||||
| 162 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 163 | ssd_mobilenet_v1_coco | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 107.63 | 36.80 | 1.005906996 | 7.175469906 | 107 | 15 | 1 | 107 | 15 | 9.12 | FPS | FPS/$ | FPS/TDP | msec. | |
| 164 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 212.15 | 122.46 | 1.813284395 | 3.263911911 | 117 | 65 | 1 | 117 | 65 | 4.93 | FPS | FPS/$ | FPS/TDP | msec. | |
| 165 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 327.95 | 171.39 | 1.532485774 | 5.045414702 | 214 | 65 | 1 | 214 | 65 | 3.61 | FPS | FPS/$ | FPS/TDP | msec. | |
| 166 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 999.78 | 361.81 | 3.038835794 | 7.99821581 | 329 | 125 | 1 | 329 | 125 | 1.90 | FPS | FPS/$ | FPS/TDP | msec. | |
| 167 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 343.23 | 200.57 | 1.787633018 | 5.280392915 | 192 | 65 | 1 | 192 | 65 | 3.11 | FPS | FPS/$ | FPS/TDP | msec. | |
| 168 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 518.48 | 150.36 | 1.217089202 | 18.51714286 | 426 | 28 | 1 | 426 | 28 | 2.24 | FPS | FPS/$ | FPS/TDP | msec. | |
| 169 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 387.68 | 101.48 | 0.791191606 | 13.8458531 | 490 | 28 | 1 | 490 | 28 | 2.80 | FPS | FPS/$ | FPS/TDP | msec. | |
| 170 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 275.38 | 157.24 | 0.908858835 | 7.868120772 | 303 | 35 | 1 | 303 | 35 | 4.33 | FPS | FPS/$ | FPS/TDP | msec. | |
| 171 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 367.82 | 194.43 | 0.753734827 | 10.50921702 | 488 | 35 | 1 | 488 | 35 | 3.35 | FPS | FPS/$ | FPS/TDP | msec. | |
| 172 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 543.47 | 186.05 | 0.999034589 | 15.5278519 | 544 | 35 | 1 | 544 | 35 | 2.61 | FPS | FPS/$ | FPS/TDP | msec. | |
| 173 | ssd_mobilenet_v1_coco | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 1525.02 | 586.71 | 2.545949853 | 12.20019169 | 599 | 125 | 1 | 599 | 125 | 1.62 | FPS | FPS/$ | FPS/TDP | msec. | |
| 174 | ssd_mobilenet_v1_coco | OV-2023.1 | atom | Intel® Processor N-200 | 14.49 | 7.97 | 0.075060228 | 2.414437321 | 193 | 6 | 1 | 193 | 6 | 71.99 | FPS | FPS/$ | FPS/TDP | msec. | |
| 175 | ssd_mobilenet_v1_coco | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 577.55 | 223.76 | 0.972304716 | 4.620392012 | 594 | 125 | 1 | 594 | 125 | 2.38 | FPS | FPS/$ | FPS/TDP | msec. | |
| 176 | ssd_mobilenet_v1_coco | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 203.21 | 126.30 | 0.664084594 | 2.862111065 | 306 | 71 | 1 | 306 | 71 | 5.09 | FPS | FPS/$ | FPS/TDP | msec. | |
| 177 | ssd_mobilenet_v1_coco | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 2048.96 | 639.54 | 0.651703831 | 9.756937353 | 3144 | 210 | 2 | 1572 | 105 | 1.57 | FPS | FPS/$ | FPS/TDP | msec. | |
| 178 | ssd_mobilenet_v1_coco | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 5725.24 | 1655.76 | 0.337692546 | 13.96399861 | 16954 | 410 | 2 | 8477 | 205 | 1.11 | FPS | FPS/$ | FPS/TDP | msec. | |
| 179 | ssd_mobilenet_v1_coco | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 10274.06 | 2354.69 | 0.548886883 | 19.0260457 | 18718 | 540 | 2 | 9359 | 270 | 0.67 | FPS | FPS/$ | FPS/TDP | msec. | |
| 180 | ssd_mobilenet_v1_coco | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 22569.91 | 3519.34 | 0.663820955 | 32.24273208 | 34000 | 700 | 2 | 17000 | 350 | 0.82 | FPS | FPS/$ | FPS/TDP | msec. | |
| 181 | ssd_mobilenet_v1_coco | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 1946.94 | 612.87 | 0.962878848 | 9.73470515 | 2022 | 200 | 2 | 1011 | 100 | 1.63 | FPS | FPS/$ | FPS/TDP | msec. | |
| 182 | ssd_mobilenet_v1_coco | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 4808.85 | 1247.67 | 2.114709828 | 16.02950049 | 2274 | 300 | 2 | 1137 | 150 | 0.81 | FPS | FPS/$ | FPS/TDP | msec. | |
| 183 | ssd_mobilenet_v1_coco | OV-2023.1 | accel | Intel® Flex-170 | 4012.21 | 3280.14 | 1 | 3.65 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 184 | ssd_mobilenet_v1_coco | OV-2023.1 | accel | Intel® Flex-140 | 837.59 | 673.84 | 1 | 19.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 185 | ssd_mobilenet_v1_coco | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 408.97 | 220.07 | 3.822128486 | 27.26451654 | 107 | 15 | 1 | 107 | 15 | 9.63 | FPS | FPS/$ | FPS/TDP | msec. | |
| 186 | ssd_mobilenet_v1_coco | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 522.64 | 285.29 | 1.066608011 | 18.6656402 | 490 | 28 | 1 | 490 | 28 | 7.49 | FPS | FPS/$ | FPS/TDP | msec. | |
| 187 | ssd_mobilenet_v1_coco | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 28.92 | 15.36 | 0.149828275 | 4.819476185 | 193 | 6 | 1 | 193 | 6 | 136.60 | FPS | FPS/$ | FPS/TDP | msec. | |
| 188 | ssd_mobilenet_v1_coco | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 637.62 | 384.26 | 1.496766725 | 22.77223659 | 426 | 28 | 1 | 426 | 28 | 6.11 | FPS | FPS/$ | FPS/TDP | msec. | |
| 189 | ssd_mobilenet_v1_coco | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 321.29 | 138.22 | 3.002740187 | 21.41954667 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 190 | ssd_mobilenet_v1_coco | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 531.28 | 141.48 | 1.084245141 | 18.97428996 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 191 | ssd_mobilenet_v1_coco | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 35.69 | 14.88 | 0.184945841 | 5.949091211 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 192 | ssd_mobilenet_v1_coco | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 690.18 | 239.85 | 1.620143192 | 24.64932143 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 193 | end_rec | ||||||||||||||||||
| 194 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 195 | ssd-resnet34-1200 | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 0.89 | 0.23 | 0.00834996 | 0.059563049 | 107 | 15 | 1 | 107 | 15 | 1119.27 | FPS | FPS/$ | FPS/TDP | msec. | |
| 196 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 1.68 | 0.97 | 0.014338412 | 0.025809141 | 117 | 65 | 1 | 117 | 65 | 596.89 | FPS | FPS/$ | FPS/TDP | msec. | |
| 197 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 2.42 | 1.40 | 0.011301245 | 0.037207176 | 214 | 65 | 1 | 214 | 65 | 459.48 | FPS | FPS/$ | FPS/TDP | msec. | |
| 198 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 8.23 | 2.40 | 0.025006186 | 0.065816281 | 329 | 125 | 1 | 329 | 125 | 163.47 | FPS | FPS/$ | FPS/TDP | msec. | |
| 199 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 2.78 | 1.56 | 0.014501179 | 0.042834252 | 192 | 65 | 1 | 192 | 65 | 362.12 | FPS | FPS/$ | FPS/TDP | msec. | |
| 200 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 3.93 | 1.00 | 0.009217819 | 0.140242536 | 426 | 28 | 1 | 426 | 28 | 278.25 | FPS | FPS/$ | FPS/TDP | msec. | |
| 201 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 2.96 | 0.76 | 0.006043555 | 0.105762215 | 490 | 28 | 1 | 490 | 28 | 336.81 | FPS | FPS/$ | FPS/TDP | msec. | |
| 202 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 2.02 | 1.13 | 0.006664408 | 0.057694728 | 303 | 35 | 1 | 303 | 35 | 563.91 | FPS | FPS/$ | FPS/TDP | msec. | |
| 203 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 2.68 | 1.49 | 0.00548551 | 0.076483685 | 488 | 35 | 1 | 488 | 35 | 405.46 | FPS | FPS/$ | FPS/TDP | msec. | |
| 204 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 4.40 | 1.32 | 0.008086729 | 0.125690868 | 544 | 35 | 1 | 544 | 35 | 235.75 | FPS | FPS/$ | FPS/TDP | msec. | |
| 205 | ssd-resnet34-1200 | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 12.52 | 4.02 | 0.020905788 | 0.100180536 | 599 | 125 | 1 | 599 | 125 | 125.64 | FPS | FPS/$ | FPS/TDP | msec. | |
| 206 | ssd-resnet34-1200 | OV-2023.1 | atom | Intel® Processor N-200 | 0.11 | 0.05 | 0.000581374 | 0.01870087 | 193 | 6 | 1 | 193 | 6 | 8951.48 | FPS | FPS/$ | FPS/TDP | msec. | |
| 207 | ssd-resnet34-1200 | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 4.33 | 2.45 | 0.007285664 | 0.034621476 | 594 | 125 | 1 | 594 | 125 | 239.93 | FPS | FPS/$ | FPS/TDP | msec. | |
| 208 | ssd-resnet34-1200 | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 1.60 | 0.92 | 0.005224348 | 0.022516206 | 306 | 71 | 1 | 306 | 71 | 625.20 | FPS | FPS/$ | FPS/TDP | msec. | |
| 209 | ssd-resnet34-1200 | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 17.63 | 4.57 | 0.005609079 | 0.083975927 | 3144 | 210 | 2 | 1572 | 105 | 115.76 | FPS | FPS/$ | FPS/TDP | msec. | |
| 210 | ssd-resnet34-1200 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 57.85 | 14.82 | 0.003412426 | 0.141107992 | 16954 | 410 | 2 | 8477 | 205 | 36.60 | FPS | FPS/$ | FPS/TDP | msec. | |
| 211 | ssd-resnet34-1200 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 79.09 | 20.81 | 0.004225558 | 0.146470375 | 18718 | 540 | 2 | 9359 | 270 | 106.87 | FPS | FPS/$ | FPS/TDP | msec. | |
| 212 | ssd-resnet34-1200 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 445.98 | 31.40 | 0.013117158 | 0.637119123 | 34000 | 700 | 2 | 17000 | 350 | 8.59 | FPS | FPS/$ | FPS/TDP | msec. | |
| 213 | ssd-resnet34-1200 | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 16.77 | 4.34 | 0.008295831 | 0.083870853 | 2022 | 200 | 2 | 1011 | 100 | 121.62 | FPS | FPS/$ | FPS/TDP | msec. | |
| 214 | ssd-resnet34-1200 | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 42.59 | 10.54 | 0.018728616 | 0.141962906 | 2274 | 300 | 2 | 1137 | 150 | 59.65 | FPS | FPS/$ | FPS/TDP | msec. | |
| 215 | ssd-resnet34-1200 | OV-2023.1 | accel | Intel® Flex-170 | 167.49 | 103.03 | 1 | 95.09 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 216 | ssd-resnet34-1200 | OV-2023.1 | accel | Intel® Flex-140 | 29.99 | 17.56 | 1 | 529.50 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 217 | ssd-resnet34-1200 | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 5.05 | 2.63 | 0.047178932 | 0.336543045 | 107 | 15 | 1 | 107 | 15 | 773.01 | FPS | FPS/$ | FPS/TDP | msec. | |
| 218 | ssd-resnet34-1200 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 8.98 | 4.71 | 0.018327459 | 0.320730535 | 490 | 28 | 1 | 490 | 28 | 445.01 | FPS | FPS/$ | FPS/TDP | msec. | |
| 219 | ssd-resnet34-1200 | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 0.29 | 0.16 | 0.001497632 | 0.048173819 | 193 | 6 | 1 | 193 | 6 | 13818.30 | FPS | FPS/$ | FPS/TDP | msec. | |
| 220 | ssd-resnet34-1200 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 9.70 | 5.44 | 0.022760985 | 0.34629213 | 426 | 28 | 1 | 426 | 28 | 422.10 | FPS | FPS/$ | FPS/TDP | msec. | |
| 221 | ssd-resnet34-1200 | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 0.90 | 0.23 | 0.00837685 | 0.059754867 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 222 | ssd-resnet34-1200 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 2.91 | 0.75 | 0.005937663 | 0.103909111 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 223 | ssd-resnet34-1200 | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 0.11 | 0.05 | 0.000582108 | 0.01872448 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 224 | ssd-resnet34-1200 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 3.92 | 1.00 | 0.00919669 | 0.139921071 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 225 | end_rec | ||||||||||||||||||
| 226 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 227 | yolo-v3 | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 5.46 | 1.54 | 0.051044248 | 0.364115633 | 107 | 15 | 1 | 107 | 15 | 183.90 | FPS | FPS/$ | FPS/TDP | msec. | |
| 228 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 10.65 | 5.82 | 0.09106238 | 0.163912284 | 117 | 65 | 1 | 117 | 65 | 94.90 | FPS | FPS/$ | FPS/TDP | msec. | |
| 229 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 15.38 | 8.31 | 0.071851432 | 0.236557023 | 214 | 65 | 1 | 214 | 65 | 74.19 | FPS | FPS/$ | FPS/TDP | msec. | |
| 230 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 51.71 | 15.62 | 0.157162207 | 0.41365093 | 329 | 125 | 1 | 329 | 125 | 29.85 | FPS | FPS/$ | FPS/TDP | msec. | |
| 231 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 17.56 | 9.38 | 0.091438134 | 0.270094181 | 192 | 65 | 1 | 192 | 65 | 57.84 | FPS | FPS/$ | FPS/TDP | msec. | |
| 232 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 24.16 | 6.62 | 0.056714953 | 0.8628775 | 426 | 28 | 1 | 426 | 28 | 45.99 | FPS | FPS/$ | FPS/TDP | msec. | |
| 233 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 18.06 | 4.86 | 0.03686323 | 0.645106519 | 490 | 28 | 1 | 490 | 28 | 57.19 | FPS | FPS/$ | FPS/TDP | msec. | |
| 234 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 12.66 | 6.85 | 0.041784766 | 0.361736687 | 303 | 35 | 1 | 303 | 35 | 86.80 | FPS | FPS/$ | FPS/TDP | msec. | |
| 235 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 16.86 | 8.71 | 0.034540452 | 0.48159259 | 488 | 35 | 1 | 488 | 35 | 65.99 | FPS | FPS/$ | FPS/TDP | msec. | |
| 236 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 27.01 | 8.10 | 0.049658249 | 0.771831063 | 544 | 35 | 1 | 544 | 35 | 42.00 | FPS | FPS/$ | FPS/TDP | msec. | |
| 237 | yolo-v3 | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 78.04 | 25.56 | 0.1302838 | 0.62431997 | 599 | 125 | 1 | 599 | 125 | 23.30 | FPS | FPS/$ | FPS/TDP | msec. | |
| 238 | yolo-v3 | OV-2023.1 | atom | Intel® Processor N-200 | 0.70 | 0.35 | 0.003642344 | 0.117162061 | 193 | 6 | 1 | 193 | 6 | 1468.27 | FPS | FPS/$ | FPS/TDP | msec. | |
| 239 | yolo-v3 | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 27.34 | 14.09 | 0.046032451 | 0.218746209 | 594 | 125 | 1 | 594 | 125 | 40.58 | FPS | FPS/$ | FPS/TDP | msec. | |
| 240 | yolo-v3 | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 10.07 | 5.66 | 0.032912167 | 0.141846806 | 306 | 71 | 1 | 306 | 71 | 100.10 | FPS | FPS/$ | FPS/TDP | msec. | |
| 241 | yolo-v3 | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 106.30 | 29.82 | 0.033811441 | 0.506205571 | 3144 | 210 | 2 | 1572 | 105 | 21.86 | FPS | FPS/$ | FPS/TDP | msec. | |
| 242 | yolo-v3 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 313.22 | 88.20 | 0.018474663 | 0.76394984 | 16954 | 410 | 2 | 8477 | 205 | 10.58 | FPS | FPS/$ | FPS/TDP | msec. | |
| 243 | yolo-v3 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 493.02 | 109.11 | 0.026339551 | 0.913006894 | 18718 | 540 | 2 | 9359 | 270 | 18.51 | FPS | FPS/$ | FPS/TDP | msec. | |
| 244 | yolo-v3 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 2136.92 | 194.88 | 0.06285072 | 3.052749275 | 34000 | 700 | 2 | 17000 | 350 | 3.29 | FPS | FPS/$ | FPS/TDP | msec. | |
| 245 | yolo-v3 | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 101.27 | 28.40 | 0.050083923 | 0.50634846 | 2022 | 200 | 2 | 1011 | 100 | 22.87 | FPS | FPS/$ | FPS/TDP | msec. | |
| 246 | yolo-v3 | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 242.00 | 62.34 | 0.106421602 | 0.806675746 | 2274 | 300 | 2 | 1137 | 150 | 13.70 | FPS | FPS/$ | FPS/TDP | msec. | |
| 247 | yolo-v3 | OV-2023.1 | accel | Intel® Flex-170 | 789.11 | 338.45 | 1 | 19.85 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 248 | yolo-v3 | OV-2023.1 | accel | Intel® Flex-140 | 159.67 | 87.28 | 1 | 99.99 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 249 | yolo-v3 | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 31.90 | 15.02 | 0.298118652 | 2.126579715 | 107 | 15 | 1 | 107 | 15 | 123.93 | FPS | FPS/$ | FPS/TDP | msec. | |
| 250 | yolo-v3 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 57.77 | 25.96 | 0.117907546 | 2.063382053 | 490 | 28 | 1 | 490 | 28 | 68.96 | FPS | FPS/$ | FPS/TDP | msec. | |
| 251 | yolo-v3 | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 1.76 | 0.94 | 0.009116198 | 0.293237699 | 193 | 6 | 1 | 193 | 6 | 2271.06 | FPS | FPS/$ | FPS/TDP | msec. | |
| 252 | yolo-v3 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 63.86 | 29.69 | 0.149904983 | 2.280697234 | 426 | 28 | 1 | 426 | 28 | 63.56 | FPS | FPS/$ | FPS/TDP | msec. | |
| 253 | yolo-v3 | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 34.09 | 9.18 | 0.318603364 | 2.272704 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 254 | yolo-v3 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 55.18 | 12.97 | 0.112605748 | 1.970600588 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 255 | yolo-v3 | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 2.22 | 0.74 | 0.011488536 | 0.369547916 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 256 | yolo-v3 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 52.21 | 13.99 | 0.122567488 | 1.864776786 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 257 | end_rec | ||||||||||||||||||
| 258 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 259 | yolo-v3-tiny | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 54.42 | 18.04 | 0.508553978 | 3.627685044 | 107 | 15 | 1 | 107 | 15 | 18.25 | FPS | FPS/$ | FPS/TDP | msec. | |
| 260 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 112.01 | 63.79 | 0.957390784 | 1.723303411 | 117 | 65 | 1 | 117 | 65 | 9.02 | FPS | FPS/$ | FPS/TDP | msec. | |
| 261 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 167.15 | 91.46 | 0.781091755 | 2.571594392 | 214 | 65 | 1 | 214 | 65 | 6.72 | FPS | FPS/$ | FPS/TDP | msec. | |
| 262 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 599.98 | 196.78 | 1.823638134 | 4.799815567 | 329 | 125 | 1 | 329 | 125 | 3.05 | FPS | FPS/$ | FPS/TDP | msec. | |
| 263 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 185.17 | 102.47 | 0.964441757 | 2.848812574 | 192 | 65 | 1 | 192 | 65 | 5.42 | FPS | FPS/$ | FPS/TDP | msec. | |
| 264 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 251.02 | 77.47 | 0.589250939 | 8.965032143 | 426 | 28 | 1 | 426 | 28 | 4.54 | FPS | FPS/$ | FPS/TDP | msec. | |
| 265 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 186.99 | 55.22 | 0.381609578 | 6.678167613 | 490 | 28 | 1 | 490 | 28 | 5.74 | FPS | FPS/$ | FPS/TDP | msec. | |
| 266 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 137.72 | 76.53 | 0.454530194 | 3.934932821 | 303 | 35 | 1 | 303 | 35 | 8.20 | FPS | FPS/$ | FPS/TDP | msec. | |
| 267 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 186.09 | 96.75 | 0.381340728 | 5.316979292 | 488 | 35 | 1 | 488 | 35 | 6.26 | FPS | FPS/$ | FPS/TDP | msec. | |
| 268 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 290.20 | 92.52 | 0.533462621 | 8.291533312 | 544 | 35 | 1 | 544 | 35 | 4.20 | FPS | FPS/$ | FPS/TDP | msec. | |
| 269 | yolo-v3-tiny | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 858.94 | 286.41 | 1.433957861 | 6.871526071 | 599 | 125 | 1 | 599 | 125 | 2.44 | FPS | FPS/$ | FPS/TDP | msec. | |
| 270 | yolo-v3-tiny | OV-2023.1 | atom | Intel® Processor N-200 | 7.65 | 4.05 | 0.039622221 | 1.27451476 | 193 | 6 | 1 | 193 | 6 | 136.49 | FPS | FPS/$ | FPS/TDP | msec. | |
| 271 | yolo-v3-tiny | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 298.60 | 148.94 | 0.502696157 | 2.388812138 | 594 | 125 | 1 | 594 | 125 | 3.99 | FPS | FPS/$ | FPS/TDP | msec. | |
| 272 | yolo-v3-tiny | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 106.58 | 62.62 | 0.348291454 | 1.501087112 | 306 | 71 | 1 | 306 | 71 | 9.44 | FPS | FPS/$ | FPS/TDP | msec. | |
| 273 | yolo-v3-tiny | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 1051.30 | 339.08 | 0.334382549 | 5.006184448 | 3144 | 210 | 2 | 1572 | 105 | 2.51 | FPS | FPS/$ | FPS/TDP | msec. | |
| 274 | yolo-v3-tiny | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 2824.66 | 923.96 | 0.166607362 | 6.889417597 | 16954 | 410 | 2 | 8477 | 205 | 1.22 | FPS | FPS/$ | FPS/TDP | msec. | |
| 275 | yolo-v3-tiny | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 4664.34 | 1378.51 | 0.249189958 | 8.637662274 | 18718 | 540 | 2 | 9359 | 270 | 0.87 | FPS | FPS/$ | FPS/TDP | msec. | |
| 276 | yolo-v3-tiny | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 13094.97 | 2140.00 | 0.385146034 | 18.70709309 | 34000 | 700 | 2 | 17000 | 350 | 1.09 | FPS | FPS/$ | FPS/TDP | msec. | |
| 277 | yolo-v3-tiny | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 1008.44 | 322.64 | 0.49873439 | 5.042204682 | 2022 | 200 | 2 | 1011 | 100 | 2.62 | FPS | FPS/$ | FPS/TDP | msec. | |
| 278 | yolo-v3-tiny | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 2217.58 | 702.90 | 0.975190642 | 7.391945065 | 2274 | 300 | 2 | 1137 | 150 | 1.33 | FPS | FPS/$ | FPS/TDP | msec. | |
| 279 | yolo-v3-tiny | OV-2023.1 | accel | Intel® Flex-170 | 3731.30 | 2395.93 | 1 | 4.06 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 280 | yolo-v3-tiny | OV-2023.1 | accel | Intel® Flex-140 | 595.41 | 589.87 | 1 | 26.79 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 281 | yolo-v3-tiny | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 289.69 | 151.78 | 2.707403451 | 19.31281129 | 107 | 15 | 1 | 107 | 15 | 13.67 | FPS | FPS/$ | FPS/TDP | msec. | |
| 282 | yolo-v3-tiny | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 482.61 | 255.46 | 0.984928525 | 17.23624918 | 490 | 28 | 1 | 490 | 28 | 8.06 | FPS | FPS/$ | FPS/TDP | msec. | |
| 283 | yolo-v3-tiny | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 18.65 | 9.81 | 0.096624282 | 3.108081056 | 193 | 6 | 1 | 193 | 6 | 212.84 | FPS | FPS/$ | FPS/TDP | msec. | |
| 284 | yolo-v3-tiny | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 555.59 | 293.27 | 1.304201059 | 19.84248754 | 426 | 28 | 1 | 426 | 28 | 6.92 | FPS | FPS/$ | FPS/TDP | msec. | |
| 285 | yolo-v3-tiny | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 266.57 | 93.47 | 2.491299065 | 17.77126667 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 286 | yolo-v3-tiny | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 383.36 | 116.03 | 0.782374111 | 13.69154694 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 287 | yolo-v3-tiny | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 23.03 | 8.30 | 0.119308014 | 3.837741122 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 288 | yolo-v3-tiny | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 444.34 | 149.05 | 1.043043427 | 15.86916071 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 289 | end_rec | ||||||||||||||||||
| 290 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 291 | unet-camvid-onnx-0001 | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 1.49 | 0.38 | 0.013950494 | 0.099513526 | 107 | 15 | 1 | 107 | 15 | 672.25 | FPS | FPS/$ | FPS/TDP | msec. | |
| 292 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 2.43 | 1.57 | 0.020775748 | 0.037396346 | 117 | 65 | 1 | 117 | 65 | 425.88 | FPS | FPS/$ | FPS/TDP | msec. | |
| 293 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 3.62 | 2.29 | 0.016924989 | 0.055722272 | 214 | 65 | 1 | 214 | 65 | 322.49 | FPS | FPS/$ | FPS/TDP | msec. | |
| 294 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 11.46 | 3.96 | 0.03483307 | 0.091680639 | 329 | 125 | 1 | 329 | 125 | 121.88 | FPS | FPS/$ | FPS/TDP | msec. | |
| 295 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 3.95 | 2.54 | 0.020576722 | 0.06078047 | 192 | 65 | 1 | 192 | 65 | 262.38 | FPS | FPS/$ | FPS/TDP | msec. | |
| 296 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 6.56 | 1.65 | 0.015387439 | 0.234108893 | 426 | 28 | 1 | 426 | 28 | 169.32 | FPS | FPS/$ | FPS/TDP | msec. | |
| 297 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 4.93 | 1.23 | 0.010063508 | 0.176111389 | 490 | 28 | 1 | 490 | 28 | 209.95 | FPS | FPS/$ | FPS/TDP | msec. | |
| 298 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 3.02 | 1.85 | 0.009976084 | 0.086364383 | 303 | 35 | 1 | 303 | 35 | 386.94 | FPS | FPS/$ | FPS/TDP | msec. | |
| 299 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 3.86 | 2.43 | 0.007900388 | 0.110153975 | 488 | 35 | 1 | 488 | 35 | 282.08 | FPS | FPS/$ | FPS/TDP | msec. | |
| 300 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 6.32 | 2.19 | 0.01162052 | 0.18061608 | 544 | 35 | 1 | 544 | 35 | 169.49 | FPS | FPS/$ | FPS/TDP | msec. | |
| 301 | unet-camvid-onnx-0001 | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 18.02 | 6.59 | 0.030079429 | 0.144140625 | 599 | 125 | 1 | 599 | 125 | 91.92 | FPS | FPS/$ | FPS/TDP | msec. | |
| 302 | unet-camvid-onnx-0001 | OV-2023.1 | atom | Intel® Processor N-200 | 0.17 | 0.09 | 0.000895225 | 0.0287964 | 193 | 6 | 1 | 193 | 6 | 5824.42 | FPS | FPS/$ | FPS/TDP | msec. | |
| 303 | unet-camvid-onnx-0001 | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 6.10 | 3.95 | 0.010266964 | 0.048788613 | 594 | 125 | 1 | 594 | 125 | 180.82 | FPS | FPS/$ | FPS/TDP | msec. | |
| 304 | unet-camvid-onnx-0001 | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 2.33 | 1.48 | 0.007623167 | 0.032854777 | 306 | 71 | 1 | 306 | 71 | 431.48 | FPS | FPS/$ | FPS/TDP | msec. | |
| 305 | unet-camvid-onnx-0001 | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 29.17 | 7.32 | 0.009277061 | 0.138890851 | 3144 | 210 | 2 | 1572 | 105 | 70.99 | FPS | FPS/$ | FPS/TDP | msec. | |
| 306 | unet-camvid-onnx-0001 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 95.18 | 21.75 | 0.005614225 | 0.232155061 | 16954 | 410 | 2 | 8477 | 205 | 23.58 | FPS | FPS/$ | FPS/TDP | msec. | |
| 307 | unet-camvid-onnx-0001 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 129.66 | 31.77 | 0.006926924 | 0.240107724 | 18718 | 540 | 2 | 9359 | 270 | 73.18 | FPS | FPS/$ | FPS/TDP | msec. | |
| 308 | unet-camvid-onnx-0001 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 597.42 | 48.08 | 0.017571322 | 0.853464211 | 34000 | 700 | 2 | 17000 | 350 | 9.00 | FPS | FPS/$ | FPS/TDP | msec. | |
| 309 | unet-camvid-onnx-0001 | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 27.77 | 6.96 | 0.01373266 | 0.138837194 | 2022 | 200 | 2 | 1011 | 100 | 74.54 | FPS | FPS/$ | FPS/TDP | msec. | |
| 310 | unet-camvid-onnx-0001 | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 68.21 | 15.93 | 0.029995749 | 0.227367774 | 2274 | 300 | 2 | 1137 | 150 | 43.86 | FPS | FPS/$ | FPS/TDP | msec. | |
| 311 | unet-camvid-onnx-0001 | OV-2023.1 | accel | Intel® Flex-170 | 277.97 | 158.53 | 1 | 57.27 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 312 | unet-camvid-onnx-0001 | OV-2023.1 | accel | Intel® Flex-140 | 46.10 | 28.49 | 1 | 346.80 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 313 | unet-camvid-onnx-0001 | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 8.40 | 4.35 | 0.078545387 | 0.56029043 | 107 | 15 | 1 | 107 | 15 | 475.75 | FPS | FPS/$ | FPS/TDP | msec. | |
| 314 | unet-camvid-onnx-0001 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 15.51 | 7.81 | 0.03164744 | 0.553830203 | 490 | 28 | 1 | 490 | 28 | 257.89 | FPS | FPS/$ | FPS/TDP | msec. | |
| 315 | unet-camvid-onnx-0001 | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 0.46 | 0.25 | 0.002385152 | 0.076722378 | 193 | 6 | 1 | 193 | 6 | 8685.75 | FPS | FPS/$ | FPS/TDP | msec. | |
| 316 | unet-camvid-onnx-0001 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 17.28 | 8.86 | 0.04056698 | 0.617197621 | 426 | 28 | 1 | 426 | 28 | 227.89 | FPS | FPS/$ | FPS/TDP | msec. | |
| 317 | unet-camvid-onnx-0001 | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 8.96 | 2.57 | 0.083779393 | 0.597626333 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 318 | unet-camvid-onnx-0001 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 15.42 | 3.90 | 0.031467977 | 0.550689601 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 319 | unet-camvid-onnx-0001 | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 0.55 | 0.19 | 0.002833692 | 0.09115042 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 320 | unet-camvid-onnx-0001 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 14.32 | 3.81 | 0.033621549 | 0.511527857 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 321 | end_rec | ||||||||||||||||||
| 322 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||
| 323 | yolo_v8n | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 24.40 | 9.61 | 0.22800938 | 1.626466914 | 107 | 15 | 1 | 107 | 15 | 40.45 | FPS | FPS/$ | FPS/TDP | msec. | |
| 324 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 53.51 | 33.07 | 0.457363269 | 0.823253884 | 117 | 65 | 1 | 117 | 65 | 19.20 | FPS | FPS/$ | FPS/TDP | msec. | |
| 325 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 81.91 | 47.09 | 0.382748211 | 1.260124878 | 214 | 65 | 1 | 214 | 65 | 13.68 | FPS | FPS/$ | FPS/TDP | msec. | |
| 326 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 248.13 | 95.51 | 0.754209583 | 1.985079623 | 329 | 125 | 1 | 329 | 125 | 6.70 | FPS | FPS/$ | FPS/TDP | msec. | |
| 327 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 86.77 | 53.00 | 0.451947196 | 1.334982486 | 192 | 65 | 1 | 192 | 65 | 11.88 | FPS | FPS/$ | FPS/TDP | msec. | |
| 328 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 110.84 | 40.77 | 0.260193662 | 3.958660714 | 426 | 28 | 1 | 426 | 28 | 10.71 | FPS | FPS/$ | FPS/TDP | msec. | |
| 329 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 76.53 | 27.31 | 0.156180065 | 2.733151145 | 490 | 28 | 1 | 490 | 28 | 13.42 | FPS | FPS/$ | FPS/TDP | msec. | |
| 330 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 71.40 | 42.60 | 0.235643867 | 2.040002619 | 303 | 35 | 1 | 303 | 35 | 16.51 | FPS | FPS/$ | FPS/TDP | msec. | |
| 331 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 93.44 | 53.42 | 0.19148001 | 2.669778431 | 488 | 35 | 1 | 488 | 35 | 12.45 | FPS | FPS/$ | FPS/TDP | msec. | |
| 332 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 129.22 | 50.19 | 0.237534522 | 3.691965149 | 544 | 35 | 1 | 544 | 35 | 9.42 | FPS | FPS/$ | FPS/TDP | msec. | |
| 333 | yolo_v8n | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 374.34 | 153.46 | 0.624943307 | 2.994728327 | 599 | 125 | 1 | 599 | 125 | 5.32 | FPS | FPS/$ | FPS/TDP | msec. | |
| 334 | yolo_v8n | OV-2023.1 | atom | Intel® Processor N-200 | 3.26 | 1.95 | 0.016869276 | 0.542628378 | 193 | 6 | 1 | 193 | 6 | 316.56 | FPS | FPS/$ | FPS/TDP | msec. | |
| 335 | yolo_v8n | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 136.37 | 72.87 | 0.229579691 | 1.090962692 | 594 | 125 | 1 | 594 | 125 | 9.15 | FPS | FPS/$ | FPS/TDP | msec. | |
| 336 | yolo_v8n | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 52.29 | 32.98 | 0.170869765 | 0.73642462 | 306 | 71 | 1 | 306 | 71 | 19.47 | FPS | FPS/$ | FPS/TDP | msec. | |
| 337 | yolo_v8n | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 452.92 | 175.37 | 0.144058565 | 2.156762523 | 3144 | 210 | 2 | 1572 | 105 | 5.85 | FPS | FPS/$ | FPS/TDP | msec. | |
| 338 | yolo_v8n | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 978.34 | 454.72 | 0.057705352 | 2.386186661 | 16954 | 410 | 2 | 8477 | 205 | 3.51 | FPS | FPS/$ | FPS/TDP | msec. | |
| 339 | yolo_v8n | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 1708.13 | 573.45 | 0.091255994 | 3.163203145 | 18718 | 540 | 2 | 9359 | 270 | 2.38 | FPS | FPS/$ | FPS/TDP | msec. | |
| 340 | yolo_v8n | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 2882.62 | 945.60 | 0.084783045 | 4.118033592 | 34000 | 700 | 2 | 17000 | 350 | 3.82 | FPS | FPS/$ | FPS/TDP | msec. | |
| 341 | yolo_v8n | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 431.62 | 166.10 | 0.213460485 | 2.158085503 | 2022 | 200 | 2 | 1011 | 100 | 6.19 | FPS | FPS/$ | FPS/TDP | msec. | |
| 342 | yolo_v8n | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 855.04 | 342.65 | 0.376007503 | 2.850136872 | 2274 | 300 | 2 | 1137 | 150 | 3.25 | FPS | FPS/$ | FPS/TDP | msec. | |
| 343 | yolo_v8n | OV-2023.1 | accel | Intel® Flex-170 | 1445.14 | 1480.07 | 1 | 10.71 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 344 | yolo_v8n | OV-2023.1 | accel | Intel® Flex-140 | 201.93 | 259.00 | 1 | 79.17 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 345 | yolo_v8n | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 126.14 | 82.58 | 1.178855159 | 8.409166799 | 107 | 15 | 1 | 107 | 15 | 31.55 | FPS | FPS/$ | FPS/TDP | msec. | |
| 346 | yolo_v8n | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 170.37 | 110.99 | 0.347683792 | 6.084466364 | 490 | 28 | 1 | 490 | 28 | 23.22 | FPS | FPS/$ | FPS/TDP | msec. | |
| 347 | yolo_v8n | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 8.61 | 5.66 | 0.044636 | 1.435791346 | 193 | 6 | 1 | 193 | 6 | 463.22 | FPS | FPS/$ | FPS/TDP | msec. | |
| 348 | yolo_v8n | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 210.16 | 143.23 | 0.493335138 | 7.505741748 | 426 | 28 | 1 | 426 | 28 | 18.84 | FPS | FPS/$ | FPS/TDP | msec. | |
| 349 | yolo_v8n | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 116.50 | 51.35 | 1.088790654 | 7.766706667 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 350 | yolo_v8n | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 114.23 | 46.77 | 0.233123263 | 4.079657102 | 490 | 28 | 1 | 490 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 351 | yolo_v8n | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 10.54 | 4.68 | 0.05458634 | 1.755860615 | 193 | 6 | 1 | 193 | 6 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 352 | yolo_v8n | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 181.83 | 76.10 | 0.426834977 | 6.493989286 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||
| 353 | end_rec | ||||||||||||||||||
| 354 | begin_rec | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||||||||
| 355 | bloomz-560m | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 356 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 0 | 0 | 117 | 65 | 1 | 117 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 357 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 0 | 0 | 214 | 65 | 1 | 214 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 358 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 0 | 0 | 329 | 125 | 1 | 329 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 359 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 0 | 0 | 192 | 65 | 1 | 192 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 360 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 361 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 362 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 0 | 0 | 303 | 35 | 1 | 303 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 363 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 0 | 0 | 488 | 35 | 1 | 488 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 364 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 0 | 0 | 544 | 35 | 1 | 544 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 365 | bloomz-560m | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 32.34 | 49.17 | 0.053990134 | 0.25872072 | 599 | 125 | 1 | 599 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 366 | bloomz-560m | OV-2023.1 | atom | Intel® Processor N-200 | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 367 | bloomz-560m | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 0 | 0 | 594 | 125 | 1 | 594 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 368 | bloomz-560m | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 0 | 0 | 306 | 71 | 1 | 306 | 71 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 369 | bloomz-560m | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 0 | 0 | 3144 | 210 | 2 | 1572 | 105 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 370 | bloomz-560m | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 0 | 0 | 16954 | 410 | 2 | 8477 | 205 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 371 | bloomz-560m | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 28.29 | 43.45 | 0.001511565 | 0.052395333 | 18718 | 540 | 2 | 9359 | 270 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 372 | bloomz-560m | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 47.21 | 52.77 | 0.00138849 | 0.067440929 | 34000 | 700 | 2 | 17000 | 350 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 373 | bloomz-560m | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 0 | 0 | 2022 | 200 | 2 | 1011 | 100 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 374 | bloomz-560m | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 40.07 | 42.88 | 0.017620783 | 0.133565533 | 2274 | 300 | 2 | 1137 | 150 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 375 | bloomz-560m | OV-2023.1 | accel | Intel® Flex-170 | 81.64 | 82.81 | 1 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||
| 376 | bloomz-560m | OV-2023.1 | accel | Intel® Flex-140 | 70.36 | 65.11 | 1 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||
| 377 | bloomz-560m | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 378 | bloomz-560m | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 379 | bloomz-560m | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 380 | bloomz-560m | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 381 | bloomz-560m | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 382 | bloomz-560m | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 383 | bloomz-560m | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 384 | bloomz-560m | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 385 | end_rec | ||||||||||||||||||
| 386 | begin_rec | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||||||||
| 387 | GPT-j-6b | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 388 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 0 | 0 | 117 | 65 | 1 | 117 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 389 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 0 | 0 | 214 | 65 | 1 | 214 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 390 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 0 | 0 | 329 | 125 | 1 | 329 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 391 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 0 | 0 | 192 | 65 | 1 | 192 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 392 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 393 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 394 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 0 | 0 | 303 | 35 | 1 | 303 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 395 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 0 | 0 | 488 | 35 | 1 | 488 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 396 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 0 | 0 | 544 | 35 | 1 | 544 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 397 | GPT-j-6b | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 242.95 | 457.83 | 0.405588331 | 1.94357928 | 599 | 125 | 1 | 599 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 398 | GPT-j-6b | OV-2023.1 | atom | Intel® Processor N-200 | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 399 | GPT-j-6b | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 0 | 0 | 594 | 125 | 1 | 594 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 400 | GPT-j-6b | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 0 | 0 | 306 | 71 | 1 | 306 | 71 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 401 | GPT-j-6b | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 0 | 0 | 3144 | 210 | 2 | 1572 | 105 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 402 | GPT-j-6b | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 0 | 0 | 16954 | 410 | 2 | 8477 | 205 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 403 | GPT-j-6b | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 110.25 | 200.49 | 0.005889907 | 0.204161611 | 18718 | 540 | 2 | 9359 | 270 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 404 | GPT-j-6b | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 119.09 | 131.63 | 0.003502792 | 0.170135629 | 34000 | 700 | 2 | 17000 | 350 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 405 | GPT-j-6b | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 0 | 0 | 2022 | 200 | 2 | 1011 | 100 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 406 | GPT-j-6b | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 277.75 | 278.22 | 0.122140598 | 0.925825733 | 2274 | 300 | 2 | 1137 | 150 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 407 | GPT-j-6b | OV-2023.1 | accel | Intel® Flex-170 | 143.21 | 143.00 | 1 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||
| 408 | GPT-j-6b | OV-2023.1 | accel | Intel® Flex-140 | 1 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||||
| 409 | GPT-j-6b | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 410 | GPT-j-6b | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 411 | GPT-j-6b | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 412 | GPT-j-6b | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 413 | GPT-j-6b | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 414 | GPT-j-6b | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 415 | GPT-j-6b | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 416 | GPT-j-6b | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 417 | end_rec | ||||||||||||||||||
| 418 | begin_rec | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||||||||
| 419 | llama-2-7b-chat | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 420 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 0 | 0 | 117 | 65 | 1 | 117 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 421 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 0 | 0 | 214 | 65 | 1 | 214 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 422 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 0 | 0 | 329 | 125 | 1 | 329 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 423 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 0 | 0 | 192 | 65 | 1 | 192 | 65 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 424 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 425 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 426 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 0 | 0 | 303 | 35 | 1 | 303 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 427 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 0 | 0 | 488 | 35 | 1 | 488 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 428 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 0 | 0 | 544 | 35 | 1 | 544 | 35 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 429 | llama-2-7b-chat | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 285.08 | 511.77 | 0.475930451 | 2.28065872 | 599 | 125 | 1 | 599 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 430 | llama-2-7b-chat | OV-2023.1 | atom | Intel® Processor N-200 | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 431 | llama-2-7b-chat | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 0 | 0 | 594 | 125 | 1 | 594 | 125 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 432 | llama-2-7b-chat | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 0 | 0 | 306 | 71 | 1 | 306 | 71 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 433 | llama-2-7b-chat | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 0 | 0 | 3144 | 210 | 2 | 1572 | 105 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 434 | llama-2-7b-chat | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 0 | 0 | 16954 | 410 | 2 | 8477 | 205 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 435 | llama-2-7b-chat | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 95.08 | 182.22 | 0.005079793 | 0.176080667 | 18718 | 540 | 2 | 9359 | 270 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 436 | llama-2-7b-chat | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 119.29 | 133.20 | 0.003508666 | 0.170420929 | 34000 | 700 | 2 | 17000 | 350 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 437 | llama-2-7b-chat | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 0 | 0 | 2022 | 200 | 2 | 1011 | 100 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 438 | llama-2-7b-chat | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 338.67 | 345.26 | 0.148931821 | 1.1289032 | 2274 | 300 | 2 | 1137 | 150 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||
| 439 | llama-2-7b-chat | OV-2023.1 | accel | Intel® Flex-170 | 138.06 | 137.36 | 1 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||
| 440 | llama-2-7b-chat | OV-2023.1 | accel | Intel® Flex-140 | 1 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||||||||
| 441 | llama-2-7b-chat | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 442 | llama-2-7b-chat | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 443 | llama-2-7b-chat | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 444 | llama-2-7b-chat | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 445 | llama-2-7b-chat | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 0 | 0 | 107 | 15 | 1 | 107 | 15 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 446 | llama-2-7b-chat | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 0 | 0 | 490 | 28 | 1 | 490 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 447 | llama-2-7b-chat | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 0 | 0 | 193 | 6 | 1 | 193 | 6 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 448 | llama-2-7b-chat | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 0 | 0 | 426 | 28 | 1 | 426 | 28 | msec/token | msec/token/$ | msec/token/TDP | msec. | ||||
| 449 | end_rec | ||||||||||||||||||
| 450 | begin_rec | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||||||||||||
| 451 | stable diffusion V2 | OV-2023.1 | atom | Intel® Celeron™ 6305E CPU-only | 0 | 0 | 107 | 15 | 1 | 107 | 15 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 452 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i3-8100 CPU-only | 0 | 0 | 117 | 65 | 1 | 117 | 65 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 453 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i5-10500TE CPU-only | 0 | 0 | 214 | 65 | 1 | 214 | 65 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 454 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i5-13600K CPU-only | 0 | 0 | 329 | 125 | 1 | 329 | 125 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 455 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i5-8500 CPU-only | 0 | 0 | 192 | 65 | 1 | 192 | 65 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 456 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i7-1185G7 CPU-only | 0 | 0 | 426 | 28 | 1 | 426 | 28 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 457 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i7-1185GRE CPU-only | 0 | 0 | 490 | 28 | 1 | 490 | 28 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 458 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i7-8700T CPU-only | 0 | 0 | 303 | 35 | 1 | 303 | 35 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 459 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i9-10900TE CPU-only | 0 | 0 | 488 | 35 | 1 | 488 | 35 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 460 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i9-12900TE CPU-only | 0 | 0 | 544 | 35 | 1 | 544 | 35 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 461 | stable diffusion V2 | OV-2023.1 | core | Intel® Core™ i9-13900K CPU-only | 43.21 | 43.13 | 0.072129599 | 0.34564504 | 599 | 125 | 1 | 599 | 125 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||
| 462 | stable diffusion V2 | OV-2023.1 | atom | Intel® Processor N-200 | 0 | 0 | 193 | 6 | 1 | 193 | 6 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 463 | stable diffusion V2 | OV-2023.1 | xeon | Intel® Xeon® W1290P CPU-only | 0 | 0 | 594 | 125 | 1 | 594 | 125 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 464 | stable diffusion V2 | OV-2023.1 | xeon | Intel® Xeon® E-2124G CPU-only | 0 | 0 | 306 | 71 | 1 | 306 | 71 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 465 | stable diffusion V2 | OV-2023.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 0 | 0 | 3144 | 210 | 2 | 1572 | 105 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 466 | stable diffusion V2 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 0 | 0 | 16954 | 410 | 2 | 8477 | 205 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 467 | stable diffusion V2 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 18.95 | 19.43 | 0.001012236 | 0.035087093 | 18718 | 540 | 2 | 9359 | 270 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||
| 468 | stable diffusion V2 | OV-2023.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 5.88 | 6.47 | 0.000172889 | 0.008397471 | 34000 | 700 | 2 | 17000 | 350 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||
| 469 | stable diffusion V2 | OV-2023.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 0 | 0 | 2022 | 200 | 2 | 1011 | 100 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 470 | stable diffusion V2 | OV-2023.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 21.92 | 22.42 | 0.00963796 | 0.073055733 | 2274 | 300 | 2 | 1137 | 150 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||
| 471 | stable diffusion V2 | OV-2023.1 | accel | Intel® Flex-170 | 4.29 | 4.31 | 1 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||||||
| 472 | stable diffusion V2 | OV-2023.1 | accel | Intel® Flex-140 | 18.68 | 18.46 | 1 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||||||
| 473 | stable diffusion V2 | OV-2023.1 | core-iGPU | Intel® Celeron™ 6305E iGPU-only | 0 | 0 | 107 | 15 | 1 | 107 | 15 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 474 | stable diffusion V2 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 0 | 0 | 490 | 28 | 1 | 490 | 28 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 475 | stable diffusion V2 | OV-2023.1 | core-iGPU | Intel® Processor N200 iGPU-only | 0 | 0 | 193 | 6 | 1 | 193 | 6 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 476 | stable diffusion V2 | OV-2023.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 0 | 0 | 426 | 28 | 1 | 426 | 28 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 477 | stable diffusion V2 | OV-2023.1 | core-CPU+iGPU | Intel® Celeron™ 6305E CPU+iGPU | 0 | 0 | 107 | 15 | 1 | 107 | 15 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 478 | stable diffusion V2 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 0 | 0 | 490 | 28 | 1 | 490 | 28 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 479 | stable diffusion V2 | OV-2023.1 | core-CPU+iGPU | Intel® Processor N200 CPU+iGPU | 0 | 0 | 193 | 6 | 1 | 193 | 6 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 480 | stable diffusion V2 | OV-2023.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 0 | 0 | 426 | 28 | 1 | 426 | 28 | Generation time, sec. | Generation-time/$ | Generation-time/TDP | msec. | ||||
| 481 | end_rec |