[DOCS] new benchmark data (#18532)

This commit is contained in:
Karol Blaszczak 2023-07-18 18:03:25 +02:00 committed by GitHub
parent 700677c5c6
commit fe7b19af6a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
5 changed files with 487 additions and 368 deletions

View File

@ -1,421 +1,541 @@
Network model,Release,IE-Type,Platform name,Throughput-INT8,Throughput-FP16,Throughput-FP32,Value,Efficiency,Price,TDP,Sockets,Price/socket,TDP/socket,Latency
Network model,Release,IE-Type,Platform name,Throughput-INT8,ThroughputFP16,ThroughputFP32,Value,Efficiency,Price,TDP,Sockets,Price/socket,TDP/socket,Latency
begin_rec,,,,,,,,,,,,,,
GPT-2,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,,,0.10,0.000,0.000,34,9.5,1,34,9.5,
GPT-2,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,1.03,0.000,0.000,117,65,1,117,65,
GPT-2,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,,,1.21,0.000,0.000,214,35,1,214,35,
GPT-2,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,,,2.94,0.000,0.000,329,125,1,329,125,
GPT-2,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,,,1.50,0.000,0.000,197,65,1,197,65,
GPT-2,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,,,1.25,0.000,0.000,426,28,1,426,28,
GPT-2,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,,,0.85,0.000,0.000,490,28,1,490,28,
GPT-2,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,,,1.57,0.000,0.000,303,35,1,303,35,
GPT-2,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,,,1.28,0.000,0.000,488,35,1,488,35,
GPT-2,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,,,1.48,0.000,0.000,544,35,1,544,35,
GPT-2,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,,,4.26,0.000,0.000,599,125,1,599,125,
GPT-2,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,,,1.45,0.000,0.000,594,125,1,594,125,
GPT-2,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,,,1.07,0.000,0.000,249,71,1,249,71,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,,,5.55,0.000,0.000,3144,204,2,1572,102,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,,,14.00,0.000,0.000,16954,410,2,8477,205,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,,,5.30,0.000,0.000,2004,250,2,1002,125,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,,,22.00,0.000,0.000,18718,540,2,9359,270,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,,,29.03,0.000,0.000,34000,700,2,17000,350,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,,,11.26,0.000,0.000,2274,300,2,1137,150,
GPT-2,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,,,2.02,0.000,0.000,697,45,1,697,45,
GPT-2,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,,,0.30,0.000,0.000,107,15,1,107,15,
GPT-2,OV-2023.0,accel,Intel® Flex-170 GPU,,49.09,,0.000,0.000,1925,150,1,1925,150,
GPT-2,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,,1.57,,0.000,0.000,490,28,1,490,28,
GPT-2,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,,2.27,,0.000,0.000,107,15,1,107,15,
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,,,1.56,0.000,0.000,490,28,1,490,28,
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,,,1.48,0.000,0.000,107,15,1,107,15,
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,71.70,,25.90,0.103,1.593,697,45,1,697,45,21.119
bert-base-cased,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,2.72,,1.33,0.080,0.286,34,9.5,1,34,9.5,392.843
bert-base-cased,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,11.27,,4.28,0.105,0.752,107,15,1,107,15,88.854
bert-base-cased,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,22.23,,14.89,0.190,0.342,117,65,1,117,65,46.754
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,33.65,,19.51,0.157,0.961,214,35,1,214,35,35.398
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,103.31,,44.62,0.314,0.826,329,125,1,329,125,18.719
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,34.72,,22.57,0.176,0.534,197,65,1,197,65,30.392
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,49.78,,17.87,0.117,1.778,426,28,1,426,28,24.03
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,38.20,,14.91,0.078,1.364,490,28,1,490,28,26.874
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,28.32,,16.03,0.093,0.809,303,35,1,303,35,41.835
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,35.62,,18.79,0.073,1.018,488,35,1,488,35,38.627
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,51.56,,19.50,0.095,1.473,544,35,1,544,35,26.626
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,150.45,,67.78,0.251,1.204,599,125,1,599,125,15.82
bert-base-cased,OV-2023.0,atom,Intel® Processor N-200,1.62,,0.85,0.008,0.270,193,6,1,193,6,668.333
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,59.78,,35.79,0.101,0.478,594,125,1,594,125,19.817
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,21.83,,14.60,0.088,0.307,249,71,1,249,71,47.596
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,215.56,,80.01,0.069,1.057,3144,204,2,1572,102,14.761
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,557.71,,222.26,0.033,1.360,16954,410,2,8477,205,8.731
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,206.20,,76.54,0.103,0.825,2004,250,2,1002,125,15.389
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-11800H,92.59,,33.22,0.213,2.057,435,45,1,435,45,14.206
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,877.01,,196.60,0.047,1.624,18718,540,2,9359,270,7.873
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,3107.56,,448.17,0.091,4.439,34000,700,2,17000,350,5.274
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,429.94,,171.12,0.189,1.433,2274,300,2,1137,150,8.897
bert-base-cased,OV-2023.0,accel,Intel® Flex-170,648.29,582.97,,0.337,4.322,1925,150,1,1925,150,24.289
bert-base-cased,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,44.64,32.01,21.94,0.417,2.976,107,15,1,107,15,89.466
bert-base-cased,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,69.65,55.42,36.87,0.142,2.487,490,28,1,490,28,53.822
bert-base-cased,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,88.24,60.90,46.38,0.127,1.961,697,45,1,697,45,44.864
bert-base-cased,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,3.31,2.36,1.49,0.017,0.551,193,6,1,193,6,1207.72
bert-base-cased,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,82.48,59.66,41.79,0.194,2.946,426,28,1,426,28,48.15
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,53.07,,24.80,0.496,3.538,107,15,1,107,15,
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,71.87,,27.99,0.147,2.567,490,28,1,490,28,
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,127.08,,55.39,0.182,2.824,697,45,1,697,45,
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,4.21,,2.08,0.022,0.701,193,6,1,193,6,
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,83.41,,39.13,0.196,2.979,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
bert-base-cased,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,3.05,,1.33,0.090,0.321,34,9.5,1,34,9.5,354.611
bert-base-cased,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,23.94,,14.89,0.205,0.368,117,65,1,117,65,43.191
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,35.72,,19.51,0.167,1.021,214,35,1,214,35,32.456
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,124.63,,44.62,0.379,0.997,329,125,1,329,125,15.855
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,37.95,,22.57,0.193,0.584,197,65,1,197,65,27.794
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,62.93,,17.87,0.148,2.248,426,28,1,426,28,19.316
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,50.36,,14.91,0.103,1.798,490,28,1,490,28,21.583
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,42.21,,22.78,0.139,1.206,303,35,1,303,35,27.589
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,38.74,,18.79,0.079,1.107,488,35,1,488,35,35.128
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,61.46,,19.49,0.113,1.756,544,35,1,544,35,22.006
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,180.30,,68.74,0.301,1.442,599,125,1,599,125,13.181
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,64.34,,35.79,0.108,0.515,594,125,1,594,125,18.403
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,23.46,,14.60,0.094,0.330,249,71,1,249,71,43.94
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,269.69,,80.01,0.086,1.322,3144,204,2,1572,102,12.823
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,678.10,,222.26,0.040,1.654,16954,410,2,8477,205,7.567
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,258.75,,76.54,0.129,1.035,2004,250,2,1002,125,13.326
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,1096.03,,196.59,0.059,2.030,18718,540,2,9359,270,6.09
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,3372.80,,445.48,0.099,4.818,34000,700,2,17000,350,4.869
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,533.66,,171.12,0.235,1.779,2274,300,2,1137,150,7.683
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,85.32,,25.90,0.122,1.896,697,45,1,697,45,17.986
bert-base-cased,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,14.00,,4.28,0.131,0.933,107,15,1,107,15,
bert-base-cased,OV-2023.0,accel,Intel® Flex-170 GPU,670.48,582.97,,0.348,4.470,1925,150,1,1925,150,23.469
bert-base-cased,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,77.37,37.02,,0.158,2.763,490,28,1,490,28,52.374
bert-base-cased,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,47.15,32.01,,0.441,3.144,107,15,1,107,15,84.683
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,85.30,,28.16,0.174,3.046,490,28,1,490,28,
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,56.20,,24.79,0.525,3.747,107,15,1,107,15,
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,6.79,,2.68,0.010,0.151,697,45,1,697,45,181.851
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.26,,0.13,0.008,0.028,34,9.5,1,34,9.5,4055.305
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,1.10,,0.38,0.010,0.074,107,15,1,107,15,883.753
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,2.11,,1.26,0.018,0.032,117,65,1,117,65,492.094
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,2.98,,1.75,0.014,0.085,214,35,1,214,35,351.295
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,9.17,,3.72,0.028,0.073,329,125,1,329,125,149.646
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,3.26,,1.91,0.017,0.050,197,65,1,197,65,308.598
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,4.60,,1.57,0.011,0.164,426,28,1,426,28,230.242
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,3.32,,1.28,0.007,0.118,490,28,1,490,28,271.873
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,2.71,,1.55,0.009,0.077,303,35,1,303,35,407.64
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,3.14,,1.76,0.006,0.090,488,35,1,488,35,335.174
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,5.13,,1.89,0.009,0.146,544,35,1,544,35,214.42
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,14.55,,6.05,0.024,0.116,599,125,1,599,125,115.166
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,atom,Intel® Processor N-200,0.16,,0.08,0.001,0.026,193,6,1,193,6,6605.009
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,4.40,,2.71,0.007,0.035,594,125,1,594,125,180.697
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,2.12,,1.30,0.008,0.030,249,71,1,249,71,481.442
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,20.31,,7.14,0.006,0.100,3144,204,2,1572,102,104.829
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,46.48,,19.65,0.003,0.113,16954,410,2,8477,205,50.293
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,19.27,,6.83,0.010,0.077,2004,250,2,1002,125,109.227
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core,Intel® Core™ i7-11800H,8.50,,2.90,0.020,0.189,435,45,1,435,45,125.712
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,74.00,,26.69,0.004,0.137,18718,540,2,9359,270,39.786
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,125.14,,44.52,0.004,0.179,34000,700,2,17000,350,23.966
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,37.60,,14.83,0.017,0.125,2274,300,2,1137,150,60.232
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,accel,Intel® Flex-170,120.47,80.23,,0.063,0.803,1925,150,1,1925,150,132.308
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,4.72,3.49,2.13,0.044,0.314,107,15,1,107,15,815.785
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,5.06,6.29,2.96,0.010,0.181,490,28,1,490,28,788.772
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,11.39,8.22,5.15,0.016,0.253,697,45,1,697,45,350.737
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,0.35,0.24,0.14,0.002,0.058,193,6,1,193,6,11593.101
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,9.16,7.22,4.24,0.021,0.327,426,28,1,426,28,445.659
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,4.87,,2.19,0.046,0.325,107,15,1,107,15,
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,3.38,,2.09,0.007,0.121,490,28,1,490,28,
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,11.78,,4.86,0.017,0.262,697,45,1,697,45,
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,0.44,,0.18,0.002,0.073,193,6,1,193,6,
bert-large-uncased-whole-word-masking-squad-0001,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,7.98,,3.42,0.019,0.285,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
bert-large-uncased,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.26,,0.13,0.008,0.028,34,9.5,1,34,9.5,4055.305
bert-large-uncased,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,2.11,,1.26,0.018,0.032,117,65,1,117,65,492.094
bert-large-uncased,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,2.98,,1.75,0.014,0.085,214,35,1,214,35,351.294
bert-large-uncased,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,9.17,,3.72,0.028,0.073,329,125,1,329,125,149.645
bert-large-uncased,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,3.26,,1.91,0.017,0.050,197,65,1,197,65,308.597
bert-large-uncased,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,4.60,,1.57,0.011,0.164,426,28,1,426,28,230.241
bert-large-uncased,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,3.32,,1.28,0.007,0.118,490,28,1,490,28,271.873
bert-large-uncased,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,3.55,,2.12,0.012,0.101,303,35,1,303,35,295.498
bert-large-uncased,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,3.14,,1.76,0.006,0.090,488,35,1,488,35,335.174
bert-large-uncased,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,5.12,,1.89,0.009,0.146,544,35,1,544,35,214.42
bert-large-uncased,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,14.40,,6.09,0.024,0.115,599,125,1,599,125,115.336
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,4.40,,2.71,0.007,0.035,594,125,1,594,125,177.897
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,2.12,,1.30,0.008,0.030,249,71,1,249,71,481.442
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,20.31,,7.14,0.006,0.100,3144,204,2,1572,102,104.828
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,46.48,,19.65,0.003,0.113,16954,410,2,8477,205,50.292
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,19.27,,6.83,0.010,0.077,2004,250,2,1002,125,109.226
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,74.00,,26.69,0.004,0.137,18718,540,2,9359,270,39.549
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,125.14,,44.52,0.004,0.179,34000,700,2,17000,350,23.947
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,37.60,,14.83,0.017,0.125,2274,300,2,1137,150,60.208
bert-large-uncased,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,6.79,,2.68,0.010,0.151,697,45,1,697,45,181.85
bert-large-uncased,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,1.10,,0.38,0.010,0.073,107,15,1,107,15,883.753
bert-large-uncased,OV-2023.0,accel,Intel® Flex-170 GPU,120.47,80.23,,0.063,0.803,1925,150,1,1925,150,132.308
bert-large-uncased,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,5.10,2.96,,0.010,0.182,490,28,1,490,28,788.772
bert-large-uncased,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,4.72,3.49,,0.044,0.314,107,15,1,107,15,815.785
bert-large-uncased,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,5.05,,2.95,0.010,0.180,490,28,1,490,28,
bert-large-uncased,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,4.86,,2.19,0.045,0.324,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
deeplabv3,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,,,1.47,0.000,0.000,34,9.5,1,34,9.5,359.456
deeplabv3,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,,0.000,0.000,117,65,1,117,65,
deeplabv3,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,74.12,,31.22,0.106,1.647,697,45,1,697,45,18.344
deeplabv3,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,2.91,,1.47,0.086,0.306,34,9.5,1,34,9.5,359.456
deeplabv3,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,12.54,,4.67,0.117,0.836,107,15,1,107,15,80.847
deeplabv3,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,23.64,,14.69,0.202,0.364,117,65,1,117,65,42.294
deeplabv3,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,36.23,,16.70,0.169,1.035,214,35,1,214,35,32.374
deeplabv3,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,95.00,,41.09,0.289,0.760,329,125,1,329,125,15.959
deeplabv3,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,38.31,,21.59,0.194,0.589,197,65,1,197,65,26.51
deeplabv3,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,54.05,,16.27,0.127,1.930,426,28,1,426,28,20.652
deeplabv3,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,34.93,,10.57,0.071,1.247,490,28,1,490,28,27.622
deeplabv3,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,,,,0.000,0.000,303,35,1,303,35,
deeplabv3,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,54.05,,16.27,0.127,1.930,426,28,1,426,28,20.653
deeplabv3,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,34.93,,10.57,0.071,1.247,490,28,1,490,28,27.623
deeplabv3,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,32.93,,18.64,0.109,0.941,303,35,1,303,35,35.127
deeplabv3,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,38.14,,18.17,0.078,1.090,488,35,1,488,35,27.35
deeplabv3,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,59.94,,23.05,0.110,1.713,544,35,1,544,35,20.76
deeplabv3,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,148.05,,58.47,0.247,1.184,599,125,1,599,125,12.241
deeplabv3,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,,,,0.000,0.000,594,125,1,594,125,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,,,,0.000,0.000,249,71,1,249,71,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,,,77.92,0.000,0.000,3144,204,2,1572,102,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,,,,0.000,0.000,16954,410,2,8477,205,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,,,75.53,0.000,0.000,2004,250,2,1002,125,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,649.53,,229.92,0.035,1.203,18718,540,2,9359,270,3.405
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,1030.08,,382.32,0.030,1.472,34000,700,2,17000,350,3.326
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,410.93,,141.37,0.181,1.370,2274,300,2,1137,150,5.875
deeplabv3,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,74.12,,31.22,0.106,1.647,697,45,1,697,45,18.343
deeplabv3,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,,,4.67,0.000,0.000,107,15,1,107,15,
deeplabv3,OV-2023.0,accel,Intel® Flex-170 GPU,746.27,500.10,,0.388,4.975,1925,150,1,1925,150,21.132
deeplabv3,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,78.43,13.79,,0.160,2.801,490,28,1,490,28,49.979
deeplabv3,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,62.44,28.53,,0.584,4.163,107,15,1,107,15,63.94
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,76.72,,13.98,0.157,2.740,490,28,1,490,28,
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,62.43,,16.71,0.583,4.162,107,15,1,107,15,
deeplabv3,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,59.94,,23.05,0.110,1.713,544,35,1,544,35,20.761
deeplabv3,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,146.06,,56.67,0.244,1.168,599,125,1,599,125,11.988
deeplabv3,OV-2023.0,atom,Intel® Processor N-200,1.78,,1.03,0.009,0.297,193,6,1,193,6,572.256
deeplabv3,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,55.64,,19.26,0.094,0.445,594,125,1,594,125,17.404
deeplabv3,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,23.34,,15.54,0.094,0.329,249,71,1,249,71,42.626
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,201.62,,77.92,0.064,0.988,3144,204,2,1572,102,10.754
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,448.78,,157.91,0.026,1.095,16954,410,2,8477,205,4.853
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,196.52,,75.53,0.098,0.786,2004,250,2,1002,125,11.109
deeplabv3,OV-2023.0,core,Intel® Core™ i7-11800H,86.85,,27.00,0.200,1.930,435,45,1,435,45,12.137
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,649.53,,229.92,0.035,1.203,18718,540,2,9359,270,3.847
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,1030.08,,382.32,0.030,1.472,34000,700,2,17000,350,3.199
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,410.93,,141.37,0.181,1.370,2274,300,2,1137,150,5.369
deeplabv3,OV-2023.0,accel,Intel® Flex-170,746.27,500.10,,0.388,4.975,1925,150,1,1925,150,21.133
deeplabv3,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,62.44,28.53,16.72,0.584,4.163,107,15,1,107,15,63.94
deeplabv3,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,76.73,36.90,13.98,0.157,2.740,490,28,1,490,28,49.979
deeplabv3,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,121.55,55.55,36.78,0.174,2.701,697,45,1,697,45,32.538
deeplabv3,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,3.85,2.01,1.36,0.020,0.641,193,6,1,193,6,1038.839
deeplabv3,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,109.22,50.67,28.82,0.256,3.901,426,28,1,426,28,36.378
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,62.77,,16.96,0.587,4.184,107,15,1,107,15,
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,51.34,,8.91,0.105,1.834,490,28,1,490,28,
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,139.61,,40.39,0.200,3.103,697,45,1,697,45,
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,4.81,,1.97,0.025,0.802,193,6,1,193,6,
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,92.48,,24.81,0.217,3.303,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
efficientdet-d0,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,3.76,,2.64,0.111,0.396,34,9.5,1,34,9.5,290.489
efficientdet-d0,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,33.53,,23.96,0.287,0.516,117,65,1,117,65,31.272
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,50.07,,28.48,0.234,1.430,214,35,1,214,35,24.356
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,128.34,,84.11,0.390,1.027,329,125,1,329,125,13.005
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,53.85,,35.65,0.273,0.828,197,65,1,197,65,20.31
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,69.87,,39.11,0.164,2.495,426,28,1,426,28,17.366
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,47.89,,20.09,0.098,1.710,490,28,1,490,28,23.549
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,47.53,,37.79,0.157,1.358,303,35,1,303,35,
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,54.67,,32.54,0.112,1.562,488,35,1,488,35,21.202
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,71.50,,45.10,0.131,2.043,544,35,1,544,35,17.778
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,192.62,,104.56,0.322,1.541,599,125,1,599,125,10.4
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,92.53,,35.06,0.156,0.740,594,125,1,594,125,13.425
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,32.46,,25.97,0.130,0.457,249,71,1,249,71,32.052
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,236.75,,163.08,0.075,1.161,3144,204,2,1572,102,12.998
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,458.66,,294.01,0.027,1.119,16954,410,2,8477,205,8.596
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,228.21,,157.38,0.114,0.913,2004,250,2,1002,125,13.312
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,709.57,,452.65,0.038,1.314,18718,540,2,9359,270,9.742
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,922.74,,791.57,0.027,1.318,34000,700,2,17000,350,6.149
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,416.01,,270.46,0.183,1.387,2274,300,2,1137,150,8.366
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,97.01,,57.69,0.139,2.156,697,45,1,697,45,14.749
efficientdet-d0,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,3.76,,2.64,0.111,0.396,34,9.5,1,34,9.5,290.49
efficientdet-d0,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,17.79,,11.10,0.166,1.186,107,15,1,107,15,61.812
efficientdet-d0,OV-2023.0,accel,Intel® Flex-170 GPU,684.48,640.17,,0.356,4.563,1925,150,1,1925,150,22.702
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,61.69,24.16,,0.126,2.203,490,28,1,490,28,63.923
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,66.61,60.60,,0.623,4.441,107,15,1,107,15,59.789
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,61.69,,24.13,0.126,2.203,490,28,1,490,28,
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,66.61,,33.76,0.623,4.441,107,15,1,107,15,
efficientdet-d0,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,33.53,,23.96,0.287,0.516,117,65,1,117,65,31.273
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,50.07,,28.48,0.234,1.430,214,35,1,214,35,24.356
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,128.34,,84.12,0.390,1.027,329,125,1,329,125,13.006
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,53.85,,35.65,0.273,0.828,197,65,1,197,65,20.31
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,69.87,,39.11,0.164,2.495,426,28,1,426,28,17.367
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,47.89,,20.09,0.098,1.710,490,28,1,490,28,23.549
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,47.53,,33.64,0.157,1.358,303,35,1,303,35,26.193
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,54.68,,32.54,0.112,1.562,488,35,1,488,35,21.202
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,71.50,,45.10,0.131,2.043,544,35,1,544,35,17.779
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,192.62,,103.94,0.322,1.541,599,125,1,599,125,10.401
efficientdet-d0,OV-2023.0,atom,Intel® Processor N-200,2.05,,1.65,0.011,0.342,193,6,1,193,6,496.613
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,79.60,,35.06,0.134,0.637,594,125,1,594,125,13.426
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,32.46,,25.97,0.130,0.457,249,71,1,249,71,32.053
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,236.75,,163.08,0.075,1.161,3144,204,2,1572,102,12.998
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,458.66,,294.01,0.027,1.119,16954,410,2,8477,205,8.597
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,228.21,,157.38,0.114,0.913,2004,250,2,1002,125,13.254
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-11800H,109.41,,61.21,0.252,2.431,435,45,1,435,45,10.459
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,709.57,,452.65,0.038,1.314,18718,540,2,9359,270,9.743
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,922.74,,791.57,0.027,1.318,34000,700,2,17000,350,6.149
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,416.02,,270.47,0.183,1.387,2274,300,2,1137,150,8.367
efficientdet-d0,OV-2023.0,accel,Intel® Flex-170,684.48,640.17,,0.356,4.563,1925,150,1,1925,150,22.703
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,66.61,60.60,33.76,0.623,4.441,107,15,1,107,15,59.789
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,61.69,49.32,24.14,0.126,2.203,490,28,1,490,28,63.923
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,123.77,105.73,60.06,0.178,2.751,697,45,1,697,45,31.947
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,5.64,5.03,3.02,0.029,0.940,193,6,1,193,6,707.252
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,108.15,90.40,51.00,0.254,3.862,426,28,1,426,28,36.641
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,56.00,,33.11,0.523,3.733,107,15,1,107,15,
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,50.72,,18.56,0.104,1.811,490,28,1,490,28,
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,144.59,,69.25,0.207,3.213,697,45,1,697,45,
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,6.03,,3.81,0.031,1.005,193,6,1,193,6,
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,97.10,,49.20,0.228,3.468,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,10.07,,3.25,0.014,0.224,697,45,1,697,45,173.007
faster_rcnn_resnet50_coco,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.31,,0.13,0.009,0.032,34,9.5,1,34,9.5,3336.101
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,2.89,,1.51,0.025,0.045,117,65,1,117,65,358.208
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,4.22,,2.26,0.020,0.120,214,35,1,214,35,307.053
faster_rcnn_resnet50_coco,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,1.60,,0.42,0.015,0.106,107,15,1,107,15,640.413
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,2.89,,1.51,0.025,0.045,117,65,1,117,65,358.209
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,4.22,,2.26,0.020,0.120,214,35,1,214,35,307.054
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,13.04,,4.32,0.040,0.104,329,125,1,329,125,163.824
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,4.59,,2.39,0.023,0.071,197,65,1,197,65,247.538
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,6.74,,1.78,0.016,0.241,426,28,1,426,28,165.661
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,5.16,,1.43,0.011,0.184,490,28,1,490,28,199.974
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,4.87,,2.66,0.016,0.139,303,35,1,303,35,264.983
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,4.42,,2.27,0.009,0.126,488,35,1,488,35,252.35
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,3.60,,1.89,0.012,0.103,303,35,1,303,35,344.134
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,4.42,,2.27,0.009,0.126,488,35,1,488,35,252.351
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,7.29,,2.34,0.013,0.208,544,35,1,544,35,188.868
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,21.05,,7.31,0.035,0.168,599,125,1,599,125,111.671
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,8.65,,4.36,0.015,0.069,594,125,1,594,125,139.23
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,2.78,,1.48,0.011,0.039,249,71,1,249,71,363.574
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,29.15,,8.22,0.009,0.143,3144,204,2,1572,102,77.579
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,20.79,,7.23,0.035,0.166,599,125,1,599,125,111.834
faster_rcnn_resnet50_coco,OV-2023.0,atom,Intel® Processor N-200,0.20,,0.09,0.001,0.034,193,6,1,193,6,5079.528
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,7.85,,4.03,0.013,0.063,594,125,1,594,125,138.525
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,2.78,,1.49,0.011,0.039,249,71,1,249,71,363.574
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,29.15,,8.22,0.009,0.143,3144,204,2,1572,102,77.58
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,85.87,,22.37,0.005,0.209,16954,410,2,8477,205,30.369
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,27.70,,7.83,0.014,0.111,2004,250,2,1002,125,79.52
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,112.09,,32.42,0.006,0.208,18718,540,2,9359,270,89.144
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,417.49,,50.54,0.012,0.596,34000,700,2,17000,350,10.171
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,65.13,,16.92,0.029,0.217,2274,300,2,1137,150,42.66
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,10.07,,3.25,0.014,0.224,697,45,1,697,45,173.006
faster_rcnn_resnet50_coco,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,1.60,,0.42,0.015,0.106,107,15,1,107,15,640.412
faster_rcnn_resnet50_coco,OV-2023.0,accel,Intel® Flex-170 GPU,222.32,144.56,,0.115,1.482,1925,150,1,1925,150,71.569
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,13.38,2.37,,0.027,0.478,490,28,1,490,28,298.019
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,8.22,4.09,,0.077,0.548,107,15,1,107,15,475.77
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,13.31,,2.38,0.027,0.475,490,28,1,490,28,
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,8.21,,1.83,0.077,0.547,107,15,1,107,15,
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,27.70,,7.83,0.014,0.111,2004,250,2,1002,125,79.521
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i7-11800H,12.17,,3.28,0.028,0.270,435,45,1,435,45,93.88
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,112.09,,32.42,0.006,0.208,18718,540,2,9359,270,90.8
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,417.49,,50.54,0.012,0.596,34000,700,2,17000,350,10.218
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,65.13,,16.92,0.029,0.217,2274,300,2,1137,150,42.57
faster_rcnn_resnet50_coco,OV-2023.0,accel,Intel® Flex-170,222.32,144.56,,0.115,1.482,1925,150,1,1925,150,71.57
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,8.22,4.09,1.84,0.077,0.548,107,15,1,107,15,475.771
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,13.31,6.13,2.38,0.027,0.475,490,28,1,490,28,298.019
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,17.32,9.61,4.50,0.025,0.385,697,45,1,697,45,230.593
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,0.48,0.28,0.14,0.002,0.080,193,6,1,193,6,8322.584
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,15.37,8.20,3.72,0.036,0.549,426,28,1,426,28,266.287
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,8.58,,1.99,0.080,0.572,107,15,1,107,15,
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,11.83,,1.81,0.024,0.423,490,28,1,490,28,
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,20.10,,5.54,0.029,0.447,697,45,1,697,45,
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,0.60,,0.19,0.003,0.099,193,6,1,193,6,
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,13.39,,3.31,0.031,0.478,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
inception-v4,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,3.19,,1.34,0.094,0.335,34,9.5,1,34,9.5,330.309
inception-v4,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,29.71,,15.29,0.254,0.457,117,65,1,117,65,34.592
inception-v4,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,42.94,,22.86,0.201,1.227,214,35,1,214,35,25.956
inception-v4,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,147.72,,42.20,0.449,1.182,329,125,1,329,125,15.377
inception-v4,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,47.19,,23.81,0.240,0.726,197,65,1,197,65,21.506
inception-v4,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,68.56,,17.47,0.161,2.449,426,28,1,426,28,16.906
inception-v4,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,55.82,,14.00,0.114,1.994,490,28,1,490,28,19.042
inception-v4,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,49.05,,26.55,0.162,1.401,303,35,1,303,35,22.154
inception-v4,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,45.87,,22.92,0.094,1.311,488,35,1,488,35,24.899
inception-v4,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,80.22,,22.64,0.147,2.292,544,35,1,544,35,19.511
inception-v4,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,224.68,,71.78,0.375,1.797,599,125,1,599,125,11.8
inception-v4,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,91.41,,42.89,0.154,0.731,594,125,1,594,125,12.94
inception-v4,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,28.17,,14.89,0.113,0.397,249,71,1,249,71,36.364
inception-v4,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,302.16,,77.16,0.096,1.481,3144,204,2,1572,102,10.627
inception-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,950.44,,228.44,0.056,2.318,16954,410,2,8477,205,5.714
inception-v4,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,287.12,,73.94,0.143,1.148,2004,250,2,1002,125,11.352
inception-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,1475.64,,347.33,0.079,2.733,18718,540,2,9359,270,3.339
inception-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,5145.62,,522.16,0.151,7.351,34000,700,2,17000,350,3.434
inception-v4,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,730.64,,169.52,0.321,2.435,2274,300,2,1137,150,6.456
inception-v4,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,111.78,,31.98,0.160,2.484,697,45,1,697,45,16.4
inception-v4,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,15.15,,4.13,0.142,1.010,107,15,1,107,15,65.483
inception-v4,OV-2023.0,accel,Intel® Flex-170 GPU,834.65,515.70,,0.434,5.564,1925,150,1,1925,150,18.9
inception-v4,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,109.98,33.26,,0.224,3.928,490,28,1,490,28,36.221
inception-v4,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,66.82,31.46,,0.625,4.455,107,15,1,107,15,59.758
inception-v4,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,106.60,,33.09,0.218,3.807,490,28,1,490,28,
inception-v4,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,66.82,,18.62,0.624,4.455,107,15,1,107,15,
googlenet-v4,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,111.78,,31.98,0.160,2.484,697,45,1,697,45,16.401
googlenet-v4,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,3.19,,1.34,0.094,0.335,34,9.5,1,34,9.5,330.309
googlenet-v4,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,15.15,,4.13,0.142,1.010,107,15,1,107,15,65.484
googlenet-v4,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,29.71,,15.29,0.254,0.457,117,65,1,117,65,34.592
googlenet-v4,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,42.94,,22.86,0.201,1.227,214,35,1,214,35,25.957
googlenet-v4,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,147.72,,42.20,0.449,1.182,329,125,1,329,125,15.377
googlenet-v4,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,47.19,,23.81,0.240,0.726,197,65,1,197,65,21.507
googlenet-v4,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,68.56,,17.47,0.161,2.449,426,28,1,426,28,16.906
googlenet-v4,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,55.82,,14.00,0.114,1.994,490,28,1,490,28,19.042
googlenet-v4,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,35.79,,18.77,0.118,1.023,303,35,1,303,35,31.127
googlenet-v4,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,45.87,,22.92,0.094,1.311,488,35,1,488,35,24.9
googlenet-v4,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,80.22,,22.64,0.147,2.292,544,35,1,544,35,19.511
googlenet-v4,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,219.92,,69.93,0.367,1.759,599,125,1,599,125,11.893
googlenet-v4,OV-2023.0,atom,Intel® Processor N-200,2.02,,0.92,0.010,0.337,193,6,1,193,6,536.385
googlenet-v4,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,82.75,,41.21,0.139,0.662,594,125,1,594,125,13.243
googlenet-v4,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,28.17,,14.89,0.113,0.397,249,71,1,249,71,36.365
googlenet-v4,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,302.16,,77.16,0.096,1.481,3144,204,2,1572,102,10.628
googlenet-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,950.44,,228.44,0.056,2.318,16954,410,2,8477,205,5.714
googlenet-v4,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,287.12,,73.94,0.143,1.148,2004,250,2,1002,125,11.353
googlenet-v4,OV-2023.0,core,Intel® Core™ i7-11800H,128.48,,32.51,0.295,2.855,435,45,1,435,45,10.465
googlenet-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,1475.64,,347.33,0.079,2.733,18718,540,2,9359,270,3.308
googlenet-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,5145.62,,522.17,0.151,7.351,34000,700,2,17000,350,3.46
googlenet-v4,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,730.64,,169.52,0.321,2.435,2274,300,2,1137,150,6.386
googlenet-v4,OV-2023.0,accel,Intel® Flex-170,834.65,515.70,,0.434,5.564,1925,150,1,1925,150,18.9
googlenet-v4,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,66.82,31.46,18.62,0.625,4.455,107,15,1,107,15,59.758
googlenet-v4,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,106.60,55.16,33.10,0.218,3.807,490,28,1,490,28,36.221
googlenet-v4,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,126.94,64.60,41.28,0.182,2.821,697,45,1,697,45,31.129
googlenet-v4,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,4.27,1.99,1.14,0.022,0.712,193,6,1,193,6,934.853
googlenet-v4,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,120.74,59.65,36.70,0.283,4.312,426,28,1,426,28,32.7
googlenet-v4,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,86.46,,20.87,0.808,5.764,107,15,1,107,15,
googlenet-v4,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,134.97,,32.38,0.275,4.820,490,28,1,490,28,
googlenet-v4,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,203.09,,55.43,0.291,4.513,697,45,1,697,45,
googlenet-v4,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,6.00,,1.59,0.031,1.001,193,6,1,193,6,
googlenet-v4,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,125.28,,33.33,0.294,4.474,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
mobilenet-ssd,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,27.01,,12.73,0.794,2.843,34,9.5,1,34,9.5,39.576
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,140.58,0.000,0.000,117,65,1,117,65,
GPT-2,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,3.76,,2.02,0.005,0.083,697,45,1,697,45,296.881
GPT-2,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.20,,0.10,0.006,0.021,34,9.5,1,34,9.5,5419.817
GPT-2,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,0.88,,0.30,0.008,0.058,107,15,1,107,15,1086.958
GPT-2,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,1.44,,1.03,0.012,0.022,117,65,1,117,65,717.508
GPT-2,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,1.71,,1.21,0.008,0.049,214,35,1,214,35,597.084
GPT-2,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,5.38,,2.94,0.016,0.043,329,125,1,329,125,227.166
GPT-2,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,2.09,,1.50,0.011,0.032,197,65,1,197,65,488.848
GPT-2,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,3.33,,1.25,0.008,0.119,426,28,1,426,28,340.886
GPT-2,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,1.73,,0.85,0.004,0.062,490,28,1,490,28,567.627
GPT-2,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,1.93,,1.26,0.006,0.055,303,35,1,303,35,572.361
GPT-2,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,1.93,,1.28,0.004,0.055,488,35,1,488,35,511.396
GPT-2,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,2.86,,1.48,0.005,0.082,544,35,1,544,35,325.104
GPT-2,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,5.88,,4.25,0.010,0.047,599,125,1,599,125,179.104
GPT-2,OV-2023.0,atom,Intel® Processor N-200,0.12,,0.07,0.001,0.021,193,6,1,193,6,8434.695
GPT-2,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,2.14,,1.45,0.004,0.017,594,125,1,594,125,401.241
GPT-2,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,1.57,,1.07,0.006,0.022,249,71,1,249,71,673.96
GPT-2,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,13.74,,5.55,0.004,0.067,3144,204,2,1572,102,154.435
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,22.60,,14.00,0.001,0.055,16954,410,2,8477,205,77.3
GPT-2,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,13.28,,5.30,0.007,0.053,2004,250,2,1002,125,160.915
GPT-2,OV-2023.0,core,Intel® Core™ i7-11800H,5.05,,2.19,0.012,0.112,435,45,1,435,45,208.952
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,38.52,,22.01,0.002,0.071,18718,540,2,9359,270,57.554
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,76.59,,29.21,0.002,0.109,34000,700,2,17000,350,30.93
GPT-2,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,23.32,,11.26,0.010,0.078,2274,300,2,1137,150,132.245
GPT-2,OV-2023.0,accel,Intel® Flex-170,39.06,49.09,,0.020,0.260,1925,150,1,1925,150,408.749
GPT-2,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,3.02,2.27,1.51,0.028,0.201,107,15,1,107,15,1319.205
GPT-2,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,2.00,2.74,1.57,0.004,0.071,490,28,1,490,28,1989.235
GPT-2,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,5.68,4.85,3.22,0.008,0.126,697,45,1,697,45,703.429
GPT-2,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,0.23,0.16,0.11,0.001,0.038,193,6,1,193,6,17533.595
GPT-2,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,4.16,4.13,2.69,0.010,0.148,426,28,1,426,28,960.778
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,3.00,,1.49,0.028,0.200,107,15,1,107,15,
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,1.68,,1.09,0.003,0.060,490,28,1,490,28,
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,5.09,,3.28,0.007,0.113,697,45,1,697,45,
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,0.28,,0.13,0.001,0.046,193,6,1,193,6,
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,4.27,,2.26,0.010,0.153,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,789.36,,299.79,1.133,17.541,697,45,1,697,45,2.072
mobilenet-ssd,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,27.01,,12.73,0.794,2.843,34,9.5,1,34,9.5,39.577
mobilenet-ssd,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,116.16,,40.17,1.086,7.744,107,15,1,107,15,8.472
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,221.80,,140.58,1.896,3.412,117,65,1,117,65,4.715
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,344.62,,201.93,1.610,9.846,214,35,1,214,35,3.456
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,1020.39,,400.82,3.101,8.163,329,125,1,329,125,1.993
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,357.96,,218.52,1.817,5.507,197,65,1,197,65,2.959
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,548.92,,158.26,1.289,19.604,426,28,1,426,28,2.105
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,357.97,,218.52,1.817,5.507,197,65,1,197,65,2.96
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,548.92,,158.26,1.289,19.604,426,28,1,426,28,2.106
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,441.91,,112.33,0.902,15.783,490,28,1,490,28,2.364
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,392.88,,242.76,1.297,11.225,303,35,1,303,35,3.046
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,361.27,,208.16,0.740,10.322,488,35,1,488,35,3.266
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,285.67,,177.22,0.943,8.162,303,35,1,303,35,4.236
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,361.27,,208.16,0.740,10.322,488,35,1,488,35,3.267
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,583.02,,215.65,1.072,16.658,544,35,1,544,35,2.48
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,1642.52,,682.33,2.742,13.140,599,125,1,599,125,1.768
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,736.72,,,1.240,5.894,594,125,1,594,125,
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,212.31,,142.58,0.853,2.990,249,71,1,249,71,
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,2268.47,,693.51,0.722,11.120,3144,204,2,1572,102,1.498
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,1604.36,,665.09,2.678,12.835,599,125,1,599,125,1.778
mobilenet-ssd,OV-2023.0,atom,Intel® Processor N-200,15.32,,8.77,0.079,2.554,193,6,1,193,6,67.817
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,652.21,,307.44,1.098,5.218,594,125,1,594,125,1.656
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,211.82,,140.47,0.851,2.983,249,71,1,249,71,4.88
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,2268.48,,693.51,0.722,11.120,3144,204,2,1572,102,1.499
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,6587.85,,1822.35,0.389,16.068,16954,410,2,8477,205,1.043
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,2163.47,,666.62,1.080,8.654,2004,250,2,1002,125,1.55
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,11311.70,,2529.80,0.604,20.948,18718,540,2,9359,270,0.697
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,24846.06,,3999.28,0.731,35.494,34000,700,2,17000,350,0.836
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,5398.00,,1364.13,2.374,17.993,2274,300,2,1137,150,0.805
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,789.36,,299.79,1.133,17.541,697,45,1,697,45,2.072
mobilenet-ssd,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,116.16,,40.17,1.086,7.744,107,15,1,107,15,8.471
mobilenet-ssd,OV-2023.0,accel,Intel® Flex-170 GPU,4127.47,3257.04,,2.144,27.516,1925,150,1,1925,150,3.643
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,626.92,201.13,,1.279,22.390,490,28,1,490,28,6.243
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,,238.03,,0.000,0.000,107,15,1,107,15,8.633
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,619.19,,199.95,1.264,22.114,490,28,1,490,28,
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,453.39,,149.06,4.237,30.226,107,15,1,107,15,
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-11800H,1031.34,,300.85,2.371,22.919,435,45,1,435,45,1.295
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,11311.71,,2529.80,0.604,20.948,18718,540,2,9359,270,0.697
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,24846.06,,3999.29,0.731,35.494,34000,700,2,17000,350,0.839
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,5398.00,,1364.13,2.374,17.993,2274,300,2,1137,150,0.809
mobilenet-ssd,OV-2023.0,accel,Intel® Flex-170,4127.47,3257.04,,2.144,27.516,1925,150,1,1925,150,3.644
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,453.40,238.03,149.06,4.237,30.226,107,15,1,107,15,8.634
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,619.19,332.33,199.95,1.264,22.114,490,28,1,490,28,6.244
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,816.41,453.27,310.53,1.171,18.142,697,45,1,697,45,4.657
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,32.42,16.84,10.65,0.168,5.403,193,6,1,193,6,121.698
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,702.15,407.81,276.23,1.648,25.077,426,28,1,426,28,5.535
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,326.89,,144.12,3.055,21.793,107,15,1,107,15,
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,569.19,,143.17,1.162,20.328,490,28,1,490,28,
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,1042.75,,416.99,1.496,23.172,697,45,1,697,45,
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,37.18,,15.37,0.193,6.197,193,6,1,193,6,
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,748.60,,253.99,1.757,26.736,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
mobilenet-v2,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,,,45.44,0.000,0.000,34,9.5,1,34,9.5,14.506
mobilenet-v2,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,456.87,0.000,0.000,117,65,1,117,65,
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,884.87,,483.11,4.135,25.282,214,35,1,214,35,1.557
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,2634.22,,1305.55,8.007,21.074,329,125,1,329,125,0.959
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,880.67,,684.15,4.470,13.549,197,65,1,197,65,1.33
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,1384.37,,520.06,3.250,49.442,426,28,1,426,28,0.93
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,1092.57,,315.10,2.230,39.020,490,28,1,490,28,1.025
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,,,670.65,0.000,0.000,303,35,1,303,35,
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,922.31,,638.15,1.890,26.352,488,35,1,488,35,1.518
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,1271.36,,687.61,2.337,36.325,544,35,1,544,35,1.229
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,4077.41,,2121.84,6.807,32.619,599,125,1,599,125,0.76
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,,,,0.000,0.000,594,125,1,594,125,
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,,,,0.000,0.000,249,71,1,249,71,
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,5589.81,,1920.53,1.778,27.401,3144,204,2,1572,102,1.349
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,15333.06,,4417.85,0.904,37.398,16954,410,2,8477,205,0.843
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,5405.01,,1859.79,2.697,21.620,2004,250,2,1002,125,1.374
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,23186.39,,6910.90,1.239,42.938,18718,540,2,9359,270,0.519
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,35768.42,,10976.35,1.052,51.098,34000,700,2,17000,350,0.618
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,12752.22,,3600.85,5.608,42.507,2274,300,2,1137,150,0.51
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,1735.86,,932.73,2.490,38.575,697,45,1,697,45,1.089
mobilenet-v2,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,,,133.14,0.000,0.000,107,15,1,107,15,3.455
mobilenet-v2,OV-2023.0,accel,Intel® Flex-170 GPU,5411.37,5188.89,,2.811,36.076,1925,150,1,1925,150,2.026
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,929.63,350.08,,1.897,33.201,490,28,1,490,28,4.227
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,674.00,511.12,,6.299,44.933,107,15,1,107,15,5.591
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,922.11,,350.46,1.882,32.933,490,28,1,490,28,
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,674.00,,338.92,6.299,44.933,107,15,1,107,15,
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,1726.00,,932.73,2.476,38.356,697,45,1,697,45,1.085
mobilenet-v2,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,74.74,,45.44,2.198,7.867,34,9.5,1,34,9.5,14.582
mobilenet-v2,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,280.00,,133.14,2.617,18.667,107,15,1,107,15,3.497
mobilenet-v2,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,534.65,,456.87,4.570,8.225,117,65,1,117,65,1.974
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,882.73,,483.11,4.125,25.221,214,35,1,214,35,1.556
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,2619.92,,1305.55,7.963,20.959,329,125,1,329,125,0.958
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,876.27,,684.15,4.448,13.481,197,65,1,197,65,1.325
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,1378.21,,520.06,3.235,49.222,426,28,1,426,28,0.931
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,1065.40,,315.10,2.174,38.050,490,28,1,490,28,1.015
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,718.66,,516.57,2.372,20.533,303,35,1,303,35,1.854
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,920.75,,638.15,1.887,26.307,488,35,1,488,35,1.514
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,1283.37,,687.61,2.359,36.668,544,35,1,544,35,1.219
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,3959.96,,2062.89,6.611,31.680,599,125,1,599,125,0.768
mobilenet-v2,OV-2023.0,atom,Intel® Processor N-200,40.77,,29.63,0.211,6.795,193,6,1,193,6,27.138
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,1670.25,,813.61,2.812,13.362,594,125,1,594,125,0.795
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,519.94,,450.61,2.088,7.323,249,71,1,249,71,2.036
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,5539.89,,1920.53,1.762,27.156,3144,204,2,1572,102,1.349
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,15210.14,,4417.85,0.897,37.098,16954,410,2,8477,205,0.851
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,5369.69,,1859.79,2.679,21.479,2004,250,2,1002,125,1.364
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-11800H,2575.56,,938.74,5.921,57.235,435,45,1,435,45,0.636
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,23172.78,,6910.90,1.238,42.913,18718,540,2,9359,270,0.522
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,35561.67,,10976.35,1.046,50.802,34000,700,2,17000,350,0.618
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,12687.83,,3600.85,5.580,42.293,2274,300,2,1137,150,0.51
mobilenet-v2,OV-2023.0,accel,Intel® Flex-170,5398.23,5255.59,,2.804,35.988,1925,150,1,1925,150,2.256
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,671.48,511.12,338.92,6.276,44.765,107,15,1,107,15,5.565
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,909.69,583.68,350.46,1.857,32.489,490,28,1,490,28,4.207
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,1205.84,894.32,586.79,1.730,26.796,697,45,1,697,45,3.127
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,60.97,41.27,26.90,0.316,10.162,193,6,1,193,6,64.669
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,1000.97,740.36,523.20,2.350,35.749,426,28,1,426,28,3.855
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,1468.05,,394.16,13.720,97.870,107,15,1,107,15,
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,1168.44,,216.48,2.385,41.730,490,28,1,490,28,
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,3183.48,,1119.78,4.567,70.744,697,45,1,697,45,
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,117.36,,49.87,0.608,19.560,193,6,1,193,6,
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,2238.11,,597.27,5.254,79.933,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
resnet-50,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,10.92,,4.54,0.321,1.150,34,9.5,1,34,9.5,94.518
resnet-50,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,372.55,,103.20,0.535,8.279,697,45,1,697,45,4.778
resnet-50,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,10.92,,4.54,0.321,1.150,34,9.5,1,34,9.5,94.519
resnet-50,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,50.13,,14.45,0.469,3.342,107,15,1,107,15,19.719
resnet-50,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,97.59,,51.99,0.834,1.501,117,65,1,117,65,10.637
resnet-50,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,144.61,,75.37,0.676,4.132,214,35,1,214,35,8.098
resnet-50,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,500.94,,143.02,1.523,4.008,329,125,1,329,125,4.455
resnet-50,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,155.16,,81.16,0.788,2.387,197,65,1,197,65,6.957
resnet-50,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,500.94,,143.02,1.523,4.008,329,125,1,329,125,4.456
resnet-50,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,155.16,,81.16,0.788,2.387,197,65,1,197,65,6.958
resnet-50,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,224.35,,60.58,0.527,8.012,426,28,1,426,28,5.088
resnet-50,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,182.57,,47.31,0.373,6.520,490,28,1,490,28,51.708
resnet-50,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,165.21,,88.47,0.545,4.720,303,35,1,303,35,7.106
resnet-50,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,155.09,,77.88,0.318,4.431,488,35,1,488,35,7.417
resnet-50,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,182.57,,47.31,0.373,6.520,490,28,1,490,28,5.96
resnet-50,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,121.71,,62.98,0.402,3.477,303,35,1,303,35,9.845
resnet-50,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,155.09,,77.88,0.318,4.431,488,35,1,488,35,7.418
resnet-50,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,267.58,,75.49,0.492,7.645,544,35,1,544,35,5.351
resnet-50,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,763.64,,241.72,1.275,6.109,599,125,1,599,125,3.362
resnet-50,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,319.70,,148.80,0.538,2.558,594,125,1,594,125,3.733
resnet-50,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,744.56,,235.07,1.243,5.956,599,125,1,599,125,3.366
resnet-50,OV-2023.0,atom,Intel® Processor N-200,6.73,,3.18,0.035,1.121,193,6,1,193,6,160.351
resnet-50,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,276.11,,141.28,0.465,2.209,594,125,1,594,125,3.804
resnet-50,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,93.19,,50.97,0.374,1.312,249,71,1,249,71,11.014
resnet-50,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,968.34,,269.28,0.308,4.747,3144,204,2,1572,102,2.912
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,2928.36,,755.49,0.173,7.142,16954,410,2,8477,205,1.501
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,2928.36,,755.50,0.173,7.142,16954,410,2,8477,205,1.501
resnet-50,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,928.12,,257.71,0.463,3.712,2004,250,2,1002,125,3.015
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,5006.83,,1168.91,0.267,9.272,18718,540,2,9359,270,1.017
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,18906.26,,1671.79,0.556,27.009,34000,700,2,17000,350,1
resnet-50,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,2292.86,,570.35,1.008,7.643,2274,300,2,1137,150,1.465
resnet-50,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,372.55,,103.20,0.535,8.279,697,45,1,697,45,4.778
resnet-50,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,50.13,,14.45,0.469,3.342,107,15,1,107,15,19.719
resnet-50,OV-2023.0,accel,Intel® Flex-170 GPU,3088.38,1947.78,,1.604,20.589,1925,150,1,1925,150,4.918
resnet-50,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,300.85,91.55,,0.614,10.744,490,28,1,490,28,13.174
resnet-50,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,212.07,117.19,,1.982,14.138,107,15,1,107,15,18.751
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,296.02,,90.64,0.604,10.572,490,28,1,490,28,
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,212.06,,66.73,1.982,14.137,107,15,1,107,15,
resnet-50,OV-2023.0,core,Intel® Core™ i7-11800H,418.87,,112.99,0.963,9.308,435,45,1,435,45,2.909
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,5006.83,,1168.91,0.267,9.272,18718,540,2,9359,270,1.016
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,18906.26,,1671.79,0.556,27.009,34000,700,2,17000,350,1.003
resnet-50,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,2292.86,,570.35,1.008,7.643,2274,300,2,1137,150,1.463
resnet-50,OV-2023.0,accel,Intel® Flex-170,3088.38,1947.78,,1.604,20.589,1925,150,1,1925,150,4.919
resnet-50,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,212.07,117.19,66.74,1.982,14.138,107,15,1,107,15,18.752
resnet-50,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,296.02,166.15,90.65,0.604,10.572,490,28,1,490,28,13.174
resnet-50,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,380.98,229.42,143.43,0.547,8.466,697,45,1,697,45,10.195
resnet-50,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,15.19,7.96,4.35,0.079,2.532,193,6,1,193,6,262.333
resnet-50,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,351.93,210.88,120.40,0.826,12.569,426,28,1,426,28,11.145
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,298.19,,75.45,2.787,19.880,107,15,1,107,15,
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,440.34,,87.84,0.899,15.726,490,28,1,490,28,
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,714.02,,187.03,1.024,15.867,697,45,1,697,45,
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,21.28,,6.36,0.110,3.546,193,6,1,193,6,
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,469.96,,122.38,1.103,16.784,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
ssd-resnet-34-1200,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.18,,0.08,0.005,0.019,34,9.5,1,34,9.5,5553.227
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,1.69,,0.97,0.014,0.026,117,65,1,117,65,593.302
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,2.42,,1.40,0.011,0.069,214,35,1,214,35,459.773
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,8.10,,2.46,0.025,0.065,329,125,1,329,125,207.938
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,2.63,,1.49,0.013,0.040,197,65,1,197,65,393.41
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,3.82,,0.99,0.009,0.136,426,28,1,426,28,280.092
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,3.15,,0.82,0.006,0.113,490,28,1,490,28,5.129
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,2.78,,1.61,0.009,0.080,303,35,1,303,35,399.367
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,2.48,,1.38,0.005,0.071,488,35,1,488,35,411.047
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,4.07,,1.34,0.007,0.116,544,35,1,544,35,297.001
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,12.60,,4.18,0.021,0.101,599,125,1,599,125,157.718
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,5.02,,,0.008,0.040,594,125,1,594,125,200.705
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,1.60,,0.92,0.006,0.023,249,71,1,249,71,622.798
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,17.65,,4.59,0.006,0.087,3144,204,2,1572,102,116.003
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,57.90,,14.86,0.003,0.141,16954,410,2,8477,205,36.506
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,16.78,,4.37,0.008,0.067,2004,250,2,1002,125,121.986
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,78.77,,20.79,0.004,0.146,18718,540,2,9359,270,105.307
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,440.92,,31.41,0.013,0.630,34000,700,2,17000,350,8.63
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,42.62,,10.56,0.019,0.142,2274,300,2,1137,150,60.312
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,6.00,,1.85,0.009,0.133,697,45,1,697,45,241.005
ssd-resnet-34-1200,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,0.90,,0.23,0.008,0.060,107,15,1,107,15,1118.93
ssd-resnet-34-1200,OV-2023.0,accel,Intel® Flex-170 GPU,150.99,92.06,,0.078,1.007,1925,150,1,1925,150,105.863
ssd-resnet-34-1200,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,9.00,2.24,,0.018,0.321,490,28,1,490,28,444.2
ssd-resnet-34-1200,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,5.04,2.62,,0.047,0.336,107,15,1,107,15,774.647
ssd-resnet-34-1200,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,8.73,,2.24,0.018,0.312,490,28,1,490,28,
ssd-resnet-34-1200,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,5.04,,1.40,0.047,0.336,107,15,1,107,15,
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,6.00,,1.85,0.009,0.133,697,45,1,697,45,241.005
ssd-resnet34-1200,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.18,,0.08,0.005,0.019,34,9.5,1,34,9.5,5553.228
ssd-resnet34-1200,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,0.90,,0.23,0.008,0.060,107,15,1,107,15,1118.931
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,1.69,,0.98,0.014,0.026,117,65,1,117,65,593.303
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,2.42,,1.40,0.011,0.069,214,35,1,214,35,459.773
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,8.10,,2.46,0.025,0.065,329,125,1,329,125,207.938
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,2.63,,1.49,0.013,0.040,197,65,1,197,65,393.411
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,3.82,,0.99,0.009,0.136,426,28,1,426,28,280.093
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,3.15,,0.82,0.006,0.113,490,28,1,490,28,315.974
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,2.02,,1.13,0.007,0.058,303,35,1,303,35,562.292
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,2.49,,1.38,0.005,0.071,488,35,1,488,35,411.048
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,4.07,,1.34,0.007,0.116,544,35,1,544,35,297.001
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,12.38,,4.12,0.021,0.099,599,125,1,599,125,157.781
ssd-resnet34-1200,OV-2023.0,atom,Intel® Processor N-200,0.11,,0.05,0.001,0.019,193,6,1,193,6,8993.66
ssd-resnet34-1200,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,4.57,,2.53,0.008,0.037,594,125,1,594,125,202.869
ssd-resnet34-1200,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,1.60,,0.92,0.006,0.023,249,71,1,249,71,622.799
ssd-resnet34-1200,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,17.65,,4.59,0.006,0.087,3144,204,2,1572,102,116.003
ssd-resnet34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,57.90,,14.86,0.003,0.141,16954,410,2,8477,205,36.506
ssd-resnet34-1200,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,16.78,,4.37,0.008,0.067,2004,250,2,1002,125,121.986
ssd-resnet34-1200,OV-2023.0,core,Intel® Core™ i7-11800H,7.08,,1.82,0.016,0.157,435,45,1,435,45,155.088
ssd-resnet34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,78.77,,20.79,0.004,0.146,18718,540,2,9359,270,106.673
ssd-resnet34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,440.92,,31.41,0.013,0.630,34000,700,2,17000,350,8.749
ssd-resnet34-1200,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,42.63,,10.56,0.019,0.142,2274,300,2,1137,150,59.63
ssd-resnet34-1200,OV-2023.0,accel,Intel® Flex-170,150.99,92.06,,0.078,1.007,1925,150,1,1925,150,105.864
ssd-resnet34-1200,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,5.04,2.62,1.41,0.047,0.336,107,15,1,107,15,774.647
ssd-resnet34-1200,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,8.74,4.78,2.25,0.018,0.312,490,28,1,490,28,444.2
ssd-resnet34-1200,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,10.88,6.26,3.42,0.016,0.242,697,45,1,697,45,367.297
ssd-resnet34-1200,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,0.29,0.17,,0.002,0.049,193,6,1,193,6,13690.681
ssd-resnet34-1200,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,9.70,5.42,2.84,0.023,0.347,426,28,1,426,28,422.084
ssd-resnet34-1200,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,0.90,,0.23,0.008,0.060,107,15,1,107,15,
ssd-resnet34-1200,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,3.15,,0.82,0.006,0.112,490,28,1,490,28,
ssd-resnet34-1200,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,5.93,,1.87,0.009,0.132,697,45,1,697,45,
ssd-resnet34-1200,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,0.11,,0.05,0.001,0.018,193,6,1,193,6,
ssd-resnet34-1200,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,3.91,,1.00,0.009,0.140,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
unet-camvid-onnx-0001,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,,,0.04,0.000,0.000,34,9.5,1,34,9.5,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,1.55,0.000,0.000,117,65,1,117,65,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,,,2.25,0.000,0.000,214,35,1,214,35,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,,,4.02,0.000,0.000,329,125,1,329,125,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,,,2.39,0.000,0.000,197,65,1,197,65,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,6.42,,1.61,0.015,0.229,426,28,1,426,28,169.94
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,5.20,,1.28,0.011,0.186,490,28,1,490,28,5.959
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,,,2.60,0.000,0.000,303,35,1,303,35,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,,,2.25,0.000,0.000,488,35,1,488,35,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,,,2.25,0.000,0.000,544,35,1,544,35,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,,,6.89,0.000,0.000,599,125,1,599,125,
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,,,4.54,0.000,0.000,594,125,1,594,125,
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,,,1.49,0.000,0.000,249,71,1,249,71,
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,29.07,,7.34,0.009,0.142,3144,204,2,1572,102,71.813
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,95.23,,21.78,0.006,0.232,16954,410,2,8477,205,23.52
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,27.71,,7.01,0.014,0.111,2004,250,2,1002,125,74.843
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,129.48,,31.77,0.007,0.240,18718,540,2,9359,270,73.758
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,505.87,,48.40,0.015,0.723,34000,700,2,17000,350,9.333
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,69.94,,16.08,0.031,0.233,2274,300,2,1137,150,42.347
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,8.65,,3.05,0.012,0.192,697,45,1,697,45,156.16
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,8.65,,3.05,0.012,0.192,697,45,1,697,45,156.161
unet-camvid-onnx-0001,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.26,,0.04,0.008,0.027,34,9.5,1,34,9.5,3981.236
unet-camvid-onnx-0001,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,1.49,,0.38,0.014,0.100,107,15,1,107,15,672.584
unet-camvid-onnx-0001,OV-2023.0,accel,Intel® Flex-170 GPU,254.48,144.90,,0.132,1.697,1925,150,1,1925,150,62.697
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,15.74,4.26,,0.032,0.562,490,28,1,490,28,253.852
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,8.41,4.37,,0.079,0.560,107,15,1,107,15,475.668
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,15.72,,4.26,0.032,0.561,490,28,1,490,28,
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,8.40,,2.38,0.079,0.560,107,15,1,107,15,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,2.46,,1.55,0.021,0.038,117,65,1,117,65,413.844
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,3.60,,2.25,0.017,0.103,214,35,1,214,35,322.582
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,11.67,,4.03,0.035,0.093,329,125,1,329,125,132.595
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,3.85,,2.39,0.020,0.059,197,65,1,197,65,263.384
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,6.42,,1.61,0.015,0.229,426,28,1,426,28,169.941
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,5.20,,1.28,0.011,0.186,490,28,1,490,28,188.957
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,3.01,,1.86,0.010,0.086,303,35,1,303,35,384.226
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,3.62,,2.25,0.007,0.103,488,35,1,488,35,286.784
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,6.15,,2.25,0.011,0.176,544,35,1,544,35,187.178
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,18.36,,6.78,0.031,0.147,599,125,1,599,125,99.814
unet-camvid-onnx-0001,OV-2023.0,atom,Intel® Processor N-200,0.17,,0.09,0.001,0.029,193,6,1,193,6,5875.117
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,6.61,,4.00,0.011,0.053,594,125,1,594,125,153.203
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,2.35,,1.49,0.009,0.033,249,71,1,249,71,436.422
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,29.07,,7.34,0.009,0.142,3144,204,2,1572,102,71.813
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,95.23,,21.78,0.006,0.232,16954,410,2,8477,205,23.521
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,27.71,,7.01,0.014,0.111,2004,250,2,1002,125,74.843
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-11800H,11.74,,2.94,0.027,0.261,435,45,1,435,45,94.316
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,129.48,,31.77,0.007,0.240,18718,540,2,9359,270,73.505
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,505.87,,48.40,0.015,0.723,34000,700,2,17000,350,9.311
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,69.94,,16.08,0.031,0.233,2274,300,2,1137,150,41.748
unet-camvid-onnx-0001,OV-2023.0,accel,Intel® Flex-170,254.48,144.90,,0.132,1.697,1925,150,1,1925,150,62.698
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,8.41,4.37,2.38,0.079,0.560,107,15,1,107,15,475.669
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,15.72,8.02,4.27,0.032,0.562,490,28,1,490,28,253.853
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,19.13,10.06,5.58,0.027,0.425,697,45,1,697,45,208.318
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,0.47,0.27,0.14,0.002,0.078,193,6,1,193,6,8545.949
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,17.31,8.85,4.83,0.041,0.618,426,28,1,426,28,227.453
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,8.90,,2.45,0.083,0.593,107,15,1,107,15,
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,14.81,,3.73,0.030,0.529,490,28,1,490,28,
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,19.83,,6.12,0.028,0.441,697,45,1,697,45,
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,0.57,,0.20,0.003,0.096,193,6,1,193,6,
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,14.14,,3.75,0.033,0.505,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
yolo-v3,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,1.13,,0.52,0.033,0.119,34,9.5,1,34,9.5,903.84
yolo-v3,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,10.63,,5.89,0.091,0.164,117,65,1,117,65,95.035
yolo-v3,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,15.37,,8.39,0.072,0.439,214,35,1,214,35,74.286
yolo-v3,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,51.84,,15.89,0.158,0.415,329,125,1,329,125,30.002
yolo-v3,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,16.37,,8.99,0.083,0.252,197,65,1,197,65,63.34
yolo-v3,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,23.65,,6.47,0.056,0.845,426,28,1,426,28,46.28
yolo-v3,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,19.40,,5.08,0.040,0.693,490,28,1,490,28,12.186
yolo-v3,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,17.61,,9.85,0.058,0.503,303,35,1,303,35,59.526
yolo-v3,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,16.06,,8.39,0.033,0.459,488,35,1,488,35,68.144
yolo-v3,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,27.93,,8.41,0.051,0.798,544,35,1,544,35,42.848
yolo-v3,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,81.69,,27.09,0.136,0.653,599,125,1,599,125,23.63
yolo-v3,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,32.62,,14.28,0.055,0.261,594,125,1,594,125,31.954
yolo-v3,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,10.06,,5.72,0.040,0.142,249,71,1,249,71,100.121
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,105.44,,29.93,0.034,0.517,3144,204,2,1572,102,22.132
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,318.96,,88.54,0.019,0.778,16954,410,2,8477,205,10.667
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,100.48,,28.51,0.050,0.402,2004,250,2,1002,125,23.175
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,485.45,,108.76,0.026,0.899,18718,540,2,9359,270,6.711
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,2042.57,,194.96,0.060,2.918,34000,700,2,17000,350,3.286
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,240.71,,62.50,0.106,0.802,2274,300,2,1137,150,13.918
yolo-v3,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,39.77,,11.97,0.057,0.884,697,45,1,697,45,34.872
yolo-v3,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,5.45,,1.55,0.051,0.363,107,15,1,107,15,184.58
yolo-v3,OV-2023.0,accel,Intel® Flex-170 GPU,715.46,313.59,,0.372,4.770,1925,150,1,1925,150,21.953
yolo-v3,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,59.07,13.71,,0.121,2.110,490,28,1,490,28,67.531
yolo-v3,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,32.01,15.01,,0.299,2.134,107,15,1,107,15,123.951
yolo-v3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,59.07,,13.68,0.121,2.110,490,28,1,490,28,
yolo-v3,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,32.00,,8.04,0.299,2.133,107,15,1,107,15,
yolo_v3,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,39.77,,11.97,0.057,0.884,697,45,1,697,45,34.872
yolo_v3,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,1.13,,0.52,0.033,0.119,34,9.5,1,34,9.5,903.841
yolo_v3,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,5.45,,1.55,0.051,0.363,107,15,1,107,15,184.58
yolo_v3,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,10.63,,5.89,0.091,0.164,117,65,1,117,65,95.036
yolo_v3,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,15.37,,8.39,0.072,0.439,214,35,1,214,35,74.286
yolo_v3,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,51.84,,15.89,0.158,0.415,329,125,1,329,125,30.003
yolo_v3,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,16.37,,8.99,0.083,0.252,197,65,1,197,65,63.341
yolo_v3,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,23.65,,6.47,0.056,0.845,426,28,1,426,28,46.28
yolo_v3,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,19.40,,5.08,0.040,0.693,490,28,1,490,28,51.709
yolo_v3,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,12.66,,6.99,0.042,0.362,303,35,1,303,35,86.495
yolo_v3,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,16.06,,8.39,0.033,0.459,488,35,1,488,35,68.145
yolo_v3,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,27.93,,8.41,0.051,0.798,544,35,1,544,35,42.848
yolo_v3,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,79.98,,26.47,0.134,0.640,599,125,1,599,125,23.62
yolo_v3,OV-2023.0,atom,Intel® Processor N-200,0.71,,0.35,0.004,0.118,193,6,1,193,6,1470.788
yolo_v3,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,29.22,,14.28,0.049,0.234,594,125,1,594,125,32.442
yolo_v3,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,10.06,,5.72,0.040,0.142,249,71,1,249,71,100.122
yolo_v3,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,105.44,,29.93,0.034,0.517,3144,204,2,1572,102,22.133
yolo_v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,318.96,,88.54,0.019,0.778,16954,410,2,8477,205,10.668
yolo_v3,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,100.48,,28.51,0.050,0.402,2004,250,2,1002,125,23.175
yolo_v3,OV-2023.0,core,Intel® Core™ i7-11800H,43.61,,11.91,0.100,0.969,435,45,1,435,45,26.339
yolo_v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,485.45,,108.76,0.026,0.899,18718,540,2,9359,270,6.704
yolo_v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,2042.57,,194.96,0.060,2.918,34000,700,2,17000,350,3.296
yolo_v3,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,240.71,,62.50,0.106,0.802,2274,300,2,1137,150,13.156
yolo_v3,OV-2023.0,accel,Intel® Flex-170,715.46,313.59,,0.372,4.770,1925,150,1,1925,150,21.953
yolo_v3,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,32.01,15.01,8.05,0.299,2.134,107,15,1,107,15,123.951
yolo_v3,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,59.08,26.50,13.68,0.121,2.110,490,28,1,490,28,67.531
yolo_v3,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,69.33,34.30,18.80,0.099,1.541,697,45,1,697,45,57.179
yolo_v3,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,1.82,0.94,0.51,0.009,0.304,193,6,1,193,6,2193.513
yolo_v3,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,62.39,29.62,16.26,0.146,2.228,426,28,1,426,28,64.935
yolo_v3,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,33.33,,8.57,0.311,2.222,107,15,1,107,15,
yolo_v3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,54.94,,12.76,0.112,1.962,490,28,1,490,28,
yolo_v3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,79.34,,21.62,0.114,1.763,697,45,1,697,45,
yolo_v3,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,2.18,,0.72,0.011,0.363,193,6,1,193,6,
yolo_v3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,50.76,,13.72,0.119,1.813,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
yolo_v3_tiny,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,12.33,,6.20,0.363,1.297,34,9.5,1,34,9.5,82.686
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,112.45,,65.06,0.961,1.730,117,65,1,117,65,8.957
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,167.83,,92.82,0.784,4.795,214,35,1,214,35,6.709
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,600.04,,199.22,1.824,4.800,329,125,1,329,125,3.139
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,176.01,,99.54,0.893,2.708,197,65,1,197,65,5.438
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,241.89,,75.37,0.568,8.639,426,28,1,426,28,4.542
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,203.84,,57.67,0.416,7.280,490,28,1,490,28,5.129
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,191.07,,108.63,0.631,5.459,303,35,1,303,35,5.593
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,180.44,,92.86,0.370,5.155,488,35,1,488,35,6.282
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,303.14,,97.03,0.557,8.661,544,35,1,544,35,4.164
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,900.78,,306.13,1.504,7.206,599,125,1,599,125,2.541
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,349.17,,170.15,0.588,2.793,594,125,1,594,125,2.953
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,106.71,,64.03,0.429,1.503,249,71,1,249,71,9.39
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,1052.16,,339.30,0.335,5.158,3144,204,2,1572,102,2.514
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,2932.78,,914.37,0.173,7.153,16954,410,2,8477,205,1.215
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,1010.00,,323.69,0.504,4.040,2004,250,2,1002,125,2.622
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,4584.21,,1374.00,0.245,8.489,18718,540,2,9359,270,0.88
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,13092.13,,2107.19,0.385,18.703,34000,700,2,17000,350,1.149
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,2217.64,,704.05,0.975,7.392,2274,300,2,1137,150,1.321
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,433.83,,136.36,0.622,9.641,697,45,1,697,45,3.411
yolo_v3_tiny,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,12.33,,6.20,0.363,1.297,34,9.5,1,34,9.5,82.687
yolo_v3_tiny,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,54.23,,18.05,0.507,3.615,107,15,1,107,15,18.195
yolo_v3_tiny,OV-2023.0,accel,Intel® Flex-170 GPU,3196.82,2123.72,,1.661,21.312,1925,150,1,1925,150,4.691
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,507.33,136.58,,1.035,18.119,490,28,1,490,28,7.675
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,290.97,151.90,,2.719,19.398,107,15,1,107,15,13.629
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,505.40,,136.40,1.031,18.050,490,28,1,490,28,
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,290.97,,86.08,2.719,19.398,107,15,1,107,15,
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,112.45,,65.07,0.961,1.730,117,65,1,117,65,8.957
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,167.83,,92.82,0.784,4.795,214,35,1,214,35,6.71
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,600.04,,199.22,1.824,4.800,329,125,1,329,125,3.14
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,176.01,,99.54,0.893,2.708,197,65,1,197,65,5.439
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,241.89,,75.37,0.568,8.639,426,28,1,426,28,4.543
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,203.84,,57.67,0.416,7.280,490,28,1,490,28,5.129
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,137.74,,78.00,0.455,3.936,303,35,1,303,35,8.162
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,180.44,,92.86,0.370,5.155,488,35,1,488,35,6.283
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,303.14,,97.03,0.557,8.661,544,35,1,544,35,4.164
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,882.39,,296.77,1.473,7.059,599,125,1,599,125,2.558
yolo_v3_tiny,OV-2023.0,atom,Intel® Processor N-200,7.82,,4.15,0.041,1.304,193,6,1,193,6,136.62
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,349.17,,156.05,0.588,2.793,594,125,1,594,125,2.995
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,106.71,,64.03,0.429,1.503,249,71,1,249,71,9.391
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,1052.16,,339.30,0.335,5.158,3144,204,2,1572,102,2.514
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,2932.78,,914.37,0.173,7.153,16954,410,2,8477,205,1.216
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,1010.00,,323.69,0.504,4.040,2004,250,2,1002,125,2.623
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-11800H,448.62,,139.59,1.031,9.969,435,45,1,435,45,2.61
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,4584.21,,1374.00,0.245,8.489,18718,540,2,9359,270,0.876
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,13092.13,,2107.19,0.385,18.703,34000,700,2,17000,350,1.143
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,2217.64,,704.05,0.975,7.392,2274,300,2,1137,150,1.319
yolo_v3_tiny,OV-2023.0,accel,Intel® Flex-170,3196.82,2123.72,,1.661,21.312,1925,150,1,1925,150,4.692
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,290.98,151.90,86.09,2.719,19.398,107,15,1,107,15,13.63
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,505.41,257.15,136.41,1.031,18.050,490,28,1,490,28,7.676
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,616.60,331.25,206.56,0.885,13.702,697,45,1,697,45,6.288
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,17.57,9.95,5.67,0.091,2.928,193,6,1,193,6,226.048
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,547.67,291.75,171.00,1.286,19.560,426,28,1,426,28,7.089
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,321.12,,92.81,3.001,21.408,107,15,1,107,15,
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,324.93,,98.38,0.663,11.605,490,28,1,490,28,
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,755.15,,230.16,1.083,16.781,697,45,1,697,45,
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,24.02,,7.84,0.124,4.003,193,6,1,193,6,
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,487.88,,144.54,1.145,17.424,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
yolo-v8n,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,5.69,,3.01,0.167,0.598,34,9.5,1,34,9.5,185.626
yolo-v8n,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,53.97,,33.14,0.461,0.830,117,65,1,117,65,18.918
yolo-v8n,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,81.11,,47.46,0.379,2.317,214,35,1,214,35,16.114
yolo-v8n,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,244.02,,96.78,0.742,1.952,329,125,1,329,125,6.96
yolo-v8n,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,84.64,,51.15,0.430,1.302,197,65,1,197,65,11.916
yolo-v8n,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,106.29,,39.77,0.250,3.796,426,28,1,426,28,10.673
yolo-v8n,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,76.65,,29.15,0.156,2.738,490,28,1,490,28,188.956
yolo-v8n,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,69.89,,57.02,0.231,1.997,303,35,1,303,35,16.595
yolo-v8n,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,83.42,,49.70,0.171,2.383,488,35,1,488,35,14.081
yolo-v8n,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,132.88,,51.98,0.244,3.796,544,35,1,544,35,10.104
yolo-v8n,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,379.01,,160.41,0.633,3.032,599,125,1,599,125,5.511
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,125.84,,74.97,0.212,1.007,594,125,1,594,125,6.46
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,52.07,,32.87,0.209,0.733,249,71,1,249,71,19.471
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,449.63,,175.44,0.143,2.204,3144,204,2,1572,102,8.25
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,996.63,,459.95,0.059,2.431,16954,410,2,8477,205,5.159
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,432.72,,168.42,0.216,1.731,2004,250,2,1002,125,8.458
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,1686.49,,552.54,0.090,3.123,18718,540,2,9359,270,2.369
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,2714.73,,1006.34,0.080,3.878,34000,700,2,17000,350,4.403
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,846.47,,341.19,0.372,2.822,2274,300,2,1137,150,3.308
yolo-v8n,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,184.70,,72.61,0.265,4.104,697,45,1,697,45,7.542
yolo-v8n,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,24.68,,9.60,0.231,1.645,107,15,1,107,15,40.111
yolo-v8n,OV-2023.0,accel,Intel® Flex-170 GPU,1205.32,1210.94,,0.626,8.035,1925,150,1,1925,150,12.951
yolo-v8n,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,154.20,106.82,,0.315,5.507,490,28,1,490,28,24.829
yolo-v8n,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,0.00,82.53,,0.000,0.000,107,15,1,107,15,
yolo-v8n,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,116.95,,45.54,0.239,4.177,490,28,1,490,28,
yolo-v8n,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,111.94,,48.30,1.046,7.462,107,15,1,107,15,
yolo_v8n,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,184.70,,72.61,0.265,4.104,697,45,1,697,45,7.542
yolo_v8n,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,5.69,,3.01,0.167,0.598,34,9.5,1,34,9.5,185.626
yolo_v8n,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,24.68,,9.60,0.231,1.645,107,15,1,107,15,40.111
yolo_v8n,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,53.97,,33.14,0.461,0.830,117,65,1,117,65,18.918
yolo_v8n,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,81.11,,47.46,0.379,2.317,214,35,1,214,35,16.114
yolo_v8n,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,244.02,,96.78,0.742,1.952,329,125,1,329,125,6.96
yolo_v8n,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,84.64,,51.15,0.430,1.302,197,65,1,197,65,11.917
yolo_v8n,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,106.30,,39.77,0.250,3.796,426,28,1,426,28,10.673
yolo_v8n,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,76.65,,29.15,0.156,2.738,490,28,1,490,28,12.187
yolo_v8n,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,69.89,,42.39,0.231,1.997,303,35,1,303,35,16.596
yolo_v8n,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,83.42,,49.70,0.171,2.383,488,35,1,488,35,13.027
yolo_v8n,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,132.88,,51.98,0.244,3.796,544,35,1,544,35,9.23
yolo_v8n,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,379.01,,156.74,0.633,3.032,599,125,1,599,125,5.512
yolo_v8n,OV-2023.0,atom,Intel® Processor N-200,3.25,,1.94,0.017,0.541,193,6,1,193,6,315.715
yolo_v8n,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,125.84,,74.97,0.212,1.007,594,125,1,594,125,6.46
yolo_v8n,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,52.07,,32.87,0.209,0.733,249,71,1,249,71,19.471
yolo_v8n,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,449.63,,175.44,0.143,2.204,3144,204,2,1572,102,5.959
yolo_v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,996.63,,459.95,0.059,2.431,16954,410,2,8477,205,3.622
yolo_v8n,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,432.72,,168.42,0.216,1.731,2004,250,2,1002,125,6.229
yolo_v8n,OV-2023.0,core,Intel® Core™ i7-11800H,194.10,,74.94,0.446,4.313,435,45,1,435,45,5.995
yolo_v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,1686.49,,552.54,0.090,3.123,18718,540,2,9359,270,2.37
yolo_v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,2714.73,,1006.34,0.080,3.878,34000,700,2,17000,350,4.403
yolo_v8n,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,846.47,,341.19,0.372,2.822,2274,300,2,1137,150,3.309
yolo_v8n,OV-2023.0,accel,Intel® Flex-170,1205.32,1210.94,,0.626,8.035,1925,150,1,1925,150,12.951
yolo_v8n,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,126.20,82.53,48.62,1.179,8.413,107,15,1,107,15,31.597
yolo_v8n,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,154.20,106.82,59.95,0.315,5.507,490,28,1,490,28,24.83
yolo_v8n,OV-2023.0,core-iGPU,Intel® Core™ i9-12900HK GPU-only,218.28,155.96,102.82,0.313,4.851,697,45,1,697,45,17.971
yolo_v8n,OV-2023.0,core-iGPU,Intel® Processor N200 GPU-only,8.78,5.75,3.36,0.045,1.463,193,6,1,193,6,454.508
yolo_v8n,OV-2023.0,core-iGPU,Intel® Core™ i7-1185G7 GPU-only,201.27,141.88,88.88,0.472,7.188,426,28,1,426,28,19.643
yolo_v8n,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E GPU-only,111.94,,48.30,1.046,7.462,107,15,1,107,15,
yolo_v8n,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE iGPU-only,116.95,,45.54,0.239,4.177,490,28,1,490,28,
yolo_v8n,OV-2023.0,core-CPU+iGPU,Intel® Core™ i9-12900HK GPU-only,283.25,,118.51,0.406,6.294,697,45,1,697,45,
yolo_v8n,OV-2023.0,core-CPU+iGPU,Intel® Processor N200 GPU-only,10.11,,4.49,0.052,1.685,193,6,1,193,6,
yolo_v8n,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185G7 GPU-only,175.79,,75.16,0.413,6.278,426,28,1,426,28,
end_rec,,,,,,,,,,,,,,
1 Network model Release IE-Type Platform name Throughput-INT8 Throughput-FP16 ThroughputFP16 Throughput-FP32 ThroughputFP32 Value Efficiency Price TDP Sockets Price/socket TDP/socket Latency
2 begin_rec
3 GPT-2 bert-base-cased OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 71.70 0.10 25.90 0.000 0.103 0.000 1.593 34 697 9.5 45 1 34 697 9.5 45 21.119
4 GPT-2 bert-base-cased OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 2.72 1.03 1.33 0.000 0.080 0.000 0.286 117 34 65 9.5 1 117 34 65 9.5 392.843
5 GPT-2 bert-base-cased OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 11.27 1.21 4.28 0.000 0.105 0.000 0.752 214 107 35 15 1 214 107 35 15 88.854
6 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 22.23 2.94 14.89 0.000 0.190 0.000 0.342 329 117 125 65 1 329 117 125 65 46.754
7 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-10500TE CPU-only 33.65 1.50 19.51 0.000 0.157 0.000 0.961 197 214 65 35 1 197 214 65 35 35.398
8 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only Intel® Core™ i5-13600K CPU-only 103.31 1.25 44.62 0.000 0.314 0.000 0.826 426 329 28 125 1 426 329 28 125 18.719
9 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only Intel® Core™ i5-8500 CPU-only 34.72 0.85 22.57 0.000 0.176 0.000 0.534 490 197 28 65 1 490 197 28 65 30.392
10 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185G7 CPU-only 49.78 1.57 17.87 0.000 0.117 0.000 1.778 303 426 35 28 1 303 426 35 28 24.03
11 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1185GRE CPU-only 38.20 1.28 14.91 0.000 0.078 0.000 1.364 488 490 35 28 1 488 490 35 28 26.874
12 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i9-12900TE CPU-only Intel® Core™ i7-8700T CPU-only 28.32 1.48 16.03 0.000 0.093 0.000 0.809 544 303 35 1 544 303 35 41.835
13 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i9-10900TE CPU-only 35.62 4.26 18.79 0.000 0.073 0.000 1.018 599 488 125 35 1 599 488 125 35 38.627
14 GPT-2 bert-base-cased OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900TE CPU-only 51.56 1.45 19.50 0.000 0.095 0.000 1.473 594 544 125 35 1 594 544 125 35 26.626
15 GPT-2 bert-base-cased OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-13900K CPU-only 150.45 1.07 67.78 0.000 0.251 0.000 1.204 249 599 71 125 1 249 599 71 125 15.82
16 GPT-2 bert-base-cased OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Processor N-200 1.62 5.55 0.85 0.000 0.008 0.000 0.270 3144 193 204 6 2 1 1572 193 102 6 668.333
17 GPT-2 bert-base-cased OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® W1290P CPU-only 59.78 14.00 35.79 0.000 0.101 0.000 0.478 16954 594 410 125 2 1 8477 594 205 125 19.817
18 GPT-2 bert-base-cased OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® E-2124G CPU-only 21.83 5.30 14.60 0.000 0.088 0.000 0.307 2004 249 250 71 2 1 1002 249 125 71 47.596
19 GPT-2 bert-base-cased OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only Intel® Xeon® Gold 5218T CPU-only 215.56 22.00 80.01 0.000 0.069 0.000 1.057 18718 3144 540 204 2 9359 1572 270 102 14.761
20 GPT-2 bert-base-cased OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8270 CPU-only 557.71 29.03 222.26 0.000 0.033 0.000 1.360 34000 16954 700 410 2 17000 8477 350 205 8.731
21 GPT-2 bert-base-cased OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Silver 4216R CPU-only 206.20 11.26 76.54 0.000 0.103 0.000 0.825 2274 2004 300 250 2 1137 1002 150 125 15.389
22 GPT-2 bert-base-cased OV-2023.0 core Intel® Core™ i9-12900HK CPU-only Intel® Core™ i7-11800H 92.59 2.02 33.22 0.000 0.213 0.000 2.057 697 435 45 1 697 435 45 14.206
23 GPT-2 bert-base-cased OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Platinum 8380 CPU-only 877.01 0.30 196.60 0.000 0.047 0.000 1.624 107 18718 15 540 1 2 107 9359 15 270 7.873
24 GPT-2 bert-base-cased OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Platinum 8490H CPU-only 3107.56 49.09 448.17 0.000 0.091 0.000 4.439 1925 34000 150 700 1 2 1925 17000 150 350 5.274
25 GPT-2 bert-base-cased OV-2023.0 core-iGPU xeon Intel® Core™ i7-1185GRE iGPU-only Intel® Xeon® Silver 4316 CPU-only 429.94 1.57 171.12 0.000 0.189 0.000 1.433 490 2274 28 300 1 2 490 1137 28 150 8.897
26 GPT-2 bert-base-cased OV-2023.0 core-iGPU accel Intel® Celeron™ 6305E GPU-only Intel® Flex-170 648.29 2.27 582.97 0.000 0.337 0.000 4.322 107 1925 15 150 1 107 1925 15 150 24.289
27 GPT-2 bert-base-cased OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Celeron™ 6305E GPU-only 44.64 32.01 1.56 21.94 0.000 0.417 0.000 2.976 490 107 28 15 1 490 107 28 15 89.466
28 GPT-2 bert-base-cased OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185GRE iGPU-only 69.65 55.42 1.48 36.87 0.000 0.142 0.000 2.487 107 490 15 28 1 107 490 15 28 53.822
29 bert-base-cased OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 88.24 60.90 46.38 0.127 1.961 697 45 1 697 45 44.864
30 bert-base-cased OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 3.31 2.36 1.49 0.017 0.551 193 6 1 193 6 1207.72
31 bert-base-cased OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 82.48 59.66 41.79 0.194 2.946 426 28 1 426 28 48.15
32 bert-base-cased OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 53.07 24.80 0.496 3.538 107 15 1 107 15
33 bert-base-cased OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 71.87 27.99 0.147 2.567 490 28 1 490 28
34 bert-base-cased OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 127.08 55.39 0.182 2.824 697 45 1 697 45
35 bert-base-cased OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 4.21 2.08 0.022 0.701 193 6 1 193 6
36 bert-base-cased OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 83.41 39.13 0.196 2.979 426 28 1 426 28
37 end_rec
38 begin_rec
39 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 3.05 6.79 1.33 2.68 0.090 0.010 0.321 0.151 34 697 9.5 45 1 34 697 9.5 45 354.611 181.851
40 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 23.94 0.26 14.89 0.13 0.205 0.008 0.368 0.028 117 34 65 9.5 1 117 34 65 9.5 43.191 4055.305
41 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 35.72 1.10 19.51 0.38 0.167 0.010 1.021 0.074 214 107 35 15 1 214 107 35 15 32.456 883.753
42 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 124.63 2.11 44.62 1.26 0.379 0.018 0.997 0.032 329 117 125 65 1 329 117 125 65 15.855 492.094
43 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-10500TE CPU-only 37.95 2.98 22.57 1.75 0.193 0.014 0.584 0.085 197 214 65 35 1 197 214 65 35 27.794 351.295
44 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only Intel® Core™ i5-13600K CPU-only 62.93 9.17 17.87 3.72 0.148 0.028 2.248 0.073 426 329 28 125 1 426 329 28 125 19.316 149.646
45 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only Intel® Core™ i5-8500 CPU-only 50.36 3.26 14.91 1.91 0.103 0.017 1.798 0.050 490 197 28 65 1 490 197 28 65 21.583 308.598
46 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185G7 CPU-only 42.21 4.60 22.78 1.57 0.139 0.011 1.206 0.164 303 426 35 28 1 303 426 35 28 27.589 230.242
47 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1185GRE CPU-only 38.74 3.32 18.79 1.28 0.079 0.007 1.107 0.118 488 490 35 28 1 488 490 35 28 35.128 271.873
48 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only Intel® Core™ i7-8700T CPU-only 61.46 2.71 19.49 1.55 0.113 0.009 1.756 0.077 544 303 35 1 544 303 35 22.006 407.64
49 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i9-10900TE CPU-only 180.30 3.14 68.74 1.76 0.301 0.006 1.442 0.090 599 488 125 35 1 599 488 125 35 13.181 335.174
50 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900TE CPU-only 64.34 5.13 35.79 1.89 0.108 0.009 0.515 0.146 594 544 125 35 1 594 544 125 35 18.403 214.42
51 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-13900K CPU-only 23.46 14.55 14.60 6.05 0.094 0.024 0.330 0.116 249 599 71 125 1 249 599 71 125 43.94 115.166
52 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Processor N-200 269.69 0.16 80.01 0.08 0.086 0.001 1.322 0.026 3144 193 204 6 2 1 1572 193 102 6 12.823 6605.009
53 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® W1290P CPU-only 678.10 4.40 222.26 2.71 0.040 0.007 1.654 0.035 16954 594 410 125 2 1 8477 594 205 125 7.567 180.697
54 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® E-2124G CPU-only 258.75 2.12 76.54 1.30 0.129 0.008 1.035 0.030 2004 249 250 71 2 1 1002 249 125 71 13.326 481.442
55 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only Intel® Xeon® Gold 5218T CPU-only 1096.03 20.31 196.59 7.14 0.059 0.006 2.030 0.100 18718 3144 540 204 2 9359 1572 270 102 6.09 104.829
56 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8270 CPU-only 3372.80 46.48 445.48 19.65 0.099 0.003 4.818 0.113 34000 16954 700 410 2 17000 8477 350 205 4.869 50.293
57 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Silver 4216R CPU-only 533.66 19.27 171.12 6.83 0.235 0.010 1.779 0.077 2274 2004 300 250 2 1137 1002 150 125 7.683 109.227
58 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core Intel® Core™ i9-12900HK CPU-only Intel® Core™ i7-11800H 85.32 8.50 25.90 2.90 0.122 0.020 1.896 0.189 697 435 45 1 697 435 45 17.986 125.712
59 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Platinum 8380 CPU-only 14.00 74.00 4.28 26.69 0.131 0.004 0.933 0.137 107 18718 15 540 1 2 107 9359 15 270 39.786
60 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Platinum 8490H CPU-only 670.48 125.14 582.97 44.52 0.348 0.004 4.470 0.179 1925 34000 150 700 1 2 1925 17000 150 350 23.469 23.966
61 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-iGPU xeon Intel® Core™ i7-1185GRE iGPU-only Intel® Xeon® Silver 4316 CPU-only 77.37 37.60 37.02 14.83 0.158 0.017 2.763 0.125 490 2274 28 300 1 2 490 1137 28 150 52.374 60.232
62 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-iGPU accel Intel® Celeron™ 6305E GPU-only Intel® Flex-170 47.15 120.47 32.01 80.23 0.441 0.063 3.144 0.803 107 1925 15 150 1 107 1925 15 150 84.683 132.308
63 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Celeron™ 6305E GPU-only 85.30 4.72 3.49 28.16 2.13 0.174 0.044 3.046 0.314 490 107 28 15 1 490 107 28 15 815.785
64 bert-base-cased bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185GRE iGPU-only 56.20 5.06 6.29 24.79 2.96 0.525 0.010 3.747 0.181 107 490 15 28 1 107 490 15 28 788.772
65 bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 11.39 8.22 5.15 0.016 0.253 697 45 1 697 45 350.737
66 bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 0.35 0.24 0.14 0.002 0.058 193 6 1 193 6 11593.101
67 bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 9.16 7.22 4.24 0.021 0.327 426 28 1 426 28 445.659
68 bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 4.87 2.19 0.046 0.325 107 15 1 107 15
69 bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 3.38 2.09 0.007 0.121 490 28 1 490 28
70 bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 11.78 4.86 0.017 0.262 697 45 1 697 45
71 bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 0.44 0.18 0.002 0.073 193 6 1 193 6
72 bert-large-uncased-whole-word-masking-squad-0001 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 7.98 3.42 0.019 0.285 426 28 1 426 28
73 end_rec
74 begin_rec
75 bert-large-uncased deeplabv3 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 0.26 74.12 0.13 31.22 0.008 0.106 0.028 1.647 34 697 9.5 45 1 34 697 9.5 45 4055.305 18.344
76 bert-large-uncased deeplabv3 OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 2.11 2.91 1.26 1.47 0.018 0.086 0.032 0.306 117 34 65 9.5 1 117 34 65 9.5 492.094 359.456
77 bert-large-uncased deeplabv3 OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 2.98 12.54 1.75 4.67 0.014 0.117 0.085 0.836 214 107 35 15 1 214 107 35 15 351.294 80.847
78 bert-large-uncased deeplabv3 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 9.17 23.64 3.72 14.69 0.028 0.202 0.073 0.364 329 117 125 65 1 329 117 125 65 149.645 42.294
bert-large-uncased OV-2023.0 core Intel® Core™ i5-8500 CPU-only 3.26 1.91 0.017 0.050 197 65 1 197 65 308.597
bert-large-uncased OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 4.60 1.57 0.011 0.164 426 28 1 426 28 230.241
bert-large-uncased OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 3.32 1.28 0.007 0.118 490 28 1 490 28 271.873
bert-large-uncased OV-2023.0 core Intel® Core™ i7-8700T CPU-only 3.55 2.12 0.012 0.101 303 35 1 303 35 295.498
bert-large-uncased OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 3.14 1.76 0.006 0.090 488 35 1 488 35 335.174
bert-large-uncased OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 5.12 1.89 0.009 0.146 544 35 1 544 35 214.42
bert-large-uncased OV-2023.0 core Intel® Core™ i9-13900K CPU-only 14.40 6.09 0.024 0.115 599 125 1 599 125 115.336
bert-large-uncased OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 4.40 2.71 0.007 0.035 594 125 1 594 125 177.897
bert-large-uncased OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 2.12 1.30 0.008 0.030 249 71 1 249 71 481.442
bert-large-uncased OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 20.31 7.14 0.006 0.100 3144 204 2 1572 102 104.828
bert-large-uncased OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 46.48 19.65 0.003 0.113 16954 410 2 8477 205 50.292
bert-large-uncased OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 19.27 6.83 0.010 0.077 2004 250 2 1002 125 109.226
bert-large-uncased OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 74.00 26.69 0.004 0.137 18718 540 2 9359 270 39.549
bert-large-uncased OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 125.14 44.52 0.004 0.179 34000 700 2 17000 350 23.947
bert-large-uncased OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 37.60 14.83 0.017 0.125 2274 300 2 1137 150 60.208
bert-large-uncased OV-2023.0 core Intel® Core™ i9-12900HK CPU-only 6.79 2.68 0.010 0.151 697 45 1 697 45 181.85
bert-large-uncased OV-2023.0 atom Intel® Celeron™ 6305E CPU-only 1.10 0.38 0.010 0.073 107 15 1 107 15 883.753
bert-large-uncased OV-2023.0 accel Intel® Flex-170 GPU 120.47 80.23 0.063 0.803 1925 150 1 1925 150 132.308
bert-large-uncased OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 5.10 2.96 0.010 0.182 490 28 1 490 28 788.772
bert-large-uncased OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only 4.72 3.49 0.044 0.314 107 15 1 107 15 815.785
bert-large-uncased OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE CPU+iGPU 5.05 2.95 0.010 0.180 490 28 1 490 28
bert-large-uncased OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E CPU+GPU 4.86 2.19 0.045 0.324 107 15 1 107 15
end_rec
begin_rec
deeplabv3 OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 1.47 0.000 0.000 34 9.5 1 34 9.5 359.456
deeplabv3 OV-2023.0 core Intel® Core™ i3-8100 CPU-only 0.000 0.000 117 65 1 117 65
79 deeplabv3 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 36.23 16.70 16.70 0.169 1.035 214 35 1 214 35 32.374
80 deeplabv3 OV-2023.0 core Intel® Core™ i5-13600K CPU-only 95.00 41.09 41.09 0.289 0.760 329 125 1 329 125 15.959
81 deeplabv3 OV-2023.0 core Intel® Core™ i5-8500 CPU-only 38.31 21.59 21.59 0.194 0.589 197 65 1 197 65 26.51
82 deeplabv3 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 54.05 16.27 16.27 0.127 1.930 426 28 1 426 28 20.652 20.653
83 deeplabv3 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 34.93 10.57 10.57 0.071 1.247 490 28 1 490 28 27.622 27.623
84 deeplabv3 OV-2023.0 core Intel® Core™ i7-8700T CPU-only 32.93 18.64 0.000 0.109 0.000 0.941 303 35 1 303 35 35.127
85 deeplabv3 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 38.14 18.17 18.17 0.078 1.090 488 35 1 488 35 27.35
86 deeplabv3 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 59.94 23.05 23.05 0.110 1.713 544 35 1 544 35 20.76 20.761
87 deeplabv3 OV-2023.0 core Intel® Core™ i9-13900K CPU-only 148.05 146.06 58.47 56.67 0.247 0.244 1.184 1.168 599 125 1 599 125 12.241 11.988
88 deeplabv3 OV-2023.0 xeon atom Intel® Xeon® W1290P CPU-only Intel® Processor N-200 1.78 1.03 0.000 0.009 0.000 0.297 594 193 125 6 1 594 193 125 6 572.256
89 deeplabv3 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only Intel® Xeon® W1290P CPU-only 55.64 19.26 0.000 0.094 0.000 0.445 249 594 71 125 1 249 594 71 125 17.404
90 deeplabv3 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only Intel® Xeon® E-2124G CPU-only 23.34 77.92 15.54 0.000 0.094 0.000 0.329 3144 249 204 71 2 1 1572 249 102 71 42.626
91 deeplabv3 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® Gold 5218T CPU-only 201.62 77.92 0.000 0.064 0.000 0.988 16954 3144 410 204 2 8477 1572 205 102 10.754
92 deeplabv3 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® Platinum 8270 CPU-only 448.78 75.53 157.91 0.000 0.026 0.000 1.095 2004 16954 250 410 2 1002 8477 125 205 4.853
93 deeplabv3 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only Intel® Xeon® Silver 4216R CPU-only 649.53 196.52 229.92 75.53 0.035 0.098 1.203 0.786 18718 2004 540 250 2 9359 1002 270 125 3.405 11.109
94 deeplabv3 OV-2023.0 xeon core Intel® Xeon® Platinum 8490H CPU-only Intel® Core™ i7-11800H 1030.08 86.85 382.32 27.00 0.030 0.200 1.472 1.930 34000 435 700 45 2 1 17000 435 350 45 3.326 12.137
95 deeplabv3 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Platinum 8380 CPU-only 410.93 649.53 141.37 229.92 0.181 0.035 1.370 1.203 2274 18718 300 540 2 1137 9359 150 270 5.875 3.847
96 deeplabv3 OV-2023.0 core xeon Intel® Core™ i9-12900HK CPU-only Intel® Xeon® Platinum 8490H CPU-only 74.12 1030.08 31.22 382.32 0.106 0.030 1.647 1.472 697 34000 45 700 1 2 697 17000 45 350 18.343 3.199
97 deeplabv3 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Silver 4316 CPU-only 410.93 4.67 141.37 0.000 0.181 0.000 1.370 107 2274 15 300 1 2 107 1137 15 150 5.369
98 deeplabv3 OV-2023.0 accel Intel® Flex-170 GPU Intel® Flex-170 746.27 500.10 0.388 4.975 1925 150 1 1925 150 21.132 21.133
99 deeplabv3 OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only Intel® Celeron™ 6305E GPU-only 78.43 62.44 13.79 28.53 16.72 0.160 0.584 2.801 4.163 490 107 28 15 1 490 107 28 15 49.979 63.94
100 deeplabv3 OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only Intel® Core™ i7-1185GRE iGPU-only 62.44 76.73 28.53 36.90 13.98 0.584 0.157 4.163 2.740 107 490 15 28 1 107 490 15 28 63.94 49.979
101 deeplabv3 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Core™ i9-12900HK GPU-only 76.72 121.55 55.55 13.98 36.78 0.157 0.174 2.740 2.701 490 697 28 45 1 490 697 28 45 32.538
102 deeplabv3 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Processor N200 GPU-only 62.43 3.85 2.01 16.71 1.36 0.583 0.020 4.162 0.641 107 193 15 6 1 107 193 15 6 1038.839
103 deeplabv3 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 109.22 50.67 28.82 0.256 3.901 426 28 1 426 28 36.378
104 deeplabv3 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 62.77 16.96 0.587 4.184 107 15 1 107 15
105 deeplabv3 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 51.34 8.91 0.105 1.834 490 28 1 490 28
106 deeplabv3 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 139.61 40.39 0.200 3.103 697 45 1 697 45
107 deeplabv3 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 4.81 1.97 0.025 0.802 193 6 1 193 6
108 deeplabv3 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 92.48 24.81 0.217 3.303 426 28 1 426 28
109 end_rec
110 begin_rec
efficientdet-d0 OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 3.76 2.64 0.111 0.396 34 9.5 1 34 9.5 290.489
efficientdet-d0 OV-2023.0 core Intel® Core™ i3-8100 CPU-only 33.53 23.96 0.287 0.516 117 65 1 117 65 31.272
efficientdet-d0 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 50.07 28.48 0.234 1.430 214 35 1 214 35 24.356
efficientdet-d0 OV-2023.0 core Intel® Core™ i5-13600K CPU-only 128.34 84.11 0.390 1.027 329 125 1 329 125 13.005
efficientdet-d0 OV-2023.0 core Intel® Core™ i5-8500 CPU-only 53.85 35.65 0.273 0.828 197 65 1 197 65 20.31
efficientdet-d0 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 69.87 39.11 0.164 2.495 426 28 1 426 28 17.366
efficientdet-d0 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 47.89 20.09 0.098 1.710 490 28 1 490 28 23.549
efficientdet-d0 OV-2023.0 core Intel® Core™ i7-8700T CPU-only 47.53 37.79 0.157 1.358 303 35 1 303 35
efficientdet-d0 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 54.67 32.54 0.112 1.562 488 35 1 488 35 21.202
efficientdet-d0 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 71.50 45.10 0.131 2.043 544 35 1 544 35 17.778
efficientdet-d0 OV-2023.0 core Intel® Core™ i9-13900K CPU-only 192.62 104.56 0.322 1.541 599 125 1 599 125 10.4
efficientdet-d0 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 92.53 35.06 0.156 0.740 594 125 1 594 125 13.425
efficientdet-d0 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 32.46 25.97 0.130 0.457 249 71 1 249 71 32.052
efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 236.75 163.08 0.075 1.161 3144 204 2 1572 102 12.998
efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 458.66 294.01 0.027 1.119 16954 410 2 8477 205 8.596
efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 228.21 157.38 0.114 0.913 2004 250 2 1002 125 13.312
efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 709.57 452.65 0.038 1.314 18718 540 2 9359 270 9.742
efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 922.74 791.57 0.027 1.318 34000 700 2 17000 350 6.149
efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 416.01 270.46 0.183 1.387 2274 300 2 1137 150 8.366
111 efficientdet-d0 OV-2023.0 core Intel® Core™ i9-12900HK CPU-only 97.01 57.69 57.69 0.139 2.156 697 45 1 697 45 14.749
112 efficientdet-d0 OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 3.76 2.64 0.111 0.396 34 9.5 1 34 9.5 290.49
113 efficientdet-d0 OV-2023.0 atom Intel® Celeron™ 6305E CPU-only 17.79 11.10 11.10 0.166 1.186 107 15 1 107 15 61.812
114 efficientdet-d0 OV-2023.0 accel core Intel® Flex-170 GPU Intel® Core™ i3-8100 CPU-only 684.48 33.53 640.17 23.96 0.356 0.287 4.563 0.516 1925 117 150 65 1 1925 117 150 65 22.702 31.273
115 efficientdet-d0 OV-2023.0 core-iGPU core Intel® Core™ i7-1185GRE iGPU-only Intel® Core™ i5-10500TE CPU-only 61.69 50.07 24.16 28.48 0.126 0.234 2.203 1.430 490 214 28 35 1 490 214 28 35 63.923 24.356
116 efficientdet-d0 OV-2023.0 core-iGPU core Intel® Celeron™ 6305E GPU-only Intel® Core™ i5-13600K CPU-only 66.61 128.34 60.60 84.12 0.623 0.390 4.441 1.027 107 329 15 125 1 107 329 15 125 59.789 13.006
117 efficientdet-d0 OV-2023.0 core-CPU+iGPU core Intel® Core™ i7-1185GRE CPU+iGPU Intel® Core™ i5-8500 CPU-only 61.69 53.85 24.13 35.65 0.126 0.273 2.203 0.828 490 197 28 65 1 490 197 28 65 20.31
118 efficientdet-d0 OV-2023.0 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185G7 CPU-only 66.61 69.87 33.76 39.11 0.623 0.164 4.441 2.495 107 426 15 28 1 107 426 15 28 17.367
119 efficientdet-d0 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 47.89 20.09 0.098 1.710 490 28 1 490 28 23.549
120 efficientdet-d0 OV-2023.0 core Intel® Core™ i7-8700T CPU-only 47.53 33.64 0.157 1.358 303 35 1 303 35 26.193
121 efficientdet-d0 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 54.68 32.54 0.112 1.562 488 35 1 488 35 21.202
122 efficientdet-d0 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 71.50 45.10 0.131 2.043 544 35 1 544 35 17.779
123 efficientdet-d0 OV-2023.0 core Intel® Core™ i9-13900K CPU-only 192.62 103.94 0.322 1.541 599 125 1 599 125 10.401
124 efficientdet-d0 OV-2023.0 atom Intel® Processor N-200 2.05 1.65 0.011 0.342 193 6 1 193 6 496.613
125 efficientdet-d0 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 79.60 35.06 0.134 0.637 594 125 1 594 125 13.426
126 efficientdet-d0 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 32.46 25.97 0.130 0.457 249 71 1 249 71 32.053
127 efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 236.75 163.08 0.075 1.161 3144 204 2 1572 102 12.998
128 efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 458.66 294.01 0.027 1.119 16954 410 2 8477 205 8.597
129 efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 228.21 157.38 0.114 0.913 2004 250 2 1002 125 13.254
130 efficientdet-d0 OV-2023.0 core Intel® Core™ i7-11800H 109.41 61.21 0.252 2.431 435 45 1 435 45 10.459
131 efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 709.57 452.65 0.038 1.314 18718 540 2 9359 270 9.743
132 efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 922.74 791.57 0.027 1.318 34000 700 2 17000 350 6.149
133 efficientdet-d0 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 416.02 270.47 0.183 1.387 2274 300 2 1137 150 8.367
134 efficientdet-d0 OV-2023.0 accel Intel® Flex-170 684.48 640.17 0.356 4.563 1925 150 1 1925 150 22.703
135 efficientdet-d0 OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only 66.61 60.60 33.76 0.623 4.441 107 15 1 107 15 59.789
136 efficientdet-d0 OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 61.69 49.32 24.14 0.126 2.203 490 28 1 490 28 63.923
137 efficientdet-d0 OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 123.77 105.73 60.06 0.178 2.751 697 45 1 697 45 31.947
138 efficientdet-d0 OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 5.64 5.03 3.02 0.029 0.940 193 6 1 193 6 707.252
139 efficientdet-d0 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 108.15 90.40 51.00 0.254 3.862 426 28 1 426 28 36.641
140 efficientdet-d0 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 56.00 33.11 0.523 3.733 107 15 1 107 15
141 efficientdet-d0 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 50.72 18.56 0.104 1.811 490 28 1 490 28
142 efficientdet-d0 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 144.59 69.25 0.207 3.213 697 45 1 697 45
143 efficientdet-d0 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 6.03 3.81 0.031 1.005 193 6 1 193 6
144 efficientdet-d0 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 97.10 49.20 0.228 3.468 426 28 1 426 28
145 end_rec
146 begin_rec
147 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i9-12900HK CPU-only 10.07 3.25 0.014 0.224 697 45 1 697 45 173.007
148 faster_rcnn_resnet50_coco OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 0.31 0.13 0.13 0.009 0.032 34 9.5 1 34 9.5 3336.101
149 faster_rcnn_resnet50_coco OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Celeron™ 6305E CPU-only 2.89 1.60 1.51 0.42 0.025 0.015 0.045 0.106 117 107 65 15 1 117 107 65 15 358.208 640.413
150 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i5-10500TE CPU-only Intel® Core™ i3-8100 CPU-only 4.22 2.89 2.26 1.51 0.020 0.025 0.120 0.045 214 117 35 65 1 214 117 35 65 307.053 358.209
151 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 4.22 2.26 0.020 0.120 214 35 1 214 35 307.054
152 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i5-13600K CPU-only 13.04 4.32 4.32 0.040 0.104 329 125 1 329 125 163.824
153 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i5-8500 CPU-only 4.59 2.39 2.39 0.023 0.071 197 65 1 197 65 247.538
154 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 6.74 1.78 1.78 0.016 0.241 426 28 1 426 28 165.661
155 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 5.16 1.43 1.43 0.011 0.184 490 28 1 490 28 199.974
156 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i7-8700T CPU-only 4.87 3.60 2.66 1.89 0.016 0.012 0.139 0.103 303 35 1 303 35 264.983 344.134
157 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 4.42 2.27 2.27 0.009 0.126 488 35 1 488 35 252.35 252.351
158 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 7.29 2.34 2.34 0.013 0.208 544 35 1 544 35 188.868
159 faster_rcnn_resnet50_coco OV-2023.0 core Intel® Core™ i9-13900K CPU-only 21.05 20.79 7.31 7.23 0.035 0.168 0.166 599 125 1 599 125 111.671 111.834
160 faster_rcnn_resnet50_coco OV-2023.0 xeon atom Intel® Xeon® W1290P CPU-only Intel® Processor N-200 8.65 0.20 4.36 0.09 0.015 0.001 0.069 0.034 594 193 125 6 1 594 193 125 6 139.23 5079.528
161 faster_rcnn_resnet50_coco OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only Intel® Xeon® W1290P CPU-only 2.78 7.85 1.48 4.03 0.011 0.013 0.039 0.063 249 594 71 125 1 249 594 71 125 363.574 138.525
162 faster_rcnn_resnet50_coco OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only Intel® Xeon® E-2124G CPU-only 29.15 2.78 8.22 1.49 0.009 0.011 0.143 0.039 3144 249 204 71 2 1 1572 249 102 71 77.579 363.574
163 faster_rcnn_resnet50_coco OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 29.15 8.22 0.009 0.143 3144 204 2 1572 102 77.58
164 faster_rcnn_resnet50_coco OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 85.87 22.37 22.37 0.005 0.209 16954 410 2 8477 205 30.369
165 faster_rcnn_resnet50_coco OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 27.70 7.83 7.83 0.014 0.111 2004 250 2 1002 125 79.52 79.521
166 faster_rcnn_resnet50_coco OV-2023.0 xeon core Intel® Xeon® Platinum 8380 CPU-only Intel® Core™ i7-11800H 112.09 12.17 32.42 3.28 0.006 0.028 0.208 0.270 18718 435 540 45 2 1 9359 435 270 45 89.144 93.88
167 faster_rcnn_resnet50_coco OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8380 CPU-only 417.49 112.09 50.54 32.42 0.012 0.006 0.596 0.208 34000 18718 700 540 2 17000 9359 350 270 10.171 90.8
168 faster_rcnn_resnet50_coco OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Platinum 8490H CPU-only 65.13 417.49 16.92 50.54 0.029 0.012 0.217 0.596 2274 34000 300 700 2 1137 17000 150 350 42.66 10.218
169 faster_rcnn_resnet50_coco OV-2023.0 core xeon Intel® Core™ i9-12900HK CPU-only Intel® Xeon® Silver 4316 CPU-only 10.07 65.13 3.25 16.92 0.014 0.029 0.224 0.217 697 2274 45 300 1 2 697 1137 45 150 173.006 42.57
170 faster_rcnn_resnet50_coco OV-2023.0 atom accel Intel® Celeron™ 6305E CPU-only Intel® Flex-170 1.60 222.32 144.56 0.42 0.015 0.115 0.106 1.482 107 1925 15 150 1 107 1925 15 150 640.412 71.57
171 faster_rcnn_resnet50_coco OV-2023.0 accel core-iGPU Intel® Flex-170 GPU Intel® Celeron™ 6305E GPU-only 222.32 8.22 144.56 4.09 1.84 0.115 0.077 1.482 0.548 1925 107 150 15 1 1925 107 150 15 71.569 475.771
172 faster_rcnn_resnet50_coco OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 13.38 13.31 2.37 6.13 2.38 0.027 0.478 0.475 490 28 1 490 28 298.019
173 faster_rcnn_resnet50_coco OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only Intel® Core™ i9-12900HK GPU-only 8.22 17.32 4.09 9.61 4.50 0.077 0.025 0.548 0.385 107 697 15 45 1 107 697 15 45 475.77 230.593
174 faster_rcnn_resnet50_coco OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Processor N200 GPU-only 13.31 0.48 0.28 2.38 0.14 0.027 0.002 0.475 0.080 490 193 28 6 1 490 193 28 6 8322.584
175 faster_rcnn_resnet50_coco OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185G7 GPU-only 8.21 15.37 8.20 1.83 3.72 0.077 0.036 0.547 0.549 107 426 15 28 1 107 426 15 28 266.287
176 faster_rcnn_resnet50_coco OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 8.58 1.99 0.080 0.572 107 15 1 107 15
177 faster_rcnn_resnet50_coco OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 11.83 1.81 0.024 0.423 490 28 1 490 28
178 faster_rcnn_resnet50_coco OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 20.10 5.54 0.029 0.447 697 45 1 697 45
179 faster_rcnn_resnet50_coco OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 0.60 0.19 0.003 0.099 193 6 1 193 6
180 faster_rcnn_resnet50_coco OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 13.39 3.31 0.031 0.478 426 28 1 426 28
181 end_rec
182 begin_rec
183 inception-v4 googlenet-v4 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 3.19 111.78 1.34 31.98 0.094 0.160 0.335 2.484 34 697 9.5 45 1 34 697 9.5 45 330.309 16.401
184 inception-v4 googlenet-v4 OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 29.71 3.19 15.29 1.34 0.254 0.094 0.457 0.335 117 34 65 9.5 1 117 34 65 9.5 34.592 330.309
185 inception-v4 googlenet-v4 OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 42.94 15.15 22.86 4.13 0.201 0.142 1.227 1.010 214 107 35 15 1 214 107 35 15 25.956 65.484
186 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 147.72 29.71 42.20 15.29 0.449 0.254 1.182 0.457 329 117 125 65 1 329 117 125 65 15.377 34.592
187 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-10500TE CPU-only 47.19 42.94 23.81 22.86 0.240 0.201 0.726 1.227 197 214 65 35 1 197 214 65 35 21.506 25.957
188 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only Intel® Core™ i5-13600K CPU-only 68.56 147.72 17.47 42.20 0.161 0.449 2.449 1.182 426 329 28 125 1 426 329 28 125 16.906 15.377
189 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only Intel® Core™ i5-8500 CPU-only 55.82 47.19 14.00 23.81 0.114 0.240 1.994 0.726 490 197 28 65 1 490 197 28 65 19.042 21.507
190 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185G7 CPU-only 49.05 68.56 26.55 17.47 0.162 0.161 1.401 2.449 303 426 35 28 1 303 426 35 28 22.154 16.906
191 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1185GRE CPU-only 45.87 55.82 22.92 14.00 0.094 0.114 1.311 1.994 488 490 35 28 1 488 490 35 28 24.899 19.042
192 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only Intel® Core™ i7-8700T CPU-only 80.22 35.79 22.64 18.77 0.147 0.118 2.292 1.023 544 303 35 1 544 303 35 19.511 31.127
193 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i9-10900TE CPU-only 224.68 45.87 71.78 22.92 0.375 0.094 1.797 1.311 599 488 125 35 1 599 488 125 35 11.8 24.9
194 inception-v4 googlenet-v4 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900TE CPU-only 91.41 80.22 42.89 22.64 0.154 0.147 0.731 2.292 594 544 125 35 1 594 544 125 35 12.94 19.511
195 inception-v4 googlenet-v4 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-13900K CPU-only 28.17 219.92 14.89 69.93 0.113 0.367 0.397 1.759 249 599 71 125 1 249 599 71 125 36.364 11.893
196 inception-v4 googlenet-v4 OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Processor N-200 302.16 2.02 77.16 0.92 0.096 0.010 1.481 0.337 3144 193 204 6 2 1 1572 193 102 6 10.627 536.385
197 inception-v4 googlenet-v4 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® W1290P CPU-only 950.44 82.75 228.44 41.21 0.056 0.139 2.318 0.662 16954 594 410 125 2 1 8477 594 205 125 5.714 13.243
198 inception-v4 googlenet-v4 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® E-2124G CPU-only 287.12 28.17 73.94 14.89 0.143 0.113 1.148 0.397 2004 249 250 71 2 1 1002 249 125 71 11.352 36.365
199 inception-v4 googlenet-v4 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only Intel® Xeon® Gold 5218T CPU-only 1475.64 302.16 347.33 77.16 0.079 0.096 2.733 1.481 18718 3144 540 204 2 9359 1572 270 102 3.339 10.628
200 inception-v4 googlenet-v4 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8270 CPU-only 5145.62 950.44 522.16 228.44 0.151 0.056 7.351 2.318 34000 16954 700 410 2 17000 8477 350 205 3.434 5.714
201 inception-v4 googlenet-v4 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Silver 4216R CPU-only 730.64 287.12 169.52 73.94 0.321 0.143 2.435 1.148 2274 2004 300 250 2 1137 1002 150 125 6.456 11.353
202 inception-v4 googlenet-v4 OV-2023.0 core Intel® Core™ i9-12900HK CPU-only Intel® Core™ i7-11800H 111.78 128.48 31.98 32.51 0.160 0.295 2.484 2.855 697 435 45 1 697 435 45 16.4 10.465
203 inception-v4 googlenet-v4 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Platinum 8380 CPU-only 15.15 1475.64 4.13 347.33 0.142 0.079 1.010 2.733 107 18718 15 540 1 2 107 9359 15 270 65.483 3.308
204 inception-v4 googlenet-v4 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Platinum 8490H CPU-only 834.65 5145.62 515.70 522.17 0.434 0.151 5.564 7.351 1925 34000 150 700 1 2 1925 17000 150 350 18.9 3.46
205 inception-v4 googlenet-v4 OV-2023.0 core-iGPU xeon Intel® Core™ i7-1185GRE iGPU-only Intel® Xeon® Silver 4316 CPU-only 109.98 730.64 33.26 169.52 0.224 0.321 3.928 2.435 490 2274 28 300 1 2 490 1137 28 150 36.221 6.386
206 inception-v4 googlenet-v4 OV-2023.0 core-iGPU accel Intel® Celeron™ 6305E GPU-only Intel® Flex-170 66.82 834.65 31.46 515.70 0.625 0.434 4.455 5.564 107 1925 15 150 1 107 1925 15 150 59.758 18.9
207 inception-v4 googlenet-v4 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Celeron™ 6305E GPU-only 106.60 66.82 31.46 33.09 18.62 0.218 0.625 3.807 4.455 490 107 28 15 1 490 107 28 15 59.758
208 inception-v4 googlenet-v4 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185GRE iGPU-only 66.82 106.60 55.16 18.62 33.10 0.624 0.218 4.455 3.807 107 490 15 28 1 107 490 15 28 36.221
209 googlenet-v4 OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 126.94 64.60 41.28 0.182 2.821 697 45 1 697 45 31.129
210 googlenet-v4 OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 4.27 1.99 1.14 0.022 0.712 193 6 1 193 6 934.853
211 googlenet-v4 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 120.74 59.65 36.70 0.283 4.312 426 28 1 426 28 32.7
212 googlenet-v4 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 86.46 20.87 0.808 5.764 107 15 1 107 15
213 googlenet-v4 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 134.97 32.38 0.275 4.820 490 28 1 490 28
214 googlenet-v4 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 203.09 55.43 0.291 4.513 697 45 1 697 45
215 googlenet-v4 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 6.00 1.59 0.031 1.001 193 6 1 193 6
216 googlenet-v4 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 125.28 33.33 0.294 4.474 426 28 1 426 28
217 end_rec
218 begin_rec
219 mobilenet-ssd GPT-2 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 27.01 3.76 12.73 2.02 0.794 0.005 2.843 0.083 34 697 9.5 45 1 34 697 9.5 45 39.576 296.881
220 mobilenet-ssd GPT-2 OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 0.20 140.58 0.10 0.000 0.006 0.000 0.021 117 34 65 9.5 1 117 34 65 9.5 5419.817
221 GPT-2 OV-2023.0 atom Intel® Celeron™ 6305E CPU-only 0.88 0.30 0.008 0.058 107 15 1 107 15 1086.958
222 GPT-2 OV-2023.0 core Intel® Core™ i3-8100 CPU-only 1.44 1.03 0.012 0.022 117 65 1 117 65 717.508
223 GPT-2 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 1.71 1.21 0.008 0.049 214 35 1 214 35 597.084
224 GPT-2 OV-2023.0 core Intel® Core™ i5-13600K CPU-only 5.38 2.94 0.016 0.043 329 125 1 329 125 227.166
225 GPT-2 OV-2023.0 core Intel® Core™ i5-8500 CPU-only 2.09 1.50 0.011 0.032 197 65 1 197 65 488.848
226 GPT-2 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 3.33 1.25 0.008 0.119 426 28 1 426 28 340.886
227 GPT-2 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 1.73 0.85 0.004 0.062 490 28 1 490 28 567.627
228 GPT-2 OV-2023.0 core Intel® Core™ i7-8700T CPU-only 1.93 1.26 0.006 0.055 303 35 1 303 35 572.361
229 GPT-2 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 1.93 1.28 0.004 0.055 488 35 1 488 35 511.396
230 GPT-2 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 2.86 1.48 0.005 0.082 544 35 1 544 35 325.104
231 GPT-2 OV-2023.0 core Intel® Core™ i9-13900K CPU-only 5.88 4.25 0.010 0.047 599 125 1 599 125 179.104
232 GPT-2 OV-2023.0 atom Intel® Processor N-200 0.12 0.07 0.001 0.021 193 6 1 193 6 8434.695
233 GPT-2 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 2.14 1.45 0.004 0.017 594 125 1 594 125 401.241
234 GPT-2 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 1.57 1.07 0.006 0.022 249 71 1 249 71 673.96
235 GPT-2 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 13.74 5.55 0.004 0.067 3144 204 2 1572 102 154.435
236 GPT-2 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 22.60 14.00 0.001 0.055 16954 410 2 8477 205 77.3
237 GPT-2 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 13.28 5.30 0.007 0.053 2004 250 2 1002 125 160.915
238 GPT-2 OV-2023.0 core Intel® Core™ i7-11800H 5.05 2.19 0.012 0.112 435 45 1 435 45 208.952
239 GPT-2 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 38.52 22.01 0.002 0.071 18718 540 2 9359 270 57.554
240 GPT-2 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 76.59 29.21 0.002 0.109 34000 700 2 17000 350 30.93
241 GPT-2 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 23.32 11.26 0.010 0.078 2274 300 2 1137 150 132.245
242 GPT-2 OV-2023.0 accel Intel® Flex-170 39.06 49.09 0.020 0.260 1925 150 1 1925 150 408.749
243 GPT-2 OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only 3.02 2.27 1.51 0.028 0.201 107 15 1 107 15 1319.205
244 GPT-2 OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 2.00 2.74 1.57 0.004 0.071 490 28 1 490 28 1989.235
245 GPT-2 OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 5.68 4.85 3.22 0.008 0.126 697 45 1 697 45 703.429
246 GPT-2 OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 0.23 0.16 0.11 0.001 0.038 193 6 1 193 6 17533.595
247 GPT-2 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 4.16 4.13 2.69 0.010 0.148 426 28 1 426 28 960.778
248 GPT-2 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 3.00 1.49 0.028 0.200 107 15 1 107 15
249 GPT-2 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 1.68 1.09 0.003 0.060 490 28 1 490 28
250 GPT-2 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 5.09 3.28 0.007 0.113 697 45 1 697 45
251 GPT-2 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 0.28 0.13 0.001 0.046 193 6 1 193 6
252 GPT-2 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 4.27 2.26 0.010 0.153 426 28 1 426 28
253 end_rec
254 begin_rec
255 mobilenet-ssd OV-2023.0 core Intel® Core™ i9-12900HK CPU-only 789.36 299.79 1.133 17.541 697 45 1 697 45 2.072
256 mobilenet-ssd OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 27.01 12.73 0.794 2.843 34 9.5 1 34 9.5 39.577
257 mobilenet-ssd OV-2023.0 atom Intel® Celeron™ 6305E CPU-only 116.16 40.17 1.086 7.744 107 15 1 107 15 8.472
258 mobilenet-ssd OV-2023.0 core Intel® Core™ i3-8100 CPU-only 221.80 140.58 1.896 3.412 117 65 1 117 65 4.715
259 mobilenet-ssd OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 344.62 201.93 201.93 1.610 9.846 214 35 1 214 35 3.456
260 mobilenet-ssd OV-2023.0 core Intel® Core™ i5-13600K CPU-only 1020.39 400.82 400.82 3.101 8.163 329 125 1 329 125 1.993
261 mobilenet-ssd OV-2023.0 core Intel® Core™ i5-8500 CPU-only 357.96 357.97 218.52 218.52 1.817 5.507 197 65 1 197 65 2.959 2.96
262 mobilenet-ssd OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 548.92 158.26 158.26 1.289 19.604 426 28 1 426 28 2.105 2.106
263 mobilenet-ssd OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 441.91 112.33 112.33 0.902 15.783 490 28 1 490 28 2.364
264 mobilenet-ssd OV-2023.0 core Intel® Core™ i7-8700T CPU-only 392.88 285.67 242.76 177.22 1.297 0.943 11.225 8.162 303 35 1 303 35 3.046 4.236
265 mobilenet-ssd OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 361.27 208.16 208.16 0.740 10.322 488 35 1 488 35 3.266 3.267
266 mobilenet-ssd OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 583.02 215.65 215.65 1.072 16.658 544 35 1 544 35 2.48
267 mobilenet-ssd OV-2023.0 core Intel® Core™ i9-13900K CPU-only 1642.52 1604.36 682.33 665.09 2.742 2.678 13.140 12.835 599 125 1 599 125 1.768 1.778
268 mobilenet-ssd OV-2023.0 xeon atom Intel® Xeon® W1290P CPU-only Intel® Processor N-200 736.72 15.32 8.77 1.240 0.079 5.894 2.554 594 193 125 6 1 594 193 125 6 67.817
269 mobilenet-ssd OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only Intel® Xeon® W1290P CPU-only 212.31 652.21 142.58 307.44 0.853 1.098 2.990 5.218 249 594 71 125 1 249 594 71 125 1.656
270 mobilenet-ssd OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only Intel® Xeon® E-2124G CPU-only 2268.47 211.82 693.51 140.47 0.722 0.851 11.120 2.983 3144 249 204 71 2 1 1572 249 102 71 1.498 4.88
271 mobilenet-ssd OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 2268.48 693.51 0.722 11.120 3144 204 2 1572 102 1.499
272 mobilenet-ssd OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 6587.85 1822.35 1822.35 0.389 16.068 16954 410 2 8477 205 1.043
273 mobilenet-ssd OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 2163.47 666.62 666.62 1.080 8.654 2004 250 2 1002 125 1.55
274 mobilenet-ssd OV-2023.0 xeon core Intel® Xeon® Platinum 8380 CPU-only Intel® Core™ i7-11800H 11311.70 1031.34 2529.80 300.85 0.604 2.371 20.948 22.919 18718 435 540 45 2 1 9359 435 270 45 0.697 1.295
275 mobilenet-ssd OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8380 CPU-only 24846.06 11311.71 3999.28 2529.80 0.731 0.604 35.494 20.948 34000 18718 700 540 2 17000 9359 350 270 0.836 0.697
276 mobilenet-ssd OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Platinum 8490H CPU-only 5398.00 24846.06 1364.13 3999.29 2.374 0.731 17.993 35.494 2274 34000 300 700 2 1137 17000 150 350 0.805 0.839
277 mobilenet-ssd OV-2023.0 core xeon Intel® Core™ i9-12900HK CPU-only Intel® Xeon® Silver 4316 CPU-only 789.36 5398.00 299.79 1364.13 1.133 2.374 17.541 17.993 697 2274 45 300 1 2 697 1137 45 150 2.072 0.809
278 mobilenet-ssd OV-2023.0 atom accel Intel® Celeron™ 6305E CPU-only Intel® Flex-170 116.16 4127.47 3257.04 40.17 1.086 2.144 7.744 27.516 107 1925 15 150 1 107 1925 15 150 8.471 3.644
279 mobilenet-ssd OV-2023.0 accel core-iGPU Intel® Flex-170 GPU Intel® Celeron™ 6305E GPU-only 4127.47 453.40 3257.04 238.03 149.06 2.144 4.237 27.516 30.226 1925 107 150 15 1 1925 107 150 15 3.643 8.634
280 mobilenet-ssd OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 626.92 619.19 201.13 332.33 199.95 1.279 1.264 22.390 22.114 490 28 1 490 28 6.243 6.244
281 mobilenet-ssd OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only Intel® Core™ i9-12900HK GPU-only 816.41 238.03 453.27 310.53 0.000 1.171 0.000 18.142 107 697 15 45 1 107 697 15 45 8.633 4.657
282 mobilenet-ssd OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Processor N200 GPU-only 619.19 32.42 16.84 199.95 10.65 1.264 0.168 22.114 5.403 490 193 28 6 1 490 193 28 6 121.698
283 mobilenet-ssd OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185G7 GPU-only 453.39 702.15 407.81 149.06 276.23 4.237 1.648 30.226 25.077 107 426 15 28 1 107 426 15 28 5.535
284 mobilenet-ssd OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 326.89 144.12 3.055 21.793 107 15 1 107 15
285 mobilenet-ssd OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 569.19 143.17 1.162 20.328 490 28 1 490 28
286 mobilenet-ssd OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 1042.75 416.99 1.496 23.172 697 45 1 697 45
287 mobilenet-ssd OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 37.18 15.37 0.193 6.197 193 6 1 193 6
288 mobilenet-ssd OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 748.60 253.99 1.757 26.736 426 28 1 426 28
289 end_rec
290 begin_rec
291 mobilenet-v2 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 1726.00 45.44 932.73 0.000 2.476 0.000 38.356 34 697 9.5 45 1 34 697 9.5 45 14.506 1.085
292 mobilenet-v2 OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 74.74 456.87 45.44 0.000 2.198 0.000 7.867 117 34 65 9.5 1 117 34 65 9.5 14.582
293 mobilenet-v2 OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 884.87 280.00 483.11 133.14 4.135 2.617 25.282 18.667 214 107 35 15 1 214 107 35 15 1.557 3.497
294 mobilenet-v2 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 2634.22 534.65 1305.55 456.87 8.007 4.570 21.074 8.225 329 117 125 65 1 329 117 125 65 0.959 1.974
295 mobilenet-v2 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-10500TE CPU-only 880.67 882.73 684.15 483.11 4.470 4.125 13.549 25.221 197 214 65 35 1 197 214 65 35 1.33 1.556
296 mobilenet-v2 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only Intel® Core™ i5-13600K CPU-only 1384.37 2619.92 520.06 1305.55 3.250 7.963 49.442 20.959 426 329 28 125 1 426 329 28 125 0.93 0.958
297 mobilenet-v2 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only Intel® Core™ i5-8500 CPU-only 1092.57 876.27 315.10 684.15 2.230 4.448 39.020 13.481 490 197 28 65 1 490 197 28 65 1.025 1.325
298 mobilenet-v2 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185G7 CPU-only 1378.21 670.65 520.06 0.000 3.235 0.000 49.222 303 426 35 28 1 303 426 35 28 0.931
299 mobilenet-v2 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1185GRE CPU-only 922.31 1065.40 638.15 315.10 1.890 2.174 26.352 38.050 488 490 35 28 1 488 490 35 28 1.518 1.015
300 mobilenet-v2 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only Intel® Core™ i7-8700T CPU-only 1271.36 718.66 687.61 516.57 2.337 2.372 36.325 20.533 544 303 35 1 544 303 35 1.229 1.854
301 mobilenet-v2 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i9-10900TE CPU-only 4077.41 920.75 2121.84 638.15 6.807 1.887 32.619 26.307 599 488 125 35 1 599 488 125 35 0.76 1.514
302 mobilenet-v2 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900TE CPU-only 1283.37 687.61 0.000 2.359 0.000 36.668 594 544 125 35 1 594 544 125 35 1.219
303 mobilenet-v2 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-13900K CPU-only 3959.96 2062.89 0.000 6.611 0.000 31.680 249 599 71 125 1 249 599 71 125 0.768
304 mobilenet-v2 OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Processor N-200 5589.81 40.77 1920.53 29.63 1.778 0.211 27.401 6.795 3144 193 204 6 2 1 1572 193 102 6 1.349 27.138
305 mobilenet-v2 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® W1290P CPU-only 15333.06 1670.25 4417.85 813.61 0.904 2.812 37.398 13.362 16954 594 410 125 2 1 8477 594 205 125 0.843 0.795
306 mobilenet-v2 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® E-2124G CPU-only 5405.01 519.94 1859.79 450.61 2.697 2.088 21.620 7.323 2004 249 250 71 2 1 1002 249 125 71 1.374 2.036
307 mobilenet-v2 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only Intel® Xeon® Gold 5218T CPU-only 23186.39 5539.89 6910.90 1920.53 1.239 1.762 42.938 27.156 18718 3144 540 204 2 9359 1572 270 102 0.519 1.349
308 mobilenet-v2 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8270 CPU-only 35768.42 15210.14 10976.35 4417.85 1.052 0.897 51.098 37.098 34000 16954 700 410 2 17000 8477 350 205 0.618 0.851
309 mobilenet-v2 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Silver 4216R CPU-only 12752.22 5369.69 3600.85 1859.79 5.608 2.679 42.507 21.479 2274 2004 300 250 2 1137 1002 150 125 0.51 1.364
310 mobilenet-v2 OV-2023.0 core Intel® Core™ i9-12900HK CPU-only Intel® Core™ i7-11800H 1735.86 2575.56 932.73 938.74 2.490 5.921 38.575 57.235 697 435 45 1 697 435 45 1.089 0.636
311 mobilenet-v2 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Platinum 8380 CPU-only 23172.78 133.14 6910.90 0.000 1.238 0.000 42.913 107 18718 15 540 1 2 107 9359 15 270 3.455 0.522
312 mobilenet-v2 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Platinum 8490H CPU-only 5411.37 35561.67 5188.89 10976.35 2.811 1.046 36.076 50.802 1925 34000 150 700 1 2 1925 17000 150 350 2.026 0.618
313 mobilenet-v2 OV-2023.0 core-iGPU xeon Intel® Core™ i7-1185GRE iGPU-only Intel® Xeon® Silver 4316 CPU-only 929.63 12687.83 350.08 3600.85 1.897 5.580 33.201 42.293 490 2274 28 300 1 2 490 1137 28 150 4.227 0.51
314 mobilenet-v2 OV-2023.0 core-iGPU accel Intel® Celeron™ 6305E GPU-only Intel® Flex-170 674.00 5398.23 511.12 5255.59 6.299 2.804 44.933 35.988 107 1925 15 150 1 107 1925 15 150 5.591 2.256
315 mobilenet-v2 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Celeron™ 6305E GPU-only 922.11 671.48 511.12 350.46 338.92 1.882 6.276 32.933 44.765 490 107 28 15 1 490 107 28 15 5.565
316 mobilenet-v2 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185GRE iGPU-only 674.00 909.69 583.68 338.92 350.46 6.299 1.857 44.933 32.489 107 490 15 28 1 107 490 15 28 4.207
317 mobilenet-v2 OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 1205.84 894.32 586.79 1.730 26.796 697 45 1 697 45 3.127
318 mobilenet-v2 OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 60.97 41.27 26.90 0.316 10.162 193 6 1 193 6 64.669
319 mobilenet-v2 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 1000.97 740.36 523.20 2.350 35.749 426 28 1 426 28 3.855
320 mobilenet-v2 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 1468.05 394.16 13.720 97.870 107 15 1 107 15
321 mobilenet-v2 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 1168.44 216.48 2.385 41.730 490 28 1 490 28
322 mobilenet-v2 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 3183.48 1119.78 4.567 70.744 697 45 1 697 45
323 mobilenet-v2 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 117.36 49.87 0.608 19.560 193 6 1 193 6
324 mobilenet-v2 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 2238.11 597.27 5.254 79.933 426 28 1 426 28
325 end_rec
326 begin_rec
327 resnet-50 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 10.92 372.55 4.54 103.20 0.321 0.535 1.150 8.279 34 697 9.5 45 1 34 697 9.5 45 94.518 4.778
328 resnet-50 OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 10.92 4.54 0.321 1.150 34 9.5 1 34 9.5 94.519
329 resnet-50 OV-2023.0 atom Intel® Celeron™ 6305E CPU-only 50.13 14.45 0.469 3.342 107 15 1 107 15 19.719
330 resnet-50 OV-2023.0 core Intel® Core™ i3-8100 CPU-only 97.59 51.99 51.99 0.834 1.501 117 65 1 117 65 10.637
331 resnet-50 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 144.61 75.37 75.37 0.676 4.132 214 35 1 214 35 8.098
332 resnet-50 OV-2023.0 core Intel® Core™ i5-13600K CPU-only 500.94 143.02 143.02 1.523 4.008 329 125 1 329 125 4.455 4.456
333 resnet-50 OV-2023.0 core Intel® Core™ i5-8500 CPU-only 155.16 81.16 81.16 0.788 2.387 197 65 1 197 65 6.957 6.958
334 resnet-50 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 224.35 60.58 60.58 0.527 8.012 426 28 1 426 28 5.088
335 resnet-50 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 182.57 47.31 47.31 0.373 6.520 490 28 1 490 28 51.708 5.96
336 resnet-50 OV-2023.0 core Intel® Core™ i7-8700T CPU-only 165.21 121.71 88.47 62.98 0.545 0.402 4.720 3.477 303 35 1 303 35 7.106 9.845
337 resnet-50 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 155.09 77.88 77.88 0.318 4.431 488 35 1 488 35 7.417 7.418
338 resnet-50 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 267.58 75.49 75.49 0.492 7.645 544 35 1 544 35 5.351
339 resnet-50 OV-2023.0 core Intel® Core™ i9-13900K CPU-only 763.64 744.56 241.72 235.07 1.275 1.243 6.109 5.956 599 125 1 599 125 3.362 3.366
340 resnet-50 OV-2023.0 xeon atom Intel® Xeon® W1290P CPU-only Intel® Processor N-200 319.70 6.73 148.80 3.18 0.538 0.035 2.558 1.121 594 193 125 6 1 594 193 125 6 3.733 160.351
341 resnet-50 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 276.11 141.28 0.465 2.209 594 125 1 594 125 3.804
342 resnet-50 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 93.19 50.97 50.97 0.374 1.312 249 71 1 249 71 11.014
343 resnet-50 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 968.34 269.28 269.28 0.308 4.747 3144 204 2 1572 102 2.912
344 resnet-50 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 2928.36 755.49 755.50 0.173 7.142 16954 410 2 8477 205 1.501
345 resnet-50 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 928.12 257.71 257.71 0.463 3.712 2004 250 2 1002 125 3.015
346 resnet-50 OV-2023.0 xeon core Intel® Xeon® Platinum 8380 CPU-only Intel® Core™ i7-11800H 5006.83 418.87 1168.91 112.99 0.267 0.963 9.272 9.308 18718 435 540 45 2 1 9359 435 270 45 1.017 2.909
347 resnet-50 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8380 CPU-only 18906.26 5006.83 1671.79 1168.91 0.556 0.267 27.009 9.272 34000 18718 700 540 2 17000 9359 350 270 1 1.016
348 resnet-50 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Platinum 8490H CPU-only 2292.86 18906.26 570.35 1671.79 1.008 0.556 7.643 27.009 2274 34000 300 700 2 1137 17000 150 350 1.465 1.003
349 resnet-50 OV-2023.0 core xeon Intel® Core™ i9-12900HK CPU-only Intel® Xeon® Silver 4316 CPU-only 372.55 2292.86 103.20 570.35 0.535 1.008 8.279 7.643 697 2274 45 300 1 2 697 1137 45 150 4.778 1.463
350 resnet-50 OV-2023.0 atom accel Intel® Celeron™ 6305E CPU-only Intel® Flex-170 50.13 3088.38 1947.78 14.45 0.469 1.604 3.342 20.589 107 1925 15 150 1 107 1925 15 150 19.719 4.919
351 resnet-50 OV-2023.0 accel core-iGPU Intel® Flex-170 GPU Intel® Celeron™ 6305E GPU-only 3088.38 212.07 1947.78 117.19 66.74 1.604 1.982 20.589 14.138 1925 107 150 15 1 1925 107 150 15 4.918 18.752
352 resnet-50 OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 300.85 296.02 91.55 166.15 90.65 0.614 0.604 10.744 10.572 490 28 1 490 28 13.174
353 resnet-50 OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only Intel® Core™ i9-12900HK GPU-only 212.07 380.98 117.19 229.42 143.43 1.982 0.547 14.138 8.466 107 697 15 45 1 107 697 15 45 18.751 10.195
354 resnet-50 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Processor N200 GPU-only 296.02 15.19 7.96 90.64 4.35 0.604 0.079 10.572 2.532 490 193 28 6 1 490 193 28 6 262.333
355 resnet-50 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185G7 GPU-only 212.06 351.93 210.88 66.73 120.40 1.982 0.826 14.137 12.569 107 426 15 28 1 107 426 15 28 11.145
356 resnet-50 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 298.19 75.45 2.787 19.880 107 15 1 107 15
357 resnet-50 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 440.34 87.84 0.899 15.726 490 28 1 490 28
358 resnet-50 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 714.02 187.03 1.024 15.867 697 45 1 697 45
359 resnet-50 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 21.28 6.36 0.110 3.546 193 6 1 193 6
360 resnet-50 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 469.96 122.38 1.103 16.784 426 28 1 426 28
361 end_rec
362 begin_rec
363 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 0.18 6.00 0.08 1.85 0.005 0.009 0.019 0.133 34 697 9.5 45 1 34 697 9.5 45 5553.227 241.005
364 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 1.69 0.18 0.97 0.08 0.014 0.005 0.026 0.019 117 34 65 9.5 1 117 34 65 9.5 593.302 5553.228
365 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 2.42 0.90 1.40 0.23 0.011 0.008 0.069 0.060 214 107 35 15 1 214 107 35 15 459.773 1118.931
366 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 8.10 1.69 2.46 0.98 0.025 0.014 0.065 0.026 329 117 125 65 1 329 117 125 65 207.938 593.303
367 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-10500TE CPU-only 2.63 2.42 1.49 1.40 0.013 0.011 0.040 0.069 197 214 65 35 1 197 214 65 35 393.41 459.773
368 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only Intel® Core™ i5-13600K CPU-only 3.82 8.10 0.99 2.46 0.009 0.025 0.136 0.065 426 329 28 125 1 426 329 28 125 280.092 207.938
369 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only Intel® Core™ i5-8500 CPU-only 3.15 2.63 0.82 1.49 0.006 0.013 0.113 0.040 490 197 28 65 1 490 197 28 65 5.129 393.411
370 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185G7 CPU-only 2.78 3.82 1.61 0.99 0.009 0.080 0.136 303 426 35 28 1 303 426 35 28 399.367 280.093
371 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1185GRE CPU-only 2.48 3.15 1.38 0.82 0.005 0.006 0.071 0.113 488 490 35 28 1 488 490 35 28 411.047 315.974
372 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only Intel® Core™ i7-8700T CPU-only 4.07 2.02 1.34 1.13 0.007 0.116 0.058 544 303 35 1 544 303 35 297.001 562.292
373 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i9-10900TE CPU-only 12.60 2.49 4.18 1.38 0.021 0.005 0.101 0.071 599 488 125 35 1 599 488 125 35 157.718 411.048
374 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900TE CPU-only 5.02 4.07 1.34 0.008 0.007 0.040 0.116 594 544 125 35 1 594 544 125 35 200.705 297.001
375 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-13900K CPU-only 1.60 12.38 0.92 4.12 0.006 0.021 0.023 0.099 249 599 71 125 1 249 599 71 125 622.798 157.781
376 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Processor N-200 17.65 0.11 4.59 0.05 0.006 0.001 0.087 0.019 3144 193 204 6 2 1 1572 193 102 6 116.003 8993.66
377 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® W1290P CPU-only 57.90 4.57 14.86 2.53 0.003 0.008 0.141 0.037 16954 594 410 125 2 1 8477 594 205 125 36.506 202.869
378 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® E-2124G CPU-only 16.78 1.60 4.37 0.92 0.008 0.006 0.067 0.023 2004 249 250 71 2 1 1002 249 125 71 121.986 622.799
379 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only Intel® Xeon® Gold 5218T CPU-only 78.77 17.65 20.79 4.59 0.004 0.006 0.146 0.087 18718 3144 540 204 2 9359 1572 270 102 105.307 116.003
380 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8270 CPU-only 440.92 57.90 31.41 14.86 0.013 0.003 0.630 0.141 34000 16954 700 410 2 17000 8477 350 205 8.63 36.506
381 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Silver 4216R CPU-only 42.62 16.78 10.56 4.37 0.019 0.008 0.142 0.067 2274 2004 300 250 2 1137 1002 150 125 60.312 121.986
382 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core Intel® Core™ i9-12900HK CPU-only Intel® Core™ i7-11800H 6.00 7.08 1.85 1.82 0.009 0.016 0.133 0.157 697 435 45 1 697 435 45 241.005 155.088
383 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Platinum 8380 CPU-only 0.90 78.77 0.23 20.79 0.008 0.004 0.060 0.146 107 18718 15 540 1 2 107 9359 15 270 1118.93 106.673
384 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Platinum 8490H CPU-only 150.99 440.92 92.06 31.41 0.078 0.013 1.007 0.630 1925 34000 150 700 1 2 1925 17000 150 350 105.863 8.749
385 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core-iGPU xeon Intel® Core™ i7-1185GRE iGPU-only Intel® Xeon® Silver 4316 CPU-only 9.00 42.63 2.24 10.56 0.018 0.019 0.321 0.142 490 2274 28 300 1 2 490 1137 28 150 444.2 59.63
386 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core-iGPU accel Intel® Celeron™ 6305E GPU-only Intel® Flex-170 5.04 150.99 2.62 92.06 0.047 0.078 0.336 1.007 107 1925 15 150 1 107 1925 15 150 774.647 105.864
387 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Celeron™ 6305E GPU-only 8.73 5.04 2.62 2.24 1.41 0.018 0.047 0.312 0.336 490 107 28 15 1 490 107 28 15 774.647
388 ssd-resnet-34-1200 ssd-resnet34-1200 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185GRE iGPU-only 5.04 8.74 4.78 1.40 2.25 0.047 0.018 0.336 0.312 107 490 15 28 1 107 490 15 28 444.2
389 ssd-resnet34-1200 OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 10.88 6.26 3.42 0.016 0.242 697 45 1 697 45 367.297
390 ssd-resnet34-1200 OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 0.29 0.17 0.002 0.049 193 6 1 193 6 13690.681
391 ssd-resnet34-1200 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 9.70 5.42 2.84 0.023 0.347 426 28 1 426 28 422.084
392 ssd-resnet34-1200 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 0.90 0.23 0.008 0.060 107 15 1 107 15
393 ssd-resnet34-1200 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 3.15 0.82 0.006 0.112 490 28 1 490 28
394 ssd-resnet34-1200 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 5.93 1.87 0.009 0.132 697 45 1 697 45
395 ssd-resnet34-1200 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 0.11 0.05 0.001 0.018 193 6 1 193 6
396 ssd-resnet34-1200 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 3.91 1.00 0.009 0.140 426 28 1 426 28
397 end_rec
398 begin_rec
399 unet-camvid-onnx-0001 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 8.65 0.04 3.05 0.000 0.012 0.000 0.192 34 697 9.5 45 1 34 697 9.5 45 156.161
400 unet-camvid-onnx-0001 OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 0.26 1.55 0.04 0.000 0.008 0.000 0.027 117 34 65 9.5 1 117 34 65 9.5 3981.236
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 2.25 0.000 0.000 214 35 1 214 35
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i5-13600K CPU-only 4.02 0.000 0.000 329 125 1 329 125
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i5-8500 CPU-only 2.39 0.000 0.000 197 65 1 197 65
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 6.42 1.61 0.015 0.229 426 28 1 426 28 169.94
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 5.20 1.28 0.011 0.186 490 28 1 490 28 5.959
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i7-8700T CPU-only 2.60 0.000 0.000 303 35 1 303 35
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 2.25 0.000 0.000 488 35 1 488 35
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 2.25 0.000 0.000 544 35 1 544 35
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i9-13900K CPU-only 6.89 0.000 0.000 599 125 1 599 125
unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 4.54 0.000 0.000 594 125 1 594 125
unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 1.49 0.000 0.000 249 71 1 249 71
unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 29.07 7.34 0.009 0.142 3144 204 2 1572 102 71.813
unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 95.23 21.78 0.006 0.232 16954 410 2 8477 205 23.52
unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 27.71 7.01 0.014 0.111 2004 250 2 1002 125 74.843
unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 129.48 31.77 0.007 0.240 18718 540 2 9359 270 73.758
unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 505.87 48.40 0.015 0.723 34000 700 2 17000 350 9.333
unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 69.94 16.08 0.031 0.233 2274 300 2 1137 150 42.347
unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i9-12900HK CPU-only 8.65 3.05 0.012 0.192 697 45 1 697 45 156.16
401 unet-camvid-onnx-0001 OV-2023.0 atom Intel® Celeron™ 6305E CPU-only 1.49 0.38 0.38 0.014 0.100 107 15 1 107 15 672.584
402 unet-camvid-onnx-0001 OV-2023.0 accel core Intel® Flex-170 GPU Intel® Core™ i3-8100 CPU-only 254.48 2.46 144.90 1.55 0.132 0.021 1.697 0.038 1925 117 150 65 1 1925 117 150 65 62.697 413.844
403 unet-camvid-onnx-0001 OV-2023.0 core-iGPU core Intel® Core™ i7-1185GRE iGPU-only Intel® Core™ i5-10500TE CPU-only 15.74 3.60 4.26 2.25 0.032 0.017 0.562 0.103 490 214 28 35 1 490 214 28 35 253.852 322.582
404 unet-camvid-onnx-0001 OV-2023.0 core-iGPU core Intel® Celeron™ 6305E GPU-only Intel® Core™ i5-13600K CPU-only 8.41 11.67 4.37 4.03 0.079 0.035 0.560 0.093 107 329 15 125 1 107 329 15 125 475.668 132.595
405 unet-camvid-onnx-0001 OV-2023.0 core-CPU+iGPU core Intel® Core™ i7-1185GRE CPU+iGPU Intel® Core™ i5-8500 CPU-only 15.72 3.85 4.26 2.39 0.032 0.020 0.561 0.059 490 197 28 65 1 490 197 28 65 263.384
406 unet-camvid-onnx-0001 OV-2023.0 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185G7 CPU-only 8.40 6.42 2.38 1.61 0.079 0.015 0.560 0.229 107 426 15 28 1 107 426 15 28 169.941
407 unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 5.20 1.28 0.011 0.186 490 28 1 490 28 188.957
408 unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i7-8700T CPU-only 3.01 1.86 0.010 0.086 303 35 1 303 35 384.226
409 unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 3.62 2.25 0.007 0.103 488 35 1 488 35 286.784
410 unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 6.15 2.25 0.011 0.176 544 35 1 544 35 187.178
411 unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i9-13900K CPU-only 18.36 6.78 0.031 0.147 599 125 1 599 125 99.814
412 unet-camvid-onnx-0001 OV-2023.0 atom Intel® Processor N-200 0.17 0.09 0.001 0.029 193 6 1 193 6 5875.117
413 unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 6.61 4.00 0.011 0.053 594 125 1 594 125 153.203
414 unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 2.35 1.49 0.009 0.033 249 71 1 249 71 436.422
415 unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 29.07 7.34 0.009 0.142 3144 204 2 1572 102 71.813
416 unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 95.23 21.78 0.006 0.232 16954 410 2 8477 205 23.521
417 unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 27.71 7.01 0.014 0.111 2004 250 2 1002 125 74.843
418 unet-camvid-onnx-0001 OV-2023.0 core Intel® Core™ i7-11800H 11.74 2.94 0.027 0.261 435 45 1 435 45 94.316
419 unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 129.48 31.77 0.007 0.240 18718 540 2 9359 270 73.505
420 unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 505.87 48.40 0.015 0.723 34000 700 2 17000 350 9.311
421 unet-camvid-onnx-0001 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 69.94 16.08 0.031 0.233 2274 300 2 1137 150 41.748
422 unet-camvid-onnx-0001 OV-2023.0 accel Intel® Flex-170 254.48 144.90 0.132 1.697 1925 150 1 1925 150 62.698
423 unet-camvid-onnx-0001 OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only 8.41 4.37 2.38 0.079 0.560 107 15 1 107 15 475.669
424 unet-camvid-onnx-0001 OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 15.72 8.02 4.27 0.032 0.562 490 28 1 490 28 253.853
425 unet-camvid-onnx-0001 OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 19.13 10.06 5.58 0.027 0.425 697 45 1 697 45 208.318
426 unet-camvid-onnx-0001 OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 0.47 0.27 0.14 0.002 0.078 193 6 1 193 6 8545.949
427 unet-camvid-onnx-0001 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 17.31 8.85 4.83 0.041 0.618 426 28 1 426 28 227.453
428 unet-camvid-onnx-0001 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 8.90 2.45 0.083 0.593 107 15 1 107 15
429 unet-camvid-onnx-0001 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 14.81 3.73 0.030 0.529 490 28 1 490 28
430 unet-camvid-onnx-0001 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 19.83 6.12 0.028 0.441 697 45 1 697 45
431 unet-camvid-onnx-0001 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 0.57 0.20 0.003 0.096 193 6 1 193 6
432 unet-camvid-onnx-0001 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 14.14 3.75 0.033 0.505 426 28 1 426 28
433 end_rec
434 begin_rec
435 yolo-v3 yolo_v3 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 1.13 39.77 0.52 11.97 0.033 0.057 0.119 0.884 34 697 9.5 45 1 34 697 9.5 45 903.84 34.872
436 yolo-v3 yolo_v3 OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 10.63 1.13 5.89 0.52 0.091 0.033 0.164 0.119 117 34 65 9.5 1 117 34 65 9.5 95.035 903.841
437 yolo-v3 yolo_v3 OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 15.37 5.45 8.39 1.55 0.072 0.051 0.439 0.363 214 107 35 15 1 214 107 35 15 74.286 184.58
438 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 51.84 10.63 15.89 5.89 0.158 0.091 0.415 0.164 329 117 125 65 1 329 117 125 65 30.002 95.036
439 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-10500TE CPU-only 16.37 15.37 8.99 8.39 0.083 0.072 0.252 0.439 197 214 65 35 1 197 214 65 35 63.34 74.286
440 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only Intel® Core™ i5-13600K CPU-only 23.65 51.84 6.47 15.89 0.056 0.158 0.845 0.415 426 329 28 125 1 426 329 28 125 46.28 30.003
441 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only Intel® Core™ i5-8500 CPU-only 19.40 16.37 5.08 8.99 0.040 0.083 0.693 0.252 490 197 28 65 1 490 197 28 65 12.186 63.341
442 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185G7 CPU-only 17.61 23.65 9.85 6.47 0.058 0.056 0.503 0.845 303 426 35 28 1 303 426 35 28 59.526 46.28
443 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1185GRE CPU-only 16.06 19.40 8.39 5.08 0.033 0.040 0.459 0.693 488 490 35 28 1 488 490 35 28 68.144 51.709
444 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i9-12900TE CPU-only Intel® Core™ i7-8700T CPU-only 27.93 12.66 8.41 6.99 0.051 0.042 0.798 0.362 544 303 35 1 544 303 35 42.848 86.495
445 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i9-10900TE CPU-only 81.69 16.06 27.09 8.39 0.136 0.033 0.653 0.459 599 488 125 35 1 599 488 125 35 23.63 68.145
446 yolo-v3 yolo_v3 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900TE CPU-only 32.62 27.93 14.28 8.41 0.055 0.051 0.261 0.798 594 544 125 35 1 594 544 125 35 31.954 42.848
447 yolo-v3 yolo_v3 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-13900K CPU-only 10.06 79.98 5.72 26.47 0.040 0.134 0.142 0.640 249 599 71 125 1 249 599 71 125 100.121 23.62
448 yolo-v3 yolo_v3 OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Processor N-200 105.44 0.71 29.93 0.35 0.034 0.004 0.517 0.118 3144 193 204 6 2 1 1572 193 102 6 22.132 1470.788
449 yolo-v3 yolo_v3 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® W1290P CPU-only 318.96 29.22 88.54 14.28 0.019 0.049 0.778 0.234 16954 594 410 125 2 1 8477 594 205 125 10.667 32.442
450 yolo-v3 yolo_v3 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® E-2124G CPU-only 100.48 10.06 28.51 5.72 0.050 0.040 0.402 0.142 2004 249 250 71 2 1 1002 249 125 71 23.175 100.122
451 yolo-v3 yolo_v3 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only Intel® Xeon® Gold 5218T CPU-only 485.45 105.44 108.76 29.93 0.026 0.034 0.899 0.517 18718 3144 540 204 2 9359 1572 270 102 6.711 22.133
452 yolo-v3 yolo_v3 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8270 CPU-only 2042.57 318.96 194.96 88.54 0.060 0.019 2.918 0.778 34000 16954 700 410 2 17000 8477 350 205 3.286 10.668
453 yolo-v3 yolo_v3 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Silver 4216R CPU-only 240.71 100.48 62.50 28.51 0.106 0.050 0.802 0.402 2274 2004 300 250 2 1137 1002 150 125 13.918 23.175
454 yolo-v3 yolo_v3 OV-2023.0 core Intel® Core™ i9-12900HK CPU-only Intel® Core™ i7-11800H 39.77 43.61 11.97 11.91 0.057 0.100 0.884 0.969 697 435 45 1 697 435 45 34.872 26.339
455 yolo-v3 yolo_v3 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Platinum 8380 CPU-only 5.45 485.45 1.55 108.76 0.051 0.026 0.363 0.899 107 18718 15 540 1 2 107 9359 15 270 184.58 6.704
456 yolo-v3 yolo_v3 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Platinum 8490H CPU-only 715.46 2042.57 313.59 194.96 0.372 0.060 4.770 2.918 1925 34000 150 700 1 2 1925 17000 150 350 21.953 3.296
457 yolo-v3 yolo_v3 OV-2023.0 core-iGPU xeon Intel® Core™ i7-1185GRE iGPU-only Intel® Xeon® Silver 4316 CPU-only 59.07 240.71 13.71 62.50 0.121 0.106 2.110 0.802 490 2274 28 300 1 2 490 1137 28 150 67.531 13.156
458 yolo-v3 yolo_v3 OV-2023.0 core-iGPU accel Intel® Celeron™ 6305E GPU-only Intel® Flex-170 32.01 715.46 15.01 313.59 0.299 0.372 2.134 4.770 107 1925 15 150 1 107 1925 15 150 123.951 21.953
459 yolo-v3 yolo_v3 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Celeron™ 6305E GPU-only 59.07 32.01 15.01 13.68 8.05 0.121 0.299 2.110 2.134 490 107 28 15 1 490 107 28 15 123.951
460 yolo-v3 yolo_v3 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185GRE iGPU-only 32.00 59.08 26.50 8.04 13.68 0.299 0.121 2.133 2.110 107 490 15 28 1 107 490 15 28 67.531
461 yolo_v3 OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 69.33 34.30 18.80 0.099 1.541 697 45 1 697 45 57.179
462 yolo_v3 OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 1.82 0.94 0.51 0.009 0.304 193 6 1 193 6 2193.513
463 yolo_v3 OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 62.39 29.62 16.26 0.146 2.228 426 28 1 426 28 64.935
464 yolo_v3 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 33.33 8.57 0.311 2.222 107 15 1 107 15
465 yolo_v3 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 54.94 12.76 0.112 1.962 490 28 1 490 28
466 yolo_v3 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 79.34 21.62 0.114 1.763 697 45 1 697 45
467 yolo_v3 OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 2.18 0.72 0.011 0.363 193 6 1 193 6
468 yolo_v3 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 50.76 13.72 0.119 1.813 426 28 1 426 28
469 end_rec
470 begin_rec
yolo_v3_tiny OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 12.33 6.20 0.363 1.297 34 9.5 1 34 9.5 82.686
yolo_v3_tiny OV-2023.0 core Intel® Core™ i3-8100 CPU-only 112.45 65.06 0.961 1.730 117 65 1 117 65 8.957
yolo_v3_tiny OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 167.83 92.82 0.784 4.795 214 35 1 214 35 6.709
yolo_v3_tiny OV-2023.0 core Intel® Core™ i5-13600K CPU-only 600.04 199.22 1.824 4.800 329 125 1 329 125 3.139
yolo_v3_tiny OV-2023.0 core Intel® Core™ i5-8500 CPU-only 176.01 99.54 0.893 2.708 197 65 1 197 65 5.438
yolo_v3_tiny OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 241.89 75.37 0.568 8.639 426 28 1 426 28 4.542
yolo_v3_tiny OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 203.84 57.67 0.416 7.280 490 28 1 490 28 5.129
yolo_v3_tiny OV-2023.0 core Intel® Core™ i7-8700T CPU-only 191.07 108.63 0.631 5.459 303 35 1 303 35 5.593
yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 180.44 92.86 0.370 5.155 488 35 1 488 35 6.282
yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 303.14 97.03 0.557 8.661 544 35 1 544 35 4.164
yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-13900K CPU-only 900.78 306.13 1.504 7.206 599 125 1 599 125 2.541
yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 349.17 170.15 0.588 2.793 594 125 1 594 125 2.953
yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 106.71 64.03 0.429 1.503 249 71 1 249 71 9.39
yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 1052.16 339.30 0.335 5.158 3144 204 2 1572 102 2.514
yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 2932.78 914.37 0.173 7.153 16954 410 2 8477 205 1.215
yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 1010.00 323.69 0.504 4.040 2004 250 2 1002 125 2.622
yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 4584.21 1374.00 0.245 8.489 18718 540 2 9359 270 0.88
yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 13092.13 2107.19 0.385 18.703 34000 700 2 17000 350 1.149
yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 2217.64 704.05 0.975 7.392 2274 300 2 1137 150 1.321
471 yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-12900HK CPU-only 433.83 136.36 136.36 0.622 9.641 697 45 1 697 45 3.411
472 yolo_v3_tiny OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 12.33 6.20 0.363 1.297 34 9.5 1 34 9.5 82.687
473 yolo_v3_tiny OV-2023.0 atom Intel® Celeron™ 6305E CPU-only 54.23 18.05 18.05 0.507 3.615 107 15 1 107 15 18.195
474 yolo_v3_tiny OV-2023.0 accel core Intel® Flex-170 GPU Intel® Core™ i3-8100 CPU-only 3196.82 112.45 2123.72 65.07 1.661 0.961 21.312 1.730 1925 117 150 65 1 1925 117 150 65 4.691 8.957
475 yolo_v3_tiny OV-2023.0 core-iGPU core Intel® Core™ i7-1185GRE iGPU-only Intel® Core™ i5-10500TE CPU-only 507.33 167.83 136.58 92.82 1.035 0.784 18.119 4.795 490 214 28 35 1 490 214 28 35 7.675 6.71
476 yolo_v3_tiny OV-2023.0 core-iGPU core Intel® Celeron™ 6305E GPU-only Intel® Core™ i5-13600K CPU-only 290.97 600.04 151.90 199.22 2.719 1.824 19.398 4.800 107 329 15 125 1 107 329 15 125 13.629 3.14
477 yolo_v3_tiny OV-2023.0 core-CPU+iGPU core Intel® Core™ i7-1185GRE CPU+iGPU Intel® Core™ i5-8500 CPU-only 505.40 176.01 136.40 99.54 1.031 0.893 18.050 2.708 490 197 28 65 1 490 197 28 65 5.439
478 yolo_v3_tiny OV-2023.0 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185G7 CPU-only 290.97 241.89 86.08 75.37 2.719 0.568 19.398 8.639 107 426 15 28 1 107 426 15 28 4.543
479 yolo_v3_tiny OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 203.84 57.67 0.416 7.280 490 28 1 490 28 5.129
480 yolo_v3_tiny OV-2023.0 core Intel® Core™ i7-8700T CPU-only 137.74 78.00 0.455 3.936 303 35 1 303 35 8.162
481 yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 180.44 92.86 0.370 5.155 488 35 1 488 35 6.283
482 yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 303.14 97.03 0.557 8.661 544 35 1 544 35 4.164
483 yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-13900K CPU-only 882.39 296.77 1.473 7.059 599 125 1 599 125 2.558
484 yolo_v3_tiny OV-2023.0 atom Intel® Processor N-200 7.82 4.15 0.041 1.304 193 6 1 193 6 136.62
485 yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 349.17 156.05 0.588 2.793 594 125 1 594 125 2.995
486 yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 106.71 64.03 0.429 1.503 249 71 1 249 71 9.391
487 yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 1052.16 339.30 0.335 5.158 3144 204 2 1572 102 2.514
488 yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 2932.78 914.37 0.173 7.153 16954 410 2 8477 205 1.216
489 yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 1010.00 323.69 0.504 4.040 2004 250 2 1002 125 2.623
490 yolo_v3_tiny OV-2023.0 core Intel® Core™ i7-11800H 448.62 139.59 1.031 9.969 435 45 1 435 45 2.61
491 yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 4584.21 1374.00 0.245 8.489 18718 540 2 9359 270 0.876
492 yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 13092.13 2107.19 0.385 18.703 34000 700 2 17000 350 1.143
493 yolo_v3_tiny OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 2217.64 704.05 0.975 7.392 2274 300 2 1137 150 1.319
494 yolo_v3_tiny OV-2023.0 accel Intel® Flex-170 3196.82 2123.72 1.661 21.312 1925 150 1 1925 150 4.692
495 yolo_v3_tiny OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only 290.98 151.90 86.09 2.719 19.398 107 15 1 107 15 13.63
496 yolo_v3_tiny OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 505.41 257.15 136.41 1.031 18.050 490 28 1 490 28 7.676
497 yolo_v3_tiny OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 616.60 331.25 206.56 0.885 13.702 697 45 1 697 45 6.288
498 yolo_v3_tiny OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 17.57 9.95 5.67 0.091 2.928 193 6 1 193 6 226.048
499 yolo_v3_tiny OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 547.67 291.75 171.00 1.286 19.560 426 28 1 426 28 7.089
500 yolo_v3_tiny OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 321.12 92.81 3.001 21.408 107 15 1 107 15
501 yolo_v3_tiny OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 324.93 98.38 0.663 11.605 490 28 1 490 28
502 yolo_v3_tiny OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 755.15 230.16 1.083 16.781 697 45 1 697 45
503 yolo_v3_tiny OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 24.02 7.84 0.124 4.003 193 6 1 193 6
504 yolo_v3_tiny OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 487.88 144.54 1.145 17.424 426 28 1 426 28
505 end_rec
506 begin_rec
507 yolo-v8n yolo_v8n OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 5.69 184.70 3.01 72.61 0.167 0.265 0.598 4.104 34 697 9.5 45 1 34 697 9.5 45 185.626 7.542
508 yolo-v8n yolo_v8n OV-2023.0 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 53.97 5.69 33.14 3.01 0.461 0.167 0.830 0.598 117 34 65 9.5 1 117 34 65 9.5 18.918 185.626
509 yolo-v8n yolo_v8n OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 81.11 24.68 47.46 9.60 0.379 0.231 2.317 1.645 214 107 35 15 1 214 107 35 15 16.114 40.111
510 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 244.02 53.97 96.78 33.14 0.742 0.461 1.952 0.830 329 117 125 65 1 329 117 125 65 6.96 18.918
511 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-10500TE CPU-only 84.64 81.11 51.15 47.46 0.430 0.379 1.302 2.317 197 214 65 35 1 197 214 65 35 11.916 16.114
512 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only Intel® Core™ i5-13600K CPU-only 106.29 244.02 39.77 96.78 0.250 0.742 3.796 1.952 426 329 28 125 1 426 329 28 125 10.673 6.96
513 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only Intel® Core™ i5-8500 CPU-only 76.65 84.64 29.15 51.15 0.156 0.430 2.738 1.302 490 197 28 65 1 490 197 28 65 188.956 11.917
514 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185G7 CPU-only 69.89 106.30 57.02 39.77 0.231 0.250 1.997 3.796 303 426 35 28 1 303 426 35 28 16.595 10.673
515 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1185GRE CPU-only 83.42 76.65 49.70 29.15 0.171 0.156 2.383 2.738 488 490 35 28 1 488 490 35 28 14.081 12.187
516 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i9-12900TE CPU-only Intel® Core™ i7-8700T CPU-only 132.88 69.89 51.98 42.39 0.244 0.231 3.796 1.997 544 303 35 1 544 303 35 10.104 16.596
517 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i9-10900TE CPU-only 379.01 83.42 160.41 49.70 0.633 0.171 3.032 2.383 599 488 125 35 1 599 488 125 35 5.511 13.027
518 yolo-v8n yolo_v8n OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900TE CPU-only 125.84 132.88 74.97 51.98 0.212 0.244 1.007 3.796 594 544 125 35 1 594 544 125 35 6.46 9.23
519 yolo-v8n yolo_v8n OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-13900K CPU-only 52.07 379.01 32.87 156.74 0.209 0.633 0.733 3.032 249 599 71 125 1 249 599 71 125 19.471 5.512
520 yolo-v8n yolo_v8n OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Processor N-200 449.63 3.25 175.44 1.94 0.143 0.017 2.204 0.541 3144 193 204 6 2 1 1572 193 102 6 8.25 315.715
521 yolo-v8n yolo_v8n OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® W1290P CPU-only 996.63 125.84 459.95 74.97 0.059 0.212 2.431 1.007 16954 594 410 125 2 1 8477 594 205 125 5.159 6.46
522 yolo-v8n yolo_v8n OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® E-2124G CPU-only 432.72 52.07 168.42 32.87 0.216 0.209 1.731 0.733 2004 249 250 71 2 1 1002 249 125 71 8.458 19.471
523 yolo-v8n yolo_v8n OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only Intel® Xeon® Gold 5218T CPU-only 1686.49 449.63 552.54 175.44 0.090 0.143 3.123 2.204 18718 3144 540 204 2 9359 1572 270 102 2.369 5.959
524 yolo-v8n yolo_v8n OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only Intel® Xeon® Platinum 8270 CPU-only 2714.73 996.63 1006.34 459.95 0.080 0.059 3.878 2.431 34000 16954 700 410 2 17000 8477 350 205 4.403 3.622
525 yolo-v8n yolo_v8n OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only Intel® Xeon® Silver 4216R CPU-only 846.47 432.72 341.19 168.42 0.372 0.216 2.822 1.731 2274 2004 300 250 2 1137 1002 150 125 3.308 6.229
526 yolo-v8n yolo_v8n OV-2023.0 core Intel® Core™ i9-12900HK CPU-only Intel® Core™ i7-11800H 184.70 194.10 72.61 74.94 0.265 0.446 4.104 4.313 697 435 45 1 697 435 45 7.542 5.995
527 yolo-v8n yolo_v8n OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Platinum 8380 CPU-only 24.68 1686.49 9.60 552.54 0.231 0.090 1.645 3.123 107 18718 15 540 1 2 107 9359 15 270 40.111 2.37
528 yolo-v8n yolo_v8n OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Platinum 8490H CPU-only 1205.32 2714.73 1210.94 1006.34 0.626 0.080 8.035 3.878 1925 34000 150 700 1 2 1925 17000 150 350 12.951 4.403
529 yolo-v8n yolo_v8n OV-2023.0 core-iGPU xeon Intel® Core™ i7-1185GRE iGPU-only Intel® Xeon® Silver 4316 CPU-only 154.20 846.47 106.82 341.19 0.315 0.372 5.507 2.822 490 2274 28 300 1 2 490 1137 28 150 24.829 3.309
530 yolo-v8n yolo_v8n OV-2023.0 core-iGPU accel Intel® Celeron™ 6305E GPU-only Intel® Flex-170 0.00 1205.32 82.53 1210.94 0.000 0.626 0.000 8.035 107 1925 15 150 1 107 1925 15 150 12.951
531 yolo-v8n yolo_v8n OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1185GRE CPU+iGPU Intel® Celeron™ 6305E GPU-only 116.95 126.20 82.53 45.54 48.62 0.239 1.179 4.177 8.413 490 107 28 15 1 490 107 28 15 31.597
532 yolo-v8n yolo_v8n OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+GPU Intel® Core™ i7-1185GRE iGPU-only 111.94 154.20 106.82 48.30 59.95 1.046 0.315 7.462 5.507 107 490 15 28 1 107 490 15 28 24.83
533 yolo_v8n OV-2023.0 core-iGPU Intel® Core™ i9-12900HK GPU-only 218.28 155.96 102.82 0.313 4.851 697 45 1 697 45 17.971
534 yolo_v8n OV-2023.0 core-iGPU Intel® Processor N200 GPU-only 8.78 5.75 3.36 0.045 1.463 193 6 1 193 6 454.508
535 yolo_v8n OV-2023.0 core-iGPU Intel® Core™ i7-1185G7 GPU-only 201.27 141.88 88.88 0.472 7.188 426 28 1 426 28 19.643
536 yolo_v8n OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E GPU-only 111.94 48.30 1.046 7.462 107 15 1 107 15
537 yolo_v8n OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 116.95 45.54 0.239 4.177 490 28 1 490 28
538 yolo_v8n OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900HK GPU-only 283.25 118.51 0.406 6.294 697 45 1 697 45
539 yolo_v8n OV-2023.0 core-CPU+iGPU Intel® Processor N200 GPU-only 10.11 4.49 0.052 1.685 193 6 1 193 6
540 yolo_v8n OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185G7 GPU-only 175.79 75.16 0.413 6.278 426 28 1 426 28
541 end_rec

View File

@ -166,12 +166,12 @@ or `create an account <https://www.intel.com/content/www/us/en/secure/forms/devc
Disclaimers
####################################
* Intel® Distribution of OpenVINO™ toolkit performance results are based on release 2023.0, as of June 01, 2023.
* Intel® Distribution of OpenVINO™ toolkit performance results are based on release 2023.0, as of July 07, 2023.
* OpenVINO Model Server performance results are based on release 2022.3, as of December 13, 2022.
* OpenVINO Model Server performance results are based on release 2023.0, as of June 01, 2023.
The results may not reflect all publicly available updates. Intel technologies features and benefits depend on system configuration
and may require enabled hardware, software, or service activation. Learn more at intel.com, or from the OEM or retailer.
and may require enabled hardware, software, or service activation. Learn more at intel.com, or from the OEM or retailer.
See configuration disclosure for details. No product can be absolutely secure.
Performance varies by use, configuration and other factors. Learn more at `www.intel.com/PerformanceIndex <https://www.intel.com/PerformanceIndex>`__.
@ -180,4 +180,3 @@ Intel optimizations, for Intel compilers or other products, may not optimize to
@endsphinxdirective