IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[DOCS] benchmark 23.0 update (#17789)

Browse Source
This commit is contained in:
Karol Blaszczak 2023-05-31 10:51:43 +02:00 committed by GitHub
parent dba5de6513
commit 4d2d58b647
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
34 changed files with 616 additions and 675 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

BIN
docs/_static/benchmarks_files/OV-2022.3-system-info-detailed.xlsx vendored
View File

Binary file not shown.

BIN
docs/_static/benchmarks_files/OV-2022.3-Performance-Data.xlsx → docs/_static/benchmarks_files/OV-2023.0-Performance-Data.xlsx vendored
View File

Binary file not shown.

BIN
docs/_static/benchmarks_files/OV-2023.0-Platform_list.pdf vendored Normal file
View File

Binary file not shown.

BIN
docs/_static/benchmarks_files/OV-2023.0-system-info-detailed.xlsx vendored Normal file
View File

Binary file not shown.

932
docs/_static/benchmarks_files/OV-benchmark-data.csv vendored
View File

@ -1,511 +1,421 @@
Network model,Release,IE-Type,Platform name,Throughput-INT8,Throughput-FP16,Throughput-FP32,Value,Efficiency,Price,TDP,Sockets,Price/socket,TDP/socket,Latency,,,
begin_rec,,,,,,,,,,,,,,,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,163.72,,57.83,0.273,1.310,$599 ,125,1,$599,125,15.53,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,56.07,,23.3,0.094,0.449,$599 ,125,1,$599,125,19.62,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,210.17,,85.83,0.351,1.681,$599 ,125,1,$599,125,,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,128.05,,45.94,0.389,1.024,$329 ,125,1,$329,125,12.71,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,53.03,,21.9,0.161,0.424,$329 ,125,1,$329,125,20.81,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,163.33,,64.74,0.496,1.307,$329 ,125,1,$329,125,,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,96.06,,35.627,0.146,0.582,$658 ,165,1,$658 ,165,17.1432,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,53.093,,22.253,0.081,0.322,$658 ,165,1,$658 ,165,22.0002,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,108.306,,44.797,0.165,0.656,$658 ,165,1,$658 ,165,,,,
bert-base-cased ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,2.763,,1.332,0.081,0.291,$34 ,9.5,1,$34 ,9.5,350.2746,,,
bert-base-cased ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,5.694,,2.002,0.085,0.475,$67 ,12,1,$67 ,12,183.1711,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,16.11,,10.009,0.240,1.343,$67 ,12,1,$67 ,12,79.7607,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,21.128,,11.81,0.315,1.761,$67 ,12,1,$67 ,12,,,,
bert-base-cased ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,14.212,,4.255,0.120,0.947,$118 ,15,1,$118 ,15,72.6516,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,18.983,,8.696,0.161,1.266,$118 ,15,1,$118 ,15,62.9729,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,30.866,,12.087,0.262,2.058,$118 ,15,1,$118 ,15,,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,645.77,,213.877,0.138,1.745,"$4,678 ",370,2,"$2,339 ",185,6.7612,,,
bert-base-cased ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,23.721,,14.457,0.203,0.365,$117 ,65,1,$117 ,65,44.0371,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,30.141,,16.38,0.141,0.861,$214 ,35,1,$214 ,35,46.6064,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,30.541,,19.319,0.159,0.470,$192 ,65,1,$192 ,65,27.8871,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,41.504,,22.75,0.137,1.186,$303 ,35,1,$303 ,35,27.974,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,32.073,,16.558,0.066,0.916,$488 ,35,1,$488 ,35,39.7617,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,69.053,,40.243,0.116,0.552,$594 ,125,1,$594 ,125,18.309,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,23.402,,14.614,0.094,0.330,$249 ,71,1,$249 ,71,44.8984,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,266.949,,79.033,0.085,1.271,"$3,144 ",210,2,"$1,572 ",105,12.4065,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,2090.76,1372.2,1368.68,0.292,4.646,"$7,166 ",450,2,"$3,583 ",225,4.61,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,682.593,,225.713,0.040,1.665,"$16,954 ",410,2,"$8,477 ",205,6.9035,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,256.994,,75.502,0.128,1.028,"$2,004 ",250,2,"$1,002 ",125,13.0382,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,64.632,,18.394,0.138,2.308,$469 ,28,1,$469 ,28,17.638,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,95.656,,44.056,0.204,3.416,$469 ,28,1,$469 ,28,14.1005,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,128.005,,50.592,0.273,4.572,$469 ,28,1,$469 ,28,,,,
bert-base-cased ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,906.3,348.52,,0.471,6.042,"$1,925 ",150,1,"$1,925 ",150,7.381,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,51.72,,17.6,0.086,0.414,$599 ,125,1,$599 ,125,49.13,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,19.05,,6.88,0.032,0.152,$599 ,125,1,$599 ,125,55.82,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,53,,19.95,0.088,0.424,$599 ,125,1,$599 ,125,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,35.31,,11.04,0.107,0.282,$329 ,125,1,$329 ,125,41.56,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,17.93,,6.46,0.054,0.143,$329 ,125,1,$329 ,125,59.37,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,43.42,,16.19,0.132,0.347,$329 ,125,1,$329 ,125,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,7.714,,3.093,0.012,0.047,$658 ,165,1,$658 ,165,155.3633,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,5.617,,1.978,0.009,0.034,$658 ,165,1,$658 ,165,181.8303,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,10.602,,3.753,0.016,0.064,$658 ,165,1,$658 ,165,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.272,,0.125,0.008,0.029,$34 ,9.5,1,$34 ,9.5,3861.0657,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.488,,0.188,0.007,0.041,$67 ,12,1,$67 ,12,2090.8266,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.395,,0.774,0.021,0.116,$67 ,12,1,$67 ,12,727.6781,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,1.827,,0.845,0.027,0.152,$67 ,12,1,$67 ,12,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.199,,0.377,0.010,0.080,$118 ,15,1,$118 ,15,831.301,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.051,,0.766,0.017,0.137,$118 ,15,1,$118 ,15,494.5363,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,3.118,,1.127,0.026,0.208,$118 ,15,1,$118 ,15,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,43.436,,17.379,0.009,0.117,"$4,678 ",370,2,"$2,339 ",185,52.2862,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.067,,1.278,0.018,0.032,$117 ,65,1,$117 ,65,495.0786,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,2.619,,1.536,0.012,0.075,$214 ,35,1,$214 ,35,502.3687,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,2.72,,1.679,0.014,0.042,$192 ,65,1,$192 ,65,320.168,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,3.625,,2.11,0.012,0.104,$303 ,35,1,$303 ,35,309.2848,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.906,,1.693,0.006,0.083,$488 ,35,1,$488 ,35,386.4947,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,4.801,,2.729,0.008,0.038,$594 ,125,1,$594 ,125,200.0794,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.098,,1.32,0.008,0.030,$249 ,71,1,$249 ,71,492.0938,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,21.062,,7.021,0.007,0.100,"$3,144 ",210,2,"$1,572 ",105,101.4694,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,651.95,378.57,384.02,0.091,1.449,"$7,166 ",450,2,"$3,583 ",225,12.87,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,46.064,,19.051,0.003,0.112,"$16,954 ",410,2,"$8,477 ",205,49.4869,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,20.014,,6.726,0.010,0.080,"$2,004 ",250,2,"$1,002 ",125,105.9423,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,5.192,,1.626,0.011,0.185,$469 ,28,1,$469 ,28,203.6311,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,10.476,,3.914,0.022,0.374,$469 ,28,1,$469 ,28,95.6598,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,11.75,,4.168,0.025,0.420,$469 ,28,1,$469 ,28,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,74.47,25.77,,0.039,0.496,"$1,925 ",150,1,"$1,925 ",150,19.768,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,184.93,,63.79,0.309,1.479,$599 ,125,1,$599 ,125,10.31,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,69.31,,22.67,0.116,0.554,$599 ,125,1,$599 ,125,15.02,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,191.48,,62.99,0.320,1.532,$599 ,125,1,$599 ,125,,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,139.02,,48.48,0.423,1.112,$329 ,125,1,$329 ,125,10.48,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,65.55,,21.24,0.199,0.524,$329 ,125,1,$329 ,125,16.12,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,154.19,,52.87,0.469,1.234,$329 ,125,1,$329 ,125,,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,99.078,,36.552,0.151,0.600,$658 ,165,1,$658 ,165,11.269,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,57.707,,13.789,0.088,0.350,$658 ,165,1,$658 ,165,16.263,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,115.59,,39.82,0.176,0.701,$658 ,165,1,$658 ,165,,,,
deeplabv3,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.327,,1.496,0.098,0.350,$34 ,9.5,1,$34 ,9.5,308.0916,,,
deeplabv3,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,6.07,,3.041,0.091,0.506,$67 ,12,1,$67 ,12,166.5404,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,5.196,0.000,0.000,$67 ,12,1,$67 ,12,217.0439,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,9.877,,7.145,0.147,0.823,$67 ,12,1,$67 ,12,,,,
deeplabv3,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,13.516,,4.681,0.115,0.901,$118 ,15,1,$118 ,15,74.1061,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,22.35,,4.635,0.189,1.490,$118 ,15,1,$118 ,15,42.9657,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,34.576,,8.955,0.293,2.305,$118 ,15,1,$118 ,15,,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,559.145,,134.159,0.120,1.511,"$4,678 ",370,2,"$2,339 ",185,5.356,,,
deeplabv3,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,27.171,,15.947,0.232,0.418,$117 ,65,1,$117 ,65,36.6584,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,34.907,,16.72,0.163,0.997,$214 ,35,1,$214 ,35,38.8986,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,35.07,,20.497,0.183,0.540,$192 ,65,1,$192 ,65,22.1865,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,47.647,,23.747,0.157,1.361,$303 ,35,1,$303 ,35,22.628,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,36.559,,18.235,0.075,1.045,$488 ,35,1,$488 ,35,27.138,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,79.42,,21.03,0.134,0.635,$594 ,125,1,$594 ,125,12.8397,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,26.173,,16.906,0.105,0.369,$249 ,71,1,$249 ,71,37.9245,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,248.049,,81.667,0.079,1.181,"$3,144 ",210,2,"$1,572 ",105,8.9485,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,1139.5,702.28,699.04,0.159,2.532,"$7,166 ",450,2,"$3,583 ",225,2.47,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,632.113,,168.65,0.037,1.542,"$16,954 ",410,2,"$8,477 ",205,4.0073,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,241.703,,78.963,0.121,0.967,"$2,004 ",250,2,"$1,002 ",125,9.356,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,64.13,,18.519,0.137,2.290,$469 ,28,1,$469 ,28,16.6586,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,104.926,,24.592,0.224,3.747,$469 ,28,1,$469 ,28,9.1435,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,121.441,,30.498,0.259,4.337,$469 ,28,1,$469 ,28,,,,
deeplabv3,OV-2022.3-8991,accel,Intel® Flex-170 GPU,882.04,98.95,,0.458,5.88,"$1,925 ",150,1,"$1,925 ",150,2.674,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,777.86,,284.56,1.299,6.223,$599 ,125,1,$599 ,125,3.26,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,195.3,,66.46,0.326,1.562,$599 ,125,1,$599 ,125,6.8,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,899.5,,293.29,1.502,7.196,$599 ,125,1,$599 ,125,,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,612.99,,184.9,1.863,4.904,$329 ,125,1,$329 ,125,3.12,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,178.37,,62.69,0.542,1.427,$329 ,125,1,$329 ,125,8.37,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,707.99,,207.12,2.152,5.664,$329 ,125,1,$329 ,125,,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,457.193,,165.166,0.695,2.771,$658 ,165,1,$658 ,165,3.141,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,203.417,,68.438,0.309,1.233,$658 ,165,1,$658 ,165,6.6728,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,575.442,,179.858,0.875,3.488,$658 ,165,1,$658 ,165,,,,
densenet-121,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,13.344,,5.882,0.392,1.405,$34 ,9.5,1,$34 ,9.5,80.7014,,,
densenet-121,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,24.172,,10.554,0.361,2.014,$67 ,12,1,$67 ,12,43.668,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,30.615,0.000,0.000,$67 ,12,1,$67 ,12,30.0241,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,39.365,,38.926,0.588,3.280,$67 ,12,1,$67 ,12,,,,
densenet-121,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,58.965,,15.713,0.500,3.931,$118 ,15,1,$118 ,15,18.3425,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,86.162,,25.34,0.730,5.744,$118 ,15,1,$118 ,15,20.7907,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,140.891,,39.929,1.194,9.393,$118 ,15,1,$118 ,15,,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,3094.742,,701.32,0.662,8.364,"$4,678 ",370,2,"$2,339 ",185,2.131,,,
densenet-121,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,120.121,,66.624,1.027,1.848,$117 ,65,1,$117 ,65,9.3755,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,142.623,,80.872,0.666,4.075,$214 ,35,1,$214 ,35,10.2536,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,149.112,,85.051,0.777,2.294,$192 ,65,1,$192 ,65,6.0817,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,194.559,,111.988,0.642,5.559,$303 ,35,1,$303 ,35,6.1906,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,146.463,,69.186,0.300,4.185,$488 ,35,1,$488 ,35,8.6496,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,360.501,,182.543,0.607,2.884,$594 ,125,1,$594 ,125,3.6046,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,114.844,,67.188,0.461,1.618,$249 ,71,1,$249 ,71,9.7609,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,1116.372,,295.952,0.355,5.316,"$3,144 ",210,2,"$1,572 ",105,3.9606,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,8279.14,4856.54,4862.51,1.155,18.398,"$7,166 ",450,2,"$3,583 ",225,2.39,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,3155.106,,815.725,0.186,7.695,"$16,954 ",410,2,"$8,477 ",205,2.8831,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1064.824,,283.423,0.531,4.259,"$2,004 ",250,2,"$1,002 ",125,4.0689,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,265.167,,74.501,0.565,9.470,$469 ,28,1,$469 ,28,4.7413,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,391.185,,123.519,0.834,13.971,$469 ,28,1,$469 ,28,6.5259,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,526.12,,150.35,1.122,18.790,$469 ,28,1,$469 ,28,,,,
densenet-121,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3440.18,1178.68,,1.787,22.935,"$1,925 ",150,1,"$1,925 ",150,3.302,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,209.26,,106.11,0.349,1.674,$599 ,125,1,$599 ,125,10.36,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,82.04,,47.85,0.137,0.656,$599 ,125,1,$599 ,125,22.35,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,197.85,,108.3,0.330,1.583,$599 ,125,1,$599 ,125,,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,155.65,,90.91,0.473,1.245,$329 ,125,1,$329 ,125,9.92,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,77.28,,44.91,0.235,0.618,$329 ,125,1,$329 ,125,22.93,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,172.54,,95.94,0.524,1.380,$329 ,125,1,$329 ,125,,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,112.297,,64.06,0.171,0.681,$658 ,165,1,$658 ,165,11.8265,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,73.766,,38.742,0.112,0.447,$658 ,165,1,$658 ,165,21.403,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,128.735,,76.62,0.196,0.780,$658 ,165,1,$658 ,165,,,,
efficientdet-d0,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.812,,2.565,0.112,0.401,$34 ,9.5,1,$34 ,9.5,274.5947,,,
efficientdet-d0,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,7.248,,5.17,0.108,0.604,$67 ,12,1,$67 ,12,143.7999,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,22.697,,15.635,0.339,1.891,$67 ,12,1,$67 ,12,59.0651,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,26.855,,17.296,0.401,2.238,$67 ,12,1,$67 ,12,,,,
efficientdet-d0,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,15.949,,10.417,0.135,1.063,$118 ,15,1,$118 ,15,62.2765,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,25.936,,14.073,0.220,1.729,$118 ,15,1,$118 ,15,54.0166,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,32.767,,20.733,0.278,2.184,$118 ,15,1,$118 ,15,,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,424.388,,256.503,0.091,1.147,"$4,678 ",370,2,"$2,339 ",185,,,,
efficientdet-d0,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,36.666,,24.041,0.313,0.564,$117 ,65,1,$117 ,65,30.2521,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,45.331,,26.92,0.212,1.295,$214 ,35,1,$214 ,35,32.8946,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,44.921,,32.357,0.234,0.691,$192 ,65,1,$192 ,65,19.7048,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,62.749,,37.807,0.207,1.793,$303 ,35,1,$303 ,35,19.901,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,50.35,,29.935,0.103,1.439,$488 ,35,1,$488 ,35,24.2916,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,94.981,,36.434,0.160,0.760,$594 ,125,1,$594 ,125,12.658,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,35.831,,27.306,0.144,0.505,$249 ,71,1,$249 ,71,30.9469,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,239.06,,161.224,0.076,1.138,"$3,144 ",210,2,"$1,572 ",105,13.9735,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,875.53,495.04,492.93,0.122,1.946,"$7,166 ",450,2,"$3,583 ",225,5.07,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,471.02,,300.291,0.028,1.149,"$16,954 ",410,2,"$8,477 ",205,9.3866,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,231.873,,156.285,0.116,0.927,"$2,004 ",250,2,"$1,002 ",125,14.1605,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,71.482,,41.123,0.152,2.553,$469 ,28,1,$469 ,28,16.6952,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,92.52,,50.538,0.197,3.304,$469 ,28,1,$469 ,28,17.295,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,107.688,,56.901,0.230,3.846,$469 ,28,1,$469 ,28,,,,
efficientdet-d0,OV-2022.3-8991,accel,Intel® Flex-170 GPU,463.67,295.13,,0.241,3.091,"$1,925 ",150,1,"$1,925 ",150,5.603,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,5.94,,2.41,0.010,0.048,$599 ,125,1,$599 ,125,270.57,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,2.3,,0.71,0.004,0.018,$599 ,125,1,$599 ,125,437.94,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,6.45,,2.25,0.011,0.052,$599 ,125,1,$599 ,125,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,4.55,,1.88,0.014,0.036,$329 ,125,1,$329 ,125,310.58,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,2.17,,0.67,0.007,0.017,$329 ,125,1,$329 ,125,465.03,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,5.3,,2.01,0.016,0.042,$329 ,125,1,$329 ,125,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,12.921,,4.016,0.020,0.078,$658 ,165,1,$658 ,165,89.8929,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,6.802,,1.82,0.010,0.041,$658 ,165,1,$658 ,165,149.7396,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,15.679,,4.499,0.024,0.095,$658 ,165,1,$658 ,165,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.32,,0.131,0.009,0.034,$34 ,9.5,1,$34 ,9.5,3206.1652,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.592,,0.242,0.009,0.049,$67 ,12,1,$67 ,12,1727.27,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.301,,0.728,0.019,0.108,$67 ,12,1,$67 ,12,776.0692,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,1.683,,0.865,0.025,0.140,$67 ,12,1,$67 ,12,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.563,,0.417,0.013,0.104,$118 ,15,1,$118 ,15,640.0005,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.616,,0.725,0.022,0.174,$118 ,15,1,$118 ,15,389.3563,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,4.056,,1.107,0.034,0.270,$118 ,15,1,$118 ,15,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,74.93,,19.965,0.016,0.203,"$4,678 ",370,2,"$2,339 ",185,65.5753,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.988,,1.473,0.026,0.046,$117 ,65,1,$117 ,65,340.7313,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,3.633,,1.926,0.017,0.104,$214 ,35,1,$214 ,35,430.1967,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,3.852,,1.982,0.020,0.059,$192 ,65,1,$192 ,65,241.5513,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,4.999,,2.648,0.016,0.143,$303 ,35,1,$303 ,35,260.2284,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,3.71,,2.005,0.008,0.106,$488 ,35,1,$488 ,35,280.1493,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,8.977,,4.542,0.015,0.072,$594 ,125,1,$594 ,125,137.1747,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.867,,1.464,0.012,0.040,$249 ,71,1,$249 ,71,353.2042,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,29.332,,8.19,0.009,0.140,"$3,144 ",210,2,"$1,572 ",105,78.1722,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,19.71,18.01,18.15,0.003,0.044,"$7,166 ",450,2,"$3,583 ",225,129.2,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,85.213,,22.066,0.005,0.208,"$16,954 ",410,2,"$8,477 ",205,30.4317,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,27.847,,7.786,0.014,0.111,"$2,004 ",250,2,"$1,002 ",125,78.6604,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,7.027,,1.855,0.015,0.251,$469 ,28,1,$469 ,28,151.8783,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,13.823,,3.545,0.029,0.494,$469 ,28,1,$469 ,28,70.7933,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,16.898,,4.191,0.036,0.604,$469 ,28,1,$469 ,28,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,accel,Intel® Flex-170 GPU,216.3,23.42,,0.112,1.442,"$1,925 ",150,1,"$1,925 ",150,9.137,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,219.06,,71.15,0.366,1.752,$599 ,125,1,$599 ,125,10.19,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,65.91,,18.1,0.110,0.527,$599 ,125,1,$599 ,125,16.55,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,279.58,,78.65,0.467,2.237,$599 ,125,1,$599 ,125,,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,171.19,,45.8,0.520,1.370,$329 ,125,1,$329 ,125,9.14,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,62.45,,17.02,0.190,0.500,$329 ,125,1,$329 ,125,17.48,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,219.02,,52.56,0.666,1.752,$329 ,125,1,$329 ,125,,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,121.813,,39.391,0.185,0.738,$658 ,165,1,$658 ,165,11.0425,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,71.229,,17.755,0.108,0.432,$658 ,165,1,$658 ,165,19.7132,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,175.049,,44.894,0.266,1.061,$658 ,165,1,$658 ,165,,,,
Inception-V4,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.12,,1.344,0.092,0.328,$34 ,9.5,1,$34 ,9.5,335.3712,,,
Inception-V4,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,5.677,,2.364,0.085,0.473,$67 ,12,1,$67 ,12,181.8897,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,17.009,,8.302,0.254,1.417,$67 ,12,1,$67 ,12,78.0548,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,21.713,,10.37,0.324,1.809,$67 ,12,1,$67 ,12,,,,
Inception-V4,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,15.576,,4.073,0.132,1.038,$118 ,15,1,$118 ,15,65.7272,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,28.105,,6.681,0.238,1.874,$118 ,15,1,$118 ,15,46.2616,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,41.918,,10.163,0.355,2.795,$118 ,15,1,$118 ,15,,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,881.403,,205.296,0.188,2.382,"$4,678 ",370,2,"$2,339 ",185,4.7029,,,
Inception-V4,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,30.004,,15.51,0.256,0.462,$117 ,65,1,$117 ,65,35.0513,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,35.882,,19.222,0.168,1.025,$214 ,35,1,$214 ,35,37.6472,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,37.987,,19.998,0.198,0.584,$192 ,65,1,$192 ,65,21.5144,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,48.903,,26.356,0.161,1.397,$303 ,35,1,$303 ,35,22.2402,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,37.301,,19.475,0.076,1.066,$488 ,35,1,$488 ,35,28.572,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,92.646,,44.966,0.156,0.741,$594 ,125,1,$594 ,125,12.3153,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,28.537,,15.13,0.115,0.402,$249 ,71,1,$249 ,71,36.8888,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,301.215,,77.005,0.096,1.434,"$3,144 ",210,2,"$1,572 ",105,10.5711,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,3406.7,1879.09,1867.99,0.475,7.570,"$7,166 ",450,2,"$3,583 ",225,3.23,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,937.139,,225.776,0.055,2.286,"$16,954 ",410,2,"$8,477 ",205,5.6984,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,287.767,,73.617,0.144,1.151,"$2,004 ",250,2,"$1,002 ",125,11.1114,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,71.295,,18.482,0.152,2.546,$469 ,28,1,$469 ,28,15.8294,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,158.282,,36.884,0.337,5.653,$469 ,28,1,$469 ,28,10.6245,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,182.132,,44.198,0.388,6.505,$469 ,28,1,$469 ,28,,,,
Inception-V4,OV-2022.3-8991,accel,Intel® Flex-170 GPU,2986.91,298.6,,1.552,19.913,"$1,925 ",150,1,"$1,925 ",150,3.968,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,1754.44,,664.82,2.929,14.036,$599 ,125,1,$599 ,125,1.4,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,528.03,,168.57,0.882,4.224,$599 ,125,1,$599 ,125,2.35,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,1568.83,,665.79,2.619,12.551,$599 ,125,1,$599 ,125,,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,1240.01,,437.11,3.769,9.920,$329 ,125,1,$329 ,125,1.47,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,493.18,,157.94,1.499,3.945,$329 ,125,1,$329 ,125,2.43,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,1063.27,,454.21,3.232,8.506,$329 ,125,1,$329 ,125,,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,1054.462,,346.546,1.603,6.391,$658 ,165,1,$658 ,165,1.4898,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,493.088,,145.503,0.749,2.988,$658 ,165,1,$658 ,165,2.472,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,1056.241,,361.472,1.605,6.401,$658 ,165,1,$658 ,165,,,,
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,28.032,,12.691,0.824,2.951,$34 ,9.5,1,$34 ,9.5,38.1991,,,
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,50.352,,23.675,0.752,4.196,$67 ,12,1,$67 ,12,20.8993,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,100.377,,60.647,1.498,8.365,$67 ,12,1,$67 ,12,11.6812,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,148.458,,79.575,2.216,12.372,$67 ,12,1,$67 ,12,,,,
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,123.806,,38.981,1.049,8.254,$118 ,15,1,$118 ,15,8.4121,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,168.473,,53.272,1.428,11.232,$118 ,15,1,$118 ,15,7.8961,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,238.511,,83.721,2.021,15.901,$118 ,15,1,$118 ,15,,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,6730.68,,1634.937,1.439,18.191,"$4,678 ",370,2,"$2,339 ",185,0.7265,,,
mobilenet-ssd ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,244.598,,140.009,2.091,3.763,$117 ,65,1,$117 ,65,4.4481,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,303.938,,173.562,1.420,8.684,$214 ,35,1,$214 ,35,4.7946,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,304.802,,185.045,1.588,4.689,$192 ,65,1,$192 ,65,2.8007,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,412.261,,241.37,1.361,11.779,$303 ,35,1,$303 ,35,2.8749,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,315.107,,152.342,0.646,9.003,$488 ,35,1,$488 ,35,3.5896,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,774.346,,345.309,1.304,6.195,$594 ,125,1,$594 ,125,1.5452,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,233.43,,147.098,0.937,3.288,$249 ,71,1,$249 ,71,4.5879,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,2331.207,,691.743,0.741,11.101,"$3,144 ",210,2,"$1,572 ",105,1.4852,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,16445.75,8733.64,8626.42,2.295,36.546,"$7,166 ",450,2,"$3,583 ",225,0.65,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,6691.915,,1796.357,0.395,16.322,"$16,954 ",410,2,"$8,477 ",205,1.0518,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,2225.935,,667.692,1.111,8.904,"$2,004 ",250,2,"$1,002 ",125,1.5444,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,579.307,,166.959,1.235,20.690,$469 ,28,1,$469 ,28,2.0215,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,582.636,,243.945,1.242,20.808,$469 ,28,1,$469 ,28,2.548,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,744.231,,292.071,1.587,26.580,$469 ,28,1,$469 ,28,,,,
mobilenet-ssd ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3548.98,1412.68,,1.844,23.66,"$1,925 ",150,1,"$1,925 ",150,1.344,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,4041.77,,2123.33,6.748,32.334,$599 ,125,1,$599 ,125,0.66,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,978.61,,424.34,1.634,7.829,$599 ,125,1,$599 ,125,1.21,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,4630.44,,1944.62,7.730,37.044,$599 ,125,1,$599 ,125,,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,3306.92,,1403.57,10.051,26.455,$329 ,125,1,$329 ,125,0.65,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,919.85,,384.42,2.796,7.359,$329 ,125,1,$329 ,125,1.36,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,3556.06,,1332.32,10.809,28.448,$329 ,125,1,$329 ,125,,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,2446.221,,1003.129,3.718,14.826,$658 ,165,1,$658 ,165,0.7182,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,1265.969,,389.894,1.924,7.673,$658 ,165,1,$658 ,165,1.3894,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,2680.458,,1013.049,4.074,16.245,$658 ,165,1,$658 ,165,,,,
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,81.572,,45.013,2.399,8.587,$34 ,9.5,1,$34 ,9.5,13.4692,,,
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,143.134,,81.991,2.136,11.928,$67 ,12,1,$67 ,12,7.609,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,164.945,0.000,0.000,$67 ,12,1,$67 ,12,7.0306,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,227.898,,202.181,3.401,18.992,$67 ,12,1,$67 ,12,,,,
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,316.763,,124.654,2.684,21.118,$118 ,15,1,$118 ,15,3.391,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,525.084,,141.61,4.450,35.006,$118 ,15,1,$118 ,15,4.9197,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,807.397,,255.964,6.842,53.826,$118 ,15,1,$118 ,15,,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,14679.84,,4065.139,3.138,39.675,"$4,678 ",370,2,"$2,339 ",185,0.4828,,,
mobilenet-v2 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,619.507,,452.366,5.295,9.531,$117 ,65,1,$117 ,65,1.8067,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,806.314,,441.904,3.768,23.038,$214 ,35,1,$214 ,35,2.1078,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,766.072,,558.975,3.990,11.786,$192 ,65,1,$192 ,65,1.2307,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,1081.253,,664.108,3.568,30.893,$303 ,35,1,$303 ,35,1.2788,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,825.071,,413.091,1.691,23.573,$488 ,35,1,$488 ,35,1.6818,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,2067.162,,868.25,3.480,16.537,$594 ,125,1,$594 ,125,0.7363,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,594.283,,479.567,2.387,8.370,$249 ,71,1,$249 ,71,1.8531,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,5882.455,,1895.498,1.871,28.012,"$3,144 ",210,2,"$1,572 ",105,1.3871,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,28383.76,16212.74,16065.38,3.961,63.075,"$7,166 ",450,2,"$3,583 ",225,0.55,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,15616.083,,4308.927,0.921,38.088,"$16,954 ",410,2,"$8,477 ",205,0.8685,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,5616.283,,1835.686,2.803,22.465,"$2,004 ",250,2,"$1,002 ",125,1.404,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,1463.21,,538.597,3.120,52.258,$469 ,28,1,$469 ,28,0.8864,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,2076.015,,544.641,4.426,74.143,$469 ,28,1,$469 ,28,1.7212,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,2677.374,,698.942,5.709,95.621,$469 ,28,1,$469 ,28,,,,
mobilenet-v2 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,18371.95,4738.33,,9.544,122.48,"$1,925 ",150,1,"$1,925 ",150,1.15,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,1495.77,,415.82,2.497,11.966,$599 ,125,1,$599 ,125,1.38,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,497.54,,150.99,0.831,3.980,$599 ,125,1,$599 ,125,2.19,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,1821.4,,615.14,3.041,14.571,$599 ,125,1,$599 ,125,,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,1169.04,,336.09,3.553,9.352,$329 ,125,1,$329 ,125,1.5,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,467.43,,141.76,1.421,3.739,$329 ,125,1,$329 ,125,2.36,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,1443.42,,445.25,4.387,11.547,$329 ,125,1,$329 ,125,,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,804.771,,212.574,1.223,4.877,$658 ,165,1,$658 ,165,1.3886,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,491.337,,146.839,0.747,2.978,$658 ,165,1,$658 ,165,2.2655,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,1180.984,,365.777,1.795,7.157,$658 ,165,1,$658 ,165,,,,
resnet-18 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,22.96,,9.564,0.675,2.417,$34 ,9.5,1,$34 ,9.5,44.5491,,,
resnet-18 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,40.944,,16.158,0.611,3.412,$67 ,12,1,$67 ,12,25.1377,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,161.381,,60.863,2.409,13.448,$67 ,12,1,$67 ,12,10.983,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,197.477,,73.927,2.947,16.456,$67 ,12,1,$67 ,12,,,,
resnet-18 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,105.574,,28.914,0.895,7.038,$118 ,15,1,$118 ,15,9.6165,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,194.694,,55.341,1.650,12.980,$118 ,15,1,$118 ,15,6.643,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,291.441,,82.105,2.470,19.429,$118 ,15,1,$118 ,15,,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,5761.961,,1431.864,1.232,15.573,"$4,678 ",370,2,"$2,339 ",185,0.6512,,,
resnet-18 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,208.65,,103.699,1.783,3.210,$117 ,65,1,$117 ,65,5.0231,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,252.987,,127.448,1.182,7.228,$214 ,35,1,$214 ,35,5.2921,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,262.785,,134.002,1.369,4.043,$192 ,65,1,$192 ,65,3.0597,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,344.219,,175.433,1.136,9.835,$303 ,35,1,$303 ,35,3.1665,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,265.351,,130.166,0.544,7.581,$488 ,35,1,$488 ,35,4.0471,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,654.533,,307.741,1.102,5.236,$594 ,125,1,$594 ,125,1.6723,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,198.189,,101.399,0.796,2.791,$249 ,71,1,$249 ,71,5.2039,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,2017.368,,547.47,0.642,9.607,"$3,144 ",210,2,"$1,572 ",105,1.2913,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,27331.02,16095.24,16009.04,3.814,60.736,"$7,166 ",450,2,"$3,583 ",225,0.38,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,6320.391,,1582.817,0.373,15.416,"$16,954 ",410,2,"$8,477 ",205,0.667,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1940.935,,522.654,0.969,7.764,"$2,004 ",250,2,"$1,002 ",125,1.3451,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,480.992,,126.244,1.026,17.178,$469 ,28,1,$469 ,28,2.242,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,1061.591,,297.705,2.264,37.914,$469 ,28,1,$469 ,28,1.793,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,1237.94,,342.513,2.640,44.212,$469 ,28,1,$469 ,28,,,,
resnet-18 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,27454.08,2264.67,,14.262,183.027,"$1,925 ",150,1,"$1,925 ",150,0.946,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,729.93,,240.59,1.219,5.839,$599 ,125,1,$599 ,125,2.91,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,238.44,,68.18,0.398,1.908,$599 ,125,1,$599 ,125,4.74,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,895.28,,255.91,1.495,7.162,$599 ,125,1,$599 ,125,,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,576.86,,153.71,1.753,4.615,$329 ,125,1,$329 ,125,3.04,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,216.97,,64.36,0.659,1.736,$329 ,125,1,$329 ,125,5.3,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,717.91,,188.59,2.182,5.743,$329 ,125,1,$329 ,125,,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,400.118,,133.834,0.608,2.425,$658 ,165,1,$658 ,165,3.0384,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,229.863,,66.122,0.349,1.393,$658 ,165,1,$658 ,165,5.2538,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,574.341,,155.749,0.873,3.481,$658 ,165,1,$658 ,165,,,,
resnet-50,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,11.094,,4.516,0.326,1.168,$34 ,9.5,1,$34 ,9.5,92.6182,,,
resnet-50,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,20.114,,8.254,0.300,1.676,$67 ,12,1,$67 ,12,51.0598,,,````
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,66.119,,29.408,0.987,5.510,$67 ,12,1,$67 ,12,21.6857,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,82.95,,35.81,1.238,6.913,$67 ,12,1,$67 ,12,,,,
resnet-50,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,52.004,,14.152,0.441,3.467,$118 ,15,1,$118 ,15,19.6053,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,90.685,,24.633,0.769,6.046,$118 ,15,1,$118 ,15,14.6415,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,140.062,,37.864,1.187,9.337,$118 ,15,1,$118 ,15,-,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,2793.997,,691.079,0.597,7.551,"$4,678 ",370,2,"$2,339 ",185,1.3288,,,
resnet-50,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,102.328,,52.896,0.875,1.574,$117 ,65,1,$117 ,65,10.4475,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,123.574,,63.836,0.577,3.531,$214 ,35,1,$214 ,35,11.6252,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,129.174,,68.242,0.673,1.987,$192 ,65,1,$192 ,65,6.8498,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,168.016,,88.675,0.555,4.800,$303 ,35,1,$303 ,35,6.9723,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,129.371,,56.366,0.265,3.696,$488 ,35,1,$488 ,35,8.7659,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,317.744,,149.441,0.535,2.542,$594 ,125,1,$594 ,125,3.6469,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,97.606,,52.17,0.392,1.375,$249 ,71,1,$249 ,71,10.851,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,980.813,,268.009,0.312,4.671,"$3,144 ",210,2,"$1,572 ",105,2.9838,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,2905.803,,748.583,0.405,6.457,"$7,166 ",450,2,"$3,583 ",225,1.475,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,11359.88,5494.15,5497.22,0.670,27.707,"$16,954 ",410,2,"$8,477 ",205,0.94,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,937.572,,255.866,0.468,3.750,"$2,004 ",250,2,"$1,002 ",125,3.0985,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,235.061,,63.241,0.501,8.395,$469 ,28,1,$469 ,28,4.7975,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,504.247,,125.407,1.075,18.009,$469 ,28,1,$469 ,28,4.7975,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,595.133,,150.024,1.269,21.255,$469 ,28,1,$469 ,28,4.7975,,,
resnet-50,OV-2022.3-8991,accel,Intel® Flex-170 GPU,10810.92,1005.16,,5.616,72.073,"$1,925 ",150,1,"$1,925 ",150,1.624,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,11.75,,4.24,0.020,0.094,$599 ,125,1,$599 ,125,162.07,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,4.5,,1.45,0.008,0.036,$599 ,125,1,$599 ,125,226.99,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,11.63,,4.24,0.019,0.093,$599 ,125,1,$599 ,125,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,8.21,,2.7,0.025,0.066,$329 ,125,1,$329 ,125,147.53,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,4.22,,1.36,0.013,0.034,$329 ,125,1,$329 ,125,241.92,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,8,,2.7,0.024,0.064,$329 ,125,1,$329 ,125,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,6.712,,2.394,0.010,0.041,$658 ,165,1,$658 ,165,175.7493,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,4.228,,1.262,0.006,0.026,$658 ,165,1,$658 ,165,241.7838,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,6.666,,2.393,0.010,0.040,$658 ,165,1,$658 ,165,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.171,,0.081,0.005,0.018,$34 ,9.5,1,$34 ,9.5,5985.7525,,,
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.31,,0.133,0.005,0.026,$67 ,12,1,$67 ,12,3246.0878,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,0.965,,0.615,0.014,0.080,$67 ,12,1,$67 ,12,1053.0078,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,0.31,,0.133,0.005,0.026,$67 ,12,1,$67 ,12,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,0.806,,0.23,0.007,0.054,$118 ,15,1,$118 ,15,1240.6212,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,1.582,,0.486,0.013,0.105,$118 ,15,1,$118 ,15,649.3806,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,0.806,,0.231,0.007,0.054,$118 ,15,1,$118 ,15,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,41.52,,12.672,0.009,0.112,"$4,678 ",370,2,"$2,339 ",185,79.0111,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,1.606,,0.959,0.014,0.025,$117 ,65,1,$117 ,65,644.0626,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,1.932,,1.177,0.009,0.055,$214 ,35,1,$214 ,35,712.3677,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,2.067,,1.248,0.011,0.032,$192 ,65,1,$192 ,65,401.8765,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,2.66,,1.606,0.009,0.076,$303 ,35,1,$303 ,35,434.9877,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.046,,1.242,0.004,0.058,$488 ,35,1,$488 ,35,485.4343,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,4.871,,2.935,0.008,0.039,$594 ,125,1,$594 ,125,239.8346,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,1.55,,0.919,0.006,0.022,$249 ,71,1,$249 ,71,665.2714,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,15.706,,4.572,0.005,0.075,"$3,144 ",210,2,"$1,572 ",105,132.0319,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,152.74,144.16,144.02,0.021,0.339,"$7,166 ",450,2,"$3,583 ",225,14.48,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,47.365,,14.722,0.003,0.116,"$16,954 ",410,2,"$8,477 ",205,44.387,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,14.966,,4.35,0.007,0.060,"$2,004 ",250,2,"$1,002 ",125,138.9625,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,3.556,,1.015,0.008,0.127,$469 ,28,1,$469 ,28,284.2379,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,8.239,,2.545,0.018,0.294,$469 ,28,1,$469 ,28,122.4561,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,3.565,,1.01,0.008,0.127,$469 ,28,1,$469 ,28,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,132.44,18.19,,0.069,0.883,"$1,925 ",150,1,"$1,925 ",150,19.933,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,18.79,,6.86,0.031,0.150,$599 ,125,1,$599 ,125,99.01,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,7.59,,2.3,0.013,0.061,$599 ,125,1,$599 ,125,132.32,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,18.14,,7,0.030,0.145,$599 ,125,1,$599 ,125,,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,12.91,,4.36,0.039,0.103,$329 ,125,1,$329 ,125,95.92,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,7.13,,2.16,0.022,0.057,$329 ,125,1,$329 ,125,140.88,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,16.63,,5.72,0.051,0.133,$329 ,125,1,$329 ,125,,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,10.652,,3.873,0.016,0.065,$658 ,165,1,$658 ,165,111.0757,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,7.059,,2.154,0.011,0.043,$658 ,165,1,$658 ,165,142.0745,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,14.933,,4.935,0.023,0.091,$658 ,165,1,$658 ,165,,,,
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.258,,0.039,0.008,0.027,$34 ,9.5,1,$34 ,9.5,3959.594,,,
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.482,,0.061,0.007,0.040,$67 ,12,1,$67 ,12,2094.2569,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.994,,0.989,0.030,0.166,$67 ,12,1,$67 ,12,502.6095,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,2.242,,0.597,0.033,0.187,$67 ,12,1,$67 ,12,,,,
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.471,,0.374,0.012,0.098,$118 ,15,1,$118 ,15,678.4977,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.715,,0.802,0.023,0.181,$118 ,15,1,$118 ,15,368.8973,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,4.12,,1.142,0.035,0.275,$118 ,15,1,$118 ,15,,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,81.838,,19.314,0.017,0.221,"$4,678 ",370,2,"$2,339 ",185,41.506,,,
unet-camvid--0001 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.482,,1.54,0.021,0.038,$117 ,65,1,$117 ,65,412.1291,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,3.031,,1.9,0.014,0.087,$214 ,35,1,$214 ,35,457.5992,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,3.227,,2.018,0.017,0.050,$192 ,65,1,$192 ,65,256.5479,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,4.155,,2.6,0.014,0.119,$303 ,35,1,$303 ,35,277.7416,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.907,,2.004,0.006,0.083,$488 ,35,1,$488 ,35,319.7667,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,7.413,,4.615,0.012,0.059,$594 ,125,1,$594 ,125,157.3622,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.386,,1.481,0.010,0.034,$249 ,71,1,$249 ,71,422.1157,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,29.251,,7.301,0.009,0.139,"$3,144 ",210,2,"$1,572 ",105,69.3596,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,381.85,151.97,151.98,0.053,0.849,"$7,166 ",450,2,"$3,583 ",225,7.95,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,93.081,,21.382,0.005,0.227,"$16,954 ",410,2,"$8,477 ",205,22.9476,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,27.814,,6.966,0.014,0.111,"$2,004 ",250,2,"$1,002 ",125,72.9773,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,6.54,,1.677,0.014,0.234,$469 ,28,1,$469 ,28,152.602,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,15.391,,4.571,0.033,0.550,$469 ,28,1,$469 ,28,61.6002,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,17.962,,4.848,0.038,0.642,$469 ,28,1,$469 ,28,,,,
unet-camvid--0001 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,218.12,35.2,,0.113,1.454,"$1,925 ",150,1,"$1,925 ",150,7.149,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,802.63,,252.57,1.340,6.421,$599 ,125,1,$599 ,125,2.69,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,249.5,,86.81,0.417,1.996,$599 ,125,1,$599 ,125,4.79,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,795.31,,247.17,1.328,6.362,$599 ,125,1,$599 ,125,,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,638.25,,206.62,1.940,5.106,$329 ,125,1,$329 ,125,2.59,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,229.22,,81.49,0.697,1.834,$329 ,125,1,$329 ,125,5.22,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,631.71,,205.81,1.920,5.054,$329 ,125,1,$329 ,125,,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,428.506,,162.077,0.651,2.597,$658 ,165,1,$658 ,165,2.4778,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,245.738,,84.457,0.373,1.489,$658 ,165,1,$658 ,165,3.8792,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,598.947,,195.608,0.910,3.630,$658 ,165,1,$658 ,165,,,,
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,12.406,,6.124,0.365,1.306,$34 ,9.5,1,$34 ,9.5,83.8614,,,
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,22.94,,10.395,0.342,1.912,$67 ,12,1,$67 ,12,44.6243,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,66.641,,38.178,0.995,5.553,$67 ,12,1,$67 ,12,15.7687,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,86.38,,45.819,1.289,7.198,$67 ,12,1,$67 ,12,,,,
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,55.629,,18.246,0.471,3.709,$118 ,15,1,$118 ,15,18.2291,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,106.588,,31.376,0.903,7.106,$118 ,15,1,$118 ,15,10.8727,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,153.471,,46.125,1.301,10.231,$118 ,15,1,$118 ,15,,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,2733.627,,761.534,0.584,7.388,"$4,678 ",370,2,"$2,339 ",185,1.1267,,,
yolo_v3_tiny,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,114.701,,66.266,0.980,1.765,$117 ,65,1,$117 ,65,8.9295,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,141.001,,79.694,0.659,4.029,$214 ,35,1,$214 ,35,9.9196,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,145.659,,85.158,0.759,2.241,$192 ,65,1,$192 ,65,5.465,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,191.931,,109.625,0.633,5.484,$303 ,35,1,$303 ,35,5.5981,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,147.041,,84.448,0.301,4.201,$488 ,35,1,$488 ,35,7.0171,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,359.61,,173.635,0.605,2.877,$594 ,125,1,$594 ,125,2.9037,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,109.066,,64.87,0.438,1.536,$249 ,71,1,$249 ,71,9.3792,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,1058.322,,337.035,0.337,5.040,"$3,144 ",210,2,"$1,572 ",105,2.4971,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,7344.88,5212.9,5236.28,1.025,16.322,"$7,166 ",450,2,"$3,583 ",225,1.06,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,2931.242,,901.832,0.173,7.149,"$16,954 ",410,2,"$8,477 ",205,1.215,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1015.77,,321.263,0.507,4.063,"$2,004 ",250,2,"$1,002 ",125,2.6076,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,258.05,,79.963,0.550,9.216,$469 ,28,1,$469 ,28,4.1833,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,492.645,,157.98,1.050,17.594,$469 ,28,1,$469 ,28,2.5788,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,606.117,,186.339,1.292,21.647,$469 ,28,1,$469 ,28,,,,
yolo_v3_tiny,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3634.16,1209.67,,1.888,24.228,"$1,925 ",150,1,"$1,925 ",150,1.293,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,37.15,,13.03,0.062,0.297,$599 ,125,1,$599 ,125,55.96,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,12.92,,4.26,0.022,0.103,$599 ,125,1,$599 ,125,78.73,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,37.16,,13.54,0.062,0.297,$599 ,125,1,$599 ,125,,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,25.5,,8.36,0.078,0.204,$329 ,125,1,$329 ,125,53.79,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,12.15,,4,0.037,0.097,$329 ,125,1,$329 ,125,83.64,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,31.99,,10.82,0.097,0.256,$329 ,125,1,$329 ,125,,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,21.833,,7.096,0.033,0.132,$658 ,165,1,$658 ,165,58.4745,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,11.956,,3.869,0.018,0.072,$658 ,165,1,$658 ,165,85.1633,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,26.693,,8.644,0.041,0.162,$658 ,165,1,$658 ,165,,,,
yolo_v4,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.522,,0.248,0.015,0.055,$34 ,9.5,1,$34 ,9.5,1900.0218,,,
yolo_v4,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.99,,0.43,0.015,0.083,$67 ,12,1,$67 ,12,1019.82,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,3.413,,1.752,0.051,0.284,$67 ,12,1,$67 ,12,295.7702,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,3.999,,2.087,0.060,0.333,$67 ,12,1,$67 ,12,,,,
yolo_v4,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,2.453,,0.748,0.021,0.164,$118 ,15,1,$118 ,15,407.2474,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,4.758,,1.434,0.040,0.317,$118 ,15,1,$118 ,15,212.7987,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,7.048,,2.122,0.060,0.470,$118 ,15,1,$118 ,15,,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,126.954,,35.481,0.027,0.343,"$4,678 ",370,2,"$2,339 ",185,37.8189,,,
yolo_v4,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,4.971,,2.885,0.042,0.076,$117 ,65,1,$117 ,65,203.4163,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,6.182,,3.532,0.029,0.177,$214 ,35,1,$214 ,35,227.5786,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,6.356,,3.757,0.033,0.098,$192 ,65,1,$192 ,65,123.3181,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,8.44,,4.868,0.028,0.241,$303 ,35,1,$303 ,35,135.9719,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,6.399,,3.765,0.013,0.183,$488 ,35,1,$488 ,35,155.642,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,15.614,,7.925,0.026,0.125,$594 ,125,1,$594 ,125,71.631,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,4.674,,2.804,0.019,0.066,$249 ,71,1,$249 ,71,214.0957,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,47.338,,14.464,0.015,0.225,"$3,144 ",210,2,"$1,572 ",105,45.7699,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,252.03,228.55,228.67,0.035,0.560,"$7,166 ",450,2,"$3,583 ",225,15.01,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,131.466,,41.001,0.008,0.321,"$16,954 ",410,2,"$8,477 ",205,19.2807,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,45.047,,13.741,0.022,0.180,"$2,004 ",250,2,"$1,002 ",125,48.0344,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,11.067,,3.259,0.024,0.395,$469 ,28,1,$469 ,28,92.2912,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,25.048,,7.384,0.053,0.895,$469 ,28,1,$469 ,28,39.1492,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,29.658,,8.32,0.063,1.059,$469 ,28,1,$469 ,28,,,,
yolo_v4,OV-2022.3-8991,accel,Intel® Flex-170 GPU,454.49,56.78,,0.236,3.03,"$1,925 ",150,1,"$1,925 ",150,6.969,,,
end_rec,,,,,,,,,,,,,,,,,
Network model,Release,IE-Type,Platform name,Throughput-INT8,Throughput-FP16,Throughput-FP32,Value,Efficiency,Price,TDP,Sockets,Price/socket,TDP/socket,Latency
begin_rec,,,,,,,,,,,,,,
GPT-2,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,,,0.10,0.000,0.000,34,9.5,1,34,9.5,
GPT-2,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,1.03,0.000,0.000,117,65,1,117,65,
GPT-2,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,,,1.21,0.000,0.000,214,35,1,214,35,
GPT-2,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,,,2.94,0.000,0.000,329,125,1,329,125,
GPT-2,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,,,1.50,0.000,0.000,197,65,1,197,65,
GPT-2,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,,,1.25,0.000,0.000,426,28,1,426,28,
GPT-2,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,,,0.85,0.000,0.000,490,28,1,490,28,
GPT-2,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,,,1.57,0.000,0.000,303,35,1,303,35,
GPT-2,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,,,1.28,0.000,0.000,488,35,1,488,35,
GPT-2,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,,,1.48,0.000,0.000,544,35,1,544,35,
GPT-2,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,,,4.26,0.000,0.000,599,125,1,599,125,
GPT-2,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,,,1.45,0.000,0.000,594,125,1,594,125,
GPT-2,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,,,1.07,0.000,0.000,249,71,1,249,71,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,,,5.55,0.000,0.000,3144,204,2,1572,102,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,,,14.00,0.000,0.000,16954,410,2,8477,205,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,,,5.30,0.000,0.000,2004,250,2,1002,125,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,,,22.00,0.000,0.000,18718,540,2,9359,270,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,,,29.03,0.000,0.000,34000,700,2,17000,350,
GPT-2,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,,,11.26,0.000,0.000,2274,300,2,1137,150,
GPT-2,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,,,2.02,0.000,0.000,697,45,1,697,45,
GPT-2,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,,,0.30,0.000,0.000,107,15,1,107,15,
GPT-2,OV-2023.0,accel,Intel® Flex-170 GPU,,49.09,,0.000,0.000,1925,150,1,1925,150,
GPT-2,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,,1.57,,0.000,0.000,490,28,1,490,28,
GPT-2,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,,2.27,,0.000,0.000,107,15,1,107,15,
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,,,1.56,0.000,0.000,490,28,1,490,28,
GPT-2,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,,,1.48,0.000,0.000,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
bert-base-cased,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,3.05,,1.33,0.090,0.321,34,9.5,1,34,9.5,354.611
bert-base-cased,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,23.94,,14.89,0.205,0.368,117,65,1,117,65,43.191
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,35.72,,19.51,0.167,1.021,214,35,1,214,35,32.456
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,124.63,,44.62,0.379,0.997,329,125,1,329,125,15.855
bert-base-cased,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,37.95,,22.57,0.193,0.584,197,65,1,197,65,27.794
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,62.93,,17.87,0.148,2.248,426,28,1,426,28,19.316
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,50.36,,14.91,0.103,1.798,490,28,1,490,28,21.583
bert-base-cased,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,42.21,,22.78,0.139,1.206,303,35,1,303,35,27.589
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,38.74,,18.79,0.079,1.107,488,35,1,488,35,35.128
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,61.46,,19.49,0.113,1.756,544,35,1,544,35,22.006
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,180.30,,68.74,0.301,1.442,599,125,1,599,125,13.181
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,64.34,,35.79,0.108,0.515,594,125,1,594,125,18.403
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,23.46,,14.60,0.094,0.330,249,71,1,249,71,43.94
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,269.69,,80.01,0.086,1.322,3144,204,2,1572,102,12.823
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,678.10,,222.26,0.040,1.654,16954,410,2,8477,205,7.567
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,258.75,,76.54,0.129,1.035,2004,250,2,1002,125,13.326
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,1096.03,,196.59,0.059,2.030,18718,540,2,9359,270,6.09
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,3372.80,,445.48,0.099,4.818,34000,700,2,17000,350,4.869
bert-base-cased,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,533.66,,171.12,0.235,1.779,2274,300,2,1137,150,7.683
bert-base-cased,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,85.32,,25.90,0.122,1.896,697,45,1,697,45,17.986
bert-base-cased,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,14.00,,4.28,0.131,0.933,107,15,1,107,15,
bert-base-cased,OV-2023.0,accel,Intel® Flex-170 GPU,670.48,582.97,,0.348,4.470,1925,150,1,1925,150,23.469
bert-base-cased,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,77.37,37.02,,0.158,2.763,490,28,1,490,28,52.374
bert-base-cased,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,47.15,32.01,,0.441,3.144,107,15,1,107,15,84.683
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,85.30,,28.16,0.174,3.046,490,28,1,490,28,
bert-base-cased,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,56.20,,24.79,0.525,3.747,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
bert-large-uncased,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.26,,0.13,0.008,0.028,34,9.5,1,34,9.5,4055.305
bert-large-uncased,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,2.11,,1.26,0.018,0.032,117,65,1,117,65,492.094
bert-large-uncased,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,2.98,,1.75,0.014,0.085,214,35,1,214,35,351.294
bert-large-uncased,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,9.17,,3.72,0.028,0.073,329,125,1,329,125,149.645
bert-large-uncased,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,3.26,,1.91,0.017,0.050,197,65,1,197,65,308.597
bert-large-uncased,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,4.60,,1.57,0.011,0.164,426,28,1,426,28,230.241
bert-large-uncased,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,3.32,,1.28,0.007,0.118,490,28,1,490,28,271.873
bert-large-uncased,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,3.55,,2.12,0.012,0.101,303,35,1,303,35,295.498
bert-large-uncased,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,3.14,,1.76,0.006,0.090,488,35,1,488,35,335.174
bert-large-uncased,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,5.12,,1.89,0.009,0.146,544,35,1,544,35,214.42
bert-large-uncased,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,14.40,,6.09,0.024,0.115,599,125,1,599,125,115.336
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,4.40,,2.71,0.007,0.035,594,125,1,594,125,177.897
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,2.12,,1.30,0.008,0.030,249,71,1,249,71,481.442
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,20.31,,7.14,0.006,0.100,3144,204,2,1572,102,104.828
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,46.48,,19.65,0.003,0.113,16954,410,2,8477,205,50.292
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,19.27,,6.83,0.010,0.077,2004,250,2,1002,125,109.226
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,74.00,,26.69,0.004,0.137,18718,540,2,9359,270,39.549
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,125.14,,44.52,0.004,0.179,34000,700,2,17000,350,23.947
bert-large-uncased,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,37.60,,14.83,0.017,0.125,2274,300,2,1137,150,60.208
bert-large-uncased,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,6.79,,2.68,0.010,0.151,697,45,1,697,45,181.85
bert-large-uncased,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,1.10,,0.38,0.010,0.073,107,15,1,107,15,883.753
bert-large-uncased,OV-2023.0,accel,Intel® Flex-170 GPU,120.47,80.23,,0.063,0.803,1925,150,1,1925,150,132.308
bert-large-uncased,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,5.10,2.96,,0.010,0.182,490,28,1,490,28,788.772
bert-large-uncased,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,4.72,3.49,,0.044,0.314,107,15,1,107,15,815.785
bert-large-uncased,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,5.05,,2.95,0.010,0.180,490,28,1,490,28,
bert-large-uncased,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,4.86,,2.19,0.045,0.324,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
deeplabv3,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,,,1.47,0.000,0.000,34,9.5,1,34,9.5,359.456
deeplabv3,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,,0.000,0.000,117,65,1,117,65,
deeplabv3,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,36.23,,16.70,0.169,1.035,214,35,1,214,35,32.374
deeplabv3,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,95.00,,41.09,0.289,0.760,329,125,1,329,125,15.959
deeplabv3,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,38.31,,21.59,0.194,0.589,197,65,1,197,65,26.51
deeplabv3,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,54.05,,16.27,0.127,1.930,426,28,1,426,28,20.652
deeplabv3,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,34.93,,10.57,0.071,1.247,490,28,1,490,28,27.622
deeplabv3,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,,,,0.000,0.000,303,35,1,303,35,
deeplabv3,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,38.14,,18.17,0.078,1.090,488,35,1,488,35,27.35
deeplabv3,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,59.94,,23.05,0.110,1.713,544,35,1,544,35,20.76
deeplabv3,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,148.05,,58.47,0.247,1.184,599,125,1,599,125,12.241
deeplabv3,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,,,,0.000,0.000,594,125,1,594,125,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,,,,0.000,0.000,249,71,1,249,71,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,,,77.92,0.000,0.000,3144,204,2,1572,102,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,,,,0.000,0.000,16954,410,2,8477,205,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,,,75.53,0.000,0.000,2004,250,2,1002,125,
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,649.53,,229.92,0.035,1.203,18718,540,2,9359,270,3.405
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,1030.08,,382.32,0.030,1.472,34000,700,2,17000,350,3.326
deeplabv3,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,410.93,,141.37,0.181,1.370,2274,300,2,1137,150,5.875
deeplabv3,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,74.12,,31.22,0.106,1.647,697,45,1,697,45,18.343
deeplabv3,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,,,4.67,0.000,0.000,107,15,1,107,15,
deeplabv3,OV-2023.0,accel,Intel® Flex-170 GPU,746.27,500.10,,0.388,4.975,1925,150,1,1925,150,21.132
deeplabv3,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,78.43,13.79,,0.160,2.801,490,28,1,490,28,49.979
deeplabv3,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,62.44,28.53,,0.584,4.163,107,15,1,107,15,63.94
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,76.72,,13.98,0.157,2.740,490,28,1,490,28,
deeplabv3,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,62.43,,16.71,0.583,4.162,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
efficientdet-d0,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,3.76,,2.64,0.111,0.396,34,9.5,1,34,9.5,290.489
efficientdet-d0,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,33.53,,23.96,0.287,0.516,117,65,1,117,65,31.272
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,50.07,,28.48,0.234,1.430,214,35,1,214,35,24.356
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,128.34,,84.11,0.390,1.027,329,125,1,329,125,13.005
efficientdet-d0,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,53.85,,35.65,0.273,0.828,197,65,1,197,65,20.31
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,69.87,,39.11,0.164,2.495,426,28,1,426,28,17.366
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,47.89,,20.09,0.098,1.710,490,28,1,490,28,23.549
efficientdet-d0,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,47.53,,37.79,0.157,1.358,303,35,1,303,35,
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,54.67,,32.54,0.112,1.562,488,35,1,488,35,21.202
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,71.50,,45.10,0.131,2.043,544,35,1,544,35,17.778
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,192.62,,104.56,0.322,1.541,599,125,1,599,125,10.4
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,92.53,,35.06,0.156,0.740,594,125,1,594,125,13.425
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,32.46,,25.97,0.130,0.457,249,71,1,249,71,32.052
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,236.75,,163.08,0.075,1.161,3144,204,2,1572,102,12.998
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,458.66,,294.01,0.027,1.119,16954,410,2,8477,205,8.596
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,228.21,,157.38,0.114,0.913,2004,250,2,1002,125,13.312
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,709.57,,452.65,0.038,1.314,18718,540,2,9359,270,9.742
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,922.74,,791.57,0.027,1.318,34000,700,2,17000,350,6.149
efficientdet-d0,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,416.01,,270.46,0.183,1.387,2274,300,2,1137,150,8.366
efficientdet-d0,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,97.01,,57.69,0.139,2.156,697,45,1,697,45,14.749
efficientdet-d0,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,17.79,,11.10,0.166,1.186,107,15,1,107,15,61.812
efficientdet-d0,OV-2023.0,accel,Intel® Flex-170 GPU,684.48,640.17,,0.356,4.563,1925,150,1,1925,150,22.702
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,61.69,24.16,,0.126,2.203,490,28,1,490,28,63.923
efficientdet-d0,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,66.61,60.60,,0.623,4.441,107,15,1,107,15,59.789
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,61.69,,24.13,0.126,2.203,490,28,1,490,28,
efficientdet-d0,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,66.61,,33.76,0.623,4.441,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
faster_rcnn_resnet50_coco,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.31,,0.13,0.009,0.032,34,9.5,1,34,9.5,3336.101
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,2.89,,1.51,0.025,0.045,117,65,1,117,65,358.208
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,4.22,,2.26,0.020,0.120,214,35,1,214,35,307.053
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,13.04,,4.32,0.040,0.104,329,125,1,329,125,163.824
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,4.59,,2.39,0.023,0.071,197,65,1,197,65,247.538
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,6.74,,1.78,0.016,0.241,426,28,1,426,28,165.661
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,5.16,,1.43,0.011,0.184,490,28,1,490,28,199.974
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,4.87,,2.66,0.016,0.139,303,35,1,303,35,264.983
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,4.42,,2.27,0.009,0.126,488,35,1,488,35,252.35
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,7.29,,2.34,0.013,0.208,544,35,1,544,35,188.868
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,21.05,,7.31,0.035,0.168,599,125,1,599,125,111.671
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,8.65,,4.36,0.015,0.069,594,125,1,594,125,139.23
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,2.78,,1.48,0.011,0.039,249,71,1,249,71,363.574
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,29.15,,8.22,0.009,0.143,3144,204,2,1572,102,77.579
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,85.87,,22.37,0.005,0.209,16954,410,2,8477,205,30.369
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,27.70,,7.83,0.014,0.111,2004,250,2,1002,125,79.52
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,112.09,,32.42,0.006,0.208,18718,540,2,9359,270,89.144
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,417.49,,50.54,0.012,0.596,34000,700,2,17000,350,10.171
faster_rcnn_resnet50_coco,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,65.13,,16.92,0.029,0.217,2274,300,2,1137,150,42.66
faster_rcnn_resnet50_coco,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,10.07,,3.25,0.014,0.224,697,45,1,697,45,173.006
faster_rcnn_resnet50_coco,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,1.60,,0.42,0.015,0.106,107,15,1,107,15,640.412
faster_rcnn_resnet50_coco,OV-2023.0,accel,Intel® Flex-170 GPU,222.32,144.56,,0.115,1.482,1925,150,1,1925,150,71.569
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,13.38,2.37,,0.027,0.478,490,28,1,490,28,298.019
faster_rcnn_resnet50_coco,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,8.22,4.09,,0.077,0.548,107,15,1,107,15,475.77
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,13.31,,2.38,0.027,0.475,490,28,1,490,28,
faster_rcnn_resnet50_coco,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,8.21,,1.83,0.077,0.547,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
inception-v4,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,3.19,,1.34,0.094,0.335,34,9.5,1,34,9.5,330.309
inception-v4,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,29.71,,15.29,0.254,0.457,117,65,1,117,65,34.592
inception-v4,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,42.94,,22.86,0.201,1.227,214,35,1,214,35,25.956
inception-v4,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,147.72,,42.20,0.449,1.182,329,125,1,329,125,15.377
inception-v4,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,47.19,,23.81,0.240,0.726,197,65,1,197,65,21.506
inception-v4,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,68.56,,17.47,0.161,2.449,426,28,1,426,28,16.906
inception-v4,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,55.82,,14.00,0.114,1.994,490,28,1,490,28,19.042
inception-v4,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,49.05,,26.55,0.162,1.401,303,35,1,303,35,22.154
inception-v4,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,45.87,,22.92,0.094,1.311,488,35,1,488,35,24.899
inception-v4,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,80.22,,22.64,0.147,2.292,544,35,1,544,35,19.511
inception-v4,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,224.68,,71.78,0.375,1.797,599,125,1,599,125,11.8
inception-v4,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,91.41,,42.89,0.154,0.731,594,125,1,594,125,12.94
inception-v4,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,28.17,,14.89,0.113,0.397,249,71,1,249,71,36.364
inception-v4,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,302.16,,77.16,0.096,1.481,3144,204,2,1572,102,10.627
inception-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,950.44,,228.44,0.056,2.318,16954,410,2,8477,205,5.714
inception-v4,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,287.12,,73.94,0.143,1.148,2004,250,2,1002,125,11.352
inception-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,1475.64,,347.33,0.079,2.733,18718,540,2,9359,270,3.339
inception-v4,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,5145.62,,522.16,0.151,7.351,34000,700,2,17000,350,3.434
inception-v4,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,730.64,,169.52,0.321,2.435,2274,300,2,1137,150,6.456
inception-v4,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,111.78,,31.98,0.160,2.484,697,45,1,697,45,16.4
inception-v4,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,15.15,,4.13,0.142,1.010,107,15,1,107,15,65.483
inception-v4,OV-2023.0,accel,Intel® Flex-170 GPU,834.65,515.70,,0.434,5.564,1925,150,1,1925,150,18.9
inception-v4,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,109.98,33.26,,0.224,3.928,490,28,1,490,28,36.221
inception-v4,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,66.82,31.46,,0.625,4.455,107,15,1,107,15,59.758
inception-v4,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,106.60,,33.09,0.218,3.807,490,28,1,490,28,
inception-v4,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,66.82,,18.62,0.624,4.455,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
mobilenet-ssd,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,27.01,,12.73,0.794,2.843,34,9.5,1,34,9.5,39.576
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,140.58,0.000,0.000,117,65,1,117,65,
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,344.62,,201.93,1.610,9.846,214,35,1,214,35,3.456
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,1020.39,,400.82,3.101,8.163,329,125,1,329,125,1.993
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,357.96,,218.52,1.817,5.507,197,65,1,197,65,2.959
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,548.92,,158.26,1.289,19.604,426,28,1,426,28,2.105
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,441.91,,112.33,0.902,15.783,490,28,1,490,28,2.364
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,392.88,,242.76,1.297,11.225,303,35,1,303,35,3.046
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,361.27,,208.16,0.740,10.322,488,35,1,488,35,3.266
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,583.02,,215.65,1.072,16.658,544,35,1,544,35,2.48
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,1642.52,,682.33,2.742,13.140,599,125,1,599,125,1.768
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,736.72,,,1.240,5.894,594,125,1,594,125,
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,212.31,,142.58,0.853,2.990,249,71,1,249,71,
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,2268.47,,693.51,0.722,11.120,3144,204,2,1572,102,1.498
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,6587.85,,1822.35,0.389,16.068,16954,410,2,8477,205,1.043
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,2163.47,,666.62,1.080,8.654,2004,250,2,1002,125,1.55
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,11311.70,,2529.80,0.604,20.948,18718,540,2,9359,270,0.697
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,24846.06,,3999.28,0.731,35.494,34000,700,2,17000,350,0.836
mobilenet-ssd,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,5398.00,,1364.13,2.374,17.993,2274,300,2,1137,150,0.805
mobilenet-ssd,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,789.36,,299.79,1.133,17.541,697,45,1,697,45,2.072
mobilenet-ssd,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,116.16,,40.17,1.086,7.744,107,15,1,107,15,8.471
mobilenet-ssd,OV-2023.0,accel,Intel® Flex-170 GPU,4127.47,3257.04,,2.144,27.516,1925,150,1,1925,150,3.643
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,626.92,201.13,,1.279,22.390,490,28,1,490,28,6.243
mobilenet-ssd,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,,238.03,,0.000,0.000,107,15,1,107,15,8.633
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,619.19,,199.95,1.264,22.114,490,28,1,490,28,
mobilenet-ssd,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,453.39,,149.06,4.237,30.226,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
mobilenet-v2,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,,,45.44,0.000,0.000,34,9.5,1,34,9.5,14.506
mobilenet-v2,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,456.87,0.000,0.000,117,65,1,117,65,
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,884.87,,483.11,4.135,25.282,214,35,1,214,35,1.557
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,2634.22,,1305.55,8.007,21.074,329,125,1,329,125,0.959
mobilenet-v2,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,880.67,,684.15,4.470,13.549,197,65,1,197,65,1.33
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,1384.37,,520.06,3.250,49.442,426,28,1,426,28,0.93
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,1092.57,,315.10,2.230,39.020,490,28,1,490,28,1.025
mobilenet-v2,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,,,670.65,0.000,0.000,303,35,1,303,35,
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,922.31,,638.15,1.890,26.352,488,35,1,488,35,1.518
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,1271.36,,687.61,2.337,36.325,544,35,1,544,35,1.229
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,4077.41,,2121.84,6.807,32.619,599,125,1,599,125,0.76
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,,,,0.000,0.000,594,125,1,594,125,
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,,,,0.000,0.000,249,71,1,249,71,
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,5589.81,,1920.53,1.778,27.401,3144,204,2,1572,102,1.349
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,15333.06,,4417.85,0.904,37.398,16954,410,2,8477,205,0.843
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,5405.01,,1859.79,2.697,21.620,2004,250,2,1002,125,1.374
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,23186.39,,6910.90,1.239,42.938,18718,540,2,9359,270,0.519
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,35768.42,,10976.35,1.052,51.098,34000,700,2,17000,350,0.618
mobilenet-v2,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,12752.22,,3600.85,5.608,42.507,2274,300,2,1137,150,0.51
mobilenet-v2,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,1735.86,,932.73,2.490,38.575,697,45,1,697,45,1.089
mobilenet-v2,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,,,133.14,0.000,0.000,107,15,1,107,15,3.455
mobilenet-v2,OV-2023.0,accel,Intel® Flex-170 GPU,5411.37,5188.89,,2.811,36.076,1925,150,1,1925,150,2.026
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,929.63,350.08,,1.897,33.201,490,28,1,490,28,4.227
mobilenet-v2,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,674.00,511.12,,6.299,44.933,107,15,1,107,15,5.591
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,922.11,,350.46,1.882,32.933,490,28,1,490,28,
mobilenet-v2,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,674.00,,338.92,6.299,44.933,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
resnet-50,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,10.92,,4.54,0.321,1.150,34,9.5,1,34,9.5,94.518
resnet-50,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,97.59,,51.99,0.834,1.501,117,65,1,117,65,10.637
resnet-50,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,144.61,,75.37,0.676,4.132,214,35,1,214,35,8.098
resnet-50,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,500.94,,143.02,1.523,4.008,329,125,1,329,125,4.455
resnet-50,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,155.16,,81.16,0.788,2.387,197,65,1,197,65,6.957
resnet-50,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,224.35,,60.58,0.527,8.012,426,28,1,426,28,5.088
resnet-50,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,182.57,,47.31,0.373,6.520,490,28,1,490,28,51.708
resnet-50,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,165.21,,88.47,0.545,4.720,303,35,1,303,35,7.106
resnet-50,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,155.09,,77.88,0.318,4.431,488,35,1,488,35,7.417
resnet-50,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,267.58,,75.49,0.492,7.645,544,35,1,544,35,5.351
resnet-50,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,763.64,,241.72,1.275,6.109,599,125,1,599,125,3.362
resnet-50,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,319.70,,148.80,0.538,2.558,594,125,1,594,125,3.733
resnet-50,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,93.19,,50.97,0.374,1.312,249,71,1,249,71,11.014
resnet-50,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,968.34,,269.28,0.308,4.747,3144,204,2,1572,102,2.912
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,2928.36,,755.49,0.173,7.142,16954,410,2,8477,205,1.501
resnet-50,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,928.12,,257.71,0.463,3.712,2004,250,2,1002,125,3.015
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,5006.83,,1168.91,0.267,9.272,18718,540,2,9359,270,1.017
resnet-50,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,18906.26,,1671.79,0.556,27.009,34000,700,2,17000,350,1
resnet-50,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,2292.86,,570.35,1.008,7.643,2274,300,2,1137,150,1.465
resnet-50,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,372.55,,103.20,0.535,8.279,697,45,1,697,45,4.778
resnet-50,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,50.13,,14.45,0.469,3.342,107,15,1,107,15,19.719
resnet-50,OV-2023.0,accel,Intel® Flex-170 GPU,3088.38,1947.78,,1.604,20.589,1925,150,1,1925,150,4.918
resnet-50,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,300.85,91.55,,0.614,10.744,490,28,1,490,28,13.174
resnet-50,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,212.07,117.19,,1.982,14.138,107,15,1,107,15,18.751
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,296.02,,90.64,0.604,10.572,490,28,1,490,28,
resnet-50,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,212.06,,66.73,1.982,14.137,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
ssd-resnet-34-1200,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,0.18,,0.08,0.005,0.019,34,9.5,1,34,9.5,5553.227
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,1.69,,0.97,0.014,0.026,117,65,1,117,65,593.302
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,2.42,,1.40,0.011,0.069,214,35,1,214,35,459.773
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,8.10,,2.46,0.025,0.065,329,125,1,329,125,207.938
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,2.63,,1.49,0.013,0.040,197,65,1,197,65,393.41
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,3.82,,0.99,0.009,0.136,426,28,1,426,28,280.092
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,3.15,,0.82,0.006,0.113,490,28,1,490,28,5.129
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,2.78,,1.61,0.009,0.080,303,35,1,303,35,399.367
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,2.48,,1.38,0.005,0.071,488,35,1,488,35,411.047
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,4.07,,1.34,0.007,0.116,544,35,1,544,35,297.001
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,12.60,,4.18,0.021,0.101,599,125,1,599,125,157.718
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,5.02,,,0.008,0.040,594,125,1,594,125,200.705
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,1.60,,0.92,0.006,0.023,249,71,1,249,71,622.798
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,17.65,,4.59,0.006,0.087,3144,204,2,1572,102,116.003
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,57.90,,14.86,0.003,0.141,16954,410,2,8477,205,36.506
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,16.78,,4.37,0.008,0.067,2004,250,2,1002,125,121.986
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,78.77,,20.79,0.004,0.146,18718,540,2,9359,270,105.307
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,440.92,,31.41,0.013,0.630,34000,700,2,17000,350,8.63
ssd-resnet-34-1200,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,42.62,,10.56,0.019,0.142,2274,300,2,1137,150,60.312
ssd-resnet-34-1200,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,6.00,,1.85,0.009,0.133,697,45,1,697,45,241.005
ssd-resnet-34-1200,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,0.90,,0.23,0.008,0.060,107,15,1,107,15,1118.93
ssd-resnet-34-1200,OV-2023.0,accel,Intel® Flex-170 GPU,150.99,92.06,,0.078,1.007,1925,150,1,1925,150,105.863
ssd-resnet-34-1200,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,9.00,2.24,,0.018,0.321,490,28,1,490,28,444.2
ssd-resnet-34-1200,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,5.04,2.62,,0.047,0.336,107,15,1,107,15,774.647
ssd-resnet-34-1200,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,8.73,,2.24,0.018,0.312,490,28,1,490,28,
ssd-resnet-34-1200,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,5.04,,1.40,0.047,0.336,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
unet-camvid-onnx-0001,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,,,0.04,0.000,0.000,34,9.5,1,34,9.5,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,,,1.55,0.000,0.000,117,65,1,117,65,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,,,2.25,0.000,0.000,214,35,1,214,35,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,,,4.02,0.000,0.000,329,125,1,329,125,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,,,2.39,0.000,0.000,197,65,1,197,65,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,6.42,,1.61,0.015,0.229,426,28,1,426,28,169.94
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,5.20,,1.28,0.011,0.186,490,28,1,490,28,5.959
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,,,2.60,0.000,0.000,303,35,1,303,35,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,,,2.25,0.000,0.000,488,35,1,488,35,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,,,2.25,0.000,0.000,544,35,1,544,35,
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,,,6.89,0.000,0.000,599,125,1,599,125,
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,,,4.54,0.000,0.000,594,125,1,594,125,
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,,,1.49,0.000,0.000,249,71,1,249,71,
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,29.07,,7.34,0.009,0.142,3144,204,2,1572,102,71.813
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,95.23,,21.78,0.006,0.232,16954,410,2,8477,205,23.52
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,27.71,,7.01,0.014,0.111,2004,250,2,1002,125,74.843
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,129.48,,31.77,0.007,0.240,18718,540,2,9359,270,73.758
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,505.87,,48.40,0.015,0.723,34000,700,2,17000,350,9.333
unet-camvid-onnx-0001,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,69.94,,16.08,0.031,0.233,2274,300,2,1137,150,42.347
unet-camvid-onnx-0001,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,8.65,,3.05,0.012,0.192,697,45,1,697,45,156.16
unet-camvid-onnx-0001,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,1.49,,0.38,0.014,0.100,107,15,1,107,15,672.584
unet-camvid-onnx-0001,OV-2023.0,accel,Intel® Flex-170 GPU,254.48,144.90,,0.132,1.697,1925,150,1,1925,150,62.697
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,15.74,4.26,,0.032,0.562,490,28,1,490,28,253.852
unet-camvid-onnx-0001,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,8.41,4.37,,0.079,0.560,107,15,1,107,15,475.668
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,15.72,,4.26,0.032,0.561,490,28,1,490,28,
unet-camvid-onnx-0001,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,8.40,,2.38,0.079,0.560,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
yolo-v3,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,1.13,,0.52,0.033,0.119,34,9.5,1,34,9.5,903.84
yolo-v3,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,10.63,,5.89,0.091,0.164,117,65,1,117,65,95.035
yolo-v3,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,15.37,,8.39,0.072,0.439,214,35,1,214,35,74.286
yolo-v3,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,51.84,,15.89,0.158,0.415,329,125,1,329,125,30.002
yolo-v3,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,16.37,,8.99,0.083,0.252,197,65,1,197,65,63.34
yolo-v3,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,23.65,,6.47,0.056,0.845,426,28,1,426,28,46.28
yolo-v3,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,19.40,,5.08,0.040,0.693,490,28,1,490,28,12.186
yolo-v3,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,17.61,,9.85,0.058,0.503,303,35,1,303,35,59.526
yolo-v3,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,16.06,,8.39,0.033,0.459,488,35,1,488,35,68.144
yolo-v3,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,27.93,,8.41,0.051,0.798,544,35,1,544,35,42.848
yolo-v3,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,81.69,,27.09,0.136,0.653,599,125,1,599,125,23.63
yolo-v3,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,32.62,,14.28,0.055,0.261,594,125,1,594,125,31.954
yolo-v3,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,10.06,,5.72,0.040,0.142,249,71,1,249,71,100.121
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,105.44,,29.93,0.034,0.517,3144,204,2,1572,102,22.132
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,318.96,,88.54,0.019,0.778,16954,410,2,8477,205,10.667
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,100.48,,28.51,0.050,0.402,2004,250,2,1002,125,23.175
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,485.45,,108.76,0.026,0.899,18718,540,2,9359,270,6.711
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,2042.57,,194.96,0.060,2.918,34000,700,2,17000,350,3.286
yolo-v3,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,240.71,,62.50,0.106,0.802,2274,300,2,1137,150,13.918
yolo-v3,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,39.77,,11.97,0.057,0.884,697,45,1,697,45,34.872
yolo-v3,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,5.45,,1.55,0.051,0.363,107,15,1,107,15,184.58
yolo-v3,OV-2023.0,accel,Intel® Flex-170 GPU,715.46,313.59,,0.372,4.770,1925,150,1,1925,150,21.953
yolo-v3,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,59.07,13.71,,0.121,2.110,490,28,1,490,28,67.531
yolo-v3,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,32.01,15.01,,0.299,2.134,107,15,1,107,15,123.951
yolo-v3,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,59.07,,13.68,0.121,2.110,490,28,1,490,28,
yolo-v3,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,32.00,,8.04,0.299,2.133,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
yolo_v3_tiny,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,12.33,,6.20,0.363,1.297,34,9.5,1,34,9.5,82.686
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,112.45,,65.06,0.961,1.730,117,65,1,117,65,8.957
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,167.83,,92.82,0.784,4.795,214,35,1,214,35,6.709
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,600.04,,199.22,1.824,4.800,329,125,1,329,125,3.139
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,176.01,,99.54,0.893,2.708,197,65,1,197,65,5.438
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,241.89,,75.37,0.568,8.639,426,28,1,426,28,4.542
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,203.84,,57.67,0.416,7.280,490,28,1,490,28,5.129
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,191.07,,108.63,0.631,5.459,303,35,1,303,35,5.593
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,180.44,,92.86,0.370,5.155,488,35,1,488,35,6.282
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,303.14,,97.03,0.557,8.661,544,35,1,544,35,4.164
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,900.78,,306.13,1.504,7.206,599,125,1,599,125,2.541
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,349.17,,170.15,0.588,2.793,594,125,1,594,125,2.953
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,106.71,,64.03,0.429,1.503,249,71,1,249,71,9.39
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,1052.16,,339.30,0.335,5.158,3144,204,2,1572,102,2.514
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,2932.78,,914.37,0.173,7.153,16954,410,2,8477,205,1.215
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,1010.00,,323.69,0.504,4.040,2004,250,2,1002,125,2.622
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,4584.21,,1374.00,0.245,8.489,18718,540,2,9359,270,0.88
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,13092.13,,2107.19,0.385,18.703,34000,700,2,17000,350,1.149
yolo_v3_tiny,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,2217.64,,704.05,0.975,7.392,2274,300,2,1137,150,1.321
yolo_v3_tiny,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,433.83,,136.36,0.622,9.641,697,45,1,697,45,3.411
yolo_v3_tiny,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,54.23,,18.05,0.507,3.615,107,15,1,107,15,18.195
yolo_v3_tiny,OV-2023.0,accel,Intel® Flex-170 GPU,3196.82,2123.72,,1.661,21.312,1925,150,1,1925,150,4.691
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,507.33,136.58,,1.035,18.119,490,28,1,490,28,7.675
yolo_v3_tiny,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,290.97,151.90,,2.719,19.398,107,15,1,107,15,13.629
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,505.40,,136.40,1.031,18.050,490,28,1,490,28,
yolo_v3_tiny,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,290.97,,86.08,2.719,19.398,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
yolo-v8n,OV-2023.0,atom,Intel® Atom™ x5-E3940 CPU-only,5.69,,3.01,0.167,0.598,34,9.5,1,34,9.5,185.626
yolo-v8n,OV-2023.0,core,Intel® Core™ i3-8100 CPU-only,53.97,,33.14,0.461,0.830,117,65,1,117,65,18.918
yolo-v8n,OV-2023.0,core,Intel® Core™ i5-10500TE CPU-only,81.11,,47.46,0.379,2.317,214,35,1,214,35,16.114
yolo-v8n,OV-2023.0,core,Intel® Core™ i5-13600K CPU-only,244.02,,96.78,0.742,1.952,329,125,1,329,125,6.96
yolo-v8n,OV-2023.0,core,Intel® Core™ i5-8500 CPU-only,84.64,,51.15,0.430,1.302,197,65,1,197,65,11.916
yolo-v8n,OV-2023.0,core,Intel® Core™ i7-1185G7 CPU-only,106.29,,39.77,0.250,3.796,426,28,1,426,28,10.673
yolo-v8n,OV-2023.0,core,Intel® Core™ i7-1185GRE CPU-only,76.65,,29.15,0.156,2.738,490,28,1,490,28,188.956
yolo-v8n,OV-2023.0,core,Intel® Core™ i7-8700T CPU-only,69.89,,57.02,0.231,1.997,303,35,1,303,35,16.595
yolo-v8n,OV-2023.0,core,Intel® Core™ i9-10900TE CPU-only,83.42,,49.70,0.171,2.383,488,35,1,488,35,14.081
yolo-v8n,OV-2023.0,core,Intel® Core™ i9-12900TE CPU-only,132.88,,51.98,0.244,3.796,544,35,1,544,35,10.104
yolo-v8n,OV-2023.0,core,Intel® Core™ i9-13900K CPU-only,379.01,,160.41,0.633,3.032,599,125,1,599,125,5.511
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® W1290P CPU-only,125.84,,74.97,0.212,1.007,594,125,1,594,125,6.46
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® E-2124G CPU-only,52.07,,32.87,0.209,0.733,249,71,1,249,71,19.471
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Gold 5218T CPU-only,449.63,,175.44,0.143,2.204,3144,204,2,1572,102,8.25
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8270 CPU-only,996.63,,459.95,0.059,2.431,16954,410,2,8477,205,5.159
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Silver 4216R CPU-only,432.72,,168.42,0.216,1.731,2004,250,2,1002,125,8.458
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8380 CPU-only,1686.49,,552.54,0.090,3.123,18718,540,2,9359,270,2.369
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Platinum 8490H CPU-only,2714.73,,1006.34,0.080,3.878,34000,700,2,17000,350,4.403
yolo-v8n,OV-2023.0,xeon,Intel® Xeon® Silver 4316 CPU-only,846.47,,341.19,0.372,2.822,2274,300,2,1137,150,3.308
yolo-v8n,OV-2023.0,core,Intel® Core™ i9-12900HK CPU-only,184.70,,72.61,0.265,4.104,697,45,1,697,45,7.542
yolo-v8n,OV-2023.0,atom,Intel® Celeron™ 6305E CPU-only,24.68,,9.60,0.231,1.645,107,15,1,107,15,40.111
yolo-v8n,OV-2023.0,accel,Intel® Flex-170 GPU,1205.32,1210.94,,0.626,8.035,1925,150,1,1925,150,12.951
yolo-v8n,OV-2023.0,core-iGPU,Intel® Core™ i7-1185GRE iGPU-only,154.20,106.82,,0.315,5.507,490,28,1,490,28,24.829
yolo-v8n,OV-2023.0,core-iGPU,Intel® Celeron™ 6305E GPU-only,0.00,82.53,,0.000,0.000,107,15,1,107,15,
yolo-v8n,OV-2023.0,core-CPU+iGPU,Intel® Core™ i7-1185GRE CPU+iGPU,116.95,,45.54,0.239,4.177,490,28,1,490,28,
yolo-v8n,OV-2023.0,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+GPU,111.94,,48.30,1.046,7.462,107,15,1,107,15,
end_rec,,,,,,,,,,,,,,
1 Network model Release IE-Type Platform name Throughput-INT8 Throughput-FP16 Throughput-FP32 Value Efficiency Price TDP Sockets Price/socket TDP/socket Latency
2 begin_rec
3 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i9-13900K CPU-only Intel® Atom™ x5-E3940 CPU-only 163.72 57.83 0.10 0.273 0.000 1.310 0.000 $599 34 125 9.5 1 $599 34 125 9.5 15.53
4 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-13900K iGPU-only Intel® Core™ i3-8100 CPU-only 56.07 23.3 1.03 0.094 0.000 0.449 0.000 $599 117 125 65 1 $599 117 125 65 19.62
5 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-13900K CPU+iGPU Intel® Core™ i5-10500TE CPU-only 210.17 85.83 1.21 0.351 0.000 1.681 0.000 $599 214 125 35 1 $599 214 125 35
6 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-13600K CPU-only 128.05 45.94 2.94 0.389 0.000 1.024 0.000 $329 329 125 1 $329 329 125 12.71
7 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i5-13600K iGPU-only Intel® Core™ i5-8500 CPU-only 53.03 21.9 1.50 0.161 0.000 0.424 0.000 $329 197 125 65 1 $329 197 125 65 20.81
8 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i5-13600K CPU+iGPU Intel® Core™ i7-1185G7 CPU-only 163.33 64.74 1.25 0.496 0.000 1.307 0.000 $329 426 125 28 1 $329 426 125 28
9 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i7-1185GRE CPU-only 96.06 35.627 0.85 0.146 0.000 0.582 0.000 $658 490 165 28 1 $658 490 165 28 17.1432
10 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i7-8700T CPU-only 53.093 22.253 1.57 0.081 0.000 0.322 0.000 $658 303 165 35 1 $658 303 165 35 22.0002
11 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i9-10900TE CPU-only 108.306 44.797 1.28 0.165 0.000 0.656 0.000 $658 488 165 35 1 $658 488 165 35
12 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900TE CPU-only 2.763 1.332 1.48 0.081 0.000 0.291 0.000 $34 544 9.5 35 1 $34 544 9.5 35 350.2746
13 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i9-13900K CPU-only 5.694 2.002 4.26 0.085 0.000 0.475 0.000 $67 599 12 125 1 $67 599 12 125 183.1711
14 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Atom™ x6425E iGPU-only Intel® Xeon® W1290P CPU-only 16.11 10.009 1.45 0.240 0.000 1.343 0.000 $67 594 12 125 1 $67 594 12 125 79.7607
15 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Atom™ x6425E CPU+iGPU Intel® Xeon® E-2124G CPU-only 21.128 11.81 1.07 0.315 0.000 1.761 0.000 $67 249 12 71 1 $67 249 12 71
16 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Gold 5218T CPU-only 14.212 4.255 5.55 0.120 0.000 0.947 0.000 $118 3144 15 204 1 2 $118 1572 15 102 72.6516
17 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Celeron™ 6305E iGPU-only Intel® Xeon® Platinum 8270 CPU-only 18.983 8.696 14.00 0.161 0.000 1.266 0.000 $118 16954 15 410 1 2 $118 8477 15 205 62.9729
18 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Celeron™ 6305E CPU+iGPU Intel® Xeon® Silver 4216R CPU-only 30.866 12.087 5.30 0.262 0.000 2.058 0.000 $118 2004 15 250 1 2 $118 1002 15 125
19 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 6336Y CPU-only Intel® Xeon® Platinum 8380 CPU-only 645.77 213.877 22.00 0.138 0.000 1.745 0.000 $4,678 18718 370 540 2 $2,339 9359 185 270 6.7612
20 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i3-8100 CPU-only Intel® Xeon® Platinum 8490H CPU-only 23.721 14.457 29.03 0.203 0.000 0.365 0.000 $117 34000 65 700 1 2 $117 17000 65 350 44.0371
21 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-10500TE CPU-only Intel® Xeon® Silver 4316 CPU-only 30.141 16.38 11.26 0.141 0.000 0.861 0.000 $214 2274 35 300 1 2 $214 1137 35 150 46.6064
22 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i9-12900HK CPU-only 30.541 19.319 2.02 0.159 0.000 0.470 0.000 $192 697 65 45 1 $192 697 65 45 27.8871
23 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i7-8700T CPU-only Intel® Celeron™ 6305E CPU-only 41.504 22.75 0.30 0.137 0.000 1.186 0.000 $303 107 35 15 1 $303 107 35 15 27.974
24 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 core accel Intel® Core™ i9-10900TE CPU-only Intel® Flex-170 GPU 32.073 49.09 16.558 0.066 0.000 0.916 0.000 $488 1925 35 150 1 $488 1925 35 150 39.7617
25 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 xeon core-iGPU Intel® Xeon® W1290P CPU-only Intel® Core™ i7-1185GRE iGPU-only 69.053 1.57 40.243 0.116 0.000 0.552 0.000 $594 490 125 28 1 $594 490 125 28 18.309
26 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 xeon core-iGPU Intel® Xeon® E-2124G CPU-only Intel® Celeron™ 6305E GPU-only 23.402 2.27 14.614 0.094 0.000 0.330 0.000 $249 107 71 15 1 $249 107 71 15 44.8984
27 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 xeon core-CPU+iGPU Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 266.949 79.033 1.56 0.085 0.000 1.271 0.000 $3,144 490 210 28 2 1 $1,572 490 105 28 12.4065
28 bert-base-cased GPT-2 OV-2022.3-8991 OV-2023.0 xeon core-CPU+iGPU Intel® Xeon® Gold 6448Y CPU-only Intel® Celeron™ 6305E CPU+GPU 2090.76 1372.2 1368.68 1.48 0.292 0.000 4.646 0.000 $7,166 107 450 15 2 1 $3,583 107 225 15 4.61
29 bert-base-cased end_rec OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only 682.593 225.713 0.040 1.665 $16,954 410 2 $8,477 205 6.9035
30 bert-base-cased begin_rec OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only 256.994 75.502 0.128 1.028 $2,004 250 2 $1,002 125 13.0382
31 bert-base-cased bert-base-cased OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i7-1165G7 CPU-only Intel® Atom™ x5-E3940 CPU-only 64.632 3.05 18.394 1.33 0.138 0.090 2.308 0.321 $469 34 28 9.5 1 $469 34 28 9.5 17.638 354.611
32 bert-base-cased bert-base-cased OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i3-8100 CPU-only 95.656 23.94 44.056 14.89 0.204 0.205 3.416 0.368 $469 117 28 65 1 $469 117 28 65 14.1005 43.191
33 bert-base-cased bert-base-cased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i5-10500TE CPU-only 128.005 35.72 50.592 19.51 0.273 0.167 4.572 1.021 $469 214 28 35 1 $469 214 28 35 32.456
34 bert-base-cased bert-base-cased OV-2022.3-8991 OV-2023.0 accel core Intel® Flex-170 GPU Intel® Core™ i5-13600K CPU-only 906.3 124.63 348.52 44.62 0.471 0.379 6.042 0.997 $1,925 329 150 125 1 $1,925 329 150 125 7.381 15.855
35 end_rec bert-base-cased OV-2023.0 core Intel® Core™ i5-8500 CPU-only 37.95 22.57 0.193 0.584 197 65 1 197 65 27.794
36 begin_rec bert-base-cased OV-2023.0 core Intel® Core™ i7-1185G7 CPU-only 62.93 17.87 0.148 2.248 426 28 1 426 28 19.316
37 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i7-1185GRE CPU-only 51.72 50.36 17.6 14.91 0.086 0.103 0.414 1.798 $599 490 125 28 1 $599 490 125 28 49.13 21.583
38 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-13900K iGPU-only Intel® Core™ i7-8700T CPU-only 19.05 42.21 6.88 22.78 0.032 0.139 0.152 1.206 $599 303 125 35 1 $599 303 125 35 55.82 27.589
39 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-13900K CPU+iGPU Intel® Core™ i9-10900TE CPU-only 53 38.74 19.95 18.79 0.088 0.079 0.424 1.107 $599 488 125 35 1 $599 488 125 35 35.128
40 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i9-12900TE CPU-only 35.31 61.46 11.04 19.49 0.107 0.113 0.282 1.756 $329 544 125 35 1 $329 544 125 35 41.56 22.006
41 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i5-13600K iGPU-only Intel® Core™ i9-13900K CPU-only 17.93 180.30 6.46 68.74 0.054 0.301 0.143 1.442 $329 599 125 1 $329 599 125 59.37 13.181
42 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i5-13600K CPU+iGPU Intel® Xeon® W1290P CPU-only 43.42 64.34 16.19 35.79 0.132 0.108 0.347 0.515 $329 594 125 1 $329 594 125 18.403
43 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-12900K CPU-only Intel® Xeon® E-2124G CPU-only 7.714 23.46 3.093 14.60 0.012 0.094 0.047 0.330 $658 249 165 71 1 $658 249 165 71 155.3633 43.94
44 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i9-12900K iGPU-only Intel® Xeon® Gold 5218T CPU-only 5.617 269.69 1.978 80.01 0.009 0.086 0.034 1.322 $658 3144 165 204 1 2 $658 1572 165 102 181.8303 12.823
45 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i9-12900K CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only 10.602 678.10 3.753 222.26 0.016 0.040 0.064 1.654 $658 16954 165 410 1 2 $658 8477 165 205 7.567
46 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 atom xeon Intel® Atom™ x5-E3940 CPU-only Intel® Xeon® Silver 4216R CPU-only 0.272 258.75 0.125 76.54 0.008 0.129 0.029 1.035 $34 2004 9.5 250 1 2 $34 1002 9.5 125 3861.0657 13.326
47 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 atom xeon Intel® Atom™ x6425E CPU-only Intel® Xeon® Platinum 8380 CPU-only 0.488 1096.03 0.188 196.59 0.007 0.059 0.041 2.030 $67 18718 12 540 1 2 $67 9359 12 270 2090.8266 6.09
48 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Atom™ x6425E iGPU-only Intel® Xeon® Platinum 8490H CPU-only 1.395 3372.80 0.774 445.48 0.021 0.099 0.116 4.818 $67 34000 12 700 1 2 $67 17000 12 350 727.6781 4.869
49 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Atom™ x6425E CPU+iGPU Intel® Xeon® Silver 4316 CPU-only 1.827 533.66 0.845 171.12 0.027 0.235 0.152 1.779 $67 2274 12 300 1 2 $67 1137 12 150 7.683
50 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 atom core Intel® Celeron™ 6305E CPU-only Intel® Core™ i9-12900HK CPU-only 1.199 85.32 0.377 25.90 0.010 0.122 0.080 1.896 $118 697 15 45 1 $118 697 15 45 831.301 17.986
51 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-iGPU atom Intel® Celeron™ 6305E iGPU-only Intel® Celeron™ 6305E CPU-only 2.051 14.00 0.766 4.28 0.017 0.131 0.137 0.933 $118 107 15 1 $118 107 15 494.5363
52 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU accel Intel® Celeron™ 6305E CPU+iGPU Intel® Flex-170 GPU 3.118 670.48 582.97 1.127 0.026 0.348 0.208 4.470 $118 1925 15 150 1 $118 1925 15 150 23.469
53 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 xeon core-iGPU Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i7-1185GRE iGPU-only 43.436 77.37 37.02 17.379 0.009 0.158 0.117 2.763 $4,678 490 370 28 2 1 $2,339 490 185 28 52.2862 52.374
54 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core core-iGPU Intel® Core™ i3-8100 CPU-only Intel® Celeron™ 6305E GPU-only 2.067 47.15 32.01 1.278 0.018 0.441 0.032 3.144 $117 107 65 15 1 $117 107 65 15 495.0786 84.683
55 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core core-CPU+iGPU Intel® Core™ i5-10500TE CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 2.619 85.30 1.536 28.16 0.012 0.174 0.075 3.046 $214 490 35 28 1 $214 490 35 28 502.3687
56 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 OV-2023.0 core core-CPU+iGPU Intel® Core™ i5-8500 CPU-only Intel® Celeron™ 6305E CPU+GPU 2.72 56.20 1.679 24.79 0.014 0.525 0.042 3.747 $192 107 65 15 1 $192 107 65 15 320.168
57 bert-large-uncased-whole-word-masking-squad-0001 end_rec OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 3.625 2.11 0.012 0.104 $303 35 1 $303 35 309.2848
58 bert-large-uncased-whole-word-masking-squad-0001 begin_rec OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 2.906 1.693 0.006 0.083 $488 35 1 $488 35 386.4947
59 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 xeon atom Intel® Xeon® W1290P CPU-only Intel® Atom™ x5-E3940 CPU-only 4.801 0.26 2.729 0.13 0.008 0.038 0.028 $594 34 125 9.5 1 $594 34 125 9.5 200.0794 4055.305
60 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i3-8100 CPU-only 2.098 2.11 1.32 1.26 0.008 0.018 0.030 0.032 $249 117 71 65 1 $249 117 71 65 492.0938 492.094
61 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i5-10500TE CPU-only 21.062 2.98 7.021 1.75 0.007 0.014 0.100 0.085 $3,144 214 210 35 2 1 $1,572 214 105 35 101.4694 351.294
62 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i5-13600K CPU-only 651.95 9.17 378.57 384.02 3.72 0.091 0.028 1.449 0.073 $7,166 329 450 125 2 1 $3,583 329 225 125 12.87 149.645
63 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i5-8500 CPU-only 46.064 3.26 19.051 1.91 0.003 0.017 0.112 0.050 $16,954 197 410 65 2 1 $8,477 197 205 65 49.4869 308.597
64 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i7-1185G7 CPU-only 20.014 4.60 6.726 1.57 0.010 0.011 0.080 0.164 $2,004 426 250 28 2 1 $1,002 426 125 28 105.9423 230.241
65 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i7-1185GRE CPU-only 5.192 3.32 1.626 1.28 0.011 0.007 0.185 0.118 $469 490 28 1 $469 490 28 203.6311 271.873
66 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i7-8700T CPU-only 10.476 3.55 3.914 2.12 0.022 0.012 0.374 0.101 $469 303 28 35 1 $469 303 28 35 95.6598 295.498
67 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i9-10900TE CPU-only 11.75 3.14 4.168 1.76 0.025 0.006 0.420 0.090 $469 488 28 35 1 $469 488 28 35 335.174
68 bert-large-uncased-whole-word-masking-squad-0001 bert-large-uncased OV-2022.3-8991 OV-2023.0 accel core Intel® Flex-170 GPU Intel® Core™ i9-12900TE CPU-only 74.47 5.12 25.77 1.89 0.039 0.009 0.496 0.146 $1,925 544 150 35 1 $1,925 544 150 35 19.768 214.42
69 end_rec bert-large-uncased OV-2023.0 core Intel® Core™ i9-13900K CPU-only 14.40 6.09 0.024 0.115 599 125 1 599 125 115.336
70 begin_rec bert-large-uncased OV-2023.0 xeon Intel® Xeon® W1290P CPU-only 4.40 2.71 0.007 0.035 594 125 1 594 125 177.897
71 bert-large-uncased OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-13900K CPU-only Intel® Xeon® E-2124G CPU-only 184.93 2.12 63.79 1.30 0.309 0.008 1.479 0.030 $599 249 125 71 1 $599 249 125 71 10.31 481.442
72 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i9-13900K iGPU-only Intel® Xeon® Gold 5218T CPU-only 69.31 20.31 22.67 7.14 0.116 0.006 0.554 0.100 $599 3144 125 204 1 2 $599 1572 125 102 15.02 104.828
73 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i9-13900K CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only 191.48 46.48 62.99 19.65 0.320 0.003 1.532 0.113 $599 16954 125 410 1 2 $599 8477 125 205 50.292
74 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-13600K CPU-only Intel® Xeon® Silver 4216R CPU-only 139.02 19.27 48.48 6.83 0.423 0.010 1.112 0.077 $329 2004 125 250 1 2 $329 1002 125 10.48 109.226
75 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i5-13600K iGPU-only Intel® Xeon® Platinum 8380 CPU-only 65.55 74.00 21.24 26.69 0.199 0.004 0.524 0.137 $329 18718 125 540 1 2 $329 9359 125 270 16.12 39.549
76 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i5-13600K CPU+iGPU Intel® Xeon® Platinum 8490H CPU-only 154.19 125.14 52.87 44.52 0.469 0.004 1.234 0.179 $329 34000 125 700 1 2 $329 17000 125 350 23.947
77 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-12900K CPU-only Intel® Xeon® Silver 4316 CPU-only 99.078 37.60 36.552 14.83 0.151 0.017 0.600 0.125 $658 2274 165 300 1 2 $658 1137 165 150 11.269 60.208
78 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i9-12900HK CPU-only 57.707 6.79 13.789 2.68 0.088 0.010 0.350 0.151 $658 697 165 45 1 $658 697 165 45 16.263 181.85
79 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU atom Intel® Core™ i9-12900K CPU+iGPU Intel® Celeron™ 6305E CPU-only 115.59 1.10 39.82 0.38 0.176 0.010 0.701 0.073 $658 107 165 15 1 $658 107 165 15 883.753
80 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 atom accel Intel® Atom™ x5-E3940 CPU-only Intel® Flex-170 GPU 3.327 120.47 80.23 1.496 0.098 0.063 0.350 0.803 $34 1925 9.5 150 1 $34 1925 9.5 150 308.0916 132.308
81 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 atom core-iGPU Intel® Atom™ x6425E CPU-only Intel® Core™ i7-1185GRE iGPU-only 6.07 5.10 2.96 3.041 0.091 0.010 0.506 0.182 $67 490 12 28 1 $67 490 12 28 166.5404 788.772
82 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-iGPU Intel® Atom™ x6425E iGPU-only Intel® Celeron™ 6305E GPU-only 4.72 3.49 5.196 0.000 0.044 0.000 0.314 $67 107 12 15 1 $67 107 12 15 217.0439 815.785
83 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i7-1185GRE CPU+iGPU 9.877 5.05 7.145 2.95 0.147 0.010 0.823 0.180 $67 490 12 28 1 $67 490 12 28
84 deeplabv3 bert-large-uncased OV-2022.3-8991 OV-2023.0 atom core-CPU+iGPU Intel® Celeron™ 6305E CPU-only Intel® Celeron™ 6305E CPU+GPU 13.516 4.86 4.681 2.19 0.115 0.045 0.901 0.324 $118 107 15 1 $118 107 15 74.1061
85 deeplabv3 end_rec OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 22.35 4.635 0.189 1.490 $118 15 1 $118 15 42.9657
86 deeplabv3 begin_rec OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 34.576 8.955 0.293 2.305 $118 15 1 $118 15
87 deeplabv3 OV-2022.3-8991 OV-2023.0 xeon atom Intel® Xeon® Gold 6336Y CPU-only Intel® Atom™ x5-E3940 CPU-only 559.145 134.159 1.47 0.120 0.000 1.511 0.000 $4,678 34 370 9.5 2 1 $2,339 34 185 9.5 5.356 359.456
88 deeplabv3 OV-2022.3-8991 OV-2023.0 core core Intel® Core™ i3-8100 CPU-only 27.171 15.947 0.232 0.000 0.418 0.000 $117 117 65 1 $117 117 65 36.6584
89 deeplabv3 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 34.907 36.23 16.72 16.70 0.163 0.169 0.997 1.035 $214 214 35 1 $214 214 35 38.8986 32.374
90 deeplabv3 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-13600K CPU-only 35.07 95.00 20.497 41.09 0.183 0.289 0.540 0.760 $192 329 65 125 1 $192 329 65 125 22.1865 15.959
91 deeplabv3 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i5-8500 CPU-only 47.647 38.31 23.747 21.59 0.157 0.194 1.361 0.589 $303 197 35 65 1 $303 197 35 65 22.628 26.51
92 deeplabv3 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1185G7 CPU-only 36.559 54.05 18.235 16.27 0.075 0.127 1.045 1.930 $488 426 35 28 1 $488 426 35 28 27.138 20.652
93 deeplabv3 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i7-1185GRE CPU-only 79.42 34.93 21.03 10.57 0.134 0.071 0.635 1.247 $594 490 125 28 1 $594 490 125 28 12.8397 27.622
94 deeplabv3 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i7-8700T CPU-only 26.173 16.906 0.105 0.000 0.369 0.000 $249 303 71 35 1 $249 303 71 35 37.9245
95 deeplabv3 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i9-10900TE CPU-only 248.049 38.14 81.667 18.17 0.079 0.078 1.181 1.090 $3,144 488 210 35 2 1 $1,572 488 105 35 8.9485 27.35
96 deeplabv3 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i9-12900TE CPU-only 1139.5 59.94 702.28 699.04 23.05 0.159 0.110 2.532 1.713 $7,166 544 450 35 2 1 $3,583 544 225 35 2.47 20.76
97 deeplabv3 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i9-13900K CPU-only 632.113 148.05 168.65 58.47 0.037 0.247 1.542 1.184 $16,954 599 410 125 2 1 $8,477 599 205 125 4.0073 12.241
98 deeplabv3 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® W1290P CPU-only 241.703 78.963 0.121 0.000 0.967 0.000 $2,004 594 250 125 2 1 $1,002 594 125 9.356
99 deeplabv3 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i7-1165G7 CPU-only Intel® Xeon® E-2124G CPU-only 64.13 18.519 0.137 0.000 2.290 0.000 $469 249 28 71 1 $469 249 28 71 16.6586
100 deeplabv3 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i7-1165G7 iGPU-only Intel® Xeon® Gold 5218T CPU-only 104.926 24.592 77.92 0.224 0.000 3.747 0.000 $469 3144 28 204 1 2 $469 1572 28 102 9.1435
101 deeplabv3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i7-1165G7 CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only 121.441 30.498 0.259 0.000 4.337 0.000 $469 16954 28 410 1 2 $469 8477 28 205
102 deeplabv3 OV-2022.3-8991 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Silver 4216R CPU-only 882.04 98.95 75.53 0.458 0.000 5.88 0.000 $1,925 2004 150 250 1 2 $1,925 1002 150 125 2.674
103 end_rec deeplabv3 OV-2023.0 xeon Intel® Xeon® Platinum 8380 CPU-only 649.53 229.92 0.035 1.203 18718 540 2 9359 270 3.405
104 begin_rec deeplabv3 OV-2023.0 xeon Intel® Xeon® Platinum 8490H CPU-only 1030.08 382.32 0.030 1.472 34000 700 2 17000 350 3.326
105 densenet-121 deeplabv3 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-13900K CPU-only Intel® Xeon® Silver 4316 CPU-only 777.86 410.93 284.56 141.37 1.299 0.181 6.223 1.370 $599 2274 125 300 1 2 $599 1137 125 150 3.26 5.875
106 densenet-121 deeplabv3 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-13900K iGPU-only Intel® Core™ i9-12900HK CPU-only 195.3 74.12 66.46 31.22 0.326 0.106 1.562 1.647 $599 697 125 45 1 $599 697 125 45 6.8 18.343
107 densenet-121 deeplabv3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU atom Intel® Core™ i9-13900K CPU+iGPU Intel® Celeron™ 6305E CPU-only 899.5 293.29 4.67 1.502 0.000 7.196 0.000 $599 107 125 15 1 $599 107 125 15
108 densenet-121 deeplabv3 OV-2022.3-8991 OV-2023.0 core accel Intel® Core™ i5-13600K CPU-only Intel® Flex-170 GPU 612.99 746.27 500.10 184.9 1.863 0.388 4.904 4.975 $329 1925 125 150 1 $329 1925 125 150 3.12 21.132
109 densenet-121 deeplabv3 OV-2022.3-8991 OV-2023.0 core-iGPU Intel® Core™ i5-13600K iGPU-only Intel® Core™ i7-1185GRE iGPU-only 178.37 78.43 13.79 62.69 0.542 0.160 1.427 2.801 $329 490 125 28 1 $329 490 125 28 8.37 49.979
110 densenet-121 deeplabv3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i5-13600K CPU+iGPU Intel® Celeron™ 6305E GPU-only 707.99 62.44 28.53 207.12 2.152 0.584 5.664 4.163 $329 107 125 15 1 $329 107 125 15 63.94
111 densenet-121 deeplabv3 OV-2022.3-8991 OV-2023.0 core core-CPU+iGPU Intel® Core™ i9-12900K CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 457.193 76.72 165.166 13.98 0.695 0.157 2.771 2.740 $658 490 165 28 1 $658 490 165 28 3.141
112 densenet-121 deeplabv3 OV-2022.3-8991 OV-2023.0 core-iGPU core-CPU+iGPU Intel® Core™ i9-12900K iGPU-only Intel® Celeron™ 6305E CPU+GPU 203.417 62.43 68.438 16.71 0.309 0.583 1.233 4.162 $658 107 165 15 1 $658 107 165 15 6.6728
113 densenet-121 end_rec OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 575.442 179.858 0.875 3.488 $658 165 1 $658 165
114 densenet-121 begin_rec OV-2022.3-8991 atom Intel® Atom™ x5-E3940 CPU-only 13.344 5.882 0.392 1.405 $34 9.5 1 $34 9.5 80.7014
115 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 atom Intel® Atom™ x6425E CPU-only Intel® Atom™ x5-E3940 CPU-only 24.172 3.76 10.554 2.64 0.361 0.111 2.014 0.396 $67 34 12 9.5 1 $67 34 12 9.5 43.668 290.489
116 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Atom™ x6425E iGPU-only Intel® Core™ i3-8100 CPU-only 33.53 30.615 23.96 0.000 0.287 0.000 0.516 $67 117 12 65 1 $67 117 12 65 30.0241 31.272
117 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i5-10500TE CPU-only 39.365 50.07 38.926 28.48 0.588 0.234 3.280 1.430 $67 214 12 35 1 $67 214 12 35 24.356
118 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 atom core Intel® Celeron™ 6305E CPU-only Intel® Core™ i5-13600K CPU-only 58.965 128.34 15.713 84.11 0.500 0.390 3.931 1.027 $118 329 15 125 1 $118 329 15 125 18.3425 13.005
119 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Celeron™ 6305E iGPU-only Intel® Core™ i5-8500 CPU-only 86.162 53.85 25.34 35.65 0.730 0.273 5.744 0.828 $118 197 15 65 1 $118 197 15 65 20.7907 20.31
120 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i7-1185G7 CPU-only 140.891 69.87 39.929 39.11 1.194 0.164 9.393 2.495 $118 426 15 28 1 $118 426 15 28 17.366
121 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i7-1185GRE CPU-only 3094.742 47.89 701.32 20.09 0.662 0.098 8.364 1.710 $4,678 490 370 28 2 1 $2,339 490 185 28 2.131 23.549
122 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core core Intel® Core™ i3-8100 CPU-only Intel® Core™ i7-8700T CPU-only 120.121 47.53 66.624 37.79 1.027 0.157 1.848 1.358 $117 303 65 35 1 $117 303 65 35 9.3755
123 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only Intel® Core™ i9-10900TE CPU-only 142.623 54.67 80.872 32.54 0.666 0.112 4.075 1.562 $214 488 35 1 $214 488 35 10.2536 21.202
124 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i9-12900TE CPU-only 149.112 71.50 85.051 45.10 0.777 0.131 2.294 2.043 $192 544 65 35 1 $192 544 65 35 6.0817 17.778
125 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i9-13900K CPU-only 194.559 192.62 111.988 104.56 0.642 0.322 5.559 1.541 $303 599 35 125 1 $303 599 35 125 6.1906 10.4
126 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-10900TE CPU-only Intel® Xeon® W1290P CPU-only 146.463 92.53 69.186 35.06 0.300 0.156 4.185 0.740 $488 594 35 125 1 $488 594 35 125 8.6496 13.425
127 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only Intel® Xeon® E-2124G CPU-only 360.501 32.46 182.543 25.97 0.607 0.130 2.884 0.457 $594 249 125 71 1 $594 249 125 71 3.6046 32.052
128 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only Intel® Xeon® Gold 5218T CPU-only 114.844 236.75 67.188 163.08 0.461 0.075 1.618 1.161 $249 3144 71 204 1 2 $249 1572 71 102 9.7609 12.998
129 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only Intel® Xeon® Platinum 8270 CPU-only 1116.372 458.66 295.952 294.01 0.355 0.027 5.316 1.119 $3,144 16954 210 410 2 $1,572 8477 105 205 3.9606 8.596
130 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 6448Y CPU-only Intel® Xeon® Silver 4216R CPU-only 8279.14 228.21 4856.54 4862.51 157.38 1.155 0.114 18.398 0.913 $7,166 2004 450 250 2 $3,583 1002 225 125 2.39 13.312
131 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® Platinum 8380 CPU-only 3155.106 709.57 815.725 452.65 0.186 0.038 7.695 1.314 $16,954 18718 410 540 2 $8,477 9359 205 270 2.8831 9.742
132 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® Platinum 8490H CPU-only 1064.824 922.74 283.423 791.57 0.531 0.027 4.259 1.318 $2,004 34000 250 700 2 $1,002 17000 125 350 4.0689 6.149
133 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i7-1165G7 CPU-only Intel® Xeon® Silver 4316 CPU-only 265.167 416.01 74.501 270.46 0.565 0.183 9.470 1.387 $469 2274 28 300 1 2 $469 1137 28 150 4.7413 8.366
134 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i9-12900HK CPU-only 391.185 97.01 123.519 57.69 0.834 0.139 13.971 2.156 $469 697 28 45 1 $469 697 28 45 6.5259 14.749
135 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU atom Intel® Core™ i7-1165G7 CPU+iGPU Intel® Celeron™ 6305E CPU-only 526.12 17.79 150.35 11.10 1.122 0.166 18.790 1.186 $469 107 28 15 1 $469 107 28 15 61.812
136 densenet-121 efficientdet-d0 OV-2022.3-8991 OV-2023.0 accel Intel® Flex-170 GPU 3440.18 684.48 1178.68 640.17 1.787 0.356 22.935 4.563 $1,925 1925 150 1 $1,925 1925 150 3.302 22.702
137 end_rec efficientdet-d0 OV-2023.0 core-iGPU Intel® Core™ i7-1185GRE iGPU-only 61.69 24.16 0.126 2.203 490 28 1 490 28 63.923
138 begin_rec efficientdet-d0 OV-2023.0 core-iGPU Intel® Celeron™ 6305E GPU-only 66.61 60.60 0.623 4.441 107 15 1 107 15 59.789
139 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core core-CPU+iGPU Intel® Core™ i9-13900K CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 209.26 61.69 106.11 24.13 0.349 0.126 1.674 2.203 $599 490 125 28 1 $599 490 125 28 10.36
140 efficientdet-d0 OV-2022.3-8991 OV-2023.0 core-iGPU core-CPU+iGPU Intel® Core™ i9-13900K iGPU-only Intel® Celeron™ 6305E CPU+GPU 82.04 66.61 47.85 33.76 0.137 0.623 0.656 4.441 $599 107 125 15 1 $599 107 125 15 22.35
141 efficientdet-d0 end_rec OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-13900K CPU+iGPU 197.85 108.3 0.330 1.583 $599 125 1 $599 125
142 efficientdet-d0 begin_rec OV-2022.3-8991 core Intel® Core™ i5-13600K CPU-only 155.65 90.91 0.473 1.245 $329 125 1 $329 125 9.92
143 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-iGPU atom Intel® Core™ i5-13600K iGPU-only Intel® Atom™ x5-E3940 CPU-only 77.28 0.31 44.91 0.13 0.235 0.009 0.618 0.032 $329 34 125 9.5 1 $329 34 125 9.5 22.93 3336.101
144 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i5-13600K CPU+iGPU Intel® Core™ i3-8100 CPU-only 172.54 2.89 95.94 1.51 0.524 0.025 1.380 0.045 $329 117 125 65 1 $329 117 125 65 358.208
145 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i5-10500TE CPU-only 112.297 4.22 64.06 2.26 0.171 0.020 0.681 0.120 $658 214 165 35 1 $658 214 165 35 11.8265 307.053
146 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i5-13600K CPU-only 73.766 13.04 38.742 4.32 0.112 0.040 0.447 0.104 $658 329 165 125 1 $658 329 165 125 21.403 163.824
147 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i5-8500 CPU-only 128.735 4.59 76.62 2.39 0.196 0.023 0.780 0.071 $658 197 165 65 1 $658 197 165 65 247.538
148 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i7-1185G7 CPU-only 3.812 6.74 2.565 1.78 0.112 0.016 0.401 0.241 $34 426 9.5 28 1 $34 426 9.5 28 274.5947 165.661
149 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i7-1185GRE CPU-only 7.248 5.16 5.17 1.43 0.108 0.011 0.604 0.184 $67 490 12 28 1 $67 490 12 28 143.7999 199.974
150 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Atom™ x6425E iGPU-only Intel® Core™ i7-8700T CPU-only 22.697 4.87 15.635 2.66 0.339 0.016 1.891 0.139 $67 303 12 35 1 $67 303 12 35 59.0651 264.983
151 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i9-10900TE CPU-only 26.855 4.42 17.296 2.27 0.401 0.009 2.238 0.126 $67 488 12 35 1 $67 488 12 35 252.35
152 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 atom core Intel® Celeron™ 6305E CPU-only Intel® Core™ i9-12900TE CPU-only 15.949 7.29 10.417 2.34 0.135 0.013 1.063 0.208 $118 544 15 35 1 $118 544 15 35 62.2765 188.868
153 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Celeron™ 6305E iGPU-only Intel® Core™ i9-13900K CPU-only 25.936 21.05 14.073 7.31 0.220 0.035 1.729 0.168 $118 599 15 125 1 $118 599 15 125 54.0166 111.671
154 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Celeron™ 6305E CPU+iGPU Intel® Xeon® W1290P CPU-only 32.767 8.65 20.733 4.36 0.278 0.015 2.184 0.069 $118 594 15 125 1 $118 594 15 125 139.23
155 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 6336Y CPU-only Intel® Xeon® E-2124G CPU-only 424.388 2.78 256.503 1.48 0.091 0.011 1.147 0.039 $4,678 249 370 71 2 1 $2,339 249 185 71 363.574
156 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i3-8100 CPU-only Intel® Xeon® Gold 5218T CPU-only 36.666 29.15 24.041 8.22 0.313 0.009 0.564 0.143 $117 3144 65 204 1 2 $117 1572 65 102 30.2521 77.579
157 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-10500TE CPU-only Intel® Xeon® Platinum 8270 CPU-only 45.331 85.87 26.92 22.37 0.212 0.005 1.295 0.209 $214 16954 35 410 1 2 $214 8477 35 205 32.8946 30.369
158 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-8500 CPU-only Intel® Xeon® Silver 4216R CPU-only 44.921 27.70 32.357 7.83 0.234 0.014 0.691 0.111 $192 2004 65 250 1 2 $192 1002 65 125 19.7048 79.52
159 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i7-8700T CPU-only Intel® Xeon® Platinum 8380 CPU-only 62.749 112.09 37.807 32.42 0.207 0.006 1.793 0.208 $303 18718 35 540 1 2 $303 9359 35 270 19.901 89.144
160 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-10900TE CPU-only Intel® Xeon® Platinum 8490H CPU-only 50.35 417.49 29.935 50.54 0.103 0.012 1.439 0.596 $488 34000 35 700 1 2 $488 17000 35 350 24.2916 10.171
161 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only Intel® Xeon® Silver 4316 CPU-only 94.981 65.13 36.434 16.92 0.160 0.029 0.760 0.217 $594 2274 125 300 1 2 $594 1137 125 150 12.658 42.66
162 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-12900HK CPU-only 35.831 10.07 27.306 3.25 0.144 0.014 0.505 0.224 $249 697 71 45 1 $249 697 71 45 30.9469 173.006
163 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Celeron™ 6305E CPU-only 239.06 1.60 161.224 0.42 0.076 0.015 1.138 0.106 $3,144 107 210 15 2 1 $1,572 107 105 15 13.9735 640.412
164 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 xeon accel Intel® Xeon® Gold 6448Y CPU-only Intel® Flex-170 GPU 875.53 222.32 495.04 144.56 492.93 0.122 0.115 1.946 1.482 $7,166 1925 450 150 2 1 $3,583 1925 225 150 5.07 71.569
165 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 xeon core-iGPU Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i7-1185GRE iGPU-only 471.02 13.38 2.37 300.291 0.028 0.027 1.149 0.478 $16,954 490 410 28 2 1 $8,477 490 205 28 9.3866 298.019
166 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 xeon core-iGPU Intel® Xeon® Silver 4216R CPU-only Intel® Celeron™ 6305E GPU-only 231.873 8.22 4.09 156.285 0.116 0.077 0.927 0.548 $2,004 107 250 15 2 1 $1,002 107 125 15 14.1605 475.77
167 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core core-CPU+iGPU Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 71.482 13.31 41.123 2.38 0.152 0.027 2.553 0.475 $469 490 28 1 $469 490 28 16.6952
168 efficientdet-d0 faster_rcnn_resnet50_coco OV-2022.3-8991 OV-2023.0 core-iGPU core-CPU+iGPU Intel® Core™ i7-1165G7 iGPU-only Intel® Celeron™ 6305E CPU+GPU 92.52 8.21 50.538 1.83 0.197 0.077 3.304 0.547 $469 107 28 15 1 $469 107 28 15 17.295
169 efficientdet-d0 end_rec OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 107.688 56.901 0.230 3.846 $469 28 1 $469 28
170 efficientdet-d0 begin_rec OV-2022.3-8991 accel Intel® Flex-170 GPU 463.67 295.13 0.241 3.091 $1,925 150 1 $1,925 150 5.603
171 end_rec inception-v4 OV-2023.0 atom Intel® Atom™ x5-E3940 CPU-only 3.19 1.34 0.094 0.335 34 9.5 1 34 9.5 330.309
172 begin_rec inception-v4 OV-2023.0 core Intel® Core™ i3-8100 CPU-only 29.71 15.29 0.254 0.457 117 65 1 117 65 34.592
173 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i5-10500TE CPU-only 5.94 42.94 2.41 22.86 0.010 0.201 0.048 1.227 $599 214 125 35 1 $599 214 125 35 270.57 25.956
174 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-13900K iGPU-only Intel® Core™ i5-13600K CPU-only 2.3 147.72 0.71 42.20 0.004 0.449 0.018 1.182 $599 329 125 1 $599 329 125 437.94 15.377
175 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-13900K CPU+iGPU Intel® Core™ i5-8500 CPU-only 6.45 47.19 2.25 23.81 0.011 0.240 0.052 0.726 $599 197 125 65 1 $599 197 125 65 21.506
176 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i7-1185G7 CPU-only 4.55 68.56 1.88 17.47 0.014 0.161 0.036 2.449 $329 426 125 28 1 $329 426 125 28 310.58 16.906
177 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i5-13600K iGPU-only Intel® Core™ i7-1185GRE CPU-only 2.17 55.82 0.67 14.00 0.007 0.114 0.017 1.994 $329 490 125 28 1 $329 490 125 28 465.03 19.042
178 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i5-13600K CPU+iGPU Intel® Core™ i7-8700T CPU-only 5.3 49.05 2.01 26.55 0.016 0.162 0.042 1.401 $329 303 125 35 1 $329 303 125 35 22.154
179 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i9-10900TE CPU-only 12.921 45.87 4.016 22.92 0.020 0.094 0.078 1.311 $658 488 165 35 1 $658 488 165 35 89.8929 24.899
180 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i9-12900TE CPU-only 6.802 80.22 1.82 22.64 0.010 0.147 0.041 2.292 $658 544 165 35 1 $658 544 165 35 149.7396 19.511
181 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i9-13900K CPU-only 15.679 224.68 4.499 71.78 0.024 0.375 0.095 1.797 $658 599 165 125 1 $658 599 165 125 11.8
182 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 atom xeon Intel® Atom™ x5-E3940 CPU-only Intel® Xeon® W1290P CPU-only 0.32 91.41 0.131 42.89 0.009 0.154 0.034 0.731 $34 594 9.5 125 1 $34 594 9.5 125 3206.1652 12.94
183 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 atom xeon Intel® Atom™ x6425E CPU-only Intel® Xeon® E-2124G CPU-only 0.592 28.17 0.242 14.89 0.009 0.113 0.049 0.397 $67 249 12 71 1 $67 249 12 71 1727.27 36.364
184 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Atom™ x6425E iGPU-only Intel® Xeon® Gold 5218T CPU-only 1.301 302.16 0.728 77.16 0.019 0.096 0.108 1.481 $67 3144 12 204 1 2 $67 1572 12 102 776.0692 10.627
185 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Atom™ x6425E CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only 1.683 950.44 0.865 228.44 0.025 0.056 0.140 2.318 $67 16954 12 410 1 2 $67 8477 12 205 5.714
186 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Silver 4216R CPU-only 1.563 287.12 0.417 73.94 0.013 0.143 0.104 1.148 $118 2004 15 250 1 2 $118 1002 15 125 640.0005 11.352
187 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Celeron™ 6305E iGPU-only Intel® Xeon® Platinum 8380 CPU-only 2.616 1475.64 0.725 347.33 0.022 0.079 0.174 2.733 $118 18718 15 540 1 2 $118 9359 15 270 389.3563 3.339
188 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Celeron™ 6305E CPU+iGPU Intel® Xeon® Platinum 8490H CPU-only 4.056 5145.62 1.107 522.16 0.034 0.151 0.270 7.351 $118 34000 15 700 1 2 $118 17000 15 350 3.434
189 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 6336Y CPU-only Intel® Xeon® Silver 4316 CPU-only 74.93 730.64 19.965 169.52 0.016 0.321 0.203 2.435 $4,678 2274 370 300 2 $2,339 1137 185 150 65.5753 6.456
190 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core core Intel® Core™ i3-8100 CPU-only Intel® Core™ i9-12900HK CPU-only 2.988 111.78 1.473 31.98 0.026 0.160 0.046 2.484 $117 697 65 45 1 $117 697 65 45 340.7313 16.4
191 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E CPU-only 3.633 15.15 1.926 4.13 0.017 0.142 0.104 1.010 $214 107 35 15 1 $214 107 35 15 430.1967 65.483
192 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core accel Intel® Core™ i5-8500 CPU-only Intel® Flex-170 GPU 3.852 834.65 515.70 1.982 0.020 0.434 0.059 5.564 $192 1925 65 150 1 $192 1925 65 150 241.5513 18.9
193 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core core-iGPU Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185GRE iGPU-only 4.999 109.98 33.26 2.648 0.016 0.224 0.143 3.928 $303 490 35 28 1 $303 490 35 28 260.2284 36.221
194 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 core core-iGPU Intel® Core™ i9-10900TE CPU-only Intel® Celeron™ 6305E GPU-only 3.71 66.82 31.46 2.005 0.008 0.625 0.106 4.455 $488 107 35 15 1 $488 107 35 15 280.1493 59.758
195 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 xeon core-CPU+iGPU Intel® Xeon® W1290P CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 8.977 106.60 4.542 33.09 0.015 0.218 0.072 3.807 $594 490 125 28 1 $594 490 125 28 137.1747
196 faster_rcnn_resnet50_coco inception-v4 OV-2022.3-8991 OV-2023.0 xeon core-CPU+iGPU Intel® Xeon® E-2124G CPU-only Intel® Celeron™ 6305E CPU+GPU 2.867 66.82 1.464 18.62 0.012 0.624 0.040 4.455 $249 107 71 15 1 $249 107 71 15 353.2042
197 faster_rcnn_resnet50_coco end_rec OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 29.332 8.19 0.009 0.140 $3,144 210 2 $1,572 105 78.1722
198 faster_rcnn_resnet50_coco begin_rec OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 19.71 18.01 18.15 0.003 0.044 $7,166 450 2 $3,583 225 129.2
199 faster_rcnn_resnet50_coco mobilenet-ssd OV-2022.3-8991 OV-2023.0 xeon atom Intel® Xeon® Platinum 8270 CPU-only Intel® Atom™ x5-E3940 CPU-only 85.213 27.01 22.066 12.73 0.005 0.794 0.208 2.843 $16,954 34 410 9.5 2 1 $8,477 34 205 9.5 30.4317 39.576
200 faster_rcnn_resnet50_coco mobilenet-ssd OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i3-8100 CPU-only 27.847 7.786 140.58 0.014 0.000 0.111 0.000 $2,004 117 250 65 2 1 $1,002 117 125 65 78.6604
201 faster_rcnn_resnet50_coco mobilenet-ssd OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i5-10500TE CPU-only 7.027 344.62 1.855 201.93 0.015 1.610 0.251 9.846 $469 214 28 35 1 $469 214 28 35 151.8783 3.456
202 faster_rcnn_resnet50_coco mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i5-13600K CPU-only 13.823 1020.39 3.545 400.82 0.029 3.101 0.494 8.163 $469 329 28 125 1 $469 329 28 125 70.7933 1.993
203 faster_rcnn_resnet50_coco mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i5-8500 CPU-only 16.898 357.96 4.191 218.52 0.036 1.817 0.604 5.507 $469 197 28 65 1 $469 197 28 65 2.959
204 faster_rcnn_resnet50_coco mobilenet-ssd OV-2022.3-8991 OV-2023.0 accel core Intel® Flex-170 GPU Intel® Core™ i7-1185G7 CPU-only 216.3 548.92 23.42 158.26 0.112 1.289 1.442 19.604 $1,925 426 150 28 1 $1,925 426 150 28 9.137 2.105
205 end_rec mobilenet-ssd OV-2023.0 core Intel® Core™ i7-1185GRE CPU-only 441.91 112.33 0.902 15.783 490 28 1 490 28 2.364
206 begin_rec mobilenet-ssd OV-2023.0 core Intel® Core™ i7-8700T CPU-only 392.88 242.76 1.297 11.225 303 35 1 303 35 3.046
207 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i9-10900TE CPU-only 219.06 361.27 71.15 208.16 0.366 0.740 1.752 10.322 $599 488 125 35 1 $599 488 125 35 10.19 3.266
208 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-13900K iGPU-only Intel® Core™ i9-12900TE CPU-only 65.91 583.02 18.1 215.65 0.110 1.072 0.527 16.658 $599 544 125 35 1 $599 544 125 35 16.55 2.48
209 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-13900K CPU+iGPU Intel® Core™ i9-13900K CPU-only 279.58 1642.52 78.65 682.33 0.467 2.742 2.237 13.140 $599 599 125 1 $599 599 125 1.768
210 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-13600K CPU-only Intel® Xeon® W1290P CPU-only 171.19 736.72 45.8 0.520 1.240 1.370 5.894 $329 594 125 1 $329 594 125 9.14
211 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i5-13600K iGPU-only Intel® Xeon® E-2124G CPU-only 62.45 212.31 17.02 142.58 0.190 0.853 0.500 2.990 $329 249 125 71 1 $329 249 125 71 17.48
212 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i5-13600K CPU+iGPU Intel® Xeon® Gold 5218T CPU-only 219.02 2268.47 52.56 693.51 0.666 0.722 1.752 11.120 $329 3144 125 204 1 2 $329 1572 125 102 1.498
213 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-12900K CPU-only Intel® Xeon® Platinum 8270 CPU-only 121.813 6587.85 39.391 1822.35 0.185 0.389 0.738 16.068 $658 16954 165 410 1 2 $658 8477 165 205 11.0425 1.043
214 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i9-12900K iGPU-only Intel® Xeon® Silver 4216R CPU-only 71.229 2163.47 17.755 666.62 0.108 1.080 0.432 8.654 $658 2004 165 250 1 2 $658 1002 165 125 19.7132 1.55
215 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i9-12900K CPU+iGPU Intel® Xeon® Platinum 8380 CPU-only 175.049 11311.70 44.894 2529.80 0.266 0.604 1.061 20.948 $658 18718 165 540 1 2 $658 9359 165 270 0.697
216 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 atom xeon Intel® Atom™ x5-E3940 CPU-only Intel® Xeon® Platinum 8490H CPU-only 3.12 24846.06 1.344 3999.28 0.092 0.731 0.328 35.494 $34 34000 9.5 700 1 2 $34 17000 9.5 350 335.3712 0.836
217 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 atom xeon Intel® Atom™ x6425E CPU-only Intel® Xeon® Silver 4316 CPU-only 5.677 5398.00 2.364 1364.13 0.085 2.374 0.473 17.993 $67 2274 12 300 1 2 $67 1137 12 150 181.8897 0.805
218 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Atom™ x6425E iGPU-only Intel® Core™ i9-12900HK CPU-only 17.009 789.36 8.302 299.79 0.254 1.133 1.417 17.541 $67 697 12 45 1 $67 697 12 45 78.0548 2.072
219 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-CPU+iGPU atom Intel® Atom™ x6425E CPU+iGPU Intel® Celeron™ 6305E CPU-only 21.713 116.16 10.37 40.17 0.324 1.086 1.809 7.744 $67 107 12 15 1 $67 107 12 15 8.471
220 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 atom accel Intel® Celeron™ 6305E CPU-only Intel® Flex-170 GPU 15.576 4127.47 3257.04 4.073 0.132 2.144 1.038 27.516 $118 1925 15 150 1 $118 1925 15 150 65.7272 3.643
221 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-iGPU Intel® Celeron™ 6305E iGPU-only Intel® Core™ i7-1185GRE iGPU-only 28.105 626.92 201.13 6.681 0.238 1.279 1.874 22.390 $118 490 15 28 1 $118 490 15 28 46.2616 6.243
222 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+iGPU Intel® Celeron™ 6305E GPU-only 41.918 238.03 10.163 0.355 0.000 2.795 0.000 $118 107 15 1 $118 107 15 8.633
223 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 xeon core-CPU+iGPU Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 881.403 619.19 205.296 199.95 0.188 1.264 2.382 22.114 $4,678 490 370 28 2 1 $2,339 490 185 28 4.7029
224 Inception-V4 mobilenet-ssd OV-2022.3-8991 OV-2023.0 core core-CPU+iGPU Intel® Core™ i3-8100 CPU-only Intel® Celeron™ 6305E CPU+GPU 30.004 453.39 15.51 149.06 0.256 4.237 0.462 30.226 $117 107 65 15 1 $117 107 65 15 35.0513
225 Inception-V4 end_rec OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 35.882 19.222 0.168 1.025 $214 35 1 $214 35 37.6472
226 Inception-V4 begin_rec OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 37.987 19.998 0.198 0.584 $192 65 1 $192 65 21.5144
227 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i7-8700T CPU-only Intel® Atom™ x5-E3940 CPU-only 48.903 26.356 45.44 0.161 0.000 1.397 0.000 $303 34 35 9.5 1 $303 34 35 9.5 22.2402 14.506
228 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i3-8100 CPU-only 37.301 19.475 456.87 0.076 0.000 1.066 0.000 $488 117 35 65 1 $488 117 35 65 28.572
229 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i5-10500TE CPU-only 92.646 884.87 44.966 483.11 0.156 4.135 0.741 25.282 $594 214 125 35 1 $594 214 125 35 12.3153 1.557
230 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i5-13600K CPU-only 28.537 2634.22 15.13 1305.55 0.115 8.007 0.402 21.074 $249 329 71 125 1 $249 329 71 125 36.8888 0.959
231 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i5-8500 CPU-only 301.215 880.67 77.005 684.15 0.096 4.470 1.434 13.549 $3,144 197 210 65 2 1 $1,572 197 105 65 10.5711 1.33
232 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i7-1185G7 CPU-only 3406.7 1384.37 1879.09 1867.99 520.06 0.475 3.250 7.570 49.442 $7,166 426 450 28 2 1 $3,583 426 225 28 3.23 0.93
233 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i7-1185GRE CPU-only 937.139 1092.57 225.776 315.10 0.055 2.230 2.286 39.020 $16,954 490 410 28 2 1 $8,477 490 205 28 5.6984 1.025
234 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i7-8700T CPU-only 287.767 73.617 670.65 0.144 0.000 1.151 0.000 $2,004 303 250 35 2 1 $1,002 303 125 35 11.1114
235 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i9-10900TE CPU-only 71.295 922.31 18.482 638.15 0.152 1.890 2.546 26.352 $469 488 28 35 1 $469 488 28 35 15.8294 1.518
236 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i9-12900TE CPU-only 158.282 1271.36 36.884 687.61 0.337 2.337 5.653 36.325 $469 544 28 35 1 $469 544 28 35 10.6245 1.229
237 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i9-13900K CPU-only 182.132 4077.41 44.198 2121.84 0.388 6.807 6.505 32.619 $469 599 28 125 1 $469 599 28 125 0.76
238 Inception-V4 mobilenet-v2 OV-2022.3-8991 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® W1290P CPU-only 2986.91 298.6 1.552 0.000 19.913 0.000 $1,925 594 150 125 1 $1,925 594 150 125 3.968
239 end_rec mobilenet-v2 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only 0.000 0.000 249 71 1 249 71
240 begin_rec mobilenet-v2 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only 5589.81 1920.53 1.778 27.401 3144 204 2 1572 102 1.349
241 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-13900K CPU-only Intel® Xeon® Platinum 8270 CPU-only 1754.44 15333.06 664.82 4417.85 2.929 0.904 14.036 37.398 $599 16954 125 410 1 2 $599 8477 125 205 1.4 0.843
242 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i9-13900K iGPU-only Intel® Xeon® Silver 4216R CPU-only 528.03 5405.01 168.57 1859.79 0.882 2.697 4.224 21.620 $599 2004 125 250 1 2 $599 1002 125 2.35 1.374
243 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i9-13900K CPU+iGPU Intel® Xeon® Platinum 8380 CPU-only 1568.83 23186.39 665.79 6910.90 2.619 1.239 12.551 42.938 $599 18718 125 540 1 2 $599 9359 125 270 0.519
244 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-13600K CPU-only Intel® Xeon® Platinum 8490H CPU-only 1240.01 35768.42 437.11 10976.35 3.769 1.052 9.920 51.098 $329 34000 125 700 1 2 $329 17000 125 350 1.47 0.618
245 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i5-13600K iGPU-only Intel® Xeon® Silver 4316 CPU-only 493.18 12752.22 157.94 3600.85 1.499 5.608 3.945 42.507 $329 2274 125 300 1 2 $329 1137 125 150 2.43 0.51
246 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i5-13600K CPU+iGPU Intel® Core™ i9-12900HK CPU-only 1063.27 1735.86 454.21 932.73 3.232 2.490 8.506 38.575 $329 697 125 45 1 $329 697 125 45 1.089
247 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i9-12900K CPU-only Intel® Celeron™ 6305E CPU-only 1054.462 346.546 133.14 1.603 0.000 6.391 0.000 $658 107 165 15 1 $658 107 165 15 1.4898 3.455
248 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-iGPU accel Intel® Core™ i9-12900K iGPU-only Intel® Flex-170 GPU 493.088 5411.37 5188.89 145.503 0.749 2.811 2.988 36.076 $658 1925 165 150 1 $658 1925 165 150 2.472 2.026
249 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 1056.241 929.63 350.08 361.472 1.605 1.897 6.401 33.201 $658 490 165 28 1 $658 490 165 28 4.227
250 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 atom core-iGPU Intel® Atom™ x5-E3940 CPU-only Intel® Celeron™ 6305E GPU-only 28.032 674.00 511.12 12.691 0.824 6.299 2.951 44.933 $34 107 9.5 15 1 $34 107 9.5 15 38.1991 5.591
251 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 atom core-CPU+iGPU Intel® Atom™ x6425E CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 50.352 922.11 23.675 350.46 0.752 1.882 4.196 32.933 $67 490 12 28 1 $67 490 12 28 20.8993
252 mobilenet-ssd mobilenet-v2 OV-2022.3-8991 OV-2023.0 core-iGPU core-CPU+iGPU Intel® Atom™ x6425E iGPU-only Intel® Celeron™ 6305E CPU+GPU 100.377 674.00 60.647 338.92 1.498 6.299 8.365 44.933 $67 107 12 15 1 $67 107 12 15 11.6812
253 mobilenet-ssd end_rec OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 148.458 79.575 2.216 12.372 $67 12 1 $67 12
254 mobilenet-ssd begin_rec OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 123.806 38.981 1.049 8.254 $118 15 1 $118 15 8.4121
255 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core-iGPU atom Intel® Celeron™ 6305E iGPU-only Intel® Atom™ x5-E3940 CPU-only 168.473 10.92 53.272 4.54 1.428 0.321 11.232 1.150 $118 34 15 9.5 1 $118 34 15 9.5 7.8961 94.518
256 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i3-8100 CPU-only 238.511 97.59 83.721 51.99 2.021 0.834 15.901 1.501 $118 117 15 65 1 $118 117 15 65 10.637
257 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i5-10500TE CPU-only 6730.68 144.61 1634.937 75.37 1.439 0.676 18.191 4.132 $4,678 214 370 35 2 1 $2,339 214 185 35 0.7265 8.098
258 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core core Intel® Core™ i3-8100 CPU-only Intel® Core™ i5-13600K CPU-only 244.598 500.94 140.009 143.02 2.091 1.523 3.763 4.008 $117 329 65 125 1 $117 329 65 125 4.4481 4.455
259 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only Intel® Core™ i5-8500 CPU-only 303.938 155.16 173.562 81.16 1.420 0.788 8.684 2.387 $214 197 35 65 1 $214 197 35 65 4.7946 6.957
260 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i7-1185G7 CPU-only 304.802 224.35 185.045 60.58 1.588 0.527 4.689 8.012 $192 426 65 28 1 $192 426 65 28 2.8007 5.088
261 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185GRE CPU-only 412.261 182.57 241.37 47.31 1.361 0.373 11.779 6.520 $303 490 35 28 1 $303 490 35 28 2.8749 51.708
262 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-8700T CPU-only 315.107 165.21 152.342 88.47 0.646 0.545 9.003 4.720 $488 303 35 1 $488 303 35 3.5896 7.106
263 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-10900TE CPU-only 774.346 155.09 345.309 77.88 1.304 0.318 6.195 4.431 $594 488 125 35 1 $594 488 125 35 1.5452 7.417
264 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-12900TE CPU-only 233.43 267.58 147.098 75.49 0.937 0.492 3.288 7.645 $249 544 71 35 1 $249 544 71 35 4.5879 5.351
265 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i9-13900K CPU-only 2331.207 763.64 691.743 241.72 0.741 1.275 11.101 6.109 $3,144 599 210 125 2 1 $1,572 599 105 125 1.4852 3.362
266 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 6448Y CPU-only Intel® Xeon® W1290P CPU-only 16445.75 319.70 8733.64 8626.42 148.80 2.295 0.538 36.546 2.558 $7,166 594 450 125 2 1 $3,583 594 225 125 0.65 3.733
267 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® E-2124G CPU-only 6691.915 93.19 1796.357 50.97 0.395 0.374 16.322 1.312 $16,954 249 410 71 2 1 $8,477 249 205 71 1.0518 11.014
268 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® Gold 5218T CPU-only 2225.935 968.34 667.692 269.28 1.111 0.308 8.904 4.747 $2,004 3144 250 204 2 $1,002 1572 125 102 1.5444 2.912
269 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i7-1165G7 CPU-only Intel® Xeon® Platinum 8270 CPU-only 579.307 2928.36 166.959 755.49 1.235 0.173 20.690 7.142 $469 16954 28 410 1 2 $469 8477 28 205 2.0215 1.501
270 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i7-1165G7 iGPU-only Intel® Xeon® Silver 4216R CPU-only 582.636 928.12 243.945 257.71 1.242 0.463 20.808 3.712 $469 2004 28 250 1 2 $469 1002 28 125 2.548 3.015
271 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i7-1165G7 CPU+iGPU Intel® Xeon® Platinum 8380 CPU-only 744.231 5006.83 292.071 1168.91 1.587 0.267 26.580 9.272 $469 18718 28 540 1 2 $469 9359 28 270 1.017
272 mobilenet-ssd resnet-50 OV-2022.3-8991 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Platinum 8490H CPU-only 3548.98 18906.26 1412.68 1671.79 1.844 0.556 23.66 27.009 $1,925 34000 150 700 1 2 $1,925 17000 150 350 1.344 1
273 end_rec resnet-50 OV-2023.0 xeon Intel® Xeon® Silver 4316 CPU-only 2292.86 570.35 1.008 7.643 2274 300 2 1137 150 1.465
274 begin_rec resnet-50 OV-2023.0 core Intel® Core™ i9-12900HK CPU-only 372.55 103.20 0.535 8.279 697 45 1 697 45 4.778
275 mobilenet-v2 resnet-50 OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i9-13900K CPU-only Intel® Celeron™ 6305E CPU-only 4041.77 50.13 2123.33 14.45 6.748 0.469 32.334 3.342 $599 107 125 15 1 $599 107 125 15 0.66 19.719
276 mobilenet-v2 resnet-50 OV-2022.3-8991 OV-2023.0 core-iGPU accel Intel® Core™ i9-13900K iGPU-only Intel® Flex-170 GPU 978.61 3088.38 1947.78 424.34 1.634 1.604 7.829 20.589 $599 1925 125 150 1 $599 1925 125 150 1.21 4.918
277 mobilenet-v2 resnet-50 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i9-13900K CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 4630.44 300.85 91.55 1944.62 7.730 0.614 37.044 10.744 $599 490 125 28 1 $599 490 125 28 13.174
278 mobilenet-v2 resnet-50 OV-2022.3-8991 OV-2023.0 core core-iGPU Intel® Core™ i5-13600K CPU-only Intel® Celeron™ 6305E GPU-only 3306.92 212.07 117.19 1403.57 10.051 1.982 26.455 14.138 $329 107 125 15 1 $329 107 125 15 0.65 18.751
279 mobilenet-v2 resnet-50 OV-2022.3-8991 OV-2023.0 core-iGPU core-CPU+iGPU Intel® Core™ i5-13600K iGPU-only Intel® Core™ i7-1185GRE CPU+iGPU 919.85 296.02 384.42 90.64 2.796 0.604 7.359 10.572 $329 490 125 28 1 $329 490 125 28 1.36
280 mobilenet-v2 resnet-50 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU Intel® Core™ i5-13600K CPU+iGPU Intel® Celeron™ 6305E CPU+GPU 3556.06 212.06 1332.32 66.73 10.809 1.982 28.448 14.137 $329 107 125 15 1 $329 107 125 15
281 mobilenet-v2 end_rec OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only 2446.221 1003.129 3.718 14.826 $658 165 1 $658 165 0.7182
282 mobilenet-v2 begin_rec OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only 1265.969 389.894 1.924 7.673 $658 165 1 $658 165 1.3894
283 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU atom Intel® Core™ i9-12900K CPU+iGPU Intel® Atom™ x5-E3940 CPU-only 2680.458 0.18 1013.049 0.08 4.074 0.005 16.245 0.019 $658 34 165 9.5 1 $658 34 165 9.5 5553.227
284 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i3-8100 CPU-only 81.572 1.69 45.013 0.97 2.399 0.014 8.587 0.026 $34 117 9.5 65 1 $34 117 9.5 65 13.4692 593.302
285 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i5-10500TE CPU-only 143.134 2.42 81.991 1.40 2.136 0.011 11.928 0.069 $67 214 12 35 1 $67 214 12 35 7.609 459.773
286 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Atom™ x6425E iGPU-only Intel® Core™ i5-13600K CPU-only 8.10 164.945 2.46 0.000 0.025 0.000 0.065 $67 329 12 125 1 $67 329 12 125 7.0306 207.938
287 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i5-8500 CPU-only 227.898 2.63 202.181 1.49 3.401 0.013 18.992 0.040 $67 197 12 65 1 $67 197 12 65 393.41
288 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 atom core Intel® Celeron™ 6305E CPU-only Intel® Core™ i7-1185G7 CPU-only 316.763 3.82 124.654 0.99 2.684 0.009 21.118 0.136 $118 426 15 28 1 $118 426 15 28 3.391 280.092
289 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Celeron™ 6305E iGPU-only Intel® Core™ i7-1185GRE CPU-only 525.084 3.15 141.61 0.82 4.450 0.006 35.006 0.113 $118 490 15 28 1 $118 490 15 28 4.9197 5.129
290 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i7-8700T CPU-only 807.397 2.78 255.964 1.61 6.842 0.009 53.826 0.080 $118 303 15 35 1 $118 303 15 35 399.367
291 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i9-10900TE CPU-only 14679.84 2.48 4065.139 1.38 3.138 0.005 39.675 0.071 $4,678 488 370 35 2 1 $2,339 488 185 35 0.4828 411.047
292 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core core Intel® Core™ i3-8100 CPU-only Intel® Core™ i9-12900TE CPU-only 619.507 4.07 452.366 1.34 5.295 0.007 9.531 0.116 $117 544 65 35 1 $117 544 65 35 1.8067 297.001
293 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only Intel® Core™ i9-13900K CPU-only 806.314 12.60 441.904 4.18 3.768 0.021 23.038 0.101 $214 599 35 125 1 $214 599 35 125 2.1078 157.718
294 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-8500 CPU-only Intel® Xeon® W1290P CPU-only 766.072 5.02 558.975 3.990 0.008 11.786 0.040 $192 594 65 125 1 $192 594 65 125 1.2307 200.705
295 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i7-8700T CPU-only Intel® Xeon® E-2124G CPU-only 1081.253 1.60 664.108 0.92 3.568 0.006 30.893 0.023 $303 249 35 71 1 $303 249 35 71 1.2788 622.798
296 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-10900TE CPU-only Intel® Xeon® Gold 5218T CPU-only 825.071 17.65 413.091 4.59 1.691 0.006 23.573 0.087 $488 3144 35 204 1 2 $488 1572 35 102 1.6818 116.003
297 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® W1290P CPU-only Intel® Xeon® Platinum 8270 CPU-only 2067.162 57.90 868.25 14.86 3.480 0.003 16.537 0.141 $594 16954 125 410 1 2 $594 8477 125 205 0.7363 36.506
298 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® E-2124G CPU-only Intel® Xeon® Silver 4216R CPU-only 594.283 16.78 479.567 4.37 2.387 0.008 8.370 0.067 $249 2004 71 250 1 2 $249 1002 71 125 1.8531 121.986
299 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 5218T CPU-only Intel® Xeon® Platinum 8380 CPU-only 5882.455 78.77 1895.498 20.79 1.871 0.004 28.012 0.146 $3,144 18718 210 540 2 $1,572 9359 105 270 1.3871 105.307
300 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 6448Y CPU-only Intel® Xeon® Platinum 8490H CPU-only 28383.76 440.92 16212.74 16065.38 31.41 3.961 0.013 63.075 0.630 $7,166 34000 450 700 2 $3,583 17000 225 350 0.55 8.63
301 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® Silver 4316 CPU-only 15616.083 42.62 4308.927 10.56 0.921 0.019 38.088 0.142 $16,954 2274 410 300 2 $8,477 1137 205 150 0.8685 60.312
302 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i9-12900HK CPU-only 5616.283 6.00 1835.686 1.85 2.803 0.009 22.465 0.133 $2,004 697 250 45 2 1 $1,002 697 125 45 1.404 241.005
303 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i7-1165G7 CPU-only Intel® Celeron™ 6305E CPU-only 1463.21 0.90 538.597 0.23 3.120 0.008 52.258 0.060 $469 107 28 15 1 $469 107 28 15 0.8864 1118.93
304 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core-iGPU accel Intel® Core™ i7-1165G7 iGPU-only Intel® Flex-170 GPU 2076.015 150.99 92.06 544.641 4.426 0.078 74.143 1.007 $469 1925 28 150 1 $469 1925 28 150 1.7212 105.863
305 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 2677.374 9.00 2.24 698.942 5.709 0.018 95.621 0.321 $469 490 28 1 $469 490 28 444.2
306 mobilenet-v2 ssd-resnet-34-1200 OV-2022.3-8991 OV-2023.0 accel core-iGPU Intel® Flex-170 GPU Intel® Celeron™ 6305E GPU-only 18371.95 5.04 4738.33 2.62 9.544 0.047 122.48 0.336 $1,925 107 150 15 1 $1,925 107 150 15 1.15 774.647
307 end_rec ssd-resnet-34-1200 OV-2023.0 core-CPU+iGPU Intel® Core™ i7-1185GRE CPU+iGPU 8.73 2.24 0.018 0.312 490 28 1 490 28
308 begin_rec ssd-resnet-34-1200 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E CPU+GPU 5.04 1.40 0.047 0.336 107 15 1 107 15
309 resnet-18 end_rec OV-2022.3-8991 core Intel® Core™ i9-13900K CPU-only 1495.77 415.82 2.497 11.966 $599 125 1 $599 125 1.38
310 resnet-18 begin_rec OV-2022.3-8991 core-iGPU Intel® Core™ i9-13900K iGPU-only 497.54 150.99 0.831 3.980 $599 125 1 $599 125 2.19
311 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU atom Intel® Core™ i9-13900K CPU+iGPU Intel® Atom™ x5-E3940 CPU-only 1821.4 615.14 0.04 3.041 0.000 14.571 0.000 $599 34 125 9.5 1 $599 34 125 9.5
312 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i3-8100 CPU-only 1169.04 336.09 1.55 3.553 0.000 9.352 0.000 $329 117 125 65 1 $329 117 125 65 1.5
313 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i5-13600K iGPU-only Intel® Core™ i5-10500TE CPU-only 467.43 141.76 2.25 1.421 0.000 3.739 0.000 $329 214 125 35 1 $329 214 125 35 2.36
314 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i5-13600K CPU+iGPU Intel® Core™ i5-13600K CPU-only 1443.42 445.25 4.02 4.387 0.000 11.547 0.000 $329 329 125 1 $329 329 125
315 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i5-8500 CPU-only 804.771 212.574 2.39 1.223 0.000 4.877 0.000 $658 197 165 65 1 $658 197 165 65 1.3886
316 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i7-1185G7 CPU-only 491.337 6.42 146.839 1.61 0.747 0.015 2.978 0.229 $658 426 165 28 1 $658 426 165 28 2.2655 169.94
317 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i7-1185GRE CPU-only 1180.984 5.20 365.777 1.28 1.795 0.011 7.157 0.186 $658 490 165 28 1 $658 490 165 28 5.959
318 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i7-8700T CPU-only 22.96 9.564 2.60 0.675 0.000 2.417 0.000 $34 303 9.5 35 1 $34 303 9.5 35 44.5491
319 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i9-10900TE CPU-only 40.944 16.158 2.25 0.611 0.000 3.412 0.000 $67 488 12 35 1 $67 488 12 35 25.1377
320 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Atom™ x6425E iGPU-only Intel® Core™ i9-12900TE CPU-only 161.381 60.863 2.25 2.409 0.000 13.448 0.000 $67 544 12 35 1 $67 544 12 35 10.983
321 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i9-13900K CPU-only 197.477 73.927 6.89 2.947 0.000 16.456 0.000 $67 599 12 125 1 $67 599 12 125
322 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® W1290P CPU-only 105.574 28.914 4.54 0.895 0.000 7.038 0.000 $118 594 15 125 1 $118 594 15 125 9.6165
323 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Celeron™ 6305E iGPU-only Intel® Xeon® E-2124G CPU-only 194.694 55.341 1.49 1.650 0.000 12.980 0.000 $118 249 15 71 1 $118 249 15 71 6.643
324 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Celeron™ 6305E CPU+iGPU Intel® Xeon® Gold 5218T CPU-only 291.441 29.07 82.105 7.34 2.470 0.009 19.429 0.142 $118 3144 15 204 1 2 $118 1572 15 102 71.813
325 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 xeon Intel® Xeon® Gold 6336Y CPU-only Intel® Xeon® Platinum 8270 CPU-only 5761.961 95.23 1431.864 21.78 1.232 0.006 15.573 0.232 $4,678 16954 370 410 2 $2,339 8477 185 205 0.6512 23.52
326 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i3-8100 CPU-only Intel® Xeon® Silver 4216R CPU-only 208.65 27.71 103.699 7.01 1.783 0.014 3.210 0.111 $117 2004 65 250 1 2 $117 1002 65 125 5.0231 74.843
327 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-10500TE CPU-only Intel® Xeon® Platinum 8380 CPU-only 252.987 129.48 127.448 31.77 1.182 0.007 7.228 0.240 $214 18718 35 540 1 2 $214 9359 35 270 5.2921 73.758
328 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-8500 CPU-only Intel® Xeon® Platinum 8490H CPU-only 262.785 505.87 134.002 48.40 1.369 0.015 4.043 0.723 $192 34000 65 700 1 2 $192 17000 65 350 3.0597 9.333
329 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i7-8700T CPU-only Intel® Xeon® Silver 4316 CPU-only 344.219 69.94 175.433 16.08 1.136 0.031 9.835 0.233 $303 2274 35 300 1 2 $303 1137 35 150 3.1665 42.347
330 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i9-12900HK CPU-only 265.351 8.65 130.166 3.05 0.544 0.012 7.581 0.192 $488 697 35 45 1 $488 697 35 45 4.0471 156.16
331 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 xeon atom Intel® Xeon® W1290P CPU-only Intel® Celeron™ 6305E CPU-only 654.533 1.49 307.741 0.38 1.102 0.014 5.236 0.100 $594 107 125 15 1 $594 107 125 15 1.6723 672.584
332 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 xeon accel Intel® Xeon® E-2124G CPU-only Intel® Flex-170 GPU 198.189 254.48 144.90 101.399 0.796 0.132 2.791 1.697 $249 1925 71 150 1 $249 1925 71 150 5.2039 62.697
333 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 xeon core-iGPU Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i7-1185GRE iGPU-only 2017.368 15.74 4.26 547.47 0.642 0.032 9.607 0.562 $3,144 490 210 28 2 1 $1,572 490 105 28 1.2913 253.852
334 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 xeon core-iGPU Intel® Xeon® Gold 6448Y CPU-only Intel® Celeron™ 6305E GPU-only 27331.02 8.41 16095.24 4.37 16009.04 3.814 0.079 60.736 0.560 $7,166 107 450 15 2 1 $3,583 107 225 15 0.38 475.668
335 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 xeon core-CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 6320.391 15.72 1582.817 4.26 0.373 0.032 15.416 0.561 $16,954 490 410 28 2 1 $8,477 490 205 28 0.667
336 resnet-18 unet-camvid-onnx-0001 OV-2022.3-8991 OV-2023.0 xeon core-CPU+iGPU Intel® Xeon® Silver 4216R CPU-only Intel® Celeron™ 6305E CPU+GPU 1940.935 8.40 522.654 2.38 0.969 0.079 7.764 0.560 $2,004 107 250 15 2 1 $1,002 107 125 15 1.3451
337 resnet-18 end_rec OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 480.992 126.244 1.026 17.178 $469 28 1 $469 28 2.242
338 resnet-18 begin_rec OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 1061.591 297.705 2.264 37.914 $469 28 1 $469 28 1.793
339 resnet-18 yolo-v3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU atom Intel® Core™ i7-1165G7 CPU+iGPU Intel® Atom™ x5-E3940 CPU-only 1237.94 1.13 342.513 0.52 2.640 0.033 44.212 0.119 $469 34 28 9.5 1 $469 34 28 9.5 903.84
340 resnet-18 yolo-v3 OV-2022.3-8991 OV-2023.0 accel core Intel® Flex-170 GPU Intel® Core™ i3-8100 CPU-only 27454.08 10.63 2264.67 5.89 14.262 0.091 183.027 0.164 $1,925 117 150 65 1 $1,925 117 150 65 0.946 95.035
341 end_rec yolo-v3 OV-2023.0 core Intel® Core™ i5-10500TE CPU-only 15.37 8.39 0.072 0.439 214 35 1 214 35 74.286
342 begin_rec yolo-v3 OV-2023.0 core Intel® Core™ i5-13600K CPU-only 51.84 15.89 0.158 0.415 329 125 1 329 125 30.002
343 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-13900K CPU-only Intel® Core™ i5-8500 CPU-only 729.93 16.37 240.59 8.99 1.219 0.083 5.839 0.252 $599 197 125 65 1 $599 197 125 65 2.91 63.34
344 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i9-13900K iGPU-only Intel® Core™ i7-1185G7 CPU-only 238.44 23.65 68.18 6.47 0.398 0.056 1.908 0.845 $599 426 125 28 1 $599 426 125 28 4.74 46.28
345 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i9-13900K CPU+iGPU Intel® Core™ i7-1185GRE CPU-only 895.28 19.40 255.91 5.08 1.495 0.040 7.162 0.693 $599 490 125 28 1 $599 490 125 28 12.186
346 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i7-8700T CPU-only 576.86 17.61 153.71 9.85 1.753 0.058 4.615 0.503 $329 303 125 35 1 $329 303 125 35 3.04 59.526
347 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i5-13600K iGPU-only Intel® Core™ i9-10900TE CPU-only 216.97 16.06 64.36 8.39 0.659 0.033 1.736 0.459 $329 488 125 35 1 $329 488 125 35 5.3 68.144
348 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i5-13600K CPU+iGPU Intel® Core™ i9-12900TE CPU-only 717.91 27.93 188.59 8.41 2.182 0.051 5.743 0.798 $329 544 125 35 1 $329 544 125 35 42.848
349 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i9-13900K CPU-only 400.118 81.69 133.834 27.09 0.608 0.136 2.425 0.653 $658 599 165 125 1 $658 599 165 125 3.0384 23.63
350 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i9-12900K iGPU-only Intel® Xeon® W1290P CPU-only 229.863 32.62 66.122 14.28 0.349 0.055 1.393 0.261 $658 594 165 125 1 $658 594 165 125 5.2538 31.954
351 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i9-12900K CPU+iGPU Intel® Xeon® E-2124G CPU-only 574.341 10.06 155.749 5.72 0.873 0.040 3.481 0.142 $658 249 165 71 1 $658 249 165 71 100.121
352 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 atom xeon Intel® Atom™ x5-E3940 CPU-only Intel® Xeon® Gold 5218T CPU-only 11.094 105.44 4.516 29.93 0.326 0.034 1.168 0.517 $34 3144 9.5 204 1 2 $34 1572 9.5 102 92.6182 22.132
353 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 atom xeon Intel® Atom™ x6425E CPU-only Intel® Xeon® Platinum 8270 CPU-only 20.114 318.96 8.254 88.54 0.300 0.019 1.676 0.778 $67 16954 12 410 1 2 $67 8477 12 205 51.0598 10.667 ````
354 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Atom™ x6425E iGPU-only Intel® Xeon® Silver 4216R CPU-only 66.119 100.48 29.408 28.51 0.987 0.050 5.510 0.402 $67 2004 12 250 1 2 $67 1002 12 125 21.6857 23.175
355 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Atom™ x6425E CPU+iGPU Intel® Xeon® Platinum 8380 CPU-only 82.95 485.45 35.81 108.76 1.238 0.026 6.913 0.899 $67 18718 12 540 1 2 $67 9359 12 270 6.711
356 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Platinum 8490H CPU-only 52.004 2042.57 14.152 194.96 0.441 0.060 3.467 2.918 $118 34000 15 700 1 2 $118 17000 15 350 19.6053 3.286
357 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Celeron™ 6305E iGPU-only Intel® Xeon® Silver 4316 CPU-only 90.685 240.71 24.633 62.50 0.769 0.106 6.046 0.802 $118 2274 15 300 1 2 $118 1137 15 150 14.6415 13.918
358 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i9-12900HK CPU-only 140.062 39.77 37.864 11.97 1.187 0.057 9.337 0.884 $118 697 15 45 1 $118 697 15 45 - 34.872
359 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 xeon atom Intel® Xeon® Gold 6336Y CPU-only Intel® Celeron™ 6305E CPU-only 2793.997 5.45 691.079 1.55 0.597 0.051 7.551 0.363 $4,678 107 370 15 2 1 $2,339 107 185 15 1.3288 184.58
360 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core accel Intel® Core™ i3-8100 CPU-only Intel® Flex-170 GPU 102.328 715.46 313.59 52.896 0.875 0.372 1.574 4.770 $117 1925 65 150 1 $117 1925 65 150 10.4475 21.953
361 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core core-iGPU Intel® Core™ i5-10500TE CPU-only Intel® Core™ i7-1185GRE iGPU-only 123.574 59.07 13.71 63.836 0.577 0.121 3.531 2.110 $214 490 35 28 1 $214 490 35 28 11.6252 67.531
362 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core core-iGPU Intel® Core™ i5-8500 CPU-only Intel® Celeron™ 6305E GPU-only 129.174 32.01 15.01 68.242 0.673 0.299 1.987 2.134 $192 107 65 15 1 $192 107 65 15 6.8498 123.951
363 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core core-CPU+iGPU Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1185GRE CPU+iGPU 168.016 59.07 88.675 13.68 0.555 0.121 4.800 2.110 $303 490 35 28 1 $303 490 35 28 6.9723
364 resnet-50 yolo-v3 OV-2022.3-8991 OV-2023.0 core core-CPU+iGPU Intel® Core™ i9-10900TE CPU-only Intel® Celeron™ 6305E CPU+GPU 129.371 32.00 56.366 8.04 0.265 0.299 3.696 2.133 $488 107 35 15 1 $488 107 35 15 8.7659
365 resnet-50 end_rec OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 317.744 149.441 0.535 2.542 $594 125 1 $594 125 3.6469
366 resnet-50 begin_rec OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 97.606 52.17 0.392 1.375 $249 71 1 $249 71 10.851
367 resnet-50 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Atom™ x5-E3940 CPU-only 980.813 12.33 268.009 6.20 0.312 0.363 4.671 1.297 $3,144 34 210 9.5 2 1 $1,572 34 105 9.5 2.9838 82.686
368 resnet-50 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i3-8100 CPU-only 2905.803 112.45 748.583 65.06 0.405 0.961 6.457 1.730 $7,166 117 450 65 2 1 $3,583 117 225 65 1.475 8.957
369 resnet-50 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i5-10500TE CPU-only 11359.88 167.83 5494.15 5497.22 92.82 0.670 0.784 27.707 4.795 $16,954 214 410 35 2 1 $8,477 214 205 35 0.94 6.709
370 resnet-50 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i5-13600K CPU-only 937.572 600.04 255.866 199.22 0.468 1.824 3.750 4.800 $2,004 329 250 125 2 1 $1,002 329 125 3.0985 3.139
371 resnet-50 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i5-8500 CPU-only 235.061 176.01 63.241 99.54 0.501 0.893 8.395 2.708 $469 197 28 65 1 $469 197 28 65 4.7975 5.438
372 resnet-50 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i7-1185G7 CPU-only 504.247 241.89 125.407 75.37 1.075 0.568 18.009 8.639 $469 426 28 1 $469 426 28 4.7975 4.542
373 resnet-50 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i7-1185GRE CPU-only 595.133 203.84 150.024 57.67 1.269 0.416 21.255 7.280 $469 490 28 1 $469 490 28 4.7975 5.129
374 resnet-50 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 accel core Intel® Flex-170 GPU Intel® Core™ i7-8700T CPU-only 10810.92 191.07 1005.16 108.63 5.616 0.631 72.073 5.459 $1,925 303 150 35 1 $1,925 303 150 35 1.624 5.593
375 end_rec yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-10900TE CPU-only 180.44 92.86 0.370 5.155 488 35 1 488 35 6.282
376 begin_rec yolo_v3_tiny OV-2023.0 core Intel® Core™ i9-12900TE CPU-only 303.14 97.03 0.557 8.661 544 35 1 544 35 4.164
377 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-13900K CPU-only 11.75 900.78 4.24 306.13 0.020 1.504 0.094 7.206 $599 599 125 1 $599 599 125 162.07 2.541
378 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i9-13900K iGPU-only Intel® Xeon® W1290P CPU-only 4.5 349.17 1.45 170.15 0.008 0.588 0.036 2.793 $599 594 125 1 $599 594 125 226.99 2.953
379 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i9-13900K CPU+iGPU Intel® Xeon® E-2124G CPU-only 11.63 106.71 4.24 64.03 0.019 0.429 0.093 1.503 $599 249 125 71 1 $599 249 125 71 9.39
380 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i5-13600K CPU-only Intel® Xeon® Gold 5218T CPU-only 8.21 1052.16 2.7 339.30 0.025 0.335 0.066 5.158 $329 3144 125 204 1 2 $329 1572 125 102 147.53 2.514
381 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i5-13600K iGPU-only Intel® Xeon® Platinum 8270 CPU-only 4.22 2932.78 1.36 914.37 0.013 0.173 0.034 7.153 $329 16954 125 410 1 2 $329 8477 125 205 241.92 1.215
382 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i5-13600K CPU+iGPU Intel® Xeon® Silver 4216R CPU-only 8 1010.00 2.7 323.69 0.024 0.504 0.064 4.040 $329 2004 125 250 1 2 $329 1002 125 2.622
383 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-12900K CPU-only Intel® Xeon® Platinum 8380 CPU-only 6.712 4584.21 2.394 1374.00 0.010 0.245 0.041 8.489 $658 18718 165 540 1 2 $658 9359 165 270 175.7493 0.88
384 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i9-12900K iGPU-only Intel® Xeon® Platinum 8490H CPU-only 4.228 13092.13 1.262 2107.19 0.006 0.385 0.026 18.703 $658 34000 165 700 1 2 $658 17000 165 350 241.7838 1.149
385 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i9-12900K CPU+iGPU Intel® Xeon® Silver 4316 CPU-only 6.666 2217.64 2.393 704.05 0.010 0.975 0.040 7.392 $658 2274 165 300 1 2 $658 1137 165 150 1.321
386 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900HK CPU-only 0.171 433.83 0.081 136.36 0.005 0.622 0.018 9.641 $34 697 9.5 45 1 $34 697 9.5 45 5985.7525 3.411
387 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 atom Intel® Atom™ x6425E CPU-only Intel® Celeron™ 6305E CPU-only 0.31 54.23 0.133 18.05 0.005 0.507 0.026 3.615 $67 107 12 15 1 $67 107 12 15 3246.0878 18.195
388 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-iGPU accel Intel® Atom™ x6425E iGPU-only Intel® Flex-170 GPU 0.965 3196.82 2123.72 0.615 0.014 1.661 0.080 21.312 $67 1925 12 150 1 $67 1925 12 150 1053.0078 4.691
389 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-CPU+iGPU core-iGPU Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i7-1185GRE iGPU-only 0.31 507.33 136.58 0.133 0.005 1.035 0.026 18.119 $67 490 12 28 1 $67 490 12 28 7.675
390 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 atom core-iGPU Intel® Celeron™ 6305E CPU-only Intel® Celeron™ 6305E GPU-only 0.806 290.97 151.90 0.23 0.007 2.719 0.054 19.398 $118 107 15 1 $118 107 15 1240.6212 13.629
391 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-iGPU core-CPU+iGPU Intel® Celeron™ 6305E iGPU-only Intel® Core™ i7-1185GRE CPU+iGPU 1.582 505.40 0.486 136.40 0.013 1.031 0.105 18.050 $118 490 15 28 1 $118 490 15 28 649.3806
392 ssd-resnet34-1200 yolo_v3_tiny OV-2022.3-8991 OV-2023.0 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU Intel® Celeron™ 6305E CPU+GPU 0.806 290.97 0.231 86.08 0.007 2.719 0.054 19.398 $118 107 15 1 $118 107 15
393 ssd-resnet34-1200 end_rec OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 41.52 12.672 0.009 0.112 $4,678 370 2 $2,339 185 79.0111
394 ssd-resnet34-1200 begin_rec OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 1.606 0.959 0.014 0.025 $117 65 1 $117 65 644.0626
395 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 core atom Intel® Core™ i5-10500TE CPU-only Intel® Atom™ x5-E3940 CPU-only 1.932 5.69 1.177 3.01 0.009 0.167 0.055 0.598 $214 34 35 9.5 1 $214 34 35 9.5 712.3677 185.626
396 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i3-8100 CPU-only 2.067 53.97 1.248 33.14 0.011 0.461 0.032 0.830 $192 117 65 1 $192 117 65 401.8765 18.918
397 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i5-10500TE CPU-only 2.66 81.11 1.606 47.46 0.009 0.379 0.076 2.317 $303 214 35 1 $303 214 35 434.9877 16.114
398 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i5-13600K CPU-only 2.046 244.02 1.242 96.78 0.004 0.742 0.058 1.952 $488 329 35 125 1 $488 329 35 125 485.4343 6.96
399 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i5-8500 CPU-only 4.871 84.64 2.935 51.15 0.008 0.430 0.039 1.302 $594 197 125 65 1 $594 197 125 65 239.8346 11.916
400 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i7-1185G7 CPU-only 1.55 106.29 0.919 39.77 0.006 0.250 0.022 3.796 $249 426 71 28 1 $249 426 71 28 665.2714 10.673
401 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i7-1185GRE CPU-only 15.706 76.65 4.572 29.15 0.005 0.156 0.075 2.738 $3,144 490 210 28 2 1 $1,572 490 105 28 132.0319 188.956
402 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i7-8700T CPU-only 152.74 69.89 144.16 144.02 57.02 0.021 0.231 0.339 1.997 $7,166 303 450 35 2 1 $3,583 303 225 35 14.48 16.595
403 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i9-10900TE CPU-only 47.365 83.42 14.722 49.70 0.003 0.171 0.116 2.383 $16,954 488 410 35 2 1 $8,477 488 205 35 44.387 14.081
404 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i9-12900TE CPU-only 14.966 132.88 4.35 51.98 0.007 0.244 0.060 3.796 $2,004 544 250 35 2 1 $1,002 544 125 35 138.9625 10.104
405 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 core Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i9-13900K CPU-only 3.556 379.01 1.015 160.41 0.008 0.633 0.127 3.032 $469 599 28 125 1 $469 599 28 125 284.2379 5.511
406 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i7-1165G7 iGPU-only Intel® Xeon® W1290P CPU-only 8.239 125.84 2.545 74.97 0.018 0.212 0.294 1.007 $469 594 28 125 1 $469 594 28 125 122.4561 6.46
407 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i7-1165G7 CPU+iGPU Intel® Xeon® E-2124G CPU-only 3.565 52.07 1.01 32.87 0.008 0.209 0.127 0.733 $469 249 28 71 1 $469 249 28 71 19.471
408 ssd-resnet34-1200 yolo-v8n OV-2022.3-8991 OV-2023.0 accel xeon Intel® Flex-170 GPU Intel® Xeon® Gold 5218T CPU-only 132.44 449.63 18.19 175.44 0.069 0.143 0.883 2.204 $1,925 3144 150 204 1 2 $1,925 1572 150 102 19.933 8.25
409 end_rec yolo-v8n OV-2023.0 xeon Intel® Xeon® Platinum 8270 CPU-only 996.63 459.95 0.059 2.431 16954 410 2 8477 205 5.159
410 begin_rec yolo-v8n OV-2023.0 xeon Intel® Xeon® Silver 4216R CPU-only 432.72 168.42 0.216 1.731 2004 250 2 1002 125 8.458
411 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core xeon Intel® Core™ i9-13900K CPU-only Intel® Xeon® Platinum 8380 CPU-only 18.79 1686.49 6.86 552.54 0.031 0.090 0.150 3.123 $599 18718 125 540 1 2 $599 9359 125 270 99.01 2.369
412 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core-iGPU xeon Intel® Core™ i9-13900K iGPU-only Intel® Xeon® Platinum 8490H CPU-only 7.59 2714.73 2.3 1006.34 0.013 0.080 0.061 3.878 $599 34000 125 700 1 2 $599 17000 125 350 132.32 4.403
413 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core-CPU+iGPU xeon Intel® Core™ i9-13900K CPU+iGPU Intel® Xeon® Silver 4316 CPU-only 18.14 846.47 7 341.19 0.030 0.372 0.145 2.822 $599 2274 125 300 1 2 $599 1137 125 150 3.308
414 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core Intel® Core™ i5-13600K CPU-only Intel® Core™ i9-12900HK CPU-only 12.91 184.70 4.36 72.61 0.039 0.265 0.103 4.104 $329 697 125 45 1 $329 697 125 45 95.92 7.542
415 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core-iGPU atom Intel® Core™ i5-13600K iGPU-only Intel® Celeron™ 6305E CPU-only 7.13 24.68 2.16 9.60 0.022 0.231 0.057 1.645 $329 107 125 15 1 $329 107 125 15 140.88 40.111
416 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core-CPU+iGPU accel Intel® Core™ i5-13600K CPU+iGPU Intel® Flex-170 GPU 16.63 1205.32 1210.94 5.72 0.051 0.626 0.133 8.035 $329 1925 125 150 1 $329 1925 125 150 12.951
417 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core core-iGPU Intel® Core™ i9-12900K CPU-only Intel® Core™ i7-1185GRE iGPU-only 10.652 154.20 106.82 3.873 0.016 0.315 0.065 5.507 $658 490 165 28 1 $658 490 165 28 111.0757 24.829
418 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core-iGPU Intel® Core™ i9-12900K iGPU-only Intel® Celeron™ 6305E GPU-only 7.059 0.00 82.53 2.154 0.011 0.000 0.043 0.000 $658 107 165 15 1 $658 107 165 15 142.0745
419 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i7-1185GRE CPU+iGPU 14.933 116.95 4.935 45.54 0.023 0.239 0.091 4.177 $658 490 165 28 1 $658 490 165 28
420 unet-camvid--0001 yolo-v8n OV-2022.3-8991 OV-2023.0 atom core-CPU+iGPU Intel® Atom™ x5-E3940 CPU-only Intel® Celeron™ 6305E CPU+GPU 0.258 111.94 0.039 48.30 0.008 1.046 0.027 7.462 $34 107 9.5 15 1 $34 107 9.5 15 3959.594
421 unet-camvid--0001 end_rec OV-2022.3-8991 atom Intel® Atom™ x6425E CPU-only 0.482 0.061 0.007 0.040 $67 12 1 $67 12 2094.2569
unet-camvid--0001 OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only 1.994 0.989 0.030 0.166 $67 12 1 $67 12 502.6095
unet-camvid--0001 OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 2.242 0.597 0.033 0.187 $67 12 1 $67 12
unet-camvid--0001 OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 1.471 0.374 0.012 0.098 $118 15 1 $118 15 678.4977
unet-camvid--0001 OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 2.715 0.802 0.023 0.181 $118 15 1 $118 15 368.8973
unet-camvid--0001 OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 4.12 1.142 0.035 0.275 $118 15 1 $118 15
unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 81.838 19.314 0.017 0.221 $4,678 370 2 $2,339 185 41.506
unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 2.482 1.54 0.021 0.038 $117 65 1 $117 65 412.1291
unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 3.031 1.9 0.014 0.087 $214 35 1 $214 35 457.5992
unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 3.227 2.018 0.017 0.050 $192 65 1 $192 65 256.5479
unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 4.155 2.6 0.014 0.119 $303 35 1 $303 35 277.7416
unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 2.907 2.004 0.006 0.083 $488 35 1 $488 35 319.7667
unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 7.413 4.615 0.012 0.059 $594 125 1 $594 125 157.3622
unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 2.386 1.481 0.010 0.034 $249 71 1 $249 71 422.1157
unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 29.251 7.301 0.009 0.139 $3,144 210 2 $1,572 105 69.3596
unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 381.85 151.97 151.98 0.053 0.849 $7,166 450 2 $3,583 225 7.95
unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only 93.081 21.382 0.005 0.227 $16,954 410 2 $8,477 205 22.9476
unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only 27.814 6.966 0.014 0.111 $2,004 250 2 $1,002 125 72.9773
unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 6.54 1.677 0.014 0.234 $469 28 1 $469 28 152.602
unet-camvid--0001 OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 15.391 4.571 0.033 0.550 $469 28 1 $469 28 61.6002
unet-camvid--0001 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 17.962 4.848 0.038 0.642 $469 28 1 $469 28
unet-camvid--0001 OV-2022.3-8991 accel Intel® Flex-170 GPU 218.12 35.2 0.113 1.454 $1,925 150 1 $1,925 150 7.149
end_rec
begin_rec
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i9-13900K CPU-only 802.63 252.57 1.340 6.421 $599 125 1 $599 125 2.69
yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Core™ i9-13900K iGPU-only 249.5 86.81 0.417 1.996 $599 125 1 $599 125 4.79
yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-13900K CPU+iGPU 795.31 247.17 1.328 6.362 $599 125 1 $599 125
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i5-13600K CPU-only 638.25 206.62 1.940 5.106 $329 125 1 $329 125 2.59
yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Core™ i5-13600K iGPU-only 229.22 81.49 0.697 1.834 $329 125 1 $329 125 5.22
yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i5-13600K CPU+iGPU 631.71 205.81 1.920 5.054 $329 125 1 $329 125
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only 428.506 162.077 0.651 2.597 $658 165 1 $658 165 2.4778
yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only 245.738 84.457 0.373 1.489 $658 165 1 $658 165 3.8792
yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 598.947 195.608 0.910 3.630 $658 165 1 $658 165
yolo_v3_tiny OV-2022.3-8991 atom Intel® Atom™ x5-E3940 CPU-only 12.406 6.124 0.365 1.306 $34 9.5 1 $34 9.5 83.8614
yolo_v3_tiny OV-2022.3-8991 atom Intel® Atom™ x6425E CPU-only 22.94 10.395 0.342 1.912 $67 12 1 $67 12 44.6243
yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only 66.641 38.178 0.995 5.553 $67 12 1 $67 12 15.7687
yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 86.38 45.819 1.289 7.198 $67 12 1 $67 12
yolo_v3_tiny OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 55.629 18.246 0.471 3.709 $118 15 1 $118 15 18.2291
yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 106.588 31.376 0.903 7.106 $118 15 1 $118 15 10.8727
yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 153.471 46.125 1.301 10.231 $118 15 1 $118 15
yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 2733.627 761.534 0.584 7.388 $4,678 370 2 $2,339 185 1.1267
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 114.701 66.266 0.980 1.765 $117 65 1 $117 65 8.9295
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 141.001 79.694 0.659 4.029 $214 35 1 $214 35 9.9196
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 145.659 85.158 0.759 2.241 $192 65 1 $192 65 5.465
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 191.931 109.625 0.633 5.484 $303 35 1 $303 35 5.5981
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 147.041 84.448 0.301 4.201 $488 35 1 $488 35 7.0171
yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 359.61 173.635 0.605 2.877 $594 125 1 $594 125 2.9037
yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 109.066 64.87 0.438 1.536 $249 71 1 $249 71 9.3792
yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 1058.322 337.035 0.337 5.040 $3,144 210 2 $1,572 105 2.4971
yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 7344.88 5212.9 5236.28 1.025 16.322 $7,166 450 2 $3,583 225 1.06
yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only 2931.242 901.832 0.173 7.149 $16,954 410 2 $8,477 205 1.215
yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only 1015.77 321.263 0.507 4.063 $2,004 250 2 $1,002 125 2.6076
yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 258.05 79.963 0.550 9.216 $469 28 1 $469 28 4.1833
yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 492.645 157.98 1.050 17.594 $469 28 1 $469 28 2.5788
yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 606.117 186.339 1.292 21.647 $469 28 1 $469 28
yolo_v3_tiny OV-2022.3-8991 accel Intel® Flex-170 GPU 3634.16 1209.67 1.888 24.228 $1,925 150 1 $1,925 150 1.293
end_rec
begin_rec
yolo_v4 OV-2022.3-8991 core Intel® Core™ i9-13900K CPU-only 37.15 13.03 0.062 0.297 $599 125 1 $599 125 55.96
yolo_v4 OV-2022.3-8991 core-iGPU Intel® Core™ i9-13900K iGPU-only 12.92 4.26 0.022 0.103 $599 125 1 $599 125 78.73
yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-13900K CPU+iGPU 37.16 13.54 0.062 0.297 $599 125 1 $599 125
yolo_v4 OV-2022.3-8991 core Intel® Core™ i5-13600K CPU-only 25.5 8.36 0.078 0.204 $329 125 1 $329 125 53.79
yolo_v4 OV-2022.3-8991 core-iGPU Intel® Core™ i5-13600K iGPU-only 12.15 4 0.037 0.097 $329 125 1 $329 125 83.64
yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i5-13600K CPU+iGPU 31.99 10.82 0.097 0.256 $329 125 1 $329 125
yolo_v4 OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only 21.833 7.096 0.033 0.132 $658 165 1 $658 165 58.4745
yolo_v4 OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only 11.956 3.869 0.018 0.072 $658 165 1 $658 165 85.1633
yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 26.693 8.644 0.041 0.162 $658 165 1 $658 165
yolo_v4 OV-2022.3-8991 atom Intel® Atom™ x5-E3940 CPU-only 0.522 0.248 0.015 0.055 $34 9.5 1 $34 9.5 1900.0218
yolo_v4 OV-2022.3-8991 atom Intel® Atom™ x6425E CPU-only 0.99 0.43 0.015 0.083 $67 12 1 $67 12 1019.82
yolo_v4 OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only 3.413 1.752 0.051 0.284 $67 12 1 $67 12 295.7702
yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 3.999 2.087 0.060 0.333 $67 12 1 $67 12
yolo_v4 OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 2.453 0.748 0.021 0.164 $118 15 1 $118 15 407.2474
yolo_v4 OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 4.758 1.434 0.040 0.317 $118 15 1 $118 15 212.7987
yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 7.048 2.122 0.060 0.470 $118 15 1 $118 15
yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 126.954 35.481 0.027 0.343 $4,678 370 2 $2,339 185 37.8189
yolo_v4 OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 4.971 2.885 0.042 0.076 $117 65 1 $117 65 203.4163
yolo_v4 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 6.182 3.532 0.029 0.177 $214 35 1 $214 35 227.5786
yolo_v4 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 6.356 3.757 0.033 0.098 $192 65 1 $192 65 123.3181
yolo_v4 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 8.44 4.868 0.028 0.241 $303 35 1 $303 35 135.9719
yolo_v4 OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 6.399 3.765 0.013 0.183 $488 35 1 $488 35 155.642
yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 15.614 7.925 0.026 0.125 $594 125 1 $594 125 71.631
yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 4.674 2.804 0.019 0.066 $249 71 1 $249 71 214.0957
yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 47.338 14.464 0.015 0.225 $3,144 210 2 $1,572 105 45.7699
yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 252.03 228.55 228.67 0.035 0.560 $7,166 450 2 $3,583 225 15.01
yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only 131.466 41.001 0.008 0.321 $16,954 410 2 $8,477 205 19.2807
yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only 45.047 13.741 0.022 0.180 $2,004 250 2 $1,002 125 48.0344
yolo_v4 OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 11.067 3.259 0.024 0.395 $469 28 1 $469 28 92.2912
yolo_v4 OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 25.048 7.384 0.053 0.895 $469 28 1 $469 28 39.1492
yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 29.658 8.32 0.063 1.059 $469 28 1 $469 28
yolo_v4 OV-2022.3-8991 accel Intel® Flex-170 GPU 454.49 56.78 0.236 3.03 $1,925 150 1 $1,925 150 6.969
end_rec

3
docs/_static/benchmarks_files/ovms/bert-small-uncased-whole-word-masking-squad-002-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bfb9d6bb2a949e032d2859fbb3ac6dd6e0ddec6888ad5473efedacb62399865f
size 65516

3
docs/_static/benchmarks_files/ovms/bert-small-uncased-whole-word-masking-squad-002-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a271efea7aa7869dd22d0f27fe6b5b3e22f6a6adff623e34d27d45d8a4e6b9f
size 68495

3
docs/_static/benchmarks_files/ovms/densenet-121-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d95ffb2fd00e54c5723e78a7c75910f580e9c8f014f130c8f074e36a3c1fc4d
size 63452

3
docs/_static/benchmarks_files/ovms/densenet-121-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c769922f256b4393e6d1ad1462004481ee717aa20ee400f6bc3fb33c15a36328
size 64067

3
docs/_static/benchmarks_files/ovms/efficientdet-d0-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8febb756ef218f95a50633710564754cd63b4d62816327b0800a3fdeb1be5c8
size 62037

3
docs/_static/benchmarks_files/ovms/efficientdet-d0-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e31681db24b0cf4ca9c5bd5c105119f0eef1d361b54cc881d526936fa3f33690
size 62771

3
docs/_static/benchmarks_files/ovms/inception-v4-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:718720b9501390345d61d0122eaf9d61f9eec657a755e026e3e7541145d0c40b
size 61301

3
docs/_static/benchmarks_files/ovms/inception-v4-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02339bef84fff6e7701cb8b55cb793add6ca8edc676ac077ae6e1a7e6878c85e
size 64581

3
docs/_static/benchmarks_files/ovms/mobilenet-ssd-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d28a032b0f109e21d341e2602d0b5783ee98c04cdd908ff40a8c72bd7729b2fc
size 65515

3
docs/_static/benchmarks_files/ovms/mobilenet-ssd-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd7019cb1ca437369e959d9a360e05aaa9f65e228481f9846b85c06870dbeb3e
size 63941

3
docs/_static/benchmarks_files/ovms/mobilenet-v2-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:546acb8af30bd20dc29b0fe69cc2f43b04d4a682bb85c1ee2fc8e6ae55f4ceb3
size 64632

3
docs/_static/benchmarks_files/ovms/mobilenet-v2-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81b7b35cccff8cb61a64792ed18cbfd730867326411b17861bcd2001e95d42bd
size 67176

3
docs/_static/benchmarks_files/ovms/resnet-18-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0aa6718e0175f66d2beef755d388a40c39eac2488ccabc6d5f475059d0681655
size 62133

3
docs/_static/benchmarks_files/ovms/resnet-18-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a72c3ab5046ff588a3d26e464be39b2476e2043071060791dc901738e43e541
size 63066

3
docs/_static/benchmarks_files/ovms/resnet-50-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26e5544cbf89d8a85fd2b10363cef1702c3c7acae2a448a2c25a0684a27e171c
size 61061

3
docs/_static/benchmarks_files/ovms/resnet-50-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:948a4baf58258766b189f0eb50691697a6a0034336726d8156a84056ca34a9d7
size 64227

3
docs/_static/benchmarks_files/ovms/ssd-resnt34-1200-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91b78d61c8c888a79528fb51b593acb1857abc2ba4a5d805b1c320d5a54d1c16
size 58144

3
docs/_static/benchmarks_files/ovms/ssd-resnt34-1200-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc23608cfdd7135619a6dbefe72670867707bdba31e42375fde3fbd752623df1
size 62003

3
docs/_static/benchmarks_files/ovms/unet-camvid-onnx-001-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bf6eee809f02a4988521441c2d5e1b224a618477af28098d689dad9f798abbb
size 61762

3
docs/_static/benchmarks_files/ovms/unet-camvid-onnx-001-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7bc416a48800ecaed6e1255de406c446064454e7892f31be88385d3c20ca002b
size 61040

3
docs/_static/benchmarks_files/ovms/yolo-v3-tiny-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:90be42f47347d8759cdb14024d56cc16db7b3d65454e01db4d16d2902c8b01e8
size 63073

3
docs/_static/benchmarks_files/ovms/yolo-v3-tiny-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:534524ed6aa12330aa2d166eb72af38a37773de99de2c4f93de5c184a1107b13
size 65611

3
docs/_static/benchmarks_files/ovms/yolo-v4-fp32.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c29488cc3a55adc6fc1e5eddc19565179f10cb8bee217093a5833d45d7f11a55
size 58381

3
docs/_static/benchmarks_files/ovms/yolo-v4-int8.png vendored
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f6699d812099a41e60e6d27f1ea241f1c6f75a386fb9464219285c7dfc26b89
size 61751

BIN
docs/_static/benchmarks_files/platform_list_22.3.pdf vendored
View File

Binary file not shown.

2
docs/_static/js/custom.js vendored
View File

@ -28,7 +28,7 @@ var wapSection = 'openvinotoolkit';
// legal notice for benchmarks
function addLegalNotice() {
if (window.location.href.indexOf('openvino_docs_performance_') !== -1) {
var legalNotice = $('<div class="opt-notice-wrapper"><p class="opt-notice">Results may vary. For workloads visit: <a href="openvino_docs_performance_benchmarks_faq.html#what-image-sizes-are-used-for-the-classification-network-models">workloads</a> and for configurations visit: <a href="openvino_docs_performance_benchmarks_openvino.html#platform-configurations">configurations</a>. See also <a class="el" href="openvino_docs_Legal_Information.html">Legal Information</a>.</p></div>');
var legalNotice = $('<div class="opt-notice-wrapper"><p class="opt-notice">Results may vary. For workloads visit: <a href="openvino_docs_performance_benchmarks_faq.html#what-image-sizes-are-used-for-the-classification-network-models">workloads</a> and for configurations visit: <a href="openvino_docs_performance_benchmarks.html#platforms-configurations-methodology">configurations</a>. See also <a class="el" href="openvino_docs_Legal_Information.html">Legal Information</a>.</p></div>');
$('body').append(legalNotice);
}
}

16
docs/benchmarks/performance_benchmarks.md
View File

@ -7,8 +7,8 @@
:hidden:
openvino_docs_performance_benchmarks_faq
openvino_docs_performance_int8_vs_fp32
Performance Data Spreadsheet (download xlsx) <https://docs.openvino.ai/2023.0/_static/benchmarks_files/OV-2022.3-Performance-Data.xlsx>
OpenVINO Accuracy <openvino_docs_performance_int8_vs_fp32>
Performance Data Spreadsheet (download xlsx) <https://docs.openvino.ai/2023.0/_static/benchmarks_files/OV-2023.0-Performance-Data.xlsx>
openvino_docs_MO_DG_Getting_Performance_Numbers
@ -91,14 +91,14 @@ For a listing of all platforms and configurations used for testing, refer to the
.. grid-item::
.. button-link:: _static/benchmarks_files/platform_list_22.3.pdf
.. button-link:: _static/benchmarks_files/OV-2023.0-Platform_list.pdf
:color: primary
:outline:
:expand:
:material-regular:`download;1.5em` Click for Hardware Platforms [PDF]
:material-regular:`download;1.5em` Click for Hardware Platforms [PDF]
.. button-link:: _static/benchmarks_files/OV-2022.3-system-info-detailed.xlsx
.. button-link:: _static/benchmarks_files/OV-2023.0-system-info-detailed.xlsx
:color: primary
:outline:
:expand:
@ -106,10 +106,6 @@ For a listing of all platforms and configurations used for testing, refer to the
:material-regular:`download;1.5em` Click for Configuration Details [XLSX]
.. the files above need to be updated with OVMS !!!
The OpenVINO benchmark setup includes a single system with OpenVINO™, as well as the benchmark application installed.
It measures the time spent on actual inference (excluding any pre or post processing) and then reports on the inferences
per second (or Frames Per Second).
@ -161,7 +157,7 @@ or `create an account <https://www.intel.com/content/www/us/en/secure/forms/devc
Disclaimers
####################################
* Intel® Distribution of OpenVINO™ toolkit performance results are based on release 2022.3, as of December 13, 2022.
* Intel® Distribution of OpenVINO™ toolkit performance results are based on release 2023.0, as of June 01, 2023.
* OpenVINO Model Server performance results are based on release 2022.3, as of December 13, 2022.

40
docs/benchmarks/performance_benchmarks_faq.md
View File

@ -29,7 +29,7 @@
For a simple instruction on testing performance, see the :doc:`Getting Performance Numbers Guide <openvino_docs_MO_DG_Getting_Performance_Numbers>`.
.. dropdown:: What image sizes are used for the classification network models?
.. dropdown:: Where can I find a more detailed description of the workloads used for benchmarking?
The image size used in inference depends on the benchmarked
network. The table below presents the list of input sizes for each
@ -42,47 +42,43 @@
- Public Network
- Task
- Input Size
* - `GPT-2 <https://https://github.com/onnx/models/blob/main/text/machine_comprehension/gpt-2/README.md>`__
- OpenAI GPT-2
- Transformer
- 1024
* - `bert-base-cased <https://github.com/PaddlePaddle/PaddleNLP/tree/v2.1.1>`__
- BERT
- question / answer
- 124
- 128
* - `bert-large-uncased-whole-word-masking-squad-int8-0001 <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/intel/bert-large-uncased-whole-word-masking-squad-int8-0001>`__
- BERT-large
- question / answer
- 384
* - `deeplabv3-TF <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/deeplabv3>`__
* - `deeplabv3 <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/deeplabv3>`__
- DeepLab v3 Tf
- semantic segmentation
- 513x513
* - `densenet-121-TF <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/densenet-121-tf>`__
- Densenet-121 Tf
- classification
- 224x224
* - `efficientdet-d0 <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/efficientdet-d0-tf>`__
- Efficientdet
- classification
- 512x512
* - `faster_rcnn_resnet50_coco-TF <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/faster_rcnn_resnet50_coco>`__
* - `faster_rcnn_resnet50_coco <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/faster_rcnn_resnet50_coco>`__
- Faster RCNN Tf
- object detection
- 600x1024
* - `inception-v4-TF <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/googlenet-v4-tf>`__
- Inception v4 Tf (aka GoogleNet-V4)
* - `inception-v4 <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/googlenet-v4-tf>`__
- Inception v4 (aka GoogleNet-V4)
- classification
- 299x299
* - `mobilenet-ssd-CF <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/mobilenet-ssd>`__
* - `mobilenet-ssd <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/mobilenet-ssd>`__
- SSD (MobileNet)_COCO-2017_Caffe
- object detection
- 300x300
* - `mobilenet-v2-pytorch <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/mobilenet-v2-pytorch>`__
* - `mobilenet-v2 <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/mobilenet-v2-pytorch>`__
- Mobilenet V2 PyTorch
- classification
- 224x224
* - `resnet-18-pytorch <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/resnet-18-pytorch>`__
- ResNet-18 PyTorch
- classification
- 224x224
* - `resnet-50-TF <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/resnet-50-tf>`__
* - `resnet-50 <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/resnet-50-tf>`__
- ResNet-50_v1_ILSVRC-2012
- classification
- 224x224
@ -94,12 +90,16 @@
- U-Net
- semantic segmentation
- 368x480
* - `yolo-v3-tiny-tf <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/yolo-v3-tiny-tf>`__
* - `yolo-v3 <https://https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/yolo-v3-tf>`__
- YOLO v3
- object detection
- 416x416
* - `yolo-v3-tiny <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/yolo-v3-tiny-tf>`__
- YOLO v3 Tiny
- object detection
- 416x416
* - `yolo_v4-TF <https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/yolo-v4-tf>`__
- Yolo-V4 TF
* - `yolov8n <https://https://github.com/ultralytics/ultralytics>`__
- Yolov8nano
- object detection
- 608x608

229
docs/benchmarks/performance_int8_vs_fp32.md
View File

@ -1,114 +1,221 @@
# Model Accuracy {#openvino_docs_performance_int8_vs_fp32}
# OpenVINO Accuracy {#openvino_docs_performance_int8_vs_fp32}
@sphinxdirective
The following table presents the absolute accuracy drop calculated as the accuracy difference
between FP32 and INT8 representations of a model on two platforms.
The following two tables present the absolute accuracy drop calculated as the accuracy difference
between OV-accuracy and the original frame work accuracy for FP32, and the same for INT8 and FP16
representations of a model on three platform architectures. Please also refer to notes below table
for more information.
* A - Intel® Core™ i9-9000K (AVX2)
* B - Intel® Xeon® 6338, (VNNI)
* C - Intel® Flex-170
* A - Intel® Core™ i9-9000K (AVX2), INT8 and FP32
* B - Intel® Xeon® 6338, (VNNI), INT8 and FP32
* C - Intel® Flex-170, INT8 and FP16
.. list-table:: Model Accuracy
.. list-table:: Model Accuracy for INT8
:header-rows: 1
* - OpenVINO™ Model name
- dataset
- Metric Name
- A
- B
- C
- A, INT8
- B, INT8
- C, INT8
* - GPT-2
- WikiText_2_raw_gpt2
- perplexity
- n/a
- n/a
- n/a
* - bert-base-cased
- SST-2_bert_cased_padded
- accuracy
- 0.11%
- 1.15%
- 0.57%
- 1.51%
- -0.85%
* - bert-large-uncased-whole-word-masking-squad-0001
- SQUAD_v1_1_bert_msl384_mql64_ds128_lowercase
- F1
- 0.51%
- 0.55%
- 0.68%
- 0.05%
- 0.11%
- 0.10%
* - deeplabv3
- VOC2012_segm
- mean_iou
- 0.44%
- 0.06%
- 0.04%
* - densenet-121
- ImageNet2012
- accuracy @ top1
- 0.31%
- 0.32%
- 0.30%
- -0.46%
- -0.23%
- -0.18%
* - efficientdet-d0
- COCO2017_detection_91cl
- coco_precision
- 0.88%
- 0.62%
- 0.50%
- -0.87%
- -0.56%
- n/a
* - faster_rcnn_resnet50_coco
- COCO2017_detection_91cl_bkgr
- coco_precision
- 0.19%
- 0.19%
- 0.20%
* - googlenet-v4
- -0.24%
- -0.24%
- 0.00%
* - inception-v4
- ImageNet2012_bkgr
- accuracy @ top1
- 0.07%
- 0.09%
- 0.26%
- -0.06%
- -0.08%
- -0.04%
* - mobilenet-ssd
- VOC2007_detection
- map
- 0.47%
- 0.14%
- 0.48%
- -0.49%
- -0.50%
- -0.47%
* - mobilenet-v2
- ImageNet2012
- accuracy @ top1
- 0.50%
- 0.18%
- 0.20%
* - resnet-18
- ImageNet2012
- accuracy @ top1
- 0.27%
- 0.24%
- 0.29%
- -0.70%
- -1.11%
- -1.05%
* - resnet-50
- ImageNet2012
- accuracy @ top1
- 0.13%
- 0.12%
- 0.13%
- -0.13%
- -0.11%
- -0.14%
* - ssd-resnet34-1200
- COCO2017_detection_80cl_bkgr
- map
- 0.08%
- 0.09%
- 0.06%
- -0.02%
- -0.03%
- 0.04%
* - unet-camvid-onnx-0001
- CamVid_12cl
- mean_iou @ mean
- 0.33%
- 0.33%
- 0.30%
- n/a
- 6.40%
- -0.30%
* - yolo_v3
- COCO2017_detection_80cl
- map
- -0.14%
- -0.01%
- -0.19%
* - yolo_v3_tiny
- COCO2017_detection_80cl
- map
- 0.01%
- 0.07%
- 0.12%
* - yolo_v4
- -0.11%
- -0.13%
- -0.17%
* - yolo_v8n
- COCO2017_detection_80cl
- map
- 0.05%
- 0.06%
- n/a
- n/a
- n/a
.. list-table:: Model Accuracy for FP32 and FP16 (Flex-170 only)
:header-rows: 1
* - OpenVINO™ Model name
- dataset
- Metric Name
- A, FP32
- B, FP32
- C, FP16
* - GPT-2
- WikiText_2_raw_gpt2
- perplexity
- -9.12%
- -9.12%
- -9.12%
* - bert-base-cased
- SST-2_bert_cased_padded
- accuracy
- 0.00%
- 0.00%
- 0.01%
* - bert-large-uncased-whole-word-masking-squad-0001
- SQUAD_v1_1_bert_msl384_mql64_ds128_lowercase
- F1
- 0.04%
- 0.04%
- 0.05%
* - deeplabv3
- VOC2012_segm
- mean_iou
- 0.00%
- 0.00%
- 0.01%
* - efficientdet-d0
- COCO2017_detection_91cl
- coco_precision
- -0.01%
- 0.02%
- 0.02%
* - faster_rcnn_resnet50_coco
- COCO2017_detection_91cl_bkgr
- coco_precision
- 0.00%
- -0.01%
- 0.03%
* - inception-v4
- ImageNet2012_bkgr
- accuracy @ top1
- 0.00%
- 0.00%
- 0.01%
* - mobilenet-ssd
- VOC2007_detection
- map
- 0.00%
- 0.00%
- 0.02%
* - mobilenet-v2
- ImageNet2012
- accuracy @ top1
- -0.08%
- -0.08%
- 0.06%
* - resnet-50
- ImageNet2012
- accuracy @ top1
- 0.00%
- 0.00%
- 0.00%
* - ssd-resnet34-1200
- COCO2017_detection_80cl_bkgr
- map
- 0.00%
- 0.00%
- 0.02%
* - unet-camvid-onnx-0001
- CamVid_12cl
- mean_iou @ mean
- -0.02%
- -0.02%
- 0.05%
* - yolo_v3
- COCO2017_detection_80cl
- map
- 0.02%
- 0.02%
- 0.03%
* - yolo_v3_tiny
- COCO2017_detection_80cl
- map
- -0.04%
- -0.04%
- 0.03%
* - yolo_v8n
- COCO2017_detection_80cl
- map
- 0.00%
- 0.00%
- 0.03%
.. note::
For all accuracy metrics except perplexity a "-" (minus sign) indicates an accuracy drop.
For perplexity a "-" indicates improved accuracy.
@endsphinxdirective