Files
openvino/docs/_static/benchmarks_files/OV-benchmark-data.csv
2023-09-15 11:50:21 +02:00

67 KiB

1Network modelReleaseIE-TypePlatform nameThroughput-INT8ThroughputFP16ThroughputFP32ValueEfficiencyPriceTDPSocketsPrice/socketTDP/socketLatencyUOM_TUOM_VUOM_EUOM_L
2begin_recFPSFPS/$FPS/TDPmsec.
3bert-base-casedOV-2023.1atomIntel® Celeron™ 6305E CPU-only11.354.270.1060936690.7568015031071511071588.11FPSFPS/$FPS/TDPmsec.
4bert-base-casedOV-2023.1coreIntel® Core™ i3-8100 CPU-only21.3815.110.1827273090.3289091561176511176548.47FPSFPS/$FPS/TDPmsec.
5bert-base-casedOV-2023.1coreIntel® Core™ i5-10500TE CPU-only32.2320.260.150611440.4958592022146512146536.18FPSFPS/$FPS/TDPmsec.
6bert-base-casedOV-2023.1coreIntel® Core™ i5-13600K CPU-only113.1845.080.3440243640.905472125329125132912517.43FPSFPS/$FPS/TDPmsec.
7bert-base-casedOV-2023.1coreIntel® Core™ i5-8500 CPU-only34.3424.040.1788670290.5283456861926511926530.88FPSFPS/$FPS/TDPmsec.
8bert-base-casedOV-2023.1coreIntel® Core™ i7-1185G7 CPU-only51.2718.440.1203456811.8309735714262814262823.31FPSFPS/$FPS/TDPmsec.
9bert-base-casedOV-2023.1coreIntel® Core™ i7-1185GRE CPU-only37.9813.590.0775180831.3565664444902814902829.22FPSFPS/$FPS/TDPmsec.
10bert-base-casedOV-2023.1coreIntel® Core™ i7-8700T CPU-only27.6017.560.0910868450.7885518313033513033542.83FPSFPS/$FPS/TDPmsec.
11bert-base-casedOV-2023.1coreIntel® Core™ i9-10900TE CPU-only34.1220.300.0699159090.9748275384883514883537.09FPSFPS/$FPS/TDPmsec.
12bert-base-casedOV-2023.1coreIntel® Core™ i9-12900TE CPU-only53.0819.480.0975750591.5165952045443515443523.07FPSFPS/$FPS/TDPmsec.
13bert-base-casedOV-2023.1coreIntel® Core™ i9-13900K CPU-only163.2066.230.2724595751.305626285599125159912513.68FPSFPS/$FPS/TDPmsec.
14bert-base-casedOV-2023.1atomIntel® Processor N-2001.650.830.0085290610.274351466193611936641.46FPSFPS/$FPS/TDPmsec.
15bert-base-casedOV-2023.1xeonIntel® Xeon® W1290P CPU-only51.0129.430.085877610.408090401594125159412528.93FPSFPS/$FPS/TDPmsec.
16bert-base-casedOV-2023.1xeonIntel® Xeon® E-2124G CPU-only20.8614.800.0681711850.2938082063067113067149.41FPSFPS/$FPS/TDPmsec.
17bert-base-casedOV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only217.8380.660.0692840521.03728124231442102157210513.64FPSFPS/$FPS/TDPmsec.
18bert-base-casedOV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only572.10224.730.0337440471.39535751216954410284772057.81FPSFPS/$FPS/TDPmsec.
19bert-base-casedOV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only872.62338.470.046619221.61596031187185402935927043.32FPSFPS/$FPS/TDPmsec.
20bert-base-casedOV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only3255.60505.880.0957528514.650852741340007002170003504.08FPSFPS/$FPS/TDPmsec.
21bert-base-casedOV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only204.8476.400.1013070661.02421443720222002101110014.24FPSFPS/$FPS/TDPmsec.
22bert-base-casedOV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only426.78167.540.1876784621.4226027432274300211371508.09FPSFPS/$FPS/TDPmsec.
23bert-base-casedOV-2023.1accelIntel® Flex-170842.00683.21118.63FPSFPS/$FPS/TDPmsec.
24bert-base-casedOV-2023.1accelIntel® Flex-140174.28123.71191.68FPSFPS/$FPS/TDPmsec.
25bert-base-casedOV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only45.8331.960.4282796043.0550611741071511071587.12FPSFPS/$FPS/TDPmsec.
26bert-base-casedOV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only73.0955.440.1491624362.6103426244902814902854.56FPSFPS/$FPS/TDPmsec.
27bert-base-casedOV-2023.1core-iGPUIntel® Processor N200 iGPU-only3.372.360.0174487240.5612672781936119361185.78FPSFPS/$FPS/TDPmsec.
28bert-base-casedOV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only84.4260.510.1981616633.0148881564262814262846.90FPSFPS/$FPS/TDPmsec.
29bert-base-casedOV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU46.6723.260.4361742063.11137610715110715FPSFPS/$FPS/TDPmsec.
30bert-base-casedOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU73.2031.700.1493855362.61424688449028149028FPSFPS/$FPS/TDPmsec.
31bert-base-casedOV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU4.432.030.0229347480.7377344193611936FPSFPS/$FPS/TDPmsec.
32bert-base-casedOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU83.6937.230.1964459152.98878428642628142628FPSFPS/$FPS/TDPmsec.
33end_rec
34begin_recFPSFPS/$FPS/TDPmsec.
35bert-large-uncased-whole-word-masking-squad-0001OV-2023.1atomIntel® Celeron™ 6305E CPU-only1.180.380.0110173190.07859020610715110715863.34FPSFPS/$FPS/TDPmsec.
36bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i3-8100 CPU-only2.091.330.0178803440.03218461811765111765492.10FPSFPS/$FPS/TDPmsec.
37bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i5-10500TE CPU-only2.971.870.0138824930.04570543921465121465347.78FPSFPS/$FPS/TDPmsec.
38bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i5-13600K CPU-only9.933.740.0301760910.0794234713291251329125155.72FPSFPS/$FPS/TDPmsec.
39bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i5-8500 CPU-only3.362.130.0175184490.05174680319265119265302.24FPSFPS/$FPS/TDPmsec.
40bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i7-1185G7 CPU-only5.091.630.0119512140.18182917942628142628219.77FPSFPS/$FPS/TDPmsec.
41bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i7-1185GRE CPU-only3.791.220.0077266690.13521671549028149028266.14FPSFPS/$FPS/TDPmsec.
42bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i7-8700T CPU-only2.711.610.0089369650.07736858130335130335412.44FPSFPS/$FPS/TDPmsec.
43bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i9-10900TE CPU-only3.351.830.0068617240.09567204248835148835327.59FPSFPS/$FPS/TDPmsec.
44bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i9-12900TE CPU-only5.061.750.0092964620.14449358454435154435210.96FPSFPS/$FPS/TDPmsec.
45bert-large-uncased-whole-word-masking-squad-0001OV-2023.1coreIntel® Core™ i9-13900K CPU-only15.195.910.0253586350.121518585991251599125113.61FPSFPS/$FPS/TDPmsec.
46bert-large-uncased-whole-word-masking-squad-0001OV-2023.1atomIntel® Processor N-2000.160.080.0008282240.02664121936119366367.32FPSFPS/$FPS/TDPmsec.
47bert-large-uncased-whole-word-masking-squad-0001OV-2023.1xeonIntel® Xeon® W1290P CPU-only4.662.880.0078426610.0372683245941251594125224.55FPSFPS/$FPS/TDPmsec.
48bert-large-uncased-whole-word-masking-squad-0001OV-2023.1xeonIntel® Xeon® E-2124G CPU-only2.111.340.0068980060.02972943330671130671486.76FPSFPS/$FPS/TDPmsec.
49bert-large-uncased-whole-word-masking-squad-0001OV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only21.276.900.0067643560.101272067314421021572105103.38FPSFPS/$FPS/TDPmsec.
50bert-large-uncased-whole-word-masking-squad-0001OV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only50.9117.710.0030027270.124166415169544102847720563.45FPSFPS/$FPS/TDPmsec.
51bert-large-uncased-whole-word-masking-squad-0001OV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only67.0327.690.0035811950.1241348431871854029359270253.77FPSFPS/$FPS/TDPmsec.
52bert-large-uncased-whole-word-masking-squad-0001OV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only251.1047.690.0073854310.3587209463400070021700035036.69FPSFPS/$FPS/TDPmsec.
53bert-large-uncased-whole-word-masking-squad-0001OV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only20.816.640.0102911680.104043704202220021011100106.83FPSFPS/$FPS/TDPmsec.
54bert-large-uncased-whole-word-masking-squad-0001OV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only38.7614.750.0170469870.129216158227430021137150237.83FPSFPS/$FPS/TDPmsec.
55bert-large-uncased-whole-word-masking-squad-0001OV-2023.1accelIntel® Flex-170144.12101.131110.90FPSFPS/$FPS/TDPmsec.
56bert-large-uncased-whole-word-masking-squad-0001OV-2023.1accelIntel® Flex-14029.9720.571534.35FPSFPS/$FPS/TDPmsec.
57bert-large-uncased-whole-word-masking-squad-0001OV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only4.663.350.0435811250.3108786910715110715820.82FPSFPS/$FPS/TDPmsec.
58bert-large-uncased-whole-word-masking-squad-0001OV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only5.115.770.0104283790.18249663549028149028745.40FPSFPS/$FPS/TDPmsec.
59bert-large-uncased-whole-word-masking-squad-0001OV-2023.1core-iGPUIntel® Processor N200 iGPU-only0.340.230.001740670.05599153719361193611899.92FPSFPS/$FPS/TDPmsec.
60bert-large-uncased-whole-word-masking-squad-0001OV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only9.136.650.0214255680.32597470742628142628449.68FPSFPS/$FPS/TDPmsec.
61bert-large-uncased-whole-word-masking-squad-0001OV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU5.202.330.0486104950.34675486710715110715FPSFPS/$FPS/TDPmsec.
62bert-large-uncased-whole-word-masking-squad-0001OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU3.872.230.0078993180.13823807149028149028FPSFPS/$FPS/TDPmsec.
63bert-large-uncased-whole-word-masking-squad-0001OV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU0.440.170.0022886530.073618327193611936FPSFPS/$FPS/TDPmsec.
64bert-large-uncased-whole-word-masking-squad-0001OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU8.633.520.020256610.30818985742628142628FPSFPS/$FPS/TDPmsec.
65end_rec
66begin_recFPSFPS/$FPS/TDPmsec.
67deeplabv3OV-2023.1atomIntel® Celeron™ 6305E CPU-only11.864.610.110840320.790660951071511071585.88FPSFPS/$FPS/TDPmsec.
68deeplabv3OV-2023.1coreIntel® Core™ i3-8100 CPU-only22.8514.480.1952569040.3514624271176511176543.93FPSFPS/$FPS/TDPmsec.
69deeplabv3OV-2023.1coreIntel® Core™ i5-10500TE CPU-only34.4716.420.1610682120.5302861142146512146533.07FPSFPS/$FPS/TDPmsec.
70deeplabv3OV-2023.1coreIntel® Core™ i5-13600K CPU-only94.1342.320.2861050040.753028371329125132912516.23FPSFPS/$FPS/TDPmsec.
71deeplabv3OV-2023.1coreIntel® Core™ i5-8500 CPU-only37.1821.160.1936509620.5720151481926511926527.36FPSFPS/$FPS/TDPmsec.
72deeplabv3OV-2023.1coreIntel® Core™ i7-1185G7 CPU-only52.8816.510.1241351641.8886278574262814262819.87FPSFPS/$FPS/TDPmsec.
73deeplabv3OV-2023.1coreIntel® Core™ i7-1185GRE CPU-only30.789.650.0628077911.0991363354902814902831.13FPSFPS/$FPS/TDPmsec.
74deeplabv3OV-2023.1coreIntel® Core™ i7-8700T CPU-only32.0218.340.1056882040.9149578833033513033537.47FPSFPS/$FPS/TDPmsec.
75deeplabv3OV-2023.1coreIntel® Core™ i9-10900TE CPU-only40.3618.540.0827122691.1532453554883514883527.15FPSFPS/$FPS/TDPmsec.
76deeplabv3OV-2023.1coreIntel® Core™ i9-12900TE CPU-only57.6922.510.1060534461.6483735675443515443521.75FPSFPS/$FPS/TDPmsec.
77deeplabv3OV-2023.1coreIntel® Core™ i9-13900K CPU-only148.8757.810.2485268181.190940511599125159912512.44FPSFPS/$FPS/TDPmsec.
78deeplabv3OV-2023.1atomIntel® Processor N-2001.721.010.0088973820.286199128193611936595.26FPSFPS/$FPS/TDPmsec.
79deeplabv3OV-2023.1xeonIntel® Xeon® W1290P CPU-only51.5119.390.0867138940.412064422594125159412521.10FPSFPS/$FPS/TDPmsec.
80deeplabv3OV-2023.1xeonIntel® Xeon® E-2124G CPU-only22.6915.400.0741457960.3195579373067113067143.78FPSFPS/$FPS/TDPmsec.
81deeplabv3OV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only190.4077.080.0605613080.90668930431442102157210511.76FPSFPS/$FPS/TDPmsec.
82deeplabv3OV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only416.77155.130.0245822071.01650422816954410284772055.66FPSFPS/$FPS/TDPmsec.
83deeplabv3OV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only584.92227.300.0312488661.08317829818718540293592703.70FPSFPS/$FPS/TDPmsec.
84deeplabv3OV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only999.22380.820.0293887581.427453957340007002170003503.55FPSFPS/$FPS/TDPmsec.
85deeplabv3OV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only184.3174.610.0911511320.92153794620222002101110012.07FPSFPS/$FPS/TDPmsec.
86deeplabv3OV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only370.93139.960.1631176571.2364318382274300211371506.87FPSFPS/$FPS/TDPmsec.
87deeplabv3OV-2023.1accelIntel® Flex-170803.58560.76119.59FPSFPS/$FPS/TDPmsec.
88deeplabv3OV-2023.1accelIntel® Flex-140148.0197.061108.12FPSFPS/$FPS/TDPmsec.
89deeplabv3OV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only60.1727.600.5623494864.0114263321071511071566.33FPSFPS/$FPS/TDPmsec.
90deeplabv3OV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only76.4036.690.1559280672.7287411674902814902851.90FPSFPS/$FPS/TDPmsec.
91deeplabv3OV-2023.1core-iGPUIntel® Processor N200 iGPU-only3.651.920.0189172060.6085034561936119361094.30FPSFPS/$FPS/TDPmsec.
92deeplabv3OV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only105.1448.760.246809433.7550291824262814262837.64FPSFPS/$FPS/TDPmsec.
93deeplabv3OV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU61.9017.220.5785113084.12671410715110715FPSFPS/$FPS/TDPmsec.
94deeplabv3OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU49.449.020.1008944221.76565238149028149028FPSFPS/$FPS/TDPmsec.
95deeplabv3OV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU4.812.030.0249208890.801621937193611936FPSFPS/$FPS/TDPmsec.
96deeplabv3OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU89.1624.780.2093049533.18442535742628142628FPSFPS/$FPS/TDPmsec.
97end_rec
98begin_recFPSFPS/$FPS/TDPmsec.
99mobilenet-v2OV-2023.1atomIntel® Celeron™ 6305E CPU-only272.36133.202.54545477118.15757736107151107153.60FPSFPS/$FPS/TDPmsec.
100mobilenet-v2OV-2023.1coreIntel® Core™ i3-8100 CPU-only542.97451.264.6407334798.353320262117651117651.99FPSFPS/$FPS/TDPmsec.
101mobilenet-v2OV-2023.1coreIntel® Core™ i5-10500TE CPU-only899.54499.684.20345174213.8390565214651214651.58FPSFPS/$FPS/TDPmsec.
102mobilenet-v2OV-2023.1coreIntel® Core™ i5-13600K CPU-only2804.171285.768.52332605422.4333941732912513291250.88FPSFPS/$FPS/TDPmsec.
103mobilenet-v2OV-2023.1coreIntel® Core™ i5-8500 CPU-only868.27679.324.52224994513.35803061192651192651.35FPSFPS/$FPS/TDPmsec.
104mobilenet-v2OV-2023.1coreIntel® Core™ i7-1185G7 CPU-only1372.54531.483.22193192549.01939286426281426280.96FPSFPS/$FPS/TDPmsec.
105mobilenet-v2OV-2023.1coreIntel® Core™ i7-1185GRE CPU-only990.18318.312.02077340435.36353457490281490281.18FPSFPS/$FPS/TDPmsec.
106mobilenet-v2OV-2023.1coreIntel® Core™ i7-8700T CPU-only741.91511.962.44855316221.19747452303351303351.84FPSFPS/$FPS/TDPmsec.
107mobilenet-v2OV-2023.1coreIntel® Core™ i9-10900TE CPU-only960.08614.861.96738166627.43092151488351488351.49FPSFPS/$FPS/TDPmsec.
108mobilenet-v2OV-2023.1coreIntel® Core™ i9-12900TE CPU-only1296.04651.562.38243218437.02980308544351544351.31FPSFPS/$FPS/TDPmsec.
109mobilenet-v2OV-2023.1coreIntel® Core™ i9-13900K CPU-only4078.622016.896.80905634532.62899859912515991250.73FPSFPS/$FPS/TDPmsec.
110mobilenet-v2OV-2023.1atomIntel® Processor N-20039.6129.850.2052107476.60094569819361193626.82FPSFPS/$FPS/TDPmsec.
111mobilenet-v2OV-2023.1xeonIntel® Xeon® W1290P CPU-only1458.83554.062.45595023911.6706755359412515941251.29FPSFPS/$FPS/TDPmsec.
112mobilenet-v2OV-2023.1xeonIntel® Xeon® E-2124G CPU-only527.91453.231.7252113187.435417792306711306712.04FPSFPS/$FPS/TDPmsec.
113mobilenet-v2OV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only5479.841921.881.74295260426.094490423144210215721051.43FPSFPS/$FPS/TDPmsec.
114mobilenet-v2OV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only14421.484410.270.85062406535.1743424416954410284772050.92FPSFPS/$FPS/TDPmsec.
115mobilenet-v2OV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only22622.046912.711.20857148741.8926686818718540293592700.56FPSFPS/$FPS/TDPmsec.
116mobilenet-v2OV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only38771.7610993.761.14034579855.3882245340007002170003500.66FPSFPS/$FPS/TDPmsec.
117mobilenet-v2OV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only5229.871856.592.58648175426.149330532022200210111001.44FPSFPS/$FPS/TDPmsec.
118mobilenet-v2OV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only12359.263615.965.43503017641.197528742274300211371500.55FPSFPS/$FPS/TDPmsec.
119mobilenet-v2OV-2023.1accelIntel® Flex-1707195.506410.6011.97FPSFPS/$FPS/TDPmsec.
120mobilenet-v2OV-2023.1accelIntel® Flex-1401219.841149.89113.07FPSFPS/$FPS/TDPmsec.
121mobilenet-v2OV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only692.73509.866.47411954446.18205274107151107155.58FPSFPS/$FPS/TDPmsec.
122mobilenet-v2OV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only903.44556.691.8437558232.26572686490281490284.30FPSFPS/$FPS/TDPmsec.
123mobilenet-v2OV-2023.1core-iGPUIntel® Processor N200 iGPU-only57.9340.130.3001297929.6541749919361193668.05FPSFPS/$FPS/TDPmsec.
124mobilenet-v2OV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only1008.77740.132.3680107736.02759243426281426283.82FPSFPS/$FPS/TDPmsec.
125mobilenet-v2OV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU514.94313.824.81251962634.3293066710715110715FPSFPS/$FPS/TDPmsec.
126mobilenet-v2OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU1114.75268.282.27500275739.8125482549028149028FPSFPS/$FPS/TDPmsec.
127mobilenet-v2OV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU73.8944.620.3828646412.31547925193611936FPSFPS/$FPS/TDPmsec.
128mobilenet-v2OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU1497.43605.843.51508450753.479542628142628FPSFPS/$FPS/TDPmsec.
129end_rec
130begin_recFPSFPS/$FPS/TDPmsec.
131resnet-50OV-2023.1atomIntel® Celeron™ 6305E CPU-only49.9614.450.4668917763.3304946711071511071519.80FPSFPS/$FPS/TDPmsec.
132resnet-50OV-2023.1coreIntel® Core™ i3-8100 CPU-only97.4951.230.8332278291.4998100921176511176510.67FPSFPS/$FPS/TDPmsec.
133resnet-50OV-2023.1coreIntel® Core™ i5-10500TE CPU-only145.2374.400.6786443872.234306135214651214658.18FPSFPS/$FPS/TDPmsec.
134resnet-50OV-2023.1coreIntel® Core™ i5-13600K CPU-only515.94140.291.5682107314.12753064332912513291253.87FPSFPS/$FPS/TDPmsec.
135resnet-50OV-2023.1coreIntel® Core™ i5-8500 CPU-only158.1882.330.8238561292.433544259192651192657.04FPSFPS/$FPS/TDPmsec.
136resnet-50OV-2023.1coreIntel® Core™ i7-1185G7 CPU-only229.9861.970.5398553998.213514286426281426285.09FPSFPS/$FPS/TDPmsec.
137resnet-50OV-2023.1coreIntel® Core™ i7-1185GRE CPU-only173.0344.880.3531179636.179564359490281490286.59FPSFPS/$FPS/TDPmsec.
138resnet-50OV-2023.1coreIntel® Core™ i7-8700T CPU-only122.8561.900.4054481453.510022512303351303359.95FPSFPS/$FPS/TDPmsec.
139resnet-50OV-2023.1coreIntel® Core™ i9-10900TE CPU-only158.9676.320.3257340874.541663835488351488357.54FPSFPS/$FPS/TDPmsec.
140resnet-50OV-2023.1coreIntel® Core™ i9-12900TE CPU-only270.0472.190.4963997227.715469968544351544354.89FPSFPS/$FPS/TDPmsec.
141resnet-50OV-2023.1coreIntel® Core™ i9-13900K CPU-only749.50228.071.2512508355.99599400459912515991252.93FPSFPS/$FPS/TDPmsec.
142resnet-50OV-2023.1atomIntel® Processor N-2006.553.160.033952771.092147419193611936159.41FPSFPS/$FPS/TDPmsec.
143resnet-50OV-2023.1xeonIntel® Xeon® W1290P CPU-only242.1598.010.4076620441.93721003359412515941255.41FPSFPS/$FPS/TDPmsec.
144resnet-50OV-2023.1xeonIntel® Xeon® E-2124G CPU-only93.1250.420.304308951.3115287143067113067111.07FPSFPS/$FPS/TDPmsec.
145resnet-50OV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only967.51269.320.3077314754.6071798033144210215721052.90FPSFPS/$FPS/TDPmsec.
146resnet-50OV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only2904.14747.720.1712950117.08325759816954410284772051.53FPSFPS/$FPS/TDPmsec.
147resnet-50OV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only4995.381161.610.2668759099.25070975118718540293592701.02FPSFPS/$FPS/TDPmsec.
148resnet-50OV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only20106.681683.030.59137293328.72382815340007002170003501.01FPSFPS/$FPS/TDPmsec.
149resnet-50OV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only930.86255.730.460367614.6543165322022200210111003.01FPSFPS/$FPS/TDPmsec.
150resnet-50OV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only2277.89566.741.0017125317.5929809862274300211371501.47FPSFPS/$FPS/TDPmsec.
151resnet-50OV-2023.1accelIntel® Flex-1703587.032207.9614.17FPSFPS/$FPS/TDPmsec.
152resnet-50OV-2023.1accelIntel® Flex-140681.39441.41123.43FPSFPS/$FPS/TDPmsec.
153resnet-50OV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only211.61117.011.97763918514.107159521071511071518.79FPSFPS/$FPS/TDPmsec.
154resnet-50OV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only289.48170.460.59078284710.338699834902814902813.64FPSFPS/$FPS/TDPmsec.
155resnet-50OV-2023.1core-iGPUIntel® Processor N200 iGPU-only14.627.800.0757699492.437266688193611936272.49FPSFPS/$FPS/TDPmsec.
156resnet-50OV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only352.09211.390.82651049312.574766794262814262811.09FPSFPS/$FPS/TDPmsec.
157resnet-50OV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU201.9671.441.88746915913.4639466710715110715FPSFPS/$FPS/TDPmsec.
158resnet-50OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU307.0888.490.62668605810.9670060149028149028FPSFPS/$FPS/TDPmsec.
159resnet-50OV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU18.586.490.096249993.096041335193611936FPSFPS/$FPS/TDPmsec.
160resnet-50OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU358.14114.230.84071502312.7908785742628142628FPSFPS/$FPS/TDPmsec.
161end_rec
162begin_recFPSFPS/$FPS/TDPmsec.
163ssd_mobilenet_v1_cocoOV-2023.1atomIntel® Celeron™ 6305E CPU-only107.6336.801.0059069967.175469906107151107159.12FPSFPS/$FPS/TDPmsec.
164ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i3-8100 CPU-only212.15122.461.8132843953.263911911117651117654.93FPSFPS/$FPS/TDPmsec.
165ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i5-10500TE CPU-only327.95171.391.5324857745.045414702214651214653.61FPSFPS/$FPS/TDPmsec.
166ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i5-13600K CPU-only999.78361.813.0388357947.9982158132912513291251.90FPSFPS/$FPS/TDPmsec.
167ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i5-8500 CPU-only343.23200.571.7876330185.280392915192651192653.11FPSFPS/$FPS/TDPmsec.
168ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i7-1185G7 CPU-only518.48150.361.21708920218.51714286426281426282.24FPSFPS/$FPS/TDPmsec.
169ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i7-1185GRE CPU-only387.68101.480.79119160613.8458531490281490282.80FPSFPS/$FPS/TDPmsec.
170ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i7-8700T CPU-only275.38157.240.9088588357.868120772303351303354.33FPSFPS/$FPS/TDPmsec.
171ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i9-10900TE CPU-only367.82194.430.75373482710.50921702488351488353.35FPSFPS/$FPS/TDPmsec.
172ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i9-12900TE CPU-only543.47186.050.99903458915.5278519544351544352.61FPSFPS/$FPS/TDPmsec.
173ssd_mobilenet_v1_cocoOV-2023.1coreIntel® Core™ i9-13900K CPU-only1525.02586.712.54594985312.2001916959912515991251.62FPSFPS/$FPS/TDPmsec.
174ssd_mobilenet_v1_cocoOV-2023.1atomIntel® Processor N-20014.497.970.0750602282.41443732119361193671.99FPSFPS/$FPS/TDPmsec.
175ssd_mobilenet_v1_cocoOV-2023.1xeonIntel® Xeon® W1290P CPU-only577.55223.760.9723047164.62039201259412515941252.38FPSFPS/$FPS/TDPmsec.
176ssd_mobilenet_v1_cocoOV-2023.1xeonIntel® Xeon® E-2124G CPU-only203.21126.300.6640845942.862111065306711306715.09FPSFPS/$FPS/TDPmsec.
177ssd_mobilenet_v1_cocoOV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only2048.96639.540.6517038319.7569373533144210215721051.57FPSFPS/$FPS/TDPmsec.
178ssd_mobilenet_v1_cocoOV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only5725.241655.760.33769254613.9639986116954410284772051.11FPSFPS/$FPS/TDPmsec.
179ssd_mobilenet_v1_cocoOV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only10274.062354.690.54888688319.026045718718540293592700.67FPSFPS/$FPS/TDPmsec.
180ssd_mobilenet_v1_cocoOV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only22569.913519.340.66382095532.24273208340007002170003500.82FPSFPS/$FPS/TDPmsec.
181ssd_mobilenet_v1_cocoOV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only1946.94612.870.9628788489.734705152022200210111001.63FPSFPS/$FPS/TDPmsec.
182ssd_mobilenet_v1_cocoOV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only4808.851247.672.11470982816.029500492274300211371500.81FPSFPS/$FPS/TDPmsec.
183ssd_mobilenet_v1_cocoOV-2023.1accelIntel® Flex-1704012.213280.1413.65FPSFPS/$FPS/TDPmsec.
184ssd_mobilenet_v1_cocoOV-2023.1accelIntel® Flex-140837.59673.84119.02FPSFPS/$FPS/TDPmsec.
185ssd_mobilenet_v1_cocoOV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only408.97220.073.82212848627.26451654107151107159.63FPSFPS/$FPS/TDPmsec.
186ssd_mobilenet_v1_cocoOV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only522.64285.291.06660801118.6656402490281490287.49FPSFPS/$FPS/TDPmsec.
187ssd_mobilenet_v1_cocoOV-2023.1core-iGPUIntel® Processor N200 iGPU-only28.9215.360.1498282754.819476185193611936136.60FPSFPS/$FPS/TDPmsec.
188ssd_mobilenet_v1_cocoOV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only637.62384.261.49676672522.77223659426281426286.11FPSFPS/$FPS/TDPmsec.
189ssd_mobilenet_v1_cocoOV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU321.29138.223.00274018721.4195466710715110715FPSFPS/$FPS/TDPmsec.
190ssd_mobilenet_v1_cocoOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU531.28141.481.08424514118.9742899649028149028FPSFPS/$FPS/TDPmsec.
191ssd_mobilenet_v1_cocoOV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU35.6914.880.1849458415.949091211193611936FPSFPS/$FPS/TDPmsec.
192ssd_mobilenet_v1_cocoOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU690.18239.851.62014319224.6493214342628142628FPSFPS/$FPS/TDPmsec.
193end_rec
194begin_recFPSFPS/$FPS/TDPmsec.
195ssd-resnet34-1200OV-2023.1atomIntel® Celeron™ 6305E CPU-only0.890.230.008349960.059563049107151107151119.27FPSFPS/$FPS/TDPmsec.
196ssd-resnet34-1200OV-2023.1coreIntel® Core™ i3-8100 CPU-only1.680.970.0143384120.02580914111765111765596.89FPSFPS/$FPS/TDPmsec.
197ssd-resnet34-1200OV-2023.1coreIntel® Core™ i5-10500TE CPU-only2.421.400.0113012450.03720717621465121465459.48FPSFPS/$FPS/TDPmsec.
198ssd-resnet34-1200OV-2023.1coreIntel® Core™ i5-13600K CPU-only8.232.400.0250061860.0658162813291251329125163.47FPSFPS/$FPS/TDPmsec.
199ssd-resnet34-1200OV-2023.1coreIntel® Core™ i5-8500 CPU-only2.781.560.0145011790.04283425219265119265362.12FPSFPS/$FPS/TDPmsec.
200ssd-resnet34-1200OV-2023.1coreIntel® Core™ i7-1185G7 CPU-only3.931.000.0092178190.14024253642628142628278.25FPSFPS/$FPS/TDPmsec.
201ssd-resnet34-1200OV-2023.1coreIntel® Core™ i7-1185GRE CPU-only2.960.760.0060435550.10576221549028149028336.81FPSFPS/$FPS/TDPmsec.
202ssd-resnet34-1200OV-2023.1coreIntel® Core™ i7-8700T CPU-only2.021.130.0066644080.05769472830335130335563.91FPSFPS/$FPS/TDPmsec.
203ssd-resnet34-1200OV-2023.1coreIntel® Core™ i9-10900TE CPU-only2.681.490.005485510.07648368548835148835405.46FPSFPS/$FPS/TDPmsec.
204ssd-resnet34-1200OV-2023.1coreIntel® Core™ i9-12900TE CPU-only4.401.320.0080867290.12569086854435154435235.75FPSFPS/$FPS/TDPmsec.
205ssd-resnet34-1200OV-2023.1coreIntel® Core™ i9-13900K CPU-only12.524.020.0209057880.1001805365991251599125125.64FPSFPS/$FPS/TDPmsec.
206ssd-resnet34-1200OV-2023.1atomIntel® Processor N-2000.110.050.0005813740.018700871936119368951.48FPSFPS/$FPS/TDPmsec.
207ssd-resnet34-1200OV-2023.1xeonIntel® Xeon® W1290P CPU-only4.332.450.0072856640.0346214765941251594125239.93FPSFPS/$FPS/TDPmsec.
208ssd-resnet34-1200OV-2023.1xeonIntel® Xeon® E-2124G CPU-only1.600.920.0052243480.02251620630671130671625.20FPSFPS/$FPS/TDPmsec.
209ssd-resnet34-1200OV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only17.634.570.0056090790.083975927314421021572105115.76FPSFPS/$FPS/TDPmsec.
210ssd-resnet34-1200OV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only57.8514.820.0034124260.141107992169544102847720536.60FPSFPS/$FPS/TDPmsec.
211ssd-resnet34-1200OV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only79.0920.810.0042255580.1464703751871854029359270106.87FPSFPS/$FPS/TDPmsec.
212ssd-resnet34-1200OV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only445.9831.400.0131171580.637119123340007002170003508.59FPSFPS/$FPS/TDPmsec.
213ssd-resnet34-1200OV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only16.774.340.0082958310.083870853202220021011100121.62FPSFPS/$FPS/TDPmsec.
214ssd-resnet34-1200OV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only42.5910.540.0187286160.14196290622743002113715059.65FPSFPS/$FPS/TDPmsec.
215ssd-resnet34-1200OV-2023.1accelIntel® Flex-170167.49103.03195.09FPSFPS/$FPS/TDPmsec.
216ssd-resnet34-1200OV-2023.1accelIntel® Flex-14029.9917.561529.50FPSFPS/$FPS/TDPmsec.
217ssd-resnet34-1200OV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only5.052.630.0471789320.33654304510715110715773.01FPSFPS/$FPS/TDPmsec.
218ssd-resnet34-1200OV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only8.984.710.0183274590.32073053549028149028445.01FPSFPS/$FPS/TDPmsec.
219ssd-resnet34-1200OV-2023.1core-iGPUIntel® Processor N200 iGPU-only0.290.160.0014976320.04817381919361193613818.30FPSFPS/$FPS/TDPmsec.
220ssd-resnet34-1200OV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only9.705.440.0227609850.3462921342628142628422.10FPSFPS/$FPS/TDPmsec.
221ssd-resnet34-1200OV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU0.900.230.008376850.05975486710715110715FPSFPS/$FPS/TDPmsec.
222ssd-resnet34-1200OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU2.910.750.0059376630.10390911149028149028FPSFPS/$FPS/TDPmsec.
223ssd-resnet34-1200OV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU0.110.050.0005821080.01872448193611936FPSFPS/$FPS/TDPmsec.
224ssd-resnet34-1200OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU3.921.000.009196690.13992107142628142628FPSFPS/$FPS/TDPmsec.
225end_rec
226begin_recFPSFPS/$FPS/TDPmsec.
227yolo-v3OV-2023.1atomIntel® Celeron™ 6305E CPU-only5.461.540.0510442480.36411563310715110715183.90FPSFPS/$FPS/TDPmsec.
228yolo-v3OV-2023.1coreIntel® Core™ i3-8100 CPU-only10.655.820.091062380.1639122841176511176594.90FPSFPS/$FPS/TDPmsec.
229yolo-v3OV-2023.1coreIntel® Core™ i5-10500TE CPU-only15.388.310.0718514320.2365570232146512146574.19FPSFPS/$FPS/TDPmsec.
230yolo-v3OV-2023.1coreIntel® Core™ i5-13600K CPU-only51.7115.620.1571622070.41365093329125132912529.85FPSFPS/$FPS/TDPmsec.
231yolo-v3OV-2023.1coreIntel® Core™ i5-8500 CPU-only17.569.380.0914381340.2700941811926511926557.84FPSFPS/$FPS/TDPmsec.
232yolo-v3OV-2023.1coreIntel® Core™ i7-1185G7 CPU-only24.166.620.0567149530.86287754262814262845.99FPSFPS/$FPS/TDPmsec.
233yolo-v3OV-2023.1coreIntel® Core™ i7-1185GRE CPU-only18.064.860.036863230.6451065194902814902857.19FPSFPS/$FPS/TDPmsec.
234yolo-v3OV-2023.1coreIntel® Core™ i7-8700T CPU-only12.666.850.0417847660.3617366873033513033586.80FPSFPS/$FPS/TDPmsec.
235yolo-v3OV-2023.1coreIntel® Core™ i9-10900TE CPU-only16.868.710.0345404520.481592594883514883565.99FPSFPS/$FPS/TDPmsec.
236yolo-v3OV-2023.1coreIntel® Core™ i9-12900TE CPU-only27.018.100.0496582490.7718310635443515443542.00FPSFPS/$FPS/TDPmsec.
237yolo-v3OV-2023.1coreIntel® Core™ i9-13900K CPU-only78.0425.560.13028380.62431997599125159912523.30FPSFPS/$FPS/TDPmsec.
238yolo-v3OV-2023.1atomIntel® Processor N-2000.700.350.0036423440.1171620611936119361468.27FPSFPS/$FPS/TDPmsec.
239yolo-v3OV-2023.1xeonIntel® Xeon® W1290P CPU-only27.3414.090.0460324510.218746209594125159412540.58FPSFPS/$FPS/TDPmsec.
240yolo-v3OV-2023.1xeonIntel® Xeon® E-2124G CPU-only10.075.660.0329121670.14184680630671130671100.10FPSFPS/$FPS/TDPmsec.
241yolo-v3OV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only106.3029.820.0338114410.50620557131442102157210521.86FPSFPS/$FPS/TDPmsec.
242yolo-v3OV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only313.2288.200.0184746630.76394984169544102847720510.58FPSFPS/$FPS/TDPmsec.
243yolo-v3OV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only493.02109.110.0263395510.913006894187185402935927018.51FPSFPS/$FPS/TDPmsec.
244yolo-v3OV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only2136.92194.880.062850723.052749275340007002170003503.29FPSFPS/$FPS/TDPmsec.
245yolo-v3OV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only101.2728.400.0500839230.5063484620222002101110022.87FPSFPS/$FPS/TDPmsec.
246yolo-v3OV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only242.0062.340.1064216020.80667574622743002113715013.70FPSFPS/$FPS/TDPmsec.
247yolo-v3OV-2023.1accelIntel® Flex-170789.11338.45119.85FPSFPS/$FPS/TDPmsec.
248yolo-v3OV-2023.1accelIntel® Flex-140159.6787.28199.99FPSFPS/$FPS/TDPmsec.
249yolo-v3OV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only31.9015.020.2981186522.12657971510715110715123.93FPSFPS/$FPS/TDPmsec.
250yolo-v3OV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only57.7725.960.1179075462.0633820534902814902868.96FPSFPS/$FPS/TDPmsec.
251yolo-v3OV-2023.1core-iGPUIntel® Processor N200 iGPU-only1.760.940.0091161980.2932376991936119362271.06FPSFPS/$FPS/TDPmsec.
252yolo-v3OV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only63.8629.690.1499049832.2806972344262814262863.56FPSFPS/$FPS/TDPmsec.
253yolo-v3OV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU34.099.180.3186033642.27270410715110715FPSFPS/$FPS/TDPmsec.
254yolo-v3OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU55.1812.970.1126057481.97060058849028149028FPSFPS/$FPS/TDPmsec.
255yolo-v3OV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU2.220.740.0114885360.369547916193611936FPSFPS/$FPS/TDPmsec.
256yolo-v3OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU52.2113.990.1225674881.86477678642628142628FPSFPS/$FPS/TDPmsec.
257end_rec
258begin_recFPSFPS/$FPS/TDPmsec.
259yolo-v3-tinyOV-2023.1atomIntel® Celeron™ 6305E CPU-only54.4218.040.5085539783.6276850441071511071518.25FPSFPS/$FPS/TDPmsec.
260yolo-v3-tinyOV-2023.1coreIntel® Core™ i3-8100 CPU-only112.0163.790.9573907841.723303411117651117659.02FPSFPS/$FPS/TDPmsec.
261yolo-v3-tinyOV-2023.1coreIntel® Core™ i5-10500TE CPU-only167.1591.460.7810917552.571594392214651214656.72FPSFPS/$FPS/TDPmsec.
262yolo-v3-tinyOV-2023.1coreIntel® Core™ i5-13600K CPU-only599.98196.781.8236381344.79981556732912513291253.05FPSFPS/$FPS/TDPmsec.
263yolo-v3-tinyOV-2023.1coreIntel® Core™ i5-8500 CPU-only185.17102.470.9644417572.848812574192651192655.42FPSFPS/$FPS/TDPmsec.
264yolo-v3-tinyOV-2023.1coreIntel® Core™ i7-1185G7 CPU-only251.0277.470.5892509398.965032143426281426284.54FPSFPS/$FPS/TDPmsec.
265yolo-v3-tinyOV-2023.1coreIntel® Core™ i7-1185GRE CPU-only186.9955.220.3816095786.678167613490281490285.74FPSFPS/$FPS/TDPmsec.
266yolo-v3-tinyOV-2023.1coreIntel® Core™ i7-8700T CPU-only137.7276.530.4545301943.934932821303351303358.20FPSFPS/$FPS/TDPmsec.
267yolo-v3-tinyOV-2023.1coreIntel® Core™ i9-10900TE CPU-only186.0996.750.3813407285.316979292488351488356.26FPSFPS/$FPS/TDPmsec.
268yolo-v3-tinyOV-2023.1coreIntel® Core™ i9-12900TE CPU-only290.2092.520.5334626218.291533312544351544354.20FPSFPS/$FPS/TDPmsec.
269yolo-v3-tinyOV-2023.1coreIntel® Core™ i9-13900K CPU-only858.94286.411.4339578616.87152607159912515991252.44FPSFPS/$FPS/TDPmsec.
270yolo-v3-tinyOV-2023.1atomIntel® Processor N-2007.654.050.0396222211.27451476193611936136.49FPSFPS/$FPS/TDPmsec.
271yolo-v3-tinyOV-2023.1xeonIntel® Xeon® W1290P CPU-only298.60148.940.5026961572.38881213859412515941253.99FPSFPS/$FPS/TDPmsec.
272yolo-v3-tinyOV-2023.1xeonIntel® Xeon® E-2124G CPU-only106.5862.620.3482914541.501087112306711306719.44FPSFPS/$FPS/TDPmsec.
273yolo-v3-tinyOV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only1051.30339.080.3343825495.0061844483144210215721052.51FPSFPS/$FPS/TDPmsec.
274yolo-v3-tinyOV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only2824.66923.960.1666073626.88941759716954410284772051.22FPSFPS/$FPS/TDPmsec.
275yolo-v3-tinyOV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only4664.341378.510.2491899588.63766227418718540293592700.87FPSFPS/$FPS/TDPmsec.
276yolo-v3-tinyOV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only13094.972140.000.38514603418.70709309340007002170003501.09FPSFPS/$FPS/TDPmsec.
277yolo-v3-tinyOV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only1008.44322.640.498734395.0422046822022200210111002.62FPSFPS/$FPS/TDPmsec.
278yolo-v3-tinyOV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only2217.58702.900.9751906427.3919450652274300211371501.33FPSFPS/$FPS/TDPmsec.
279yolo-v3-tinyOV-2023.1accelIntel® Flex-1703731.302395.9314.06FPSFPS/$FPS/TDPmsec.
280yolo-v3-tinyOV-2023.1accelIntel® Flex-140595.41589.87126.79FPSFPS/$FPS/TDPmsec.
281yolo-v3-tinyOV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only289.69151.782.70740345119.312811291071511071513.67FPSFPS/$FPS/TDPmsec.
282yolo-v3-tinyOV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only482.61255.460.98492852517.23624918490281490288.06FPSFPS/$FPS/TDPmsec.
283yolo-v3-tinyOV-2023.1core-iGPUIntel® Processor N200 iGPU-only18.659.810.0966242823.108081056193611936212.84FPSFPS/$FPS/TDPmsec.
284yolo-v3-tinyOV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only555.59293.271.30420105919.84248754426281426286.92FPSFPS/$FPS/TDPmsec.
285yolo-v3-tinyOV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU266.5793.472.49129906517.7712666710715110715FPSFPS/$FPS/TDPmsec.
286yolo-v3-tinyOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU383.36116.030.78237411113.6915469449028149028FPSFPS/$FPS/TDPmsec.
287yolo-v3-tinyOV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU23.038.300.1193080143.837741122193611936FPSFPS/$FPS/TDPmsec.
288yolo-v3-tinyOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU444.34149.051.04304342715.8691607142628142628FPSFPS/$FPS/TDPmsec.
289end_rec
290begin_recFPSFPS/$FPS/TDPmsec.
291unet-camvid-onnx-0001OV-2023.1atomIntel® Celeron™ 6305E CPU-only1.490.380.0139504940.09951352610715110715672.25FPSFPS/$FPS/TDPmsec.
292unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i3-8100 CPU-only2.431.570.0207757480.03739634611765111765425.88FPSFPS/$FPS/TDPmsec.
293unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i5-10500TE CPU-only3.622.290.0169249890.05572227221465121465322.49FPSFPS/$FPS/TDPmsec.
294unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i5-13600K CPU-only11.463.960.034833070.0916806393291251329125121.88FPSFPS/$FPS/TDPmsec.
295unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i5-8500 CPU-only3.952.540.0205767220.0607804719265119265262.38FPSFPS/$FPS/TDPmsec.
296unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i7-1185G7 CPU-only6.561.650.0153874390.23410889342628142628169.32FPSFPS/$FPS/TDPmsec.
297unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i7-1185GRE CPU-only4.931.230.0100635080.17611138949028149028209.95FPSFPS/$FPS/TDPmsec.
298unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i7-8700T CPU-only3.021.850.0099760840.08636438330335130335386.94FPSFPS/$FPS/TDPmsec.
299unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i9-10900TE CPU-only3.862.430.0079003880.11015397548835148835282.08FPSFPS/$FPS/TDPmsec.
300unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i9-12900TE CPU-only6.322.190.011620520.1806160854435154435169.49FPSFPS/$FPS/TDPmsec.
301unet-camvid-onnx-0001OV-2023.1coreIntel® Core™ i9-13900K CPU-only18.026.590.0300794290.144140625599125159912591.92FPSFPS/$FPS/TDPmsec.
302unet-camvid-onnx-0001OV-2023.1atomIntel® Processor N-2000.170.090.0008952250.02879641936119365824.42FPSFPS/$FPS/TDPmsec.
303unet-camvid-onnx-0001OV-2023.1xeonIntel® Xeon® W1290P CPU-only6.103.950.0102669640.0487886135941251594125180.82FPSFPS/$FPS/TDPmsec.
304unet-camvid-onnx-0001OV-2023.1xeonIntel® Xeon® E-2124G CPU-only2.331.480.0076231670.03285477730671130671431.48FPSFPS/$FPS/TDPmsec.
305unet-camvid-onnx-0001OV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only29.177.320.0092770610.13889085131442102157210570.99FPSFPS/$FPS/TDPmsec.
306unet-camvid-onnx-0001OV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only95.1821.750.0056142250.232155061169544102847720523.58FPSFPS/$FPS/TDPmsec.
307unet-camvid-onnx-0001OV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only129.6631.770.0069269240.240107724187185402935927073.18FPSFPS/$FPS/TDPmsec.
308unet-camvid-onnx-0001OV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only597.4248.080.0175713220.853464211340007002170003509.00FPSFPS/$FPS/TDPmsec.
309unet-camvid-onnx-0001OV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only27.776.960.013732660.13883719420222002101110074.54FPSFPS/$FPS/TDPmsec.
310unet-camvid-onnx-0001OV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only68.2115.930.0299957490.22736777422743002113715043.86FPSFPS/$FPS/TDPmsec.
311unet-camvid-onnx-0001OV-2023.1accelIntel® Flex-170277.97158.53157.27FPSFPS/$FPS/TDPmsec.
312unet-camvid-onnx-0001OV-2023.1accelIntel® Flex-14046.1028.491346.80FPSFPS/$FPS/TDPmsec.
313unet-camvid-onnx-0001OV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only8.404.350.0785453870.5602904310715110715475.75FPSFPS/$FPS/TDPmsec.
314unet-camvid-onnx-0001OV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only15.517.810.031647440.55383020349028149028257.89FPSFPS/$FPS/TDPmsec.
315unet-camvid-onnx-0001OV-2023.1core-iGPUIntel® Processor N200 iGPU-only0.460.250.0023851520.0767223781936119368685.75FPSFPS/$FPS/TDPmsec.
316unet-camvid-onnx-0001OV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only17.288.860.040566980.61719762142628142628227.89FPSFPS/$FPS/TDPmsec.
317unet-camvid-onnx-0001OV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU8.962.570.0837793930.59762633310715110715FPSFPS/$FPS/TDPmsec.
318unet-camvid-onnx-0001OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU15.423.900.0314679770.55068960149028149028FPSFPS/$FPS/TDPmsec.
319unet-camvid-onnx-0001OV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU0.550.190.0028336920.09115042193611936FPSFPS/$FPS/TDPmsec.
320unet-camvid-onnx-0001OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU14.323.810.0336215490.51152785742628142628FPSFPS/$FPS/TDPmsec.
321end_rec
322begin_recFPSFPS/$FPS/TDPmsec.
323yolo_v8nOV-2023.1atomIntel® Celeron™ 6305E CPU-only24.409.610.228009381.6264669141071511071540.45FPSFPS/$FPS/TDPmsec.
324yolo_v8nOV-2023.1coreIntel® Core™ i3-8100 CPU-only53.5133.070.4573632690.8232538841176511176519.20FPSFPS/$FPS/TDPmsec.
325yolo_v8nOV-2023.1coreIntel® Core™ i5-10500TE CPU-only81.9147.090.3827482111.2601248782146512146513.68FPSFPS/$FPS/TDPmsec.
326yolo_v8nOV-2023.1coreIntel® Core™ i5-13600K CPU-only248.1395.510.7542095831.98507962332912513291256.70FPSFPS/$FPS/TDPmsec.
327yolo_v8nOV-2023.1coreIntel® Core™ i5-8500 CPU-only86.7753.000.4519471961.3349824861926511926511.88FPSFPS/$FPS/TDPmsec.
328yolo_v8nOV-2023.1coreIntel® Core™ i7-1185G7 CPU-only110.8440.770.2601936623.9586607144262814262810.71FPSFPS/$FPS/TDPmsec.
329yolo_v8nOV-2023.1coreIntel® Core™ i7-1185GRE CPU-only76.5327.310.1561800652.7331511454902814902813.42FPSFPS/$FPS/TDPmsec.
330yolo_v8nOV-2023.1coreIntel® Core™ i7-8700T CPU-only71.4042.600.2356438672.0400026193033513033516.51FPSFPS/$FPS/TDPmsec.
331yolo_v8nOV-2023.1coreIntel® Core™ i9-10900TE CPU-only93.4453.420.191480012.6697784314883514883512.45FPSFPS/$FPS/TDPmsec.
332yolo_v8nOV-2023.1coreIntel® Core™ i9-12900TE CPU-only129.2250.190.2375345223.691965149544351544359.42FPSFPS/$FPS/TDPmsec.
333yolo_v8nOV-2023.1coreIntel® Core™ i9-13900K CPU-only374.34153.460.6249433072.99472832759912515991255.32FPSFPS/$FPS/TDPmsec.
334yolo_v8nOV-2023.1atomIntel® Processor N-2003.261.950.0168692760.542628378193611936316.56FPSFPS/$FPS/TDPmsec.
335yolo_v8nOV-2023.1xeonIntel® Xeon® W1290P CPU-only136.3772.870.2295796911.09096269259412515941259.15FPSFPS/$FPS/TDPmsec.
336yolo_v8nOV-2023.1xeonIntel® Xeon® E-2124G CPU-only52.2932.980.1708697650.736424623067113067119.47FPSFPS/$FPS/TDPmsec.
337yolo_v8nOV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only452.92175.370.1440585652.1567625233144210215721055.85FPSFPS/$FPS/TDPmsec.
338yolo_v8nOV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only978.34454.720.0577053522.38618666116954410284772053.51FPSFPS/$FPS/TDPmsec.
339yolo_v8nOV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only1708.13573.450.0912559943.16320314518718540293592702.38FPSFPS/$FPS/TDPmsec.
340yolo_v8nOV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only2882.62945.600.0847830454.118033592340007002170003503.82FPSFPS/$FPS/TDPmsec.
341yolo_v8nOV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only431.62166.100.2134604852.1580855032022200210111006.19FPSFPS/$FPS/TDPmsec.
342yolo_v8nOV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only855.04342.650.3760075032.8501368722274300211371503.25FPSFPS/$FPS/TDPmsec.
343yolo_v8nOV-2023.1accelIntel® Flex-1701445.141480.07110.71FPSFPS/$FPS/TDPmsec.
344yolo_v8nOV-2023.1accelIntel® Flex-140201.93259.00179.17FPSFPS/$FPS/TDPmsec.
345yolo_v8nOV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only126.1482.581.1788551598.4091667991071511071531.55FPSFPS/$FPS/TDPmsec.
346yolo_v8nOV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only170.37110.990.3476837926.0844663644902814902823.22FPSFPS/$FPS/TDPmsec.
347yolo_v8nOV-2023.1core-iGPUIntel® Processor N200 iGPU-only8.615.660.0446361.435791346193611936463.22FPSFPS/$FPS/TDPmsec.
348yolo_v8nOV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only210.16143.230.4933351387.5057417484262814262818.84FPSFPS/$FPS/TDPmsec.
349yolo_v8nOV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU116.5051.351.0887906547.76670666710715110715FPSFPS/$FPS/TDPmsec.
350yolo_v8nOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU114.2346.770.2331232634.07965710249028149028FPSFPS/$FPS/TDPmsec.
351yolo_v8nOV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU10.544.680.054586341.755860615193611936FPSFPS/$FPS/TDPmsec.
352yolo_v8nOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU181.8376.100.4268349776.49398928642628142628FPSFPS/$FPS/TDPmsec.
353end_rec
354begin_recmsec/tokenmsec/token/$msec/token/TDPmsec.
355bloomz-560mOV-2023.1atomIntel® Celeron™ 6305E CPU-only0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
356bloomz-560mOV-2023.1coreIntel® Core™ i3-8100 CPU-only0011765111765msec/tokenmsec/token/$msec/token/TDPmsec.
357bloomz-560mOV-2023.1coreIntel® Core™ i5-10500TE CPU-only0021465121465msec/tokenmsec/token/$msec/token/TDPmsec.
358bloomz-560mOV-2023.1coreIntel® Core™ i5-13600K CPU-only003291251329125msec/tokenmsec/token/$msec/token/TDPmsec.
359bloomz-560mOV-2023.1coreIntel® Core™ i5-8500 CPU-only0019265119265msec/tokenmsec/token/$msec/token/TDPmsec.
360bloomz-560mOV-2023.1coreIntel® Core™ i7-1185G7 CPU-only0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
361bloomz-560mOV-2023.1coreIntel® Core™ i7-1185GRE CPU-only0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
362bloomz-560mOV-2023.1coreIntel® Core™ i7-8700T CPU-only0030335130335msec/tokenmsec/token/$msec/token/TDPmsec.
363bloomz-560mOV-2023.1coreIntel® Core™ i9-10900TE CPU-only0048835148835msec/tokenmsec/token/$msec/token/TDPmsec.
364bloomz-560mOV-2023.1coreIntel® Core™ i9-12900TE CPU-only0054435154435msec/tokenmsec/token/$msec/token/TDPmsec.
365bloomz-560mOV-2023.1coreIntel® Core™ i9-13900K CPU-only32.3449.170.0539901340.258720725991251599125msec/tokenmsec/token/$msec/token/TDPmsec.
366bloomz-560mOV-2023.1atomIntel® Processor N-20000193611936msec/tokenmsec/token/$msec/token/TDPmsec.
367bloomz-560mOV-2023.1xeonIntel® Xeon® W1290P CPU-only005941251594125msec/tokenmsec/token/$msec/token/TDPmsec.
368bloomz-560mOV-2023.1xeonIntel® Xeon® E-2124G CPU-only0030671130671msec/tokenmsec/token/$msec/token/TDPmsec.
369bloomz-560mOV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only00314421021572105msec/tokenmsec/token/$msec/token/TDPmsec.
370bloomz-560mOV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only001695441028477205msec/tokenmsec/token/$msec/token/TDPmsec.
371bloomz-560mOV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only28.2943.450.0015115650.0523953331871854029359270msec/tokenmsec/token/$msec/token/TDPmsec.
372bloomz-560mOV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only47.2152.770.001388490.06744092934000700217000350msec/tokenmsec/token/$msec/token/TDPmsec.
373bloomz-560mOV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only00202220021011100msec/tokenmsec/token/$msec/token/TDPmsec.
374bloomz-560mOV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only40.0742.880.0176207830.133565533227430021137150msec/tokenmsec/token/$msec/token/TDPmsec.
375bloomz-560mOV-2023.1accelIntel® Flex-17081.6482.811msec/tokenmsec/token/$msec/token/TDPmsec.
376bloomz-560mOV-2023.1accelIntel® Flex-14070.3665.111msec/tokenmsec/token/$msec/token/TDPmsec.
377bloomz-560mOV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
378bloomz-560mOV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
379bloomz-560mOV-2023.1core-iGPUIntel® Processor N200 iGPU-only00193611936msec/tokenmsec/token/$msec/token/TDPmsec.
380bloomz-560mOV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
381bloomz-560mOV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
382bloomz-560mOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
383bloomz-560mOV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU00193611936msec/tokenmsec/token/$msec/token/TDPmsec.
384bloomz-560mOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
385end_rec
386begin_recmsec/tokenmsec/token/$msec/token/TDPmsec.
387GPT-j-6bOV-2023.1atomIntel® Celeron™ 6305E CPU-only0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
388GPT-j-6bOV-2023.1coreIntel® Core™ i3-8100 CPU-only0011765111765msec/tokenmsec/token/$msec/token/TDPmsec.
389GPT-j-6bOV-2023.1coreIntel® Core™ i5-10500TE CPU-only0021465121465msec/tokenmsec/token/$msec/token/TDPmsec.
390GPT-j-6bOV-2023.1coreIntel® Core™ i5-13600K CPU-only003291251329125msec/tokenmsec/token/$msec/token/TDPmsec.
391GPT-j-6bOV-2023.1coreIntel® Core™ i5-8500 CPU-only0019265119265msec/tokenmsec/token/$msec/token/TDPmsec.
392GPT-j-6bOV-2023.1coreIntel® Core™ i7-1185G7 CPU-only0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
393GPT-j-6bOV-2023.1coreIntel® Core™ i7-1185GRE CPU-only0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
394GPT-j-6bOV-2023.1coreIntel® Core™ i7-8700T CPU-only0030335130335msec/tokenmsec/token/$msec/token/TDPmsec.
395GPT-j-6bOV-2023.1coreIntel® Core™ i9-10900TE CPU-only0048835148835msec/tokenmsec/token/$msec/token/TDPmsec.
396GPT-j-6bOV-2023.1coreIntel® Core™ i9-12900TE CPU-only0054435154435msec/tokenmsec/token/$msec/token/TDPmsec.
397GPT-j-6bOV-2023.1coreIntel® Core™ i9-13900K CPU-only242.95457.830.4055883311.943579285991251599125msec/tokenmsec/token/$msec/token/TDPmsec.
398GPT-j-6bOV-2023.1atomIntel® Processor N-20000193611936msec/tokenmsec/token/$msec/token/TDPmsec.
399GPT-j-6bOV-2023.1xeonIntel® Xeon® W1290P CPU-only005941251594125msec/tokenmsec/token/$msec/token/TDPmsec.
400GPT-j-6bOV-2023.1xeonIntel® Xeon® E-2124G CPU-only0030671130671msec/tokenmsec/token/$msec/token/TDPmsec.
401GPT-j-6bOV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only00314421021572105msec/tokenmsec/token/$msec/token/TDPmsec.
402GPT-j-6bOV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only001695441028477205msec/tokenmsec/token/$msec/token/TDPmsec.
403GPT-j-6bOV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only110.25200.490.0058899070.2041616111871854029359270msec/tokenmsec/token/$msec/token/TDPmsec.
404GPT-j-6bOV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only119.09131.630.0035027920.17013562934000700217000350msec/tokenmsec/token/$msec/token/TDPmsec.
405GPT-j-6bOV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only00202220021011100msec/tokenmsec/token/$msec/token/TDPmsec.
406GPT-j-6bOV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only277.75278.220.1221405980.925825733227430021137150msec/tokenmsec/token/$msec/token/TDPmsec.
407GPT-j-6bOV-2023.1accelIntel® Flex-170143.21143.001msec/tokenmsec/token/$msec/token/TDPmsec.
408GPT-j-6bOV-2023.1accelIntel® Flex-1401msec/tokenmsec/token/$msec/token/TDPmsec.
409GPT-j-6bOV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
410GPT-j-6bOV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
411GPT-j-6bOV-2023.1core-iGPUIntel® Processor N200 iGPU-only00193611936msec/tokenmsec/token/$msec/token/TDPmsec.
412GPT-j-6bOV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
413GPT-j-6bOV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
414GPT-j-6bOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
415GPT-j-6bOV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU00193611936msec/tokenmsec/token/$msec/token/TDPmsec.
416GPT-j-6bOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
417end_rec
418begin_recmsec/tokenmsec/token/$msec/token/TDPmsec.
419llama-2-7b-chatOV-2023.1atomIntel® Celeron™ 6305E CPU-only0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
420llama-2-7b-chatOV-2023.1coreIntel® Core™ i3-8100 CPU-only0011765111765msec/tokenmsec/token/$msec/token/TDPmsec.
421llama-2-7b-chatOV-2023.1coreIntel® Core™ i5-10500TE CPU-only0021465121465msec/tokenmsec/token/$msec/token/TDPmsec.
422llama-2-7b-chatOV-2023.1coreIntel® Core™ i5-13600K CPU-only003291251329125msec/tokenmsec/token/$msec/token/TDPmsec.
423llama-2-7b-chatOV-2023.1coreIntel® Core™ i5-8500 CPU-only0019265119265msec/tokenmsec/token/$msec/token/TDPmsec.
424llama-2-7b-chatOV-2023.1coreIntel® Core™ i7-1185G7 CPU-only0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
425llama-2-7b-chatOV-2023.1coreIntel® Core™ i7-1185GRE CPU-only0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
426llama-2-7b-chatOV-2023.1coreIntel® Core™ i7-8700T CPU-only0030335130335msec/tokenmsec/token/$msec/token/TDPmsec.
427llama-2-7b-chatOV-2023.1coreIntel® Core™ i9-10900TE CPU-only0048835148835msec/tokenmsec/token/$msec/token/TDPmsec.
428llama-2-7b-chatOV-2023.1coreIntel® Core™ i9-12900TE CPU-only0054435154435msec/tokenmsec/token/$msec/token/TDPmsec.
429llama-2-7b-chatOV-2023.1coreIntel® Core™ i9-13900K CPU-only285.08511.770.4759304512.280658725991251599125msec/tokenmsec/token/$msec/token/TDPmsec.
430llama-2-7b-chatOV-2023.1atomIntel® Processor N-20000193611936msec/tokenmsec/token/$msec/token/TDPmsec.
431llama-2-7b-chatOV-2023.1xeonIntel® Xeon® W1290P CPU-only005941251594125msec/tokenmsec/token/$msec/token/TDPmsec.
432llama-2-7b-chatOV-2023.1xeonIntel® Xeon® E-2124G CPU-only0030671130671msec/tokenmsec/token/$msec/token/TDPmsec.
433llama-2-7b-chatOV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only00314421021572105msec/tokenmsec/token/$msec/token/TDPmsec.
434llama-2-7b-chatOV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only001695441028477205msec/tokenmsec/token/$msec/token/TDPmsec.
435llama-2-7b-chatOV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only95.08182.220.0050797930.1760806671871854029359270msec/tokenmsec/token/$msec/token/TDPmsec.
436llama-2-7b-chatOV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only119.29133.200.0035086660.17042092934000700217000350msec/tokenmsec/token/$msec/token/TDPmsec.
437llama-2-7b-chatOV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only00202220021011100msec/tokenmsec/token/$msec/token/TDPmsec.
438llama-2-7b-chatOV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only338.67345.260.1489318211.1289032227430021137150msec/tokenmsec/token/$msec/token/TDPmsec.
439llama-2-7b-chatOV-2023.1accelIntel® Flex-170138.06137.361msec/tokenmsec/token/$msec/token/TDPmsec.
440llama-2-7b-chatOV-2023.1accelIntel® Flex-1401msec/tokenmsec/token/$msec/token/TDPmsec.
441llama-2-7b-chatOV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
442llama-2-7b-chatOV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
443llama-2-7b-chatOV-2023.1core-iGPUIntel® Processor N200 iGPU-only00193611936msec/tokenmsec/token/$msec/token/TDPmsec.
444llama-2-7b-chatOV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
445llama-2-7b-chatOV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU0010715110715msec/tokenmsec/token/$msec/token/TDPmsec.
446llama-2-7b-chatOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU0049028149028msec/tokenmsec/token/$msec/token/TDPmsec.
447llama-2-7b-chatOV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU00193611936msec/tokenmsec/token/$msec/token/TDPmsec.
448llama-2-7b-chatOV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU0042628142628msec/tokenmsec/token/$msec/token/TDPmsec.
449end_rec
450begin_recGeneration time, sec.Generation-time/$Generation-time/TDPmsec.
451stable diffusion V2OV-2023.1atomIntel® Celeron™ 6305E CPU-only0010715110715Generation time, sec.Generation-time/$Generation-time/TDPmsec.
452stable diffusion V2OV-2023.1coreIntel® Core™ i3-8100 CPU-only0011765111765Generation time, sec.Generation-time/$Generation-time/TDPmsec.
453stable diffusion V2OV-2023.1coreIntel® Core™ i5-10500TE CPU-only0021465121465Generation time, sec.Generation-time/$Generation-time/TDPmsec.
454stable diffusion V2OV-2023.1coreIntel® Core™ i5-13600K CPU-only003291251329125Generation time, sec.Generation-time/$Generation-time/TDPmsec.
455stable diffusion V2OV-2023.1coreIntel® Core™ i5-8500 CPU-only0019265119265Generation time, sec.Generation-time/$Generation-time/TDPmsec.
456stable diffusion V2OV-2023.1coreIntel® Core™ i7-1185G7 CPU-only0042628142628Generation time, sec.Generation-time/$Generation-time/TDPmsec.
457stable diffusion V2OV-2023.1coreIntel® Core™ i7-1185GRE CPU-only0049028149028Generation time, sec.Generation-time/$Generation-time/TDPmsec.
458stable diffusion V2OV-2023.1coreIntel® Core™ i7-8700T CPU-only0030335130335Generation time, sec.Generation-time/$Generation-time/TDPmsec.
459stable diffusion V2OV-2023.1coreIntel® Core™ i9-10900TE CPU-only0048835148835Generation time, sec.Generation-time/$Generation-time/TDPmsec.
460stable diffusion V2OV-2023.1coreIntel® Core™ i9-12900TE CPU-only0054435154435Generation time, sec.Generation-time/$Generation-time/TDPmsec.
461stable diffusion V2OV-2023.1coreIntel® Core™ i9-13900K CPU-only43.2143.130.0721295990.345645045991251599125Generation time, sec.Generation-time/$Generation-time/TDPmsec.
462stable diffusion V2OV-2023.1atomIntel® Processor N-20000193611936Generation time, sec.Generation-time/$Generation-time/TDPmsec.
463stable diffusion V2OV-2023.1xeonIntel® Xeon® W1290P CPU-only005941251594125Generation time, sec.Generation-time/$Generation-time/TDPmsec.
464stable diffusion V2OV-2023.1xeonIntel® Xeon® E-2124G CPU-only0030671130671Generation time, sec.Generation-time/$Generation-time/TDPmsec.
465stable diffusion V2OV-2023.1xeonIntel® Xeon® Gold 5218T CPU-only00314421021572105Generation time, sec.Generation-time/$Generation-time/TDPmsec.
466stable diffusion V2OV-2023.1xeonIntel® Xeon® Platinum 8270 CPU-only001695441028477205Generation time, sec.Generation-time/$Generation-time/TDPmsec.
467stable diffusion V2OV-2023.1xeonIntel® Xeon® Platinum 8380 CPU-only18.9519.430.0010122360.0350870931871854029359270Generation time, sec.Generation-time/$Generation-time/TDPmsec.
468stable diffusion V2OV-2023.1xeonIntel® Xeon® Platinum 8490H CPU-only5.886.470.0001728890.00839747134000700217000350Generation time, sec.Generation-time/$Generation-time/TDPmsec.
469stable diffusion V2OV-2023.1xeonIntel® Xeon® Silver 4216R CPU-only00202220021011100Generation time, sec.Generation-time/$Generation-time/TDPmsec.
470stable diffusion V2OV-2023.1xeonIntel® Xeon® Silver 4316 CPU-only21.9222.420.009637960.073055733227430021137150Generation time, sec.Generation-time/$Generation-time/TDPmsec.
471stable diffusion V2OV-2023.1accelIntel® Flex-1704.294.311Generation time, sec.Generation-time/$Generation-time/TDPmsec.
472stable diffusion V2OV-2023.1accelIntel® Flex-14018.6818.461Generation time, sec.Generation-time/$Generation-time/TDPmsec.
473stable diffusion V2OV-2023.1core-iGPUIntel® Celeron™ 6305E iGPU-only0010715110715Generation time, sec.Generation-time/$Generation-time/TDPmsec.
474stable diffusion V2OV-2023.1core-iGPUIntel® Core™ i7-1185GRE iGPU-only0049028149028Generation time, sec.Generation-time/$Generation-time/TDPmsec.
475stable diffusion V2OV-2023.1core-iGPUIntel® Processor N200 iGPU-only00193611936Generation time, sec.Generation-time/$Generation-time/TDPmsec.
476stable diffusion V2OV-2023.1core-iGPUIntel® Core™ i7-1185G7 iGPU-only0042628142628Generation time, sec.Generation-time/$Generation-time/TDPmsec.
477stable diffusion V2OV-2023.1core-CPU+iGPUIntel® Celeron™ 6305E CPU+iGPU0010715110715Generation time, sec.Generation-time/$Generation-time/TDPmsec.
478stable diffusion V2OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185GRE CPU+iGPU0049028149028Generation time, sec.Generation-time/$Generation-time/TDPmsec.
479stable diffusion V2OV-2023.1core-CPU+iGPUIntel® Processor N200 CPU+iGPU00193611936Generation time, sec.Generation-time/$Generation-time/TDPmsec.
480stable diffusion V2OV-2023.1core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU0042628142628Generation time, sec.Generation-time/$Generation-time/TDPmsec.
481end_rec