d1a7b0e3c0
* Docs: Update the doc on default hint and execution devices property (#14836) * Docs: Update to LATENCY as default hint * Docs: Update the doc on execution devices property * Update auto_device_selection.md Co-authored-by: Yuan Xu <yuan1.xu@intel.com> * 22.3: remove tbb version check for using tbbbind static library (#15700) * update symbolic link on uninstall page (#15720) * Update deployment_simplified.svg (#15681) * [NormalizeL2] normalization of reduction axes (#15841) (#15879) * Add test for negative axes, preliminary solution to solve uncorrect results * Normalize axes in operation NormalizeL2 * Add test for negative axes * Add EOF * [67541] - face-detection-0205, 0206 issues fixed (incorrect dimensions error) (#14687) * [CVS-67541] - face-detection-0205, 0206 issues fixed (incorrect dimensions error) * [CVS-67541] - face-detection-0205, 0206 issues fixed * Conversion fail for ov::hint::performance_mode with UNDEFINED value (#15903) * Update ov::hint::performance_hint UNDEFINED value from empty string to "UNDEFINED". Update benchmark Python version. Update the description about hint setting within benchmark APP README and help message. * Drop the reduntant changes. * Supported OpenSUSE 15.3 (#15897) (#15907) * [DOCS] Structure change for 'AUTO Device Selection' article - post merge fix (#15752) * aligning with 14750 * Fixed samples build on Debian 10 with cmake 3.13 (#15939) * Fixed samples build on Debian 10 with cmake 3.13 * Use 2022/3 branches * Limit setuptools version * Fixed issues in setupvars.sh (#15884) (#15952) * Fixed issues with setupvar.sh * Fixes setupvars realpath error --------- Co-authored-by: Otoka, Tomasz <tomasz.otoka@intel.com> * Apivalidator (#15951) * Improved API validator logic (#15942) * Fix for apiValidator when more than 1 target needs to be checked (#15950) * Prevent infinite recursion * [Snippets] Added matcher_name in ConvertConstantsToScalars pass (#15977) * Install libtbb2 instead of libtbb12 on U22.04 (#15993) * Apply Apivalidator to extra TBB libs (#15998) * [GNA] Changed max layer limit tests to avoid SEH exceptions (#15015) (#15460) * splitted test model * Changed test config * Set SF for all inputs * [Transformations] Enable missing runtime info check (#15796) (#15972) * Add rt info propagation to StridesOptimization * Enable rt info check for pruning tests * Fixed clang-format for C API (#16025) * Port to 2022.3 from master (#16049) * notebooks update (#16091) 20230302220806 * Update Customize_Model_Optimizer.md (#15687) Recreating #14062 * fix benchmark_app python to support YES and NO values for -pin parameter (#16042) * support YES and NO for -pin * add if property_name == 'AFFINITY' --------- Co-authored-by: Chen Peter <peter.chen@intel.com> * [Docs] nv12 changes port to 22.3 (#16115) Port: #15370 #16004 add single-plane input information create single-plane cpp snippet menu fix update formatting for sphinx directives additional snippet fixes --------- Co-authored-by: Ilya Churaev <ilyachur@gmail.com> Co-authored-by: Vladimir Paramuzov <vladimir.paramuzov@intel.com> * [DOCS] Port Frontend Extensions and OTX page (#16135) * [DOCS] Add OTX page to Ecosystem (#16118) * add otx page * change ecosystem page * add ote img * move ote page to rst * fix path * add path * img test * otx page * add docs to ecosystem page * [DOCS] Fix Frontend Extensions snippets (#16120) * move fe to rst * fix code snippets * add more line breaks * fix tabsets * fix link * fix anchor * test * fixing link * change tab directive * fix tabs * align code tabs * fix link * fix snippets * add dlwb to ecosystem * change ecosystem menu * exclude fe page * Port to 2022.3 (#16174) * Remove setuptools upperbound (#16054) * Added missed licenses to openvino-dev (#16057) * Fixed OpenMP + debian package code-path (#16058) * [CPU] Prevent out of bounds read inside Graph::InferDynamic (#16067) * Fixed compilation on Debian 11 with gcc 12.2 (#16096) * Fix for OpenCL --------- Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com> Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com> * Docs benchmarks page update port 22.3 (#16187) changes to benchmarks page to align with theme * Andreib/2022.3 myriad plugin obs (#16079) * Changed to OBS firmware * Changed dependencies settings for new FW --------- Co-authored-by: Daria Mityagina <daria.mityagina@intel.com> * port-16085 (#16210) * 234 update (#16212) Adding notebook 234-encodec-audio-compression * [DOCS] Adding 'Scrollbox' - new sphinx directive (#15307) port https://github.com/openvinotoolkit/openvino/pull/15305 * [DOCS] Updating 'Prerequisites' section in `Configurations for GNA` article - for 22.3 (#16237) * issue-15090 Add command for installation of prerequisites on Linux. * DOCS-image-fix port22.3 (#16341) (#16324) (#16308) * Clearing of CustomReplacementRegistry.registry in convert_model() (#15893) (#16347) * Clearing of CustomReplacementRegistry.registry. * Added test. * Fixed clearing of pipeline config params and TF session in convert_model() (#16191) (#16346) * Fixed pipeline config params clearing. * Added clearing of TF session. Added tests. --------- Co-authored-by: Wang Wangwang <wangwang.wang@intel.com> Co-authored-by: Yuan Xu <yuan1.xu@intel.com> Co-authored-by: Fang Xu <fang.xu@intel.com> Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com> Co-authored-by: Artur Kulikowski <artur.kulikowski@intel.com> Co-authored-by: Daria Mityagina <daria.mityagina@intel.com> Co-authored-by: Wang, Yang <yang4.wang@intel.com> Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com> Co-authored-by: Otoka, Tomasz <tomasz.otoka@intel.com> Co-authored-by: Alexandra Sidorova <alexandra.sidorova@intel.com> Co-authored-by: Vitaliy Urusovskij <vitaliy.urusovskij@intel.com> Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com> Co-authored-by: Tomasz Jankowski <tomasz1.jankowski@intel.com> Co-authored-by: Haiqi Pan <haiqi.pan@intel.com> Co-authored-by: Chen Peter <peter.chen@intel.com> Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com> Co-authored-by: Ilya Churaev <ilyachur@gmail.com> Co-authored-by: Vladimir Paramuzov <vladimir.paramuzov@intel.com> Co-authored-by: Tatiana Savina <tatiana.savina@intel.com> Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com> Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com> Co-authored-by: Andrei-George Boji <andrei-george.boji@intel.com> Co-authored-by: Anastasiia Pnevskaia <anastasia.popova@intel.com>
2.1 KiB
2.1 KiB
Model Accuracy
The following table presents the absolute accuracy drop calculated as the accuracy difference between FP32 and INT8 representations of a model on two platforms
- A - Intel® Core™ i9-9000K (AVX2)
- B - Intel® Xeon® 6338, (VNNI)
- C - Intel® Flex-170
@sphinxdirective .. list-table:: Model Accuracy :header-rows: 1
-
- OpenVINO™ Model name
- dataset
- Metric Name
- A
- B
- C
-
- bert-base-cased
- SST-2_bert_cased_padded
- accuracy
- 0.11%
- 1.15%
- 0.57%
-
- bert-large-uncased-whole-word-masking-squad-0001
- SQUAD_v1_1_bert_msl384_mql64_ds128_lowercase
- F1
- 0.51%
- 0.55%
- 0.68%
-
- deeplabv3
- VOC2012_segm
- mean_iou
- 0.44%
- 0.06%
- 0.04%
-
- densenet-121
- ImageNet2012
- accuracy @ top1
- 0.31%
- 0.32%
- 0.30%
-
- efficientdet-d0
- COCO2017_detection_91cl
- coco_precision
- 0.88%
- 0.62%
- 0.50%
-
- faster_rcnn_resnet50_coco
- COCO2017_detection_91cl_bkgr
- coco_precision
- 0.19%
- 0.19%
- 0.20%
-
- googlenet-v4
- ImageNet2012_bkgr
- accuracy @ top1
- 0.07%
- 0.09%
- 0.26%
-
- mobilenet-ssd
- VOC2007_detection
- map
- 0.47%
- 0.14%
- 0.48%
-
- mobilenet-v2
- ImageNet2012
- accuracy @ top1
- 0.50%
- 0.18%
- 0.20%
-
- resnet-18
- ImageNet2012
- accuracy @ top1
- 0.27%
- 0.24%
- 0.29%
-
- resnet-50
- ImageNet2012
- accuracy @ top1
- 0.13%
- 0.12%
- 0.13%
-
- ssd-resnet34-1200
- COCO2017_detection_80cl_bkgr
- map
- 0.08%
- 0.09%
- 0.06%
-
- unet-camvid-onnx-0001
- CamVid_12cl
- mean_iou @ mean
- 0.33%
- 0.33%
- 0.30%
-
- yolo_v3_tiny
- COCO2017_detection_80cl
- map
- 0.01%
- 0.07%
- 0.12%
-
- yolo_v4
- COCO2017_detection_80cl
- map
- 0.05%
- 0.06%
- 0.01%
@endsphinxdirective