Yuan Hu
bf2d6a72a4
fix a typo in benchmark_app sample ( #12507 )
...
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com >
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com >
2022-08-25 07:12:03 +03:00
Sebastian Golebiewski
6227123d21
Porting to master - update -readme for CPP and Python benchmark ( #12245 )
...
Porting #11961
2022-07-26 14:12:08 +02:00
Chenhu Wang
43b3fff708
[DOC][CPU] Denormals optimization doc ( #12127 )
2022-07-20 04:35:45 +03:00
Luo Cheng
23b1b76457
[CPU] revert pr 11990 and enable brgconv avx512 on SPR by default ( #12105 )
2022-07-14 14:11:21 +04:00
Chenhu Wang
8c152405ad
[CPU] General denormals optimization ( #11883 )
...
* FTZ_and_DAZ_set_for_cpu
* remove DAZ
* fix
* extract to utils
* ie core part changes to add do as property and benchmark_app enable do
* enable brgcov from Luocheng patch
* add debug info
* enable_brgemm_on_avx512
* add python binding
* dlb test
* FTZ_and_DAZ_set_for_cpu
* remove DAZ
* fix
* extract to utils
* ie core part changes to add do as property and benchmark_app enable do
* enable brgcov from Luocheng patch
* add debug info
* enable_brgemm_on_avx512
* add python binding
* dlb test
* revert test code
* revert test code
2022-07-05 15:50:16 +08:00
Luo Cheng
35ee842446
[CPU] [WA] Use config to enable brgconv f32 kernel ( #11990 )
...
* enable brgconv f32
* use config to enable brgconv f32
* when brg disabled not init bin-postops
* change prop name for extensive
* use more general field
* fix review comments.
2022-07-05 07:14:40 +08:00
guozhong wang
0a65f5f607
selectdevice returns MULTI:device in cumulative_throughput ( #11367 )
...
* selectdevice returns MULTI:device in cumulative_throughput
* load multi with throughput and disable cpu helper in cumulative
* disable cpu helper in cumulative_throughput
* add cumulative to bechmark_app help message
* modify benchmark_app.hpp clang-format
2022-05-06 12:42:59 +08:00
Fedor Zharinov
787610b0db
-l option is replaced with -extensions ( #10878 )
2022-04-04 16:08:38 +03:00
Ilya Lavrenov
3c724a1dee
Build with system TBB ( #11244 )
...
* Build with system TBB
* Fixes
* Check whether system TBB is available
* Try to fix ONNX Runtime build with system TBB
* Test
* Fixed compilation of threading.cpp
* Fixed unset of cache dirs
* Limit dearch paths of TBB
* Try to enable pip packages with custom TBB
* Fix for TBB 2021.2
* Install only needed TBB libraries
* Install TBB from system to pip package
* Reverted usage of TBBROOT
* Fixed oneTBB case
* Try to fix Android
* Escape some paths
* Added samples path
* Fixed TBBBind usage for case of system TBB
2022-03-31 18:05:59 +03:00
Ilya Lavrenov
a883dc0b85
DOCS: ported changes from 2022.1 release branch ( #11206 )
...
* Extensibility guide with FE extensions and remove OV_FRAMEWORK_MAP from docs
* Rework of Extensibility Intro, adopted examples to missing OPENVINO_FRAMEWORK_MAP
* Removed OPENVINO_FRAMEWORK_MAP reference
* Frontend extension detailed documentation
* Fixed distributed snippets
* Fixed snippet inclusion in FE extension document and chapter headers
* Fixed wrong name in a snippet reference
* Fixed test for template extension due to changed number of loaded extensions
* Update docs/Extensibility_UG/frontend_extensions.md
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com >
* Minor fixes in extension snippets
* Small grammar fix
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com >
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com >
* DOCS: transition banner (#10973 )
* transition banner
* minor fix
* update transition banner
* updates
* update custom.js
* updates
* updates
* Documentation fixes (#11044 )
* Benchmark app usage
* Fixed link to the devices
* More fixes
* Update docs/OV_Runtime_UG/multi_device.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Removed several hardcoded links
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Updated documentation for compile_tool (#11049 )
* Added deployment guide (#11060 )
* Added deployment guide
* Added local distribution
* Updates
* Fixed more indentations
* Removed obsolete code snippets (#11061 )
* Removed obsolete code snippets
* NCC style
* Fixed NCC for BA
* Add a troubleshooting issue for PRC installation (#11074 )
* updates
* adding gna to linux
* add missing reference
* update
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* Update docs/install_guides/installing-model-dev-tools.md
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* update
* minor updates
* add gna item to yum and apt
* add gna to get started page
* update reference formatting
* merge commit
* add a troubleshooting issue
* update
* update
* fix CVS-71846
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
* DOCS: fixed hardcoded links (#11100 )
* Fixes
* Use links
* applying reviewers comments to the Opt Guide (#11093 )
* applying reviewrs comments
* fixed refs, more structuring (bold, bullets, etc)
* refactoring tput/latency sections
* next iteration (mostly latency), also brushed the auto-batching and other sections
* updates sync/async images
* common opts brushed
* WIP tput redesigned
* minor brushing of common and auto-batching
* Tput fully refactored
* fixed doc name in the link
* moved int8 perf counters to the right section
* fixed links
* fixed broken quotes
* fixed more links
* add ref to the internals to the TOC
* Added a note on the batch size
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* [80085] New images for docs (#11114 )
* change doc structure
* fix manager tools
* fix manager tools 3 step
* fix manager tools 3 step
* new img
* new img for OV Runtime
* fix steps
* steps
* fix intendents
* change list
* fix space
* fix space
* code snippets fix
* change display
* Benchmarks 2022 1 (#11130 )
* Minor fixes
* Updates for 2022.1
* Edits according to the review
* Edits according to review comments
* Edits according to review comments
* Edits according to review comments
* Fixed table
* Edits according to review comments
* Removed config for Intel® Core™ i7-11850HE
* Removed forward-tacotron-duration-prediction-241 graph
* Added resnet-18-pytorch
* Add info about Docker images in Deployment guide (#11136 )
* Renamed user guides (#11137 )
* fix screenshot (#11140 )
* More conservative recommendations on dynamic shapes usage in docs (#11161 )
* More conservative recommendations about using dynamic shapes
* Duplicated statement from C++ part to Python part of reshape doc (no semantical changes)
* Update ShapeInference.md (#11168 )
* Benchmarks 2022 1 updates (#11180 )
* Updated graphs
* Quick fix for TODO in Dynamic Shapes article
* Anchor link fixes
* Fixed DM config (#11199 )
* DOCS: doxy sphinxtabs (#11027 )
* initial implementation of doxy sphinxtabs
* fixes
* fixes
* fixes
* fixes
* fixes
* WA for ignored visibility attribute
* Fixes
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com >
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com >
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com >
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com >
Co-authored-by: Yuan Xu <yuan1.xu@intel.com >
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com >
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com >
Co-authored-by: Ilya Naumov <ilya.naumov@intel.com >
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com >
2022-03-24 22:27:29 +03:00
Vladimir Dudnik
3a8800cbd2
[Docs][IE Samples] fix hard links ( #11144 )
...
* fix hard links
* change encoding
* fix TM
Co-authored-by: CCR\ntyukaev <nikolay.tyukaev@intel.com >
2022-03-23 23:48:08 +03:00
Sergey Lyubimtsev
dacdf67c2c
Update Benchmark guides ( #11076 ) ( #11085 )
...
* - Update Benchmark Tool usage message
- Remove not existed paths
- Fix examples
* remove reference on FPGA
(cherry picked from commit 3caa77eb30
2022-03-21 19:31:17 +03:00
Ilya Churaev
1fec99afa3
Removed duplicated words ( #10754 )
2022-03-03 06:50:54 +00:00
Ilya Lavrenov
991c9db1c1
Config api docs ( #10563 )
...
* Renamed hetero md
* Renamed some guides
* Updated OpenVINO_Runtime_User_Guide.md
* Updated plugin's page
* More updates
* Fixed links
* Updated link names
* Fixed links
* Fixed docs build
* Self-review
* Fixed issues in doc snippets
2022-02-22 14:32:57 +03:00
Xuejun Zhai
9b41aa707d
Modify for CVS-69023: hint configuration ( #10259 )
...
Signed-off-by: xuejun <xuejun.zhai@intel.com >
2022-02-14 17:46:11 +03:00
Anton Pankratov
1621a5a0b5
Used new config for streams and threads ( #10150 )
...
* Used new config for streams and threads
* Fixed review coments in ba
* format fix
* fixed hello_query_device
* Added STL string io
* fixed tests
* Fixed test
* Fixed build
* fixed format
* Fixed build
* try fix win
* other any io specialization
* Fixed after merge
* renamed streams
* build fixed
* fixed build
* fixed format
* fix for old mac build
* Fixed type of exception
* test fix
2022-02-11 09:22:45 +03:00
Ilya Churaev
a2ca1d4499
Merge IE & nGraph DG ( #10055 )
...
* Changed folder for documentation
* Fixed links
* Merged nGraph DG to OpenVINO Runtime UG
* Fixed errors
* Fixed some issues
* Fixed tree
* Fixed typo
* Update docs/documentation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update README.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update README.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Fixed name
* FIxed snippets
* Small fixes
* Update docs/HOWTO/Custom_Layers_Guide.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Fixed comments
* Try to fix doc
* Try to fix doc issue
* Update docs/OV_Runtime_UG/Integrate_with_customer_application_new_API.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
* Update docs/OV_Runtime_UG/model_representation.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
2022-02-07 06:57:35 +03:00
Nikolay Tyukaev
622027bee5
fix errors in documentation ( #9384 )
...
* add sphinx log parsing
* fix
* fix log
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* doxygen-xfail
* fixes
* fixes
* fixes
* fixe
* fixes
* fixes
* fix pot
* add pot check
* fixes
* fixes
* Fixed POT docs
* Fixed POT docs
* Fixes
* change heading markup
* fixes
Co-authored-by: azaytsev <andrey.zaytsev@intel.com >
2022-01-27 19:39:49 +03:00
Ivan Vikhrev
a2cf98bebb
[IE Samples] json configuration reader and dumper for benchmark_app ( #9648 )
...
* added load_config and dump_config functions implemented with json library
* add warning, upd readme
* Update samples/cpp/benchmark_app/README.md
Co-authored-by: Fedor Zharinov <fedor.zharinov@intel.com >
Co-authored-by: Fedor Zharinov <fedor.zharinov@intel.com >
2022-01-18 11:22:47 +03:00
Andrey Zaytsev
4ae6258bed
Feature/azaytsev/from 2021 4 ( #9247 )
...
* Added info on DockerHub CI Framework
* Feature/azaytsev/change layout (#3295 )
* Changes according to feedback comments
* Replaced @ref's with html links
* Fixed links, added a title page for installing from repos and images, fixed formatting issues
* Added links
* minor fix
* Added DL Streamer to the list of components installed by default
* Link fixes
* Link fixes
* ovms doc fix (#2988 )
* added OpenVINO Model Server
* ovms doc fixes
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com >
* Updated openvino_docs.xml
* Updated the link to software license agreements
* Revert "Updated the link to software license agreements"
This reverts commit 706dac500e#8151 )
* docs to sphinx
* Update GPU.md
* Update CPU.md
* Update AUTO.md
* Update performance_int8_vs_fp32.md
* update
* update md
* updates
* disable doc ci
* disable ci
* fix index.rst
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
# Conflicts:
# .gitignore
# docs/CMakeLists.txt
# docs/IE_DG/Deep_Learning_Inference_Engine_DevGuide.md
# docs/IE_DG/Extensibility_DG/Custom_ONNX_Ops.md
# docs/IE_DG/Extensibility_DG/VPU_Kernel.md
# docs/IE_DG/InferenceEngine_QueryAPI.md
# docs/IE_DG/Int8Inference.md
# docs/IE_DG/Integrate_with_customer_application_new_API.md
# docs/IE_DG/Model_caching_overview.md
# docs/IE_DG/supported_plugins/GPU_RemoteBlob_API.md
# docs/IE_DG/supported_plugins/HETERO.md
# docs/IE_DG/supported_plugins/MULTI.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Caffe.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_MxNet.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_ONNX.md
# docs/MO_DG/prepare_model/convert_model/Converting_Model.md
# docs/MO_DG/prepare_model/convert_model/Converting_Model_General.md
# docs/MO_DG/prepare_model/convert_model/Cutting_Model.md
# docs/MO_DG/prepare_model/convert_model/pytorch_specific/Convert_RNNT.md
# docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_EfficientDet_Models.md
# docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_WideAndDeep_Family_Models.md
# docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md
# docs/doxygen/Doxyfile.config
# docs/doxygen/ie_docs.xml
# docs/doxygen/ie_plugin_api.config
# docs/doxygen/ngraph_cpp_api.config
# docs/doxygen/openvino_docs.xml
# docs/get_started/get_started_macos.md
# docs/get_started/get_started_raspbian.md
# docs/get_started/get_started_windows.md
# docs/img/cpu_int8_flow.png
# docs/index.md
# docs/install_guides/VisionAcceleratorFPGA_Configure.md
# docs/install_guides/VisionAcceleratorFPGA_Configure_Windows.md
# docs/install_guides/deployment-manager-tool.md
# docs/install_guides/installing-openvino-linux.md
# docs/install_guides/installing-openvino-macos.md
# docs/install_guides/installing-openvino-windows.md
# docs/optimization_guide/dldt_optimization_guide.md
# inference-engine/ie_bridges/c/include/c_api/ie_c_api.h
# inference-engine/ie_bridges/python/docs/api_overview.md
# inference-engine/ie_bridges/python/sample/ngraph_function_creation_sample/README.md
# inference-engine/ie_bridges/python/sample/speech_sample/README.md
# inference-engine/ie_bridges/python/src/openvino/inference_engine/ie_api.pyx
# inference-engine/include/ie_api.h
# inference-engine/include/ie_core.hpp
# inference-engine/include/ie_version.hpp
# inference-engine/samples/benchmark_app/README.md
# inference-engine/samples/speech_sample/README.md
# inference-engine/src/plugin_api/exec_graph_info.hpp
# inference-engine/src/plugin_api/file_utils.h
# inference-engine/src/transformations/include/transformations_visibility.hpp
# inference-engine/tools/benchmark_tool/README.md
# ngraph/core/include/ngraph/ngraph.hpp
# ngraph/frontend/onnx_common/include/onnx_common/parser.hpp
# ngraph/python/src/ngraph/utils/node_factory.py
# openvino/itt/include/openvino/itt.hpp
# thirdparty/ade
# tools/benchmark/README.md
* Cherry-picked remove font-family (#8211 )
* Cherry-picked: Update get_started_scripts.md (#8338 )
* doc updates (#8268 )
* Various doc changes
* theme changes
* remove font-family (#8211 )
* fix css
* Update uninstalling-openvino.md
* fix css
* fix
* Fixes for Installation Guides
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com >
Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com >
# Conflicts:
# docs/IE_DG/Bfloat16Inference.md
# docs/IE_DG/InferenceEngine_QueryAPI.md
# docs/IE_DG/OnnxImporterTutorial.md
# docs/IE_DG/supported_plugins/AUTO.md
# docs/IE_DG/supported_plugins/HETERO.md
# docs/IE_DG/supported_plugins/MULTI.md
# docs/MO_DG/prepare_model/convert_model/Convert_Model_From_Kaldi.md
# docs/MO_DG/prepare_model/convert_model/tf_specific/Convert_YOLO_From_Tensorflow.md
# docs/install_guides/installing-openvino-macos.md
# docs/install_guides/installing-openvino-windows.md
# docs/ops/opset.md
# inference-engine/samples/benchmark_app/README.md
# inference-engine/tools/benchmark_tool/README.md
# thirdparty/ade
* Cherry-picked: doc script changes (#8568 )
* fix openvino-sphinx-theme
* add linkcheck target
* fix
* change version
* add doxygen-xfail.txt
* fix
* AA
* fix
* fix
* fix
* fix
* fix
# Conflicts:
# thirdparty/ade
* Cherry-pick: Feature/azaytsev/doc updates gna 2021 4 2 (#8567 )
* Various doc changes
* Reformatted C++/Pythob sections. Updated with info from PR8490
* additional fix
* Gemini Lake replaced with Elkhart Lake
* Fixed links in IGs, Added 12th Gen
# Conflicts:
# docs/IE_DG/supported_plugins/GNA.md
# thirdparty/ade
* Cherry-pick: Feature/azaytsev/doc fixes (#8897 )
* Various doc changes
* Removed the empty Learning path topic
* Restored the Gemini Lake CPIU list
# Conflicts:
# docs/IE_DG/supported_plugins/GNA.md
# thirdparty/ade
* Cherry-pick: sphinx copybutton doxyrest code blocks (#8992 )
# Conflicts:
# thirdparty/ade
* Cherry-pick: iframe video enable fullscreen (#9041 )
# Conflicts:
# thirdparty/ade
* Cherry-pick: fix untitled titles (#9213 )
# Conflicts:
# thirdparty/ade
* Cherry-pick: perf bench graph animation (#9045 )
* animation
* fix
# Conflicts:
# thirdparty/ade
* Cherry-pick: doc pytest (#8888 )
* docs pytest
* fixes
# Conflicts:
# docs/doxygen/doxygen-ignore.txt
# docs/scripts/ie_docs.xml
# thirdparty/ade
* Cherry-pick: restore deleted files (#9215 )
* Added new operations to the doc structure (from removed ie_docs.xml)
* Additional fixes
* Update docs/IE_DG/InferenceEngine_QueryAPI.md
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com >
* Update docs/IE_DG/Int8Inference.md
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com >
* Update Custom_Layers_Guide.md
* Changes according to review comments
* doc scripts fixes
* Update docs/IE_DG/Int8Inference.md
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com >
* Update Int8Inference.md
* update xfail
* clang format
* updated xfail
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com >
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com >
Co-authored-by: kblaszczak-intel <karol.blaszczak@intel.com >
Co-authored-by: Yury Gorbachev <yury.gorbachev@intel.com >
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com >
2021-12-21 20:26:37 +03:00
Fedor Zharinov
e9874ec1d4
Dynamic reshapes ( #7788 )
...
* Merged and compiling
* Fix for dynamic shape type
* review fixes
* renamed blob shape to tensor shape, small improvements
* fix code style
* added parsing of multiple shapes
* store latency per group, add isIdleRequestAvailable() to Infer Queue
* added cached random inputs
* redesign pipeline, added new metrics(avg, max, min), added metrics per groups
* fixed code style
* small improvements
* modified tensor parameters parsing
* modified -i parameter parsing: added possibility to specify input names
* implemented image cashing
* added cashed blobs creating
* added -pcseq flag, modified batch filling, changes fps formula
* improvements
* code formatting
* code formatting2
* apply suggestions from review
* replaced Buffer class with InferenceEngine Blobs
* use batch size in blobs filling
* added shared blob allocator to handle blob's data
* fixed warnings & code style
* allocate blobs
* fix for networks with image info input
* added comments & fixed codestyle
* clear data in free() in SharedBlobAllocator
* remove unnecessary check
* Delimeter is changed to ::
* stylefix
* added layout from string function, small improvements
* modified parsing to enable : in input parameters
* small fixes
* small fixes
* added missed blob allocation, fixes
* [TEST]added support for remote blobs
* fix remote blobs
* new inputs/files output format
* removed vectors resize which caused bugs
* made cl::Buffer type under ifdef, fix inputs filling
* changed batch() function to not throwing exceptions
* removed unused var
* fix code style
* replace empty name in input files with name from net input
* restored old behaviour for static models
* fix code style
* fix warning - made const iterator
* fix warning - remove reference in loop variable
* added random and image_info input types to -i, fix problem with layout
* replaced batch() with getBatchSize() in main
* fix layout, shape, tensor shape parameters parsing
* upd help messages for input, tensor shape and pcseq command
* added buffer for cl output blobs, small fixes
Signed-off-by: ivikhrev <ivan.vikhrev@intel.com >
* added legacy mode
* restore setBlob
* code style formatting
* move collecting latency for groups under flag
* removed not applicable layouts
* added hint to error message when wrong input name in -tensor_shape was specified
* added new metrics to statistics report
* Apply suggestions from code review
* fix binary blobs filling when layout is CN
* apply suggestions
* moved file in the right place after rebase
* improved -pcseq output
* updated args and readme
* removed TEMPLATE plugin registration
* fix -shape arg decsription
* enable providing several -i args as input
* renamed legacy_mode to inference_only and made it default for static models, renamed tensor_shape to data_shape
* upd readme
* use getBlob() in inference only mode
* fix old input type for static case
* fix typo
* upd readme
* move log about benchmark mode to the measuring perfomance step
* added class for latency metrics
* upd readme, fix typos, renamed funcs
* fix warning and upd parsing to avoid error with : in file paths
* fix error on centos : error: use of deleted function ‘std::basic_stringstream<char>::basic_stringstream(const std::basic_stringstream<char>&)
* added check for key in inputs
* renamed input to inputs
* adjust batch size for binary blobs
* replaced warning with exception in bench mode defining
* align measurement cycle with master
Co-authored-by: ivikhrev <ivan.vikhrev@intel.com >
2021-12-17 12:20:43 +03:00
Ilya Churaev
f639e4e902
Moved inference_engine samples to cpp folder ( #8615 )
...
* Moved inference_engine samples to cpp folder
* Fixed documentations links
* Fixed installation
* Fixed scripts
* Fixed cmake script
* Try to fix install
* Fixed samples
* Some fix
2021-11-18 10:08:20 +03:00
