* Added migration for deployment (#10800)
* Added migration for deployment
* Addressed comments
* more info after the What's new Sessions' questions (#10803)
* more info after the What's new Sessions' questions
* generalizing the optimal_batch_size vs explicit value message
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Perf Hints docs and General Opt Guide refactoring (#10815)
* Brushed the general optimization page
* Opt GUIDE, WIP
* perf hints doc placeholder
* WIP
* WIP2
* WIP 3
* added streams and few other details
* fixed titles, misprints etc
* Perf hints
* movin the runtime optimizations intro
* fixed link
* Apply suggestions from code review
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* some details on the FIL and other means when pure inference time is not the only factor
* shuffled according to general->use-case->device-specifics flow, minor brushing
* next iter
* section on optimizing for tput and latency
* couple of links to the features support matrix
* Links, brushing, dedicated subsections for Latency/FIL/Tput
* had to make the link less specific (otherwise docs compilations fails)
* removing the Temp/Should be moved to the Opt Guide
* shuffled the tput/latency/etc info into separated documents. also the following docs moved from the temp into specific feature, general product desc or corresponding plugins
- openvino_docs_IE_DG_Model_caching_overview
- openvino_docs_IE_DG_Int8Inference
- openvino_docs_IE_DG_Bfloat16Inference
- openvino_docs_OV_UG_NoDynamicShapes
* fixed toc for ov_dynamic_shapes.md
* referring the openvino_docs_IE_DG_Bfloat16Inference to avoid docs compilation errors
* fixed main product TOC, removed ref from the second-level items
* reviewers remarks
* reverted the openvino_docs_OV_UG_NoDynamicShapes
* reverting openvino_docs_IE_DG_Bfloat16Inference and openvino_docs_IE_DG_Int8Inference
* "No dynamic shapes" to the "Dynamic shapes" as TOC
* removed duplication
* minor brushing
* Caching to the next level in TOC
* brushing
* more on the perf counters ( for latency and dynamic cases)
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Updated common IE pipeline infer-request section (#10844)
* Updated common IE pipeline infer-reqest section
* Update ov_infer_request.md
* Apply suggestions from code review
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
* DOCS: Removed useless 4 spaces in snippets (#10870)
* Updated snippets
* Added link to encryption
* [DOCS] ARM CPU plugin docs (#10885)
* initial commit
ARM_CPU.md added
ARM CPU is added to the list of supported devices
* Update the list of supported properties
* Update Device_Plugins.md
* Update CODEOWNERS
* Removed quotes in limitations section
* NVIDIA and Android are added to the list of supported devices
* Added See Also section and reg sign to arm
* Added Preprocessing acceleration section
* Update the list of supported layers
* updated list of supported layers
* fix typos
* Added support disclaimer
* update trade and reg symbols
* fixed typos
* fix typos
* reg fix
* add reg symbol back
Co-authored-by: Vitaly Tuzov <vitaly.tuzov@intel.com>
* Try to fix visualization (#10896)
* Try to fix visualization
* New try
* Update Install&Deployment for migration guide to 22/1 (#10933)
* updates
* update
* Getting started improvements (#10948)
* Onnx updates (#10962)
* onnx changes
* onnx updates
* onnx updates
* fix broken anchors api reference (#10976)
* add ote repo (#10979)
* DOCS: Increase content width (#10995)
* fixes
* fix
* Fixed compilation
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
Co-authored-by: Aleksandr Voron <aleksandr.voron@intel.com>
Co-authored-by: Vitaly Tuzov <vitaly.tuzov@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
Co-authored-by: Victoria Yashina <victoria.yashina@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
* Moved openvino to src
* Moved ngraph and frontends to src
* Fixed cmake generation
* Moved inference_engine libs to src
* Moved C API to src
* Fixed CMake generation
* Moved readers to tests, snippets and preprocessing to common
* Fixed CMake
* Moved transformations and lp_transformations
* Fixed transformations cmake
* Fixed build
* Fixed unit-tests and ci paths
* Fixed docs
* Fixed C API build
* Try to fix static build
* More clear order
* Renamed inference_engine_legacy_api to legacy
* Fixed some cmake scripts
* Fixed path to legacy
* Fixed Myriad plugin
* Fixed v7 reader
* Fixed plugin.hpp
* Fixed developer config
* Fixed ie_parallel
* Proper cmake install for static libraries case
* Added an ability to skip template plugin
* Added install rules for VPU / GPU
* Install more libraries
* Fixed absolute TBB include paths
* Disable GNA
* Fixed issue with linker
* Some fixes
* Fixed linkage issues in tests
* Disabled some tests
* Updated CI pipelines
* Fixed Windows linkage
* Fixed custom_opset test for static casr
* Fixed CVS-70313
* Continue on error
* Fixed clanf-format
* Try to fix Windows linker
* Fixed compilation
* Disable samples
* Fixed samples build with THREADING=SEQ
* Fixed link error on Windows
* Fixed ieFuncTests
* Added static Azure CI
* Revert "Fixed link error on Windows"
This reverts commit 78cca36fd2.
* Merge static and dynamic linux pipelines
* Fixed Azure
* add missed __init__.py files
* Update __init__.py
empty line
* Merge infirence_engine/tools/benchmark_tool with tools/benchmark_tool
* Update MD links
* remove benchmark_tool from package_BOM.txt
* add tools folder to the list of Doxygen files
* fix relative paths
* Update index.md
remove extra line
* Merge onnx_importer to onnx_ngraph_frontend
* address review comments
* use onnx_ngraph_frontend in docs/template_extension
* link onnx_ngraph_frontend instead of onnx_importer
* switch onnxruntime branch to rel-1.8.1_ov_2022.1 in https://github.com/intel/onnxruntime
* Remove pip install cmake since the 1.8.1 release doesnt require it
* add alias
* set IMPORTED_GLOBAL
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Added pugixml as submodule
* CVS-34900: updated pugixml to v1.11.4
* Fixed link with pugixml
* USe pugixml::static
* Try to fix bug
* Removed GITHUB_PULL_REQUEST
* Replaced OpenVINO_MAIN_SOURCE_DIR -> OpenVINO_SOURCE_DIR
* Removed some usages of IE_MAIN_SOURCE_DIR
* Use ngraph target directly
* enable make clean to remove ie_wheel artifacts
* ./setup.py:132:1: E302 expected 2 blank lines
* fix CI build issue
* Removed not-needed components from ie_wheel
* Use explicit python3 vresion in ngraph pythpn
* Use python3 everywhere
* Reuse python3 more
* Added function to build with Py_LIMITED_API
* Sync 2 cmake python modules
* Fix for tools
* Fixed typo
* Enable python by default
* Enable python build iff python-dev is found
* More migration to Python3_VERSION
* Install wheel requirements
* Fixed ngraph Python separate build
* Fixed cython compilation
* Revert to old packages
* Added suffix
* Specify python version explicitly
* Don't depend on python interp to build python itself
* More improvements
* Revert offline transformations back to ie_wheel
* Refactoring
* Trying to build wheel independently on C++ runtime
* Build wheel only with main OpenVINO
* Fixed typo in test_utils cmake lists
* Adding link stage
* small fix
* git diff
* Try to fix python tests
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>
* Fixed documentation build when paths contain spaces
* ops math formula fix
* Fixed typo in
* Added more dependencies for openvino_docs
* Improvements
Co-authored-by: Nikolay Tyukaev <ntyukaev_lo@jenkins.inn.intel.com>
* Added VariableState to Plugin API documentation
* More fixes for plugin documentation
* Added ie_memory_state.hpp to documentation
* Added proper dependencies between C++ and Plugin API targets
* Fixed issues in public C++ API reference
* Fixed issues in public C++ API reference: part 2
* Removed obsolete entries from EXCLUDE_SYMBOLS in doxygen config
* Fixed path to examples, tag files for Plugin API doxygen file
* Put impl to a private section for VariableStatebase
* Fixed examples path to Plugin API: part 2
* Fixed path to examples in main ie_docs doxygen file
* Replaced path to snippets; otherwise path depends on how cloned repo is named
* Added path to snippets for ie_docs doxygen file as well
* Great amount of fixes for documentation
* Removed IE_SET_METRIC
* Fixes for C API documentation
* More fixes for documentation
* Restored Transformations API as a part of Plugin API
* Fixed tag files usage for Plugin API
* Fixed link to FakeQuantize operation
* Add tests, examples and documentation changes for custom ONNX operators registration mechanism
* Change snippet paths
* fix CoreThreadingTests.ReadNetwork - data race in ops_bridge
* Make TemplateExtension::Operation externally visible
* changes after review
* apply code format
* use std::int64_t
* forward declare get_attribute_value specializations
* introduce unregister_operator in onnx_importer
* onnx_custom_op - lock mem first then take a buffer
* func tests - create template_extension via make_so_pointer
* fix build with NGRAPH_ONNX_IMPORT_ENABLE=OFF
* remove exports from Operation and Extension
* Move multithreaded AddExtension test to different directory to it can be excluded when NGRAPH_ONNX_IMPORT_ENABLE=OFF
* Dont include Extension tests if ENABLE_MKL_DNN=OFF
* fix excluding onnx_reader tests
* include extension tests only if mkl is enabled
* add comment on empty blob
* use register_operator conditionally in template_extension
* fix docs after review
* create static library from onnx_custom_op
* add additional test for unregister_operator
* move model example after register step
* revert changes to unit tests
* update ngraphConfig.cmake.in header
* add headers to onnx_custom_op
* changes to docs CMakeLists
* remove redundant onnx_importer dependency
* remove extension directory from func tests
* make onnx_importer a component of ngraph package
* docs fixes
* update header of ngraph/cmake/share/ngraphConfig.cmake.in with ngraph_onnx_importer_FOUND
