Introduce vpu ngraph transformation that decomposes Mish layer with the following formula: mish(x) = x * tanh(ln(exp(x) + 1)). It is needed to fix the accuracy drop of Yolo-v4 public model that happened due to Mish implementation in the myriad plugin is not accurate enough. It is just a workaround and will be removed when Mish layer will be improved.
map: 70.97% (ref: 70.96%)
coco_precision: 73.50% (ref 73.49%)
* Optimized Infer Request Scheduling
* Fixed misprint
* Brushing the code and comments a bit
* further brushing of the ScheduleToWorkerRequest: moving the task execution directly into the loop over devices (avoids pointers and 'else' clause)
* 1) zero-copy (assuming determenistic app-level scheduling) for the multi-device, via "borrowing" the corresponding device-specific blobs and letting the app to implicitly use these
2) Initial MULTI section in the opt guide (primarily to document a tip on helping the MULTI to keep the zero-copy path)
Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
* [MO] Add CMake install for Model Optimizer
* [MO] Update test for version.py
* [MO] Add CMake install for Model Optimizer
* [MO] Update test for version.py
* [MO] Add CMake install for Model Optimizer
* [MO] Update test for version.py
* Add CMake install rules for OpenVINO 3rd party dependencies
Remove unwanted targets from final distribution (test, static libs, etc)
* remove duplicated targets from install
align GNA Windows install path with Linux
* Add COMPONENT install name for OMP
remove empty lines
* Add OMP to CPack components
* remove gtest from deliverables
add explicitly clDNN_unit_tests target to build
* set clDNN_unit_tests properties only by condition
* remove install commands for clDNN
Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
* ROIPooling: Specification and op class alignment
* ROIPooling: Add check to input tensor type to be aligned with spec
* ROIPooling: Corrected spec description for input tensor shape and box coordinates
* ROIPooling: Changed attributes pooled_h and pooled_w from Shape to plain int
* Revert "ROIPooling: Changed attributes pooled_h and pooled_w from Shape to plain int"
This reverts commit d49cfa8e53.
* ROIPooling: Further specification changes
* ROIPooling: Rename enum class ROIPoolingMethod methods
* Fix style
* ROIPooling: Draft reference implementation
* ROIPooling: Adjust feature map element type to float for attribute unit test
* ROIPooling: Add single layer test class
* ROIPooling: Corrected output index to iterate through output tensor elements
* ROIPooling: Added validation checks for input types in op constructor
* ROIPooling: Add unit tests
* ROIPooling: Attributes unit test changed to align with spec
* ROIPooling: Add check for batch id in reference implementation and unit test
* ROIPooling: Refactor single layer test class
* ROIPooling: Add test for invalid pooling method
* ROIPooling: Clean up unnecessary function declaration
* ROIPooling: Remove duplicated default ROIPooling method in op constructors
* ROIPooling: Add Infer method to generate suitable ROI data
* ROIPooling: CPU single layer test instantiation for max method
* ROIPooling: Remove enum class ROIPoolingMethod
* Revert "ROIPooling: Clean up unnecessary function declaration"
This reverts commit 074b540dea.
* ROIPooling: Refactor single layer tests after removing enum class ROIPoolingMethod
* ROIPooling: Add attribute checks in op constructor to align with spec and unit tests
* Resolve CI failure: clang could not resolve static conversion from uint64_t to size_t
* ROIPooling: Fix for output index calculation to loop through all ROIs
* ROIPooling: Add unit test for bilinear interpolation method
* ROIPooling: Add CPU single layer test instantiation for bilinear method
* ROIPooling: Clean up unnecessary enum class for pooling method
* ROIPooling: Add myriad single layer test instantiation
* ROIPooling: Add F16 precision single layer tests for CPU plugin
* ROIPooling: Add node validation check for string method attribute in constructor and unit tests
* ROIPooling: Spec changes to improve understanding of the operation
* ROIPooling: Fix for bilinear method when pooled size is 1x1
* ROIPooling: Add unit test for bilinear method and pooled size 1x1
* ROIPooling: Fix to broken format of specifications
* ROIPooling: Disable Myriad single layer tests
* ROIPooling: Handle dynamic dims and ranks for input tensors and unit tests
* ROIPooling: Code clean up
* ROIPooling: Address review comments
* ROIPooling: Changed location for makeROIPooling helper method
Co-authored-by: Kirill Molchanov <kirill.molchanov@intel.com>
* Optimized Infer Request Scheduling
* Fixed misprint
* Brushing the code and comments a bit
* further brushing of the ScheduleToWorkerRequest: moving the task execution directly into the loop over devices (avoids pointers and 'else' clause)
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
* [CPU BF16] Greedy mode was added
* [IE TESTS][BF16] Added support for operations with bf16 precision in the single layer tests.
* Added cpu specific bfloat16 single layer tests for the jit_eltwise primitive.
* [CPU TESTS] Activation and logical single layer tests fixes.
* [IE TESTS] Fix activation single layer tests run.
* [IE TESTS][CPU] CPUTestBase further refactoring.
* [CPU BF16] Support for Bfloat16 type was added to the MVN layer. (#3)
* [CPU BF16] MVN layer bfloat16 compatibility.
* [CPU BF16] MVN bfloat16 minor fixes.
* [CPU BF16] MVN node exception about BF16 support replaced with precision redefinition.
* [CPU BF16] MVN layer bloat16 support fixed for quantization operations and blocking layout.
* [CPU] Input and output precision checks were added to MVN layer.
* [IE TESTS][CPU BF16] Most of the bloat16 tests have been fixed.
* Bf16 crop layer (#4)
* [IE TESTS][CPU] Cpu specific test for the Crop layer has been created.
* [IE TESTS][CPU] Deprecated Crop single layer test removed.
* [CPU BF16] Bfloat16 precision was added to the Crop layer.
* [CPU BF16] Crop layer minor code improvements.
* [IE TESTS][CPU] Crop layer test added 2D tensor tests.
* [IE TESTS][CPU] Crop layer test, obsolete comment removed.
* [IE TESTS][CPU] Fixed CropIE include path.
* Crop test fix for older gcc compiler.
* [CPU BF16] Reduce layer extended with bfloat16 support.
* [IE TESTS][CPU] CPU specific single layer test for Reduce operation.
* BF16 optimized layers
* [CPU BF16] Bfloat16 custom type added to the MKLDNN plugin.
* [CPU BF16] Mem alignment to 16 bytes added to bfloat16 class union.
* [IE TESTS][CPU] Permute cpu specific single layer test and minor cpu tests fixes
* MVN cpu single layer tests extended with nhwc ndhwc layouts.
* Mod mode removed from Eltwise cpu single layer test.
* Permute cpu specific single layer test.
* Smoke keyword was added to the CPU single layer tests.
* Normalize node was modified for BF16 support
* [CPU BF16] The RegionYolo layer has been extended with the bfloat16 type support.
* Resample node was extended with BF16
* Select layer was enabled with BF16
* psroi supports bf16 (#7)
* reorders replaces converts (#9)
* BF16 planar pooling was enabled
* [CPU BF16] Cpu_convert added to the RegionYOLO node.
* [IE TESTS][CPU] Crop single layer test has been rewritten using the StridedSlice operation.
* [IE TESTS][CPU] Covert layer test extended with bf16 precision.
* [CPU BF16] The bfloat16 class was renamed bfloat16_t and some refactoring has been done.
* [CPU BF16] RegionYOLO and Softmax were aligned with the review.
* [IE TESTS CPU] CPU single layer tests refactored according to the review suggestions.
* [IE TESTS CPU] The Reduce CPU single layer test was extended with different mem orders.
* [IE TESTS CPU] Minor fixes after the review.
* [IE TESTS CPU] Common plugin configuration has been moved to PreparePluginConfiguration function.
* Minor changes after review
* StridedSlice, Select, ScaleShift notes were resolved
* Fixes to the Reduce operation cpu test and minor fixes related to the review.
* GPU eltwise tests fix.
* psroi unrolled to the primary state; code clean (#12)
* PSROIPooling layer with C++ optimizations
* Minor fix for compatibility with CPUTestsBase for fuse_permute_reorder test.
* Code clean & psroi rollbacked
Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com>
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
Co-authored-by: Yury Gaydaychuk <yury.gaydaychuk@intel.com>
* add 4 tests for operators based on model zoo
* fix wrong names of the models
* add functional tests for equal, lstm_cell and psroi_pooling operators
* add functional tests for ConverLike and Mod operators
* Removed legacy network represetnation usage
* Updated core threading tests not to use legacy networks
* Removed QueryNetworkMULTIwithHETERONoThrowv7 test
* Removed QueryNetworkHETEROwithMULTINoThrow_v7 test
* Added QueryNEtwork test add skipped for GNA
Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
* Added VariableState to Plugin API documentation
* More fixes for plugin documentation
* Added ie_memory_state.hpp to documentation
* Added proper dependencies between C++ and Plugin API targets
* Fixed issues in public C++ API reference
* Fixed issues in public C++ API reference: part 2
* Removed obsolete entries from EXCLUDE_SYMBOLS in doxygen config
* Fixed path to examples, tag files for Plugin API doxygen file
* Put impl to a private section for VariableStatebase
* Fixed examples path to Plugin API: part 2
* Fixed path to examples in main ie_docs doxygen file
* Replaced path to snippets; otherwise path depends on how cloned repo is named
* Added path to snippets for ie_docs doxygen file as well
* Great amount of fixes for documentation
* Removed IE_SET_METRIC
* Fixes for C API documentation
* More fixes for documentation
* Restored Transformations API as a part of Plugin API
* Fixed tag files usage for Plugin API
* Fixed link to FakeQuantize operation
Unconditional Eltwise+ReLU merge makes some models take a bit more memory,
so they could not be inferred on Myriad-X. With this change used can
optionally disable this optimization and use Myriad-X.
* Add missing `SHA256` for `SYSTEM_PROTOC` package.
* Do not use `NGRAPH_ONNX_IMPORT_ENABLE` variable for it,
since it might not be defined at this time.
* Added info on DockerHub CI Framework
* Feature/azaytsev/change layout (#3295)
* Changes according to feedback comments
* Replaced @ref's with html links
* Fixed links, added a title page for installing from repos and images, fixed formatting issues
* Added links
* minor fix
* Added DL Streamer to the list of components installed by default
* Link fixes
* Link fixes
* ovms doc fix (#2988)
* added OpenVINO Model Server
* ovms doc fixes
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Updated openvino_docs.xml
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Tools for conditional compilation
* Unit tests for conditional compilation & Refactoring
* Fix for MSVC selective build macros
* Unit tests for conditional compilation in analysys mode
* Code generation for selective build is hidden inside CMake
* Comments for conditional compilation options
