* add support for scalar shapes into cli_parser.py
* add test-case with scalar shapes for convert_model
* reordered inputs in test-case with scalar shapes for convert_model
* minor clarifications
---------
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Update DepthToSpace to use ngraph shape infer
* Remove legacy block_size limitation for static shape
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add TCs for ov_gpu_func_tests and ov_gpu_unit_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add GroupNorm reference implementation
* Clean up
* Handle GroupNorm in ov namespace only
* Simplify the flow
* Add various scale and bias tests
* Fix batches case
* Add more float tests
* Set output shape
* Set output shape
* Fix missing includes
* Move to ov namespace
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
* Pad ref impl tests for negative pads begin end
* Adjust indentation
* Remove redundant line from the output
* Add tests with removal on middle axis
* Add tests with empty result
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
* Initial commit for proxy plugin
* Include proxy to openvino library
* Fixed some tests
* Added plugin properties
* Added readme
* Support Compile model for the proxy plugin
* Fixed python
* Remove gmock
* Fixed some tests
* Fixed load plugin tests
* Removed internal PROXY_FALLBACK_PRIORITIES initialization property
* Fixed code style
* Added new tests
* Create architecture.md
* Fixed some proxy tests
* Implement not implemented functions
* Fixed ICore mock
* Remove redundant code
* Added import/export tests
* Fixed hetero import/export tests
* Fixed ICore mock
* Fixed import tests
* Fixed build
* Remove redundant parse config
* Fixed some comments
* Try to fix Windows build
* Fixed incorrect logic
* Small fix in tests
* Fixed python API
* Fixed typo
* Try to fix python
* Switch GPU under proxy
* Fixed GPU name
* Revert GPU plugin under proxy
* Small changes in CMake files
* Temp commit
* Build without proxy
* Revert "Temp commit"
This reverts commit 1ac9824bdf.
* Fixed test linking
* Removed tests from ncc check
* Add option to disable proxy plugin
* Fixed minor comments
* Disable some proxy tests if IR frontend is disabled
* Enable Intel GPU under the proxy
* Fixed typo
* Fixed segfault in tests
* Small fix for case if only GPU is registered
* Fixed code style
* Added remote context tests
* Added proxy tests to CI
* Fixed mock engine
* Test change
* Revert "Test change"
This reverts commit 2d1d67766f.
* Add new tests
* Removed some tests
* Revert "Removed some tests"
This reverts commit 090398652f.
* Revert incorrect logic
* Removed unused variables
* Use original name for the GPU plugin
* Fixed CMake
* Do not show hidden devices
* Try to fix GPU remote context
* Fixed GPU plugin build
* Added interface for proxy remote context
* Remove local properties
* Remove redundant API
* Fixed typo
* Added remote tensors
* Fixed code style
* Fixed some comments
* Unwrap remote tensors before conversion to Blob
* Added cast for legacy API
* Fixed some cldnn tests
* Do not add preprocessing for proxy plugin
* Enabled more tests and wrap tensors in infer request
* Use hardware request inside conversion wrapper
* Fixed hand on cache calculation
* Try to fix some tests
* Support set tensor for remote tensors in proxy plugin
* Revert "Support set tensor for remote tensors in proxy plugin"
This reverts commit 5a927de590.
* Remove redundant friend from compiled model and fix life time for infer
request
* Fixed code style
* Add additional so pointers to the tensor
* Rewrite approach for compile model and tensor
* Removed API from proxy
* Fixed is/as Blob for wrapped Blobs
* Wrap tensor when set tensor to plugin
* Fixed recursive call
* Don't unwrap tensors for AUTO plugin
* Fixed Some Multi tests with remote blob for proxy
* Align context name with tests
* Fixed code style
* Try to fix more tests
* Some minor changes
* Try to fix OVHoldersTests
* Try to save low level SO in high level wrappers
* Revert "Try to save low level SO in high level wrappers"
This reverts commit 430ff8a526.
* Revert "Try to fix OVHoldersTests"
This reverts commit 32604f0d3e.
* Disable some tests
* Fixed DynamicBatchShapeTests
* Fixed caching tests and skip OVHoldersTest
* Small refactoring
* Fixed import model
* Small fix
* Fix typo which causes fails of caching tests
* Disabled AUTO BATCH for proxy device
* Support Export in Auto batch
* Small changes
* Fixed initialization fallback to plugin with proxy name
* Added more values for tests
* Ask all devices and create context if no device id
* Support export in auto batch
* Fixed some comments
* Fixed some comments and removed auto batch
* Fixed some comments
* Fixed auto batch test and some comments
* Fixed build
* Removed proxy plugin class from dev api
* Fixed code style
* Fixed disabled tests
* [WA] Comment the onnx test.
Seems this test error would be a little bigger than expected error.
* Remove the softmax CPU function test filter because onednn merge all
ISAs into one primitive.
* Fix zero point issue.
* Remove wino conv test cases because ONEDNN3.2 does not supported.
* Fix cpu debug log verbose
* Update onednn to squash commit version.
* Applied tolerance threashold for onnx_model_bias_gelu test.
* Restore to fix ICX perf regression.
* Clean winograd related code.
* Update ONEDNN to support ARM.
* Applied review comments.
* [GPU] Add roi_align get_shape_infer_dependencies (#18345)
* [GPU] Fix concat cpu impl for buffer fusing case
* [GPU] Add roi_align shape_infer unit tests
* [GPU] Fix windows build issue
* [GPU] add unit test
* Resolve tensor sharing issue when there are same name output port name
In some case, model has 2 or more same name input/output ports, they aslo have the same
precision and partial_shape. Compiled_model will share the same ov::Descriptor::Tensor pointer
and ov::Tensor between multiple such ports.
Considered solving python segment fault issue to create seperated input/output ports, which also
need handle such tensor shared case, this patch will do it.
* Better method to find shrared tensor desc
* Use port's tensor_ptr to replace creating new tensor_ptr
* Add auto pad attribute support for conv
* Fix to let concat onednn impl check can_be_optimized in impl_param instead of that in node
* Apply auto padding to kernel param for conv ocl impl
* conv shape agnostic kernel is not selected if conv is not explicit padding
* Fix failed TCs for ov_gpu_unit_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* enabled MVN SLT tests on ARM
* moved nhwc to common section
* exclude normalizeVariance=true from x64
* fixed comments
* add NCHW+acrossChannels = false test case
* Add comment about unsupported case
* fixed 5d layout in Mvn5D_noAcrossChannels
* MvnLayerCPUTest::isSupportedTestCase() added
* init
* moved NHWC to common section
* experiment to support dynamic shapes in reduce transformation
* support dynamic shapes
* axes sorting fix in reduce transformations
* Introduce ov::element visitor
* Example usage visitor in shape infer tools
* Example usage of visitor in unsqueeze evaluate
* Example usage of visitor in Round evaluate
* Example usage of visitor in Unique evaluate
* Refactor element visitor
- Use visitor in tanh and tan operators
* Fix enable_if for MSVC compiler
* Update comments in element visitor
* Move test to the core
* Corrects typos
* Apply code style
* prim::TupleUnpack and prim::ListUnpack removing transformation in PT FE to flatten input list and tuples
* Enabled tuples and lists as items in example_inputs
* Applied code style
* Added tests for tuples as inputs and extended test infrastructure to support it
* Negligible performance optimizations
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fixed duplicated names of test classes
* Added description for tuple flattening transformation
* Removed any support for list flattening on inputs; fixed layer tests
* Fixed style
* Fixed order of new Parameters and Results while flattening tuples
* Fixed style
* Better diagnostics when not all prim::TupleUnpack ops after Parameters are decomposed
* Small fix in diagnostics message
---------
Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
* skip fuse_quantize_f if input or output layout is dynamic
* Update condition of can_fuse_reorder_to_prev for concat in shapeof subgraph
* skip concat_in_place_optimization if concat is shape of subgraph
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add reorder if eltwise is shapeof subgraph and data type between input and output is different
* Skip reorder optimization if reorder has dynamic shape on remove_redundant_reorders
* Add reproducible TCs for ov_gpu_unit_tests
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
