* Query the property optimal_number_of_infer_requests from plugin first if plugin supported.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Query the property ov::optimal_number_of_infer_request of actual device first and use it as the result of AutoExecutableNetwork property.
* Updated.
* Updated.
* Update.
* Update.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Update selection logic for 3rd part devices within AUTO plugin.
* Remove MYRAID from AUTO test case.
* Update.
* Update.
* Update.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Update ReorgYolo to use ngraph shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add dynamic TCs for ov_gpu_func_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add shape infer TCs for ov_gpu_unit_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply comments
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix clang-format
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflict
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* [GPU] Fix cl kernel build error(#18513)
* [GPU] Rollback cl kernel code change and add type converions to activatino function)
* [GPU] Use output data type instead of unit type in MakeActivationJitConstants
* [GPU] remove unused code and add comments
- add unit test
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`
* Temporary support of StaticShape
* Minor corrections in ShapeInferenceTA
* Migrate shape_infer to new interface version
* Replace StaticShape by adapter implementation
* Replace IShapeInferCommon by IStaticShapeInfer
* Correct code formatting
* Fix build issues
* NodeValidationFailure::create for StaticShapeRef
* test not run in ci
Signed-off-by: fishbell <bell.song@intel.com>
* skip unsupported case in batch
Signed-off-by: fishbell <bell.song@intel.com>
---------
Signed-off-by: fishbell <bell.song@intel.com>
* Update RegionYolo to use ngraph shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add dynamic TCs for ov_gpu_func_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add shape infer TCs for ov_gpu_unit_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* 1. Setting property ov::compilation_num_threads for actual device (not CPU) selected by AUTO.
2. Add the test case.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* check if the selected device supports this property before enabling this property.
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Updated.
* Updated.
* Using the ov::device::properties, instead of the device name, to check if secondary property is set for hardware device.
* Update.
* Update.
* Update.
* Update the property handling logic to support the ov::device::properties setting.
* Update.
* Update.
* Update the case to check if the secondary propery has high priority.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Add debug config for disabled dynamic impl
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply comment
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Draft version of save_model function (C++, Python)
* Fixed code style.
* Fixed incorrect test model construction for Python save_model tests
* Minor improvements in code readability
* Minor adjustment based on PR review
* merget loadnetwork and importnetwork for cpu plugin
* fix testcase
* remove multithreading config saving
* modify test case
* separate function
* modify function name
* save model_prefer_threads to cache
* remove function encapsulation for config
* Update op creation for DetectionOutput-8 w/o num_classes attribute
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update DetectionOutput to use ngraph shape inference
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add dynamic TCs for ov_gpu_func_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix issues for detection output cpu impl selection on dynamic shape
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update detection_output primitive API and funcs for serialization
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add shape infer TCs for ov_gpu_unit_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix build failure in azure pipeline
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* WIP: parameters cleanup
* Removed debug output, fixed CLI
* Fixed python objects conversion
* Finally renamed mmap to share_weights
* Fixed TF conversion from a file or a directory
* Fixed obvious errors in unit tests
* Deleted layouts from OVC. Fixed most of the fails in ovc unit tests (there are still failures)
* Clenaup other references to layouts and fixed --version
* Fixed case when two model files are passed in TF case
* Fixed multiple model parts passing in ovc command line
* Tests fixed, support of unnamed input in cli parser.
* Remove convert_model from runtime.
* Changed silent to verbose.
* Removed transform param.
* Removed example_input, share_weights from ovc cli tool.
* Remove wrong change.
* Test fix.
* Code corrections.
* Returned comment.
* WA to fix process hanging after extension loading.
* Removed not needed code.
* Added comment.
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
