* [GPU] Fix cl kernel build error(#18513)
* [GPU] Rollback cl kernel code change and add type converions to activatino function)
* [GPU] Use output data type instead of unit type in MakeActivationJitConstants
* [GPU] remove unused code and add comments
- add unit test
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`
* Temporary support of StaticShape
* Minor corrections in ShapeInferenceTA
* Migrate shape_infer to new interface version
* Replace StaticShape by adapter implementation
* Replace IShapeInferCommon by IStaticShapeInfer
* Correct code formatting
* Fix build issues
* NodeValidationFailure::create for StaticShapeRef
* test not run in ci
Signed-off-by: fishbell <bell.song@intel.com>
* skip unsupported case in batch
Signed-off-by: fishbell <bell.song@intel.com>
---------
Signed-off-by: fishbell <bell.song@intel.com>
* Update RegionYolo to use ngraph shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add dynamic TCs for ov_gpu_func_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add shape infer TCs for ov_gpu_unit_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* 1. Setting property ov::compilation_num_threads for actual device (not CPU) selected by AUTO.
2. Add the test case.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* check if the selected device supports this property before enabling this property.
* Update.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Updated.
* Updated.
* Using the ov::device::properties, instead of the device name, to check if secondary property is set for hardware device.
* Update.
* Update.
* Update.
* Update the property handling logic to support the ov::device::properties setting.
* Update.
* Update.
* Update the case to check if the secondary propery has high priority.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Add debug config for disabled dynamic impl
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply comment
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Draft version of save_model function (C++, Python)
* Fixed code style.
* Fixed incorrect test model construction for Python save_model tests
* Minor improvements in code readability
* Minor adjustment based on PR review
* merget loadnetwork and importnetwork for cpu plugin
* fix testcase
* remove multithreading config saving
* modify test case
* separate function
* modify function name
* save model_prefer_threads to cache
* remove function encapsulation for config
* Update op creation for DetectionOutput-8 w/o num_classes attribute
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update DetectionOutput to use ngraph shape inference
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add dynamic TCs for ov_gpu_func_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix issues for detection output cpu impl selection on dynamic shape
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update detection_output primitive API and funcs for serialization
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add shape infer TCs for ov_gpu_unit_tests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix build failure in azure pipeline
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* WIP: parameters cleanup
* Removed debug output, fixed CLI
* Fixed python objects conversion
* Finally renamed mmap to share_weights
* Fixed TF conversion from a file or a directory
* Fixed obvious errors in unit tests
* Deleted layouts from OVC. Fixed most of the fails in ovc unit tests (there are still failures)
* Clenaup other references to layouts and fixed --version
* Fixed case when two model files are passed in TF case
* Fixed multiple model parts passing in ovc command line
* Tests fixed, support of unnamed input in cli parser.
* Remove convert_model from runtime.
* Changed silent to verbose.
* Removed transform param.
* Removed example_input, share_weights from ovc cli tool.
* Remove wrong change.
* Test fix.
* Code corrections.
* Returned comment.
* WA to fix process hanging after extension loading.
* Removed not needed code.
* Added comment.
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* add streams_info_table init in the constructor of config
* add refresh _proc_type_table
* add get_org_proc_type_table
* add numa_node per stream in reserve_available_cpus()
* fix warning
* remove log
* fix code style
* fix gpu test build failed issue, modify debug info
* fix code style
* fix build failed on macos
* fix code style
* select socket in reserve cpu on 2 sockets platform
* fix build failed on macos
* modify numa node selecting in reserve_cpu_by_streams_info
* add test case
* fix code style
* modify test case
* fix core dump
* fix core dumped on pin=NUMA
* fix test failed on macos
* fix reserve cpu is wrong when streams_info_table=[1 1 36] proc_type_table=[36 18 0 18]
* add test case in LinuxCpuReserve
* modify test case
* add test case in cpu_reserve_test
* add cpu_stream_info_test
* modify enum
* fix test failed
* change int to size_t
* remove invalid code, fix running failed on macos
* modify LinuxCpuStreamType test case, move ie_cpu_streams_info.hpp to openvino/runtime/threading/
* fix code sytle
* modify enum name
* add comments in test case
* fix build issue
* change IE_ASSERT to OPENVINO_ASSERT
* fix test failed on macos and windows
* updated test cases due to the cpu mapping is changed
* enable numa_node_id and socket_id in streams_info_table
* fix code style issue
* fix document issue
* add get socket id interface
* fix segment fault on machine enabled socket_id=1 with numactl command
* fix numactl failed on four numa nodes machine
* remove compile warning
* fix numa_node_id=-1
* fix test case failed on macos
* fix test failed on macos
* fix numa_node_id=0 on macos
* Solve conflicts with master branch
* separate test cases for Linux and Mac/Windows
* update code style for windows compiler
* fix comments
* fix code style
* fix code style
* remove _plugin_mutex, fix comments
* fix code style
* fix code style
* add get_num_sockets
* fix cpu reserve issue in latency mode,ANY core on RPL machine
* add cpu reserve test case
---------
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
