* [GPU] Add weight format to enable models
Add g_os_zy_is_x_osv8_isv2, g_os_zyx_is_osv8_isv2, g_os_is_zyx_isa8_osv8_isv2
These formats are required from brain-tumor-segmentation-0001/mxnet/fp16/bs1,
resnext-101-3d/onnx/fp16/bs1.
* [GPU] Fix the issue, Can't find reduce output later in OutputsDataMap.
The layer name of Reduce converted from AvgPool is different originals.
It caused an exception, so use original name.
We have AvgPool to Reduce conversion to improve Perf in dGPU.
-target model
action-recognition-0001-encoder, driver-action-recognition-adas-0002-encoder
* [GPU] Remove bfzyx format in oneDNN FC supported format
Current clDNN FC supports 4dims NOT 5dims, and many related logics are implemented from this, likes
calc_output_layout.
For this reason, oneDNN FC 5dims occur the functional issue in resnext-3/onnx/FP16/BS1
* [GPU] Fix to unsupported 6dims block-format in gather cals_output_layout.
It's failed issue in cocosnet/onnx/FP16/BS1
Signed-off-by: hyunback <hyunback.kim@intel.com>
* ov::set_property should not set HW plugin when device is AUTO or MULTI plugin.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* core set_property() didn't support setting ov::device::propreties for HW device.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Added doxygen comment for opset10
* Added get_available_opsets method to API
* Fixed build
* Fixed build and typo
* Use constant map
* Removed defines from global opset
* Added const to map
* turn on bom_tests
* fixed root directories to search
* leftovers fix
* removed requirements from package_BOM.txt; corrected error messages to install via pip
* removed extract_release_version.py from package_BOM.txt, added requirements files to skip
* removed redundant commented line
* mentioned CustomLayersMapping.xml.example in docs
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
* Intial update for NMS mutiple outputs support
- update get_depedencies_new primitive overriding func for nms and reorder
- primitve API update for nms and reorder
- add non_max_suppression_base test TC for multiple outputs
- update non_max_suppression cpu impl for backward compatibility
- update dependencies_new for remove_redundant_reorders opt pass
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update program_node and kernel_impl_params for multiple outputs supports
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix runtime error and failed TC for multiple outputs support
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflicts and newly update
Signed-off-by: Andrew Park <andrew.park@intel.com>
* TopK shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Implement TopK gpuFunctests for dynamic shape and multiple outputs
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflicts
Signed-off-by: Andrew Park <andrew.park@intel.com>
* minor API fix
Signed-off-by: Andrew Park <andrew.park@intel.com>
* NMS shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Implement Nms gpuFunctests for dynamic shape and multiple outputs
Signed-off-by: Andrew Park <andrew.park@intel.com>
* move gpuFunctests and fix conflict
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix issues for Nms gpuFunctests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflicts and code cleanup
Signed-off-by: Andrew Park <andrew.park@intel.com>
* apply clang-format
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply change to onednn primitive_impl
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix CI issues
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply code review
Signed-off-by: Andrew Park <andrew.park@intel.com>
* updates for ngraph shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflicts
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply code review
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Failing case
* Apply code review
Signed-off-by: Andrew Park <andrew.park@intel.com>
Signed-off-by: Andrew Park <andrew.park@intel.com>
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
* [TF FE] Refactor translator for L2Loss and test in the pre-commit
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use Power for square operation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* [PYTHON] Pipeline transfer
* [PYTHON] Align python benchmark
* [PYTHON] Align last step
* [PYTHON] Fix innacuracies of the last step - median
* [PYTHON/CPP] Add Core::get_version method to python API, refactor Ben benchmark to print version with this func
* [PYTHON] Remove get_version_string from API
* [PYTHON/CPP] Align output for model input/output info
* [PYTHON/CPP] Step 4,6 alignment of outputs, step 8 dumps all info stored in config parameters
* [CPP] Fix a bug causing nstreams parameter to never be set to AUTO in CPP benchmark_app
* [CPP] Fix clang format errors
* [CPP] Modify print order and data output for 8th step
* [PYTHON] Add verification checks from C++, modify set_thoughtput_streams to match documentation
* [CPP] Revert changes to C++ benchmark_app
* [CPP] Remove additional spacebar
* Update submodules versions on remote
* Update module from master branch
* Redownload submodules from master and override changes from commit
* [PYTHON] Remove unneccesary parse_status from validation function
* [PYTHON] Check for HINT in map, fix circular import
* [PYTHON] Remove artifacts from commit, fix args.perf_hint set to '' instead to 'none'
* [PYTHON] Reverse changes to perf hint, add key in map check, fix validation function throwing error on set hint
* [PYTHON] Fix linter
* [PYTHON] Remove linter spacebar
* [CPP] Fix wait_all exception throw
* [CPP/PYTHON] Clean artifacts and unwanted changes from work process
* [PYTHON] Fix artifacts from merge, clean submodule update
* [C++ CPU] Fix device name string by removing padding NULL characters from the back
* [CPP] Fix ba infer_request_wrap in other throw-catch clauses
* [PYTHON/CPP] Fix missing latencies in final step for shape group, fix minor misaligned messages, add missing report parameter create infer requests time
* [CPP] Clang fix formatting
* [CPP] Reverse clang fix format on plugin.cpp
* [PYTHON/CPP] Fix C++ progressbar printing endl when disabled, fix rounding in python creating infer request message
* [CPP] Fix foramtiing error
* [PYTHON/C++] Refactor network to model based on naming conventions, provide fresh README output example
* [PYTHON/C++] Add example output to C++ README, remove unnecessary device loop
* [BENCHMARK_APP/C++] Fix artifact from refactoring, remove try-catch clause
* Update samples/cpp/benchmark_app/benchmark_app.hpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* [CPP] Fix clang errors
* [CPP/PLUGIN Reverse modification to extract to separate task
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/parameters.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON/C++/BENCHMARK_APP] Fix language inconsistencies, remove unnecessary checks
* Update pyopenvino.cpp
* [CPP/BENCHMARK_APP] Remove unnecessary try-catch, fix linter errors
* [PYTHON/CPP/BENCHMARK_APP] Revert changes to Core, align version prints usin only provided methods
* [DOCS/BENCHMARK_APP] Update README with proper model examples
* Update README.md
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [GPU] Refactor impls factory method
* [GPU] Return unique_ptr from impls factory
* [GPU] implemented get_kernel_params for most of ocl impls
* [GPU] Common create impl
* [GPU] Fixes after rebase
* [GPU] Codestyle fixes
* [GPU] handle optimized out prims in common create
* [GPU] Fix exception type in region yolo tests
* [GPU] Resolve ambiguity of make_unique on windows
* [GPU] Multiclass NMS
* [GPU] Fixes after rebase
