* turn on bom_tests
* fixed root directories to search
* leftovers fix
* removed requirements from package_BOM.txt; corrected error messages to install via pip
* removed extract_release_version.py from package_BOM.txt, added requirements files to skip
* removed redundant commented line
* mentioned CustomLayersMapping.xml.example in docs
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
* Intial update for NMS mutiple outputs support
- update get_depedencies_new primitive overriding func for nms and reorder
- primitve API update for nms and reorder
- add non_max_suppression_base test TC for multiple outputs
- update non_max_suppression cpu impl for backward compatibility
- update dependencies_new for remove_redundant_reorders opt pass
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update program_node and kernel_impl_params for multiple outputs supports
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix runtime error and failed TC for multiple outputs support
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflicts and newly update
Signed-off-by: Andrew Park <andrew.park@intel.com>
* TopK shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Implement TopK gpuFunctests for dynamic shape and multiple outputs
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflicts
Signed-off-by: Andrew Park <andrew.park@intel.com>
* minor API fix
Signed-off-by: Andrew Park <andrew.park@intel.com>
* NMS shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Implement Nms gpuFunctests for dynamic shape and multiple outputs
Signed-off-by: Andrew Park <andrew.park@intel.com>
* move gpuFunctests and fix conflict
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix issues for Nms gpuFunctests
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflicts and code cleanup
Signed-off-by: Andrew Park <andrew.park@intel.com>
* apply clang-format
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply change to onednn primitive_impl
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix CI issues
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply code review
Signed-off-by: Andrew Park <andrew.park@intel.com>
* updates for ngraph shape infer
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix conflicts
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Apply code review
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Failing case
* Apply code review
Signed-off-by: Andrew Park <andrew.park@intel.com>
Signed-off-by: Andrew Park <andrew.park@intel.com>
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
* [TF FE] Refactor translator for L2Loss and test in the pre-commit
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use Power for square operation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* [PYTHON] Pipeline transfer
* [PYTHON] Align python benchmark
* [PYTHON] Align last step
* [PYTHON] Fix innacuracies of the last step - median
* [PYTHON/CPP] Add Core::get_version method to python API, refactor Ben benchmark to print version with this func
* [PYTHON] Remove get_version_string from API
* [PYTHON/CPP] Align output for model input/output info
* [PYTHON/CPP] Step 4,6 alignment of outputs, step 8 dumps all info stored in config parameters
* [CPP] Fix a bug causing nstreams parameter to never be set to AUTO in CPP benchmark_app
* [CPP] Fix clang format errors
* [CPP] Modify print order and data output for 8th step
* [PYTHON] Add verification checks from C++, modify set_thoughtput_streams to match documentation
* [CPP] Revert changes to C++ benchmark_app
* [CPP] Remove additional spacebar
* Update submodules versions on remote
* Update module from master branch
* Redownload submodules from master and override changes from commit
* [PYTHON] Remove unneccesary parse_status from validation function
* [PYTHON] Check for HINT in map, fix circular import
* [PYTHON] Remove artifacts from commit, fix args.perf_hint set to '' instead to 'none'
* [PYTHON] Reverse changes to perf hint, add key in map check, fix validation function throwing error on set hint
* [PYTHON] Fix linter
* [PYTHON] Remove linter spacebar
* [CPP] Fix wait_all exception throw
* [CPP/PYTHON] Clean artifacts and unwanted changes from work process
* [PYTHON] Fix artifacts from merge, clean submodule update
* [C++ CPU] Fix device name string by removing padding NULL characters from the back
* [CPP] Fix ba infer_request_wrap in other throw-catch clauses
* [PYTHON/CPP] Fix missing latencies in final step for shape group, fix minor misaligned messages, add missing report parameter create infer requests time
* [CPP] Clang fix formatting
* [CPP] Reverse clang fix format on plugin.cpp
* [PYTHON/CPP] Fix C++ progressbar printing endl when disabled, fix rounding in python creating infer request message
* [CPP] Fix foramtiing error
* [PYTHON/C++] Refactor network to model based on naming conventions, provide fresh README output example
* [PYTHON/C++] Add example output to C++ README, remove unnecessary device loop
* [BENCHMARK_APP/C++] Fix artifact from refactoring, remove try-catch clause
* Update samples/cpp/benchmark_app/benchmark_app.hpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* [CPP] Fix clang errors
* [CPP/PLUGIN Reverse modification to extract to separate task
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/parameters.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON/C++/BENCHMARK_APP] Fix language inconsistencies, remove unnecessary checks
* Update pyopenvino.cpp
* [CPP/BENCHMARK_APP] Remove unnecessary try-catch, fix linter errors
* [PYTHON/CPP/BENCHMARK_APP] Revert changes to Core, align version prints usin only provided methods
* [DOCS/BENCHMARK_APP] Update README with proper model examples
* Update README.md
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [GPU] Refactor impls factory method
* [GPU] Return unique_ptr from impls factory
* [GPU] implemented get_kernel_params for most of ocl impls
* [GPU] Common create impl
* [GPU] Fixes after rebase
* [GPU] Codestyle fixes
* [GPU] handle optimized out prims in common create
* [GPU] Fix exception type in region yolo tests
* [GPU] Resolve ambiguity of make_unique on windows
* [GPU] Multiclass NMS
* [GPU] Fixes after rebase
* gpu graph serialization
* fix to rebase
* onednn_gpu.patch for serialization
* git apply --verbode to --quiet
* functional tests
* removed referece of mas_unpooling.hpp
* git apply --verbose
* add no args ctor for proposal_impl
* changed kernel_cache save/load error messages
* gpu model cacning control env. variable
* fixed nonnull warning
* impl_params are added to save and load
* changed a way to use kernel_impl_params in save and load
* get_arguments_by_idx is added
* setenv is disabled in windows
* added missed part for onednn
* code refactoring based on code review
* fixed to use get_node_output_layout()
* OV_GPU_MODEL_CACHING is changed to OV_GPU_CACHE_MODEL
* reference to node and primitive are removed
* fixed hash of enum class
* restored CanShareContextWith
* serialization of intermediate memory
* fix to rebase
* multiclass_nms serialization
* caching_properties added
* add HybridAware stream setting and core binding
* fix clang format issue
* unified code style, add parameter check
* correct input affinity skip NUMA, modify function name
* remove unnecessary floor
* fix ci compile issue on Mac/windows platform
* modify smoke_SetConfigAffinity test
* modify ov_core_set_and_get_property_enum test, affinity HYBRID_AWARE is changed to NUMA
* remove affinity correcting on this pr
* revert ov_core_test.cpp
* merge function by comments
* fix code style issue
* add custom nstreams setting, remove mutable qualifier
* fix code style issue
* fix some issues according to comments
* modify UpdateHybridCustomThreads
* fix code style issue
* modify comments
* use logic core in phase 2
* modify steams threads setting method
* add custom setting nstreams nthreads
* modify comments
* fix code style issue
* fix threads_per_stream_big is wrong in the some ADL machine which has 6 pcore
* add one condition that custom set nthreads but not set nstreams
* remove the limit to nstreams
* remove the feature in branch p_e_core_phase2_logic
* add comments
* rename num_small_cores to num_small_cores_phys
* fix code style issue
* fix thread number is wrong in corner case on 6Pcore and 10Pcore condition
* fix some condition which nstreams<2
* add check for config._threads_per_stream_big
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
* Blocked layouts support for ExperimentalDetectronGenerateProposalsSingleImage
* fix RHEL 8.2 build
* reduce number of tests
* Added bs_fs_yx_bsv16_fsv32 format
* [PYTHON] CV2 module required only when loading images
* [PYTHON] Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* [PYTHON] Make CV import not global
* [PYTHON] Update format of inputs_filling.py
* [PYTHON] Fix missing newline
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
* [BENCHMARK_APP/PYTHON] Introduce exception when module is installed but fails to import
* [SAMPLES/PYTHON] Sporadic access violation fix through checking whether module was cached
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
* Move GeluFusion into ov namespace
It required to move utils as well.
* Move AddFakeQuantizeFusion into ov namespace
* Move AlignEltwiseInputRanks into ov namespace
* Move BatchToSpaceFusion into ov namespace
* Move BinarizeWeights into ov namespace
* Move BroadcastElementwiseFusion into ov namespace
* Move ClampFusion into ov namespace
* Move Concats and Eliminations into ov namespace
* Move many passes and such into ov namespace
* Move many passes and such into ov namespace
ngraph_ops
op_conversions
* Move control_flow into ov namespace
* Apply style
* Move smart_reshape into ov namespace
* Move opset_conversions into ov namespace
* Move low_precision into ov namespace
* Apply style
* Move fused_names into ov namespace
* Add missing aliases
* Move few passes into ov namespace
ConvertPrecision
FixRtInfo
InitNodeInfo
* Move CommonOptimizations into ov namespace
* Fix convert_precision conflicting namespaces
* Apply code style
* ov-nize Type Relaxed definitions
* Remove useless aliases
bulkly added by script
* Revert opsets
* Address review comments
* Remove NGRAPH_RTTI
* Clean up remains of yet another implicit inclusion
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
