* Create separated auto_batch plugin testcase
* Add test sample into azure
* Move to auto_plugin directory
* Fix CI build issues
* move batch test cases from gpu/cpu/template plugin to auto batch plugin
* Check OpenCL to decide whether enable auto_batch gpu test cases
* Revert "move batch test cases from gpu/cpu/template plugin to auto batch plugin"
This reverts commit 9f4f2ce1af.
* Add functional tests for auto_batch
* Runtime check gpu available to decide whether run gpu test cases
* Remove HW plugins from functional test
1. Apply Template plugin for auto_batch functional test
2. Remove unnecessary code
* Restore some original tests
* Apply new api property replace old config
* Solve warning suppressions issue
* Fix CI build error
* Solve CI failure issues
* Fix getOutputsFromFunctionWithSeveralOutputs bug
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Add dependency from ov_plugins.hpp only for files which use it
* Remove rebuild files depends on CI_BUILD_NUMBER changes
* Try to fix static build
* Fixed comments
* Fixed build
* Merged some change
* Try to fix build
* Try to fix nvidia build
* Take LTO value from target property
* Properties improvements: part 2
* Accurate configs handling in HETERO / BATCH
* Align plugins in caching properties
* Fixed caching mock tests
* Added new TestNoCachingProperties test
* Fixed test
* Added ov::caching_properties to API 1.0 metrics as well
* Fixes for HETERO plugin
* Fixed tests
* Even more refactoring in HETERO plugin config management
* Init auto_batch plugin unit test
* Add more mock test
* Add to ci yml file
* Fix clang issue
* Resolve compilation issue
* Fix symbol multiple definition in static build
* Add test cases for AutoBatchInferRequest
* Add test cases for AutoBatchAsyncInferRequest
* qFixed build error after PR-15229
* Resolve blocked issue when call StartAsync test cases
* add more test for auto batch async inference
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
* remove ... in /src/bindings/c and resolve format
* remove ... in auto and resolve format
* remove ... in auto batch and resolve format
* remove ... in hetero and resolve format
* IE exception
* IE exception
* const
* const
* resolve format and ov::Exception
* ov::Exception
* reset IE::Exception
* remove ov::Exception
* InferenceEngine->IE in auto_schedule.cpp
* fix coredump while runing test case smoke_AutoMultiMock_NumStreamsAndDefaultPerfHintToHWTest
* fix coredump issue of running LoadNetworkWithSecondaryConfigsMockTest
* fix commpile fail in CI
* resolve core dump of running exec_network_get_metrics.cpp and disable some test cases for KEEMBAY and MYRIAD in exec_network_get_metrics.cpp
* remove test cases of MYRIAD and resolve core dump of running KEEMBAYin exec_network_get_metrics.cpp
* resolve conflic of common.h
* resolve conflic of common.h
* resolve common.h complie fail
---------
Co-authored-by: guozhong <guozhong.wang@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
* Added -Wall for Clang and GCC
* Fixes
* Don't use /J
* Fixed warnings
* Fixed warnings
* More fixes
* Fixed for MSVC
* Fixed more warnings on Windows
* Suppressed some warnings in template plugin
* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp
* Added suppression for PT FE
* Suppressed warnings in TF FE
* Suppressed warnings on Core unit tests
* Suppress warnings in python
* Suppressed Windows warning for 3rd party modules
* Suppresed one more warning
* parent 6e7016ccda
author Ilya Churaev <ilya.churaev@intel.com> 1664281499 +0400
committer Ilya Churaev <ilya.churaev@intel.com> 1664510018 +0400
Fixed warnings on local machine
* Added CMAKE_COMPILE_WARNING_AS_ERROR usage
* Fixed style
* Fixed merge conflicts
* Fixed typo
* Fixed myriad build for macOS
* Fixed warning
* Fixed tests
* Disabled incorrect test
* Try to fix linux tests
* Revert "Try to fix linux tests"
This reverts commit 29224c93ff.
* Fixed tests
* Revert logic with incorrect cast
* Fixed log softmax
* Disable warning as error for cuda
* Try to fix inference_engine_s
* Fixed cmake
* Revert "Fixed cmake"
This reverts commit 87e9e4e674.
* Revert "Try to fix inference_engine_s"
This reverts commit a1adca8b05.
* WA for static symbols in inference_engine_s test library
* Fixed code style
* Fixed static definition for master
* Revert "Fixed static definition for master"
This reverts commit 20d00d215a.
* Revert "Fixed code style"
This reverts commit 0eb2362543.
* Revert "WA for static symbols in inference_engine_s test library"
This reverts commit 75ef86a79d.
* Fixed linker issue for Windows
* Disable WaE by default
* Disable warning as error in the developer package
* Try to fix dev package
* Try to fix Windows Jenkins
* Revert old behavior for tread_warn_as_err variable
* Fixes for cases when TBB_DIR env var is set
* Don't use make in build_samples.sh script
* First version of Windows installer
* WIndows NSIS installer
* Fixed newAPI for case if core was removed
* Fixed code style
* Fixed typo
* Use new API by default
* Create core with template plugin
* Added doxygen comment
* checking the network batchability (internal helper func on top of batch tracking) before doing hetero
* more general logic with respect to batch-ability of the network
* a dynamism check that I've owed from the PR-10560
* using the DO-detached mechanism for early hetero exit, also fixed this flag in the Batching plugin (although minor, as the DO is removed by HETERO)
* adding the dimension tracking logic depending on whether implicitly/expicitly the auto-batching is enabled
* changed the DetectionOutput affinity markup to go over results, also accomodate Convert, so only 2 subgraphs are made by the HETERO
* fixed perf-counters
* explicit auto-batching params that should guarantee the auto-batching is triggered ( to avoid fallback to no-batching when the selected batch1 size is just 1)
* makeConvPoolReluNoReshapes and using that whenever applicable to gaurantee the auto-batching is required (not important for things like plugin/executable-network config tests, but important for the inference-requests)
* getDefaultNGraphFunctionForTheDevice moved to the ov_behavior_test_utils.hpp
* Depricated Any implicit cast
* Fixed test
* fixed gna build
* Fixed warnings in benchmark_app
* Fixed test build
* ncc exception for PrintTo
* Error mesage in test
* Error mesage in test
* fixed build
* moving the HETERO logic to the Auto-Batch (WIP), reverting to the ALLOW_AUTO_BATCHING and using that in the GPU remote tests
* shortned the vars names in the ie_core and prevented recursive auto-batching calls by checking for exclusive requests and disabling further auto-batching in the plugin, when HETERO is involved
* checking for the batch-dim presence (this is still WA until the https://github.com/openvinotoolkit/openvino/pull/9559 is merged) - pls see CVS-75317
+clang for the ie_core.cpp
* moving the HETERO logic back to the ie_core.cpp, storing the _so internally for no-batch code-path
