* CLean up ov_helpers headers from ngraph/
* Move `ngraph/` includes from ov_helpers to tests
* Remove include of all opsets in builders.hpp
* Remove opsets includes from ov_helpers
* Fix GNA tests
* Delete comments
* ClangFormat
* Fix build
* Fix `-fpermissive`
* Fix build #2
* Fix `<` && `>` in includes
* Fix build #3
* Build fix
* [Core] Support String Tensors
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add String Constant implementation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue in tests
* Add cast_vector for Constant of ov::string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue: ambiguous type in GNA
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in TF FE tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update openvino.style for naming convention check
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix compilation error in core unit tests - need typename
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add test for new element_type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Add support of string Tensors for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix copying string tensor value for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Complete template methods for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Improve performance for initialization and destruction of string Tensor for set_shape
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add check for string value in test
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unused variable
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
* Fix copy_to for ITensor of string type and add tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add tests for Constant of string type and serialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use memset_allocation to switch initialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add additional documentation for host_ptr
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/src/op/constant.cpp
* Use OPENVINO_THROW
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/include/openvino/op/constant.hpp
* Update src/core/include/openvino/op/constant.hpp
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
* Apply code-review feedback: use string_size
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Recover evaluate impl for non-string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code for creating of string constant for legacy non HostTensor tensor
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback: simplify copy_to method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use StringAlignedBuffer to store string Constant values
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove not needed methods in StringAlignedBuffer
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Refactor set_shape method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
[Snippets] BufferManager is not derived from PassPipeline now
[Snippets] Added MemorySolver support
[Snippets] Made as static class
[Snippets] Added one-level inplace support
[Snippets] Added optimization bits
[Snippets] Small cosmetic fixes
[Snippets] Renamed to BufferSolver
[Snippets] Refactored
[Snippets] Fixed IdendifyBuffers
[Snippets] Add inplace multi + identify buffers
[Snippets] Made common pass
[Snippets] Added PassPipeline::get_pass<>()
[Snippets] Added comments, briefs, refactored smth
[Snippets] Fixed win build
[Snippets] Not allow to have the same Buffer ID for multi level Buffers
[Snippets] Moved CleanupRepeatedPtrShifts to common pioeline
[Snippets] Made IdentifyBuffers::ShiftPtrParams
[Snippets] Fixed window sliding mode
[Snippets] Refactored nested clusters
[Snippets] Adde normalized buffer regs
[Snippets] Not allowed to have the same ID for nested Buffers in IdentifyBuffers
[Snippets] Fixed DefineBufferClusters::are_buffer_neighbours::find
[Snippets] Removed useless method from InitLoops
[Snippets] Fixed CC build
[Snippets] Applied Ivan comments
[Snippets] Applied Ivan comment: refactored pass classes
[Snippets] Applied Vladislav comments
[Snippets] Applied Ivan comments 2
[Runtime] Moved MemorySolver to API2.0
[Snippets] Created common buffer allocation pass AllocateBuffers
[Snippets][Tests] Added InplaceEltwise unit test
[Snippets] fixed NormalizeBufferIDs
[Snippets][CPU] Fixed BrgemmBlocking lowered pass: move wsp for AMX to brgemm
[Snippets][CPU][Tests] Covered AMX MHA buffer allocation by unit tests
* [Core] lstm api fix
* Fix LSTMCell failure issues
* Solve GNA failures
* Update for comments
* Minor update
* Use new ov::test::utils::makeEltwise
---------
Co-authored-by: Durandin, Pavel <pavel.durandin@intel.com>
* migrate threading related interface from API 1.0 to 2.0
* fix code style
* fix @ref issue in doc
* change <> to quotation marks
* restore threading related interface API 1.0
* restore the changes of legacy code
* add get property test case
* add CanCreateTwoExeNetworksAndCheckFunction and pluginDoesNotChangeOriginalNetwork
* tmp
* add canSetInputPrecisionForNetwork and canSetOutputPrecisionForNetwork
* fix code style
* tmp
* Revert "tmp"
This reverts commit ff3f8d56d5.
* tmp
* add CanCompileModelWithEmptyProperties
* remove comment
* add infer request
* add CanLoadNetworkWithCustomLocale
* add CanLoadNetworkWithCustomLocale
* fix error
* remove case in io_tensor.cpp
* fix Unsupported metric key: OPTIMAL_BATCH_SIZE
* Update src/tests/functional/plugin/conformance/test_runner/api_conformance_runner/include/api_conformance_helpers.hpp
Co-authored-by: Chen Peter <peter.chen@intel.com>
* fix batch size
* remove useless code
* remove failed case CanCompileModelWithEmptyProperties, CanLoadNetworkWithCustomLocale and LoadNetworkWithBigDeviceIDThrows to test
* Revert "remove failed case CanCompileModelWithEmptyProperties, CanLoadNetworkWithCustomLocale and LoadNetworkWithBigDeviceIDThrows to test"
This reverts commit 1317d0773c.
* Revert "remove useless code"
This reverts commit b3dd0ffaab.
* Revert "fix batch size"
This reverts commit 2afd673cff.
* Revert "Update src/tests/functional/plugin/conformance/test_runner/api_conformance_runner/include/api_conformance_helpers.hpp"
This reverts commit 9d6030952f.
* Revert "fix Unsupported metric key: OPTIMAL_BATCH_SIZE"
This reverts commit 2de26547ea.
* try to add optimal_batch_size in cpu plugin
* return model when optimal_batch_size not found in apply_auto_batching
* revert cpu plugin
* gna cannot support some model
* update test case name
* skip CanCreateTwoCompiledModelsAndCheckRuntimeModel in gna
* Update src/inference/src/dev/core_impl.cpp
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Update src/inference/src/dev/core_impl.cpp
Co-authored-by: Chen Peter <peter.chen@intel.com>
* replace deviceName.substr(pos + 1) with deviceNameWithoutBatch
* fix bug
* Update src/inference/src/dev/core_impl.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Update src/tests/functional/plugin/shared/include/behavior/compiled_model/compiled_model_base.hpp
Co-authored-by: River Li <river.li@intel.com>
* Update src/tests/functional/plugin/shared/include/behavior/compiled_model/compiled_model_base.hpp
Co-authored-by: River Li <river.li@intel.com>
* Update src/plugins/intel_gna/tests/functional/shared_tests_instances/skip_tests_config.cpp
Co-authored-by: River Li <river.li@intel.com>
* Update src/plugins/intel_gna/tests/functional/shared_tests_instances/skip_tests_config.cpp
Co-authored-by: River Li <river.li@intel.com>
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: River Li <river.li@intel.com>
Transformation fuses Transpose on first or second MatMul's input
and sets MatMul's transpose_a/transpose_b accordingly.
TransposeMatMul is already part of SmartReshape, but it can be added
to MOCTransformations as well so native models that are don't use reshape
can benefit from that.
Ticket: CVS-118908
* Migrated all subgraph tests after quantization graphs
* Fixed skip tests config
* Add alias for NPU
* Try to fix NPU
* Remove unsupported precisions
* Remove GNA test
* Remove more tests
* API 2.0 replace ngraph headers and namespaces in CPU, LPT etc transformations tests
* revert the incorrect renaming
* function -> model in arm transformation tests
* Introduce model reader which works only with new API
* Fix GNA compilation
* Removed old code
* Fixed Windows build
* Remove legacy headers from core_impl
* Fixed caching tests if plugin on legacy API call ReadNetwork
* [GNA] Fix for GeminiLake detection
* Added HWGeneration::GNA_1_0_E enumerator
Added DeviceVersion::GNAEmbedded1_0 enumerator, changed the meaning of DeviceVersion::GNA1_0.
Updated ConvLowPrecision test with all supported targets
* [GNA] Extended a few tests with GNA1.0
Ivan TikhonovandMaksim Kutakov
Vitaliy Urusovskij
Oleg Pipikin
Haiqi PanandChen Peter
Tomasz Adamowicz
Ilya Lavrenov
Xuejun Zhai
Alexandra Sidorova
River LiandDurandin, Pavel
Sun Xiaoxia
Mateusz Tabaka
Ilya Churaev
Marcin Kusmierski
Marcin Kacprzak