* [Core] Support String Tensors
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add String Constant implementation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue in tests
* Add cast_vector for Constant of ov::string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue: ambiguous type in GNA
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in TF FE tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update openvino.style for naming convention check
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix compilation error in core unit tests - need typename
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add test for new element_type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Add support of string Tensors for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix copying string tensor value for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Complete template methods for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Improve performance for initialization and destruction of string Tensor for set_shape
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add check for string value in test
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unused variable
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
* Fix copy_to for ITensor of string type and add tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add tests for Constant of string type and serialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use memset_allocation to switch initialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add additional documentation for host_ptr
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/src/op/constant.cpp
* Use OPENVINO_THROW
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/include/openvino/op/constant.hpp
* Update src/core/include/openvino/op/constant.hpp
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
* Apply code-review feedback: use string_size
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Recover evaluate impl for non-string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code for creating of string constant for legacy non HostTensor tensor
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback: simplify copy_to method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use StringAlignedBuffer to store string Constant values
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove not needed methods in StringAlignedBuffer
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Refactor set_shape method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
[Snippets] BufferManager is not derived from PassPipeline now
[Snippets] Added MemorySolver support
[Snippets] Made as static class
[Snippets] Added one-level inplace support
[Snippets] Added optimization bits
[Snippets] Small cosmetic fixes
[Snippets] Renamed to BufferSolver
[Snippets] Refactored
[Snippets] Fixed IdendifyBuffers
[Snippets] Add inplace multi + identify buffers
[Snippets] Made common pass
[Snippets] Added PassPipeline::get_pass<>()
[Snippets] Added comments, briefs, refactored smth
[Snippets] Fixed win build
[Snippets] Not allow to have the same Buffer ID for multi level Buffers
[Snippets] Moved CleanupRepeatedPtrShifts to common pioeline
[Snippets] Made IdentifyBuffers::ShiftPtrParams
[Snippets] Fixed window sliding mode
[Snippets] Refactored nested clusters
[Snippets] Adde normalized buffer regs
[Snippets] Not allowed to have the same ID for nested Buffers in IdentifyBuffers
[Snippets] Fixed DefineBufferClusters::are_buffer_neighbours::find
[Snippets] Removed useless method from InitLoops
[Snippets] Fixed CC build
[Snippets] Applied Ivan comments
[Snippets] Applied Ivan comment: refactored pass classes
[Snippets] Applied Vladislav comments
[Snippets] Applied Ivan comments 2
[Runtime] Moved MemorySolver to API2.0
[Snippets] Created common buffer allocation pass AllocateBuffers
[Snippets][Tests] Added InplaceEltwise unit test
[Snippets] fixed NormalizeBufferIDs
[Snippets][CPU] Fixed BrgemmBlocking lowered pass: move wsp for AMX to brgemm
[Snippets][CPU][Tests] Covered AMX MHA buffer allocation by unit tests
* [Core] lstm api fix
* Fix LSTMCell failure issues
* Solve GNA failures
* Update for comments
* Minor update
* Use new ov::test::utils::makeEltwise
---------
Co-authored-by: Durandin, Pavel <pavel.durandin@intel.com>
* migrate threading related interface from API 1.0 to 2.0
* fix code style
* fix @ref issue in doc
* change <> to quotation marks
* restore threading related interface API 1.0
* restore the changes of legacy code
* add get property test case
* add CanCreateTwoExeNetworksAndCheckFunction and pluginDoesNotChangeOriginalNetwork
* tmp
* add canSetInputPrecisionForNetwork and canSetOutputPrecisionForNetwork
* fix code style
* tmp
* Revert "tmp"
This reverts commit ff3f8d56d5.
* tmp
* add CanCompileModelWithEmptyProperties
* remove comment
* add infer request
* add CanLoadNetworkWithCustomLocale
* add CanLoadNetworkWithCustomLocale
* fix error
* remove case in io_tensor.cpp
* fix Unsupported metric key: OPTIMAL_BATCH_SIZE
* Update src/tests/functional/plugin/conformance/test_runner/api_conformance_runner/include/api_conformance_helpers.hpp
Co-authored-by: Chen Peter <peter.chen@intel.com>
* fix batch size
* remove useless code
* remove failed case CanCompileModelWithEmptyProperties, CanLoadNetworkWithCustomLocale and LoadNetworkWithBigDeviceIDThrows to test
* Revert "remove failed case CanCompileModelWithEmptyProperties, CanLoadNetworkWithCustomLocale and LoadNetworkWithBigDeviceIDThrows to test"
This reverts commit 1317d0773c.
* Revert "remove useless code"
This reverts commit b3dd0ffaab.
* Revert "fix batch size"
This reverts commit 2afd673cff.
* Revert "Update src/tests/functional/plugin/conformance/test_runner/api_conformance_runner/include/api_conformance_helpers.hpp"
This reverts commit 9d6030952f.
* Revert "fix Unsupported metric key: OPTIMAL_BATCH_SIZE"
This reverts commit 2de26547ea.
* try to add optimal_batch_size in cpu plugin
* return model when optimal_batch_size not found in apply_auto_batching
* revert cpu plugin
* gna cannot support some model
* update test case name
* skip CanCreateTwoCompiledModelsAndCheckRuntimeModel in gna
* Update src/inference/src/dev/core_impl.cpp
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Update src/inference/src/dev/core_impl.cpp
Co-authored-by: Chen Peter <peter.chen@intel.com>
* replace deviceName.substr(pos + 1) with deviceNameWithoutBatch
* fix bug
* Update src/inference/src/dev/core_impl.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Update src/tests/functional/plugin/shared/include/behavior/compiled_model/compiled_model_base.hpp
Co-authored-by: River Li <river.li@intel.com>
* Update src/tests/functional/plugin/shared/include/behavior/compiled_model/compiled_model_base.hpp
Co-authored-by: River Li <river.li@intel.com>
* Update src/plugins/intel_gna/tests/functional/shared_tests_instances/skip_tests_config.cpp
Co-authored-by: River Li <river.li@intel.com>
* Update src/plugins/intel_gna/tests/functional/shared_tests_instances/skip_tests_config.cpp
Co-authored-by: River Li <river.li@intel.com>
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: River Li <river.li@intel.com>
Transformation fuses Transpose on first or second MatMul's input
and sets MatMul's transpose_a/transpose_b accordingly.
TransposeMatMul is already part of SmartReshape, but it can be added
to MOCTransformations as well so native models that are don't use reshape
can benefit from that.
Ticket: CVS-118908
* Migrated all subgraph tests after quantization graphs
* Fixed skip tests config
* Add alias for NPU
* Try to fix NPU
* Remove unsupported precisions
* Remove GNA test
* Remove more tests
* API 2.0 replace ngraph headers and namespaces in CPU, LPT etc transformations tests
* revert the incorrect renaming
* function -> model in arm transformation tests
* Introduce model reader which works only with new API
* Fix GNA compilation
* Removed old code
* Fixed Windows build
* Remove legacy headers from core_impl
* Fixed caching tests if plugin on legacy API call ReadNetwork
* [GNA] Fix for GeminiLake detection
* Added HWGeneration::GNA_1_0_E enumerator
Added DeviceVersion::GNAEmbedded1_0 enumerator, changed the meaning of DeviceVersion::GNA1_0.
Updated ConvLowPrecision test with all supported targets
* [GNA] Extended a few tests with GNA1.0
* added display of sum of memory usage per operation block and per memory type in GNA dump file
* fixed some clang format issues
* forgot to save file - missing clang fix
* changes according to review - added counting memory usage per layer and names changes
* clang changes
* changes according to review
* clang fixes
* Handle sequence ops with non constant W, R, B inputs
Ticket: CVS-49207
* fix tests
* tests
* fix gna tests
* add include
* change type for seqLenIdx
* rename is_constfoldable to is_on_constant_path
---------
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
Xuejun Zhai
Alexandra Sidorova
Oleg Pipikin
River LiandDurandin, Pavel
Sun Xiaoxia
Ivan Tikhonovandcecilia peng
Vitaliy Urusovskij
Mateusz Tabaka
Ilya Churaev
Marcin Kusmierski
Tomasz Adamowicz
Marcin Kacprzak
Jakub Nowicki
Nadezhda Ageeva