* [Core] Support String Tensors
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add String Constant implementation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue in tests
* Add cast_vector for Constant of ov::string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue: ambiguous type in GNA
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in TF FE tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update openvino.style for naming convention check
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix compilation error in core unit tests - need typename
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add test for new element_type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Add support of string Tensors for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix copying string tensor value for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Complete template methods for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Improve performance for initialization and destruction of string Tensor for set_shape
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add check for string value in test
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unused variable
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
* Fix copy_to for ITensor of string type and add tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add tests for Constant of string type and serialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use memset_allocation to switch initialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add additional documentation for host_ptr
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/src/op/constant.cpp
* Use OPENVINO_THROW
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/include/openvino/op/constant.hpp
* Update src/core/include/openvino/op/constant.hpp
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
* Apply code-review feedback: use string_size
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Recover evaluate impl for non-string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code for creating of string constant for legacy non HostTensor tensor
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback: simplify copy_to method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use StringAlignedBuffer to store string Constant values
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove not needed methods in StringAlignedBuffer
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Refactor set_shape method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
* Use ShapeOf node output type to evaluate bound
- lower bound is not set to 0 when only upper is above inf
- update test where lower bound was set to 0 previously
- re-factor label evaluation
* Remove `max_et_val` from capture list
* Fix constexpr capture for MSVC
* Restore clear lower bound if upper is infinite
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* cldnn::program serialization
* fixed to set a stream in a outputbuffer
* removed unnecessary comments
* replaced emplace_back with push_back
* updated bool vector serializer
* fixed several bugs
* removed m_model from compiled_model
* fixed streams_test for model caching
* updated mutable_data handling logic
* added a new API SetUpdateDispatchDataFunc
* updated to serialize weights_reorder_param
* added functional tests for dynamic model caching
* renamed to GetUpdateDispatchDataFunc
* added dynamic model caching tests
[Snippets] BufferManager is not derived from PassPipeline now
[Snippets] Added MemorySolver support
[Snippets] Made as static class
[Snippets] Added one-level inplace support
[Snippets] Added optimization bits
[Snippets] Small cosmetic fixes
[Snippets] Renamed to BufferSolver
[Snippets] Refactored
[Snippets] Fixed IdendifyBuffers
[Snippets] Add inplace multi + identify buffers
[Snippets] Made common pass
[Snippets] Added PassPipeline::get_pass<>()
[Snippets] Added comments, briefs, refactored smth
[Snippets] Fixed win build
[Snippets] Not allow to have the same Buffer ID for multi level Buffers
[Snippets] Moved CleanupRepeatedPtrShifts to common pioeline
[Snippets] Made IdentifyBuffers::ShiftPtrParams
[Snippets] Fixed window sliding mode
[Snippets] Refactored nested clusters
[Snippets] Adde normalized buffer regs
[Snippets] Not allowed to have the same ID for nested Buffers in IdentifyBuffers
[Snippets] Fixed DefineBufferClusters::are_buffer_neighbours::find
[Snippets] Removed useless method from InitLoops
[Snippets] Fixed CC build
[Snippets] Applied Ivan comments
[Snippets] Applied Ivan comment: refactored pass classes
[Snippets] Applied Vladislav comments
[Snippets] Applied Ivan comments 2
[Runtime] Moved MemorySolver to API2.0
[Snippets] Created common buffer allocation pass AllocateBuffers
[Snippets][Tests] Added InplaceEltwise unit test
[Snippets] fixed NormalizeBufferIDs
[Snippets][CPU] Fixed BrgemmBlocking lowered pass: move wsp for AMX to brgemm
[Snippets][CPU][Tests] Covered AMX MHA buffer allocation by unit tests
* Integrate `IfTypeOf` class with CC
- Add macro to warp class to add support for CC
- Update `ccheader.py` to created PP symbols for template parameter list
- Use new macro in Convert operator
* Correct symbols generation
* Update OV PP macros
* Wrap TestVisitor into namespace{}
* Removed not required macros, update comments
* Update element_visitor.hpp
* Migrate Range operator to new API
- remove legacy function an duplicated shape inference
- Minor change range reference implementation
* Move accessing tensors after validation
* [PT FE] Fix timm model list according to newest version
* Remove xfail for hf model passed in latest nightly
* Fix code for loading vit_h model
* Restore torchvision
* [CPU Plugin][Func Test] Upgrade Fuse related to API 2.0
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* Update src/plugins/intel_cpu/tests/functional/subgraph_tests/src/fuse_non0_output_port.cpp
Co-authored-by: River Li <river.li@intel.com>
---------
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
Co-authored-by: River Li <river.li@intel.com>
* [CPU Tests] migrate ConcatResizeConcatTest to be 2.0
* [CPU Tests] migate matmul test cases to be api 2.0
* Update
* Revert "[CPU Tests] migate matmul test cases to be api 2.0"
This reverts commit b5fe09b3fa.
* Remove Node type
CPU graph always adds Result node for outputs which don't have consumers. If Conversion is inserted between such output and Result this Conversion became consumer and require defined memory.
