* fix scatter update axis name
* Remove _exec_deps control for backedge_from because this is not required after PR-21333
* Previously, we organized execution order based on dependency for input-output buffer sharing from loop-body
* With PR-21333, we are not sharing buffer between input and output when loop input has multiple outputs.
* Therefore, there is no need to adjust exec order.
* 1. Update the logic for filtering out the device that supports the stateful model.
2. Enable the function to create stateful model in the test case.
* 1. Enable unit test cases for stateful model support.
2. disable accelerator device(CPU_HELP) if model is stateful.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Updated.
* Updated.
* Updated.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* [GPU] union 1D and scalar output dim for subgraph is skipped in condition
* Set friendly name using primitive_id for debugging.
* Do not share memory between internal input and external input when internal input has backedge in loop
* Set backedge mode to SINGLE when backedge_from_prim has multiple users
* Add condition unit test to check empty inner body
* Fix functional test failures
* Fix unit test failure on dg2
* Follow up code review - rename function
* [Core] Support String Tensors
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add String Constant implementation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue in tests
* Add cast_vector for Constant of ov::string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue: ambiguous type in GNA
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in TF FE tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update openvino.style for naming convention check
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix compilation error in core unit tests - need typename
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add test for new element_type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Add support of string Tensors for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix copying string tensor value for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Complete template methods for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Improve performance for initialization and destruction of string Tensor for set_shape
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add check for string value in test
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unused variable
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
* Fix copy_to for ITensor of string type and add tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add tests for Constant of string type and serialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use memset_allocation to switch initialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add additional documentation for host_ptr
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/src/op/constant.cpp
* Use OPENVINO_THROW
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/include/openvino/op/constant.hpp
* Update src/core/include/openvino/op/constant.hpp
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
* Apply code-review feedback: use string_size
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Recover evaluate impl for non-string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code for creating of string constant for legacy non HostTensor tensor
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback: simplify copy_to method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use StringAlignedBuffer to store string Constant values
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove not needed methods in StringAlignedBuffer
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Refactor set_shape method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
* Use ShapeOf node output type to evaluate bound
- lower bound is not set to 0 when only upper is above inf
- update test where lower bound was set to 0 previously
- re-factor label evaluation
* Remove `max_et_val` from capture list
* Fix constexpr capture for MSVC
* Restore clear lower bound if upper is infinite
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* cldnn::program serialization
* fixed to set a stream in a outputbuffer
* removed unnecessary comments
* replaced emplace_back with push_back
* updated bool vector serializer
* fixed several bugs
* removed m_model from compiled_model
* fixed streams_test for model caching
* updated mutable_data handling logic
* added a new API SetUpdateDispatchDataFunc
* updated to serialize weights_reorder_param
* added functional tests for dynamic model caching
* renamed to GetUpdateDispatchDataFunc
* added dynamic model caching tests
[Snippets] BufferManager is not derived from PassPipeline now
[Snippets] Added MemorySolver support
[Snippets] Made as static class
[Snippets] Added one-level inplace support
[Snippets] Added optimization bits
[Snippets] Small cosmetic fixes
[Snippets] Renamed to BufferSolver
[Snippets] Refactored
[Snippets] Fixed IdendifyBuffers
[Snippets] Add inplace multi + identify buffers
[Snippets] Made common pass
[Snippets] Added PassPipeline::get_pass<>()
[Snippets] Added comments, briefs, refactored smth
[Snippets] Fixed win build
[Snippets] Not allow to have the same Buffer ID for multi level Buffers
[Snippets] Moved CleanupRepeatedPtrShifts to common pioeline
[Snippets] Made IdentifyBuffers::ShiftPtrParams
[Snippets] Fixed window sliding mode
[Snippets] Refactored nested clusters
[Snippets] Adde normalized buffer regs
[Snippets] Not allowed to have the same ID for nested Buffers in IdentifyBuffers
[Snippets] Fixed DefineBufferClusters::are_buffer_neighbours::find
[Snippets] Removed useless method from InitLoops
[Snippets] Fixed CC build
[Snippets] Applied Ivan comments
[Snippets] Applied Ivan comment: refactored pass classes
[Snippets] Applied Vladislav comments
[Snippets] Applied Ivan comments 2
[Runtime] Moved MemorySolver to API2.0
[Snippets] Created common buffer allocation pass AllocateBuffers
[Snippets][Tests] Added InplaceEltwise unit test
[Snippets] fixed NormalizeBufferIDs
[Snippets][CPU] Fixed BrgemmBlocking lowered pass: move wsp for AMX to brgemm
[Snippets][CPU][Tests] Covered AMX MHA buffer allocation by unit tests
* Integrate `IfTypeOf` class with CC
- Add macro to warp class to add support for CC
- Update `ccheader.py` to created PP symbols for template parameter list
- Use new macro in Convert operator
* Correct symbols generation
* Update OV PP macros
* Wrap TestVisitor into namespace{}
* Removed not required macros, update comments
* Update element_visitor.hpp
* Migrate Range operator to new API
- remove legacy function an duplicated shape inference
- Minor change range reference implementation
* Move accessing tensors after validation
* [PT FE] Fix timm model list according to newest version
* Remove xfail for hf model passed in latest nightly
* Fix code for loading vit_h model
* Restore torchvision
* [CPU Plugin][Func Test] Upgrade Fuse related to API 2.0
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* Update src/plugins/intel_cpu/tests/functional/subgraph_tests/src/fuse_non0_output_port.cpp
Co-authored-by: River Li <river.li@intel.com>
---------
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
Co-authored-by: River Li <river.li@intel.com>
