* fix didn't udpate last second input issue
Signed-off-by: HU Yuan2 <yuan2.hu@intel.com>
* to match master code
Signed-off-by: HU Yuan2 <yuan2.hu@intel.com>
* fix review comment
use parametrized test case instead of creating new test case
Signed-off-by: HU Yuan2 <yuan2.hu@intel.com>
---------
Signed-off-by: HU Yuan2 <yuan2.hu@intel.com>
* Improve Constant creation from string values
* Optimize Constant creation from vector<T>
binary size reduction
* Fix code style
* Add tests to check there is no precision los
* Fix conversion for string -> integral numbers
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
* only use current thread when -nstreams=0 with TBB
* add comments
* fix building issue
* fix comments
* only use current thread when -nstreams=0 with TBB
* add comments
* fix building issue
* fix comments
* fix scatter update axis name
* Remove _exec_deps control for backedge_from because this is not required after PR-21333
* Previously, we organized execution order based on dependency for input-output buffer sharing from loop-body
* With PR-21333, we are not sharing buffer between input and output when loop input has multiple outputs.
* Therefore, there is no need to adjust exec order.
* 1. Update the logic for filtering out the device that supports the stateful model.
2. Enable the function to create stateful model in the test case.
* 1. Enable unit test cases for stateful model support.
2. disable accelerator device(CPU_HELP) if model is stateful.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Updated.
* Updated.
* Updated.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* [GPU] union 1D and scalar output dim for subgraph is skipped in condition
* Set friendly name using primitive_id for debugging.
* Do not share memory between internal input and external input when internal input has backedge in loop
* Set backedge mode to SINGLE when backedge_from_prim has multiple users
* Add condition unit test to check empty inner body
* Fix functional test failures
* Fix unit test failure on dg2
* Follow up code review - rename function
* [Core] Support String Tensors
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add String Constant implementation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue in tests
* Add cast_vector for Constant of ov::string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue: ambiguous type in GNA
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in GNA tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix ambiguous build issue in TF FE tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update openvino.style for naming convention check
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix compilation error in core unit tests - need typename
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add test for new element_type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Add support of string Tensors for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix copying string tensor value for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Complete template methods for Constant
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Improve performance for initialization and destruction of string Tensor for set_shape
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add check for string value in test
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unused variable
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/inference/src/dev/make_tensor.cpp
* Fix copy_to for ITensor of string type and add tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add tests for Constant of string type and serialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use memset_allocation to switch initialization
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add additional documentation for host_ptr
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/src/op/constant.cpp
* Use OPENVINO_THROW
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/core/include/openvino/op/constant.hpp
* Update src/core/include/openvino/op/constant.hpp
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
* Apply code-review feedback: use string_size
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Recover evaluate impl for non-string type
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix code for creating of string constant for legacy non HostTensor tensor
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback: simplify copy_to method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use StringAlignedBuffer to store string Constant values
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove not needed methods in StringAlignedBuffer
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Refactor set_shape method
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
* Use ShapeOf node output type to evaluate bound
- lower bound is not set to 0 when only upper is above inf
- update test where lower bound was set to 0 previously
- re-factor label evaluation
* Remove `max_et_val` from capture list
* Fix constexpr capture for MSVC
* Restore clear lower bound if upper is infinite
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* cldnn::program serialization
* fixed to set a stream in a outputbuffer
* removed unnecessary comments
* replaced emplace_back with push_back
* updated bool vector serializer
* fixed several bugs
* removed m_model from compiled_model
* fixed streams_test for model caching
* updated mutable_data handling logic
* added a new API SetUpdateDispatchDataFunc
* updated to serialize weights_reorder_param
* added functional tests for dynamic model caching
* renamed to GetUpdateDispatchDataFunc
* added dynamic model caching tests
[Snippets] BufferManager is not derived from PassPipeline now
[Snippets] Added MemorySolver support
[Snippets] Made as static class
[Snippets] Added one-level inplace support
[Snippets] Added optimization bits
[Snippets] Small cosmetic fixes
[Snippets] Renamed to BufferSolver
[Snippets] Refactored
[Snippets] Fixed IdendifyBuffers
[Snippets] Add inplace multi + identify buffers
[Snippets] Made common pass
[Snippets] Added PassPipeline::get_pass<>()
[Snippets] Added comments, briefs, refactored smth
[Snippets] Fixed win build
[Snippets] Not allow to have the same Buffer ID for multi level Buffers
[Snippets] Moved CleanupRepeatedPtrShifts to common pioeline
[Snippets] Made IdentifyBuffers::ShiftPtrParams
[Snippets] Fixed window sliding mode
[Snippets] Refactored nested clusters
[Snippets] Adde normalized buffer regs
[Snippets] Not allowed to have the same ID for nested Buffers in IdentifyBuffers
[Snippets] Fixed DefineBufferClusters::are_buffer_neighbours::find
[Snippets] Removed useless method from InitLoops
[Snippets] Fixed CC build
[Snippets] Applied Ivan comments
[Snippets] Applied Ivan comment: refactored pass classes
[Snippets] Applied Vladislav comments
[Snippets] Applied Ivan comments 2
[Runtime] Moved MemorySolver to API2.0
[Snippets] Created common buffer allocation pass AllocateBuffers
[Snippets][Tests] Added InplaceEltwise unit test
[Snippets] fixed NormalizeBufferIDs
[Snippets][CPU] Fixed BrgemmBlocking lowered pass: move wsp for AMX to brgemm
[Snippets][CPU][Tests] Covered AMX MHA buffer allocation by unit tests
