* optimize TensorIterator DynamicBuffer by preallocating a large chunk of intermediate buffer.
code clean.
review update: always copy in transfer as it is not worthy.
review update: update mem_holder_buffer as dnnl::memory instead of shared_ptr of it.
review update: reuse mem_buffer_holder even if the shape changes.
review update: growth factor.
review update: bug fix.
* fix code style
* review update: rewrite the dynamic buffer using the cpu Memory class, instead of dnnl::memory
* Update src/plugins/intel_cpu/src/nodes/tensoriterator.cpp
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
* Update src/plugins/intel_cpu/src/nodes/tensoriterator.cpp
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
* review update: minor fix
---------
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
* add test case for device_bind_buffer
* Correct path to header file properties.hpp
* rename remote blob testcase with multi
* add test case for remote blob and device bind buffer
* add logs for debug
* disable test case RemoteBlobInitializedWithoutGPU
* add property for remote blob test case
* remove debug logs for bind_multi_schedule.cpp
* fix MultiDeviceMultipleGPU_Test fail
* add test case for oversubsciption of infer requests
* get optimal number to create inferRequests
* using macro ENABLE_INTEL_CPU to make sure tests need CPU
* fix the issue that canCreateRemoteTensorThenInferWithAffinity test case fails to run
* remove ov::hint::PerformanceMode::UNDEFINED from MultiDeviceMultipleGPU_Test
* add test case for get perf_hint from GetMetric
* Increase Mock GetMetric test sleep time
* add mock test case for getMetric
* add new test case OVAutoExecutableNetworkTest
* convert ov::Any to ov::hint::Priority
* resolve conflict of get_metric.hpp
* add macro ENABLE_INTEL_CPU for gpu test case and fix cases not getting instantiated for cpu test
* fix the issue of running Mock GetMetric test cases fail
* add perf_hint test cases to properties_tests.cpp
* Modify the logic of judging whether it is a single device in ctput mode
* Enable AUTO compiledModel::get_property supporting its properties only.
* Update.
* Update.
* Update some releated test cases.
* Update.
* Update related test case.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Provide ENABLE_STARTUP_FALLBACK property to enable/disable CPU as acceleration
* Add more test cases to ENABLE_STARTUP_FALLBACK property
* Remove unnecessary config
* Remove plugin.hpp
* Update test case by PR#14754
* Update copyright
Co-authored-by: River Li <river.li@intel.com>
* Simplify using namespace
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: River Li <river.li@intel.com>
* Review interval shape and labels propagation
* Review shape infer template implementation
- add test for default ctor
* Add evaluate upper, lower and label
- add new default label evaluator which propagates labels
from inputs list
* default_label_evaluator for 0 input only is wrapper for
generic evaluator implementation
* Use default_label_evaluator in ScatterUpdate
* Fix build issues
* optimize shape infer of matmul
* remove some redundant check
* fix some comments
* fix some comments
* Update src/plugins/intel_cpu/src/nodes/matmul.cpp
fix an implicit bug
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
* Update src/plugins/intel_cpu/src/nodes/matmul.cpp
optimize by using OV RTTI instead of dynamic_pointer_cast
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
---------
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
* Added -Wall for Clang and GCC
* Fixes
* Don't use /J
* Fixed warnings
* Fixed warnings
* More fixes
* Fixed for MSVC
* Fixed more warnings on Windows
* Suppressed some warnings in template plugin
* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp
* Added suppression for PT FE
* Suppressed warnings in TF FE
* Suppressed warnings on Core unit tests
* Suppress warnings in python
* Suppressed Windows warning for 3rd party modules
* Suppresed one more warning
* Add shape_infer function for GatherND
* GatherND shape infer improvements
* Align test to trigger correct error message
* Add new and improve GatherND type_prop tests
* Update tests to use ov namespace
* Add GatherND common shape_infer tests
* Init shape infer tests for not common cases
* Tests refactor
* Add default ctor tests
* Add more test cases
* Register shape_infer for GatherND V5 and V8
* Enable more tests and print params
* Move GatherNDTestParams
* Review ctc loss operator for
- partial shape and label propagation
- template implementation of shape_infer
- update/extend tests
* Use namespace ov in ctc loss operator
* Remove global ENABLE_INTEL_CPU macro ddefinition.Add mlocal definition for some source files where it is used
* Fix1
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
* Review reverse sequence for:
- partial shapes and labels propagation
- template implementation of shape infer
- refactor shape_infer to use it when op created with default ctor
* Remove friend shape_infer from reverse sequence op
* Infrastructure for tflite
* Removed submodule flatbuffers
* Added flatbuffers submodule. Fixed version to v22.12.06 aka acf39ff
* Move headers back
* Flatbuffers integration
* Small fixes
* Started parsing the Model
* flatbuffer changes
* decoder_flatbuffer changes
* Lite Input Model -- not needed as of now but looks cool
* Rolled back inherritance from ov::frontend::tensorflow::InputModel
* Results are not treated as outputs, but its ok
* Fix missplaced input vs output
* Refactor
* Load model op-by-op. Frontend API finalized
* Debugging still, there are prints here and there. Decoder is not sane
* Convolution with all attributes is translated and quantization is applied for inputs and constatants. TODO: quantize intermediate tensors, separate decoder specific logic?
* Float ssd and posenet models are showing good accuracy
* Need to refactor but work flawlessly
* Telemetry and lightweight model cutting
* Code style and test changes. Extensions supported
* Quantization and style
* Style refinements
* Move onednn back
* New portion of operations enabled
* TFLite FE doesn't inherrit TF FE
* Moved files to another directory
* Rename header op_table.hpp to common_op_table.hpp for all files in src/frontends/tensorflow_common/src/op/
* Removed visability macroses
* CMake changes
* Unit-test execution in .ci
* Update labeler.yml
* Codeowners
* Style check and fix
* Static Build arrangement
* Addressing the comments
* install common headers to previous place
* New approach with public decoder and graph_iterator
* New approach with public decoder and graph_iterator
* Move GraphIterator back
* Comments addressed
* Comments adressed
* Preliminary TF FE README.md changes
* Added target_compile_definitions OPENVINO_STATIC_LIBRARY for static build
* Fixed conflicts and added TF to common places
* Frontends use only openvino::core::dev API
* Merged common tensorflow changes and made code build and work on selective number of models
* Style
* Rollback unnecessary changes from Tensorflow FE
* Rollback unnecessary changes from Tensorflow Common
* Minor refactor
* cmake minor refactoring
* Mixed commit
* Style and merge fix
* Low hanging fruit operations
* Fix windows build
* Refactor quantization parameters representation
* license compliance. approved by OS PDT
* copyrights in generic file
* dependabot
* labeler
* Unit Test to be triggered in CI
* cmake variables naming. corrected copyright years in copyrights/generic file
* library renamed in .ci/ calls
* Copyright year update
* Set openvino-tf-frontend-maintainers as owner of /src/frontends/tensorflow_lite/
* Fixed flatc corss-compilation
* Cleaned flatbuffers header usage
* Nitpicks solved
* Update cmake/templates/OpenVINOConfig.cmake.in
* Compile with flatbuffers headers
* Fixed "which is prefixed in the source directory"
* Fixed typo in flatbuffers cmake
* Removed flatbuffers submodule
* Added fork submodule
* Fixed static build
* Fixed cross-compilatio
* Fixed -Wshadow warning
* Fixed warning on Windows
* Use only headers from flatbuffers library
* Added LTO and fixed compilation errors on Windows
* Fixed warnings in tensorflow_common
* Move ctors implementation to cpp file
* Added information about new frontends to common FEm part
* Temporaryily disable warnings
* Fixed code style using clang-format
* Fixed Windows
* reverted changes in onnx
* Revert changes in onnx_common
* Removed pragma once frm cpp
Co-authored-by: missjane <estepyreva@gmail.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Review propagate interval shapes and labels
* Review eye template shape inference
* Add partial value and label propagation on inputs
columns and rows
* Include array in eye shape inference
* Fix compilation issues
* Remove local label_t alias from eye tests
* New static shape inference iface using ov::Tensors
- Add new shape inference factory
- Add helpers to create inference factory map entries
- Create map for IShapeInferCommon instead of if else switch
- Create new map for IStaticShapeInfer
* Re-factor tile shape inference to use new iface
* ov::default_label_evaluator uses ov::Tensor now
* Improve cmp::lt for mixed types unsigned and float
* Fix cpp lint issue
* Update using tile shape_inference in GPU plugin
* Do tile shape infer before repeats lock deletion
* Fix label type conversion to element type
* Rename shape infer transformation
to type utils and change namespace from ov::sh_infer_tr to ov::util
* Update shape inference utilities
* Add unit test for safe compare of values
* Update shape infer factory to be a template
and use unordered map
* Remove from_label_type as lebel_t can be used
by element:from<>
* Review TopK for:
- label and dimension propagation
- partial value and label propagation
- preserve partial value and labels
- add evaluate upper, lower and label
* TopK v1 use shape infer instead fallback
- update static shape inference tests
* TopK shape_infer return output shapes
* Add new way to get tensor data as shape
with custom data processing
- Update tail op to use new function
- Update topk op to use this function
- Add test for negative k
* Add missing include
* Fix compilation issues
* Add support for i4 and u4 element types in
get_raw_data_as
* Fix signed and unsigned and compile warnings
* Remove constexpr from InTypeRange::operator()
* Use forward reference for functor
- minor corrections in InTypeRange class
* Use shape)infer in evaluate
- fix TopK v3 ctor for input data validation
* Fix transformation tests to use correct type for k
* Fix f16 handling in get_raw_data_as
* Correct topk bounds evaluators
* Topk detect overlap for same size dimensions
As op specification not guarantee correct order of
several elements same value
* Remove evaluate bounds
required investigation if required then will be provided
* Remove bound evaluation leftovers
* Update get const data in slice ops
