Move all openvino_conversion rountines into utils. Avoid using Squeeze without axis
that can create dynamic output rank
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* [GPU] Added shape agnostic TopK kernel implementation
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Update kernel to use internal buffers for shape agnostic kernel
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Add WA to compile_graph for shape agnostic arg_max_min_axis with non-const k input
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix is_dynamic pameter for FillCLKernelData with the case where the output is static shape
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Fix corner case where inbuf size becomes 0 when ops_size is 1
Signed-off-by: Andrew Park <andrew.park@intel.com>
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
* Implement CTPUT in AUTO code logic
* Add logic to handle device loading failure
* add some code comments
* fix warnning conversion from size_t to int
* Updated code according to comments of bell and wanglei
* the preferred device code path need to be updated with ctput also
* add fallback logic for CTPUT
* Modify the code logic according to bell suggestion
* Add prints for debugging bug
* throw exception when no device to run pipline task
* initialize idleWorkerRequest for CTPUT
* fix getting properties
Signed-off-by: fishbell <bell.song@intel.com>
refine
Signed-off-by: fishbell <bell.song@intel.com>
* fix warning
Signed-off-by: fishbell <bell.song@intel.com>
* fix illegal character on windows
Signed-off-by: fishbell <bell.song@intel.com>
* fix illegal character
Signed-off-by: fishbell <bell.song@intel.com>
add missing include
Signed-off-by: fishbell <bell.song@intel.com>
* more code refine
Signed-off-by: fishbell <bell.song@intel.com>
---------
Signed-off-by: fishbell <bell.song@intel.com>
Co-authored-by: fishbell <bell.song@intel.com>
* Properties improvements: part 2
* Accurate configs handling in HETERO / BATCH
* Align plugins in caching properties
* Fixed caching mock tests
* Added new TestNoCachingProperties test
* Fixed test
* Added ov::caching_properties to API 1.0 metrics as well
* Fixes for HETERO plugin
* Fixed tests
* Even more refactoring in HETERO plugin config management
* Align plugins in caching properties
* Fixed caching mock tests
* Added new TestNoCachingProperties test
* Fixed test
* Added ov::caching_properties to API 1.0 metrics as well
* Prevent memory reset at runtime allocation for dynamic shape
* Set default alloc to reset mem
* Additional fixes :
- If there is any convolution/deconvolution users which requires padded input, enqueue reset buffer when reuse buffer.
- Removed cl finish from gpu_buffer::fill. (Hopefully it should be waited only when needed. Otherwise sync is to be done by event)
- Removed buffer reset from on_execute of nonzero count, which is not needed any more.
* Remove unused API
* Fix tensor offset to project the padding
* Added unittest
* Applied review comment
* Added Saved Model proto descriptors
* Included Google's protobuf repository
* Added wstring version of ov::util::directory_exists
* Added initial implementation of Saved Model iterator
# Conflicts:
# src/frontends/tensorflow/src/frontend.cpp
* Added missing proto files to repository
* Implemented reading of variables index and data files
# Conflicts:
# src/frontends/tensorflow/src/frontend.cpp
* Renamed class
# Conflicts:
# src/frontends/tensorflow/src/frontend.cpp
* Fix for cross-platform directory_exists
* Fixed codestyle and simplified code
* CI fixes
* Separeted Saved Model iterator from Proto iterator
* Moved variables index into separate class
* Added initial implementation of reading a variables from
saved model
# Conflicts:
# src/frontends/tensorflow/src/frontend.cpp
* Added external variable mapping
* Code cleanup
* Commit is for discussion purposes!!!
Implemented RestoreV2 with a workaround for strings
Not optimized, includes mem leak
* In progress...
* Added DT_STRING coverage into decoder_proto
* m_variables_index moved into underlying class
* Updated copyrgihts, added space between license and code
* Moved string constant to separate class
* Added AssignVariableOp operation
* Changed behavior of RestoreV2
Updated stubs for other ops
* Second working implementation, enabled:
Program-only models
Variables reading from data files
* Extended docs
* Fixed dynamic type
* Fixed naming
* Added Snappy submodule to support compression in TF FE
* Enabled Snappy Compression for TF FE
* Make static linkage of Snappy
Changing Warning as error behavior for 3rd party
* CI fixes
* Added Snappy copyright info
* Aligned behavior of StringConstant with UnsupportedConstant
* Added correct naming and removing unused inputs/outputs
* [TF FE] Post leftovers to support the MUSE model in SavedModel format
It contains tests imitating a case with Tokenizer extension and raised problems:
setting custom type for body graph Parameter, named ports for RaggedTensorToSparse
and Unique operations.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/frontends/tensorflow/tests/convert_tricky_models.cpp
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* py/benchmark_app: fix -hint
Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.
Ticket 106544
* Remove extra throw
* Fix code style
* Add GatherV7 and gatherV8 for convert_gather_0d pattern
* Add updating output_shape using reorder/reshape for scalar indice instead of using ConvertGather0D pass
* Add WA for NMS-gather8 pattern
* Improve op support for detectron mask rcnn
* Initial commit
* Fix for reading processed list
* Format code
* Cleanup
* cleanup
* Cleanup
* cleanup test
* Add comment
* Add rt_info
* fix type
* More fixes for detectron
* Fix build
* Add tests for if
* Revert changes in index
* Add comment
* Fix test
* Fix get_axes_range
* Add tests and fix if type alignment
* Fix code style
---------
Co-authored-by: Mateusz <mateusz.mikolajczyk@intel.com>
