* Initial impl for runtime buffer fusing
Passing unittest with static kernel
* pass unittest with dynamic impl
* Refactor allocate_output
* Separate header of buffer fusing
* Refactored buffer fusing :: matcher/optimize
* More cleanup
* Fix crash in dolly
* Reset can_be_optimized of primitive_inst when it is not
* Fix empty tensor : Primitive with empty data should be skipped
* Fix issue in dynamic padding : Static kernel should not contain dynamic padding dims
Fix missing reset of update_shape_done_by_other flag
* Not to add cache with emtpy kernel for optimized out inst
* Fix corner case error in buffer fusing
- Shapes of some preds may not be changed, but still needed to do update_impl because 1) paddings are changed 2) output memory should be updated
- optimizable impl should not be added to the cache
* Allowing reorder & permute_ref to be optimized concat predecessor
* Some more fixes :
runtime buffer fusing is available only when all preds/concat are dynamic
runtime buffer fusing is to be executed only if the node is dynamic
* Fix allocate_output parameter called by get_estimated_device_mem_usage according to the new change
* Fixed error in cascaded concatt
* Need to reinterprete even though the size is same
* Requirements for the HW plugin to integrate with AUTO
Signed-off-by: Peter Chen <peter.chen@intel.com>
* Update property requirements and wording
1. Added purpose for each reqired property
2. Removed autobatching properties
3. Updated wording
Signed-off-by: Peter Chen <peter.chen@intel.com>
* Add one BA test and update purpose for model_name
Signed-off-by: Peter Chen <peter.chen@intel.com>
* Add request to ov::compilation_num_threads
Signed-off-by: Peter Chen <peter.chen@intel.com>
* Add link to intgration with AUTO
Signed-off-by: Peter Chen <peter.chen@intel.com>
* Wording with API 2.0
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
* Try to fix the link
* Remove ":doc:"
* Add postfix "__" for external link
* Apply suggestions from code review
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* bash command and multiple devices description update
Signed-off-by: Peter Chen <peter.chen@intel.com>
---------
Signed-off-by: Peter Chen <peter.chen@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Introduce PadBase
* Update ov scope name
* Introduce Pad-12
* Common type_prop Pad tests
* Init Pad-12 ref tests
* Add Pad reference tests
* attr and op check tests
* Move eval and clone inputs from PadBase
* Init opset12
* Headers clean up
* Update shape_inference map for CPU
* Update Pad evaluates to use ov::TensorVetor
* Update shape infer map with Pads
* Fix namespace
* Update op check test
* Add common Pad shape_inference tests
* Reuse PadBase shape_infer
* Fix C API registers unit test failed
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* Fix compile error in macos
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* Fix CI format issue
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* using the getExecutableDirectory() func from openvino::utils
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
---------
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
* Deprecate ExecutableNetwork and InferRequest API
* Fixed some warnings
* Fixed some warnings
* Try to fix documentation
* Try to skip documentation warnings
* Mark as deprecated nGraph API
* Fixed code style
* Added IN_OV_LIBRARY define
* Suppress warnings for log
* Suppress warning
* Updated nGraph headers
* Fixed build for macOS
* Fixed lpt and snippets
* Fixed build all on macOS
* Suppress some warnings
* Fixed some new warnings
* Fixed new warnings
* Try to fix some warnings
* More warnings
* Soome change
* Suppress more warnings
* Suppress warnings for transformations
* Suppress warnings for LPT
* One more fix
* Suppress more warnings
* Try to fix opset error
* Remove opset constructor
* Cannot fix opset warning
* Suppress warnings for offline transfromations
* Fixed some warnings for Windows
* Fixed code style
* Suppress some warnings for onnx FE
* Revert "Suppress some warnings for onnx FE"
This reverts commit 75d23b64fc.
* Revert "Fixed code style"
This reverts commit c6eba63116.
* Revert "Fixed some warnings for Windows"
This reverts commit 23d7ed88b6.
* Revert "Suppress warnings for offline transfromations"
This reverts commit 0b9f6317bf.
* Revert "Cannot fix opset warning"
This reverts commit 19ea658639.
* Revert "Remove opset constructor"
This reverts commit 06afb1bc20.
* Revert "Suppress warnings for LPT"
This reverts commit 58b1c0f5a0.
* Revert "Suppress warnings for transformations"
This reverts commit f8bb9814a1.
* Revert "Suppress more warnings"
This reverts commit f9f0da9acb.
* Revert "Soome change"
This reverts commit e545d4984e.
* Remove deprecation for ngraph::OpSet and FactoryRegistry
* remove @param and separate line
* separate line of ov_remote_context_free
* fix code style
* Update src/bindings/c/include/openvino/c/ov_remote_context.h
Co-authored-by: Chen Peter <peter.chen@intel.com>
* add ...
* add ...
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Fix squeeze compatibility
* Fix issue in remainder causing model to fail
* Add tests for slice
* Modify remainder to support int + add type tests
* Apply requested changes
* Add comment
conformance table added
ARM merged with CPU
precision support and layout tables removed from the overview device article (info available in device articles)
