Commit Graph

11640 Commits

Author SHA1 Message Date
Wanglei Shen
a9c4e4ab56
enable node support (#17943)
* enable node support on Linux

* fix code style issue

* enable node support on Windows

* fix merge conflict

* update for comments

* update for comments

* enable numa node id and socket id in proc_type_table and udpate inference unit test

* update get_streams_info_table() and smoke test cases in CPU unit test

* fix code style issue

* update numa node id and socket id in proc_type_table on windows

* update for comments

* update for comments

* update for comments
2023-06-20 10:04:42 +08:00
Wilson Seok
3519050ef0
skip all user format check when dynamic shape in get_preferred_format() to avoid endless recursive call (#18096) 2023-06-19 18:52:58 -07:00
Sofya Balandina
429af27b86
Add full summary for apiConformance (#17818)
* Add full summary for apiConformance

* Move to summarize.py, split mandatory and opt scope
2023-06-19 18:40:26 +04:00
Przemyslaw Wysocki
b63e8433b0
Update labeler and numpy (#18136) 2023-06-19 14:21:10 +00:00
Patman11
b9575d9586
[GPU] Disable threaded kernel compilation when running in Windows Store app (#18062) 2023-06-19 17:55:47 +04:00
Egor Duplenskii
6143a4fa42
[CPU] Add early throw for filtering primitive descriptors (#17065)
Otherwise the plugin will throw later when trying to init optimal
primitive descriptor (when there is actually no descriptors at all)
2023-06-19 12:16:02 +00:00
dependabot[bot]
e54bd6ab1b
Update numpy requirement in /tests (#18134)
Updates the requirements on [numpy](https://github.com/numpy/numpy) to permit the latest version.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/RELEASE_WALKTHROUGH.rst)
- [Commits](https://github.com/numpy/numpy/compare/v1.16.6...v1.25.0)

---
updated-dependencies:
- dependency-name: numpy
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-19 14:46:06 +04:00
Haiqi Pan
3c619d8339
ov_remote_context -> Remote Context (#18132) 2023-06-19 12:58:14 +04:00
Xuejun Zhai
5c2925ada6
[AUTO BATCH PLUGIN] Split auto_batch.cpp & auto_batch.hpp to small files (#18133)
* [AUTO BATCH PLUGIN] split the auto_batch.hpp to plugin.hpp, complied_model.hpp sync_infer_request.hpp async_infer_request.hpp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] Add plugin.cpp, seprate the plugin related operations from auto_batch.cpp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] Add compiled_model.cpp, seprate the compiled model related operations from auto_batch.cpp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] Add sync_infer_request.cpp, seprate the sync request related operations from auto_batch.cpp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] Add async_infer_request.cpp, seprate the async request related operations from auto_batch.cpp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] remove auto_batch.cpp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix code format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-06-19 12:52:36 +04:00
Min, Byungil
9943ffc259
[GPU] Fix unit-tests for dGPU (#18125)
+ Resolved unit-tests failure on dGPU
+ Applied get_test_default_config for testing config

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-06-19 11:41:47 +04:00
Luo Cheng
fa545ffb1c
[CPU] MHA will produce NAN when all inputs are negative (#15995) 2023-06-19 09:30:23 +04:00
Min, Byungil
555c083336
[GPU] Optimize out Gather by converting to implicit crop (#17743)
+ Changed Gather if it divides input tensor along batch axis
+ Converted Gather to cldnn Crop in CreateGatherOpBase
+ Added implicit Crop condition for batch axis

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-06-19 05:05:22 +00:00
Ilya Lavrenov
5574acc6ca
Fixed Snappy dependent option default value (#18128) 2023-06-18 21:33:57 +04:00
Roman Kazantsev
3c623e890d
[MO][TF FE] Remove WA for supporting different TF formats (#18078)
* [MO][TF FE] Remove WA for supporting different TF formats

After providing direct support of all TensorFlow formats, we are ready to remove WA
that converts all unsupported formats to frozen protobuf using native TensorFlow

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Debug failure for LSTM multicell

* Reset default graph before entering session

* Remove temporal debug info

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-06-17 17:44:20 +00:00
Georgiy Manuilov
26c4ed7ba8
Add workaround for MSVC141 bug evoking C2440 compilation error (#18122)
MSVC141 fails to handle reinterpret cast of a template function
pointer due to a bug in the compiler:
https://developercommunity.visualstudio.com/t/bug-reinterpret-cast-address-of-templated-static-f/396044
2023-06-17 17:49:41 +04:00
Ilya Lavrenov
358893c758
Fixed compilaiton of ONNX FE tests (#18126) 2023-06-17 15:22:38 +04:00
Georgy Krivoruchko
5aa03f8e30
[TF FE] Extended support of tagged MetaGraphs and variables handling in SavedModel (#18084)
* Added support of alternate MetaGraph tags
Added support of variables without explicit RestoreV2

* Applied comments
2023-06-17 11:25:19 +04:00
Andrei Kashchikhin
74be4e04f3
rm explicit job specification (#18105) 2023-06-17 00:25:36 +04:00
Georgiy Manuilov
957ab9b831
Add missing header for std::tolower (#18118) 2023-06-17 00:25:13 +04:00
Ivan Tikhonov
6f14a43ea6
TSForwardBase class and a transformation to reset no_sinking attribute (#17913)
* Added TSForwardBase class and a new transformation to reset no_sinking attribute

* Refactoring

* fix an issue with legacy_output_names

* resolve review comments

* Resolve review comments
2023-06-16 20:43:26 +04:00
Georgy Krivoruchko
2f59e5d697
Fixed Windows behavior if folder path on input (#18112) 2023-06-16 20:32:40 +04:00
Mateusz Bencer
79e935fe97
[ONNX FE] Allow to mix new and legacy extensions (#18103) 2023-06-16 16:29:36 +00:00
Pavel Esir
cb63b39c72
do not change names while replacing FQ nodes (#17936)
* do not change names while replacing FQ nodes

* more solid fix

* even more solid fix

* fix UT failure
2023-06-16 15:51:50 +04:00
Tomasz Adamowicz
a4519f0a2c
16 byte memory alignment and concat (#17712)
* use device specific alignment instead of ALIGN64 macro

* update for tests

* update after review
2023-06-16 12:30:59 +01:00
Santhosh Mamidisetti
0b708b5eff
updated py_checks.yml , workflow to be triggered (#17956)
* updated py_checks , trying to trigger workflow

* trail trigger

* undone changes

* changes after PR

* corrected flake for logger , constants .py

* fixed flake8 test on modified files

* fixed flake8 test on modified files

* fixed logger.py to trigger workflow

* Update .github/workflows/py_checks.yml

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>

* Update .github/workflows/py_checks.yml

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

---------

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>
Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
2023-06-16 14:02:43 +04:00
Mateusz Mikolajczyk
42c93a70d4
[PT FE] Add aten::fft_rfftn and aten::fft_irfft complex replacers (#17999)
* Add transformations for rfftn and irfftn

* Formatting & reduce tests

* Improvements

* rm unused namespace

* Apply suggestions from review

* Fix format

* Add tests for dynamic type

* Add error messages
2023-06-16 11:35:30 +02:00
Tatiana Savina
945157cc7b
[DOCS] Local distribution page improvements (#18049)
* add slider with os specific libs

* doc review

* local distrib doc changes
2023-06-16 11:21:51 +02:00
Tatiana Savina
f165d8cb2b
add python block (#18085) 2023-06-16 11:21:33 +02:00
Maciej Smyk
a7442c8ed3
[DOCS] CMake options description in build guide for master (#18101) 2023-06-16 10:37:03 +02:00
Xuejun Zhai
e56405ef3b
[C API] Fix str copy to char* issue in debug & release mode, issue number 18019 (#18097)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-06-16 12:31:31 +04:00
Yury Gaydaychuk
f5dc8e7796
[ONNX FE] [CPU] Tests were aligned with DeformableConvolution specification (#10808) 2023-06-16 09:02:25 +02:00
Maxim Vafin
77584d301e
Fix automatic scripting for quantized models (#18089) 2023-06-16 08:51:21 +02:00
Vladimir Paramuzov
3d79bd1ac5
[GPU] Minor layout optimizer refactoring (#17553) 2023-06-16 10:33:53 +04:00
Maxim Vafin
55156f9a6c
Validate only one If body if condiction is const (#18087)
* Validate only one If body if condiction is const

* Add test with invalid body
2023-06-15 20:04:10 +00:00
Maxim Vafin
10ace822ef
[PT FE] Do not freeze for quantized models (#18082)
* Do not freeze for quantized models

* Update tests/layer_tests/pytorch_tests/pytorch_layer_test_class.py

* Fix getitem
2023-06-15 19:41:06 +02:00
Tatiana Savina
8031cfea98
[DOCS] PORT Add examples of using named outputs in extensions (#17622) (#17754)
* [DOCS] Add examples of using named outputs in extensions (#17622)

* [DOCS]Add examples of using named outputs in extensions

* Fix opset

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/Extensibility_UG/frontend_extensions.md

* Add reference to external docs

* Update docs/Extensibility_UG/frontend_extensions.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

---------

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/Extensibility_UG/frontend_extensions.md

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-06-15 16:35:45 +02:00
Maxim Vafin
9684f9184a
[PT FE] Improve operation naming (#17997)
* Improve operation naming

* Use set to reduce operations with indexes, fix code style

* Refactor

* Make good names in transformations

* Remove tensor index from input/output names

* Fix tests
2023-06-15 14:28:38 +02:00
Nikita Malinin
483a040d52
Update OMZ submodule with MMAP (#18073) 2023-06-15 14:32:34 +04:00
Pavel Esir
aa32ff1df3
keep Const + DecompressionConvert for CPU (#15930)
* keep Const+DecompressionConvert pattern for CPU

* temporary disabled failing unit-tests

* disable CF by modifying bounds evaluate as well; minor corrections

* added TODOs with ticket numbers

* join const+decompression markings

* minimized convert_precision.cpp changes

* minor corrections

* refactor fp16 transformations: moved into separate fp16_compression folder

* style-fix

* minor fixes

* do not disable evaluate and CF in shape path

* safer disabling of Const conversion

* style-fix and minor corrections

* restore original placement of ConvertPrecision
2023-06-15 13:07:22 +04:00
Maxim Vafin
caedb6a6b4
[PT FE] Print better exception message (#18015)
* [PT FE] Print better exception message

* Sort ops and fix code style

* Apply feedback

* Remove obsolete variable

* Rearrange newlines

* Apply feedback, add messages in transformations

* Fix style

* Add exceptions in cat and getitem replacers

* Add test

* Fix test regex
2023-06-15 12:04:01 +04:00
Anastasia Kuporosova
7fd394e87e
[PyOV] AsyncInferQueue documentation notice about iteration limit (#18042) 2023-06-15 09:23:26 +02:00
Andrei Gorbachev
52834659c4
[GPU] additional checks fixed for fully_connected (#18068) 2023-06-15 09:11:38 +04:00
Haiqi Pan
3e63ab0dc3
Remove ov::core dependency after CPU CompiledModel constructed (#17156)
* fx repr

* remove isNewApi

* add cisLegacyApi

* remove isNewApi

* fix logic

* add test case

* remove comment

* fix bug

* add configuration

* skip in template

* skip failed case

* skip AUTO and MULTI to test

* resolve conflicts

* fix confilcts

* skip AUTO and MULTI to test

* template on

* Revert "template on"

This reverts commit d82a5a4964.

* get log

* add tmp core

* reset to test

* Revert "reset to test"

This reverts commit 7a39d4e24b.

* try to push

* use createCoreWithTemplate()

* remove AUTO and MULTI in skip_config

* Revert "remove AUTO and MULTI in skip_config"

This reverts commit d42420590f.

* fix confilcts

* fix conflicts

* remove AUTO and MULTI in skip config

* fix confilcts

* remove isLegacyAPI

* remove useless code

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
2023-06-15 01:50:24 +04:00
Roman Kazantsev
79683c24ca
[TF FE] Support models with v1 checkpoints (#18000)
* [TF FE] Support models with v1 checkpoints

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix build issue

* Fix issue in load_impl

* Fix MO unit-tests

* Check input_checkpoint in argv

* Fix build issue

* Update src/frontends/tensorflow/src/checkpoint_v1_reader.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

* Apply comments from code-review: split CheckpointV1Reader constructor

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-06-14 21:01:33 +00:00
Ilya Lavrenov
967faf878a
t Improved samples build stability (#18053) 2023-06-14 18:23:02 +00:00
Mykhailo Hnap
bae926de22
[GPU] Unique-10 operation implementation. (#16412)
* [GPU] Unique-10 operation implementation.

* Handled flattened case.

* Created results for all outputs in single layer test.

* Save total unique count as fifth output.

* Handled axis case.

* Added unique reshape kernel.

* Moved data types to unique primitive constructor.

* Added shape agnostic Unique ref kernel.

* Added blocked layout support to Unique-10.

* Use int in bubble sort.

* Added unit tests.

* Added support for blocked layouts to flattened mode.

* Fixed usage of shape_info in kernel.

* Use correct total data size for dynamic shapes.

* Commented some functional tests.

For some reasons big shapes cause std::bad_alloc.

* Initialize out_counts with zeros.

* Implemented new approach for reducing memory footprint.

Changed first kernel to only count unique values and changed second kernel to fill all outputs.

* Revert "Commented some functional tests."

This reverts commit a7f9763c575e71e14b85ee37adf1e98f10785c15.

* Fixed calc output layouts for flattened case when rank in greater than 4.

* Added temporary fix for axis case when rank is greater than 4.

* Revert "Added temporary fix for axis case when rank is greater than 4."

This reverts commit 236640d2f0e9d5b1f8dcbbf9482763badd7fde66.

* Renamed "unique" to "unique_count" and "unique_reshape" to "unique_gather" primitives.

* Quick fix for add_intermediate_node to consider dep_idx of multiple output

* Fix bug for multiple output:
1) get_reorder was getting reorder from cache regardless of the dep_idx.
2) remove_redundant_reorder was not considering original dep_idx

* Fixed conflicts.

* Fixed win build issue.

* Fixed build issue.

* Revert "Fix bug for multiple output:"

This reverts commit d4a2c4f32eabe9108df31d4837fed8995c93bd1c.

* Revert "Quick fix for add_intermediate_node to consider dep_idx of multiple output"

This reverts commit 2dfd2aaefdf32067a7469505b35f7096632ac5f2.

* Added some tests to skip config.

---------

Co-authored-by: Taylor Yeonbok Lee <taylor.lee@intel.com>
2023-06-14 10:41:51 -07:00
Anastasiia Pnevskaia
5993c4942a
Fixed load_by_model() test. (#18060) 2023-06-14 18:43:40 +04:00
Wanglei Shen
277e759dcd
rebase (#17212) 2023-06-14 21:19:39 +08:00
Sebastian Golebiewski
92ac04dcac
[DOCS] Restyling tabs fix
Fixing style of active tabs.
2023-06-14 15:01:33 +03:00
Andrei Gorbachev
1761427ab1
fixed fp16 x fp16 overflow in NonMaxSuppression (#18038) 2023-06-14 15:58:49 +04:00