Commit Graph

11869 Commits

Author SHA1 Message Date
Ilya Lavrenov
94887bed38
Removed prebuilt OpenCV usage (#17838) 2023-07-28 16:08:09 +00:00
Alexandra Sidorova
4bef661f7a
[Snippets][CI] Added ov_snippets_func_tests validation to Azure CI (#18844)
* [Snippets][CI] Added Snippets Func Tests to Azure Windows

* [Snippets][CI] Added Snippets Func Tests to Azure Linux

* [Snippets][CI] Added Snippets Func Tests to GitHib workflow Linux

* [Snippets][CI] Added Snippets Func Tests to GitHib workflow Windows

* [Snippets][CI] Added Snippets Func Tests to Azure Linux Debian
2023-07-28 15:23:10 +00:00
Vladimir Paramuzov
3e0b4b337b
[GPU] LUID property added (#18815) 2023-07-28 19:16:25 +04:00
bstankix
3a83237a6c
Bugfix newsletter and footer scripts (#18853) 2023-07-28 16:12:07 +02:00
Ilya Lavrenov
41750e1ada
Added a WA for running Python API in debug mode (#18848) 2023-07-28 17:29:09 +04:00
Anastasia Kuporosova
f23f937b85
[PyOV] Add more ovany tests (#18730) 2023-07-28 15:01:53 +02:00
Anastasiia Pnevskaia
c7cde6a102
Removed saved_model_tags from OVC, improved help. (#18785)
* Removed saved_model_tags, improved help.

* Fixed help, removed to string conversion of params.

* Help corrections.

* Small correction.

* Corrected wrong changes.

* Corrected wrong changes.

* Fixed arguments creating in cli parser.

* Renamed extensions parameter to extension.
2023-07-28 15:46:47 +04:00
Maxim Vafin
481721e979
[PT FE] Partially disable freezing for int8 and uint8 weights (#18827) 2023-07-28 13:37:01 +02:00
Georgy Krivoruchko
9bf5b6effb
Fixed loading error when we see string type (#18837) 2023-07-28 11:02:50 +00:00
Vladislav Golubev
5e846a0433
[CPU] Extensions shape inference issue fix (#18824) 2023-07-28 15:02:38 +04:00
Vladimir Paramuzov
9177809bd7
[GPU] Fixed removal of reorder connected to non-default out port (#18826) 2023-07-28 14:55:46 +04:00
Mustafa Cavus
c720052f40
TorchFX caching fix (#18813)
* TorchFX caching fix

* Added required newlines for code formatting

* TorchFX model caching file_name check added
2023-07-28 12:25:18 +02:00
Jakub Nowicki
fd085f870f
[GNA] Update doc for GNA 3.5 (#18825)
* [GNA] Update doc for GNA 3.5
2023-07-28 12:25:03 +02:00
Sofya Balandina
223461e462
[apiConformanceReport] Fix double 'passed' in 'all test amount' and fist mandatory view (#18822) 2023-07-28 12:41:32 +03:00
Georgy Krivoruchko
4f13f0c5c9
Aligned namespaces with an actual master (#18671) 2023-07-28 12:20:54 +04:00
Ekaterina Aidova
349a0d420f
[PT FE]: cleanup unused imports (#18833) 2023-07-28 12:03:15 +04:00
Jan Iwaszkiewicz
583939b828
[PyOV] Aliases and namespace redesign (#18157)
* Remove inits, update main one

* Fix stacklevel

* Testing wrong solution

* Testing test test

* Fix test test test test

* mo modules mo problems

* Xfail test that check stdout/err?

* not so correct solution to circular imports

* Fix or not to fix

* CMake magic, co-authors: my best team

* Fix package imports

* Fix tools inits

* Fix ovc tf

* Fix Q000

* Fix F401

* Fix linters

* Add save_model

* Remove LayoutMap

* Move test_utils to 'internal modules'

* First testing

* Missing Type

* Expand main namespace

* Change some more tests

* Add OVAny to namespace

* Add Constant and Parameter to namespace

* More tests changes

* Fix inits

* Add layout_helpers to main namespace

* Revert CMake and linux.yml with ovc

* Update main inits

* Remove MO from tools inits

* changes to init files

* Fix tests

---------

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
2023-07-28 11:52:21 +04:00
Luwei Zhou
493723ecdf
Fix dump_check.py argument. (#18400) 2023-07-28 15:25:43 +08:00
Marcin Kacprzak
e1ec17013d
[GNA] Fix for GeminiLake detection (#18653)
* [GNA] Fix for GeminiLake detection

* Added HWGeneration::GNA_1_0_E enumerator
Added DeviceVersion::GNAEmbedded1_0 enumerator, changed the meaning of DeviceVersion::GNA1_0.
Updated ConvLowPrecision test with all supported targets

* [GNA] Extended a few tests with GNA1.0
2023-07-28 08:18:22 +02:00
Ilya Churaev
c4f8afb741
Fix GPU stress tests under the proxy (#18700)
* Add debug messages

* Add more debug messages

* Add more messages

* Disable proxy plugin

* Enable proxy and suppress NVIDIA

* Remove disabling NVIDIA

* Update hidden device only if proxy settings were changed

* Use static unavailable device to load unavailable device only one time
for the process

* Removed debug messages and add global mutexes for unavailable plugins
2023-07-28 09:56:39 +04:00
David Nam
1fcdc90989
Modify the condition making batch interpretation true/false (#18283)
* Modify the condition making batch interpretation true/false

- When the user is Convert for Constant node, and tensor is 1d,
- Set needBatchInterpretation to true

* Narrow down the range of the condition

* Merge the condition

* Add additional condition not to check self node

* Fix incomplete condition

* Check if all inputs to binary eltwise is 1d

* Change code style
2023-07-27 22:42:07 -07:00
Luwei Zhou
c9001980ef
[CPU] Ensure const blob 16 byte alignment on non-AVX platforms (#18705) 2023-07-28 09:01:36 +04:00
Andrew Kwangwoong Park
aba2770921
[GPU] Do not add post reorder for inputs if data type does not change (#18797)
* Remove reorders of inputs for KV cache

* Fix failed CI TC for ov_gpu_func_tests
2023-07-27 20:50:04 -07:00
Taylor Yeonbok Lee
acb7e870ce
Add new debug config disable_memory_reuse (#18792) 2023-07-27 21:45:34 +00:00
Maxim Vafin
ab8b46165b
[PT FE] Support chunk->ListUnpack in quantized models (#18823)
* [PT FE] Support chunk->ListUnpack in quantized models

* Add comment

* Use type

* Fix build

* Update src/frontends/pytorch/src/op/list_unpack.cpp

* Update src/frontends/pytorch/src/utils.hpp
2023-07-27 19:10:21 +00:00
Nesterov Alexander
1857c7a793
Revert "[ARM CPU] ACL TBB scheduler (#17445)" (#18821)
This reverts commit 510f578aab.
2023-07-27 21:38:20 +04:00
Tomasz Jankowski
37fb5d2736
[CPU] Handle negative indices in ScatterElementsUpdate (#18770)
* Handle negative indices in ScatterElementsUpdate

* Enable test on negative indices

* Enable onnx test on negative indices
2023-07-27 16:53:58 +00:00
Vitaliy Urusovskij
4be69bdd5f
Fix get_directory() to return / on Linux (#18820) 2023-07-27 17:24:07 +04:00
Sergey Shlyapnikov
2bd49cc1f8
[GPU] Add extra flush() command for dynamic models and OOO queue (#18819) 2023-07-27 16:15:37 +04:00
Luwei Zhou
5f5df36b60
[CPU] Enable oneDNN avx2 brgemm impls for Matmul/FullyConnected operations (#18467) 2023-07-27 13:09:13 +02:00
Zhang Yi
5a945a6219
[CPU] Apply sdl requirement for mlas (#18812) 2023-07-27 14:53:05 +04:00
Evgenya Stepyreva
812d11cf8c
Dimension equality fix (#18806) 2023-07-27 12:01:45 +02:00
Tatyana Raguzova
609a7d7716
Fix issue with cleaning up after build wheels (#18774)
Co-authored-by: Artyom Anokhov <artyom.anokhov@intel.com>
2023-07-27 11:33:19 +02:00
Pavel Esir
98df87099a
[MO] compress_to_fp16=True by default (2nd attempt) (#18652)
* [MO] compress_to_fp16=True by default (2dn attempt)

* fix unit-tests

* second round of fixin unit-tests

* set compress_to_fp16 default to True in ovc/cli_parser.py

* use save_model in mo_python_api_tests

* enforce compress_to_fp16=False in test_zero_copy

* selectively compress depending on the path user has chosen to generate IR

* corrected doc

* allow compress_to_fp16=False/True for ovc

* doc and unit-tests failing fix

* user save_model in ovc cli tool

* revert back serialize and compress_model but into main instead of moc_emit_ir

* cover more argument combinations for cli tool and convert_model
2023-07-27 12:32:50 +04:00
Mateusz Mikolajczyk
a0a1102499
[PT FE] Add quantized::cat (#18750)
* Add quantized cat

* Add quantized cat

* Format

* Improve tests

* Fix merge conflict
2023-07-27 10:32:17 +02:00
Vitaliy Urusovskij
f8f6d4a5b5
Note ONNX FE in mem_optimization_guide.md (#18777) 2023-07-27 10:42:35 +04:00
Mingyu Kim
416fdddd34
[GPU] bugfix for copy_from (#17993) 2023-07-27 11:47:40 +09:00
Min, Byungil
83a78eb559
[GPU] Improvement for buffer dump (#18542)
* [GPU] Improvement for buffer dump

+ added OV_GPU_DumpLayersInput to support dump input layers
+ added OV_GPU_DumpLayersRawBinary to make binary dump
+ added OV_GPU_LoadDumpRawBinary to use binary dump as input
+ binary dump naming rule layername_datatype_tensor_format.bin

Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-07-27 11:11:34 +09:00
Taylor Yeonbok Lee
c145d8f1e9
[GPU] Allocate reorder & permute's output memory for bounded dynamic shape (#18793)
* Previously reorder / permute was not allocating its memory at build time thought the shape has upper bound

* Update src/plugins/intel_gpu/src/graph/permute.cpp

Co-authored-by: Sergey Shlyapnikov <Sergeishlyapnikov@gmail.com>

* Fix as review comment

---------

Co-authored-by: Sergey Shlyapnikov <Sergeishlyapnikov@gmail.com>
2023-07-27 02:08:58 +02:00
Sofya Balandina
2afcd950fa
[apiConformanceReport] Fix result passrate persantage (#18808) 2023-07-27 01:44:47 +03:00
Oleg Pipikin
ff0b51f3ca
Rename CommonTestUtils namespace (#18590)
* Rename CommonTestUtils namespace 1

* Rename CommonTestUtils namespace 2

* Rename CommonTestUtils namespace 3

* Rename CommonTestUtils namespace 4

* Fix1

* Fix2

* Fix3

* Apply comments

* Fix4

* Fix5
2023-07-26 21:06:50 +02:00
Pawel Raasz
2655512b2f
Review RandomUniform for shape inference (#18800)
* Review RandomUniform for shape inference
- Check dynamic and static shape propagation
- Check label propagation
- Check preserve input values and labels
- Add template implementation of shape_infer
- Add unit tests

* Update RandomUniform copy test

* Use correct type for call reference implementation
2023-07-26 21:54:15 +04:00
Pawel Raasz
32f2868a5b
Review shape inference of ExtractImagesPatches (#18771)
* Review shape inference of ExtractImagesPatches
- Check static and dynamic shapes propagation
- Check label propagation
- Review template implementation of `shape_infer function
- Add unit tests.

* Add additional test to check padding calc
2023-07-26 21:49:48 +04:00
Pawel Raasz
bb3c9aa9a7
Review RegionYolo class for shape inference aspects (#18741)
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`

* Temporary support of StaticShape

* Minor corrections in ShapeInferenceTA

* Migrate shape_infer to new interface version

* Replace StaticShape by adapter implementation

* Replace IShapeInferCommon by IStaticShapeInfer

* Correct code formatting

* Fix build issues

* NodeValidationFailure::create for StaticShapeRef

* Review RegionYolo for shape inference:
- Check dynamic shape and label propagation
- Check static shape inference
- Review shape_infer template implementation
- Update unit test

* Remove commented test code

* Correct flatten dim calculation
2023-07-26 20:42:41 +04:00
dependabot[bot]
ab42ff1164
Bump certifi from 2022.12.7 to 2023.7.22 in /docs (#18789)
Bumps [certifi](https://github.com/certifi/python-certifi) from 2022.12.7 to 2023.7.22.
- [Commits](https://github.com/certifi/python-certifi/compare/2022.12.07...2023.07.22)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-26 20:09:06 +04:00
Surya Siddharth Pemmaraju
d42b53c070
Torchfx backend (#18244)
* Added Torchscript Backend

* First commit for backend with Torch FX Decoder

* Merging changes from Torch FX branch

* Torch FX initial fixes (Temporary)

* Fixed type/shape issues in Torch FX decoder

* Added translation for built-in getitem

* MaxPool update & Output shape fix (Torch FX)

* Torch FX graph outputs fix

* Torch FX support for sigmoid and slu_

* Torch FX graph module caching

* Torch Fx partitioner cache removed

* Torch FX initial getitem replacer added

* Index check for torch fx getitem replacer

* Debug print removed from partitioner

* Added environment variables for pytorch tracing mode and openvino device

* FX translation fix for getitem & getitem replacer removed

* Added checks for PyTorch tracing mode environment variable

* Adding compile mode for fallback

* Added more ops for resnet18

* Added a check for environment variable

* Generalized addmm to work with torchscript and torchfx

* Added the missing batch_norm.default translation

* fx_backend: include get_attr ops to the partitions

* AddeTODO note t to improvget_attr algorithm

* created function for adding get_attr nodes

* fx_backend: added aten.mul.Tensor, re-enabled aten.empty.memory_format

* fx_backend: Additional op support/improvement for Inception V3

* Added comment for fix 64-bit to 32-bit max int conversion

* fx_backend: Update for avg_poolnd to support 3 inputs

* Fixed erorr in decoder.py

* TorchFX caching fix

* Torch backend, op support for Stable Diff. & BERT

* Arranged ops in order and added torch tensor mapping

* Added support for more ops for super glue

* TorchFX: Initial permanent fallback

* TorchFX: New ops for improved TorchVision support

* TorchFX backend optimizations for partitioning and tmp fallback

* working operator updates for superglue

* Updates to operators for superglue

* Removed max.dim and stack

* Cleanup

* Cleanup

* Fixed a couple of syntax issues

* Fixed a couple of syntax issues

* Added missing method to TorchFX Decoder

* Added missing method to TorchFX Decoder

* Removed redundant code for transpose

* TorchFX: Initial StableDiffusion support

* PyTorch decoder ovtype to ctype fix for int64

* Added ops for distilbert

* Fixed few unnecessary include statements

* Seperated TorchFX and TorchScript decoders

* Modified import statements to reflect two decoders

* f64 fix for TorchFX

* Import fix for PyTorch backend modules

* TorchFX serialize graph for debugging (Temporary)

* Serialize and load back feature enabled for TorchFX

* Temporary optimization to remove Broadcast

* Temporary SoftmaxRehapeElimination pass is added

* TorchFX custom model cache directory

* PyTorch bitwise translation, conversion checks enabled

* Naming fix in make_list_construct

* TorchFX: Added comments to Softmax and Slice translations

* translate_chunk temporarily removed for TS backend

* Fixed linter issues

* Addressed clang formatting issues

* Fixed few more clang and linter issues

* Fixed tests to use ts_decoder

* Fixed naming convention issues

* Added missing import

* Added inlined_inputs to TorchScriptDecoder

* Added tests for torch fx backend

* Removed magic numbers in PyTorch decoder utils

* TorchFX decoder data type fix

* Added cast from size_t to int

* TorchFX output handling code cleanup

* TorchFX: Use detached input tensor

* Added missing cast from size_t to int

* Added static cast in group_norm

* Fixed casting issue in split

---------

Co-authored-by: ynimmaga <yamini.nimmagadda@intel.com>
Co-authored-by: Cavus Mustafa <mustafa.cavus@intel.com>
2023-07-26 16:23:42 +02:00
Tomasz Jankowski
1ee5b6dd3f
[Tests] Add subgraph body functions comparison (#18254)
* Add subgraph body comparison

* Avoid confusing function name

* Skip failing snippet test

* Skip some ov_snippets_func_tests

* Derive comparison flags

* Skip snippet test

* Drop on bodies mismatch

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-26 15:59:28 +02:00
Sofya Balandina
6aa542ab12
[subgraphDumper] Setup op priority based on opset version (#18629)
* [subgraphDumper] Setup op priority based on opset version

* Add dependency on version id
2023-07-26 13:57:50 +00:00
Mikhail Ryzhov
0569bb8c5d
[GNA] Fuse gather and transpose (#18648) 2023-07-26 13:44:44 +00:00
Nadezhda Ageeva
a930c74143
[HETERO] Fix problem with ov_hetero_unit_tests (#18794)
* [HETERO] Fix problem with ov_hetero_unit_tests

* FIX 2

* Rename ov_hetero_unit_tests -> ov_hetero_func_tests
2023-07-26 16:12:22 +04:00