Commit Graph

10605 Commits

Author SHA1 Message Date
Aleksandr Voron
55fa8da5e4
[CPU] MVN 1D fix in ACL Executor (#16930) 2023-04-14 10:00:20 +04:00
Xuejun Zhai
802742e59f
split evaluate_map.cpp to small files (#16216)
* Split evaluate_map.cpp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix compiler error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI build error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI build error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI build error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issues

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issues

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issues

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issues

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Add op v7::Gelu

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-04-14 06:57:19 +04:00
Pavel Esir
68f46ff9a1
[MO] compress_to_fp16=False by default (#16854)
* compress_to_fp16=False by default

* Apply suggestions from code review

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* note abound RAM consumption for FP16 compressed models

* detailed notion about RAM usage

* update 'get_compression_message()'

* corrected get_compression_message: remove infor about RAM

* fix pytorch convert layer tests

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-04-14 01:16:41 +00:00
Ilya Lavrenov
de8f34c8f0
Fixed plugin name in tests for ARM CPU (#16932) 2023-04-13 22:35:21 +04:00
Ilya Lavrenov
85f9d1392c
Used cmake interface in ARM compute (#16929) 2023-04-13 22:35:03 +04:00
Luwei Zhou
6aeb054e48
[CPU] Use ONEDNN3.x weight/dest scale API to optimize perf (#16805)
* [LPT][CPU] Added callback for AddTransformation

* [WIP] Convolution scales fusion

* Force to use weight sclae to test performance.

* Update on interface.

* Use weight scale to adapt to ONEDNN 3.x API changes.

* Update the code.

* Update ONEDNN fix for gemm_x8s8s32x_conv kernel

* Fix the bug in ONEDNN and deconvFusingScale.

* Fuse FC Bias when having DQscale.

* WR to perf regression on

* Update onednn version.

* Fix bug and clean code.

* FC fusing dq scale bug fix.

* Add more comments and debug information.

* Fix CI issues.

* Merge ONEDNN changes.

* Fix CI issues and bugs.

* Apply review comments.

* Update comments.

* Apply reveiw comments.

* Avoid using LPT BiasAttribute RTInfo.

* Applied review comments.

---------

Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
2023-04-13 19:02:48 +02:00
Maxim Vafin
25015f9790
[PT FE] Support prim::DictConstruct on the output (#16894)
* Support dict on the output

* Preserve output order
2023-04-13 16:42:17 +00:00
Aleksandr Voron
0426c645eb
Fix for ambiguous overloaded function call (#16927)
* fix

* change type to unsigned long long
2023-04-13 19:28:30 +04:00
Shen, Wanglei
3461064507
update benchmark_app to remove setting UNDEFINED with -hint none (#16695)
* Remove setting ov::hint::PerformanceMode::UNDEFINED from benchmark_app

* update benchmark_app

* update python code and description

* update python code

* fix code style issue

* update python code

* update c++ app
2023-04-13 14:29:13 +00:00
Maxim Vafin
c592ecd44e
[MO] Fix legacy If (#16613)
* Fix legacy If

* Add test for If op

* Small fix
2023-04-13 18:10:40 +04:00
bstankix
5795a50a22
[docs] Update switchers 5 (#16925) 2023-04-13 16:07:53 +02:00
Egor Duplenskii
a016e4e6bb
[IE_TESTS] Avoid any extra work for the skipped tests (#16915)
i.e. do not clone the function if it is unnecessary
2023-04-13 13:23:38 +00:00
Vladimir Paramuzov
5299f26168
[GPU] Handle unsupported eltwise fusion for onednn gemm in dynamic cases (#16875)
* [GPU] Handle unsupported eltwise fusion for onednn gemm in dynamic cases

* Update src/plugins/intel_gpu/tests/fusions/gemm_fusion_test.cpp

Co-authored-by: Sergey Shlyapnikov <Sergeishlyapnikov@gmail.com>

---------

Co-authored-by: Sergey Shlyapnikov <Sergeishlyapnikov@gmail.com>
2023-04-13 15:55:44 +04:00
Roman Lyamin
656428bc4f
[GPU] Skip kernel logic for Concat fix (#16885) 2023-04-13 15:55:05 +04:00
Min, Byungil
da7ee613a3
[GPU] Disable oneDNN failed TCs on dGPU (#16853)
Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-04-13 20:41:29 +09:00
Taylor Yeonbok Lee
df6557cfad
[GPI]Fixed not to allocate internal buffer with size 0 (#16899)
* Fixed not to allocate internal buffer with size 0

* Fixed unittest failure
2023-04-13 10:32:12 +00:00
Ilya Churaev
f70954bda9
Fixed build for macOS with LLVM from brew (#16907) 2023-04-13 10:20:30 +00:00
Ilya Churaev
ad2dc4d479
Fixed ARM CPU tests. (#16910)
* Use name from OUTPUT_NAME property

* Fixed plugins without OUTPUT_NAME
2023-04-13 13:29:42 +04:00
Karol Blaszczak
7782d85b26
[DOCS] model caching update to GPU (#16909)
Update GPU.md
Update Model_caching_overview.md

Co-authored-by: Eddy Kim <eddy.kim@intel.com>
2023-04-13 11:09:16 +02:00
Mateusz Tabaka
5d80bca16e
[TF frontend] Add test for Split->Conv->Concat scenario (#16816) 2023-04-13 10:42:17 +02:00
Jan Iwaszkiewicz
63c5be3ed2
[PyOV] Fix models checking and ensure correct destructor calls in tests (#16814) 2023-04-13 10:37:05 +02:00
Gorokhov Dmitriy
ae350c7107
[CPU] Fixed unused-private-field compilation errors (#16905) 2023-04-13 12:20:18 +04:00
Anastasiia Pnevskaia
4921d1ad28
Fix for slowdown of convert_model() after multiple runs (#16751)
* Used singleton class for version check.

* Moved VersionChecker to utitl/version.py, added tests.

* Minor corrections.

* Sort imports.

* Small correction.

* Small correction.
2023-04-13 11:59:11 +04:00
Nikolay Shchegolev
061ba1d773
[CPU] Convert i64->i32 for Reference node. (#16797) 2023-04-13 11:55:53 +04:00
Xuejun Zhai
e238bfc1d0
Fix C API test failed with debug version on Windows & MacOS (#16903)
Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-04-13 10:59:42 +04:00
Wang Wangwang
1037f24c46
[AUTO] Remove exclusive_asyc_requests property from AUTO plugin (#16840)
* Remove exclusive_asyc_requests property from AUTO plugin

* Update test case

* Add test case to test incorrect config

* Remove the test case related to exclusive_asyc_requests property of AUTO plugin
2023-04-13 06:35:42 +00:00
Vladimir Paramuzov
67c07ccebe
[GPU] Support 7D and 8D tensors (#16810) 2023-04-13 09:04:14 +04:00
Tomasz Dołbniak
dcf6fb1e1a
Allow stable sort in TopK when sorting by indices (#16811)
* Allow stable sort in TopK when sorting by indices

* Clarification of stable sorting by index and unblocked test

* XFAIL the test again

* Clarification of sorting by indices

* Revert of changes in previous versions op TopK (spec)
2023-04-13 05:26:01 +02:00
Vladislav Golubev
9c6d287a58
[LPT] GroupConvolution plugin tests: test class corrected to restore behavior in arm plugin instances (#16883)
* [LPT] GroupConvolution plugin tests: restored test params default values

* return FQOnData shape automatic generation
2023-04-13 01:41:44 +01:00
Min, Byungil
1ba87971d1
[GPU] fix unit-test seg fault error on dGPU (#16879)
Signed-off-by: Min, Byungil <byungil.min@intel.com>
2023-04-13 09:20:06 +09:00
Aleksandr Voron
73be9d31b6
Skip CPU tests on ARM platform (#16891)
* [CPU] ARM architecture support

This patch extends existing CPU plugin capabilities with ARM CPUs optimized support

* Fixed undefined reference in unit tests

* refactoring

* Fixed Eltwise node behavior for ARM

* init commit

* tests passed

* fix skip failures

* Apply suggestions from code review

---------

Co-authored-by: dmitrygo <dmitry.gorokhov@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-04-13 02:34:36 +04:00
Ilya Lavrenov
86142b0f4b
Fixed compilation with gcc-12 (#16895) 2023-04-13 02:24:19 +04:00
Maciej Kwapulinski
0e975ffbb6
[GNA] smoke_MemoryTest suite enabled for transformation=NONE (#16481)
* relative threshold for smoke_MemoryTest suite adjusted for GNA

* smoke_MemoryTest suite enabled

* GNA MemoryTest. TransformNone: input changed to [5-10]. TransformLatency is disabled.

* RR comments applied

* RR2 comments applied

* RR3 comments applied

* clang-format-9 fix

* RR4 comments applied
2023-04-12 21:16:08 +00:00
Karol Blaszczak
65a49e903c
Update prerelease_information.md (#16898) 2023-04-12 20:04:25 +00:00
Ilya Lavrenov
418f70abb0
Improvements related to arm support (#16892) 2023-04-12 23:02:57 +04:00
Taylor Yeonbok Lee
bee357bcf8
Fix softmax perf of stable diffusion (#16869) 2023-04-12 12:01:31 -07:00
Ilya Lavrenov
298bf15a1b
Debian / RPM changes for ARM CPU plugin (#16871) 2023-04-12 23:00:07 +04:00
Aleksandr Voron
9b5ca2bb6a
Add ACL license (#16889) 2023-04-12 19:53:47 +04:00
Wang, Yang
86d7c97fa9
Update the logic of benchmark app property setting (#16427)
* 1. refine the logic to ov::device::properties setting.
2. the config overrides will be performed if same config setting is came from CMD line.-a

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update configuration sample file within README.md.

* Update.

* Update.

* 1. Update configuration example file within REAMDME.md for Python version.
2. implement the config DEVICE_PROPERTIES value convertation between the string type and dictionary of Python type.
3. Update the configuration file loading and dumping logic.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Update.

* Update.

* Update.

* 1. Enable configs to be interchangeable between C++ and Python.
2. Update perf_count showing logic.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert the logic of showing show performance counters.

* Update help msg for loading config option.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2023-04-12 15:32:54 +00:00
Gorokhov Dmitriy
c283d21215
[CPU] ARM architecture support (#15256)
* [CPU] ARM architecture support

This patch extends existing CPU plugin capabilities with ARM CPUs optimized support
2023-04-12 18:42:05 +04:00
Sofya Balandina
a368e10fff
[apiConformance] Stop work after crash and save report (#16539) 2023-04-12 18:31:39 +04:00
Irina Efode
c2a90f4c01
[CONFORMANCE] Fix error with import sigkill (#16884) 2023-04-12 18:21:57 +04:00
Wang Wangwang
c2c2143f45
clean AB property from virtual plugin and core global config (#16877)
* Benchmark_app set ov::hint::allow_auto_batching through compile_model

* Remove the process about allow_auto_batching in set_property of core

* Remove allow_auto_batching and auto_batch_timeout property from AUTO plugin

* Reserve the info logs and add API to check auto_batching

* Update test case, rm AB property test from core config tests

* Update some API in AUTO plugin config
2023-04-12 17:37:57 +04:00
Tomasz Dołbniak
fb49228fec
Pillow modes in the preprocessor's resize mechanism (#16601) 2023-04-12 15:30:42 +02:00
Sofya Balandina
ed5148b75f
[apiConformance] Refactor io_tensor tests (#16348) 2023-04-12 17:22:01 +04:00
Vladimir Paramuzov
7d4496bb12
[GPU] Remove unused constants from the graph (#16873) 2023-04-12 16:52:26 +04:00
Mateusz Bencer
e737e18b02
[ONNX FE] Fix Squeeze v1 (#16865) 2023-04-12 14:33:49 +02:00
Sergey Shlyapnikov
997f60f1c3
[GPU] Fix shape_of shape inference optimization (#16863) 2023-04-12 15:44:34 +04:00
Mateusz Tabaka
bdd79fe931
CompressQuantizeWeights - use f32 precision when computing scale and zero point (#16794)
Ticket: 101825
2023-04-12 12:42:39 +02:00
Szymon Irzabek
496fe7a7db
[GNA] Extend unsupported concat detection to include cascaded concat with convolution (#16756) 2023-04-12 12:19:42 +02:00