Commit Graph

4800 Commits

Author SHA1 Message Date
Taylor Yeonbok Lee
61c97edd40
[GPU] Reduce unused macros to reduce loading time (#7435)
* Reduce unused macros, where two strategies are used:
(1) Extract batch_headers and let them be included only once in each batch.
(2) Static reduction in primitive_db_gen.py, which scans each macro's users and exclude the macro if there is no user.

* Removed dependency from runtime to kernel_selector

* Resolve too large string error

* Fix duplicated definition (GET_FILTER_XXXX is defined in both fetch_weight.cl and by runtime.
Removed from runtime because the definition is incorrect

* Resolve GRN & deconv & gpu_select issues

* Fix cldnn unittest issues

* Minor fix

* Applied review comments

* Fix rebase error
2021-10-01 15:18:15 +09:00
Sungeun Kim
e0cea200e3
[GPU] Onednn integration for pooling (#7753)
* [GPU] Onednn integration for pooling primitive

* layout_optimizer for pooling

* Padding code merge for onednn

Co-authored-by: Kim, Mingyu <mingyu.kim@intel.com>
2021-10-01 15:02:30 +09:00
Gleb Kazantaev
a16cc81233
Remove VariantWrapper for simple attr classes (#7771)
* Remove VariantWrapper for simple attr classes

* Code style
2021-10-01 08:03:37 +03:00
Ilya Churaev
faeaf045a9
Graph comparator to ngraph util (#7729)
* Moved FrameworkNode to nGraph

* Moved graph comparator to ngraph test util

* Fixed build

* Try to fix centos

* Fix export target

* Moved engine utils to separate library

* Removed ONNX util from common library

* Fixed build

* Fixed code style
2021-10-01 07:24:28 +03:00
Ilya Znamenskiy
f675df625c
[GPU] Added post-ops support for OneDNN primitives (#7737)
[GPU] Memory lock fix
2021-10-01 12:18:00 +09:00
Ilya Lavrenov
302eb08dc5
Replaced gtest deprecated macro (#7779) 2021-10-01 03:46:32 +03:00
Egor Duplensky
778cc2ddbb
[CPU] Migration on oneDNN v2.3.2 (#7680)
binary post
binary post ops support for gemm convolution and gemm inner product
plugin fixes
mkldnn: avx512: fixed prelu post op

Co-authored-by: dmitrygo <dmitry.gorokhov@intel.com>
2021-09-30 20:25:49 +03:00
Dmitry Pigasin
7fade1e357
Fix a result shape for a model with a 3d tensor at the output (#7741) 2021-09-30 16:58:11 +03:00
Maksim Derbasov
3f0fea5c1b
Fix for warning C4297 (#7740) 2021-09-30 16:57:43 +03:00
Mikhail Nosov
6e05cead11
[OV20] Reference implementation for NV12toRGB and NV12toBGR operations (#7601)
* Reference implementation for NV12toRGB and NV12toBGR operations
Tests:
- ngraph: visitor + type_prop
- template plugin: reference implementation
- inference-engine: shared tests for plugins
- cpu plugin: compare with ref implementation tests

* Fix clang

* Serialization tests

* Fix clang-format

* Changed 'f32' to 'any supported floating-point type'
Added appropriate shape inference tests
Added error test for >2 inputs
Fixed failed CI tests

* Updates after rebase
+ Try to fix Ninja build

* Fix CI

* Support endianness + potential fix of win32 test fails

* Fix review comment

* Fix review comments

* Fix unit test build

* Fix unit test build #2

* Possible build fix 3

* Simplified reference tests
Observed issue with shuffling Y pixels on little-endian systems, added tests
2021-09-30 16:34:46 +03:00
Evgenya Stepyreva
b339bb780b
Resolved unexpected -1s in IRs (#7709) 2021-09-30 15:39:32 +03:00
Anton Pankratv
fab4056ceb
Fixed callback copy count (#6607) 2021-09-30 15:09:47 +03:00
Ilya Lavrenov
757db35528
Dynamism in new API (#7742)
* Fixed precisions conversion in new API

* Added tests

* Fixed old IR cases

* Disable FP16

* Fixed regex for CentoOS

* Refactored tests to use new API

* Temp

* Fixed tests

* Moved smart reshape related sources to ngraph

* Added tests for invalid names

* Moved reshape to tensor_names

* clang-format

* Fixed CC build

* Removed IEConv, IEDeconv from primitives pririty
2021-09-30 15:04:24 +03:00
Michał Karzyński
bd5b1bf99f
Change the way Model Optimizer loads frontends (#7330)
* Adds two switches `use_new_frontend` and `use_legacy_frontend` to override defaults.
* Rename ONNX frontend from `onnx_experimental` to `onnx`
2021-09-30 12:17:36 +02:00
Sergey Shlyapnikov
f3c8f2bc49
[GPU] Add use OneDNN impls attribute (#7716) 2021-09-30 19:15:40 +09:00
Michał Karzyński
d0efd61aad
Add nGraph Python API versioning (#7539)
* Expose ngraph_version_string as ngraph.__version__

* Fix linking error on CentOS
2021-09-30 12:59:20 +03:00
cecilia peng
eee22b6253
Temporarily disable some paddle test case which sporadically fail during CI. (#7757)
Further investigation required. JIRA tracking.
2021-09-30 12:56:10 +03:00
Katarzyna Mitrus
0eeaf6b2e4
ROIAlign fix - Unify sample_value calculation between max/avg mode (#7710)
* Unify sample_value between max/avg mode

* Fix mkldnn roi_align impl

* Update test

* Revert missing assert
2021-09-30 11:50:06 +03:00
Mikhail Nosov
414c3dc133
[OV2.0] Preprocessing - resize (#7583)
* Initial version

* Added 'network' layout to preprocessing info
Moved existing resize tests to template plugin

* Fix clang

* More tests for 'resize' reference implementation + CPU tests + error cases
Coverage is 100%

* Align with new base_reference_test implementation

* Fixed comments

* Add assert to check that desired size is not out of bounds

* CPU: skip failed test
2021-09-30 11:41:25 +03:00
Sergey Shlyapnikov
c00b0b6ae4
[GPU] Profiling refactoring and fixes (#7714) 2021-09-30 10:54:27 +03:00
Roman Lyamin
17091476d8
[IE CLDNN] Add optional memory access type (#7686) 2021-09-30 10:32:07 +03:00
Mingyu Kim
fbed7e13a8
[GPU] debug_config bug fix of not accepting multiple strings (#7754)
It receives space-separated parameter. Currently, only first argument is
received in case of string argument.
2021-09-30 10:10:50 +03:00
Dmitrii Khurtin
a13b934622
[GNA] fixed failed to inserting transpose after matmul (#7720)
* fixed failed to inserting transpose after matmul

* added verifier for matmul
2021-09-30 09:55:34 +03:00
Sergey Shlyapnikov
ffd2091477
[GPU] Add new data formats (#7722) 2021-09-30 09:38:48 +03:00
Vladislav Volkov
4bf8d15793
Import/Export tests enabled for the CPU plugin (#7735) 2021-09-30 09:11:01 +03:00
Ilya Lavrenov
1f5355cd07
Enabled several CPU tests (#7724) 2021-09-29 20:51:23 +03:00
Gleb Kazantaev
62ed238f54
RT Info Attributes Serialization/Deserialization (#7603)
* Init rt info deserialization

* Add RT Info attributes deserialization

* Add RT Info attributes serialization

* Add Serialization and Deserialization tests

* Code style

* Fix AttributeAdapter place

* Extended rt_info section; added support for multi-field attrs; use version for attr serialization/deserialization

* Align attributes and their usage

* Fix LPT

* Add missing #pragma one

* Fix build

* Change version delimiter to have valid xml

* Fix PromitivesPriority

* Fix tests

* Fix test

* Fix IR Reader; remove empty rt_info

* More explicit attribute name and version representation
2021-09-29 19:17:03 +03:00
Vladislav Golubev
04158afc21
[LPT] Added check for uniqueness of friendly names in tests (#7570)
* FQDecomposition: added check on unique friendly names after transformation

* NormalizeL2Transformation: added check on unique friendly names after transformation

* ti to sequences conversion: naming fix

* [LPT][TESTS] Check on unique names added to functional tests

* compilation error fix

* compilation error fix
2021-09-29 18:40:21 +03:00
Eugeny Volosenkov
08897e4c80
Transformation convert_reduce_to_pooling fix (#7705)
* fix convert_reduce_to_pooling transformation

* Fix codestyle

* add/delete spaces

* Fix code style

* fix code style
2021-09-29 12:51:10 +03:00
Karol Trzciński
3187e32062
cmake: OneCoreUap: Use proper dot escape sequence in cmake regex (#7702)
See https://cmake.org/pipermail/cmake/2004-May/005136.html

Signed-off-by: Karol Trzcinski <karolx.trzcinski@intel.com>
2021-09-29 12:06:27 +03:00
Jade Cho
1e6fd56e01
[GPU] Merge kernel updates (#7699)
+ fix a bug due to bias type mismatching
  - convolution_gpu_bfyx_to_bfyx_f16

+ refactoring
  - depth_to_space_kernel_base
  - depth_to_space_kernel_ref

+ Adjusting LWS
  - eltwise_kernel_base
2021-09-29 17:10:53 +09:00
Mingyu Kim
ee93823b3a
[GPU] New debug config: dry_run (#7689)
Enabling dry_run will shorten runtime of any application by exiting just
after graph compilation.
2021-09-29 17:09:52 +09:00
Mikhail Nosov
4fd59f72ea
Use 'u8' element type in tests (#7704)
Use 'float32' output for 'compare with reference' tests to avoid IE precisions undesired conversions
Added GPU preprocessing tests skeleton
2021-09-29 09:46:37 +03:00
Ilya Lavrenov
bd09f70876
Fixed precisions conversion in new API with compile_model(filename) (#7711)
* Fixed precisions conversion in new API

* Added tests

* Fixed old IR cases

* Disable FP16
2021-09-29 07:00:13 +03:00
Ilya Churaev
d2878e4012
Code style for test util (#7723)
* Enabled code style for ngraph test util

* remove some methods

* Fixed backends code style
2021-09-29 06:31:37 +03:00
Ilya Lavrenov
d074eea063
Fixed regex for template tests skip (#7725) 2021-09-29 01:58:02 +03:00
Zhang Yi
a5250fd0fc
[Transformation]hswish_fusion with clamp mul (#7414)
* [Transformation]hswish_fusion with clamp

* add const for constant variable

* [Transformation]fix review comments

* [Transformation]fix opset version
2021-09-28 19:22:53 +03:00
Ilya Lavrenov
65dcffe913
Reference tests use OpenVINO 2.0 headers and namespaces (#7700)
* Reference tests via OpenVINO 2.0

* Migrated to new API acos test

* Fixed other tests compilation

* Fixed tests

* Reference tests use ov::

* Fixed compilation
2021-09-28 19:19:08 +03:00
Krzysztof Bruniecki
eee864aed6
[GNA] Fix KEY_EXEC_TARGET (cherry pick #7671) (#7701)
* Use Gna2DeviceCreateForExport when GNA_EXEC_TARGET is != detected

* Update detected GNA device version field in GNA Device helper

   * Use EXEC instead of COMPILE TARGET to append
   CNN Legacy enforcement (GNA1)

* Apply review
2021-09-28 18:39:49 +03:00
Ilya Lavrenov
068d31511b
Improved ov::Tensor behavior (#7683)
* Improved ov::Tensor behavior

* Fixed python test for setShape on preallocated

* Fixed clang-format
2021-09-28 12:50:51 +03:00
Sergey Shlyapnikov
6bd0873a40
[GPU] Add CL_QUEUE_INDEX property and queue configuration refactoring (#7633) 2021-09-28 11:37:09 +03:00
Dmitrii Khurtin
a3dfa980ad
[GNA] Improved accuracy on model after Accuracy Aware (#7576)
* improved accuracy on model after Accuracy Aware

* refactoring+test

* removed unnessary FakeQuantI8/I16

* added comments, moved fake_quantized from UpdateInputScaleFromNetwork(), removed _Np template param from QuantDescTmpl
2021-09-28 11:34:09 +03:00
Mingyu Kim
acc14c6469
[GPU] Onednn integration for reorder primitive (#7687) 2021-09-28 17:10:35 +09:00
Gleb Kazantaev
204c17cc21
Enable SoftmaxFusion inside MOC Transformations pipeline (#7684)
* Enable SoftmaxFusion inside MOC Transformations pipeline

* Disable SoftmaxDecomposition by default
2021-09-28 10:46:31 +03:00
Ilya Lavrenov
476fbee00f
Reference template plugin tests to OpenVINO 2.0 (#7685) 2021-09-28 10:46:03 +03:00
Alexander Zhogov
66bf54898c
Partial revert of "Add set_argument/s methods to nGraph Python API (#7196)" (#7657)
* Try to revert "Add set_argument/s methods to nGraph Python API (#7196)"

* Add native "CPU FuncTests"

* continueOnError: true

* Fix indent

* Add m_inputs.clear();

* Add set_argument(i++, output);

* Revert calling set_argument(i++, output);
Revert Windows Azure to prod
2021-09-27 19:51:28 +03:00
Roman Lyamin
6ecfbd47e3
[IE CLDNN] clDNNPlugin size fix (#7655) 2021-09-27 14:32:52 +03:00
Vladimir Gavrilov
1d3df63d64
Implement reference nGraph implementation for operation ExperimentalDetectronROIFeatureExtractor (#6484)
* Written reference implementation of the operation ExperimentalDetectronROIFeatureExtractor.

* Small fixes.

* Started to write tests for evaluation of the operation ExperimentalDetectronROIfeatureExtractor.

* Written test for evaluation of the nGraph operation ExperimentalDetectronROIFeatureExtractor.

* Some changes.

* Added debug prints to evaluates.map.

* Added more debug prints.

* Added another debug prints.

* Added more debug prints.

* Added more debug prints.

* Added more debug prints.

* Inserted additional static_casts.

* Added more static_casts.

* Commented some debug prints.

* Some reversion.

* Deleted some debug prints.

* Deleted some debug prints.

* Deleted more debug prints.

* Added some casts and debug prints.

* Some changes.

* Small changes.

* Some changes.

* Added png files.

* Small changes.

* Code style fixes.

* Code style fixes.

* Rewritten some auxiliary functions.

* Corrected the body of the function experimental_detectron_roi_feature_extractor().

* Some code style fixes.

* Code style fixes.

* Small code style fixes.

* Commented one debug print.

* Small changes.

* Added some debug print.

* Small changes.

* Added more debug prints.

* Small fixes.

* Added more debug prints.

* Commented some code.

* Indexing operation [] was replaced by .at() method in the function pre_calc_for_bilinear_interpolate().

* Deleted unneeded variables w1, w2, w3, w4.

* Deleted variable xx.

* Added GCC pragma before the function pre_calc_for_bilinear_interpolate().

* Fixes in macros.

* Fixed pragma before the function pre_calc_for_bilinear_interpolate().

* Deleted some debug prints.

* Deleted more debug prints and fixed some code style issues.

* Deleted redundant assert.

* Deleted redundant assert in the function split_points().

* Started to move tests for nGraph reference implementation of ExperimentalDetectronROIFeatureExtractor to template plugin.

* Enabled test INTERPRETER.onnx_model_experimental_detectron_roi_feature_extractor.

* Deleted backend tests for the reference nGraph implementation of the operation ExperimentalDetectronROIFeatureExtractor.

* Deleted commented code.

* Fixed typo.

* Some fixes.

* Some fixes.

* Some fixes.

* Some fixes.

* Some fixes.

* Renamed the function that calculates ROIAlign.

* Deleted redundant usings.

* Now input shapes are parameters of test.

* Small fix.

* Now element type is also test parameter.

* Deleted some commented code.

* Added test for float16 case.

* Small fix.

* Added test for bfloat16 case.

* Deleted redundant parameters of tests.

* Deleted commented code.

* Deleted redundant structure.

* Small fix.

* Some reverting.
2021-09-27 12:49:18 +03:00
Vladislav Golubev
7fa9bbf6fc
[LPT] Avoid using std::shared_ptr<Node> when creating a node (#7357)
* [LPT] Avoid using std::shared_ptr<Node> when creating a node

* [LPT] removed unused files

* [LPT] D2STransformation: transform & isPrecisionPreserved methods are moved to base class

* [LPT] Revert redundant changes
2021-09-27 11:50:17 +03:00
Irina Efode
818f385398
[IE TESTS] Add example for QueryNetwork in SLT (#7628)
* [IE TESTS] Add example for QueryNetwork in SLT

* Update mul_conv_fusion.cpp

* Skip

* skip[
2021-09-27 11:22:38 +03:00