Commit Graph

196 Commits

Author SHA1 Message Date
Steve Yoo
bd756df2f5 Migrate ngraph backend test of constant operation (#7996)
* Add test cases for PReLU in cpu plugin

* For case when slope is vector

* Add Constant template plugin reference tests

* Update CMakeLists.txt and delete constant.in.cpp

* Add tests of tensor_2constant and constant_multi_use

* Add test of constant_equality_bool

* Remove wrong comments

* Remove some of strange if

* Merge to one CreateFunction

* Remove test names and update test for types

* Add bf16 and f64 tests

* Add missing type tests

* Clear actualOutData to allow multiple use of Validate()

* Update SetUp and CreateFunction to support CentOS CI

* Remove inputData = {}
2021-11-03 07:52:59 +03:00
Wilson Seok
75c6af7af5 Migrate ngraph backend test/experimental detectron detection & experimental detectron generate proposals (#8264)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of experimental_detectron_detection_output and experimental_detecteion_generate_proposals and remove ngraph backend test

* modify visitor api test of experimental_detectron_detection for clang-format

* modify visitor api test of experimental_detectron_detection for clang-format again

* modify visitor api test of experimental_detectron_detection for clang-format again2
2021-11-02 10:48:15 +03:00
Wilson Seok
3775efd54a Migrate ngraph backend test/detection output (#8111)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of detection_output

* update op reference test and remove ngraph backend test

* make up the reference test data
2021-11-01 07:21:28 +03:00
Steve Yoo
ff713a5e01 Migrate Movement 1 Operations (Transpose-1) (#8135)
* Migrate Transpose-1

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:52:14 +03:00
Steve Yoo
05dfee0a70 Migrate Movement 1 Operations (VariadicSplit-1) (#8091)
* Migrate VariadicSplit

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:42:10 +03:00
Wilson Seok
f912a8102d Migrate ngraph backend test/psroi pooling/deformable psroi pooling/proposal (#8152)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of psroi_pooling and deformable_psrio_pooling

* update op reference test

* remove ngraph backend test

* add op reference test of proposalV1 and proposalV4

* update skip_test_config.cpp to avoid failure of accuracy drop in fp16/bf16 test case of proposal
2021-11-01 04:47:42 +03:00
David Nam
cc457e003e Migrate normalization to template plugin test (#8240)
* Migrate normalization to template plugin test

* Migrate result, parameter to template plugin test
2021-10-30 17:58:33 +03:00
David Nam
a429044038 Migrate signals to template plugin test (#8279)
* Migrate signals to template plugin test

* Use AutobroadcastType::NONE instead of AutobroadcastSpec::NONE

* Remove unused variable

* Fix cpplint error

* Remove unused variable
2021-10-29 13:01:42 +03:00
David Nam
b2b9d9f2c7 Migrate MatMul to template plugin test (#8253) 2021-10-29 13:00:30 +03:00
Steve Yoo
5c2ef7268b Migrate Movement 1 Operations (Reverse-1, Split-1) (#8079)
* Migrate Reverse-1 and Split-1

* Separate classes for each exception test case
2021-10-29 12:49:41 +03:00
Irina Efode
c9e7e60a84 [IE TESTS] LayerTestCommon2.0 (#7945)
* Init

* try adopt softmax

* fix size of expected

* Fix cpuFuncTests

* Add configure model

* Remove extra

* fix softmax

* Adopt eltwise

* Eltwise

* Remove old dynamism

* fix oss build

* Remove In,OutPrecision

* Remove incorrect OPENVINO_ASSERT, correct eltwise tests and fix threshold

* Apply Maxim's comments

* Fix build

* ieFuncTests

* return in, out, prc

* fix tests

* Fix tests

* Fixes according to new api

* skip gpu

* try to fix myriad

* Fix myriad

* cpu fix
2021-10-29 12:00:45 +03:00
Ilya Lavrenov
8fb699a42c Static compilation for inference plugins (#8197)
* 1. Removed explicit SHARED from libraries
2. Fixed double definition for ie_layer_validators

* Fixed SEG in unit-test: order of initialization for global vars

* Added an ability to find plugins.xml from static IE

* Fixes in unit-test

* Migrated to new macro for import / export

* Minimized number of custom dllexport

* Don't use IR v7 for static libraries

* Revert for merge

* Don't enable tests with dlopen for static libraries

* Code style

* Added condition for export

* Revert format_reader

* Removed forward decalaration with external linkage

* Fixed IE linkage on Windows

* Reverted back 2 flags

* Minimal RRTI for cpuFuncTests

* Minimal RRTI for cpuFuncTests

* Still need IR v7 reader

* Fixed build

* Fixed compilation

* clang-format fix

* Removed BUILD_AS_IS and used USE_STATIC_IE

* Enable IR v7 reader as static library

* Fixed compilation for GPU plugin

* Trying to build plugins as static library

* Plugins are able provide their own name for CreatePluginEngine function

* Fixed CPU

* Fixed comments

* Fixed ENABLE_IR_V7_READER usage

* Fixed VPU

* clang-format

* Fixes

* Fix

* Load multiple plugins at once

* Fixed interpreter undefined symbols

* Trying to dynamically register static plugins

* Reverted some ngraph changes

* Fixed cpuUnitTests compilation

* Fixed compilation

* Fixed myriad

* Fixed custom_opset tests

* Reverted linker flags

* Support both static and dynamic plugins

* Fixed compilation of myriadFuncTests

* Removed duplication

* Fixes after self-review

* Fixed linkage for preprocessing

* Fixes for Windows

* Fixes

* Fixed cmake options

* Fix

* Fix

* Fix 2
2021-10-28 11:33:56 +03:00
David Nam
d198d57fe1 Migrate pooling to template plugin test (#8136)
* Migrate pooling to template plugin test

* Fix clang format

* Fix clang style error

* Fix clang style error

* Remove unused variable

* Fix cpplint error

* Fix CI build error

* Remove max_pool.in.cpp
2021-10-28 09:45:12 +03:00
Steve Yoo
6f862822e1 Migrate Movement 1 Operations (ScatterNDUpsate-1) (#8116)
* Migrate ScatterNDUpsate-1

* Remove round.in.cpp
2021-10-28 08:42:50 +03:00
Mikhail Nosov
a2a8969201 [OV20] Enable OpenCV tests and support 'u8' type for Interpolate op (#8182)
* Interpolate reference implementation:
- Support u8 and other numeric types
- For integral types - round result to nearest integer (don't cast)
Preprocessing: enable OpenCV tests and add resize conformance tests with OpenCV

* Revert changes in interpolate.cpp, making them minimal needed (added u8 resize)
2021-10-27 20:56:43 +03:00
Mikhail Nosov
7ef4ff6385 Update only Reference implementation and tests (#8126)
There were discovered a lot of issues in 'CompareWithRefs' tests when generated float inputs are not rounded to 'int'
2021-10-27 12:29:37 +03:00
Mikhail Nosov
d65e7d4d4f [OV20] Preprocessing: convert_layout<std::vector<uint64_t>> implementation (#8213)
* Preprocessing: convert_layout<std::vector<uint64_t>> implementation

User is able to use this version without specifying layout explicitly

Same version of convert_layout is added for post-processing

Added usage of new convert_layout to ie_network_reader

* Fix review comment
2021-10-27 11:32:44 +03:00
David Nam
96af987c46 Migrate shape1,2 to template plugin test (#8200)
* Migrate shape1,2 to template plugin test

* Fix member variables order
2021-10-27 09:26:32 +03:00
David Nam
fb9c949b29 Migrate FakeQuantize-1 to template plugin test (#8115)
* Migrate FakeQuantize-1 to template plugin test

* Fix cpplint error
2021-10-26 19:10:25 +03:00
Anton Pankratv
c39e6fcfd8 added ov InferRequest behaviour tests (#7811) 2021-10-25 10:36:17 +03:00
Anton Pankratv
c6eaa5d653 Added syntetic hetero tests for dynamic shapes (#8050) 2021-10-23 01:20:49 +03:00
Mikhail Nosov
d39fe50470 [OV20] Preprocessing: reverse_channels and RGB<->BGR conversion (#8098)
* Initial draft

* Support of dynamic shapes
2021-10-21 11:22:43 +03:00
David Nam
e9777a6da0 Migrate range1,4 to template plugin test (#8023)
* Migrate range1,4 to template plugin test

* Fix cpplint issue

* Return NULL in default case in range test

* Fix cpplint error
2021-10-21 09:27:56 +03:00
David Nam
f80005f513 Migrate arithmetic2 to template plugin test (#8053) 2021-10-21 09:27:06 +03:00
Ilya Churaev
0f3c10c810 Infer request api (#7962)
* Introduce new API

* Fixed comments

* Fixed code style

* Introduce some new API

* Fixed code style

* Reverted names

* Exend OVExecNetwork tests

* Changed executable network API

* Fixed tests

* Fixed comments

* Fixed style

* More tests

* Applied changes

* Fixed windows build

* Fixed typo

* Fixed some tests

* Fixed code style

* Fixed pre-proc tests

* Fixed documentation comments

* Added more comments

* Fixed code style

* Remove friend

* Removed find tensor API from internal classes

* Avoid old API in new constructors

* Fixed CPU tests

* Fixed comments

* Fixed template tests

* Extended test cases

* Revert data creation

* Fixed GNA and GPU plugins

* Fixed comments

* Fixed GNA tests

* Try to fix tests for GPU

* Fixed GNA tests

* Fixed GNA

* Try to fix Myriad tests

* Removed check to see an exception message

* Fixed HETERO import

* Reverted mkl-dnn submodule

* Fixed clang-format

Co-authored-by: y <ilya.lavrenov@intel.com>
2021-10-20 22:08:55 +03:00
David Nam
eb7d7e4413 Migrate arithmetic1 to template plugin test (#8052)
* Migrate arithmetic1 to template plugin test

* Remove backend tests of arithmetic1
2021-10-20 19:16:51 +03:00
Mikhail Nosov
e976a221f5 [OV2.0 Preprocessing] NV12 ref implementation fixes + tests with legacy CNNNetwork (#7985)
* NV12 Ref impl: Align with Legacy NV12 conversion
Little-endian tricks are completely not needed finally

Basic tests of OV20 preprocessing vs Legacy preprocessing:
- Mean/Scale
- Resize (Linear vs Bilinear)
- NV12 color conversion

* Register Template plugin in legacy core before CNNNetwork compliance test
NV12: round to nearest integer for 'u8' mode
Fix preprocess-reference NV12 tests (swap U & V)

* Decreased default threshold and use random distribution for inputs generation

* Added tests RefImpl vs OpenCV - NV12 color conversion
Added CPU accuracy tests + nightly (including all RGB color combinations)

* Fix build issue after rebase

* Remove test code

* Fix comments
Disable OpenCV tests on CI (some machines can't load opencv_imgproc during test)
2021-10-20 13:39:46 +03:00
Wilson Seok
11ddd731b7 Migrate ngraph backend test/group convolution (#8089)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of group_convolution and group_convolution_backpropdata

* update reference test of group_convolution/group_convolution_backpropdata and remove their ngraph backend test
2021-10-20 11:20:11 +03:00
Wilson Seok
132ae33de0 Migrate ngraph backend test/deformable convolution (#8045)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add initial version of op reference test of deformable convolution

* update reference test

* update reference test 2

* update deformable_convolution referencet est

* add deformable_convolution_opset8 op reference test

* update skip_test_config.cpp

* remove backend test and add visitor api test

* merge test code of deformable_convolution v1 and v8 in a single file

* merge deformable_convolition_opset8 of visitor api test into single file
2021-10-20 11:19:19 +03:00
Xiping Yan
b7ccdf4490 Xp/fix jira 6671 atanh fail mac wins (#8058)
* tmp

* Fix atanh correctness test issue and veriyf pass.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Only keep available input value for correctness test.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
2021-10-19 14:33:49 +03:00
Anton Pankratv
3f8856862d Forbid typed data access and roi tensor creation for little bit types (#8007) 2021-10-19 04:53:33 +03:00
Steve Yoo
4c722e025b Migrate ngraph backend test of condition operations (#7907)
* Add test cases for PReLU in cpu plugin

* For case when slope is vector

* Add Bucketize and NonZero template plugin reference tests

* Apply supported types for NonZero

* Edit float_t and double_t to float and double

* Edit std::vector<bool> to std::vector<char>
2021-10-18 13:20:09 +03:00
Irina Efode
e8f2249d8e Fix master branch and resolve conflicted PRS (#8039) 2021-10-15 14:05:39 +03:00
Katarzyna Mitrus
96df1a14ce Slice-8 Reference implementation (#7749)
* Init template reference tests

* Move output shape calculation to separate function

* Add to evaluate_map (reuse old ref)

* Add negative step test

* Make slice evaluate template type independent

* Enable typed tests for reference

* Add more reference tests

* Revert old slice ref changes

* New Slice reference implementation POC

* N-dim generalization

* Code refactor

* Style alignment

* Add more checks

* Add more tests

* Add zero dims/empty output tests

* Simplify typed tests generation

* Slice op leftovers

* Add unsigned types reference tests
2021-10-15 12:41:39 +03:00
Eugeny Volosenkov
3e48008c3f Unroll If in ngraph (#7403)
* added unroll_if

* Fix interface function

* Fix code style

* add false test for unroll if

* add if transformation in subgraphs

* fix code style

* fix transformations

* delete internal transformations

* Fix comments

* fix to replace_node

* fix description fo transformation

* fix CompileNetwork

* fix comments

* fix comments

* add function get_ie_output_name(input);

* fix code style

* disable cpu test
2021-10-15 12:37:43 +03:00
Irina Efode
3f690314fa [IE TESTS] Behavior2.0 -> Plugin (#7579)
* Need to remove

* Preprocessing + InferRequest

* infer_request_callback

* tmp commit

* InferRequest

* tst

* tetet

* Fix template

* SetBlobType

* InferRequest Conformance

* Add prc

* Remove prc

* Fix paths

* commit

* Fixes for review

* Dynamic Batch

* fix

* fiz

* Try

* fkf

* Fix azure

* Centos

* skip

* conformance fix

* fix template

* Small fix

* small fix in print

* Fixes

* Behavior 2.0 -> ExecutableNetwork

* Export

* Skip configs

* Incorrect config

* Extend ExecNet

* add_out

* GnA+CPU

* fix template

* fix centos

* Init

* init

* Fix merge

* Separate OV_CORE_INTEGRATION

* vers

* plugin

* Remove test_plugin

* plugin

* test

* configuration

* config

* core_integration

* Small refactor

* Clean up exec net

* Config

* Clean&Up behavior tests

* Remove extra

* query network

* Version

* Add new tests

* merge

* fix win

* Fix some ci problems

* Refactor

* gpu

* myriad

* template

* gna

* Fix all plugin

* ov2.0 exec_nry

* openvino2.0

* build

* fix ci

* fix ci

* fix myriad

* Try to fix ci

* Try

* try

* Update windows.yml

* Update windows.yml

* Revert "Update windows.yml"

This reverts commit 93e326229c.

* ddd

* Update windows.yml

* Revert "Update windows.yml"

This reverts commit 5eb4bf875a.

* Revert "Update windows.yml"

This reverts commit 351ede4e1e.

* fix inference chaining

* Fix issues

* try to remove mkldnn from commit

* GPU

* Fix ov namespace

* fix ci

* try to fix kmb

* Try to fix

* Merge

* fix ci

* gna

* fix myriad

* merge

* Myriad

* myriad

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2021-10-15 11:47:50 +03:00
Wilson Seok
34fce43ab0 Migrate ngraph backend test/convolution backprop (#7997)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add draft reference of binary convolution

* build test

* fix build error

* add binary_convolution reference test and ngraph visitor api test

* remove ngraph backend test of binary_convolution

* add reference test and remove ngraph backend test of convolution_backprop

* add f64 case for convolution_backprop
2021-10-15 11:39:04 +03:00
Anton Pankratv
4cc53c97a1 Blob processing in HETERO forwarded to sub requests (#8012)
* Blob processing in HETERO forwarded to subrequests

* Added template dynamic hetero tests
2021-10-15 10:44:11 +03:00
Wilson Seok
a8f0109584 Migrate ngraph backend test/activations (#7973)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* create new PR from PR7849

* remove backend tests of activation operations
2021-10-14 09:38:30 +03:00
Ilya Churaev
82f8f19d11 Moved serialization pass to public (#7862)
* Moved serialization pass to public

* Fixed unit tests

* Fixed code style

* Fixed tests

* Fix link

* Fix kmb

* Fixed build

* Removed InferenceEngine::Core from ngraph tests

* Add missed models

* Restore IR weights

* Fixed code style
2021-10-13 11:17:53 +03:00
Ilya Churaev
c323775f2c Add input/output to ov ExecNetwork (#7650)
* Added template for new tests

* Fixed simple test

* Added output tests

* Removed get_result/get_parameter methods

* Fixed documentation

* Fixed functional tests

* Fixed caching tests

* Added new test for import

* Added new tests

* Fixed code style

* Fixed comments

* Fixed tests

* Fixed code style

* Save version in the function
Fixed pre-post processing

* Change IR version

* Fixed documentation

* Fixed MockICore

* HETERO almost works

* Fixed tests and core logic

* Disabled some CPU tests

* Tmp disable fp16 for template

* Fixed tests and clang-format

* Small fixes

* Fix

* Simplified code in templatePlugin

* Added IE precisions checks

* Simplified hetero plugin

* Added ieImportExportedFunction test

* Added MYRIAD test

* Skip tests directly in tests

* More correct filter for CPU

* Fixed CPU tests

* Template plugin tests

* Some comments

* FIxed clanf-format

* Removed myriad tests

* Fixed comment

* small changes

* Fixed condition

* Fixed unit tests

* clang-format

* Comment

* Hetero plugin update

* Fixed tests

* Moved re-create under ig

* Fixed clang-format

* Fixed some caching_tests

* Disable some caching_tests

* Fixed setLayout with dynamic case

* Fixed clang-format

* Disable execution graph

* Disabled one more CPU test

* Simplified regex

* Disabled GNA tests

Co-authored-by: y <ilya.lavrenov@intel.com>
2021-10-12 13:11:25 +03:00
Wilson Seok
d50ba1129b Migration convolution ngraph backend test (#7846)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add convolution reference test and ngraph backend test

* fix location of ngraph visitor convolution.cpp
2021-10-08 16:52:00 +03:00
Mikhail Nosov
2592856200 [OV2.0] Leftovers for Preprocessing/input/output (#7893)
* Pre-process:
- Implicit conversions for element type and layout
- 'convert_element_type' with default argument to network
- Convert_element_type - don't add ops if dst and src types are same
- Convert_layout - don't add ops if dst and src layouts are same
- Custom step - use Output<Node> instead of shared_ptr<Node>
- Support of addressing input by tensor name

Post-process:
- Avoid duplication of tensor names after post-processing

* Fixed IE tests
2021-10-08 12:58:29 +03:00
Eugeny Volosenkov
05cd830de5 Move eval tests to template tests (#7132)
* Add If implementation with reference

* fix test

* fix comments

* Fix validate_and_INFER_TYPES

* rewrite tests for dynamic cases

* Fix ci failed

* add comentaries for validate_and_infer_types

* fix api

* Added ngraph checks and delete copied op from opset8

* code style fix

* fix code style

* add checkers to reference

* add has_evaluate

* fix eval

* Fix code style

* fix code style

* Add template plugin tests

* fix code style

* delete boolean

* fix IfParams

* Fix comments

* intermediate commit

* delete eval test

* add common header

* Fix codestyle

* fix set_invariant_input/set_body_output

* fix code_style

* fix codestyle

* delete validate_and_infer_types from type prop tests

* delete comments
2021-10-07 18:40:57 +03:00
Bartek Szmelczynski
cfe18d289c Scatter update ref impl revision (#7476)
* add template tests for scatter_update

* rm CT from ref impl

* fix namings

* minor code refactor

* fix style

* change ref impl

* add lambda func

* new tests

* remove CT from reference implementation, add template tests

* fix cpu IE

* refactor template tests

* split template tests
2021-10-07 14:40:15 +03:00
Mikhail Nosov
e20cefb620 PrePostProcessor.output() - first implementation of post-processing (#7866)
* PrePostProcessor.output() - first implementation of post-processing
Supported convert_layout, convert_element_type and custom operations

* Fix review comments

* Added test for pre and post processing together
Fix clang-format

* Move 'validate_and_infer_types' before post-processing
2021-10-06 21:17:10 +03:00
Mikhail Nosov
f57dc05c66 [OV20] Convert NV12 to RGB operation + preprocessing (#7508)
* # Conflicts:
#	docs/template_plugin/tests/functional/op_reference/convert_color_nv12.cpp
#	inference-engine/tests/functional/plugin/cpu/shared_tests_instances/single_layer_tests/convert_color_nv12.cpp
#	inference-engine/tests/functional/shared_test_classes/include/shared_test_classes/single_layer/convert_color_nv12.hpp
#	inference-engine/tests/functional/shared_test_classes/src/single_layer/convert_color_nv12.cpp
#	ngraph/core/include/openvino/core/preprocess/input_tensor_info.hpp
#	ngraph/core/include/openvino/core/preprocess/preprocess_steps.hpp
#	ngraph/core/include/openvino/op/nv12_to_bgr.hpp
#	ngraph/core/include/openvino/op/nv12_to_rgb.hpp
#	ngraph/core/src/op/nv12_to_bgr.cpp
#	ngraph/core/src/op/nv12_to_rgb.cpp
#	ngraph/core/src/preprocess/pre_post_process.cpp
#	ngraph/core/src/preprocess/preprocess_steps_impl.hpp
#	ngraph/test/CMakeLists.txt

* Added more test to cover 100% of code
Allow convert element type for 'multi-plane' color format

* Inherit tensor names for 'convert_color'

* Clang

* Fix tests

* Disable 'int8' preprocessing resize test

* Fix review comments

* Add more restrictions and tests for planes sub-names

* 1) Added check for uniqueness of tensor names generated for nodes
Raise error if user's plane sub-name conflicts with some node in a function
2) Added exception safety to preprocess build. Before, when input #2 fail, only one preprocess will be applied to function and it will be corrupted
Exception guard will restore function to original state if exception occurs

* Fix clang-format
2021-10-06 15:22:05 +03:00
Ilya Churaev
3859990b1b Introduce IR v11 (#7787)
* Enabled support of IR v11 in IR frontend

* Enabled serialization to v11

* Added indexes for Inputs/Outputs

* Fixed typo

* Fixed code style

* Fixed deserialization tests

* FIxed typo

* Avoid changes in the original serialized function

* Fixed TI tests

* Removed version from the function and indexes from parameters/results

* Restore function version

* Clone function rt info

* Removed v11 version
2021-10-05 13:09:59 +03:00
Ilya Lavrenov
f762751968 Deprecated dynamism in old IE API (#7812) 2021-10-05 01:06:10 +03:00
Ilya Lavrenov
0bebd53b4a Inference chaining: static and dynamic cases (#7776)
* Fixed precisions conversion in new API

* Added tests

* Fixed old IR cases

* Disable FP16

* Fixed regex for CentoOS

* Refactored tests to use new API

* Temp

* Fixed tests

* Moved smart reshape related sources to ngraph

* Added tests for invalid names

* Moved reshape to tensor_names

* clang-format

* Fixed CC build

* Removed IEConv, IEDeconv from primitives pririty

* Added tests for Inference chaining

* Fixed dynamic chaining for template plugin

* Added test for 2 conflicting names for the single parameter

* Removed invalid test

* Added more tests for dynamism

* Fixed clang-format

* Fixed macosx compilation

* Some simplifications
2021-10-04 14:51:14 +03:00