Commit Graph
1403 Commits
Author SHA1 Message Date
Ilya Lavrenov 384eea4eda Static version: plugin registration as extension (#8365)
* Load CPU plugin as extension as well

* Fixed linkage issues

* Added static linux build

* Disabled GPU
2021-11-02 16:07:45 +03:00
Tomasz Jankowski de4ceba375 [ONNX FE] Add implementation of Frontend API methods for naming and annotation (#8026) 2021-11-02 09:35:04 +01:00
Wilson Seok 75c6af7af5 Migrate ngraph backend test/experimental detectron detection & experimental detectron generate proposals (#8264)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of experimental_detectron_detection_output and experimental_detecteion_generate_proposals and remove ngraph backend test

* modify visitor api test of experimental_detectron_detection for clang-format

* modify visitor api test of experimental_detectron_detection for clang-format again

* modify visitor api test of experimental_detectron_detection for clang-format again2
2021-11-02 10:48:15 +03:00
Mang GuoandEvgenya Stepyreva 0a850ce73e [Shape infer] Implement ExperimentalDetectronTopKROIs shape infer (#7926)
* Implement ExperimentalDetectronROIs shape infer

* Fix review comments

* Update for review comments

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2021-11-02 05:32:46 +03:00
Ilya Churaev 4122ef50d6 Introduce OV Extension base api (#7562)
* Moved so loader to utils

* Fixed extension tests

* Fixed tests and style

* Fixed style and tests

* Fixed ARM build

* Fix windows

* Fix ieFuncTests

* Wrap runtime exception

* Fixed tests

* Added separate new extension

* Fixed unicode extension loading

* Try to fix windows

* Fixed windows

* Fixed macro

* Fixed doc

* Fixed build

* Fixed comments

* Try to fix build

* Fixed build

* Fixed build

* Fixed shared_from_this

* Temp commit

* Changed extension

* Fixed merge conflicts

* Removed ngraph namespace from new extensions

* Fixed code style

* Added core add_extension methods and tests

* Added new tests

* Implement tile operation

* Enabled new extensions support

* Fixed build

* Fixed code style

* Try to fix windows

* Changed base extension class

* Removed redundant Ptr

* Fixed comments

* Fixed friend decl

* Fixed Windows export

* Fixed centos

* Added template add_extension method

* Move destructor to public

* Removed BaseExtension class

* Added variadic add_extension methods

* Fixed doc and typo

* Added BaseOpDestructor

* Allow to create new extension only for new operations

* Revert tests

* Fixed comments

* Fixed comments

* Fixed comment

* Added SO Extension wrapper
2021-11-01 10:36:30 +03:00
Ilya Churaev 94206b9e2d Removed redundant evaluate methods (#8283)
* Removed redundant evaluate methods

* Added If to eval map

* Disable unsupported test cases
2021-11-01 09:08:32 +03:00
Wilson Seok 3775efd54a Migrate ngraph backend test/detection output (#8111)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of detection_output

* update op reference test and remove ngraph backend test

* make up the reference test data
2021-11-01 07:21:28 +03:00
Steve Yoo ff713a5e01 Migrate Movement 1 Operations (Transpose-1) (#8135)
* Migrate Transpose-1

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:52:14 +03:00
Steve Yoo 05dfee0a70 Migrate Movement 1 Operations (VariadicSplit-1) (#8091)
* Migrate VariadicSplit

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:42:10 +03:00
Evgenya Stepyreva d50a40cd09 Shape inference (#8307)
* Convolution update

* Adds pragma once

* Reductions shape infer

* Shape nodes

* style
2021-11-01 05:39:57 +03:00
Wilson Seok f912a8102d Migrate ngraph backend test/psroi pooling/deformable psroi pooling/proposal (#8152)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of psroi_pooling and deformable_psrio_pooling

* update op reference test

* remove ngraph backend test

* add op reference test of proposalV1 and proposalV4

* update skip_test_config.cpp to avoid failure of accuracy drop in fp16/bf16 test case of proposal
2021-11-01 04:47:42 +03:00
David Nam cc457e003e Migrate normalization to template plugin test (#8240)
* Migrate normalization to template plugin test

* Migrate result, parameter to template plugin test
2021-10-30 17:58:33 +03:00
David Nam a429044038 Migrate signals to template plugin test (#8279)
* Migrate signals to template plugin test

* Use AutobroadcastType::NONE instead of AutobroadcastSpec::NONE

* Remove unused variable

* Fix cpplint error

* Remove unused variable
2021-10-29 13:01:42 +03:00
David Nam b2b9d9f2c7 Migrate MatMul to template plugin test (#8253) 2021-10-29 13:00:30 +03:00
Steve Yoo 5c2ef7268b Migrate Movement 1 Operations (Reverse-1, Split-1) (#8079)
* Migrate Reverse-1 and Split-1

* Separate classes for each exception test case
2021-10-29 12:49:41 +03:00
Piotr Szmelczynski c729a6bfca [PYTHON] Expose Layout class (#7578)
* Create binding for Layout class

* add import of Layout to __init__

* add Layout to pyngraph.cpp

* create test for Layout

* fix typo

* fix style

* clean file

* fix style

* add Layot import to ngrapph init

* remove const char* init

* style fix

* move Layout from pyngraph/ to pyopenvino/graph

* style fix

* add doc() and args to Layout

* add Layout to openvino init

* fix style

* change import name

* fix import

* add __str__ impl

* remove duplicate

* style fix

* update test_layout

* add eq and ne operators

* create test for eq and ne operators

* fix style

* update copyright year
2021-10-28 19:46:50 +03:00
Ilya Lavrenov 8fb699a42c Static compilation for inference plugins (#8197)
* 1. Removed explicit SHARED from libraries
2. Fixed double definition for ie_layer_validators

* Fixed SEG in unit-test: order of initialization for global vars

* Added an ability to find plugins.xml from static IE

* Fixes in unit-test

* Migrated to new macro for import / export

* Minimized number of custom dllexport

* Don't use IR v7 for static libraries

* Revert for merge

* Don't enable tests with dlopen for static libraries

* Code style

* Added condition for export

* Revert format_reader

* Removed forward decalaration with external linkage

* Fixed IE linkage on Windows

* Reverted back 2 flags

* Minimal RRTI for cpuFuncTests

* Minimal RRTI for cpuFuncTests

* Still need IR v7 reader

* Fixed build

* Fixed compilation

* clang-format fix

* Removed BUILD_AS_IS and used USE_STATIC_IE

* Enable IR v7 reader as static library

* Fixed compilation for GPU plugin

* Trying to build plugins as static library

* Plugins are able provide their own name for CreatePluginEngine function

* Fixed CPU

* Fixed comments

* Fixed ENABLE_IR_V7_READER usage

* Fixed VPU

* clang-format

* Fixes

* Fix

* Load multiple plugins at once

* Fixed interpreter undefined symbols

* Trying to dynamically register static plugins

* Reverted some ngraph changes

* Fixed cpuUnitTests compilation

* Fixed compilation

* Fixed myriad

* Fixed custom_opset tests

* Reverted linker flags

* Support both static and dynamic plugins

* Fixed compilation of myriadFuncTests

* Removed duplication

* Fixes after self-review

* Fixed linkage for preprocessing

* Fixes for Windows

* Fixes

* Fixed cmake options

* Fix

* Fix

* Fix 2
2021-10-28 11:33:56 +03:00
Mikhail Nosov 5cb2174721 Layout: add _idx suffix for helper getters (#8196)
'layout::width' -> 'layout::width_idx', etc
2021-10-28 11:26:55 +03:00
David Nam d198d57fe1 Migrate pooling to template plugin test (#8136)
* Migrate pooling to template plugin test

* Fix clang format

* Fix clang style error

* Fix clang style error

* Remove unused variable

* Fix cpplint error

* Fix CI build error

* Remove max_pool.in.cpp
2021-10-28 09:45:12 +03:00
Steve Yoo 6f862822e1 Migrate Movement 1 Operations (ScatterNDUpsate-1) (#8116)
* Migrate ScatterNDUpsate-1

* Remove round.in.cpp
2021-10-28 08:42:50 +03:00
Ilya Lavrenov fe457aa59c Wmissing declarations for core OpenVINO (#8242)
* Fixed common libraries

* Enable flags only for ngraph, FEM, plugins and IE

* Fixed OpenVINOConfig.cmake

* Fixes for plugins

* Fixed link stage
2021-10-27 22:45:16 +03:00
Mikhail Nosov 846d1e0467 [OV2.0+Bugfix] Layout serialization + Fix caching issues with auto-generated friendly names (#8153)
* Fix caching issues with auto-generated friendly names

Introduce "HashPass" to calculate hash like a serialize but without auto-generated friendly names
IE Compilation context: use HashPass to calculate hash of ov::Function
IE Compilation context tests: removed "friendly names" from tests
Layout: serialization support + tests
Parameter/Result: update set/get_layout according to layout changes

* Fix clang

* Tiny correction of CmakeLists

* Renamed VariantWrapper<Layout> to LayoutAttribute
Removed test for conversion from/to fully dynamic layout (allowed now and does nothing)
'set_layout' - remove layout runtime info if empty layout is passed. This allows hashes to be the same if set_layout(param->get_layout()) is called

* Fix build

* change size_t to uint64_t for hash value
Using size_t leads to high probability of conflict for 32-bit platforms

* Removed debug print

* Fix hash calculation for 32-bit platforms

* Fix review comment
2021-10-27 21:05:06 +03:00
Mikhail Nosov a2a8969201 [OV20] Enable OpenCV tests and support 'u8' type for Interpolate op (#8182)
* Interpolate reference implementation:
- Support u8 and other numeric types
- For integral types - round result to nearest integer (don't cast)
Preprocessing: enable OpenCV tests and add resize conformance tests with OpenCV

* Revert changes in interpolate.cpp, making them minimal needed (added u8 resize)
2021-10-27 20:56:43 +03:00
Mikhail NosovandAlexander Zhogov 0880a7d4af PDPD: Revert 'Four Jobs' pool usage (#7912)
* Put JOB_POOL after comments

* Revert "Put JOB_POOL after comments"

This reverts commit a8fc4c64e5.

* Revert "Use jobs pool for PDPD model conversion as well (#7602)"

This reverts commit 1390440256.

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2021-10-27 16:06:04 +03:00
Ilya Lavrenov e481758f73 Removed some global variables from ngraph (#8229) 2021-10-27 15:47:48 +03:00
Mikhail Nosov 7ef4ff6385 Update only Reference implementation and tests (#8126)
There were discovered a lot of issues in 'CompareWithRefs' tests when generated float inputs are not rounded to 'int'
2021-10-27 12:29:37 +03:00
Mikhail Nosov d65e7d4d4f [OV20] Preprocessing: convert_layout<std::vector<uint64_t>> implementation (#8213)
* Preprocessing: convert_layout<std::vector<uint64_t>> implementation

User is able to use this version without specifying layout explicitly

Same version of convert_layout is added for post-processing

Added usage of new convert_layout to ie_network_reader

* Fix review comment
2021-10-27 11:32:44 +03:00
Ilya Churaev 6717868bbf Remove blob symbols from Inference Engine library (#8212) 2021-10-27 11:08:37 +03:00
David Nam 96af987c46 Migrate shape1,2 to template plugin test (#8200)
* Migrate shape1,2 to template plugin test

* Fix member variables order
2021-10-27 09:26:32 +03:00
Mang Guo 3ce0f2573a [pdpd] Specify SEQ_LEN for each batch (#8057)
* Specify SEQ_LEN for each batch

* Generate different seq_len for each batch

* Remove print
2021-10-27 09:00:13 +03:00
David Nam fb9c949b29 Migrate FakeQuantize-1 to template plugin test (#8115)
* Migrate FakeQuantize-1 to template plugin test

* Fix cpplint error
2021-10-26 19:10:25 +03:00
Vladislav Golubev 4a96d14adc [nGraph] Reshape: upper_bound propagation fix (#8177) 2021-10-26 14:22:29 +03:00
Bartek Szmelczynski bd2fdca9de remove CT from ref impl (#7959) 2021-10-26 13:54:47 +03:00
cecilia peng 1858fa3853 [frontend][paddle] It is possible that get_output_partial_shape returns dynamic shape. Then we cannot simply check if it is 1. In case of BERT which input shape is dynamic, this check will absolutely fail. (#8030) 2021-10-25 15:36:13 +03:00
Anton Pankratv c39e6fcfd8 added ov InferRequest behaviour tests (#7811) 2021-10-25 10:36:17 +03:00
Ilya Lavrenov 479081ff32 Minimized a number of static variables in static build (#8131)
* Minimal RRTI for cpuFuncTests

* Fixed build

* Fixed compilation

* clang-format fix

* Fixed compilation for GPU plugin

* Fixed CPU

* Fixed comments

* Fixes

* Fix

* Reverted some ngraph changes

* Fixed cpuUnitTests compilation
2021-10-25 10:23:04 +03:00
Ilya Churaev 838bd20065 Removed autogeneration of tensor names, added new reshape API (#8134)
* Removed autogeneration of tensor names, added new reshape API

* Fixed code style

* Fixed tests

* Fixed tests

* Fixed comments
2021-10-25 07:34:24 +03:00
Ilya LavrenovandMichael Nosov eb7f261d15 Several samples moved to OpenVINO 2.0 (#7970)
* ngraph functio sample

* Fixes

* OV2.0: NV12 hello classification with new preprocessing API

* Fix clang-format

* Rewrote several samples

* Some updates

* clang-format

* Fixed TODO

* Fixed comments and improved samples

* Preprocessing comments

* clang-format

* Fixed comment

* Fixed Windows

* Added back Blob support to ClassificationResult

Co-authored-by: Michael Nosov <mikhail.nosov@intel.com>
2021-10-23 22:47:35 +03:00
Roman Kazantsev 8b3a7cfc8e Hide extra header files of TF Frontend into src (#8086)
* Move extra TF Frontend headers to src

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Load a model by GraphIterator

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Avoid use of InputModelTF in FrontEndTF API and correct a comment

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code style

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-10-23 01:17:06 +03:00
Ivan Tikhonov a7dff0d0ec [TF FE] Enable unit tests in precommits (#8132)
* Enable unit tests in azure

* fix build

* check w/o installing to the package

* return to the package

* remove from the package again and set path to bin for tf unit tests

* Azure CI: set lib path for tf tests

* Azure CI: set correct path for tf tests on Win

* Azure CI: fix test start directory

* fix cmake file

* resolve review comments

* fix destination paths, fix comments
2021-10-22 18:56:53 +03:00
Ilya Lavrenov dfefb92164 Made ov::runtime::Tensor strides to be in bytes (#8078) 2021-10-21 22:35:58 +03:00
song, bell ff14899a96 revise GRU cell/sequence (#7901)
* add typepro/vistor tests

Signed-off-by: fishbell <bell.song@intel.com>

* remove redundant test file

Signed-off-by: fishbell <bell.song@intel.com>

* fix clang format

Signed-off-by: fishbell <bell.song@intel.com>

* typo

Signed-off-by: fishbell <bell.song@intel.com>

* update doc

Signed-off-by: fishbell <bell.song@intel.com>
2021-10-21 11:26:53 +03:00
Mikhail Nosov d39fe50470 [OV20] Preprocessing: reverse_channels and RGB<->BGR conversion (#8098)
* Initial draft

* Support of dynamic shapes
2021-10-21 11:22:43 +03:00
Ilya Lavrenov 1b1e0e7553 preparation for static compilation (#8099)
* 1. Removed explicit SHARED from libraries
2. Fixed double definition for ie_layer_validators

* Fixed SEG in unit-test: order of initialization for global vars

* Added an ability to find plugins.xml from static IE

* Fixes in unit-test

* Migrated to new macro for import / export

* Minimized number of custom dllexport

* Don't use IR v7 for static libraries

* Revert for merge

* Don't enable tests with dlopen for static libraries

* Code style

* Added condition for export

* Revert format_reader

* Removed forward decalaration with external linkage

* Fixed IE linkage on Windows

* Reverted back 2 flags
2021-10-21 10:56:06 +03:00
Gleb Kazantaev f8439eeed8 Update Transformations tests to check tensor and node names (#8100)
* Check tensor names in pass tests

* Update Transformations tests to check tensor and node names

* Check input node names; default TENSOR_NAMES comparison; fix transformations to keep node names
2021-10-21 10:41:37 +03:00
Dawid Kożykowski 64340ec2fc [ONNX] ConvInteger (#8042) 2021-10-21 08:58:20 +02:00
David Nam e9777a6da0 Migrate range1,4 to template plugin test (#8023)
* Migrate range1,4 to template plugin test

* Fix cpplint issue

* Return NULL in default case in range test

* Fix cpplint error
2021-10-21 09:27:56 +03:00
David Nam f80005f513 Migrate arithmetic2 to template plugin test (#8053) 2021-10-21 09:27:06 +03:00
Luwei Zhou c2512f8dc5 [shape_infer]Implement ExperimentalDetectronDetectionOutput shape infer. (#7903)
* Implement ExperimentalDetectronDetectionOutput shape infer.

Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>

* Update on the review comments.

* Update based on review
2021-10-21 09:15:16 +03:00
Ilya Churaevandy 0f3c10c810 Infer request api (#7962)
* Introduce new API

* Fixed comments

* Fixed code style

* Introduce some new API

* Fixed code style

* Reverted names

* Exend OVExecNetwork tests

* Changed executable network API

* Fixed tests

* Fixed comments

* Fixed style

* More tests

* Applied changes

* Fixed windows build

* Fixed typo

* Fixed some tests

* Fixed code style

* Fixed pre-proc tests

* Fixed documentation comments

* Added more comments

* Fixed code style

* Remove friend

* Removed find tensor API from internal classes

* Avoid old API in new constructors

* Fixed CPU tests

* Fixed comments

* Fixed template tests

* Extended test cases

* Revert data creation

* Fixed GNA and GPU plugins

* Fixed comments

* Fixed GNA tests

* Try to fix tests for GPU

* Fixed GNA tests

* Fixed GNA

* Try to fix Myriad tests

* Removed check to see an exception message

* Fixed HETERO import

* Reverted mkl-dnn submodule

* Fixed clang-format

Co-authored-by: y <ilya.lavrenov@intel.com>
2021-10-20 22:08:55 +03:00