Commit Graph

733 Commits

Author SHA1 Message Date
Taylor Yeonbok Lee
abbf0384ae [GPU] Add GetMaxBatchSize functionality (#8226) 2021-11-24 09:30:14 +03:00
Steve Yoo
808323afa8 Migrate Movement 1 (Broadcast-1, Concat-1, Tile-1) (#8388)
* Migrate Movement 1 (Broadcast-1, Concat-1, Tile-1)

* Add Broadcast-3

* Update to namespace opset

* Add broadcast_test_helper
2021-11-24 05:20:41 +03:00
Vitaliy Urusovskij
5198c4644c Convert pad_val to Parameter in ReferencePadTestNonConst... test (#8760) 2021-11-23 16:32:50 +03:00
Mikhail Nosov
c29569ecbd [TemplateFuncTests] RGBX->RGB: Increase image size to avoid test failures on some platforms (#8762)
* Increase image size to avoid test failures on some platforms

There is an assert 'length >= nlanes' and 'nlanes' value depends on machine architecture
Set 320x320 test image to guarantee that image size >= nlanes

Also increased image size for 'plugin shared tests' to ensure the same (even though tests do not work with legacy preprocessing)

* Descreased to 160x160
2021-11-23 15:26:22 +03:00
song, bell
f06aa9955b revise RNN spec (#8081)
* revise RNN spec

Signed-off-by: fishbell <bell.song@intel.com>

* formatting the formula

Signed-off-by: fishbell <bell.song@intel.com>

* Update docs/ops/sequence/RNNSequence_5.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2021-11-23 12:12:37 +03:00
Steve Yoo
d248bdc91a Migrate Sort (TopK-1) (#8423)
* Migrate Sort (TopK-1)

* Add topk_mode_sort_order

* Skip topk_min_sort_none in Windows

* Add types to tests

* Skip topk_max_sort_none and topk_min_sort_none

* Modify names from 1d to 1dMaxMin and SetUp1 to SetUpSecond

* Add outIdx to run tests one by one

* Set default value 0 to outIdx

* Remove copy_data
2021-11-23 10:29:55 +03:00
Mikhail Nosov
7545af07d0 Preprocessing: convert color RGBX/BGRX -> RGB/BGR implementation (#8755) 2021-11-23 10:29:00 +03:00
Vitaliy Urusovskij
3b88682159 Support NonConst pads_begin and pads_end in Pad op (#8697)
* Support pads_begin & pads_end as dynamic ops in Pad

* Extend Pad template test w/ NonConst PB & PE cases

* Remove xfails for 69443 after issue was fixed
2021-11-23 09:27:37 +03:00
Mikhail Nosov
e34a66d828 Typo fix in I420toRGB specification example (#8705) 2021-11-19 10:47:19 +00:00
Evgeny Talanin
2777820882 Skip Exp test (#8692)
* Skip Exp test

* Fix regexp

* One more attempt...

* Update exp.cpp
2021-11-19 11:08:39 +03:00
Mikhail Nosov
aaac5de2fa [OV2.0] I420 preprocessing color format support (#8680)
* Add I420 preprocessing

Tests:
- Template reference
- OpenCV
- Legacy Preprocessing tests
- Functional shared tests for plugins (CPU)
- Disable i420 preprocessing tests on GPU

* clang-format fix
2021-11-18 23:30:44 +03:00
Andrey Zaytsev
6f1a3acf3c Feature/azaytsev/doc int8 image fix (#8684)
* Added info on DockerHub CI Framework

* Feature/azaytsev/change layout (#3295)

* Changes according to feedback comments

* Replaced @ref's with html links

* Fixed links, added a title page for installing from repos and images, fixed formatting issues

* Added links

* minor fix

* Added DL Streamer to the list of components installed by default

* Link fixes

* Link fixes

* ovms doc fix (#2988)

* added OpenVINO Model Server

* ovms doc fixes

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>

* Updated openvino_docs.xml

* Updated the link to software license agreements

* Revert "Updated the link to software license agreements"

This reverts commit 706dac500e.

* Fixed diagram

Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
2021-11-18 21:37:51 +03:00
Irina Efode
3efd842dd9 [IE TESTS] Skip sporadic failures for ref test (#8685) 2021-11-18 18:52:46 +03:00
Ilya Lavrenov
90e10e369d Configurable G-API preprocessing in static build (#8631)
* Added cmake option todisable G-API preprocessing

* Enabled PDPD, TF on Windows

* Revert "Enabled PDPD, TF on Windows"

This reverts commit 2851cba056.
2021-11-18 16:40:53 +03:00
Andrew Kwangwoong Park
9972410aa3 [GPU] Add IE Core GPU plugin metric to query overall memory statistics for GPU device (#8421) 2021-11-18 14:26:53 +03:00
Ilya Churaev
f639e4e902 Moved inference_engine samples to cpp folder (#8615)
* Moved inference_engine samples to cpp folder

* Fixed documentations links

* Fixed installation

* Fixed scripts

* Fixed cmake script

* Try to fix install

* Fixed samples

* Some fix
2021-11-18 10:08:20 +03:00
Mikhail Nosov
03c8542357 [I420 color conversion] I420toRGB/I420toBGR reference implementation (#8605)
* ngraph part

* Template reference tests
Common plugin tests
CPU compliance tests
Serialization tests

* Clang format fixes

* Remove reference implementation for f16, bf16, f64 types

* Fix ninja build

* Fix opset8_dump test

* Fix opset8_dump test

* Fix CentOS build

* Removed Myriad preprocessing tests (to be added by separate PR)
2021-11-18 09:48:18 +03:00
Mikhail Nosov
2245ea8be2 [FrontEnd] Rename all frontends from "*_ngraph_frontend*" to "_ov_frontend*" (#8645)
* Renaming all frontends from "*_ngraph_frontend*" to "_ov_frontend*"

Also Debug builds on Windows release frontends without "d" suffix will not be loaded

* Fix review comments and add wheels test debug prints

* More debug prints

* Load by absolute path and remove debug prints
2021-11-18 09:26:13 +03:00
Mikhail Nosov
c81e1aef05 [OV20] I420toRGB and I420toBGR operations specification (#8292) 2021-11-17 16:06:27 +03:00
Roman Kazantsev
8e327bd2ff [MO, TF] Support Custom Wide and Deep CTR model by MO (#8505)
* [MO, TF] Support Custom Wide and Deep CTR model by MO

It implements implicit support of EmbeddingSegmentsMean operation through decomposition.
Also, this extends the current transformation to fuse TensorFlow sub-graph (for Wide and Deep model family)
containing SparseSegmentSum and SparseSegmentMean operations into EmbeddingSegmentsSum or EmbeddingSegmentsMean.

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix unit-tests after modifications of SparseToDense and EmbeddingSegmentsOperationFusing

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Document SparseSegmentMean support

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add computation scheme for normalization coeffs and correct documentation

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-11-17 11:44:04 +03:00
Mikhail Nosov
c2d09afab9 PreProcess API change: (#8629)
- PrePostProcessor takes 'function' argument in constructor
- PrePostProcessor::build() doesn't take any function anymore
- PrePostProcessor::input() method to get reference to input
- PrePostProcessor::output() method to get reference to output
- InputInfo - add getters of tensor, preprocess, network
- OutputInfo - add getters of tensor, preprocess, network

Samples:
ClassificationSampleAsync - use new getters

Inference engine:
- Use new getters in ie_network_reader.cpp

TODO: Consider removal of builder-like API in PrePostProcessor, InputInfo, OutputInfo
2021-11-17 00:51:19 +03:00
Anton Chetverikov
4a8554a76d Add links to missed ops in opset_8.md file (#8620) 2021-11-16 15:23:14 +03:00
Anton Chetverikov
d0f16d205a GatherND_8 reference implementation (#8257)
* Add GatherND_8 operation

* Update shape infer function and tests

* Initial commit for nGraph GatherND_8 operation

* Add GatherNDBase class implementation

* Fix base class errors

* Add missrd header

* Update base class

* Update GatherND_8 implementation

* Fix codestyle

* Fix wrong rank

* Implement tests for gatherND_8 shape inference function

* fix codestyle

* Add limitation to doc

* Siplyfy check in shape inference

* Add more test cases

* Update shape inference function

* Add more test cases to cover all case with dynamic input shapes

* Update shape inference function

* Refactor tests

* Initial commit for gatherND_8 reference implementation

* Add visitor tests for gatherND_8 operation

* Add visitor tests for gatherND_8 operation

* Correct comment

* Add additional check is shape inference function

* Update shape inference implementation for gathernd operartion

* Fix codestyle

* Remove restriction for data is fully defined

* Update shape inference functon

* Add gatherND_8 reference to evaluate map

* Add tests for gathernd_8 reference in batch_dims > 1

* Fix codestyle

* Fix codestyle

* Fix missed check for nonetype

* Remove redundant checks for batch_dims

* Use get_shape method instead of get_input_shape in GatherND reference implementation call

* update reference implementation call

* Properly add GatherND_8 to test opset table

* Update GatherND reference implementation for support opset8 version

* Add unit tests for gatherND_8 reference implementation

* Update gatherND reference implementation call in evaluate map

* Mark failed tests for missed plugin gatherND_8 implementations

* Fix codestyle

* Fix codestyle

* Fix codestyle

* Update tests

* Move common methods to base class

* Fix codestyle

* Revert clone_with_new_input function moving

* Add more test for reference

* partially revert API changes
2021-11-16 10:58:06 +03:00
Steve Yoo
90094e8a8a Migrate Sequence (CTCGreedyDecoder-1, CTCGreedyDecoderSeqLen-6, GRUCell-3, LSTMCell-4, OneHot-1, RNNCell-1) and Sort (ExperimentalDetectronTopKROIs-6) (#8314) 2021-11-16 08:46:21 +03:00
song, bell
9ccc308523 Bell/revise lstm cell sequence (#7638)
* revise LSTM spec

Signed-off-by: fishbell <bell.song@intel.com>

* add param check and related test case

Signed-off-by: fishbell <bell.song@intel.com>

* fix clang-format

Signed-off-by: fishbell <bell.song@intel.com>

* use static_cast to replace c style force conversion

Signed-off-by: fishbell <bell.song@intel.com>
2021-11-16 06:13:26 +03:00
Steve Yoo
f66d9216ef Migrate Movement 2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleCha… (#8158)
* Migrate Movement2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleChannels-1, SpaceToBatch-2, SpaceToDepth-1)

* Fix typos while copying

* Update to opset namespace and add i4, u4, bf16 tests when available

* Remove i4, u4 tests from BatchToSpace and Roll
2021-11-16 03:32:29 +03:00
Alexandra Sidorova
5352c2b370 commented test (#8596) 2021-11-15 17:01:02 +03:00
Xiping Yan
3354275da1 Xp/revise embedding bag (#7694)
* Fix: variable writing error.
mas_dimension -> max_dimension

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Update description.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Update EmbeddingBagOffsetsSum comment, it will be easy to understand how to calculate bag.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add attribute description for md

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* WIP: Add correctness test.

Known issue:
1: weight fp16 issue.
2: default idx(1), don't choose in segment id. why?

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* change param order.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Support test T_IND type (int32 and int64)

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* weight support multiple type input.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* refactor correctness test code.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* embeddingbag offset sum correctness test pass.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* embeddingbag packed sum correctness test pass.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add visitor without attribute test.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add EmbeddingSegmentsSum serialization test.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add EmbeddingBagPackedSum, EmbeddingBagOffsetsSum serialization test.


Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix build error after rebase.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* unify name: from ngraph:: to ov::

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* add fp64 support

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove my MACRO define wrappers.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove useless header file.

* tmp. pass.

* Remove MACRO warpper for embeddingbag_offsetsum

* Remove myown wrapper header, and update template plugin.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Change vector to ov::Shape.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Rename CreateConstantVV-> CreateConstant

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix rebase issue. duplicate case ov::element::f64:

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
2021-11-15 13:49:21 +03:00
Steve Yoo
b320061ea3 Migrate Movement 1 (Gather-1, Gather-7, Pad-1) (#8414) 2021-11-15 04:31:59 +03:00
Steve Yoo
7a7ea100ec Migrate Movement 1 Operations (StridedSlice-1) (#8221)
* Migrate StridedSlice-1

* Update generate function to literals for bf16 and f16

* Add shapes to tensors
2021-11-12 12:19:19 +03:00
Ilya Lavrenov
e57a455b92 Added support of external modules in static build (#8518)
* Added support of external modules in static build

* Enable template plugin static run; disabled CPU tests run in dynamic build

* Make FEM library dynamic

* Fixed static build

* clang-format

* Fixed targets

* Python tests fix

* Fixed python API tests skip

* Fixed pattern

* Fixed pattern 2

* Don't run template plugin tests in static build
2021-11-12 08:56:57 +03:00
Ilya Lavrenov
461f746430 Install rules for static libraries case (#8384)
* Proper cmake install for static libraries case

* Added an ability to skip template plugin

* Added install rules for VPU / GPU

* Install more libraries

* Fixed absolute TBB include paths

* Disable GNA

* Fixed issue with linker

* Some fixes

* Fixed linkage issues in tests

* Disabled some tests

* Updated CI pipelines

* Fixed Windows linkage

* Fixed custom_opset test for static casr

* Fixed CVS-70313

* Continue on error

* Fixed clanf-format

* Try to fix Windows linker

* Fixed compilation

* Disable samples

* Fixed samples build with THREADING=SEQ

* Fixed link error on Windows

* Fixed ieFuncTests

* Added static Azure CI

* Revert "Fixed link error on Windows"

This reverts commit 78cca36fd2.

* Merge static and dynamic linux pipelines

* Fixed Azure
2021-11-10 18:25:51 +03:00
Ilya Churaev
54c384db11 Updated common migration pipeline (#8176)
* Updated common migration pipeline

* Fixed merge issue

* Added new model and extended example

* Fixed typo

* Added v10-v11 comparison
2021-11-10 16:27:23 +03:00
Wilson Seok
35ba404bcb Migrate ngraph backend test/prior box (#8227)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of prior_box/prior_box_clustered/reorg_yolo and remove ngraph backend test

* remove related backend test file
2021-11-10 15:28:41 +03:00
Anton Chetverikov
c8e1c8e3eb [MO|nGraph]GatherND_8 (#7743)
* Add GatherND_8 operation

* Update shape infer function and tests

* Initial commit for nGraph GatherND_8 operation

* Add GatherNDBase class implementation

* Fix base class errors

* Add missrd header

* Update base class

* Update GatherND_8 implementation

* Fix codestyle

* Fix wrong rank

* Implement tests for gatherND_8 shape inference function

* fix codestyle

* Add limitation to doc

* Siplyfy check in shape inference

* Add more test cases

* Update shape inference function

* Add more test cases to cover all case with dynamic input shapes

* Update shape inference function

* Refactor tests

* Add visitor tests for gatherND_8 operation

* Correct comment

* Add additional check is shape inference function

* Update shape inference implementation for gathernd operartion

* Fix codestyle

* Remove restriction for data is fully defined

* Update shape inference functon

* Fix missed check for nonetype

* Remove redundant checks for batch_dims

* Fix codestyle
2021-11-10 11:54:52 +03:00
Paul Youngsoo Ahn
d544787254 [GPU] Fix default value of KEY_GPU_MODEL_PRIORITY (#8398) 2021-11-04 12:49:00 +03:00
Ilya Lavrenov
e14ead8dd3 Don't use global objects during CPU plugin nodes registration (#8367)
* Load CPU plugin as extension as well

* Fixed linkage issues

* Added static linux build

* Disabled GPU

* Fix for CPU nodes registration

* Disabled GPU

* Disabled GPU

* Disabled GPU

* Disabled GPU

* Disabled HETERO synthetic tests in static case

* Fixed dependencies

* Proper fix
2021-11-04 12:39:28 +03:00
Mateusz Tabaka
3fc210af21 Reimplement Extension.OnnxModelWith* cases w/o model in source code (#8112)
Ticket: 62567
2021-11-03 14:43:44 +03:00
Paul Youngsoo Ahn
ece45630f0 [GPU] Set affinity TBB using CPUStreamsExecutor (#7738) (#7738) 2021-11-03 11:50:55 +03:00
Steve Yoo
e3f1813e5c Migrate Movement 2 (GatherElements-6, GatherND-5) (#8282) 2021-11-03 08:02:19 +03:00
Steve Yoo
bd756df2f5 Migrate ngraph backend test of constant operation (#7996)
* Add test cases for PReLU in cpu plugin

* For case when slope is vector

* Add Constant template plugin reference tests

* Update CMakeLists.txt and delete constant.in.cpp

* Add tests of tensor_2constant and constant_multi_use

* Add test of constant_equality_bool

* Remove wrong comments

* Remove some of strange if

* Merge to one CreateFunction

* Remove test names and update test for types

* Add bf16 and f64 tests

* Add missing type tests

* Clear actualOutData to allow multiple use of Validate()

* Update SetUp and CreateFunction to support CentOS CI

* Remove inputData = {}
2021-11-03 07:52:59 +03:00
Vladislav Volkov
680e53a005 [Doc] Optimization guide update (#8359)
* [Doc] Optimization guide update

* brushing the freq locking section a bit

Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
2021-11-02 14:35:21 +03:00
Wilson Seok
75c6af7af5 Migrate ngraph backend test/experimental detectron detection & experimental detectron generate proposals (#8264)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of experimental_detectron_detection_output and experimental_detecteion_generate_proposals and remove ngraph backend test

* modify visitor api test of experimental_detectron_detection for clang-format

* modify visitor api test of experimental_detectron_detection for clang-format again

* modify visitor api test of experimental_detectron_detection for clang-format again2
2021-11-02 10:48:15 +03:00
Anton Chetverikov
bfa7d41038 Fix incorrect example in GatherND_8 specification (#8308)
* Fix incorrect example

* Added varsion=8 to examples
2021-11-01 14:39:01 +03:00
Anastasia Kuporosova
3251e0cbc3 [Samples] Move C samples to the new samples directory (#8021)
* [Samples] Move C samples to the new samples directory

* fix samples

* [Samples] Move C samples to the new samples directory

* fix samples

* code reivew inspired fixes

* rename folder to lower case

* move ENABLE_SAMPLES cond level up, fix readmes

* fix ref in doc

* fix install path

* fix install of samples to tests

Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
2021-11-01 12:59:09 +03:00
Ilya Churaev
4122ef50d6 Introduce OV Extension base api (#7562)
* Moved so loader to utils

* Fixed extension tests

* Fixed tests and style

* Fixed style and tests

* Fixed ARM build

* Fix windows

* Fix ieFuncTests

* Wrap runtime exception

* Fixed tests

* Added separate new extension

* Fixed unicode extension loading

* Try to fix windows

* Fixed windows

* Fixed macro

* Fixed doc

* Fixed build

* Fixed comments

* Try to fix build

* Fixed build

* Fixed build

* Fixed shared_from_this

* Temp commit

* Changed extension

* Fixed merge conflicts

* Removed ngraph namespace from new extensions

* Fixed code style

* Added core add_extension methods and tests

* Added new tests

* Implement tile operation

* Enabled new extensions support

* Fixed build

* Fixed code style

* Try to fix windows

* Changed base extension class

* Removed redundant Ptr

* Fixed comments

* Fixed friend decl

* Fixed Windows export

* Fixed centos

* Added template add_extension method

* Move destructor to public

* Removed BaseExtension class

* Added variadic add_extension methods

* Fixed doc and typo

* Added BaseOpDestructor

* Allow to create new extension only for new operations

* Revert tests

* Fixed comments

* Fixed comments

* Fixed comment

* Added SO Extension wrapper
2021-11-01 10:36:30 +03:00
Wilson Seok
3775efd54a Migrate ngraph backend test/detection output (#8111)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of detection_output

* update op reference test and remove ngraph backend test

* make up the reference test data
2021-11-01 07:21:28 +03:00
Steve Yoo
ff713a5e01 Migrate Movement 1 Operations (Transpose-1) (#8135)
* Migrate Transpose-1

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:52:14 +03:00
Steve Yoo
05dfee0a70 Migrate Movement 1 Operations (VariadicSplit-1) (#8091)
* Migrate VariadicSplit

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:42:10 +03:00
Wilson Seok
f912a8102d Migrate ngraph backend test/psroi pooling/deformable psroi pooling/proposal (#8152)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of psroi_pooling and deformable_psrio_pooling

* update op reference test

* remove ngraph backend test

* add op reference test of proposalV1 and proposalV4

* update skip_test_config.cpp to avoid failure of accuracy drop in fp16/bf16 test case of proposal
2021-11-01 04:47:42 +03:00