Commit Graph

54 Commits

Author SHA1 Message Date
Rafik Saliev
d225ba6e53 [IE] Add batched blob support (#2203)
* [IE] Add batched blob support

New `class BatchedBlob : public CompoundBlob` defined to allow to pass multiple blobs as 1 InferRequest input.

Motivation: There is the special user case when a number of plain images (e.g. `NV12Blob`) should be passed as one input for network which batch size > 1.

`class CompoundBlob` is not applicable for such cases due to:
1. `NV12Blob` is `CompoundBlob` which prevents to combine multiple NV12 images to a CompoundBlob
2. The default behavior in most of plugins - do not accept generic CompoundBlob as `SetBlob()` argument

Adding `SetBlob(name, vector<Blob::Ptr>...)` to `class IInferRequest`, `class InferRequest`, `class IInferRequestInternal`, ...  - is not effective solution due to limited and specific use cases for `batched inputs`.

+ Apply rule-of-zero to CompoundBlob and inherited classes.

* Add "BATCHED_BLOB" optimization capability metric

* Add BatchedBlob usage to hello_nv12_input_classification

* Apply offline code review outcome:

1. Revert CompoundBlob public .ctors signatures
2. Remove 'workaround' .ctor for `BatchedBlob`
3. Revert tensor descriptors of `I420Blob` `NV12Blob` back to the 'fake' value.

* Code review fix

* Add functional tests for CPU, GPU, MULTI, HETERO

* update doc comment

* Apply code review change requests.
2020-11-03 21:19:26 +03:00
Anton Romanov
50e6d0e31e Added check in hello sample (#2896)
* Added check in hello sample

* move check before inference
2020-11-03 06:34:06 +03:00
Ilya Lavrenov
1a1451ed8f Compilation with MSVC for ARM (#2928)
* Enable compilation with MSVC for ARM / ARM64

* Condition fix
2020-11-03 00:55:49 +03:00
Mikhail Ryzhov
0267cbd286 Fixed ngraph sample logical errors (#2600)
* Fixed ngrapth sample logical errors

- added batch size, because sample accepts several images
- set label file as optional
2020-10-26 15:36:49 +03:00
Ilya Lavrenov
258c51bd1f Openvino extra module adding - refactored (#2754)
* Rename plugin to module

* Added openvino_contrib handling

* Moved NEON flags to common place

* Fixed -Werror=catch-value= gcc-9 error
2020-10-23 08:54:48 +03:00
Anton Pankratv
8a1653b0d1 Supported threading command line options for other devices (#2725)
* Supported thrieding command line options for ohter devices

* Fixed python benchmark
2020-10-21 06:40:18 +03:00
Andrey Dmitriev
aff7a66082 [GNA][Speech sample] Add option to specify blob names (#1529)
* Added output names

* Add input, output, ref names

* Added zero scale factor

* Adding support for multiple reference files
2020-10-16 15:34:22 +03:00
Ilya Lavrenov
da625b995e Shellcheck update (#2557)
* Fixed SC2236 rules

* Fixed SC2086 rule

* Small fixes in other scripts
2020-10-09 13:25:53 +03:00
Denis Orlov
1cc25fc885 Port 2021.1 documentation updates for GNA plugin and speech libs and demos. (#2564)
* Update docs for speech libs and demos (#2518)

* [GNA] Documentation updates for 2021.1 (#2460)

* [GNA] Documentation updates for 2021.1

* Take Mike's comments into account

* More fixes according to review

* Fix processor generation names
2020-10-07 15:13:16 +03:00
Mikhail Ryzhov
6e3a69c3f1 Downgrade cmake for samples (#2372) (#2434)
* Downgrade cmake for samples

Downgraded cmake version to default version for Ubuntu 18.04

* Updated supported python version

The minimal python version in 2021.1 is 3.5

* Added notes about cmake requirements for samples and demo
2020-10-01 11:37:39 +03:00
Anna Alberska
1cfa47cde8 [GNA] clear input scale factor from configuration for imported model (#2172)
* [GNA] clear input scale factor from configuration for imported model

* add test

* [GNA] add warning for using imported scale factors
2020-09-29 18:32:09 +03:00
Evgeny Talanin
fe99e055f2 Bump cmake version to 3.13 (#2258) 2020-09-18 18:58:12 +03:00
Ilya Lavrenov
147a508a51 fixes for UWP (#2255)
* UWP fixes

* Commented code for compilation with UWP

* Current state: compiled for DESKTOP_APP

* Fixes

* Added toolchain

* Enabled ONNX imported for Windows Store

* Updated toolchain

* Fixes

* Disable ONNX in case of UWP

* Fix for Windows Driver

* Applied style check

* Dynamic loading of GetDLLDirectory symbols

* Clean-up in the toolchain

* Updated mkldnn plugin cmake
2020-09-18 17:13:27 +03:00
Mikhail Ryzhov
dbf8fbf9c6 Fixed c samples build (#2278)
* Fixed c samples build

fixed CVS-38816 - Failure to build samples in C

* Fixed issue with gflags
2020-09-17 13:51:23 +03:00
Mikhail Ryzhov
7859aab4b0 Modified samples to support ONNX models (#1680)
* Modified samples to support ONNX models

- Removed manual loading of IR .bin files (hello_classification, object_detection_sample_ssd)
- Corrected comments
- Added Note in README files

* Modified samples to support ONNX models

- Removed manual loading of IR .bin files (hello_classification, object_detection_sample_ssd)
- Corrected comments
- Added Note in README files
2020-08-26 18:53:24 +03:00
Harald Rotuna
84028be544 Add method to classification_result for returning results (#1460) 2020-08-21 11:59:12 +03:00
Ilya Lavrenov
6a5993fb36 Implement unicode conversion using Windows native functions (#1590)
* Implement unicode conversion using Windows native functions

* NOCPPLINT

* Fixed deprecated c++ api usage in tests

* Moved impl to cpp

* Moved Unicode utils to Plugin API

* Added missed include for Windows

* Fixes for unit tests; CentOS fixes

* Fixed Windows compilation

* Fixed unit tests on Unix

* Fixed unix 2
2020-08-06 12:01:34 +03:00
Ilya Lavrenov
9f767f7b93 Hide implementation of SharedObjectLoader to cpp files (#1556)
* Hide implementation of SharedObjectLoader to cpp files

* Fixed GPU tests compilation

* Fixes for Unix; check OpenCL headers with strict flags

* Fixed Windows

* More fixes for Windows

* Fixed Unit tests

* Enabled compilation with libVA for new GPU tests

* Fixes for case when libVA is not available

* Removed useless NOMINMAX

* Useless include

* Fix

* Fixes

* Fixes for Intel compiler

* Fix for Windows + Intel compiler

* Fixed samples compilation with Intel compiler
2020-08-03 14:01:56 +03:00
Ilya Lavrenov
17e457d7c8 Updated inference_engine.hpp (#1539) 2020-07-30 18:40:28 +03:00
Ilya Lavrenov
9351547707 Removed public headers / dependencies for readers plugins (#1534)
* Removed public headers / depedencies for readers plugins

* Refactored cmake for onnx reader plugin as well
2020-07-30 07:00:44 +03:00
Nadezhda Ageeva
40d597c313 Adds first inference time measurements in benchmark_app (#1487) 2020-07-27 16:45:07 +03:00
Andrey Zaytsev
045fe44d29 Fixes LFS issues (#1440)
* Removed non-LFS images to reload them to LFS

* Reload images to LFS

* Reload images to LFS
2020-07-22 22:35:58 +03:00
Ilya Churaev
141b24cf44 Replaced copy_with_new_args() to clone_with_new_inputs() (#1395) 2020-07-22 13:44:22 +03:00
Nikolay Tyukaev
ef45b5da8d Doc Migration (master) (#1377)
* Doc Migration from Gitlab (#1289)

* doc migration

* fix

* Update FakeQuantize_1.md

* Update performance_benchmarks.md

* Updates graphs for FPGA

* Update performance_benchmarks.md

* Change DL Workbench structure (#1)

* Changed DL Workbench structure

* Fixed tags

* fixes

* Update ie_docs.xml

* Update performance_benchmarks_faq.md

* Fixes in DL Workbench layout

* Fixes for CVS-31290

* [DL Workbench] Minor correction

* Fix for CVS-30955

* Added nGraph deprecation notice as requested by Zoe

* fix broken links in api doxy layouts

* CVS-31131 fixes

* Additional fixes

* Fixed POT TOC

* Update PAC_Configure.md

PAC DCP 1.2.1 install guide.

* Update inference_engine_intro.md

* fix broken link

* Update opset.md

* fix

* added opset4 to layout

* added new opsets to layout, set labels for them

* Update VisionAcceleratorFPGA_Configure.md

Updated from 2020.3 to 2020.4

Co-authored-by: domi2000 <domi2000@users.noreply.github.com>
2020-07-20 17:36:08 +03:00
Nadezhda Ageeva
0887a7c0d6 Allow python benchmark_app load onnx model (#1283) 2020-07-16 13:53:43 +03:00
Ilya Churaev
32d7959b92 Added U32 precision (#1297) 2020-07-14 10:27:10 +03:00
Ilya Churaev
5feeab37d4 Use ngraph.hpp in samples and documentation (#1240) 2020-07-09 06:09:28 +03:00
Ilya Churaev
5d1c5ee6a9 Removed nGraph experimental operations and headers (#1197) 2020-07-07 07:27:17 +03:00
Anna Alberska
0b9987f5e9 [GNA] fix custom scale factors when importing a model (#1096) 2020-06-25 12:43:47 +03:00
Anton Romanov
81046cacf4 Fix samples build script (#819) 2020-06-22 16:12:02 +03:00
Nikolay Shchegolev
26ae52b461 [Common] Static analysed issues. Part II. (#881) 2020-06-18 13:59:26 +03:00
Nikita Kudriavtsev
fbf062c46b Changes: (#982)
- Named structures in bmp.h to avoid MSFT compiler error
- Fix for non-void function with missing return statement to avoid Intel compiler error
- Enabled "smoke_ExportUsingFileNameImportFromStreamNoThrowWithDeviceName" test
- Fix for MvncTest
2020-06-18 13:49:20 +03:00
Denis Orlov
ef8a8dd309 add support for multiple scale factors in speech sample (#835)
Co-authored-by: Anna Alberska <anna.alberska@intel.com>
2020-06-09 14:36:28 +03:00
Kami-996
cad3ccd8a3 add /wd4819 to disable C4819 warning, which is treated as error in win32 (#767)
Co-authored-by: jasonlee <jasonlee@qiyi.com>
2020-06-05 16:04:59 +03:00
Denis Orlov
67e3e06bee Fix hetero mode in speech sample - set config when loading network (#786) 2020-06-05 11:54:03 +03:00
Ilya Churaev
7a5d447e9f [SAMPLES] Use defined constant instead of string (#788) 2020-06-05 11:22:24 +03:00
Artyom Anokhov
09192b804e [OpenVINO scripts] Fixed *.sh files index from 644 to 755 (#664)
* Fixed *.sh files index from 644 to 755

* Added convert.py executable permission
2020-05-29 13:50:17 +03:00
Alexey Suhov
deb008a26f publish master branch snapshot, revision 8d31237e2c3f673cbb0f0ba110fc10f5cce1d2bb 2020-05-22 02:23:12 +03:00
Alexey Suhov
eab7ef4895 add submodules for mkl-dnn, gflags and gtest 2020-05-21 23:00:55 +03:00
Alexey Suhov
d222c99ca7 add speech demo 2020-05-21 17:14:03 +03:00
Alexey Suhov
f30dcc218c publish master branch snapshot, revision 9df5eb1f84e13a35720a918f88324561222ab114 2020-05-20 01:13:06 +03:00
Alexey Suhov
5b428f0655 publish master branch snapshot, revision 49482ae3bea0cbaa07474f86f36db11943142687 2020-05-13 21:12:22 +03:00
Alexey Suhov
357cc7eb4c publish master branch snapshot, revision 0110d9c98fd7209589d06344f0d836f61d81f4b3 2020-04-27 21:21:29 +03:00
Alexey Suhov
127cbac5bc publish master branch snapshot, revision cdcab9d7ab48ffb0ee5629fabbfa06cb45debd9b 2020-04-15 19:01:57 +03:00
Alexey Suhov
95a57795dc Publishing 2020.2 content 2020-04-13 21:17:23 +03:00
Alexey Suhov
b2140c083a Publishing 2020.1 content 2020-02-11 22:48:49 +03:00
Alexey Suhov
0923303e02 Publishing 2019 R3 content 2019-10-04 19:26:43 +03:00
Alexey Suhov
ba6e22b1b5 Publishing 2019 R2 content (#223) 2019-08-09 19:02:42 +03:00
Alexey Suhov
0ef92871b6 Publishing 2019 R1.1 content and Myriad plugin sources (#162)
* Publishing 2019 R1.1 content and Myriad plugin sources
2019-05-27 21:18:32 +03:00
Alexey Suhov
e206d06f18 Publishing 2019 R1.0.1 content 2019-04-30 18:55:07 +03:00