Commit Graph

128 Commits

Author SHA1 Message Date
Mateusz Tabaka
0e4c50e24d [MO] Move reverse input channels before mean/scale (#9182) 2021-12-15 00:41:21 +03:00
Anastasia Popova
3cb27715e2 Partial shape serialization MO (#8927)
* Support of partial shape in MO.

* Added partial shapes serialization in MO.

* Removed breckets.

* Fixed parameter extender in IR reader.

* Removed wrong changes.

* Added checks, added tests.

* Updated help.

* Fixed import.
2021-12-14 17:59:19 +03:00
Nikita Malinin
950fc508ad [POT] Update tests references (#9187)
* Update test utils with the new MO

* Update references

* Refs update

* Disabled few tests & update refs

* Change model data_type

* Added TODOs
2021-12-14 12:15:49 +03:00
Maxim Vafin
1ae556a426 Fix network -> model renaming merge conflict (#9191) 2021-12-14 00:50:25 +03:00
Anastasia Popova
5124d95df7 Old API map element type applying fix (#8735)
* Changed logic of applying old_api_map_element_type.

* Code style.

* Added validate_nodes_and_infer_types().

* Fixed MeanScale for uint8 parameters.

* Added checks.

* Small fix.

* Added unit test.

* Merge conflicts fix.

* Small correction.

* Small corrections.

* Added type correction.

* Added comment.

* Fix conflicts.

* Test fix.

* Small fix.

* Fixed conflicts.
2021-12-13 14:51:09 +03:00
Maxim Vafin
51947eeb3d Add layout commands in MO (#8829)
* Add layout support in MO

* Apply review feedback
2021-12-13 13:57:19 +03:00
Pavel Esir
2ff4ef2e4f fix requirements copy in mo setup.py (#9127) 2021-12-13 13:33:14 +03:00
Ilya Lavrenov
11f0ec8f46 Legacy as STATIC (#5691)
* Legacy library is static

* Don't export symbols from legacy

* LEgacy only for cnn_network_ngraph_impl.cpp

* Removed Windows specific functions calls

* Use static_cast

* Fixed Windows

* Removed legacy library to DM configs
2021-12-13 13:02:53 +03:00
Ilya Churaev
a984b8d6ba Fixed incorrect path to TBB (#9151) 2021-12-10 20:38:24 +03:00
Ilya Churaev
ec6f57872f Renamed ov::Function to ov::Model (#9051)
* Renamed ov::Function to ov::Model

* Fixed all for macos

* Fixed build

* Fixed build

* Revert changes in GPU plugin

* Fixed ngraphFunctions

* Fixed all for mac

* Fixed new test

* Fixed if for Windows

* Fixed unit tests and renamed Function in python API

* Fixed code style

* Fixed import

* Fixed conflict

* Fixed merge issues
2021-12-10 13:08:38 +03:00
Yegor Kruglov
33fb7d2036 fix (#9124) 2021-12-09 20:54:36 +03:00
Svetlana Dolinina
cbae8e0532 Added calculation of lower/upper bound for divide operation (#8325) 2021-12-09 16:40:14 +03:00
Yegor Kruglov
7cb1bd6a1b Extend nGraph for operation Softmax-8 (#8157) 2021-12-09 16:21:55 +03:00
Vladimir Gavrilov
d6ab463ab5 Failure of quantization for some models due to absence ShuffleChannels operation in some set (#8919)
* Added ShuffleChannels operation into OpVersioning.opset_1_types set.

* Fixed the attribute 'version' of the MO operation ShuffleChannels.

* Reverted opset change for the operation ShuffleChannels.
2021-12-09 15:20:29 +03:00
Katarzyna Mitrus
a787fade68 [Python API] Move openvino.runtime.impl to openvino.runtime (#9096) 2021-12-09 10:40:22 +01:00
Svetlana Dolinina
b06ff4ced7 fix iteration count calculation for output record for case of negative start/end and non integer division (#8641)
* fix iteration count calculation for output record for case of negative start/end and non integer division

* added tests;
process case with both start/end

* test refactoring done
2021-12-09 11:29:11 +03:00
Gleb Kazantaev
d18e80b604 Move back temp frolder to the CMAKE_SOURCE_DIR (#9072)
* Move back temp frolder to the CMAKE_SOURCE_DIR

* Fix windows azure
2021-12-09 00:00:36 +03:00
Svetlana Dolinina
672565a8ed deprecate mean_file option in Caffe (#8707)
* deprecate mean_file option

* add deprecation warning even if error happens

* removed Suppress for now deprecated options

* review fixes

* added dot
2021-12-08 17:38:46 +03:00
Alexey Lebedev
ebba28a3e3 [tools] correct options for dynamic models (#9010)
* process dynamic model with one data_shape as static

* static reshaped to dynamic with one data shape can't be mesuared as static
2021-12-08 16:53:52 +03:00
Sergey Lyubimtsev
01236619b5 Update TPP files for wheels (#8935)
* Update TPP files for wheels

* Remove myriad plugin and update `openvino` package description

* Update for product names
2021-12-08 12:50:30 +03:00
Milana Shhanukova
38600949fa [POT] Remove tpe algo (#8929)
* remove tpe

* delete unused object_dump.py

* delete tpe reference

* tpe removal in optimization

* deleted benchmark

* docs changes

* tunable quantization changes

* mistype in sentence
2021-12-08 11:43:39 +03:00
Pavel Esir
980904c9ec [MO] Align MO namespaces (#7708)
* Moved and merged mo/ and extensions/ into openvino/tools/mo

* edited imports

* edited docs to use mo script from entry_point

* edited MO transformations list loading and setup.py

* changed full path -> 'mo' entry point in docs (leftovers)

* corrected package_BOM

* updated resolving --transformation_config in cli_parser.py

* pkgutil-style __init__.py, added summarize_graph into entry points

* updated DOCs for the new --transformations_config

* fix select

* updated install instructions, fixed setup.py for windows and python_version < 3.8

* fixed typo in requirements.txt

* resolved conflicts

* removed creating custom __init__.py from setup.py

* corrected folder with caffe proto

* corrected loading user defined extensions

* fix openvino.tools.mo import in serialize.py

* corrected layer tests for new namespace

* fix in get_testdata.py

* moved model-optimizer into tools/

* renamed import in POT

* corrected mo.yml

* correct CMakeLists.txt for the newest tools/mo

* corrected find_ie_version.py

* docs and openvino-dev setup.py update for the newest tools/mo

* miscellaneous leftovers and fixes

* corrected CI files, pybind11_add_module in CMakeLists.txt and use of tools/mo path instead of tools/model_optimizer

* add_subdirectory pybind11 for tools/mo

* POT path fix

* updated setupvars.sh setupvars.bat

* Revert "updated setupvars.sh setupvars.bat"

This reverts commit c011142340.

* removed model-optimizer env variables from setupvars

* updated CMakeLists.txt to pack MO properly with tests component

* corrected left imports, corrected loading requirements for layer tests

* mo doc typo correction

* minor corrections in docs; removed summarize_graph from entry_points

* get_started_windows.md, MonoDepth_how_to.md corrections, mo path corrections
2021-12-08 08:53:53 +03:00
Mikhail Nosov
20bf5fcc4a Rename "network" to "model" in preprocessing API (#9054) 2021-12-07 19:26:27 +03:00
Nikita Malinin
257ba79b82 [POT] Update model compression pass and FQ values precision (#8855)
* Update model compression pass and FQ values precision

* Pylint fixes

* Fix for case with 2 or more destinations

* Update pass.py from suggestion

Co-authored-by: Anton Chetverikov <Anton.Chetverikov@intel.com>

* Update with the const condition

* Update ref

* Revert ref and update data_type for FQ consts

Co-authored-by: Anton Chetverikov <Anton.Chetverikov@intel.com>
2021-12-07 11:47:13 +03:00
Mikhail Ryzhov
40691e9cc5 [GNA] Renamed plugin and moved it to new place (#8944)
* Renamed plugin

* Changed plugin source dir

* Fixed tests

* Renamed ENABLE_GNA to ENABLE_INTEL_GNA

* Fixed centos compile error

* One more renaming place

* HF for centos 7

* renamed the name in version api

* Fixed CI configurations

* Disabled GNA plugin for old gcc (<=5.4)

* Fixed Azure Win job
2021-12-06 13:00:35 +03:00
Wang, Yang
83a7d9bda3 [AUTO Plugin] Rename Multi plugin to ov_multi_plugin and move the src files to new (#8885)
place.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2021-12-06 05:58:05 +03:00
Sergey Lyubimtsev
c11ae2d691 Add requirements files generation for installer (#9019)
* Add requirements files generation for installer (#8940) *

* remove caffe2
2021-12-06 01:15:31 +03:00
Andrey Babushkin
61cae2a401 Revert "Add requirements files generation for installer (#8940)" (#8993)
This reverts commit 1d6d3ebea8.
2021-12-03 09:16:16 +03:00
Alexey Lebedev
f9bd7402ff [tools] new api and support dynamic models in python benchmark app (#8582)
* Preprocessing API - base classes

Includes API definition for trivial mean/scale operations (which don't require layout)

Mean/scale with 'layout' support will be done under separate task together
 with Layout

Current test code coverage: 100%

* Python bindings for base preprocessing API

* remove pre_post_process directory from ngraph/core

* remove files from ngraph/python dir

* move pyngraph pre_post_process files from ngraph/python to runtime

* remove pre_post_process test from CMakeList

* move include to the header

* update include path for pre_post_process

* style fix

* bind InputTensorInfo::set_layout

* cleaned test_preprocess

* fix test expected output

* remove duplicate test

* update description of set_element_type

* fix style

* move preprocess from pyngraph to pyopenvino/graph

* update test_preprocess imports and remove unnecessary test

* remove duplicate import

* update custom method

* update test

* update test

* create decorator that changes Node into Output<Node>

* create function that cast Node to Output<Node>

* update test_preprocess to use decorator for custom function

* change _cast_to_output -> _from_node

* style fix

* add tests fro scale and mean with vector input

* style fix

* add docstring for custom_preprocess_function

* bind InputInfo network method

* style fix

* bind OutputInfo

* fix description of preprocess submodule

* fix style

* update copyright year

* bind OutputTensorInfo

* bind OutputNetworkInfo and InputNetworkInfo

* Bind exec core ov (#50)

* Output const node python tests (#52)

* add python bindings tests for Output<const ov::None>

* add proper tests

* add new line

* rename ie_version to version

* Pszmel/bind infer request (#51)

* remove set_batch, get_blob and set_blob

* update InferRequest class

* change InferenceEngine::InferRequest to ov::runtime::InferRequest

* update set_callback body

* update bindings to reflect ov::runtime::InferRequest

* bind set_input_tensor and get_input_tensor

* style fix

* clen ie_infer_queue.cpp

* Bind exec core ov (#50)

* bind core, exec_net classes

* rm unused function

* add new line

* rename ie_infer_request -> infer_request

* update imports

* update __init__.py

* update ie_api.py

* Replace old containers with the new one

* create impl for create_infer_request

* comment out infer_queue to avoid errors with old infer_request

* update infer_request bind to reflect new infer_request api

* comment out inpuit_info from ie_network to avoid errors with old containers

* Register new containers and comment out InferQueue

* update infer request tests

* style fix

* remove unused imports

* remove unused imports and 2 methods

* add tests to cover all new methods from infer_request

* style fix

* add test

* remove registration of InferResults

* update name of exception_ptr parameter

* update the loops that iterate through inputs and outputs

* clean setCustomCallbacks

* style fix

* add Tensor import

* style fix

* update infer and normalize_inputs

* style fix

* rename startTime and endTime

* Create test for mixed keys as infer arguments

* update infer function

* update return type of infer

Co-authored-by: Bartek Szmelczynski <bartosz.szmelczynski@intel.com>

* fix get_version

* fix opaque issue

* some cosmetic changes

* fix codestyle in tests

* make tests green

* Extend python InferRequest

* Extend python Function

* Change return value of infer call

* Fix missing precisions conversions in CPU plugin

* Rework of runtime for new tests

* Fixed onnx reading in python tests

* Edit compatibility tests

* Edit tests

* Add FLOAT_LIKE xfails

* bind ColorFormat and ResizeAlgorithm

* clean imports

* fix typo

* [Python API] bind ProfilingInfo (#55)

* bind ProfilingInfo

* Add tests

* Fix code style

* Add property

* fix codestyle

* Infer new request method (#56)

* fix conflicts, add infer_new_request function

* remove redundant functions, fix style

* revert the unwanted changes

* revert removal of the Blob

* revert removal of isTblob

* add add_extension from path

* codestyle

* add PostProcessSteps to init

* bind PreProcessSteps

* create additional tests

* fix win build

* add inputs-outputs to function

* update infer queue

* fix code style

* Hot-fix CPU plugin with precision

* fix start_async

* add performance hint to time infer (#8480)

* Updated common migration pipeline (#8176)

* Updated common migration pipeline

* Fixed merge issue

* Added new model and extended example

* Fixed typo

* Added v10-v11 comparison

* Avoid redundant graph nodes scans (#8415)

* Refactor work with env variables (#8208)

* del MO_ROOT

* del MO_ROOT from common_utils.py

* add MO_PATH to common_utils.py

* change mo_path

* [IE Sample Scripts] Use cmake to build samples (#8442)

* Use cmake to build samples

* Add the option to set custom build output folder

* Remove opset8 from compatibility ngraph python API (#8452)

* [GPU] OneDNN gpu submodule update to version 2.5 (#8449)

* [GPU] OneDNN gpu submodule update to version 2.5

* [GPU] Updated onednn submodule and added layout optimizer fix

* Install rules for static libraries case (#8384)

* Proper cmake install for static libraries case

* Added an ability to skip template plugin

* Added install rules for VPU / GPU

* Install more libraries

* Fixed absolute TBB include paths

* Disable GNA

* Fixed issue with linker

* Some fixes

* Fixed linkage issues in tests

* Disabled some tests

* Updated CI pipelines

* Fixed Windows linkage

* Fixed custom_opset test for static casr

* Fixed CVS-70313

* Continue on error

* Fixed clanf-format

* Try to fix Windows linker

* Fixed compilation

* Disable samples

* Fixed samples build with THREADING=SEQ

* Fixed link error on Windows

* Fixed ieFuncTests

* Added static Azure CI

* Revert "Fixed link error on Windows"

This reverts commit 78cca36fd2.

* Merge static and dynamic linux pipelines

* Fixed Azure

* fix codestyle

* rename all methods in this class to snake_case

* some updates

* code style

* fix code style in tests

* update statistics reporting

* update filling inputs

* change ngraph.Type to ov.Type

* fix typo

* save work

* save work

* save work

* compute latency in callback

* save work

* Fix get_idle_request

* save work

* fix latency

* Fix code style

* update AppInputInfo

* add iteration to PatrialShape

* fix rebasing

* bind result::get_layout()

* correct mistakes

* fix setup

* use parameters/results instead inputs/outputs

* move _from_node to node_output.hpp

* add read_model from buffer

* update imports

* revert package struct

* add new line

* remove bad quotes

* update imports

* style fix

* add new line

* Fix preprocessing

* rename functin args

* set NCHW layout to image as default

* Fix input fillings

* remove Type import

* update tests

* style fix

* test clean

* remove blank line

* Add tensor_shape

* fix comments

* update PrePostProcessor init and build methods

* create test with model update tests with new PrePostProcessor init and build

* Change filling inputs

* fix preprocessing

* basic support dynamic shapes

* fix legacy mode

* rename ie to core

* fix cpp code style

* fix input files parsing

* fix binary filling

* support dynamic batch size

* process images with original shapes if no tensor shapes were given

* fix fps and number of iterations

* Add new metrics

* support pass path to folder into input mapping

* add pcseq flag

* fix resolving conflicts

* dump statistic per group

* check for compatibility with partial shape

* revert statistic report names

* code refactoring

* update parameters

* enable legacy_mode if data size less than nireq

* add serialize to offline_transformations

* Fix preprocessing import

* change log output due to ci parsing

* fix layout

* allow to pass batch size with undefined layout

* add serializer

* fix comments from jiwaszki

* Fix latency parsing for ci

* code style

* rename tensor_shape to data_shape

* add message if image is processed with original shape

* fix syntax warning

* remove default legacy_mode if requests cover all data

* rewrite all file parsing

* fix preprocessing

* Fix preprocessing #2

* Use layout instead str

* Fix file extensions

* Fix image sizes filling

* sort input files

* [Python API] quick fix of packaging

* update tests

* fix setup.py

* small fix

* small fixes according to comments

* skip mo frontend tests

* full mode is default for dynamic models only

* backward compatibility

* Fix package

* set layout in runtime

* static mode for dynamic models with all equal data shapes

* use get_tensor instead set_tensor in legacy mode

* benchmarking dynamic model available in full mode only

* fix layout detection

* use batch_size * iteration instead processed_frames in legacy mode

* fix tensor naming

* represent --inference_only

* refactoring main loop

* Fix number of iterations for full mode

Co-authored-by: Michael Nosov <mikhail.nosov@intel.com>
Co-authored-by: pszmel <piotr.szmelczynski@intel.com>
Co-authored-by: Bartek Szmelczynski <bartosz.szmelczynski@intel.com>
Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: jiwaszki <jan.iwaszkiewicz@intel.com>
Co-authored-by: Victor Kuznetsov <victor.kuznetsov@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Tomasz Jankowski <tomasz1.jankowski@intel.com>
Co-authored-by: Dmitry Pigasin <dmitry.pigasin@intel.com>
Co-authored-by: Artur Kulikowski <artur.kulikowski@intel.com>
Co-authored-by: Ilya Znamenskiy <ilya.znamenskiy@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-12-02 16:18:18 +03:00
Sergey Lyubimtsev
1d6d3ebea8 Add requirements files generation for installer (#8940)
* Add requirements files generation for installer

* add line

* fix build

* fix var

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-12-02 11:54:38 +03:00
Vladimir Paramuzov
0f667b90ff [GPU] Renamed GPU plugin to ov_intel_gpu_plugin (#8957) 2021-12-02 11:06:00 +03:00
Indira Salyahova
9d776ffc2f feat: symmetic fq in self attention block transformer (#8616) 2021-12-01 15:34:40 +03:00
Ilya Lavrenov
5a52a8e4a3 Don't install content of openvino-dev; install wheels (#8820)
* Don't install content of openvino-dev

* Install MO in tests

* Install python's BA tool only for tests
2021-12-01 14:34:50 +03:00
Ilya Churaev
7678ab2b18 Move hetero plugin (#8872) 2021-11-29 14:05:08 +03:00
Ilya Churaev
07651aa5c0 Fixed some inference-engine paths (#8878) 2021-11-29 07:17:36 +03:00
Liubov Batanina
2d0ae6028a [POT] Added quantization inside subgraphs (#8530)
* [POT] Support subgraphs

* Add support for inplace statistics

* Fixed cascade models

* Fixed bug

* Fixed import

* Fix name

* Add test

* Fix comments

* Replace test model

* Replace test model

* Add recursively flag

* Fix pylint

* Updated AA node names

* Fix adding results to node

* Disable subgraph quantization

* Disable recursion search in graph

* Skip test with subgraphs quantization
2021-11-26 12:42:33 +03:00
Indira Salyahova
e32a569fb4 fix: quantize only one input mvn operation (#8822) 2021-11-26 12:17:43 +03:00
Indira Salyahova
8db9168d41 [POT] Check node is not None (#8732)
* fix: check the node is not None

* input port is not None
2021-11-26 12:10:33 +03:00
Nikita Malinin
d8d9954ad6 Fix bug with the outputs naming (#8556)
(cherry picked from commit 13c99e8882)
2021-11-26 12:08:01 +03:00
Anton Chetverikov
163bc458db [POT] Transformations to remove and add Convert operations in graph (#8672)
* Added special passes to remove and add Convert operations in POT

* Update passes

* Implement changes to support new FP16 models

* Apply codestyle patch

* Revert Cast inserting and add data parameter

* Update FastBC rule

Co-authored-by: Malinin, Nikita <nikita.malinin@intel.com>
2021-11-25 12:59:39 +03:00
Maxim Vafin
2f612f776b Define common frontend (#8110)
* Rename and reorganize frontend_manager

* Apply codestyle

* Fix installing headers

* Fix codestyle
2021-11-24 18:56:05 +03:00
Nikita Malinin
516d510045 [POT] Added typecast while nodes updating & creation (#8621)
* Update type casting while update

* Fix Pylint

* Update precision setting for FQ values

* Update FQ values precision setting

* Fix scales dump

* Update reference

* Another reference update
2021-11-23 17:13:04 +03:00
Alexey Lebedev
8e46eecac0 fix input files parsing (#8718) 2021-11-22 12:15:00 +03:00
Indira Salyahova
d9241dda72 fix: check int branch while find fqs_to_unify (#8661) 2021-11-19 15:21:27 +03:00
Ilya Churaev
f639e4e902 Moved inference_engine samples to cpp folder (#8615)
* Moved inference_engine samples to cpp folder

* Fixed documentations links

* Fixed installation

* Fixed scripts

* Fixed cmake script

* Try to fix install

* Fixed samples

* Some fix
2021-11-18 10:08:20 +03:00
Mikhail Nosov
2245ea8be2 [FrontEnd] Rename all frontends from "*_ngraph_frontend*" to "_ov_frontend*" (#8645)
* Renaming all frontends from "*_ngraph_frontend*" to "_ov_frontend*"

Also Debug builds on Windows release frontends without "d" suffix will not be loaded

* Fix review comments and add wheels test debug prints

* More debug prints

* Load by absolute path and remove debug prints
2021-11-18 09:26:13 +03:00
Indira Salyahova
29a3f56003 [POT] Add pattern se blocks (#8425)
* fix(patterns): add pattern se_block

* update reference
2021-11-15 12:53:07 +03:00
Milana Shhanukova
700beb7d1f [POT] Update add node name (#8487)
* Update node name to make ports visible

* proxy algo

* m

* mistype for add node name

* undo_utils

* Update utils.py

* Update algorithm.py

* undo
2021-11-11 10:35:00 +03:00
Indira Salyahova
a788dc31e2 fix: delete fq if node precision bool (#8336) 2021-11-10 15:27:45 +03:00
Tagir Rakipov
ac0582c2d9 [POT] get_num_levels function (#8393)
* added function for calculating the number of discret levels in the input tensors and tests for this function

* added function for calculating the number of discret levels in the input tensors and tests for this function

* fixed pylint issues

* changed the function for delta estimation from mean to min

* added empty delta array processing in get_num_levels func and tests for it
2021-11-10 15:27:09 +03:00