Commit Graph

9594 Commits

Author SHA1 Message Date
Kelvin Choi
f1dcf6ec4a
[GPU] Add functional tests with dynamic input for CumSum op (#14942)
* Add STOP_IND by shape_info in case of reverse
2023-01-26 20:27:56 -08:00
Evgenya Stepyreva
0513a79a79
Tensorflow Lite frontend (#14977)
* Infrastructure for tflite

* Removed submodule flatbuffers

* Added flatbuffers submodule. Fixed version to v22.12.06 aka acf39ff

* Move headers back

* Flatbuffers integration

* Small fixes

* Started parsing the Model

* flatbuffer changes

* decoder_flatbuffer changes

* Lite Input Model -- not needed as of now but looks cool

* Rolled back inherritance from ov::frontend::tensorflow::InputModel

* Results are not treated as outputs, but its ok

* Fix missplaced input vs output

* Refactor

* Load model op-by-op. Frontend API finalized

* Debugging still, there are prints here and there. Decoder is not sane

* Convolution with all attributes is translated and quantization is applied for inputs and constatants. TODO: quantize intermediate tensors, separate decoder specific logic?

* Float ssd and posenet models are showing good accuracy

* Need to refactor but work flawlessly

* Telemetry and lightweight model cutting

* Code style and test changes. Extensions supported

* Quantization and style

* Style refinements

* Move onednn back

* New portion of operations enabled

* TFLite FE doesn't inherrit TF FE

* Moved files to another directory

* Rename header op_table.hpp to common_op_table.hpp for all files in src/frontends/tensorflow_common/src/op/

* Removed visability macroses

* CMake changes

* Unit-test execution in .ci

* Update labeler.yml

* Codeowners

* Style check and fix

* Static Build arrangement

* Addressing the comments

* install common headers to previous place

* New approach with public decoder and graph_iterator

* New approach with public decoder and graph_iterator

* Move GraphIterator back

* Comments addressed

* Comments adressed

* Preliminary TF FE README.md changes

* Added target_compile_definitions OPENVINO_STATIC_LIBRARY for static build

* Fixed conflicts and added TF to common places

* Frontends use only openvino::core::dev API

* Merged common tensorflow changes and made code build and work on selective number of models

* Style

* Rollback unnecessary changes from Tensorflow FE

* Rollback unnecessary changes from Tensorflow Common

* Minor refactor

* cmake minor refactoring

* Mixed commit

* Style and merge fix

* Low hanging fruit operations

* Fix windows build

* Refactor quantization parameters representation

* license compliance. approved by OS PDT

* copyrights in generic file

* dependabot

* labeler

* Unit Test to be triggered in CI

* cmake variables naming. corrected copyright years in copyrights/generic file

* library renamed in .ci/ calls

* Copyright year update

* Set openvino-tf-frontend-maintainers as owner of /src/frontends/tensorflow_lite/

* Fixed flatc corss-compilation

* Cleaned flatbuffers header usage

* Nitpicks solved

* Update cmake/templates/OpenVINOConfig.cmake.in

* Compile with flatbuffers headers

* Fixed "which is prefixed in the source directory"

* Fixed typo in flatbuffers cmake

* Removed flatbuffers submodule

* Added fork submodule

* Fixed static build

* Fixed cross-compilatio

* Fixed -Wshadow warning

* Fixed warning on Windows

* Use only headers from flatbuffers library

* Added LTO and fixed compilation errors on Windows

* Fixed warnings in tensorflow_common

* Move ctors implementation to cpp file

* Added information about new frontends to common FEm part

* Temporaryily disable warnings

* Fixed code style using clang-format

* Fixed Windows

* reverted changes in onnx

* Revert changes in onnx_common

* Removed pragma once frm cpp

Co-authored-by: missjane <estepyreva@gmail.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-27 06:27:59 +04:00
hyunback kim
d8d0083744
[GPU] Fix onednn concat, activation fusing functional regression. (#15328)
onednn doesn't support activation fusing.
faceboxes, icv-reid-embeddin, modnet_webcam_portrait_matting fail to run.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2023-01-27 11:00:26 +09:00
Vitaliy Urusovskij
ef8481d008
Apply snake_case to ov::Core API (#15313) 2023-01-27 00:47:04 +00:00
Irina Efode
532df18e00
Fix broken CI (#15345)
* Fix broken CI

* Fix division by zero
2023-01-27 01:07:36 +04:00
Ilya Lavrenov
93255deb41
Fixed G-API preprocessing tests (#15344) 2023-01-27 00:11:30 +04:00
Jan Iwaszkiewicz
37317b130d
[PyOV] Fix UserWarning in setup.py (#15334) 2023-01-26 22:02:17 +03:00
Sebastian Golebiewski
60664358be
architecture (#15338) 2023-01-26 22:58:09 +04:00
Anastasia Kuporosova
b4f069b9f9
[PyOV] Remove obsolete requirements (#15178)
* [PyOV] Remove obsolete requirements

* add cond for onnx

* cond

* cond

* cond
2023-01-26 19:51:48 +01:00
Gorokhov Dmitriy
b7f6e0f76f
[CORE] Fixed VEX/NonVEX performance penalty inside Convert evalute impl (#15336) 2023-01-26 21:45:24 +03:00
Anastasia Kuporosova
dd17aeead3
[PyOV] Update futureWarning in offline_transformations (#15319) 2023-01-26 17:12:21 +01:00
Ekaterina Aidova
3f5d7ad7a0
[PT FE]: support aten::var_mean and aten::remainder (#15193)
* [PT FE]: support aten::var_mean and aten::remainder

* upd headers

* fix gather version
2023-01-26 14:30:42 +00:00
Pawel Raasz
a7fa66c52d
Review eye class for shape inference aspects (#15039)
* Review propagate interval shapes and labels

* Review eye template shape inference

* Add partial value and label propagation on inputs
columns and rows

* Include array in eye shape inference

* Fix compilation issues

* Remove local label_t alias from eye tests
2023-01-26 15:03:35 +01:00
Marcin Kusmierski
3ccef5bb88
[GNA] Fix issue with Parameter followed by Broadcast/Tile layer (#14217)
* [GNA] Fix issue with Parameter followed by Broadcast/Tile layer

* added InsertCopyBeforeLayerToBeEliminated transofrmation: handling issue with
      Broadcast and Tile layer in case they are eliminated from network,
* added tests for verifying fix

* [GNA] Fix review comment. Remove unnecessery loop and varialble
2023-01-26 16:40:20 +03:00
Vitaliy Urusovskij
59ad317ce4
Remove "IEUnitTests" from linux_debian.yml (#15318)
Since there is no GNA for that build, tests are not built,
so call of InferenceEngineUnitTests lead to failure
because file not found
2023-01-26 13:40:13 +00:00
Georgy Krivoruchko
5637fd547e
[TF FE] Added TF Cumsum layer test (#15298)
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-01-26 12:46:20 +00:00
Maxim Vafin
84a4e3bbf4
Try to fix sporadic sum layer test fail (#15304) 2023-01-26 16:08:30 +04:00
Ilya Churaev
033368caab
Removed redundant convert_model from CoreImpl (#15231)
* Removed redundant convert_model from CoreImpl

* Fixed code style

* Removed redundant clones and fixed tests

* Removed methods from header

* Fixed CC

* Fixed tests

* Removed code duplication

* Removed caching from v7 logic

* Completely remove compute hash for CNNNetwork

* Removed legacy code

* Revert logic which is used in tests

* Try to understand the issue

* Revert "Try to understand the issue"

This reverts commit 72abf3a354.

* Revert "Revert logic which is used in tests"

This reverts commit 845e392bdd.

* Fixed tests

* Remove legacy test

* Revert query_model logic

* Revert "Revert query_model logic"

This reverts commit b694cd6999.

* Revert "Revert "Revert query_model logic""

This reverts commit 0df850838a.

* Fixed master build

* Revert "Revert "Revert "Revert query_model logic"""

This reverts commit 3bb2af2250.

* Revert changes with query_model
2023-01-26 13:29:02 +04:00
Mateusz Tabaka
3ad92084d6
Fix MarkDequantizationSubgraph when Mul has Convert on both inputs (#14997)
Ticket: 100042
2023-01-26 08:55:23 +00:00
Ilya Churaev
c0f524e3bd
Try to fix fuzzer tests (#15303)
* Try to fix fuzzer tests

* Try to fix test
2023-01-26 12:09:58 +04:00
Ilya Churaev
5e77169079
Fixed master build (#15308) 2023-01-26 07:55:58 +00:00
Sergey Shlyapnikov
6c22f06d07
[GPU] Perform memory transfer from usm_host to usm_device for dGPU only (#15263)
* [GPU] Perform memory transfer from usm_host to usm_device only for dGPU

* [GPU] Allocate new memory buffer for biases fusions to avoid original buffer modification since it may be used by other primitives
2023-01-26 10:44:38 +04:00
Pawel Raasz
b44b4fcf2c
Refactor shape inference factory (#15004)
* New static shape inference iface using ov::Tensors
- Add new shape inference factory
- Add helpers to create inference factory map entries
- Create map for IShapeInferCommon instead of if else switch
- Create new map for IStaticShapeInfer

* Re-factor tile shape inference to use new iface

* ov::default_label_evaluator uses ov::Tensor now

* Improve cmp::lt for mixed types unsigned and float

* Fix cpp lint issue

* Update using tile shape_inference in GPU plugin

* Do tile shape infer before repeats lock deletion

* Fix label type conversion to element type

* Rename shape infer transformation
to type utils and change namespace from ov::sh_infer_tr to ov::util

* Update shape inference utilities

* Add unit test for safe compare of values

* Update shape infer factory to be a template
and use unordered map

* Remove from_label_type as lebel_t can be used
by element:from<>
2023-01-26 07:44:13 +01:00
Kelvin Choi
8575ad690c
[GPU] Update Broadcast operation to use dynamic input (#14264)
* Refactor to merge extend_to_6d and get_agnostic_updated_params functions
2023-01-25 11:38:33 -08:00
Wilson Seok
70a0c713d3
use bfyx format as defalut for scalar layout (#15056) 2023-01-25 10:22:15 -08:00
Ekaterina Aidova
6475165833
[PT FE]: supports eye, tril, triu, tensor.fill_ and implicit scalars (#15187) 2023-01-25 21:04:56 +03:00
Roman Kazantsev
7ee781dfbf
[TF FE] Fix Transpose Sinking for dynamic shapes (#15302)
* TransposeSinking transformation: add support for dynamic shapes

* fix e2e tests

Co-authored-by: Ivan <ivan.tikhonov@intel.com>
2023-01-25 21:04:26 +04:00
Artemy Skrebkov
bf98d31393
Remove SDL check WA for VPUX (#15106)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-25 19:24:12 +04:00
Mateusz Tabaka
8512fc1655
Add PushConstantToSubgraph transformation (#15250)
* Add PushConstantToSubgraph transformation

Transformation detects constfoldable inputs to MultiSubGraphOp,
constantfold them and then pushes them to inner subgraphs.

Ticket: 98155

* cast to int

* comments, split to functions

* remove op::util
2023-01-25 18:46:09 +04:00
Sebastian Golebiewski
2c64c3a8a9
sphinx_design (#15198)
Adding new sphinx extension for designing responsive web components.
2023-01-25 15:15:03 +01:00
Georgy Krivoruchko
be3ed31513
[TF FE] Added CTC Greedy Decoder layer test with fixes (#15296)
* [TF FE] Added CTC Greedy Decoder layer test with fixes

* Update src/frontends/tensorflow_common/src/op/ctc_greedy_decoder.cpp

* Update src/frontends/tensorflow_common/src/op/ctc_greedy_decoder.cpp

* Update src/frontends/tensorflow_common/src/op/ctc_greedy_decoder.cpp

* Update src/frontends/tensorflow_common/src/op/ctc_greedy_decoder.cpp

* Update src/frontends/tensorflow_common/src/op/ctc_greedy_decoder.cpp

* Update src/frontends/tensorflow_common/src/op/ctc_greedy_decoder.cpp

* Removed ov:: and fixed codestyle

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-01-25 17:08:39 +03:00
Mikhail Ryzhov
623de0fdb4
[GNA] Excluded EXACT mode from the test (#15239)
* Excluded EXACT mode from the test

* Update src/plugins/intel_gna/tests/functional/shared_tests_instances/behavior/ov_infer_request/inference_chaining.cpp
2023-01-25 14:58:46 +01:00
Roman Kazantsev
93ef678d75
[MO][TF FE] Correct info messages from TF FE (#15299)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-01-25 12:51:23 +00:00
Sebastian Golebiewski
a1fb7fe5bc
apt brew yum (#15297) 2023-01-25 14:40:33 +04:00
Maxim Vafin
994b227b86
Remove None at outputs of the model, improve types handling in frontend (#15258)
* Remove None at outputs of the model, improve types handling in frontend

* Fix py code style

* Add torch dependency in pybind tests

* Fix tests if fe is disabled and add backward type cpnversion

* Move decoder tests to layer tests

* Fix codestyle

* Add comment

* Move tests to separate folder

* Update .ci/azure/linux.yml
2023-01-25 13:28:47 +03:00
Roman Lyamin
8e073819c3
[GPU] Added shape agnostic ref kernel for Reduce and Quantize (#15183)
* [GPU] Added shape agnostic ref kernel for quantize

* [GPU] Added shape agnostic ref kernel for Reduce
2023-01-25 14:25:13 +04:00
Bartek Szmelczynski
3bbaa16d90
Add aten mul tests (#15223)
* add tests for aten::mul

* add mul tests to precommit

* add test cases, remove parametrization

* add reason to xfails
2023-01-25 10:01:46 +01:00
Ilya Lavrenov
0970bc8fcf
Moved legacy library and deprecated tests to GNA (#15244) 2023-01-25 11:36:22 +04:00
Ilya Churaev
a3fafda1bc
Ignore empty tensor for hash calculation (#15282)
* Ignore empty tensor for hash calculation

* Added test
2023-01-25 10:02:51 +04:00
Roman Kazantsev
f12ffc0428
[MO][TF FE] Switch MO to TF FE in default mode (#15100)
* [MO][TF FE] Switch MO to TF FE in default mode

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix code-style

* Extend operations for the fallback

* Fix MO unit-tests

* Check only legacy FE for read-from-memory functionality

* Fix failures in IR comparator tests

* Fallback to the legacy FE in case tensorflow_custom_operations_config_update

* Revert copyright and update

* Fix unit-test since it is oriented for the legacy FE

* Fallback to the legacy FE in case deprecated config options

* Fix value propagation from deprecated config option

* Fix the Result node name in case cutting by input port for outputs

* Set Result node name aligned with the Legacy Frontend

* Reformat a list of operations to fallback

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-01-25 07:54:56 +04:00
Tomasz Jankowski
988847f559
Transformation component transition to OV namespace (phase 4) (#13558)
* Use openvino pass graph_rewrite

* Replace use of ngraph::pass to ov::pass

* Remove ngraph::pass aliases

* Update after rebase

* Fix post merge conflicts

* Apply code style

* Apply code style

* Remove bypassing inclusion

* Apply code style
2023-01-25 01:02:35 +03:00
Przemyslaw Wysocki
163baa3c1c
[PyOV] Allow numpy patch releases (#15265)
* Update reqs

* test, minor change
2023-01-24 19:13:12 +04:00
Irina Efode
0797cd15a8
[CONFORMANCE] Fix executable file paths in runner (#15285) 2023-01-24 15:00:30 +00:00
Karol Blaszczak
2394d226fa
Docs minor content adjustments (#15281) 2023-01-24 14:47:22 +01:00
Liubov Talamanova
5fca707ebd
[POT] Update CPU_SPR transformer quantization (#15241)
* [POT] Update CPU_SPR transformer quantization

* Add comments
2023-01-24 15:56:22 +04:00
Vitaliy Urusovskij
54ea2612ae
[Core] Safe loading of default plugins (#15073)
* Safe loading of default plugins

1. In case of default plugins.xml all plugins is registered by
absolute paths
2. In case of user API user is able to specify abs or rel path
or plugin name to be found in ENV
3. Update `ov::util::get_absolute_file_path()` in order to prevent
checking file exists or can be accessed
4. Add tests + delete duplicated tests

* Add `OV_CORE_CALL_STATEMENT` to `Core()` ctor
to convert InferenceEngine::Exception to
ov::Exception

* Add `ie_plugins.hpp` dependency to `ov_infer_unit_tests`

* Update C and Py docstrings

* Comment fix

* Update LD_LIB_PATH in openvino-onnx/Dockerfile

* Skip `test_register_plugin*` for Debian job
2023-01-24 14:53:00 +04:00
Georgy Krivoruchko
910ed759c3
[TF] Added BroadcastTo layer tests (#15205) 2023-01-24 13:55:59 +04:00
Katarzyna Mitrus
c72c6ba331
[ShapeInference] Improvements of GatherElements shape inference (#15264)
* GatherElements shape infer improvements

* Add new tests

* Update test error message
2023-01-24 10:20:28 +01:00
Pawel Raasz
9ee80d67b7
Review topk for shape inference aspects (#14890)
* Review TopK for:
- label and dimension propagation
- partial value and label propagation
- preserve partial value and labels
- add evaluate upper, lower and label

* TopK v1 use shape infer instead fallback
- update static shape inference tests

* TopK shape_infer return output shapes

* Add new way to get tensor data as shape
with custom data processing
- Update tail op to use new function
- Update topk op to use this function
- Add test for negative k

* Add missing include

* Fix compilation issues

* Add support for i4 and u4 element types in
get_raw_data_as

* Fix signed and unsigned and compile warnings

* Remove constexpr from InTypeRange::operator()

* Use forward reference for functor
- minor corrections in InTypeRange class

* Use shape)infer in evaluate
- fix TopK v3 ctor for input data validation

* Fix transformation tests to use correct type for k

* Fix f16 handling in get_raw_data_as

* Correct topk bounds evaluators

* Topk detect overlap for same size dimensions
As op specification not guarantee correct order of
several elements same value

* Remove evaluate bounds
required investigation if required then will be provided

* Remove bound evaluation leftovers

* Update get const data in slice ops
2023-01-24 12:38:08 +04:00
Yuan Hu
ea776672ba
[CPU] Allow external blob to be reallocated (#12029) 2023-01-24 09:30:07 +04:00