Commit Graph
141 Commits
Author SHA1 Message Date
Ilya Lavrenov d6c2a10b38 Merge Linux CC + static build + clang compiler (#20243)
* Merge Linux CC + static build + clang compiler

* Improvements

* Fixes
2023-10-06 00:30:11 +04:00
Ivan Tikhonov 3d6fb85a99 Model builders refactoring: rename dirs, targets, file names (#19885)
* Model builders refactoring

* Apply review comments

* resolve review commets: update cmake target names

* fix build: use correct headers

* fix headers

* fix build

* fix docs
2023-10-04 18:08:24 +02:00
Edward Shogulin ae3b19d034 [LPT] [NPU] Multiply support (#19859)
* [LPT] [NPU] Multiply support

* [LPT] [NPU] Multiply support documentation

* 1) FakeQuantize support 2) refactoring

* [LPT] DisableCleanup attribute + cleanup transformations extension

* [LPT] DisableCleanup usage

* [LPT] Tests infrastructure support

* [LPT] infrastructure quick fix

* [LPT] Recurrent Cell Transformation fix

* refactoring & comment fixes
2023-10-03 15:31:33 +01:00
andreyanufr b73b2502b1 Introduce NF4 data type (#19900)
* NF4 reference initial commit

* Compilable version.

* Executable NF4.

* Fixed nf4 unpacking.

* 1) Fixed warnings with nf4.
2) Removed unused functions.

* Added one test for nf4.

* Fixed code-style errors.

* Fixed code-style errors.

* Fixed NamingConventionCheck errors.

* Fixed test with nf4.

* Fixed windows compilation.

* Fixed casting warning.

* Fixed incorrect changes.

* Changed order of elements in nf4 pack/unpack.

* 1) Made Convert only on direction nf4->other type.
2) Applied reviewers suggestions.

* Fixed code style.

* Fised code style.

* 1) Added array header.
2) Added Bitsandbytes to third-party-programs.txt.

* 1) Removed unused code.
2) Fixed style typos.
3) Revert submodule version.

* Added test for nf4 compression.

* NF4 test refactoring.

* Added cpp tests for NF4.

* Removed model compilation from NF4 tests.

* Reverted submodule version.
2023-09-28 20:56:57 +04:00
Anton Voronov 3ce48fc3d6 Fixed OV static build issues (#19976) 2023-09-26 10:23:00 +04:00
Evgeny Kotov d6d6888d7a LPT opset12::Pad negative indexes support (#19430)
* changed unit tests

* add unit tests; fixed

* code review fixes

* remove debugging

* remove debug code

* add tests to ov_cpu_func_tests

* add negative padding tests to ov_gpu_func_tests

* code review fixes: change point to check positive indexes; check Pad mode in the list of currently supported

* code review fix: move check in canBeTransformed
2023-09-25 18:59:16 +00:00
Ilya Lavrenov 35a0706dff Replaced several cmake utilities with new ov_ prefix (#19819)
* Replaced several cmake utilities with new ov_ prefix

* Replaced several cmake utilities with new ov_ prefix
2023-09-14 16:22:50 +04:00
Edward ShogulinandKarol Blaszczak 16adb01810 [LPT] SpaceToBatch & BatchToSpace implementation (#19660)
* [LPT] SpaceToBatch & BatchToSpace implementation

* Update docs/IE_PLUGIN_DG/plugin_transformation_pipeline/low_precision_transformations/pipeline/step3_main.md

* comments: fixes & refactoring

* rebase fix

* Update docs/IE_PLUGIN_DG/plugin_transformation_pipeline/low_precision_transformations/pipeline/step3_main.md

* rebase fix

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-09-14 08:16:04 +01:00
Ilya ChuraevandIlya Lavrenov 4df4ea9b31 Move ngraph function to new api (#19728)
* Moved ngraphFunctions to new API

* Fixed code style

* Fixed build function

* Fixed cpu unit tests

* Fixed code style

* Fixed transformation tests

* Fixed code style

* Fixed build

* Fixed LP tests

* Fixed build all for macOS

* Fixed more issues

* Fixed some func tests

* Try to fix CPU tests

* Revert incorrect change

* Try to fix tests

* Fixed merge conflicts

* Remove redundant headers

* Update src/tests/ngraph_helpers/ngraph_functions/src/non_max_suppression.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-14 10:57:23 +04:00
Ivan Tikhonov d0213301a5 Transformations: API 2.0 transition part 3 for LPT transformations (#19610)
* lpt transformations: transition to api 2.0, ngraph -> openvino

* use ov namespace for lpt transformations

* fix low_precision usings

* includes refactoring

* delete RecurrentGraphRewrite and RecurrentMatcher as unused classes

* use ov header for itt; delete the disabled test

* delete the unused function

* suppress doxygen warning

* fix link in the documentation
2023-09-13 12:30:31 +00:00
Ilya Churaev 1d62f0141d Rename cmake ie_ macros and ie_parallel script (#19606)
* Rename cmake ie_ macros and ie_parallel script

* Add warning messages
2023-09-05 19:31:52 +02:00
Ivan Tikhonov 38cf4764cb Transformations: API 2.0 transition part 2 (#19475)
* Transformation component API 2.0:part 2

* Refactoring

* fix build
2023-08-30 14:28:20 +02:00
Ivan Tikhonov 0f9734aaa7 Transformation tests API 2.0: part 1 (#19366)
* API 2.0 replace ngraph headers and namespaces in CPU, LPT etc transformations tests

* revert the incorrect renaming

* function -> model in arm transformation tests
2023-08-27 18:52:03 +02:00
Edward Shogulin 318009f8d5 [LPT] MoveFakeQuantize: Q/DQ pattern identification generalization (#18945)
* [LPT] MoveFakeQuantize Q/D pattern dequantization generalization

* [LPT] MoveFakeQuantize Q/D pattern dequantization generalization: quantize op convert
2023-08-17 17:07:51 +01:00
Edward Shogulin b76fc24824 [LPT] Unexpected quantisation level fix (#18888)
* [LPT] Unexpected quantisation level support

* [LPT] Unexpected quantisation level support - extension for weights

* [LPT] Unexpected quantisation level support - extension for weights + tests

* refactoring: compilation fix
2023-08-04 15:02:12 +01:00
Vladislav Golubev 2b5ca40eb6 [CPU] MatMul: move i8 compressed weights constant folding to the plugin (#18718)
- Reused LPT pass for ConstantFold pass disabling for decompression subgraph
- GraphOptimizer: added FuseFCAndWeightsDecompression transformation
- Transformation pipeline adapted to the MatMuls with compressed weights
- Added MoveFCReshapeToWeights CPU transformation
2023-07-31 12:44:09 +04:00
Ilya Lavrenov 700677c5c6 Less argressive chages (#18591) 2023-07-18 19:54:00 +04:00
Oleg Pipikin b211767280 Consolidate common test utils targets (#18385)
* Consolidate test util targets

* Fix code style

* Fix 1

* Fix code style
2023-07-17 11:59:13 +00:00
Evgeny KotovandIvan Tikhonov bfe8899839 initial fixes (#18508)
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-14 04:53:54 +02:00
Oleg Pipikin d6c0289008 Move common test utils (#18339)
* Move common test utils

* Apply comments

* Comments 2
2023-07-10 12:48:24 +00:00
Luwei Zhou 0b3a004825 [CPU] Combine DQ scales and multiply into DQ scales. (#17276)
* Fix the multible multiply case.

* Add test case.

* Fix CI issues.

* Fix the dynamic shape FC kernel creating issue.

* Expose FC weight with original linear layout to CPU graph.

* Apply review comments.

* Apply review comments.

* Applied review comments.
2023-07-04 13:38:25 +02:00
Oleg Pipikin 48b47e754f Rename ngraph with ov in common_test_utils (#17905)
* Rename ngraph with ov in common_test_utils

* Fix comments

* Delete opset includes from commonTestUtils

* Fix CI and code style

* Apply comments

* Fix CI and apply comments
2023-06-23 09:51:47 +02:00
Pavel Esir cb63b39c72 do not change names while replacing FQ nodes (#17936)
* do not change names while replacing FQ nodes

* more solid fix

* even more solid fix

* fix UT failure
2023-06-16 15:51:50 +04:00
Pavel Esir aa32ff1df3 keep Const + DecompressionConvert for CPU (#15930)
* keep Const+DecompressionConvert pattern for CPU

* temporary disabled failing unit-tests

* disable CF by modifying bounds evaluate as well; minor corrections

* added TODOs with ticket numbers

* join const+decompression markings

* minimized convert_precision.cpp changes

* minor corrections

* refactor fp16 transformations: moved into separate fp16_compression folder

* style-fix

* minor fixes

* do not disable evaluate and CF in shape path

* safer disabling of Const conversion

* style-fix and minor corrections

* restore original placement of ConvertPrecision
2023-06-15 13:07:22 +04:00
Edward Shogulin 43d67b0a32 [LPT] StridedSlice dequantization improvement (#17563)
* [LPT] StridedSlice dequantization improvement

* review comments: refactoring & simplification
2023-06-02 08:47:36 +01:00
Ilya Churaev ea04f8217d Mark as deprecated nGraph API (#17647)
* Mark as deprecated nGraph API

* Fixed code style

* Added IN_OV_LIBRARY define

* Suppress warnings for log

* Suppress warning

* Updated nGraph headers

* Fixed build for macOS

* Fixed lpt and snippets

* Fixed build all on macOS

* Suppress some warnings

* Fixed some new warnings

* Fixed new warnings

* Try to fix some warnings

* More warnings

* Soome change

* Suppress more warnings

* Suppress warnings for transformations

* Suppress warnings for LPT

* One more fix

* Suppress more warnings

* Try to fix opset error

* Remove opset constructor

* Cannot fix opset warning

* Suppress warnings for offline transfromations

* Fixed some warnings for Windows

* Fixed code style

* Suppress some warnings for onnx FE

* Revert "Suppress some warnings for onnx FE"

This reverts commit 75d23b64fc.

* Revert "Fixed code style"

This reverts commit c6eba63116.

* Revert "Fixed some warnings for Windows"

This reverts commit 23d7ed88b6.

* Revert "Suppress warnings for offline transfromations"

This reverts commit 0b9f6317bf.

* Revert "Cannot fix opset warning"

This reverts commit 19ea658639.

* Revert "Remove opset constructor"

This reverts commit 06afb1bc20.

* Revert "Suppress warnings for LPT"

This reverts commit 58b1c0f5a0.

* Revert "Suppress warnings for transformations"

This reverts commit f8bb9814a1.

* Revert "Suppress more warnings"

This reverts commit f9f0da9acb.

* Revert "Soome change"

This reverts commit e545d4984e.

* Remove deprecation for ngraph::OpSet and FactoryRegistry
2023-06-01 12:44:28 +04:00
Oleg Pipikin ce82fc78df Revert code style formatting for lp transformation tests (#17437) 2023-05-10 14:44:16 +01:00
Edward Shogulin 000311d72e LPT cmake warning flag was removed (#17358) 2023-05-08 09:03:40 +04:00
Edward Shogulin 9c3186b243 [LPT] Concat: different branch precisions support (#17330)
* [LPT] Concat: different branch precisions support
2023-05-07 11:38:32 +01:00
Edward Shogulin e593cf8545 [LPT] Precision restriction customization extending (#17147)
* [LPT] Precision restriction customization extending

* comments fix: refactoring
2023-04-26 13:29:09 +01:00
Vladislav Golubev a8278ba4a6 [LPT] FQ reference implementation reused in foldFakeQuantize function (#17096)
* [LPT] reused reference FQ implementation in fold_fake_quantize

* [LPT] Removed legacy parameters

* Added plugin tests with per-channel FQ for GrConv wo reshape

* Apply folding only in the case when FQ data input is constant

* EliminateFQ fix
2023-04-25 14:08:01 +01:00
Vladislav Golubev f410658d32 [LPT] AddTransformation fix (#17076)
* [LPT] AddTransformation: constants on 0's input support

* AddTransformation: new test instances

* codestyle
2023-04-24 12:15:01 +01:00
Edward Shogulin a3f14366d9 [LPT] Extending EliminateFakeQuantize transformation (two interval boundaries) (#17140)
* [LPT] EliminateFakeQuantize extending

* tests

* folding quick fix
2023-04-24 11:58:00 +01:00
Vladislav Golubev f100c36ac9 [LPT] Revert changes in fold_reshape (#17068) 2023-04-20 11:43:59 +01:00
Vladislav Golubev 00a4fc514c Review comments applied (#16856) 2023-04-19 10:11:47 +01:00
Vladislav Golubev e6341917cd [LPT] PullReshapeThroughDequantization transformation fix (#16395)
* PullReshapeThroughDequantization fix

* Added a test-case
2023-04-18 15:22:31 +01:00
Edward Shogulin 8bdc5bc85f [LPT] Support ONNX quantized models coming from ORT PTQ (#14811)
* [LPT] FakeQuantize fuse

* GPU & CPU tests alignment

* refactoring & comments

* doc quick fix

* quick fix
2023-04-14 21:22:55 +00:00
Vladislav Golubev 98afdc848a [LPT] ConvolutionTransformation: support for a new per channel dequantization representation (#16687)
* [LPT][TESTS] GrConv: added test cases with per channel dq on weights and without reshape

* FoldFQ: don't transform FQ with quantization by several dimensions

* ConvolutionTransformation: supported GrConv with per channel dq on weights and without reshape

* fold_reshape: refactoring
2023-04-11 14:07:23 +02:00
Vladislav Golubev 5f416dc4d2 [LPT] Introduced BiasAttribute (#16781)
* Extended check on ConvSum fusing

* [LPT] Introduced 'bias' rt attribute

* [CPU][TESTS] Added FQLayerDQBias tests
2023-04-06 16:01:04 +00:00
Oleg Pipikin 1c564226f3 Deprecate util functions in public api (#16716)
* Deprecate util functions in public api

* Add deprecation suppression for usage inside openvino

* Fix clang-format

* Fix1
2023-04-06 06:32:04 +04:00
Edward Shogulin fb24e91416 [LPT] NNCF GroupConvolution 5D on weights support (#16336)
* [LPT] NNCF GroupConvolution 5D on weights support

* PullReshapeThroughDequantization rollback
2023-03-23 13:24:10 +00:00
Xuejun Zhai 8509d0dd82 [Deprecated API] remove version (#16426)
* [Remove version] Remove version from py openvino

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Modify caused by remove version

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix clang format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Revert "Fix clang format issue"

This reverts commit 132787286f.

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix merge conflict error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-03-22 16:09:14 +01:00
Xuejun Zhai a9bd5f741d Xuejun/remove api model (#15924)
* [Remove APIs] remove api m_transformation_callback

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove api run_on_function(), replaced by run_on_model()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove set_callback(), use get_pass_config() to configure transformation pipeline

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] remove api add_matcher()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remove APIs] Fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix formast issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix merge master error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI compiler error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Update ONNX Runtime from rel-1.8.1 to rel-1.14.0

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Revert "Update ONNX Runtime from rel-1.8.1 to rel-1.14.0"

This reverts commit e31a9e04b7.

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-03-17 10:44:28 +04:00
Tingqian Li fdc2664b24 fix special FQ node (#14594)
* fix special FQ with zero range in quantized models

* fix format & comments

* Add test case

* remove dot interval test case from smoke_LPT/FakeQuantizeTransformation.CompareFunctions

* Remove dot interval gpu test case because Pooling is also folded

* handle review comment

* fix code style

* update docs

* remove fold_zero_multiply
2023-03-15 10:13:29 +00:00
Xuejun Zhai 91df0a8aa9 [API remove] remove variantImpl & variantwrapper related class/interfaces (#15580)
* [API remove] remove variantImpl & variantwrapper related class/interfaces

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove api] fix python compiler issue caused by deprecated varient

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-17 16:31:26 +04:00
Pawel Raasz d32da828b4 Review scatter nd update class for shape inference aspects (#15610)
* Review interval shape and labels propagation

* Review shape infer template implementation
- add test for default ctor

* Add evaluate upper, lower and label
- add new default label evaluator which propagates labels
from inputs list

* default_label_evaluator for 0 input only is wrapper for
generic evaluator implementation

* Use default_label_evaluator in ScatterUpdate

* Fix build issues
2023-02-16 13:49:19 +01:00
Mateusz Tabaka 9a540e61dc Don't use could_propagate in MarkDequantizationSubgraph (#15325) 2023-02-13 11:28:38 +01:00
Vladislav Golubev b8a7b3bb43 Cleanup & refactoring (#15588) 2023-02-13 10:50:46 +01:00
Vladislav Golubev 6630ae82d2 [LPT] Avoid AddTransformation for the cases which introduce Infinite constants after math calculations (#15496) 2023-02-08 13:06:24 +00:00
Ilya Lavrenov 1f3e469c5e Added -Wall for Clang and GCC (#15513)
* Added -Wall for Clang and GCC

* Fixes

* Don't use /J

* Fixed warnings

* Fixed warnings

* More fixes

* Fixed for MSVC

* Fixed more warnings on Windows

* Suppressed some warnings in template plugin

* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp

* Added suppression for PT FE

* Suppressed warnings in TF FE

* Suppressed warnings on Core unit tests

* Suppress warnings in python

* Suppressed Windows warning for 3rd party modules

* Suppresed one more warning
2023-02-08 15:01:00 +04:00