Commit Graph

1929 Commits

Author SHA1 Message Date
Maksim Proshin
39ba1ed03f [DOCS] Update reference in quantization_w_accuracy_control.md (#21337)
* Update quantization_w_accuracy_control.md

avoid 404

* Update quantization_w_accuracy_control.md
2023-11-29 09:40:25 +01:00
Katarzyna Mitrus
37bac6ebcd [Opset13][FP8][Spec] FakeConvert op specification (#21039)
* FakeConvert spec init

* Add spec files to the opset docs

* Remove apply_scale attribute and update inputs description

* Experimental op notice

* Update short description

* Update detailed description.

* Add BF16 type to supported inputs

* Update  note about "Fake"

* Add more details

* Add formula of the operation
2023-11-28 09:14:06 +01:00
Alexander Suslov
be5c755c32 migrate to new convert API (#21323) 2023-11-28 11:36:25 +04:00
Ilya Lavrenov
c241405c5e Update docs (#21326) 2023-11-28 11:26:09 +04:00
Maciej Smyk
4804ff8b1e [DOCS] Update of Sample Articles for master (#20957)
* Sample Articles Update

* Update get_started_demos.md

* Update get_started_demos.md

* Update get_started_demos.md

* Update get_started_demos.md

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* adding python code

* applying suggested changes

* Apply suggestions from code review

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

* Update get_started_demos.md

* fix notes

* fix synching of tabs

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
Co-authored-by: sgolebiewski-intel <sebastianx.golebiewski@intel.com>
2023-11-27 16:15:31 +01:00
Ivan Tikhonov
57d794c810 ConvertPrecision transformation: handle Assign, ReadValue and Variable (#21266)
* ConvertPresicion transformation: handle Assign, ReadValue and Variable

* revert debug code

* use correct commit for onednn_gpu

* codestyle
2023-11-27 18:34:31 +04:00
Karol Blaszczak
558e713043 [DOCS] fixes lts disclaimer master 2023-11-27 14:58:10 +01:00
Andrzej Kopytko
758524978b [DOCS] tabs styling (#21272) 2023-11-24 13:11:50 +01:00
Sun Xiaoxia
b7edd5df69 migrate threading related interface from API 1.0 to 2.0 (#21167)
* migrate threading related interface from API 1.0 to 2.0

* fix code style

* fix @ref issue in doc

* change <> to quotation marks

* restore threading related interface API 1.0

* restore the changes of legacy code
2023-11-24 10:52:44 +04:00
Anastasia Kuporosova
0137fd7008 [Docs][PyOV] add missing docs (#21201)
* [Docs][PyOV] add missing docs

* more dirs

* one more missed
2023-11-22 01:33:02 +04:00
Ivan Tikhonov
a329611349 Support dynamic shapes in ReadValue/Assign ops and MakeStateful transformation (#20404)
* Support for dynamic shapes in ReadValue/Assign ops and MakeStateful transformation

* fix unit tests

* codestyle

* fix warning

* fix visitors test

* Fix lowLatency transformation, fix functional tests

* fix LowLatency2

* codestyle

* Fix CPU/GNA tests

* fix shape inference of assign operation

* fix python API

* fix mypy error

* Fix read_value operation version in python API for opsets7-13

* Update python API and fix tests

* set the same Varibable obj to Assign/ReadValue in py API, disable fp16 memory tests

* Update shape inference methods of Assign, ReadValue; update tests; fix codestyle

* fix python codestyle

* fix tests

* Resolve review comments

* codestyle

* resolve review comments

* codestyle

* Update ReadValue op in kaldi frontend, fix GNA tests

* fix Assign/ReadValue bindings, fix read_value test

* Apply suggestions from code review

Co-authored-by: cecilia peng <cecilia.peng@intel.com>

* Fix functional tests, add ov::Type support as an argument for read_value py binding

* temporary disable test_query_state_write_buffer fp16 tests

* Fix backward compatibility with the IRs with ReadValue/Assign ops generated via prev versions of OV; fix func tests

* fix python test, support type as str in read_value/assign bindings

* fix model binding

* fix pre-commit tests: variables vector cleanup

* fix integration with cpu changes

* codestyle

* fix warning

* Fix type/shape validation for read_value op

* fix a type_prop test for assign op

---------

Co-authored-by: cecilia peng <cecilia.peng@intel.com>
2023-11-21 20:59:36 +04:00
Mateusz Mikolajczyk
54a68c8a13 [Opset13][pyAPI] Python API FakeConvert-13 (#21155)
* [Opset13][pyAPI] Python API FakeConvert-13

* Fix typo

* Add experimental warning

* Add missing py opset in docs

* Fix flake

* Apply suggestions from code review

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* Apply suggestions from code review

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Apply requested changes

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
2023-11-21 14:25:02 +00:00
Maciej Smyk
95accde9df [DOCS] README files for Samples + name update for Get Started for master (#21157) 2023-11-21 13:20:25 +01:00
Sebastian Golebiewski
90437f7efa Update reference to Supported Model Formats (#21216) 2023-11-21 13:18:38 +01:00
Sebastian Golebiewski
7150a98d95 Fix math formula in Elu_1 (#21203) 2023-11-21 12:14:25 +01:00
Sebastian Golebiewski
a530a53eee Fixing links in notebooks (#21208) 2023-11-21 12:09:19 +01:00
Sebastian Golebiewski
44d56b9dc7 [DOCS] New page design for notebooks (#20996)
New design and new directive for notebooks
2023-11-17 16:34:34 +01:00
Andrzej Kopytko
d29207e201 [DOCS] update benchmark files 2023-11-17 14:02:43 +01:00
Karol Blaszczak
fa0a6ab9d1 [DOCS] fix npu mention (#21147) 2023-11-17 13:50:05 +01:00
Tatiana Savina
c01fdc9276 [DOCS] Port release docs to master (#21154)
* update links (#21118)

* change install (#21117)

* deprecate deployment manager (#21089)
2023-11-17 13:47:00 +01:00
Sebastian Golebiewski
908fa51742 Fixing versions in Install Openvino (#21124) 2023-11-16 13:38:21 +01:00
Alexander Suslov
2a33f35c43 DOCS Update optimization docs with ov.save_model() instead of ov.serialize() (#20711)
* introduced ov.save_model(...) to the ptq code examples

* replied to comments

* fixed rendering

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-11-16 13:34:33 +01:00
Sebastian Golebiewski
bed6eeb94b [DOCS] final update of relnotes (#21115)
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-11-16 12:49:48 +01:00
Andrzej Kopytko
fa1ca27576 [DOCS] GraphJs refactor (#21110)
* [DOCS]InitGraphChanges

* [DOCS] Benchmark files update

* [DOCS] update files from 0635

* [DOCS] fix

* [DOCS ]fix2
2023-11-16 11:09:39 +01:00
Alexander Suvorov
023f6b8682 Update 2023.2.0 Selector Tool (#21097)
* Update selector tool

* update ov version title
2023-11-16 11:06:28 +01:00
Karol Blaszczak
7e5f491459 [DOCS] home-tile-removal (#21096) 2023-11-15 16:21:25 +01:00
Karol Blaszczak
4b078f698d [DOCS] sys req update (#20953) 2023-11-15 16:00:36 +01:00
Piotr Krzemiński
bb3ed2d42e [SPEC] Apply changes from release branch (#20986) 2023-11-14 06:56:06 +01:00
Maciej Smyk
5a04359200 [DOCS] Updating links for master 2023-11-13 12:23:23 +01:00
Tatiana Savina
e446dac727 [DOCS] Add content to about ov page (#21010)
* add about ov info

* fix format

* fill ov page
2023-11-10 16:28:09 +01:00
Tatiana Savina
8034d1795f change structure (#20988) 2023-11-09 15:03:01 +01:00
Sergey Lyalin
854158612f Scaled dot product attention (#20492)
* Added experimental ScaledDotProductAttention operation in opset12. Supported in PT FE for aten::scaled_dot_product_attention translation. Decomposed in the common optimizations as functional reference.

* Better ScaledDotProductAttention

- Moved decomposition to the decomposing transformation
- Implemented more ctors for the op
- Renamed is_causal to causal
- Shape/type inference native code instead of using decomposition
- Moved the op from opset12 to opset13
- Added Python wrapper for ScaledDotProductAttention

* Fix test that counts ops in the opsets

* Update src/core/src/op/scaled_dot_product_attention.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update src/core/src/op/scaled_dot_product_attention.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Move ScaledDotProductAttentionDecomposition from fusions to decompositions.

* Remove not used legacy shape inference in ScaledDotProductAttention

* Better namespace usage

* Register all nodes in ScaledDotProductDecomposition for correct tracking of nodes and running next mather passes on all new nodes.

* Don't use register_new_node_

* ScaledDotProductAttention specification (with an extra scale argument)

* Code style fix

* Scale input implementation for ScaledDotProductAttention

* Handle attention_mask=0 case in the op spec

* Better description of scale input

* N->M in scale description

* Code style fix, remove debug print.

* Apply suggestions from code review

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>

* Fix for case when is_causal is not passed

* Extended description of ScaledDotProduct op

* Better description in py op wrapper

* Basic shape propagation tests for ScaledDotProductAttention

* Added ScaledDotProductAttention to toc.

* Add op impl check

---------

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>
2023-11-08 20:17:13 +01:00
Maciej Smyk
fdaa4b5d03 [DOCS] Small fixes in articles for master (#20947)
* Fixes

* Update deployment_intro.md

* Update docs/articles_en/openvino_workflow/deployment_intro.md

Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com>

---------

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com>
2023-11-08 13:40:52 +01:00
Alexander Kozlov
0f260c2ccd [DOC]: Added INT4 weight compression description (#20812)
* Added INT4 information into weight compression doc

* Added GPTQ info. Fixed comments

* Fixed list

* Fixed issues. Updated Gen.AI doc

* Applied comments

* Added additional infor about GPTQ support

* Fixed typos

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Update docs/optimization_guide/nncf/code/weight_compression_openvino.py

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Applied changes

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Added table with results

* One more comment

---------

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2023-11-08 10:17:57 +04:00
Sebastian Golebiewski
ac1fb7b955 Fixing OS list in System Requirements for YUM (#20934) 2023-11-07 17:18:18 +01:00
Sebastian Golebiewski
3f7989a817 [DOCS] Fixing link in Get Started article (#20881)
* Updating Get Started section

Addressing JIRA ticket: 124289

* Update get_started.md
2023-11-07 14:37:24 +01:00
Karol Blaszczak
3036a3d249 [DOCS] improving the "conversion" section v2 (#20887)
adjustments to conversion and workflow
2023-11-06 18:17:44 +01:00
Sebastian Golebiewski
a554611644 Updating notebooks (#20865) 2023-11-06 10:08:58 +01:00
Anatoliy Talamanov
f890bf7930 Extend throughput benchmark with device CLI parameter (#20816)
* Extend throughput benchmark CLI parameters

* Added device name as the second CLI parameter with default CPU value

* Update samples/cpp/benchmark/throughput_benchmark/main.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Fix comments to review

* Modified python version
* Modified documentation

* Fix comments to review

* Fixed the comment
* Modified python doc
* Fixed device name handling in python version

* Update main.cpp

* Update throughput_benchmark.py

---------

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2023-11-03 09:57:04 +01:00
Anatoliy Talamanov
c20d52dc4f Extend sync benchmark CLI parameters (#20844) 2023-11-03 09:51:22 +01:00
Anastasiia Pnevskaia
3f5f923a70 [DOC] Update list of TF formats imported from memory. (#20834)
* Update list of TF formats.

* Minor correction.

* Added comment.

* Update docs/articles_en/openvino_workflow/model_preparation/Convert_Model_From_TensorFlow.md

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Model changed.

* Update docs/articles_en/openvino_workflow/model_preparation/Convert_Model_From_TensorFlow.md

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-11-02 17:31:08 +04:00
Nikolay Shchegolev
57571d36e6 [CPU] NMSRotated operation implementation. (#20410) 2023-10-31 12:10:52 +00:00
Ilya Lavrenov
da1f0199a0 Removed WA for static protobuf for vcpkg installation path (#20784) 2023-10-31 14:55:28 +04:00
Ilya Lavrenov
b13cb8ce12 Make RPM packages compatible with wide range of RHEL systems (#20762) 2023-10-31 10:25:35 +04:00
Sebastian Golebiewski
81dbe4aedd [DOCS] Fixing formatting in Model Preparation (#20752)
* Update model_preparation.md

* Update installing-openvino-from-archive-windows.md
2023-10-30 10:46:46 +01:00
Tatiana Savina
fbcb58127a fix headers (#20728) 2023-10-27 10:41:54 +02:00
Maciej Smyk
706d657637 [DOCS] Install Guide Update for master (#20677)
* missing info

* System Requirements

* Update installing-openvino-from-archive-macos.md

* system requirements update
2023-10-25 09:12:41 +02:00
Ilya Lavrenov
2b8827abd0 Updated urllib3 to resolve CVE (#20620) 2023-10-20 11:37:13 +04:00
Sebastian Golebiewski
818c78d80a [DOCS] Fix command for Building with Ninja (#20605)
* Fix command for Building with Ninja

Removing current directory from the command.

* Update docs/dev/build_windows.md

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-19 15:31:03 +04:00
Anastasiia Pnevskaia
be177021b0 Switching telemetry to opt-out and disabling telemetry in CI jobs (#20391)
* Added disabling telemetry script to linux azure job, added debug checks to convert_model.

* Telemetry disabling.

* Disabling telemetry.

* Config corrections.

* Config corrections.

* Update .github/workflows/mac.yml

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>

* Debug output.

* Win config correction.

* Win config correction.

* Debug output.

* Debug output.

* Added turning off telemetry to onnx azure tests config.

* Corrected config.

* Removed debug output.

* Switch telemetry to opt-out.

* Removed not needed blank lines.

* Text correction.

* Debug output.

* Remove changes from CI configs, add CI var to dockers.

* Config correction.

* Debug output.

* Config corrected.

* Readme corrected.

* Config changed.

* Config changed.

* Debug output.

* Required version changed.

* Remove debug output.

---------

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-10-19 15:26:21 +04:00