IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,664 Commits 38 Branches 54 Tags
7e25a49cae7d0be4d07d98ba79c1daa7c6edb7b6
Commit Graph

1945 Commits

Author SHA1 Message Date
Karol Blaszczak
6367206ea8 [DOCS] NPU articles (#21430) 
merging with the reservation that additional changes will be done in a follow-up PR
 2023-12-14 17:31:44 +01:00
Alexander Suvorov
9faf18b0ff Update 2023.2.0 Selector Tool with nightly archive (#21629) 
* Update selector tool

* Trigger CI
 2023-12-14 16:49:19 +04:00
Ilya Lavrenov
17008c9389 Escape pip command with apostrophe (#21645) 2023-12-14 10:29:38 +04:00
Maciej Smyk
3e2037c943 [DOCS] Troubleshooting note for WINOGRAD convolutions in GPU for master (#21623) 
* Update GPU.rst

* Update GPU.rst

* Update docs/articles_en/openvino_workflow/running_inference_with_openvino/Device_Plugins/GPU.rst

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
 2023-12-13 13:03:11 +01:00
Sebastian Golebiewski
82cdc116c1 Updating Interactive Tutorials (#21548) 2023-12-13 10:33:50 +01:00
Ivan Tikhonov
ff8d8a5b16 Introduced "reset_state" method to reset all model states in one line (#21595) 
* added reset_state method to simplify the user API

* using reset_state method in the tests
 2023-12-13 00:55:49 +04:00
Maciej Smyk
2f65827f9f [DOCS] Moving files to new location for master (#21575) 
* repo update

* repo update

* repo update

* Update LowPrecisionModelRepresentation.rst

* Update LowPrecisionModelRepresentation.rst

* Update CMakeLists.txt

* Update QuantizedNetworks.rst

* separate location for pypi publishing files

* Update src/bindings/python/CMakeLists.txt

fixing path in src/bindings/python/CMakeLists.txt

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
 2023-12-12 16:27:01 +04:00
Maciej Smyk
89e4cb4252 Update learn_openvino.rst (#21539) 2023-12-08 10:58:05 +01:00
Evgenya Nugmanova
dde7e70771 [DOCS] Reduce Min / Max -- Reducing empty tensor would result in an undefined behavior (#20736) 2023-12-07 13:06:02 +01:00
Wang, Yang
fd0809ead4 [AUTO] Enable round robin policy for cumulative throughput mode of AUTO plugin (#20439) 
* Add and implement the logic of property SCHEDULE_POLICY for MULTI plugin.

* Updated.

* Enable test case for schedule policy test.

* enable test case for property ov::intel_auto::schedule_policy.

* Update.

* Updated.

* Updated.

* Update.

* Update the lock logic here by considering the runtime fallback case.

* Update.

* Update.

* Update.

* Update default value of schedule policy to DEVICE_PRIORITY

* Enable the function test case for schedule policy.

* Add description for inference requests schedule policy within AUTO plugin cumulative mode.

* Updated.

* Python bindings for enum SchedulePolicy and property ov::intel_auto::schedule_policy.

* Update.

* Update.

* Update.

* Updated.

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
 2023-12-07 07:04:56 +01:00
Tatiana Savina
94d1d7a033 [DOCS] Add legacy notes pot (#21449) 
* add note to pot

* change header
 2023-12-04 16:36:03 +01:00
Anastasia Kuporosova
ca87784a29 [PyOV] Missed variable API in Model class (#21434) 
* [PyOV] Missed variable API in Model class

* fixes in model docstr and codestyle

* add test

* fix ci

* fix ci
 2023-12-04 15:44:23 +01:00
Tatiana Savina
f37cf22db8 add legacy note to mo section (#21432) 2023-12-04 10:19:38 +01:00
jmacekx
c759f8df86 [DOCS] update documentation build instruction (#21427) 2023-12-04 08:39:47 +01:00
Tatiana Savina
ad12f114f4 change wording (#21428) 2023-12-01 15:18:56 +01:00
jmacekx
54e61ac9f5 refactor docs build process (#21239) 2023-11-29 15:30:05 +04:00
Maksim Proshin
39ba1ed03f [DOCS] Update reference in quantization_w_accuracy_control.md (#21337) 
* Update quantization_w_accuracy_control.md

avoid 404

* Update quantization_w_accuracy_control.md
 2023-11-29 09:40:25 +01:00
Katarzyna Mitrus
37bac6ebcd [Opset13][FP8][Spec] FakeConvert op specification (#21039) 
* FakeConvert spec init

* Add spec files to the opset docs

* Remove apply_scale attribute and update inputs description

* Experimental op notice

* Update short description

* Update detailed description.

* Add BF16 type to supported inputs

* Update  note about "Fake"

* Add more details

* Add formula of the operation
 2023-11-28 09:14:06 +01:00
Alexander Suslov
be5c755c32 migrate to new convert API (#21323) 2023-11-28 11:36:25 +04:00
Ilya Lavrenov
c241405c5e Update docs (#21326) 2023-11-28 11:26:09 +04:00
Maciej Smyk
4804ff8b1e [DOCS] Update of Sample Articles for master (#20957) 
* Sample Articles Update

* Update get_started_demos.md

* Update get_started_demos.md

* Update get_started_demos.md

* Update get_started_demos.md

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

* adding python code

* applying suggested changes

* Apply suggestions from code review

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

* Update docs/articles_en/learn_openvino/openvino_samples/get_started_demos.md

* Update get_started_demos.md

* fix notes

* fix synching of tabs

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
Co-authored-by: sgolebiewski-intel <sebastianx.golebiewski@intel.com>
 2023-11-27 16:15:31 +01:00
Ivan Tikhonov
57d794c810 ConvertPrecision transformation: handle Assign, ReadValue and Variable (#21266) 
* ConvertPresicion transformation: handle Assign, ReadValue and Variable

* revert debug code

* use correct commit for onednn_gpu

* codestyle
 2023-11-27 18:34:31 +04:00
Karol Blaszczak
558e713043 [DOCS] fixes lts disclaimer master 2023-11-27 14:58:10 +01:00
Andrzej Kopytko
758524978b [DOCS] tabs styling (#21272) 2023-11-24 13:11:50 +01:00
Sun Xiaoxia
b7edd5df69 migrate threading related interface from API 1.0 to 2.0 (#21167) 
* migrate threading related interface from API 1.0 to 2.0

* fix code style

* fix @ref issue in doc

* change <> to quotation marks

* restore threading related interface API 1.0

* restore the changes of legacy code
 2023-11-24 10:52:44 +04:00
Anastasia Kuporosova
0137fd7008 [Docs][PyOV] add missing docs (#21201) 
* [Docs][PyOV] add missing docs

* more dirs

* one more missed
 2023-11-22 01:33:02 +04:00
Ivan Tikhonov
a329611349 Support dynamic shapes in ReadValue/Assign ops and MakeStateful transformation (#20404) 
* Support for dynamic shapes in ReadValue/Assign ops and MakeStateful transformation

* fix unit tests

* codestyle

* fix warning

* fix visitors test

* Fix lowLatency transformation, fix functional tests

* fix LowLatency2

* codestyle

* Fix CPU/GNA tests

* fix shape inference of assign operation

* fix python API

* fix mypy error

* Fix read_value operation version in python API for opsets7-13

* Update python API and fix tests

* set the same Varibable obj to Assign/ReadValue in py API, disable fp16 memory tests

* Update shape inference methods of Assign, ReadValue; update tests; fix codestyle

* fix python codestyle

* fix tests

* Resolve review comments

* codestyle

* resolve review comments

* codestyle

* Update ReadValue op in kaldi frontend, fix GNA tests

* fix Assign/ReadValue bindings, fix read_value test

* Apply suggestions from code review

Co-authored-by: cecilia peng <cecilia.peng@intel.com>

* Fix functional tests, add ov::Type support as an argument for read_value py binding

* temporary disable test_query_state_write_buffer fp16 tests

* Fix backward compatibility with the IRs with ReadValue/Assign ops generated via prev versions of OV; fix func tests

* fix python test, support type as str in read_value/assign bindings

* fix model binding

* fix pre-commit tests: variables vector cleanup

* fix integration with cpu changes

* codestyle

* fix warning

* Fix type/shape validation for read_value op

* fix a type_prop test for assign op

---------

Co-authored-by: cecilia peng <cecilia.peng@intel.com>
 2023-11-21 20:59:36 +04:00
Mateusz Mikolajczyk
54a68c8a13 [Opset13][pyAPI] Python API FakeConvert-13 (#21155) 
* [Opset13][pyAPI] Python API FakeConvert-13

* Fix typo

* Add experimental warning

* Add missing py opset in docs

* Fix flake

* Apply suggestions from code review

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>

* Apply suggestions from code review

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Apply requested changes

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
 2023-11-21 14:25:02 +00:00
Maciej Smyk
95accde9df [DOCS] README files for Samples + name update for Get Started for master (#21157) 2023-11-21 13:20:25 +01:00
Sebastian Golebiewski
90437f7efa Update reference to Supported Model Formats (#21216) 2023-11-21 13:18:38 +01:00
Sebastian Golebiewski
7150a98d95 Fix math formula in Elu_1 (#21203) 2023-11-21 12:14:25 +01:00
Sebastian Golebiewski
a530a53eee Fixing links in notebooks (#21208) 2023-11-21 12:09:19 +01:00
Sebastian Golebiewski
44d56b9dc7 [DOCS] New page design for notebooks (#20996) 
New design and new directive for notebooks
 2023-11-17 16:34:34 +01:00
Andrzej Kopytko
d29207e201 [DOCS] update benchmark files 2023-11-17 14:02:43 +01:00
Karol Blaszczak
fa0a6ab9d1 [DOCS] fix npu mention (#21147) 2023-11-17 13:50:05 +01:00
Tatiana Savina
c01fdc9276 [DOCS] Port release docs to master (#21154) 
* update links (#21118)

* change install (#21117)

* deprecate deployment manager (#21089)
 2023-11-17 13:47:00 +01:00
Sebastian Golebiewski
908fa51742 Fixing versions in Install Openvino (#21124) 2023-11-16 13:38:21 +01:00
Alexander Suslov
2a33f35c43 DOCS Update optimization docs with ov.save_model() instead of ov.serialize() (#20711) 
* introduced ov.save_model(...) to the ptq code examples

* replied to comments

* fixed rendering

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
 2023-11-16 13:34:33 +01:00
Sebastian Golebiewski
bed6eeb94b [DOCS] final update of relnotes (#21115) 
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
 2023-11-16 12:49:48 +01:00
Andrzej Kopytko
fa1ca27576 [DOCS] GraphJs refactor (#21110) 
* [DOCS]InitGraphChanges

* [DOCS] Benchmark files update

* [DOCS] update files from 0635

* [DOCS] fix

* [DOCS ]fix2
 2023-11-16 11:09:39 +01:00
Alexander Suvorov
023f6b8682 Update 2023.2.0 Selector Tool (#21097) 
* Update selector tool

* update ov version title
 2023-11-16 11:06:28 +01:00
Karol Blaszczak
7e5f491459 [DOCS] home-tile-removal (#21096) 2023-11-15 16:21:25 +01:00
Karol Blaszczak
4b078f698d [DOCS] sys req update (#20953) 2023-11-15 16:00:36 +01:00
Piotr Krzemiński
bb3ed2d42e [SPEC] Apply changes from release branch (#20986) 2023-11-14 06:56:06 +01:00
Maciej Smyk
5a04359200 [DOCS] Updating links for master 2023-11-13 12:23:23 +01:00
Tatiana Savina
e446dac727 [DOCS] Add content to about ov page (#21010) 
* add about ov info

* fix format

* fill ov page
 2023-11-10 16:28:09 +01:00
Tatiana Savina
8034d1795f change structure (#20988) 2023-11-09 15:03:01 +01:00
Sergey Lyalin
854158612f Scaled dot product attention (#20492) 
* Added experimental ScaledDotProductAttention operation in opset12. Supported in PT FE for aten::scaled_dot_product_attention translation. Decomposed in the common optimizations as functional reference.

* Better ScaledDotProductAttention

- Moved decomposition to the decomposing transformation
- Implemented more ctors for the op
- Renamed is_causal to causal
- Shape/type inference native code instead of using decomposition
- Moved the op from opset12 to opset13
- Added Python wrapper for ScaledDotProductAttention

* Fix test that counts ops in the opsets

* Update src/core/src/op/scaled_dot_product_attention.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Update src/core/src/op/scaled_dot_product_attention.cpp

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>

* Move ScaledDotProductAttentionDecomposition from fusions to decompositions.

* Remove not used legacy shape inference in ScaledDotProductAttention

* Better namespace usage

* Register all nodes in ScaledDotProductDecomposition for correct tracking of nodes and running next mather passes on all new nodes.

* Don't use register_new_node_

* ScaledDotProductAttention specification (with an extra scale argument)

* Code style fix

* Scale input implementation for ScaledDotProductAttention

* Handle attention_mask=0 case in the op spec

* Better description of scale input

* N->M in scale description

* Code style fix, remove debug print.

* Apply suggestions from code review

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>

* Fix for case when is_causal is not passed

* Extended description of ScaledDotProduct op

* Better description in py op wrapper

* Basic shape propagation tests for ScaledDotProductAttention

* Added ScaledDotProductAttention to toc.

* Add op impl check

---------

Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
Co-authored-by: Mateusz Mikolajczyk <mateusz.mikolajczyk@intel.com>
 2023-11-08 20:17:13 +01:00
Maciej Smyk
fdaa4b5d03 [DOCS] Small fixes in articles for master (#20947) 
* Fixes

* Update deployment_intro.md

* Update docs/articles_en/openvino_workflow/deployment_intro.md

Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com>

---------

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com>
 2023-11-08 13:40:52 +01:00
Alexander Kozlov
0f260c2ccd [DOC]: Added INT4 weight compression description (#20812) 
* Added INT4 information into weight compression doc

* Added GPTQ info. Fixed comments

* Fixed list

* Fixed issues. Updated Gen.AI doc

* Applied comments

* Added additional infor about GPTQ support

* Fixed typos

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Update docs/optimization_guide/nncf/code/weight_compression_openvino.py

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Applied changes

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Added table with results

* One more comment

---------

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
 2023-11-08 10:17:57 +04:00