* [TF FE] Support TF1 While Control flow
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-style fix
* Update API for OpPlace to store back edge
* Fix build: no rvalue by reference passing
* Fix build issue: correct type
* Fix TF FE unit-tests
* Apply code-review feedback: remove unused vars
* Fix fusing complicated case of TF1 While
* Remove unused variable
* Update MO unit test
* Fix layer tests for While
* Handle Switch and NextIteration nodes connected directly
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use FindPython3.cmake
* Fixed compilation on macOS 14 with new core development tools
* Try to use Python3_SOABI instead of PYTHON_MODULE_EXTENSION
* Use Development.Module
* Keep specifying only Python3_EXECUTABLE
* Print PYTHON_MODULE_EXTENSION
* Added check for minimal cmake version for python API
* Returned Python3_INCLUDE_DIR for cross-compilation case
* Try to allow cmake older than 3.18
* Use build python interpreter to check cython dependency
* revert changes in .ci/openvino-onnx/Dockerfile
* removed unused code
* Fixed issue with variables scope
* Experiment: remove include dirs
* Corrected docs
* Use pybind11 function to set extension
* Revert "Experiment: remove include dirs"
This reverts commit 6f7f90211c.
* Refactor ConvolutionBackpropDataLayerTest, ConvolutionLayerTest, DeformableConvolutionLayerTest (#19810)
* Refactor ConvolutionBackpropDataLayerTest
* Refactor ConvolutionLayerTest
* Refactor DeformableConvolutionLayerTest
* Apply comments
* Apply comments
* Fix
* Updated minimum cmake version for Windows
* Simplified check
* Removed useless message status
* Use puiblic option
---------
Co-authored-by: Oleg Pipikin <oleg.pipikin@intel.com>
* [workflows/liux] Trying AKS runners
* Remove sudo usages
* Fix repositories path
* Well, adding debug output
* execution bit?
* more debug output
* using bash...
* We should use shell syntax for env variables in 'run' sections
* again, may be we should use bash...
* fix cloning path for openvino repo
* more debug output
* Trying to populate WORKSPACE var in other way
* Trying different WORKSPACE
* export ALL variables for samples tests
* Trying to put openvino build into correct directory
* Replace more occurences of BUILD_DIR...
* Use shell expansion instead of Actions syntax in run steps
* Skip unit test failures
* Oops, there's no pytest for MO unit tests
* Oops, typo
* Fix LAYER_TESTS_INSTALL_DIR variable expansion
* Fix LAYER_TESTS_INSTALL_DIR for new stages
* Replace all the varibles
* Comment out CCACHE_DIR
I want to test worst-case scenario
* Comment setup ccache step
* Revert "Comment out CCACHE_DIR"
This reverts commit 046663a9f1.
* Just checking something
* Update with new stages from master
* One more stage to fix
* Fix INSTALL_DIR again (new stages were merged to master?)
* Remove concurrency limit (for test purposes)
* Trigger one more pipeline
* Disable concurrency settings
* Trigger another build
* Disable ccache (for testing purposes)
* trigger another build to measure duration without ccache
* And one more test commit
* Return back ccache
* Testing new image
* Enable concurrency back
* Using new image
* And another image
* Trying build on the clean image
* Install git
Upstream ubuntu image doesn't have git
* Oops, forgot apt-get update
* Upstream Ubuntu image, but using ACR cache
* Remove debug output
* Use Ubuntu image from ACR cache for the rest of the stages
* Display version of ccache
* Swith to ubuntu 20 temporarily (I hope)
* Set CCACHE_TEMP_DIR outside of shared space
* Revert "Swith to ubuntu 20 temporarily (I hope)"
This reverts commit 2e53109d83.
* trying ccche nohardlink option
* Trying to disable ccache file cloning
* fix CCACHE_TEMPDIR
* Install git to Python unit tests stage
* Install libsnappy-dev as tests require it
* Install python to test stage
* Fix env vars syntax in few places
* Update docker image name
* Increase timeout for CPU tests
* Debug output - trying to find out what's wrong with test reports
* Change file name in debug-output 'find' command
* let's try shell syntax for upload artifact action...
It most likely won't work but I see strange output in the logs:
Error: No files were found with the provided path: /__w/openvino/openvino/install/tests/TEST*.xml
/runner/_work/openvino/openvino/install/tests/logs/failed/*.log
/runner/_work/openvino/openvino/install/tests/logs/crashed/*.log
/runner/_work/openvino/openvino/install/tests/logs/hanged/*.log
/runner/_work/openvino/openvino/install/tests/logs/interapted/*.log
/runner/_work/openvino/openvino/install/tests/logs/disabled_tests.log. No
artifacts will be uploaded.
So the first path is translated to the path inside the container
correctly and the rest are not O_o
* Revert "let's try shell syntax for upload artifact action..."
This reverts commit eb19b4f319.
* Leave just disabled_tests.log (as it is the only one present)
* Use my own directory instead of github.workspace
Inside-container path translation doesn't work for upload-artifact
actions (it works only for the first path, but not for the rest)
* Revert "Leave just disabled_tests.log (as it is the only one present)"
This reverts commit 4321827880.
* Okay, let's try hardcoded workspace path...
* Okay, path should be inside "official" workspace. Hardcode it
* Missed some variables, replace github.workspace to hard-coded value
* Remove debug output 'find' command
* Remove old-style cache setup
* Clean ccache stats after cmake
* Change docker image to the one with non-root user
* Oops, switch to Ubuntu 20
* Playing with concurrency group name
* Oops, forgot sudo for ninja installation
* Revert "Oops, forgot sudo for ninja installation"
This reverts commit a7e1730279.
* Revert "Oops, switch to Ubuntu 20"
This reverts commit 19fe75f4af.
* Revert "Change docker image to the one with non-root user"
This reverts commit 553116492d.
* Use Ubuntu 20 DockerHub image
* Trying to force apt-get packages not to wait for user input
* Make DEBIAN_FRONTED for all stages
* Update reason of skipped MO unit test
* Add DEBIAN_FRONTED to all jobs
* Fix environment variables expansion in newly-added stages
* Update .github/workflows/linux.yml
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Update .github/workflows/linux.yml
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Fix review comments
* More review comment fixes
* Remove DEBIAN_FRONTEND from Python Models job
* "Get tools versions" step is absent on master
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* trying with pytest
* update as per suggested
* pytest testing on compress_quantized_weights_test
* resolved warning of assert on tuple
---------
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* [TF FE] Use regular Convolution in case dynamic input channels
This solution is aligned with the legacy frontend but it has limitation.
This is a temporal solution until the core obtains ShapeOf evaluator.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unused variable from the test
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix unit-test
* Update mo unit-test
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Added check that nncf was imported.
* Added check that nncf was imported in MO.
* Added check that nncf was imported in MO.
* Apply suggestions from code review
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* Removed not needed import.
* Pylint fix.
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* Fixed output_model logic.
* Removed InputCutInfo, disabled input cut in ovc.
* Disabled output cut, added tests for setting shapes or types for not all inputs.
* Returned support of numpy type.
* Separated MO and OVC python API tests.
* Small corrections.
* Added output dir test, exceptions test.
* Tests fixed.
* Corrected extension param description.
* Corrected input description, minor code corrections.
* [PT FE] Use weight share switch in frontend
* Return static for function
* Update src/bindings/python/src/openvino/frontend/pytorch/ts_decoder.py
* Fix issue with quantized constants
* Add tests for shared
* Remove inits, update main one
* Fix stacklevel
* Testing wrong solution
* Testing test test
* Fix test test test test
* mo modules mo problems
* Xfail test that check stdout/err?
* not so correct solution to circular imports
* Fix or not to fix
* CMake magic, co-authors: my best team
* Fix package imports
* Fix tools inits
* Fix ovc tf
* Fix Q000
* Fix F401
* Fix linters
* Add save_model
* Remove LayoutMap
* Move test_utils to 'internal modules'
* First testing
* Missing Type
* Expand main namespace
* Change some more tests
* Add OVAny to namespace
* Add Constant and Parameter to namespace
* More tests changes
* Fix inits
* Add layout_helpers to main namespace
* Revert CMake and linux.yml with ovc
* Update main inits
* Remove MO from tools inits
* changes to init files
* Fix tests
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* [MO] compress_to_fp16=True by default (2dn attempt)
* fix unit-tests
* second round of fixin unit-tests
* set compress_to_fp16 default to True in ovc/cli_parser.py
* use save_model in mo_python_api_tests
* enforce compress_to_fp16=False in test_zero_copy
* selectively compress depending on the path user has chosen to generate IR
* corrected doc
* allow compress_to_fp16=False/True for ovc
* doc and unit-tests failing fix
* user save_model in ovc cli tool
* revert back serialize and compress_model but into main instead of moc_emit_ir
* cover more argument combinations for cli tool and convert_model
* Added Torchscript Backend
* First commit for backend with Torch FX Decoder
* Merging changes from Torch FX branch
* Torch FX initial fixes (Temporary)
* Fixed type/shape issues in Torch FX decoder
* Added translation for built-in getitem
* MaxPool update & Output shape fix (Torch FX)
* Torch FX graph outputs fix
* Torch FX support for sigmoid and slu_
* Torch FX graph module caching
* Torch Fx partitioner cache removed
* Torch FX initial getitem replacer added
* Index check for torch fx getitem replacer
* Debug print removed from partitioner
* Added environment variables for pytorch tracing mode and openvino device
* FX translation fix for getitem & getitem replacer removed
* Added checks for PyTorch tracing mode environment variable
* Adding compile mode for fallback
* Added more ops for resnet18
* Added a check for environment variable
* Generalized addmm to work with torchscript and torchfx
* Added the missing batch_norm.default translation
* fx_backend: include get_attr ops to the partitions
* AddeTODO note t to improvget_attr algorithm
* created function for adding get_attr nodes
* fx_backend: added aten.mul.Tensor, re-enabled aten.empty.memory_format
* fx_backend: Additional op support/improvement for Inception V3
* Added comment for fix 64-bit to 32-bit max int conversion
* fx_backend: Update for avg_poolnd to support 3 inputs
* Fixed erorr in decoder.py
* TorchFX caching fix
* Torch backend, op support for Stable Diff. & BERT
* Arranged ops in order and added torch tensor mapping
* Added support for more ops for super glue
* TorchFX: Initial permanent fallback
* TorchFX: New ops for improved TorchVision support
* TorchFX backend optimizations for partitioning and tmp fallback
* working operator updates for superglue
* Updates to operators for superglue
* Removed max.dim and stack
* Cleanup
* Cleanup
* Fixed a couple of syntax issues
* Fixed a couple of syntax issues
* Added missing method to TorchFX Decoder
* Added missing method to TorchFX Decoder
* Removed redundant code for transpose
* TorchFX: Initial StableDiffusion support
* PyTorch decoder ovtype to ctype fix for int64
* Added ops for distilbert
* Fixed few unnecessary include statements
* Seperated TorchFX and TorchScript decoders
* Modified import statements to reflect two decoders
* f64 fix for TorchFX
* Import fix for PyTorch backend modules
* TorchFX serialize graph for debugging (Temporary)
* Serialize and load back feature enabled for TorchFX
* Temporary optimization to remove Broadcast
* Temporary SoftmaxRehapeElimination pass is added
* TorchFX custom model cache directory
* PyTorch bitwise translation, conversion checks enabled
* Naming fix in make_list_construct
* TorchFX: Added comments to Softmax and Slice translations
* translate_chunk temporarily removed for TS backend
* Fixed linter issues
* Addressed clang formatting issues
* Fixed few more clang and linter issues
* Fixed tests to use ts_decoder
* Fixed naming convention issues
* Added missing import
* Added inlined_inputs to TorchScriptDecoder
* Added tests for torch fx backend
* Removed magic numbers in PyTorch decoder utils
* TorchFX decoder data type fix
* Added cast from size_t to int
* TorchFX output handling code cleanup
* TorchFX: Use detached input tensor
* Added missing cast from size_t to int
* Added static cast in group_norm
* Fixed casting issue in split
---------
Co-authored-by: ynimmaga <yamini.nimmagadda@intel.com>
Co-authored-by: Cavus Mustafa <mustafa.cavus@intel.com>
* WIP: parameters cleanup
* Removed debug output, fixed CLI
* Fixed python objects conversion
* Finally renamed mmap to share_weights
* Fixed TF conversion from a file or a directory
* Fixed obvious errors in unit tests
* Deleted layouts from OVC. Fixed most of the fails in ovc unit tests (there are still failures)
* Clenaup other references to layouts and fixed --version
* Fixed case when two model files are passed in TF case
* Fixed multiple model parts passing in ovc command line
* Tests fixed, support of unnamed input in cli parser.
* Remove convert_model from runtime.
* Changed silent to verbose.
* Removed transform param.
* Removed example_input, share_weights from ovc cli tool.
* Remove wrong change.
* Test fix.
* Code corrections.
* Returned comment.
* WA to fix process hanging after extension loading.
* Removed not needed code.
* Added comment.
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* [PT FE]: support nested inputs in example_inputs and arg dicts with different argtypes
* accept hande lists as inputs
* Update tools/ovc/openvino/tools/ovc/moc_frontend/pytorch_frontend_utils.py
* update tests and add comments in code
* fix for custom types in annotations and duplicate in mo
* Update tools/mo/openvino/tools/mo/moc_frontend/pytorch_frontend_utils.py
* [TF FE] Support Switch and Merge to fuse into If operation
It introduces support of TF1 control flow with Switch and Merge nodes.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add script for test model generation
* Fix code-style
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue with types
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review feedback: optimizations in utils
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply code-review remarks and cover more cases
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove commented code
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unused vars
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update MO unit-tests wit Switch-Merge case
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue: remove unused variable
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Implementation of MMAP for ONNX FE
* fix win offsets
* added virtual dtor to MappedMemory
* review remarks. part.1
* added disable mmap flag to MO
* added additional checks to mmap
* remove unnecessary const
* fix pybind default value
* Added args.disable_mmap = False to MO tests
* fixed MO test
* avoid global headers
* fix casting for win
* disable mmap for legacy frontends flow
* review remarks
* Fixed passing parameters
* added doc to MappedMemory and load_mmap_object
* Made MO cli parser independent from OVC, added OVC Pylint test, minor fixes.
* Small corrections.
* PyLint fixes.
* Added init files.
* PyLint fixes.
* Small correction.
* Removed OVC dependency from MO.
* Fixed MO unit tests.
* PyLint fixes.
* Unit tests fix.
* Returned MO unit tests.
* PyLint configs.
* Small correction.
* Moved offline_transformations to back.
* Moved offline_transformations to back.
* skip validation, always include cmake
* rm unconditional inclusion of zlib
* always include zlib
* correct path for builtin_extensions
* find builtin extensions recursively
* include test_utils always
* add logs for build_samples
* skip tests with dir accessing
* remove platform specification for samples build
* do not pkgconfig on win, use cmake generic on linux for samples
* rm make
* fix num_threads
* use bare numbers
* skip failing
* skip test_lrn_basic
* find zlib
* print error of downloading
* add linux pipeline
* do not save cache from PRs; add skipif only in GHA
* rm caching
* evaluate against a string
* do not include test_utils to the install dir
* Used pip wheel to build OpenVINO wheel
* Added convert_model() to openvino.runtime.
* Removed duplication of InputCutInfo, LayoutMap
* Switched Model Conversion API tests to convert_model from openvino.runtime.
* Small correction.
* Format correction.
* Small correction.
* Removed duplication of moc frontend files.
* Small correction.
* Removed duplication of cli_parser, offline_transformations.
* Code corrections.
* Removed code duplications.
* Removed code duplications.
* Updated codeowners.
* Switched layer tests to convert_model().
* Improvements
* Small correction.
* Caffe parser path fix.
* Added python api properly into deb / rpm packages
* Moved implementation to ovc tool.
* Moved implementation to ovc tool.
* Small correction.
* Use cmake -E variant from cmake 3.13
* Namespace fixes.
* Minor fixes.
* Pylint fixes.
* Fixed BOM file.
* Small corrections.
* Minor corrections.
* Minor fix.
* Error fixes.
* Added telemetry requirement.
* Improvements to fix CI
* Some refactoring
* Don't use developer package for scripts projects
* Added exception in case when MO is not imported.
* Removed exception from init.
* Removed changes from cmake.
* Added unit ovc tests, fixed minor errors.
* Added ovc unit tests to azure.
* Corrected imports.
* Fixed path to tests.
* Added missed files.
* Corrected github labels.
* Removed benchmark app from dev package.
* Small fix.
* Small corrections.
* Comment fixed.
* Removed changes from setup.py
* Removed not needed change.
* Removed duplicating unit tests.
* Removed wrong change.
* Removed not needed change.
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Added ovc tool test, corrected imports.
* Added legacy TF config test.
* Removed not needed files.
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* [PT FE]: use example input for dtype and rank detection, support unordered input dict
* Apply suggestions from code review
* restore old behaviour for old torch versions
* move info addition after parsing
* [MO][TF FE] Remove WA for supporting different TF formats
After providing direct support of all TensorFlow formats, we are ready to remove WA
that converts all unsupported formats to frozen protobuf using native TensorFlow
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Debug failure for LSTM multicell
* Reset default graph before entering session
* Remove temporal debug info
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Mark as deprecated nGraph API
* Fixed code style
* Added IN_OV_LIBRARY define
* Suppress warnings for log
* Suppress warning
* Updated nGraph headers
* Fixed build for macOS
* Fixed lpt and snippets
* Fixed build all on macOS
* Suppress some warnings
* Fixed some new warnings
* Fixed new warnings
* Try to fix some warnings
* More warnings
* Soome change
* Suppress more warnings
* Suppress warnings for transformations
* Suppress warnings for LPT
* One more fix
* Suppress more warnings
* Try to fix opset error
* Remove opset constructor
* Cannot fix opset warning
* Suppress warnings for offline transfromations
* Fixed some warnings for Windows
* Fixed code style
* Suppress some warnings for onnx FE
* Revert "Suppress some warnings for onnx FE"
This reverts commit 75d23b64fc.
* Revert "Fixed code style"
This reverts commit c6eba63116.
* Revert "Fixed some warnings for Windows"
This reverts commit 23d7ed88b6.
* Revert "Suppress warnings for offline transfromations"
This reverts commit 0b9f6317bf.
* Revert "Cannot fix opset warning"
This reverts commit 19ea658639.
* Revert "Remove opset constructor"
This reverts commit 06afb1bc20.
* Revert "Suppress warnings for LPT"
This reverts commit 58b1c0f5a0.
* Revert "Suppress warnings for transformations"
This reverts commit f8bb9814a1.
* Revert "Suppress more warnings"
This reverts commit f9f0da9acb.
* Revert "Soome change"
This reverts commit e545d4984e.
* Remove deprecation for ngraph::OpSet and FactoryRegistry