* [GPU] Added common exec mode hint and gpu support
* Add ov::inference precision and update usages. Deprecate ov::hint::inference_precision property
* [GPU] Execution mode tests and fixes
* Fixed code style
* Moved execution_mode test to common. Fixes for python API
* Remove deprecations for hint::inference_precision and just keep both
* Fix test
* WIP
* update input validation
* upsample_nearest2d and upsample_bilinear2d support
* support leaky_relu add test for inplace relu
* update tests, add handler for ListConstruct
* Do not create extra outputs in main body
* add positive case with non-default value
* update testing
* update test, handle non constant size and scale
* remove ie_device
* add aten::group_norm support
* refactoring
* Enable aten::reshape_as operator and add layer test
* more tests
* Fix typo in test
* Resolve conflicts
* fix code style
* expand init version
* expand_as and tests
* add transposed convolutions support
* add tests
* initial support pad
* add circular
* update for differenced in rang
* cleanup
* refactor
* more tests
* apply review comments
* Add split+listunpack transformation
* Add split+getitem transformation
* Add test cases
* fix typo
* Minor fixes
* Apply suggestions from code review
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Apply suggestions from code review
* Small fix
* Support converting models without freezing
* support BoolTensor and masked_fill
* add support aten::rsqrt and test for sqrt
* add cumsum and type_as
* support clamp
* support more matrix operations
* add tests
* Add aten::adaptive_avg_pool3d and layer test
* Change to rank
* fix code style in utils.hpp
* Update src/frontends/pytorch/src/op_table.cpp
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* fix code style
* add tests
* add xfail
* remove unnecessary broadcast
* Changes required by style formater
* aten::_convolution_mode
* Changes requested by a reviewer
* remove code duplication
* add aten::unbind transformation
* full, zeros and ones
* Support getattr list and unrolling nested ifs
* Remove line change
* Enable back freezing in layer tests
* Add aten::norm operator and layer test
* Small fix in layer test
* add aten::roll
* add empty line
* Typo fix
* fix style
* fix style v2
* add pytorch frontend to wheel
* Support all types of numeric norms
* add check for dynamic shapes
* remove random change
* merge statements
* add min and max ops support
* aten::max and aten::min
* move axes range creation to utils
* add transformation for tuple results, update tests
* fix copyright
* aten::var
* add test and translation for numel
* ignore aten::clone
* Add layer test for aten::add operator
* Fix typo
* Remove redundant import
* Add parameter name in forward method
* fix code style
* apply review comments
* Add size+slice+listunpack transform
* Add append listunpack transformation
* Register transformation
* aten::where
* update realization
* Fix issue with getitem
* Fix getitem
* Add layer test for aten::view operator
* Add tests for listunpack
* add test for aten::div
* fix style
* update aten::adaptive_max_pool2d
* fix style
* add aten::floor_divide
* aten::addmm support alpha and beta with different dtype
* nonzero
* Change test name
* update test cases to include other dtypes
* aten::arange
* prim::max transformation for ListConstruct
* rename op
* generalize conv2d implementation for conv1d and conv3d
* aten::unsqueeze_ and tests for aten::unsqueeze (#70)
* add aten::le, aten::ge and tests for other tensor comparision ops (#74)
* add support trigonometry ops (#73)
* support aten::upsample_bicubic2d, aten::ceil, aten::floor (#72)
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* extend and add tests for avg_pool and max_pool
* extend tests and constant filling ops
* fix as_tensor and full ops
* aten::repeat
* fix code style
* aten::im2col (#61)
* aten::im2col
* remove debug prints, add number of elements check
* fix failed tests
* move helper function
* use split
* Update src/frontends/pytorch/src/op/im2col.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* fix code style
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Update src/frontends/pytorch/src/utils.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* fix code style
* revert removeinf floordiv, add floor_divide file
* Fix merge issue
* reduce code duplication
* refactor
* Add len operator with layer test
* update clamp to support mixed precision and add support torch.long for constants
* aten::selu
* add trunc mode to div
* add else statement
* Add test case to layer test
* Fix submodules (#88)
* update test file
* fix namings
* execute in fp64 and convert back to initial precision
* Revert set_output_size to master. Small fix in If validate
* Fix build and code style
* fix failed tests
* Add torchvision::nms operator and layer test
* Change requested by a reviewer
* Remove div test
* convert constants to input type
* Mark some cases in div tests as xfail (#93)
* Small refactoring (#94)
* Small refactoring
* Fix type
* Fix python codestyle
* Incremental fix code style (#95)
* Fix style (#96)
* Fix copyright
* Fix code style
* Branch clean up (#97)
* Optimize includes and force opset10 (#98)
* Optimize includes
* Force opset10 in pt fe
* Fix codestyle (#99)
* Fix style
* Fix clang codestyle
* Fix cerr with debug log
* Update src/bindings/python/src/pyopenvino/frontend/pytorch/decoder.cpp
* Add pytorch dependency only if pytorch frontend is enabled
* Update src/bindings/python/src/pyopenvino/CMakeLists.txt
* Add layer tests to precommit (#100)
* Add layer tests to precommit
* Remove accidentally added files
* Apply code style on layer tests
* batch norm tests and fixes
* move default weight and bias to else block
* reduce code duplication
* Changes requested by a reviewer
* Changes requested by a reviewer
* Remove dependency from pytorch in pyopenvino (#102)
* Remove dependency from pytorch when fe is disabled
* Change docstring
* Remove pytorch FE dependency from pyopenvino
* Apply codestyle (#107)
* Apply codestyle
* Remove commented line
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix mock FE test (#108)
* Fix mock PE test (#111)
* Revert changes in StridedSlice (#114)
* Small refactoring (#116)
* Small refactoring
* Fix codestyle
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply suggestions from code review
* Update src/frontends/pytorch/src/op/group_norm.cpp
* Fix cmake copyright define (#117)
* Update src/frontends/pytorch/src/op/arange.cpp
* Apply suggestions from code review
* Update build configs (#120)
* FIx build configs
* Update type cast in full.cpp
* Apply review feedback (#121)
* Apply suggestions from code review
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix issue after master merge (#122)
* Fix issue after master merge
* Fix build
Co-authored-by: eaidova <ekaterina.aidova@intel.com>
Co-authored-by: bszmelcz <bartosz.szmelczynski@intel.com>
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
Co-authored-by: sikorsl1 <leonard.sikorski@intel.com>
Co-authored-by: Leonard Sikorski <l.sikorski123@gmail.com>
Co-authored-by: Mateusz <mateusz.mikolajczyk@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add more type_prop tests for interval dims and labels
* Add setter for grid sample attributes
* Merge grid sample batch dims
* Add StaticShapeInferenceTest for GridSample
* Fix label test
* Use OpStaticShapeInferenceTest fixture in test
* Review slice ope for
- Interval dimension and label propagation
- add template shape inference with static shape test
- check preserve partial values on inputs
- check upper/lower evaluate
* Add bounds evaluation for inputs start, stop
* Share code between slice and strided slice
Use same function to calculate elements in step
* Add array includes
* Add to int64_t strides size
* Fix windows compile warnings
* Fix shape inference for unknown axes
* Remove empty lines in slice shape inference
* Correct slice static shape tests
* Use arrays of const chars to store literals
Remove and update exception messages for strided slice
* Fix slice test and apply review comments
* Fix compilation issues
* Fix ellipsis when there is not begin
* Fix get element type for const inputs
* Insert optional axes as const or dynamic param
* Remove temp vectors for dimensions calculation
* Revert set optional input in ctor
* Fix forward slicing for negative start and MAX end
Previously, reorder_input pass checked only output layouts of each node, with an assumption that the input/output ranks are same at that pass.
However in dynamic shape using ngraph shape infer, there are cases input / output ranks differ. In such cases, the reorder_input pass inserts reorder to the format of current node's output_layout in the input of the current node, which causes error.
Fixed the above behavior by applying set_preferred_input/output_layout.
* Fixed Windows Arm64 build
* Fixed linker warnings in docs
* Fixed Windowd ARM build
* Reverted changes in docs
* Added OpenVINO level macro to define CPU architecture
* Properly remove xbyak from reference kernels optimizations
* Added documentation for cmake functions
* Fixed samples build
* Added installation dir for host protoc
* Fixed installation stage for host_protoc
* Added build dir
* Fixed compilation on Apple
* cççç
* Fixed clang code-style
* Tely on CPU id from xbyak
* Fixed build
* Fixed compilation on mac
* Fixed compilation
* [TF FE] Support Group Convolutions
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Split cases of regular Convolution and GroupConvolution operations
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* fix checking if there are data nodes for operations with several outputs
* added unit-test
* added ports explicitly, removed redundant lambda
* typo in port
Update POT tool configs to use unified scales for concat by default.
Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>
Co-authored-by: Liubov Talamanova <liubov.talamanova@intel.com>
It allows to fix inference results mismatch for some models
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* added missed layout to string conversion
* added an unit test for layout_from_string
* added missing spaces around =
* replaced 95 with SCALAR
* moved layout_to_string into a new file
* changed to parametrized test
* [GPU] Use in-order queue for devices with dpas support
* [GPU] Don't query properties in inference time
Co-authored-by: Mingyu Kim <mingyu.kim@intel.com>
* Add ov::label_t alias and set it to uint32_t
to simplify conversion to tensor element type
* Fix clang formatting
* Fix one hot test to use label_t
* Remove label types alias duplicates
propagate using alias for label types
* Correct label type in transpose tests
* Define label_t in dimension
remove size_t usage as label type.
* Correct label type usage in Einsum and LSTM op's
* Correct label type usage in tracker transformation
scatter update and split op tests
* Correct usage label type in type_porp tests
- squeeze
- tile
- transpose
- variadic split
* Correct usage label type in type_porp tests
- squeeze
- transpose
- unsqeeze
- variadic split
* Remove excess Azure Pipelines steps
* Installed unzip inside Azure pipelibes
* Added --no-install-recommends
* Move ccache to build tools
* Added libffi-dev for python _stypes
* Exit if debian packages cannot be installed
* Added comment
* Install wget for cmake downloading
* Update Azure
* Try to fix samples tests on Debian Linux
* Fixes
* Moved env
* More refactoring
* Fixes
* Revert: bash => script back
* Fixed arm64 linux
* Fixed CUDA
* Fixed mac
* Try to fix
* Try to fix cuda
* Fixed CUDA
* Fixes
* Optimize Mac build
* Fixed windows
* Try to fix debian
* Build CC COLLECT
* Use ninja for CC
* Try to fix WinCC
* Apply suggestions from code review
* Fixed sample spath
* Update .ci/azure/windows_conditional_compilation.yml
* Apply suggestions from code review
* Fixed CC ON compilation with ninja
* Improvements
* Print CC header content
* Try to fix Ninja build for Win CC
* Added explicit dependency between targets
* Reverted changes in Windows CC Azure config
* Update cmake/developer_package/compile_flags/os_flags.cmake
* Support oneDNN3.0 API
* Use binary_mul post_opt instead of oscale channel-wise mask(2)
* Disable some post-opt fusing because of no eltwise scale API
eltw(non_linear)+eltw(linear), eltw+sum+eltw(linear)
* Fix hardwish issue in 3.0
hard coded hardswish parameter(2.7) is changed alpha and beta from user's required input.
Signed-off-by: hyunback <hyunback.kim@intel.com>