Maxim Vafin
2e29e048b5
Fix results validation ( #20246 )
...
* Fix results validation
* Remove pt quantization
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com >
* Refactor requirements
* Revert "Refactor requirements"
This reverts commit f78fe3d774roman.kazantsev@intel.com >
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com >
2023-11-23 14:41:13 +01:00
Maxim Vafin
64cc3a96bb
Restrict version of pytorch-quantization ( #20137 )
2023-09-28 23:11:41 +04:00
Mikhail Ryzhov
f85a276782
[GHA] Azure pip cache ( #20029 )
...
* switched PyTorch_Models
* fixed root issue
* upgrade pip
* set bash environments
* install pip deps
* added git installation
* added g++ deps
* added python-dev package
* get particular python-dev package
* fixed package name
* removed python-dev
* cython dep
* debug
* fixed inlude path
* test cache
* set home dir
* changed disk space calculation
* crosspipeline pip cache
* added tag for source builded deps
* immutable deps
* use commit id instead of tag
* Update .github/workflows/linux.yml
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com >
* fixed logs upload condition
* removed pip upgrade
* changed detectotron version
* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com >
* changed wheel installation way
* reset onednn
* added cleanup workload
* cleanup test
* fixed reqs install
* test cache depending on pip version
* syntax fix
* env overwriting test
* test env output
* fixed set env step
* move pip cahc initialization to step
* changed pip ver regexp
* set custom pip cahce for each step
* cleanup code and enabled test cleanup job
* test cleanup 2
* speedup removal
* check existed dir
* Enabled cache for samples job
* removed debug job
* changed way how to get pip ver
* improved pip version extration
* revert omz
* switched PyTorch_Models
* fixed root issue
* upgrade pip
* set bash environments
* install pip deps
* added git installation
* added g++ deps
* added python-dev package
* get particular python-dev package
* fixed package name
* removed python-dev
* cython dep
* debug
* fixed inlude path
* test cache
* set home dir
* changed disk space calculation
* crosspipeline pip cache
* added tag for source builded deps
* immutable deps
* use commit id instead of tag
* Update .github/workflows/linux.yml
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com >
* fixed logs upload condition
* removed pip upgrade
* changed detectotron version
* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com >
* changed wheel installation way
* added cleanup workload
* reset onednn
* cleanup test
* fixed reqs install
* test cache depending on pip version
* syntax fix
* env overwriting test
* test env output
* fixed set env step
* move pip cahc initialization to step
* changed pip ver regexp
* set custom pip cahce for each step
* cleanup code and enabled test cleanup job
* test cleanup 2
* speedup removal
* check existed dir
* Enabled cache for samples job
* removed debug job
* changed way how to get pip ver
* improved pip version extration
* revert omz
* review fixes
* remove cache files using atime
* mtime->atime
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com >
2023-09-28 22:21:32 +04:00
Maxim Vafin
f735999e7b
Improve testing for hf models ( #20017 )
2023-09-22 20:10:33 +00:00
Maxim Vafin
2151e5f979
[PT FE] Add tests for timm models ( #19997 )
...
* Add tests for timm models
* Apply suggestions from code review
* Some improvements
* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-22 10:34:07 +02:00
Maxim Vafin
058b45e608
[PT FE] Fix aten::repeat regression ( #19991 )
...
* Revert "[PT FE] Simplify repeat operation (#19926 )"
This reverts commit f926e0e392
2023-09-21 23:58:09 +02:00
Maxim Vafin
02f5b7a7e3
[PT FE] Add huggingface hub tests ( #19858 )
...
* [PT FE] Add huggingface hub tests
* Update requirements.txt
* natten can't be installed
* Remove librosa
* Add xfail and skip marks
* Remove t5
* Free up space
* Apply suggestions from code review
* Report free space
* Clean pip cache
* Temporarily disable det2 models
* More du info
* Remove tmp info
* More du stats
* Fix du report
* Optimize du
* Ignore error
* Finalize changes
* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-21 17:30:17 +02:00
Anastasiia Pnevskaia
215a2f435b
tf.Graph decoder accuracy fixes ( #19903 )
...
* Fixed outputs passing from decoder.
* Fixed get_variable method.
* Code style.
* Removed xfails from precommit models.
* Minor fix.
* Comment fixed.
* Added test.
2023-09-19 19:04:24 +02:00
Maxim Vafin
c10b45fe9e
[PT FE] Fix issue with http error when using torch.hub ( #19901 )
...
* [PT FE] Fix issue with http error when using torch.hub
* Mark failing models as xfail
* Remove incorrect model names
2023-09-18 17:04:39 +02:00
Roman Kazantsev
d90ceb93d1
[TF Hub][TF FE] Fix 5D case for FusedBatchNorm ( #19904 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-18 12:51:33 +00:00
Roman Kazantsev
df19699e3a
[TF Hub API][TF FE] Support TF Keras Model OOB without example_input ( #19892 )
...
* [TF Hub] Cover TF Hub use cases with adoption to OpenVINO
This is necessarily to demonstrate support of models programmed with TF Hub API
through OV notebooks.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
* Preserve original keras input and output tensor names
* Add tests with TF Hub API models
* No KerasLayer handling
* Handle specific signature
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-18 12:18:05 +00:00
Maxim Vafin
a4cbac3dee
[PT FE] Add tests for detectron2 models ( #19888 )
...
* [PT FE] Add tests for detectron2 models
* Fix names of tests
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com >
* Create secondary requirements file
---------
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com >
2023-09-18 13:40:40 +02:00
Maxim Vafin
3c762240f3
[PT FE] Add tests for torchvision models ( #19702 )
...
* [PT FE] Add tests for torchvision models
* Update tests/model_hub_tests/torch_tests/requirements.txt
* Apply review comments
* Clean tmp directory and make this separate job
* Update .github/workflows/linux.yml
* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-09-13 15:24:09 +04:00
Roman Kazantsev
d1a8c8f914
[TF Hub] Set seed for input data generation and fix integer input data ( #19765 )
...
* [TF Hub] Set seed for input data generation and fix integer input data
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
* Clean-up workflow
* Update precommit model scope
* Avoid legacy generator
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-13 00:30:39 +04:00
Roman Kazantsev
530da61a4e
[TF Hub] Fix compute output size issue in test ( #19719 )
...
It helps to get 4 new models passed and other 2 models failed with accuracy issue.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-11 12:14:09 +04:00
Roman Kazantsev
37f61551a3
[TF FE][TF Hub] Use ConcreteFunc input and output signatures ( #19690 )
...
* [TF Hub][TF FE] Preserve outputs of ConcreteFunction from signature and their names
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
* Fix naming and complete TODO
* Apply code-review: extra assert to check input_signature
* Fix inputs for fw
* Fix input data preparation and import convert_model
* Correct variable detection among all inputs
* Handle special input and output signature
* Fix adjust_saved_model_names
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-10 03:46:01 +00:00
Roman Kazantsev
63a6d4c41e
[TF Hub][GA] Set correct scheduler and model scope for regular validation ( #19658 )
...
* [TF Hub][GA] Set correct scheduler and model scope for regular validation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
* Remove empty line
* Update .github/workflows/linux.yml
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com >
* Correct a path to output html report
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com >
2023-09-06 22:51:31 +02:00
Roman Kazantsev
4f7ac430fc
[TF Hub][TF FE][GA] Establish regular validation for all TF Hub models ( #19649 )
...
* [TF Hub][TF FE] Establish regular validation for all TF Hub models
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
* Correct names of reports
* Simplify configuration
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-06 17:02:59 +02:00
Roman Kazantsev
023a2f462a
[TF Hub][Notebook] Secure future notebook models in the precommit ( #19652 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-06 18:43:30 +04:00
Roman Kazantsev
188d53d813
[TF Hub][TF FE] Clean-up all downloaded files for TF Hub models validation ( #19612 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-05 13:07:13 +00:00
Roman Kazantsev
4eadef9e61
[TF Hub][TF FE] Make TF Hub validation more robust and add convenient xfail test marking ( #19596 )
...
* [TF Hub][TF FE] Use multiprocessing based tests for TF Hub validation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
* Fix import and initialization
* [TF Hub][TF FE] Make TF Hub validation more robust and add convenient marking for failing cases
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-05 09:41:01 +04:00
Roman Kazantsev
44657183f3
[TF Hub][TF FE] Fix TF Hub models validation and extend precommit ( #19567 )
...
* Add all scope of models for testing
* Fix signature in test
* Fix workaround with output tensor names
* Fix unknown rank input resource case
* [TF Hub][TF FE] Fix TF Hub model validation and extend precommit
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
* Remove unneeded comments
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com >
2023-09-04 07:41:42 +02:00
Roman Kazantsev
1d0d00bf22
[TF Hub][GitHub Actions][TF FE] Introduce TF Hub Models Validation in GitHub Actions ( #19368 )
2023-08-23 18:40:31 +00:00
