Commit Graph
100 Commits
Author SHA1 Message Date
Irina Efode d613bb0e65 [CPU][ARM] Fix build CPU ARM plugin (#21722) 2023-12-18 13:20:33 +04:00
Irina Efode d5b0f4d2d7 [CONFORMANCE TOOLS][SUBAGRAPHS DUMPER] Repeat pattern extractor improvement (#21200)
* Init

* Implemented custom sort

* algo

* extend

* time

* decrease exec time

* fix code

* Impove pattern extractor

* repe

* Improve

* partial fix

* Patual fix

* fix_tests

* Remove extra + fix tests

* enable model

* Patial fix for align_in_info

* Exclude the nodes with the same size

* Prints

* update

* fix tests

* Fix crash

* Update cache.hpp
2023-12-15 10:34:33 +04:00
Irina Efode 8e52742f86 [CONFORMANCE] Specify validation entity as arg of run_conformance (#21610)
* [CONFORMANCE] Specify validation entity as arg of

* Readme + op_summary
2023-12-12 20:07:11 +00:00
Irina Efode fef3d0d3aa [CONFORMANCE] Fix incorrect comparation model in (#21461) 2023-12-07 18:03:30 +04:00
Irina Efode 1f01036997 [CONFORMANCE] Fix reg exp to find models (#21496) 2023-12-06 13:29:03 +01:00
Irina Efode bbfe22732f [CONFORMANCE] Change downgrade coefficient logic for conformance reports (#21475)
* [CONFORMANCE] Change downgrade coefficient logic for conformance reports

* Remove extra reports
2023-12-06 13:02:04 +04:00
Irina Efode 4237de6bf1 [CONFORMANCE] Remove old-named conformance exec files (#21128)
* [CONFORMANCE] Remove old-named conformance exec files

* fix_GHA
2023-11-21 17:06:05 +04:00
Irina Efode d1e1555f2f [CONFORMANCE] Cleaning up (#20835)
* 1. Add Op_conformance_utils lib.
2.rename targets.
3. Remove behavior folder from api conformance
4. Remove ov1.0 from opImplCheck
5. move tests and insts to one file
6. small refactoring for op conformance test names

* align namespaces, remove test_utils from subgraphs_dumper

* update target names

* Remove extra

* Fix the tests without shapes in meta

* fix failed test names

* Add attribute reader

* Fix buils

* Check the registered lib

* try

* add comparator

* Revert "try"

This reverts commit 27eaa4ea0f.

* try to fix win build

* types

* tr

* remove pragma once
2023-11-16 16:27:44 +04:00
Irina Efode eedc8d814c [IE TESTS ]Checking path of TEMPLATE plugin for OV_PLUGIN_CACHE (#20960)
* [IE TESTS] Change path of TEMPLATE plugin for OV_PLUGIN_CACHE

* fix code style

* partial revert revert

* Update ov_plugin_cache.cpp
2023-11-15 19:19:47 +04:00
Irina Efode ebf1874eee [GHA] Check OpImplCheck conformance for template plugin (to make sure that all functions are checked by conformance) (#20712)
* [CONFROMANCE] Fix Template OpImplCheck on Win

* Update windows.yml

* check win

* Update windows.yml

* remove extra changes
2023-11-10 12:39:58 +04:00
Irina Efode dd10a520e3 [DO NOT REVIEW OR MERGE] LLM in SubgraphsDumper (#20756) 2023-10-31 16:57:41 +01:00
Irina Efode 8eee1b52ed [IE TESTS] ImportExport reporting + extension of base class (#20765)
* [IE TESTS] ImportExport reporting + extension of base class

* reuse dynamic check
2023-10-31 19:00:36 +04:00
Irina Efode 0139fffc18 [CONFORMANCE] Revert Real Op versions to Opsets (#20714) 2023-10-27 09:27:18 +02:00
Irina Efode 7720135f58 [SUBGRAPHS DUMPER] Fix Application Crash for Subgraphs Dumper (#20698)
* [SUBGRAPHS DUMPER] Fix Application Crash for Subgraphs Dumper

* Update model.hpp
2023-10-26 15:03:03 +02:00
Irina Efode e4f4714fca [CONFORMANCE] Prepare model filelist for SubgraphsDumper (#20617)
* [CONFORMANCE] Prepare model filelist for SubgraphsDumper

* Improve default and custom scenario

* Update constants.py

* remove extra file

* improveemnt
2023-10-25 21:52:45 +04:00
Irina Efode d138dd2f08 [CONFORMANCE][SUBGRAPHS DUMPER] Fix issue connected with fused_names extractor (#20522)
* [CONFORMANCE][SUBGRAPHS DUMPER] Fix issue connected with  extractor

* fix build
2023-10-25 12:37:04 +04:00
Irina Efode 63fff9d270 [IE TESTS][CONFORMANCE] Move Calculate reference over TEMPLATE plugin instead of interpreter (#12532)
* [CONFORMANCE] Enable template calculation reference

* Move convert init to cpu

* skip gpu
2023-10-24 16:34:37 +02:00
Irina Efode 4fe6d5ec54 Fix OpImplCheck in GHA (#20650)
* Update mac.yml

* Update mac.yml
2023-10-23 15:04:05 +04:00
Irina Efode 6e4ec88db8 [GHA][CONFORMANCE] Enable and conformance for Template in GHA (#20604)
* [GHA][CONFORMANCE] Enable  and conformance  for Template in GHA

* apply review

* Update linux.yml
2023-10-23 10:47:15 +02:00
Irina Efode 137c8e896f [OP CONFORMANCE] Fix op version operations in conformance report (#20502)
* [OP CONFORMANCE] Fix op version operations in conformance report

* Code style + SD test
2023-10-19 11:22:44 +04:00
Irina Efode c24d1b4abc [CONFORMANCE][CPU] Add Expected failures for CPU Opset13 OP (#20490)
* [CONFORMANCE][CPU] Add Expected failures for CPU Opset13 OP

* Update expected_failures_OP.csv

* Update expected_failures_OP.csv
2023-10-16 13:19:07 +02:00
Irina Efode 523333cf1d [CMAKE][CONFORMANCE] Replace Lib target generation by executable for SubgraphsDumper (#20444) 2023-10-13 20:06:26 +02:00
Irina Efode 74690d038b [CONFORMANCE][TOOLS] Repeat pattern extractor API (#20293)
* Prepare API

* Refactor api

* Move model comparation to separate component

* Cover by tests

* Move align_in_info to utils

* Change arch diagram
2023-10-12 19:01:04 +02:00
Irina Efode 518a879a83 [CONFORMANCE][PRECOMMIT] Add one sporadically interapted test to expected failures (#20420) 2023-10-12 15:59:42 +04:00
Irina Efode 471295420f [CONFORMANCE][SUBGRAPHS DUMPER] Fix warning threated as error (#20279)
* [CONFORMANCE][SUBGRAPHS DUMPER] Fix warning threated as error

* apply comments
2023-10-06 00:28:47 +04:00
Irina Efode 46dc704e3f Fix SubgraphsDumper compilation Win (#20256) 2023-10-05 13:22:25 +02:00
Irina Efode cdcbb1dc00 [CONFORMANCE][SUBGRAPHS DUMPER] Rework subgraphs_dumper graphs extraction algo feedback by plugins (#19669)
* [CONFORMANCE][SUBGRAPHS DUMPER] Change repeat pattern extractor to avoid duplications and reduce graphs size

* Small change

* temporary

* merge

* try to handle large models

* Fixes + tests

* Remove extra

* Exclude models after const folding in case dynamic modesl

* shapes to meta

* Fix tests

* Fix test + is_subgraph

* Fix issue with default output

* change hashing

* Check memory

* Hash algo

* correct modelsize check

* Log large models

* tmp disable fused_names extractor

* add device for fused_names

* remove extra

* fix vuild

* Disable fused_names extractor
2023-10-04 19:50:56 +02:00
Irina Efode d7be40b808 [CONFORMANCE][CMAKE] Add SubgraphsDumper lib (#20053) 2023-10-04 20:48:15 +04:00
Irina Efode 8679414be4 [GHA][CONFORMANCE] Init gtest filter for parallel runner in case not used arg (#20234) 2023-10-04 14:57:32 +04:00
Irina Efode 2742752747 [CONFORMANCE] Provide plugin impl status based on QM instead of compile_model (#20036) 2023-09-26 23:01:27 +04:00
Irina Efode 47dec42ca0 [CONFORMANCE] Provide correct numbers for rel_passed && rel_all (#20035) 2023-09-26 12:24:56 +02:00
Irina Efode c979ece791 [CONFORMANCE][IE TESTS] Remove w/a with using Convert (#19748) 2023-09-14 17:01:17 +02:00
Irina Efode 1d0709f533 [CONFORMANCE] Enable QM + IE tests in Opset Conformance (#19693) 2023-09-11 11:10:47 +04:00
Irina Efode cddcec8ba8 [CONFORMANCE] Fix for Eye-9 op in the Opset Conformance report (#19404) 2023-08-25 17:22:18 +02:00
Irina Efode ba6cca8740 [CONFORMANCE] Add comparator accuracy vs conformance (#19374) 2023-08-24 16:22:13 +01:00
Irina Efode e0a75b78d1 [CONFORMANCE] Update runner readme (#19393) 2023-08-24 18:41:42 +04:00
Irina Efode 07ca0cd426 [CONFORMANCE] Remove debug code from Conformance runner (#19389) 2023-08-24 16:13:04 +02:00
Irina Efode 551cb7ab1a [CONFORMANCE] Extend conformance runner to use in GA with expected_failures filelist (#19285)
* [CONFORMANCE] Extend conformance runner to use in GA with expected_failures filelist

* fix

* exclude failed tests from run in case without update

* Small refactoring
2023-08-22 13:32:34 +04:00
Irina Efode e9fdf0cac4 [CONFORMANCE] Add progress bar to Subgraphs Dumper (#19235) 2023-08-18 11:59:22 +04:00
Irina Efode 043cd86449 [CONFORMANCE] Fix memory leak in Subgraphs Dumper (#19172)
* [CONFORMANCE] Fix memory leak in Subgraphs Dumper

* Update fused_names.cpp

* Change inheritance of extractors

* Check graph cache

* Enable Op cache
2023-08-15 14:24:17 +01:00
Irina Efode a0d1b91a78 [CONFORMANCE] Readability in model_utils (#19175) 2023-08-14 23:15:20 +04:00
Irina Efode d2594200bc [CONFORMANCE] Enabling SubgraphsDumping (#18896)
* Change fused_names algo -> cut subgraphs

* Added extractor name to serialization dir + meta_info

* Uncomment log

* Add this_op_cnt to model_info, fix in_info for model

* Replace clone node second time to relace input node

* fix small problem

* small fixes

* Switch off repeat extractor

* remove model serialization

* fused_names

* change default device in fused_names extractor

* fused_names

* Small speed up

* Move replace of const by param to cache

* Move alignament of in_info to extractorManager

* Sort model by size (check mem fragmentation)

* Fix problem with opset12

* Update manager.cpp

* Serialize cache in case of long

* Add test

* Update graph_cache.cpp

* Update graph_cache.cpp

* Graph cache size

* test other approach

* remove extra

* Fix issue with replae

* try with 1gb limitatiom

* to merge

* revert
2023-08-10 13:44:33 +00:00
Irina Efode ae20c5251a [CONFORMANCE] Fix expected trusted op passrate + python constants fix (#19050)
* [CONFORMANCE] Fix expected trusted op passrate + constants

* tmp disable qm & ie

* rename read_ir to inference

* take max timestamp instead of min
2023-08-09 17:27:45 +02:00
Irina Efode 0232042061 [CONFORMANCE] Change URL to conformance IRs and add list of failed models (#19023) 2023-08-07 19:42:01 +04:00
Irina Efode 9b801bcff8 [CONFORMANCE] Add ReadMe file for new SubgraphsDumper tool (#18802)
* [CONFORMANCE] Add ReadMe file for new SubgraphsDumper tool

* Review comments apply

* move readme

* Update README.md

* Update README.md
2023-08-04 10:30:48 +00:00
Irina Efode 3109d8fd25 [CONFORMANCE] Remove deprecated subgraphs dumper tool (#18905)
* [CONFORMANCE] Remove deprecated subgraphs dumper tool

* fix build
2023-08-03 14:35:09 +02:00
Irina Efode 87ff00426f [CONFORMANCE][TOOLS] Temporary skip part of subgraphsDumper tests (#18878) 2023-07-31 16:41:58 +04:00
Irina Efode 6a94ae3409 [CONFORMANCE] Move testsRunner to new subgraphsDumper (#18129)
* New Subgraph Dumper -> Cache + Meta

* iCache tests

* tests_meta

* OpCache tests

* Move & refactor matchers

* fix all tests and refactor meta

* Prepare for review

* Add caching types

* Model testing + improvement

* Add ignored ports. Add tests for node utils

* [CONFORMANCE] MOVE conformance runner to new subgraphsDumper

* fix build

* Fix compilation error

* fix compilation of deprecated subgraphs dumper

* fix build

* arm

* fix win?

* temp commit

* revert

* Add w/a to save const

* Update constant.hpp

* Update constant.hpp

* fix ci build

* cleanup

* Update model.hpp

* Update data_utils.hpp

* Update generate_inputs.cpp

* fix compilation

* Fix update cache with partial shape is 0

* Fix tests

* fix some problems

* tmp disable tests

* TMP disable

* Add skip tests config to subgraphs dumper tests

* Remove extra changes

* Fix build

* One more commit

* Mere

* Remove extra

* Skip one test
2023-07-28 19:04:44 +02:00
Irina Efode 05247c9a86 [IE TESTS] Fix parallel runner to run any test (#18787)
* [IE TESTS] Fix parallel runner to run any test

* Fix run_conformance on Macos
2023-07-26 14:36:45 +04:00
Irina Efode f70ef8be5b [CONFORMANCE] Extend Graph Cache by repeats in models (#18602)
* Add Repeat extractor

* fix build
2023-07-24 23:24:15 +02:00
Irina Efode 1d3dec9e99 [CONFORMANCE] Extend Graph Cache by Fused names based extractor (#18601)
* Add fused names based subgraph extractor

* fix test build
2023-07-24 13:52:00 +02:00
Irina Efode 1affc6e66f [CONFORMANCE] Fix compilation on Debian Post-commit (#18720) 2023-07-22 02:02:07 +04:00
Irina Efode 0ff70a0649 [CONFORMANCE] Extend SubgraphsDumper by graph cache + subgraph extractors (#18398)
* New Subgraph Dumper -> Cache + Meta

* iCache tests

* tests_meta

* OpCache tests

* Move & refactor matchers

* fix all tests and refactor meta

* Prepare for review

* Add caching types

* Model testing + improvement

* Add ignored ports. Add tests for node utils

* [CONFORMANCE] MOVE conformance runner to new subgraphsDumper

* fix build

* Fix compilation error

* fix compilation of deprecated subgraphs dumper

* fix build

* arm

* fix win?

* temp commit

* revert

* Add w/a to save const

* [IE TESTS][CONFORMANCE] Fix data generation

* fix cpu tests

* CPP Lint

* Update ranges.hpp

* change start_from and range according typo

* Update constant.hpp

* Update constant.hpp

* fix ci build

* Update deformable_convolution.cpp

* cleanup

* clenup

* Merge

e Changes to be committed:

* Fix tests -> change start_from type

* Initial commit to dump subgraphs

* try to collect graphs usong fused_names

* Correct graph generation based on fused_names

* addition

* Define SubgraphMatchers

* Add new matcher structure

* fix buils commit

* repeat

* repeat pattern

* finalize

* Move to extractors

* extract_body

* cleanup_cache

* replace big constant by params

* Replace constants by param in serialization

* Add tests for matchers

* add model-tests

* fix model tests

* Extend tests

* fix extractors test

* fix model recover test

* Remove extra

* remove extra

* return old name to tests

* remove subgraphs extractors -> move them to other PR
2023-07-21 12:21:29 +03:00
Irina Efode b1e250757e [IE TESTS][CONFORMANCE] Change data_generation initialization to avoid incorrect value (#18193)
* [IE TESTS][CONFORMANCE] Fix data generation

* fix cpu tests

* CPP Lint

* Update ranges.hpp

* change start_from and range according typo

* Update deformable_convolution.cpp

* clenup

* Update activation.cpp

* Update deformable_convolution.cpp

* Update grid_sample.cpp

* Fix tests -> change start_from type
2023-07-11 09:12:25 +03:00
Irina Efode 31b07c40d9 Add global config for test infra (#17547)
* [IE TESTS] Add Global test config for Subgraph base test

* Replace using option by function redefinition

* fix build

* remove extra changes for gna/template

* code style

* add nvidia to devices

* Fix debian

* remove nvidia
2023-06-24 01:07:36 +04:00
Irina Efode aefaf74a08 [CONFORMANCE][TOOLS] New SubgraphsDumper (#17836)
* New Subgraph Dumper -> Cache + Meta

* iCache tests

* tests_meta

* OpCache tests

* Move & refactor matchers

* fix all tests and refactor meta

* Prepare for review

* Add caching types

* Model testing + improvement

* Add ignored ports. Add tests for node utils

* fix build

* Fix compilation error

* fix arm build

* fix win?

* revert chanes in file util

* Update file_util.hpp

* Update constant.hpp
2023-06-24 00:12:47 +04:00
Irina Efode 098a4089c7 [CONFORMANCE] Fix type to find not run tests (#18196) 2023-06-23 15:09:01 +04:00
Irina Efode 71a970546e [OV UTIL] Fix method in case file_size == 0 (#18187) 2023-06-22 17:30:10 +02:00
Irina Efode 9e646bf446 [CONFORMANCE] Add generation of archieve with failed IRs (#17739) 2023-05-26 10:53:38 +02:00
Irina Efode 8cda1fdc51 Initial commit (#17538) 2023-05-18 11:42:10 +04:00
Irina Efode 8fed094168 [CONFORMANCE] Fix functions with several dynamic inputs (#17404) 2023-05-15 14:49:55 +04:00
Irina Efode 4303d10e26 [IE TESTS] Fix abs for FP16 comparation (#17414)
* [IE TESTS] Fix abs for FP16 comparation

* Update data_utils.hpp

* Skipps failed tests
2023-05-12 14:25:03 +02:00
Irina Efode 7aea8d6641 [CONFORMANCE] Remove extra print from op_summary (#17336) 2023-05-03 12:31:05 +00:00
Irina Efode e616bcbad8 [CONFORMANCE] Remove duplications from API Conformance report (#17339)
* [CONFORMANCE] Remove duplications from API Conformance report

* remove extra prints
2023-05-03 12:01:56 +01:00
Irina Efode fd2ccab93b [CONFORMANCE] Add message to explain passrates in report (#17314) 2023-05-03 12:54:39 +04:00
Irina Efode 8c7a0800b6 [CONFORMANCE] Add rel_weights reporting for QM tests (#17198) 2023-04-28 13:28:27 +01:00
Irina Efode ca92eb96ad [CONFORMANCE] Fix Runner on Win (#17221) 2023-04-26 13:03:20 +01:00
Irina Efode ae34720818 [CONFORMANCE] Add check devices in parallelization over devices (#16964)
* [CONFORMANCE] Add check devices in parallelization over devices

* Remove extra
2023-04-14 15:50:35 +01:00
Irina Efode d07fa6f80e [CONFORMANCE] Fix Opset filters (#16928)
* [CONFORMANCE] Fix filters related to opsets

* fix

* Fix op_summary

* Update op_summary.cpp

* fix

* fix
2023-04-14 17:42:42 +04:00
Irina Efode fd824cf036 [CONFORMANCE] Correct passrate when added skipped tests (#16844)
* init

* Refactor

* Static and dynamic approach

* next

* fix

* small fixes

* fix
2023-04-14 17:00:19 +04:00
Irina Efode c2a90f4c01 [CONFORMANCE] Fix error with import sigkill (#16884) 2023-04-12 18:21:57 +04:00
Irina Efode b7bf760516 [CONFORMANCE] Add re-run of interapted tests to avoid not reported tests (#16782)
* [CONFORMANCE] Add re-run of interapted tests to avod not reported tests

* Fix mistake with interapted

* test

* Remove extra prints
2023-04-10 12:23:59 +04:00
Irina Efode ff8f361778 [CONFORMANCE] Solve the problem to generate filters (#16713)
* [CONFORMANCE] Solve the problem to generate filters

* trigger linux build

* Add handling of not run tests

* Remove extra
2023-04-05 21:25:05 +04:00
Irina Efode 87365fa21d [CONFORMANCE] Parallelization over HW devices (#16431)
* init

* just fix version

* Update merge script

* remove extra code

* Uncomment correct func

* dd

* validate_nvidia

* Small refactoring

* Trigger linux build

* Update main.cpp

revert

* trigger

* fix build

* Update main.cpp
2023-03-30 14:45:49 +04:00
Irina EfodeandIlya Lavrenov 3849d5aa02 [INSTALL] Fix setupvars (installation for MacOS) and build python (#16514)
* Fix installation + Python build on MacOS

* Update setupvars.sh

* Update setupvars.sh

* Revert

* revert

* Update scripts/setupvars/setupvars.sh

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-03-28 22:03:22 +04:00
Irina Efode 9863b32792 [CONFORMANCE] w/a Api Conformance crash for NVIDIA (#16508) 2023-03-27 17:57:10 +02:00
Irina Efode 448654ea65 [CONFORMANCE] Fix report gewneration in case of mixed reports: rel and abs (#16505) 2023-03-23 15:08:18 +04:00
Irina Efode 6ac5e42b62 [CONFORMANCE] Fix if impossible to remove log (#16485)
* fix_reporting

* w/a for remove

* Update merge_xmls.py

remove extra
2023-03-22 20:07:47 +04:00
Irina Efode 0ee8c966b2 [CONFORMANCE] Fix API report (#16338) 2023-03-16 22:15:51 +04:00
Irina Efode 072acc1ea7 Fix win run (#16309)
* ix conformance on win

* fix summarizer

* try
2023-03-15 19:45:21 +04:00
Irina Efode df6cd3303a [CONFOMANCE] Add handling crashes (#16214)
* [CONFOMANCE] Add handling crashes

* Fix win paths
2023-03-13 14:23:26 +04:00
Irina Efode da8d5ba056 Fix generation of report in CI (#16209) 2023-03-10 14:02:43 +01:00
Irina Efode 54d3641baa Fix reportgeneration in CI (#16113) 2023-03-06 12:05:47 +01:00
Irina Efode 190b64a0af [CONFORMANCE] Add check the crash or non zero status in python runner (#16081)
* [CONFORMANCE] Add check the crash or non zero status in python runner

* Update run_parallel.py
2023-03-03 15:23:23 +04:00
Irina Efode 3b6bb06f1d Update merge script to work with outdated reports (#16078)
* Update merge script to work with outdated xml

* change report name
2023-03-03 11:02:04 +00:00
Irina Efode 4e8590bf9b Add correct handling of conformance processes (#16031)
* Update run_parallel.py

* Add correct handling of conformance processes

* remove extra

* Update run_parallel.py
2023-03-03 12:18:53 +04:00
Irina Efode 7aaf966039 [CONFORMANCE] Add relative weights for conformance (#15799)
* Add Weights by ops

* Upgrade conformance tools

* api_conformance

* Change prefix

* Reorg meta info

* Chnage base algo

* fix all other

* return summary

* Update the report

* wa

* review
2023-02-28 10:11:48 +01:00
Irina Efode e21c71dd48 Fix error with incorrect symbol in ParallelRunner (#15934)
* uncomment run

* Fix error with incorrect symbol in ParallelRunner

* Remove extra
2023-02-24 17:53:24 +04:00
Irina Efode 414f7fc4f8 [CONFORMANCE] Fix small bug with hours && replace URL for models (#15771) 2023-02-16 22:20:01 +00:00
Irina Efode b80a77683e [CONFORMANCE] Enable ref cache if it exists (#15709)
* init

* Implement

* Final

* Update read_ir.cpp
2023-02-17 01:41:29 +04:00
Irina Efode 4351c060f3 Fix conformance report (#15710)
* init

* [CONFORMANCE] Fix conformance reporting

* Revert "init"

This reverts commit 0e59ebd2fe.
2023-02-14 22:41:35 +01:00
Irina Efode 4009fa703c [CONFORMANCE] Fix ReadMe according option (#15703) 2023-02-14 11:19:11 +00:00
Irina Efode 3d6474a4a3 [CONFORMANCE] Change Name of ReadIR tests and op serialization folder by subgraphsDumper (#15671)
* [CONFORMANCE] Change Name of ReadIR tests and opserialization

* remove  op_name from ir name

* remove extra file
2023-02-14 12:02:01 +04:00
Irina Efode 831b637fbe [CONFORMANCE] Add Shappe mode to the conformance runner (#15689) 2023-02-13 19:08:09 +04:00
Irina EfodeandIlya Lavrenov c8afb90218 [CONFORMANCE] Exclude convert from report if it is additional layer (#15578)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-13 17:21:21 +04:00
Irina Efode 8213a8f7ec [CONFORMANCE][IE TEESTS] Move Summary from ngraph:: to ov:: (#15539)
* [CONFORMANCE] Fix issue with overflowed crash

* [CONFORMANCE][IE TEESTS] Move Summary from ngraph:: to ov::

* Revert "[CONFORMANCE] Fix issue with overflowed crash"

This reverts commit a1f16777b5.

* Apply comments

* Fix build

* Update run_conformance.py
2023-02-09 15:20:32 +04:00
Irina Efode 70177dbfb3 [CONFORMANCE] Add support of models and lists of models to the conformance rrunner (#15559)
* [CONFORMANCE] Add support of models and lists of models to the conformance rrunner

* Update models.lst
2023-02-08 13:53:02 +01:00
Irina Efode 6b503099db [CONFORMANCE] Fix issue with overflowed crash (#15538) 2023-02-08 10:54:42 +00:00
Irina Efode a48b4fc2b5 [CONFORMANCE] FIX bug with the dynamic shapes to separate run (#15550) 2023-02-07 17:36:59 +04:00
Irina Efode 46564543f8 [CONFORMANCE] Change log extension in runner (#15531) 2023-02-06 13:28:07 +00:00