IntenseWebs/openvino
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Moved memory tests to OV API 2.0 (#9924)

Browse Source 
* Moved memory tests to OV API 2.0

* Added configs for OV api 2, updated configs for api 1

* Commented several models in configs (no such models on omz)

* Updated fillTensors

* Fix to get network inputs

* Updated fillTensors and configs
This commit is contained in:
Lidia Toropova 2022-02-01 14:36:05 +03:00 committed by GitHub
parent 8892b7b327
commit 2ce7becc6b
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
16 changed files with 6538 additions and 6885 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1313
tests/memory_tests/.automation/nightly_configs/desktop_test_api_2_config.yml Normal file
View File

File diff suppressed because it is too large Load Diff

1473
tests/memory_tests/.automation/nightly_configs/desktop_test_config.yml
View File

File diff suppressed because it is too large Load Diff

656
tests/memory_tests/.automation/nightly_configs/myriad_test_api_2_config.yml Normal file
View File

@ -0,0 +1,656 @@
# Models with precision: FP32 -- device: MYRIAD
- device:
name: MYRIAD
model:
name: mobilenet-v2-1.4-224
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: brain-tumor-segmentation-0001
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: faster_rcnn_inception_resnet_v2_atrous_coco
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-inception
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: efficientnet-b0
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-v1-1.0-224-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd_mobilenet_v1_coco
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v3
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: alexnet
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v4-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd300
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: vgg19
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v1
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v3-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mtcnn-o
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v1-tiny-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v1-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tiny-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd512
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: brain-tumor-segmentation-0002
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: Sphereface
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v2
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctdet_coco_dlav0_512
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctpn
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: i3d-rgb-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-v2
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-ssd
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnext-50
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: caffenet
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mtcnn-r
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnet-50
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: densenet-121
precision: FP32
source: omz
references: {}
# Models with precision: FP16 -- device: MYRIAD
- device:
name: MYRIAD
model:
name: mobilenet-v2-1.4-224
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: brain-tumor-segmentation-0001
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: faster_rcnn_inception_resnet_v2_atrous_coco
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-inception
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: efficientnet-b0
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-v1-1.0-224-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd_mobilenet_v1_coco
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v3
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: alexnet
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v4-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd300
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: vgg19
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v1
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v3-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mtcnn-o
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v1-tiny-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v1-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tiny-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd512
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: brain-tumor-segmentation-0002
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: Sphereface
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v2
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctdet_coco_dlav0_512
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctpn
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: i3d-rgb-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-v2
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-ssd
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnext-50
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: caffenet
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mtcnn-r
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnet-50
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: densenet-121
precision: FP16
source: omz
references: {}
# Models with precision: FP16-INT8 -- device: MYRIAD
- device:
name: MYRIAD
model:
name: vehicle-attributes-recognition-barrier-0039
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-action-recognition-0006
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-vehicle-bike-detection-crossroad-1016
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: age-gender-recognition-retail-0013
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: vehicle-detection-adas-0002
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: image-retrieval-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-retail-0002
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-attributes-recognition-crossroad-0230
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: action-recognition-0001-decoder
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-action-recognition-teacher-0002
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-vehicle-bike-detection-crossroad-0078
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: face-detection-adas-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: unet-camvid-onnx-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: human-pose-estimation-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: faster-rcnn-resnet101-coco-sparse-60-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: action-recognition-0001-encoder
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-ava-sparse-35-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-raisinghand-recognition-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-asl-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tiny-ava-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: license-plate-recognition-barrier-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-retail-0013
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: single-image-super-resolution-1032
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: landmarks-regression-retail-0009
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: driver-action-recognition-adas-0002-decoder
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-ava-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-action-recognition-0005
precision: FP16-INT8
source: omz
references: {}

732
tests/memory_tests/.automation/nightly_configs/myriad_test_config.yml
View File

@ -1,60 +1,4 @@
# Models with precision: FP32 -- device: MYRIAD
- device:
name: MYRIAD
model:
name: mobilenet-v2-1.4-224
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: brain-tumor-segmentation-0001
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: faster_rcnn_inception_resnet_v2_atrous_coco
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-inception
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: efficientnet-b0
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-v1-1.0-224-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mask_rcnn_resnet101_atrous_coco
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
@ -62,679 +6,3 @@
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnet-152
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: octave-resnext-50-0.25
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v3
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd_mobilenet_v2_coco
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: alexnet
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v4-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd300
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: vgg19
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctdet_coco_dlav0_384
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v1
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v3-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mtcnn-o
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v1-tiny-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v1-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tiny-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd512
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: densenet-169
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: brain-tumor-segmentation-0002
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: Sphereface
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v2
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctdet_coco_dlav0_512
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctpn
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: i3d-rgb-tf
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-v2
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-ssd
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnext-50
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: caffenet
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mtcnn-r
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnet-50
precision: FP32
source: omz
references: {}
- device:
name: MYRIAD
model:
name: densenet-121
precision: FP32
source: omz
references: {}
# Models with precision: FP16 -- device: MYRIAD
- device:
name: MYRIAD
model:
name: mobilenet-v2-1.4-224
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: brain-tumor-segmentation-0001
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: faster_rcnn_inception_resnet_v2_atrous_coco
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-inception
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: efficientnet-b0
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-v1-1.0-224-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mask_rcnn_resnet101_atrous_coco
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd_mobilenet_v1_coco
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnet-152
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: octave-resnext-50-0.25
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v3
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd_mobilenet_v2_coco
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: alexnet
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v4-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd300
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: vgg19
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctdet_coco_dlav0_384
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v1
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v3-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mtcnn-o
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v1-tiny-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v1-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tiny-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ssd512
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: densenet-169
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: brain-tumor-segmentation-0002
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: Sphereface
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: googlenet-v2
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctdet_coco_dlav0_512
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: ctpn
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: i3d-rgb-tf
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-v2
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mobilenet-ssd
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnext-50
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: caffenet
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: mtcnn-r
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: se-resnet-50
precision: FP16
source: omz
references: {}
- device:
name: MYRIAD
model:
name: densenet-121
precision: FP16
source: omz
references: {}
# Models with precision: FP16-INT8 -- device: MYRIAD
- device:
name: MYRIAD
model:
name: vehicle-attributes-recognition-barrier-0039
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-action-recognition-0006
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-vehicle-bike-detection-crossroad-1016
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: age-gender-recognition-retail-0013
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: vehicle-detection-adas-0002
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: image-retrieval-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-retail-0002
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-attributes-recognition-crossroad-0230
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: action-recognition-0001-decoder
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-action-recognition-teacher-0002
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-vehicle-bike-detection-crossroad-0078
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: face-detection-adas-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: unet-camvid-onnx-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: human-pose-estimation-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: faster-rcnn-resnet101-coco-sparse-60-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: action-recognition-0001-encoder
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-ava-sparse-35-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-raisinghand-recognition-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-asl-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-tiny-ava-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: license-plate-recognition-barrier-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-retail-0013
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: single-image-super-resolution-1032
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: landmarks-regression-retail-0009
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: driver-action-recognition-adas-0002-decoder
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: yolo-v2-ava-0001
precision: FP16-INT8
source: omz
references: {}
- device:
name: MYRIAD
model:
name: person-detection-action-recognition-0005
precision: FP16-INT8
source: omz
references: {}

4267
tests/memory_tests/.automation/weekly_configs/desktop_test_api_2_config.yml Normal file
View File

File diff suppressed because it is too large Load Diff

4455
tests/memory_tests/.automation/weekly_configs/desktop_test_config.yml
View File

File diff suppressed because it is too large Load Diff

3
tests/memory_tests/scripts/run_memorytest.py
View File

@ -17,11 +17,10 @@ import os
import statistics
import sys
import tempfile
import yaml
from pathlib import Path
from pprint import pprint
import yaml
UTILS_DIR = os.path.join(Path(__file__).parent.parent.parent, "utils")
sys.path.insert(0, str(UTILS_DIR))

12
tests/memory_tests/src/memory_tests/memtest_infer.cpp
View File

@ -8,7 +8,6 @@
#include "common_utils.h"
#include "memory_tests_helper/memory_counter.h"
#include "memory_tests_helper/utils.h"
using namespace InferenceEngine;
/**
@ -18,10 +17,10 @@ using namespace InferenceEngine;
*/
int runPipeline(const std::string &model, const std::string &device) {
auto pipeline = [](const std::string &model, const std::string &device) {
Core ie;
CNNNetwork cnnNetwork;
ExecutableNetwork exeNetwork;
InferRequest inferRequest;
InferenceEngine::Core ie;
InferenceEngine::CNNNetwork cnnNetwork;
InferenceEngine::ExecutableNetwork exeNetwork;
InferenceEngine::InferRequest inferRequest;
size_t batchSize = 0;
ie.GetVersions(device);
@ -30,8 +29,7 @@ int runPipeline(const std::string &model, const std::string &device) {
if (MemoryTest::fileExt(model) == "blob") {
exeNetwork = ie.ImportNetwork(model, device);
MEMORY_SNAPSHOT(import_network);
}
else {
} else {
cnnNetwork = ie.ReadNetwork(model);
MEMORY_SNAPSHOT(read_network);

71
tests/memory_tests/src/memory_tests/memtest_infer_api_2.cpp Normal file
View File

@ -0,0 +1,71 @@
// Copyright (C) 2018-2022 Intel Corporation
// SPDX-License-Identifier: Apache-2.0
//
#include <openvino/runtime/infer_request.hpp>
#include <iostream>
#include <fstream>
#include "common_utils.h"
#include "memory_tests_helper/memory_counter.h"
#include "memory_tests_helper/utils.h"
#include "openvino/runtime/core.hpp"
/**
* @brief Function that contain executable pipeline which will be called from
* main(). The function should not throw any exceptions and responsible for
* handling it by itself.
*/
int runPipeline(const std::string &model, const std::string &device) {
auto pipeline = [](const std::string &model, const std::string &device) {
ov::Core ie;
std::shared_ptr<ov::Model> network;
ov::CompiledModel compiled_model;
ov::InferRequest infer_request;
ie.get_versions(device);
MEMORY_SNAPSHOT(load_plugin);
if (MemoryTest::fileExt(model) == "blob") {
std::ifstream streamModel{model};
compiled_model = ie.import_model(streamModel, device);
MEMORY_SNAPSHOT(import_network);
} else {
network = ie.read_model(model);
MEMORY_SNAPSHOT(read_network);
compiled_model = ie.compile_model(network, device);
MEMORY_SNAPSHOT(load_network);
}
MEMORY_SNAPSHOT(create_exenetwork);
infer_request = compiled_model.create_infer_request();
auto inputs = network->inputs();
fillTensors(infer_request, inputs);
MEMORY_SNAPSHOT(fill_inputs)
infer_request.infer();
MEMORY_SNAPSHOT(first_inference);
MEMORY_SNAPSHOT(full_run);
};
try {
pipeline(model, device);
} catch (const InferenceEngine::Exception &iex) {
std::cerr
<< "Inference Engine pipeline failed with Inference Engine exception:\n"
<< iex.what();
return 1;
} catch (const std::exception &ex) {
std::cerr << "Inference Engine pipeline failed with exception:\n"
<< ex.what();
return 2;
} catch (...) {
std::cerr << "Inference Engine pipeline failed\n";
return 3;
}
return 0;
}

6
tests/memory_tests/src/memory_tests_helper/memory_counter.cpp
View File

@ -14,8 +14,10 @@
#include <psapi.h>
#include <tlhelp32.h>
#else
#include <sys/unistd.h>
#include <sys/wait.h>
#endif
#include "statistics_writer.h"
@ -100,9 +102,13 @@ size_t getSystemDataByName(char *name){
}
size_t getVmSizeInKB() { return getSystemDataByName((char *) "VmSize:"); }
size_t getVmPeakInKB() { return getSystemDataByName((char *) "VmPeak:"); }
size_t getVmRSSInKB() { return getSystemDataByName((char *) "VmRSS:"); }
size_t getVmHWMInKB() { return getSystemDataByName((char *) "VmHWM:"); }
size_t getThreadsNum() { return getSystemDataByName((char *) "Threads:"); }
#endif

2
tests/memory_tests/src/memory_tests_helper/statistics_writer.h
View File

@ -28,7 +28,9 @@ private:
std::vector<std::string> mem_struct_order;
StatisticsWriter() = default;
StatisticsWriter(const StatisticsWriter &) = delete;
StatisticsWriter &operator=(const StatisticsWriter &) = delete;
public:

12
tests/memory_tests/test_runner/conftest.py
View File

@ -18,17 +18,16 @@ This plugin adds the following command-line options:
import hashlib
import json
import logging
import tempfile
# pylint:disable=import-error
import os
import pytest
import sys
import tempfile
import yaml
from copy import deepcopy
from inspect import getsourcefile
from pathlib import Path
import pytest
import yaml
from jsonschema import validate, ValidationError
from pathlib import Path
UTILS_DIR = os.path.join(os.path.dirname(os.path.dirname(os.path.dirname(os.path.abspath(__file__)))), "utils")
sys.path.insert(0, str(UTILS_DIR))
@ -43,7 +42,6 @@ sys.path.append(MEMORY_TESTS_DIR)
from test_runner.utils import query_memory_timeline, REFS_FACTOR
OMZ_NUM_ATTEMPTS = 6
@ -168,6 +166,8 @@ def executable(request):
def niter(request):
"""Fixture function for command-line option."""
return request.config.getoption('niter')
# -------------------- CLI options --------------------

1
tests/memory_tests/test_runner/utils.py
View File

@ -37,6 +37,7 @@ def _transpose_dicts(items, template=None):
def query_memory_timeline(records, db_url, db_name, db_collection, max_items=20, similarity=TIMELINE_SIMILARITY):
""" Query database for similar memory items committed previously
"""
def timeline_key(item):
""" Defines order for timeline report entries
"""