Add benchmark samples (#13388)
* Add sync_bnehcmark
* Fix Unix comilation
* niter->time
* Explain main loop
* samples: factor out common
* Code style
* clang-format -i
* return 0; -> return EXIT_SUCCESS;, +x
* Update throughput_benchmark
* Add READMEs
* Fix READMEs refs
* Add sync_benchmark.py
* Add niter, infer_new_request, -pc
* from datetime import timedelta
* Fix niter and seconds_to_run
* Add disclaimer about benchmark_app performance
* Update samples/cpp/benchmark/sync_benchmark/README.md
* Add dynamic_shape_bert_benhcmark
* Add dynamic_shape_detection_benchmark
* Adopt for detr-resnet50
* Remove sync_benchmark2, throughput_benchmark2, perf counters
* clang-format -i
* Fix flake8
* Add README.md
* Add links to sample_dynamic_shape_bert_benchmark
* Add softmax
* nameless LatencyMetrics
* parent.parent -> parents[2]
* Add bert_benhcmark sample
* Code style
* Add bert_benhcmark/README.md
* rm -r samples/python/benchmark/dynamic_shape_bert_benhcmark/
* rm -r samples/cpp/benchmark/dynamic_shape_detection_benchmark/
* bert_benhcmark/README.md: remove dynamic shape
* Remove add_subdirectory(dynamic_shape_detection_benchmark)
* flake8
* samples: Add a note about CUMULATIVE_THROUGHPUT, don’t expect get_property() to throw, don’t introduce json dependency for samples/cpp/common
* / namespace
* Add article
* namespace -> static
* Update README, seconds_ro_run 10, niter 10, no inter alinment
* percentile->median
* benchmark samples: use generate(), align logs, update READMEs
* benchmakr samples: remove percentile()
* samples/python/benchmark/bert_benhcmark/bert_benhcmark.py: report average sequence length and processing time
* Python samples: move requirements.txt to every sample
* Remove numpy from requirements.txt
* Remove Building section from Python samples, install only required extras from openvino-dev, set up environment for bert_benhcmark, report duration for bert_benhcmark
* Install openvino-dev for Hello Reshape SSD C++ Sample