* [Test] Build doc for C API reperence
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [Test] Build doc for C API reperence add C path
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [Test] Build doc for C API reperence add C path
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [C API][DOC][DOXYGEN] refact the components of C API
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [DOC][API reference] remove useless code
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [C API][DOC] Modify format to generate api reference
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [DOC][API reference] fix doc build error
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Update to the latest cmake for Windows
* Skip new warnings
* Added compiler flags for old cmake
* Disabled some warnings
* Suppress new warnings
* Fixed some errors
* Disable some warning for lpt
* Fix some warnings
* Disable new warnings
* Fix some warnings
* Disabled Was error for arm
* Fixed some errors
* Fixed some new warnings
* Fixed auto plugin
* Fixed Windows warning
* Fixed Windows
* Disable some warnings
* Some changes
* Small test fixes
* Fixed python build
* Added skip warnings for legacy python API
* parent 6e7016ccda
author Ilya Churaev <ilya.churaev@intel.com> 1664281499 +0400
committer Ilya Churaev <ilya.churaev@intel.com> 1664510018 +0400
Fixed warnings on local machine
* Added CMAKE_COMPILE_WARNING_AS_ERROR usage
* Fixed style
* Fixed merge conflicts
* Fixed typo
* Fixed myriad build for macOS
* Fixed warning
* Fixed tests
* Disabled incorrect test
* Try to fix linux tests
* Revert "Try to fix linux tests"
This reverts commit 29224c93ff.
* Fixed tests
* Revert logic with incorrect cast
* Fixed log softmax
* Disable warning as error for cuda
* Try to fix inference_engine_s
* Fixed cmake
* Revert "Fixed cmake"
This reverts commit 87e9e4e674.
* Revert "Try to fix inference_engine_s"
This reverts commit a1adca8b05.
* WA for static symbols in inference_engine_s test library
* Fixed code style
* Fixed static definition for master
* Revert "Fixed static definition for master"
This reverts commit 20d00d215a.
* Revert "Fixed code style"
This reverts commit 0eb2362543.
* Revert "WA for static symbols in inference_engine_s test library"
This reverts commit 75ef86a79d.
* Fixed linker issue for Windows
* Disable WaE by default
* Disable warning as error in the developer package
* Try to fix dev package
* Try to fix Windows Jenkins
* Revert old behavior for tread_warn_as_err variable
* Avoid duplicated code
Change-Id: I86fe59bab13010aedc62a2c92102b00e060ceeec
* Add more test cased for element type
Change-Id: I1f02254cee715d53ede0422c14a4732267d3db27
* Apply INSTANTIATE_TEST_SUITE_P for tensor element type test
Change-Id: I8bbeeb00ae872b7b286b5a776a5c2681e6b5ee94
* Fix some potential segmentfault in test cases
Change-Id: Ie12956e32805d950fa1eb82a1e49d532b26bc390
* Use OV_ASSERT_OK to replace OV_EXPECT_OK
Change-Id: I6780072cca4b4a6485105db4832ef3085c990df0
* Fix compile error
Change-Id: Ib4594093ddc60e504e45c6581410fa22d09bd9a6
* Update usage of ASSERT and EXCEPT
Change-Id: I7cb5d0bda4a60a2de899132c47fbf745bc760305
* Use EXPECT by default
Use EXPECT by default, unless you require something to hold for the remainder of the tests.
Change-Id: I2d2d8d8d9632e9e8742c4d923353d319e597a46a
* Avoid the issue of ov::hint::PerformanceMode::UNDEFINED
If convert ov::hint::PerformanceMode::UNDEFINED to string format, the string value is 0 (string_value=0, not "UNDEFINED")
We should avoid to copy this empty string.
Change-Id: I9d4a080b697a863762342f6f890d8ac7434e1864
* Unicode support
Change-Id: I6da095b0f0b86eb0fa9c44ddb41fa40f82fbded2
* Unicode support load compile model from file and add test cases
Change-Id: Ic66c2b9d5bc7da44db85772fc55abb9a699f4b7d
* Fix build error in Windows
Change-Id: I98c686f5bef17bef63ec6937035fac011224a790
* Fix compile error caused by rebase
Change-Id: I1457ba6bfd6743855bf55d77a2103a558548a8a0
* Fix refefinition issue in Windows
In windows it reports below error:
include\10.0.18362.0\um\winnt.h(1131): error C2365: 'BOOLEAN': redefinition; previous definition was 'enumerator'
openvino\src\bindings\c\include\openvino/c/ov_common.h(105): note: see declaration of 'BOOLEAN'
Change-Id: Ic84b7f0d6e3de5ba6c37af39533a3ca2f2d17ad8
* Link ov::util to call unicode code function
Change-Id: Ib324173524b8fe9b7f523fe6b838e155ffbe0842
* rename BL0 to be BOOLEAN
* Boolean should be 8bits data
* Solve some code style issues
Change-Id: I06c31ad9513463c758db96dbe33031983a8fd7a5
* Refine ov_dimension with C style structure
Use C style definition to replace opaque C++ handle:
1). Improve partial shape
2). Improve dimension/rank
3). Improve shape
Change-Id: I680fd3e76c63d0c06d9d8b07c67af0440fb15bb7
* Some minor update
Change-Id: I237490a765e6ecd6f3896b1bd75d5f962304f43b
* add partial_shape_is_dynamic and update doc
Change-Id: Ief358f27de8386e35485d08847c8243d1490157f
* Rename property and add basic test cases
Change-Id: Ifbed0bbf7a5e836d2cab186763d7e5f8f2cb7d44
* address reviewer's comments
Change-Id: I9a5d1ede6d086906f3777c3d29237986a505db52
* Fix compile error
Change-Id: I72267a8dda32dd8f43c1ea1522d07b392052358f
* Use ov_any_t to replace ov_property_value_t
Change-Id: Ia4062d0da0941c901990bf5f16497ae3c8f2eb0f
* update doc for ov_model
Change-Id: I80183394f16dd1e07ff998993e26f8b903f2402e
* Property key apply string variables replace enum variable
Change-Id: I0e1699862de3913ccdc06ded5b8f8ac5a2bf8773
* Fix compiling error in windows
Change-Id: I4f9c7c746e218db94491c5f4bc5aeda1b3fde62b
* Change init/deinit method to create/free, remove unnecessary methods
Change-Id: Ibc5de039da94e92db494583ab1ff1a63e0586c73
* Pass by value for single C structure data
Change-Id: I289eb56e2ba1ab90942c8c801c585ab0f792952f
* fix dllexport issue in windows
Change-Id: I1632375e5e651fdfa076cdab2d8d1c3e83986549
* Fix static build error
Change-Id: I6633fe4887edad0b3a8b7e10730fb9d36a6ac0cd
* Use pass by value for all transparent structure
Change-Id: I652f6e70b420ef7c5af5cff3f5d482911cf0d75a
* Unify parameter order in C APIs, input first and then output parameters
Change-Id: Ib89c77d81c314e3a81bfcec9917630abbc896f5e
* Rename preprocess api to be more readable
Change-Id: I0a8ecd005e73e4ba8e90a8f25bedf0739fe31836
* Simplfy property implement for set and get property
Change-Id: Icad41606368cef9520b1623f6207784c295f1b9f
* check string type property issue
Change-Id: Ie8ee6995dda401f1db0cc098e061ffcfd24de92a
* Fix memory leak
Change-Id: Ife8980736be320314eca6fb3f3605e019663e1da
* Check string property data
Change-Id: I542a136ff874cb345c67f7d3c1dbc74981a909df
* Fix issues caused by rebase
Change-Id: I3d675a16cf76980a6414e369a83464a46dec1e49
* Remove some redundant code
Change-Id: Iab6bf7f355ec7a7424d884e620319ed9db80ecf5
* Remove property type from interface
ov_core_set_property will have 2 cases:
1) enum type: <const char* property_key, ov_property_xxx_e property_value>
2) other: <const char* property_key, const char* property_value>
Change-Id: Id7dec1ac40948d45c4f8baee687652aee92ea75d
* Remove redundant code
Change-Id: I66865d3313e305b0109cb63bd049772a01c0688f
* Remove exception log and update propery size argument
Change-Id: Ia1a60c07c9adf08d175d94a7d5e4298adb27bf80
* Apply string for enum property
Change-Id: I591b1db453a52b5ea9000e0cc3e11edf0ef5f790
* Add test case for MULTI_DEVICE_PRIORITIES
Change-Id: I59e4307564a2560724b4dacdb83c3ed45ea1ce8d
* Fix test issues and add more negative test case
Change-Id: Ib849fb8c098e487a537c1b1ab881f5e905871f73
* Add ov_model_output_by tensor name and index function
* Fix the clang format issue
* clang format
* Add ov_output_node_t in input and shape function
* Add ov_oputput_node_t in model_output function
* Fix clang-format
* change ov_output_node_list_t to ov_output_const_node_list_t
* Add ov_output_node_list_t new struct
* Rename oputput_node to be port
* Rename output_node to be port in CAPI test and samples
* Add ov_model_output/outputs/input/inputs function and testcases
* Rename output_ports to ports
* Chage ov_node_list_get_element_type_by_index to ov_node_list_get_element_type
* Change ov_output_node to ov_output_port
* Delete node list and modify the function that used the node list structure before
* Fix clang-format in ov_infer_request_test.cpp
* change node to port in funcation name
* Rebase new master
* Add new API in compile model and model,such as get input/output size
* Add err info in hello_classification_c
* Fix clang-format in hello_classification_c
* Merge the new infer_request
* Initialize ov_output_const_port
* Change the location of initialization
Co-authored-by: River Li <river.li@intel.com>
* Solve some code style issues
Change-Id: I06c31ad9513463c758db96dbe33031983a8fd7a5
* Refine ov_dimension with C style structure
Use C style definition to replace opaque C++ handle:
1). Improve partial shape
2). Improve dimension/rank
3). Improve shape
Change-Id: I680fd3e76c63d0c06d9d8b07c67af0440fb15bb7
* Some minor update
Change-Id: I237490a765e6ecd6f3896b1bd75d5f962304f43b
* add partial_shape_is_dynamic and update doc
Change-Id: Ief358f27de8386e35485d08847c8243d1490157f
* Rename property and add basic test cases
Change-Id: Ifbed0bbf7a5e836d2cab186763d7e5f8f2cb7d44
* address reviewer's comments
Change-Id: I9a5d1ede6d086906f3777c3d29237986a505db52
* Fix compile error
Change-Id: I72267a8dda32dd8f43c1ea1522d07b392052358f
* Use ov_any_t to replace ov_property_value_t
Change-Id: Ia4062d0da0941c901990bf5f16497ae3c8f2eb0f
* update doc for ov_model
Change-Id: I80183394f16dd1e07ff998993e26f8b903f2402e
* Property key apply string variables replace enum variable
Change-Id: I0e1699862de3913ccdc06ded5b8f8ac5a2bf8773
* Fix compiling error in windows
Change-Id: I4f9c7c746e218db94491c5f4bc5aeda1b3fde62b
* Change init/deinit method to create/free, remove unnecessary methods
Change-Id: Ibc5de039da94e92db494583ab1ff1a63e0586c73
* Pass by value for single C structure data
Change-Id: I289eb56e2ba1ab90942c8c801c585ab0f792952f
* fix dllexport issue in windows
Change-Id: I1632375e5e651fdfa076cdab2d8d1c3e83986549
* Fix static build error
Change-Id: I6633fe4887edad0b3a8b7e10730fb9d36a6ac0cd
* Use pass by value for all transparent structure
Change-Id: I652f6e70b420ef7c5af5cff3f5d482911cf0d75a
* Unify parameter order in C APIs, input first and then output parameters
Change-Id: Ib89c77d81c314e3a81bfcec9917630abbc896f5e
* Rename preprocess api to be more readable
Change-Id: I0a8ecd005e73e4ba8e90a8f25bedf0739fe31836
* Warning suppression for C-API.
Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
* Add compiler flags for CI verification.
Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
* Update parent cmake compiler flag, and make it work for total bindings folder.
Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
* Open compiler check.
Move "sign-compare" to below, and make it only work for bindings. Because plugins have many compare errors.
Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
* Remove sign-compare.
Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* [C API 2.0]Redifine partial shape and property wrapper
1. Use dimension object to initialize partial_shape rather than string
2. Use void* to unify property value rather than union
3. rename some C api name to strict align with C++ method.
Change-Id: I64b5c521461264dba2d23543808584632fbd6d4b
* [C API 2.0]Memory check and implement all reshape interface
1. Memory safe create and free
2. Implement all reshape interface align with C++ interface
3. rename some api to align with C++ interface
Change-Id: Ib5e4192bdbd8a11cdd7e30b1dc84881ba3f2d505
* Rename prepostprocess to strict align with C++ name
Change-Id: I7a4d0a6e835b2d6ed01cd218ac81b1b621f600bf
* [C API 2.0]redefine ov_node and ov_model interface
1. redefine ov_node and ov_model interface
2. rename some api to aligne with C++ interface
3. remove some redundant code
4. align CMakeLists.txt with OpenVINO 2.0 convention
Change-Id: I4d5e92157e7891319c9754da8e70b9c6150ae2e3
* Redefine ov_layout to support more than one char
Change-Id: I39e5389246cf3edcc2f4734d13157457773d89b8
* Add interface to get partial_shape from node
Change-Id: I8cef77db581b43d2f0a9ac48cfdc09a86e39b694
* Use unique_ptr prevent memory leaks in case of exception
Change-Id: I150b375108a3eded400bdde087ab5c858958c25f
* Put legacy C API and 2.0 C API into a library
Change-Id: I067a55a00e78b80cdede5ae7adad316ee98cabd1
* Only keep OV 2.0 C sample and move legacy C sample to legacy directory
1. Move legacy C samples to tools/legacy/c directory
2. Keep OV 2.0 C samples in samples/c directory
Change-Id: I05880d17ee7cb7eafc6853ebb5394f3969258592
* Fix format and log issues
Change-Id: I05d909b3d7046d41b807e35808a993bb09672e68
* Restore documents update
Change-Id: I82dd92081c0aa1a2d7dca7f114cf6a35131d6f92
* Change config map data be const
Change-Id: I9043859e8308c01d80794dc8280ae236947f3bbb
* Update api document
Change-Id: I35bc149bad0de17424d95f48c3027030b708e147
* Add clang enable
Change-Id: I335639c05fb5fb38e682dbb72bfaf78380c0adaf
* Fix clang issue after enable clang for ie_c_api.c
Change-Id: Idcb4dda9d66e47a169eb79a9c4fe7a7d4df838db
* split header file and c file into multiple files
Change-Id: I7c3398966809ef70d7fcb799f2d612a33b471e31
* Fix clang format issue
Change-Id: Ibd18b45537c8f3bcbb5b995c90ae28999161d54d
* Add single ov_dimension_create method
Change-Id: Icd06b50e4f4df8f7897c7c4327edb67178162544
* Remove all legacy c samples completely
Change-Id: I098360a0d9002340e8769074181f7997b43bce8f
* Update ov_property_value to replace only ptr
Change-Id: I9f5a11b4cf07e759c1998e78e2624f0a1266d9b0
* Split more header files, add static dimension api
Change-Id: I14e4fb8585fc629480c06b86bd8219e75a9682f7
* Change ov_dimensions_create to be ov_dimensions_create_dynamic
Change-Id: I50c02749cea96f12bcea702b53a89c65b289550e
* rename status and get_out_tensor
Change-Id: I762c1d0c5a069454506fe3c04283c63ddbfacf31
* Split ov_c_api_test.cpp
* Split OV2.0 CAPI tests
* move var into Setup
* Merge legacy and 2.0 C API test
* Merge InferenceEngineCAPITests into openvino_capi_test
1. put InferenceEngineCAPITests into openvino_capi_test
2. resolve some format issues
Change-Id: I47bbba6bd70a871ee063becbd80eb57919fa9fb0
* legacy api test skips clang format
Change-Id: Id54ecdba827cf98c99b92295c0a0772123098b63
* Fix clang format issue
Change-Id: I7ed510d8178971fe04a895e812c261db99d8b9f2
* Restore InferenceEngineCAPITests
Change-Id: I4d641ffb1de9ce4d20ebecf35fc036fa7bd73e55
* rename openvino_capi_test to ov_capi_test
Change-Id: I6b6fe0cdb89aab7210abb17f32dbfdcdce72ba25
* unify list size name and refine ov_core_version_t
Change-Id: I137fc6d990c7b07f597ee94fa3b98d07ae843cb6
* align header file path to be openvino/c/openvino.h
Change-Id: I1a4552e1d558098af704942fe45488b0d6d53a90
* Fix path issue
Change-Id: I84d425d25e3b08c1516cbcc842fb9cb75574bf17
* move ov_color_format and remove opencv depenency
Change-Id: I486145f9e92e8bbf2e937d3572334aa9f0e68841
* Resolve some memory allocation error handling issues and read model with empty weight issue
Change-Id: Icd8e3b6de9741147993fa215a0c7cfd7debd5500
* Add GPU test cases
Change-Id: I13324ef019b5b1af79259ca932a36a0cec792c27
* Fix clang issue
Change-Id: I9bb4c47de301d142b5e2a77a39f667689ad9fe38
* Resolve CI test failure
Change-Id: Ia327d5edab19d8dd44ac369670f190d5c57aca79
* Redefine ov_shape and add default ov_core_create
Change-Id: I3e47d607f8aad65cb99cdddacaecf7bf34b1361b
* Remove some unnecessary api of node
Remove the unnecessary node api:
ov_node_get_any_name(ov_output_const_node_t* node, char** tensor_name)
ov_node_get_element_type(ov_output_const_node_t* node, ov_element_type_e* tensor_type)
Change-Id: I80a3243676800263a9e56afa3cfffce7b4bd2ae7
* Rename reshape api
ov_model_reshape should be common case which allow to reshape any models with different number of input.
Change-Id: I26bafeeb8a3dda7cd5164cda15fdb338db8668cb
* Rename ov_node api
Change-Id: I03114ecb6de5c46b6d02c909b6f6fb6c8bfd5cba
* Remove subfolder out of source code
Change-Id: Ib033ae7712cc0460d6fc21a0f89818381ae503c0
* apply absolute path for all header files
Change-Id: I8024c897d424b407025e21460ed4b62829b853d2
* Fix CI issue ov_capi_test failed to find libgna
Change-Id: I166e79a818498c6721fe956f43873f36d9ae1e07
* Resolve build issue to align with PR12214
Change-Id: I9e6094db213b431ee1b46e0d64199131db33bb36
Co-authored-by: ruiqi <ruiqi.yang@intel.com>
* OpenCV build switched off by default
* Removal of OCV copy from the "install tests" stage
* Switch off OCV dependent tests
* cmake code repositioning
* More OCV-dependent tests disabled
* OCV removed entirely from the C-API tests
* Final cleanup
* Fixes for cases when TBB_DIR env var is set
* Don't use make in build_samples.sh script
* First version of Windows installer
* WIndows NSIS installer
* Improved version of debian packages
* Improvements
* Improvements
* Debian packages now look good
* Library versioning
* Fixed tests to run against debian packages
* Fixed frontend tests
* Fixed code style
* FIxed Windows
* Fixed python tests
* Fixed paths in tests
* fdvfdv
* Fixes
* USe versioning only for debian packages
* Relocatable tests
* Fixed
* Fixed all tests
* Fixed clang-format
* Fixed more tests
* Fixed some tests
* Absolute paths in .ci
* Fixes
* Added support of OpenCV 3.4
* Trying to fix gnaUnitTests
* Add static shared_objects map in FEM
- add unit tests for frontend lib close
- not use static FEM in ie network reader
- add main for gtest which can use manifest file to filter tests
* Move library pointers map to manger impl
- add to manger impl method to make frontend from loaded plugin
* Add shutdown function to ov namespace
it cleans the static resources
* Revert changes related to linking mian for tests
* Add python binding to ov::openvino_shutdown
* Renamed shutdown method and added to legacy C++ API
(cherry picked from commit a8395bd207)
* Added C bindings
(cherry picked from commit d2c9ddc263)
* Move frontend lib close test to ieFunctTest
- moved to not introduced new test binary and modification on CI
the frontend tests use dynamic linked frontend lib which is load
on test application start and mask lib close tests
- remove gtest_main_manifest as not required now
- add ov::shutdown test to expect application crash
* Fix lib_close test
- remove not get_disabled_tests from utils
- revert CMake file formating
* Fix get model path in lib close tests
* Skip frontend lib close tests if static lib build
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
* Fixes for cases when TBB_DIR env var is set
* Don't use make in build_samples.sh script
* First version of Windows installer
* WIndows NSIS installer
* Define new ppp API for nv12
* Add new ppp API function
* Add new ppp API unit test
* Add hello nv12 input classification ov
* Define new ppp API for nv12
* Add new ppp API function
* Add new ppp API unit test
* Add hello nv12 input classification ov
* Fix the clang -formate issue
* Modify the function called is_supported_image_size
* Update code as suggested
* Add hello_nv12_input_classification e2e test
* clang-format openvinotoolkit
* Fix the doc error in CI
Co-authored-by: River Li <river.li@intel.com>
* Refine ov_partial_shape for OV 2.0 C interface
To avoid potential string security problem, remove string pointer from ov_partial_shape structure.
* Remove redundant code
* fix typo issue
* fix shape test issue
* fix some minor issues
* Address reviewing comments
Use Dimension to represent rank of parital shape.
* Appy safer method to parse partialShape string
1. adopt ov::Dimension::value_type to construct ov::Dimension
2. safter method to convert string to dimension value
3. apply std::vector<std::string> to replace std::vector<char *> during pasrsing partialShape string
Change-Id: I0e0b70a915fc5c5fefad51de51f167798854f55e
* Initial files & cmakefiles for ov 2.0 c api development
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Add all ov 2.0 C APIs define
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Fix review comments
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Disable test of OV 2.0 C APIs test for tmp
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Add related property key for ov 2.0 C-API
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Add description for ov_property_key_e
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Add EXECEPTION handling
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* compiledModel add interface
* add inferrequest interface
* solve cpplint problem
* Finished OV 2.0 C-APIs PPP related development
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Fix code review issues
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Add ov::tensor API
* add compiled model func
* Finished C-API funs about core, model, node development
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [OV 2.0 C-API] add const to ov_output_node
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [OV 2.0 C-API] Using define GET_OV_ELEMENT_TYPE & GET_CAPI_ELEMENT_TYPE in tensor APIs
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [OV 2.0 C-API] add string initialize
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* add inferrequest func
* add move construction to runtime_model
* supplement two infer request interface functions
* [OV 2.0 C-API] Add the common framwork of unit test
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* modify ov_infer_request_get_profiling_info
* add tests dir
* restore CMakeLists.txt
* Fix the bug of COPY in Tensor
* [OV 2.0 C API] Finished core related function unite test
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Add ov:Tensor API test
* [OV 2.0 C API] fix some review issues
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* add some infer request test
* add compiled model test
* [OV 2.0 C API] Finished preprocess related function unite test
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [OV 2.0 C API] Fix review issues
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [OV 2.0 C API] Modify to use default model
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* transfer device_name from fix value to parameter
* add some infer request test
* remove compiled model get_property test
* add infer request tests
* Add ov::model Test and modify Tensor Test name
* Determine whether partial shape meets the standard
* Add get tensor name function and Modify reshape test case
* modify fixed tensor name,remove unnecessary comparison
* add ov_model_get_nodes_info, modify according to comments
* Update reshape test
* extract common function, modify interface about get tensor name,shape and type
* modify according comments
* [OV 2.0 C API] Finished hello classification with ov 2.0 c-api development
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [OV 2.0 C API] Fixed hello classification with ov 2.0 c-api review issues
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [OV 2.0 C API] delete inactive code hello classification with ov 2.0 c-api
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Fix clang format issue
* [OV 2.0 C API] rename
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Fix windows build erre
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Apply qsort for sorting data
Apply qsort for sarting data
Fix issues of "potentially uninitialized local pointer variable"
* Not use deprecated INSTANTIATE_TEST_CASE_P for c api gtest
INSTANTIATE_TEST_CASE_P is deprecated, should use INSTANTIATE_TEST_SUITE_P.
* Fix some review issues
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [Ov 2.0 C API] Add error info
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Fix some review issues
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* Fix review issues
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* polish error message for ov c api
* Redefined ov_shape_t, ov_partial_shape_t and ov_layout_t. Modified functions and test cases involving these variables
* Added the conversion between char* and partial_shape
* Add partial_shape_to_shape
* prune code
* modify split
* Use regex to split and search pattern
* Modify str_to_char_array delete
* Add the judgment of rank
* Fix compiling error
Fix issue: address of array 'shape.dims' will always evaluate to 'true' if -Wpointer-bool-conversion
Co-authored-by: xuejun <Xuejun.Zhai@intel.com>
Co-authored-by: sunxiaoxia2022 <xiaoxia.sun@intel.com>
Co-authored-by: ruiqi <ruiqi.yang@intel.com>
* auto-batching POC squashed (all commits from auto-batch-2021.3 branch)
(cherry picked from commit d7742f2c747bc514a126cc9a4d5b99f0ff5cbbc7)
* applying/accomodating the API changes after rebase to the master
* replaying modified version of actual batch selection
* eearly experiments with model mem footprint
* changes from rebasing to the latest master
* experimenting with DG1 on the batch size selection, also collecting the mem footprint
* WIP:moving the auto-batching to the icore to let the MULT/AUTO support that, ALLOW_AUTO_BATCHING as a conventional config key. still fials hot device swap
* quick-n-dirty batch footpint vs device total mem
* code style
* testing which models perform badly due to kernels and NOT (batched) footprint
* stub pipeline task to comunicate the readiness rather than promise/future
* quick-n-dirty timeout impl
* explicit _completionTasks,reverting BA to use the timeout
* inputs outputs copies, works with AUTO and demo now
* accomodate the config per device-id, after rebase to the latest master
* allowing the auto-batching only with tput hint to let more conventional tests pass
* fix the pre-mature timeout restaring via waiting for batch1 requests completion
* moved the bacthed request statring ( along with input copies) to the dedicated thread
* [IE CLDNN] Disable bs_fs_yx_bsv16_fsv16 format for int8 convolution
* code style
* increasing the timeout to test the ssd_* models perf (timeout?) issues
* reducing number of output stuff in BA to avoid bloating the logs in experiments
* more aggressive batching for experiments, not limited to 32 and also 4 as a min
* more accurate timeout debugging info
* getting the reqs limitation from the plugin SetConfig as well
* refactor the reshape logic a bit to accomodate CPU for bathcing, also added remeote context
* let the benchamrk_app to consume specific batch values for the auto-batching such as BATCH:GPU(4)
* auto-batching functional test (with results check vs ref) and GPU instance for that
* fixed arithemtic on blobs ptrs
* clang
* handling possible batched network failure
* BATCH as the constants device name in test
* ENABLE_BATCH
* func tests for CPU, also DetectionOutput hetero tests (CPU and GPU)
* DetectionOutput hetero test for the CPU
* reenabling the Auto-Batching in the AUTO
* auto-batching device enabled in the test
* fixed the DO test
* improve the loading loop logic
* brushed the config keys
* allow hetero code-path for explicit device name like BATCH:GPU(4), used in the hetero code-path tests
* fix the test after refactoring
* clang
* moving ThreadSafeQueue to the ie_parallel, as it is re-used in the AUTO/MULTI and BATCH now
* auto-batching hetero test (subgraph with DetectionOutput)
* fixed minor changes that were result of experiments with impl
* code-style
* brushing, disabling CPU's HETERO tests until planned activity for 22.2
* removing home-baked MAX_BATCH_SZIE and swicthing to the official impl by GPU team
* remote blobs tests for the auto-batching (old API)
* brushed names a bit
* CreateContext and LoadNEtwork with context for the Auto-Batching plus remote-blobs tests
* fixed the ieUnitTests with adding CreateContext stub to the MockICore
* clang
* improved remote-blobs tests
* revert the back BA from exeprimenents with AB + device_use_mem
* conformance tests for BATCH, alos batch size 1 is default for BATCH:DEVICE
* remote blobs 2.0 tests, issue with context having the orig device name
* debugging DG1 perf drop (presumably due to non-fitting the device-mem)
* disbaling WA with batch/=2 for excesive mem footptint, leaving only streams 2
* remote blobs 2.0 tests for different tensor sharing types
* converting assert to throw to accomodate legacy API where the lock() was possible to be called
* revert the timeout back to avoid mixing the studies, fixed the footprint calc
* reverting to estimating the max batch by extrapolating from bacth1 size
* more conservative footptint etimation (with bacth1), graceful bacth 1 handling without duplication
* even graceful batch 1 handling without duplication
* WA for MAX_BATCH_SIZE failure, removing batch4 as a min for the auto-batching
* AutoBatchPlugin -> ov_auto_batch_plugin
* WA for gcc 4.8
* clang
* fix misprint
* fixed errors resulted from recent OV's Variant to Any transition
* skip auto-batching for already-batched networks
* AUTO_BATCH_TIMEOUT and tests
* GPU-specific L3
* switched to pure config, also improved ALLOW_AUTO_BATCHING config key handling logic
* debugging device info
* enabling the config tests for the GPU and fixing the Auto-batching tests to pass
* making the default (when not recognized the driver) cache size more aggressive, to accomodate recent HW with old drivers
* skip auto-batching for RNNs and alikes (e.g. single CHW input)
* fixed fallback to the bacth1 and moved HETERO path under condition to avoid bloating
* brushing
* Auto plugin GetMetric support gpu auto-batch
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* add test case
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* add comments on test
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* brushing the vars names, alos adding the excpetion handling
* disabling the auto-batching for the networks with non-batched outputs and faster-rcnn and alikes (CVS-74085) to minimize the of #failures
* add try catch
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* brushing the code changed in the GPU plugin
* Auto-Batch requests tests
* brushed varibles a bit (ref)
* cleaned debug output from the ie_core
* cleaned cmake for the Auto-Batch
* removed batchN estimation from batch1
* cleaned from debug printf
* comments, cleanup
* WA the mock test errors introduced with merging the https://github.com/myshevts/openvino/pull/13
* Adding back removed batchN estimation from batch1 to debug degradations on DG1 (resulted from too optimistic MAX_BATCH_SIZE?). This partially reverts commit e8f1738ac1.
* brushing ie_core.cpp
* fix 32bit compilation
* Code review: ENABLE_AUTO_BATCH
* consolidate the auot-batching logic in ie_core.cpp into single ApplyAutoBAtching
* renamed brushed the OPTIMAL_BATCH (now with_SIZE) and mimicks the MAX_BATCH_SZIE wrt MODEL_PTR
* default value for the OPTIMAL_BATCH_SIZE
* clang
* accomodate new func tests location
* fix shuffle of headers after clang + copyrights
* fixed misprint made during code refactoring
* moving the common therad-safe containers (like ThreadSafeQueue) to the dedicated dev_api header
* switch from the device name to the OPTIMAL_BATCH_SIZE metric presence as a conditin to consider Auto-Batching
* switching from the unsafe size() and minimizing time under lock
* code style
* brushed the ApplyAutoBatching
* brushed the netric/config names and descriptions
* completed the core intergration tests for the auto-batching
* ExecGraphInfo and check for incorrect cfg
* removed explicit dependencies from cmake file of the plugin
* disabling Auto-Batching thru the tput hint (to preserve current product default), only excplicit like BATCH:GPU used in the tests
Co-authored-by: Roman Lyamin <roman.lyamin@intel.com>
Co-authored-by: Hu, Yuan2 <yuan2.hu@intel.com>
* Remove some legacy targets
* Replace some targets
* Removed inference_engine_plugin_api dependency
* Minor comment for developer config
* Fixed include paths
* Small fixes for static build
* Try to fix build pyopenvino
* Fixed comments
* Try to fix build
* Include OpenVINODeveloperPackage inside InferenceEngineDeveloperPackageConfig
* Try to fix GAPI tests
* Create ov_runtime library
* Added dev target
* Fixed SOURCE_DIR property for interface lib
* Fixed missed include path
* Fixed SOURCES for plugins and frontends
* Fixed Windows export
* Try to fix preproc build
* Fixed MKLDNNPlugin
* Fix C API
* Try to fix public CI
* Fixed comments
* Use TARGET_NAME variable
* Fixed static build
* Fixed target name in comfig
* Revert "Fixed target name in comfig"
This reverts commit f61c1e0c09.
* Try to remove WA with include path
* Try to fix TBB dependency for old CMake
* Revert install to lib for legacy tests
* Try to fix public tests
* Add WA for v7 reader
* Fixed dev export name
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Moved openvino to src
* Moved ngraph and frontends to src
* Fixed cmake generation
* Moved inference_engine libs to src
* Moved C API to src
* Fixed CMake generation
* Moved readers to tests, snippets and preprocessing to common
* Fixed CMake
* Moved transformations and lp_transformations
* Fixed transformations cmake
* Fixed build
* Fixed unit-tests and ci paths
* Fixed docs
* Fixed C API build
* Try to fix static build
* More clear order
* Renamed inference_engine_legacy_api to legacy
* Fixed some cmake scripts
* Fixed path to legacy
* Fixed Myriad plugin
* Fixed v7 reader
* Fixed plugin.hpp
* Fixed developer config
* Fixed ie_parallel
