* change threshold to 20 instead of max limit of data type
* add invalid input type test case
* add invalid input data check
* add input type dynamic check
* add backend test case
* add more clarity on spec and align with real implementation
* Revert "[CPU] Fix for CoreThreadingTestsWithIterations tests (#5892)"
This reverts commit 115aa143ef.
* Revert "Revert "[CPU] Fix for CoreThreadingTestsWithIterations tests (#5892)""
This reverts commit 95afa50d94.
* Revert "change threshold to 20 instead of max limit of data type"
This reverts commit 91af825056.
* Revert "add more clarity on spec and align with real implementation"
This reverts commit a3b232a8fb.
* add visitor attribute test case
* Revert "add visitor attribute test case"
This reverts commit 610728f1ab.
* add attribute test case
* revise the attribute visitor test per parametrized visitor API PR: #6181
* update spec
* add RTTI macro
* create visitor test
* clean backend test file
* add negative to type_prop tests of unary_ops
* add validate_and_infer_types method
* remove negative from type_propp unary_ops
* create negative type_prop tests
* remove boolean check from validate_and_infer_types
* update supported types in spec
* Remove check for signed numeric types
* Remove type_prop test cases with non-signed type
* Add zero sized negative test to interpreter manifest
* Revert "update supported types in spec"
This reverts commit a7ac3e4dc8.
* Revert "update spec"
This reverts commit 4c431d753d.
* Add minor changes to review op class
* Add validation of inputs and outputs in evaluate
* Use shape from host tensor to calculate element count
* Minor changes in variable names of backend tests
* Add SLT case with integer precision
* Add operation to list of trusted ops
* Address review comments:
* Add bf16 precision to evaluate method
* Use unary ops typed case tests for type_prop tests
* Add end of line to interpreter manifest
* Refactored visitor unit test
* Fix typo in visitor test name
Co-authored-by: ggalieroc <gabriele.galiero.casay@intel.com>
* [NG Frontend] Introduce classes and macros for Frontend-specific exceptions
* [nGraph Frontend] Python bindings
Exposing Python API for nGraph FrontEndManager introduced in PR #5470
* [nGraph Frontend] Python bindings
Exposing Python API for nGraph FrontEndManager introduced in PR #5470
* Added docs + moved sources to 'pyngraph/frontend'
* Fix issues after rebase
* Fix clang
* Moving ngraph/python/tests_cpp to ngraph/python/tests/mock
* Fix cmakelists-related comments
* Apply review comments
* Added dots to docstrings
* Cmake - Set target properties for ARCHIVE/PDB/COMPILE_PDB as well as for LIBRARY_OUTPUT_DIRECTORY
* Fix unknown command line flag errors if -sample-options is used
* Fix raw escape sequences output with dashes
* Fix raw escape sequences output with run_again message
* try change sampleoptions to array
* additional checks are added to prevent errors from occurring on the GNA library side
* fixing after review
* move AreLayersSupported from Cnn2D namespace
* GNA_DEBUG is commented
* batch size <= 8 test was added
* Correct output nodes naming in scope of NMS transformation
Details:
NMS transformation changes name of NMS node output (adds '/convert' suffix)
In case NMS transformation is the last node before Output, it leads to
the situation when InferRequest's network Outputs do not match any
graph's Output nodes.
Tickets:
- 57695
* Add test
* Migrate the unary OP visitor to typed template test.
The unaray OP list is :Floor, Log, Result, Sqrt, Squeeze.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Add element precision type into GTEST typed parameter.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Update the license to new version.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Update the OP Ceiling visitor test to use unary typed template.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Specification of a new operator called MatrixNMS.
This Op functionally equivalent to NonMaxSuppression-5, with an non max suppression algorithm called matrix_nms, and perform more post-processing phases, and lay out
the detection outputs in the way of PaddlePaddle detection.
* Update docs/ops/sort/MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/ops/sort/MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/ops/sort/MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/ops/sort/MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/ops/sort/MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/ops/sort/MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/ops/sort/MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/ops/sort/MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update MatrixNMS_8.md
* Update MatrixNMS_8.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* [GNA] [WIP] Introduce an option to invoke the QoS feature 56759
* Apply remaining revew (typos) for PR 5741
* Introduce HW_WITH_SW_FBACK
* Add unit test for HW_WITH_SW_FBACK
* Enable HW_WITH_SW_FBACK in speech_sample cpp
* Use perf counters to report number of HW delivered frames to the user (eg speech_sample)
* Update speech_sample.hpp
based on review
* Update gna_config.hpp
Describe special perf counter
* lint fix
* Apply review
* Remove special performance counter
* Add GNA frequency for 6/151 CPU family/model
* Update inference-engine/samples/speech_sample/main.cpp
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
* Update main.cpp
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
* MulticlassNms-8 spec.
This Op functionally extends NonMaxSuppression-5, to perform more post-processing phases, and lay out
the detection outputs in the way of PaddlePaddle detection.
* Update MulticlassNMS_8.md
Clarify the meaning of "nms_top_k".
* Update MulticlassNMS_8.md
* Update MulticlassNMS_8.md
* Update MulticlassNMS_8.md
* Update MulticlassNMS_8.md
* Update MulticlassNMS_8.md
* Deprecated the get_default_value method of Node class
* Cleanup of the obsolete get_version methods
* Deprecation warnings suppression
* Deprecation of get_default_value for v0 ops
* [IE]: Enables Abstract class -> Parameter conversion support
Parameter has templated constructor allowing to write code
```
Parameter p = i; // i of type int for example
```
This constructor uses SFINAE to resolve ambiguity with
move-constructor, so checks that argument is not of the same type.
In case it's not the same type it calls std::tuple constructors that
constructs an instance of argument type. In the following case:
```
Parameter p = static_cast<Parameter>(abstractRef);
// abstractRef is a reference to abstract class
```
We have a reference to some abstract class that defines explicit
cast operator to Parameter. In contrast with expectations,
instead of cast operator, Parameter constructor is instantiated,
since template type deduction for Parameter constructor didn't fail
(abstract class has not the same type as Parameter). Instantiation
of tuple constructor used inside failed: it's impossible to create an
instance of abstract class what lead to compile-time error. To resolve
the issue additional condition introduced to check if argument type is
abstract.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE]: Enables PrintTo method for Parameter and tests on it
Inference Engine API for configuration options uses Parameter
type as a return type of GetConfig method. Parameter is intended
to store object associated with configuration option.
To support objects of different types its constructor is templated.
Parameter overloads cast operators which are templated
as well. Both constructor and cast operators are implicit, which
makes it possible to implicitly convert any type to Parameter
and vice versa.
Since Parameter is a part of Inference Engine configuration API it's
essential google tests on API contain Parameter as tests parameter.
For each test parameter Google Test framework tries to print it to
an output stream. For that purpose, Google Test checks if test
parameter has output stream operator or PrintTo method. If not, it
checks if it could be implicitly converted to integral type and,
in this case, prints it as a long integer.
InferenceEngine::Parameter does not define output stream operator,
but could be implicitly converted to an integer, according cast
operators mentioned above, so Google Test tries to convert to
integer. Since Parameter not necessarily contains integer, this
conversion throws an exception of type mismatch, which makes it
impossible to use Parameter in Google Test framework as is.
In order to resolve that issue Parameter should define either
output stream operator or PrintTo method. If Parameter will
define output stream operator it will make it possible to compile
streaming almost any object to an output stream. The reason for it
is C++ checks if object could be implicitly converted to other type
which defines output stream operator, if objects itself doesn't do it
(e.g. `stream << "text";` calls std::string::operator<<, since
char const* is implicitly convertible to std::string).
Taking this into consideration the only way to support Parameter in
Google Test without breaking backward compatibility is define PrintTo
method.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE]: Fixes ill-formed extending std names
According to the standard:
The behavior of a C++ program is undefined if
it adds declarations or definitions to namespace
std or to a namespace within namespace std unless
otherwise specified. A program may add a template
specialization for any standard library template
to namespace std only if the declaration depends
on a user-defined type and the specialization meets
the standard library requirements for the original
template and is not explicitly prohibited.
As as an unexpected result, InferenceEngine::Parameter
that contains std::vector<std::string> can be printed
via PrintTo. In that case operator<< version from
Inference Engine is picked up.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Moves CompilationConfig out of GT header
Keeping config in a separate header simplifies migration
to new interface.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Removes Platform enum
Since there is enum from MVNC for the same purpose
there is no need in Platform anyway
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Introduces containers utility header
Contains some helpers to work with C++ maps
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Introduces new configuration API
The main ideas are separate option-specific logic
from common container, automate logic processing
public vs private, deprecated, compile-time vs
runtime-time options and remove code duplication.
Since IE defines configuration API using std::string
and Parameter, options have to provide ways to be
represented as Parameter (ex.: GetConfig is called)
and be defined using std::string (ex.: SetConfig is
called). Keeping information about actual key value
is useful for error reporting.
New API fallbacks to previous version in case of
unsupported options are requested. This way migration
becomes iterative and looks simpler.
Options containers are related to corresponding components:
CompilationConfig (name to be changed) - GraphTransformer,
PluginConfiguration - base class for plugins configurations,
MyriadConfiguration - Myriad plugin configuration,
HDDLConfiguration - HDDL plugin configuration (to be
introduced in a separate request)
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Replaces CompilationConfig with PluginConfiguration
Some of options to be refactored are stored inside CompilationConfig.
CompilationConfig is passed to graph transformer as a compiler to be
processed. Since it's separate data structure and migration process
is iterative we need a mechanism to provide some of compilation
options from new interface and some from old. It cannot be done via
plugin specific class (MyriadConfiguration), since there are others
plugins as graph transformer users. Plugin specific class
(MyriadConfiguration) already inherits from old version (MyriadConfig),
which in turn inherits from ParsedConfig containing CompilationConfig.
To resolve the issue MyriadConfig inheritance from ParsedConfig is made
virtual to make it possible for PluginConfiguration to virtually inherit
from ParsedConfig as well an so make PluginConfiguration data structure
for configuration options for graph transformer. Since
PluginConfiguration is base class of MyriadConfiguration as well as
MyriadConfig and inheritance is virtual plugin just casts its specific
configuration to base one passing to graph transformer.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Enables new tests on configuration API
* Enables following new shared tests on configuration API
* Can load network with empty configuration
* Check default value for configuration option
* Can load network with correct configuration
* Check custom value for configuration option (set and compare)
* Check public configuration options are visible through API
* Check private configuration options are invisible through API
* Check GetConfig throws an exception on incorrect key
* Refactors myriad plugin instantiations for shared tests
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Extracts LogLevel enum to a separate header
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Refactors LOG_LEVEL configuration option
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Refactors COPY_OPTIMIZATION configuration option
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Fixes behavior tests build
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Updates tests on new exception class
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Removes unused variable from mvnc test
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Removes SizeVector streaming call
New assertion macro IE_ASSERT implementation uses
output streaming operator with r-value reference
argument as a stream. This prevents the compiler
from picking up overload from InferenceEngine::details,
since our version takes stream by non-const l-value
reference.
Since there is no simple solution to provide output
streaming operator overload for r-value references as
well and this call is just a message for assert in
test utilities, it was decided just to remove call
for now.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [CPU] Refactor load_emitter_context semantic. Update store emitter
New load_emitter_context constructor arguments order
seems to be more convenient.
Store emitter now emits bf16 emu.
