Files
openvino/inference-engine
Mateusz Tabaka 65c3b4c357 Fix 'cannot estimate element if precision is UNSPECIFIED' error cause… (#7748)
* Fix 'cannot estimate element if precision is UNSPECIFIED' error caused by LPT

In some models after ConvMulFusion and FakeQuantizeMulFusion, output_low contains
denorms. That is problematic since LayerTransformation::getPrecisionDetails function checks
if output_low is close to zero and if it is - the function sets 'signedPrecision' flag to false.
In that case, both 'signedPrecision' and 'unsignedPrecision' are set to false and that makes
getPrecisionDetails return element::undefined.
This patch changes zeroThreshold to handle denorms.

Ticket: 65375

* fix FakeQuantizeTransformation tests
2021-11-03 11:39:52 +03:00
..