Commit Graph
22 Commits
Author SHA1 Message Date
cecilia pengandMaksim Kutakov 3a67d2a722 [CPU] Fix mergeTransposeAndReorder when Transpose and Reorder do oppos… (#20537)
* [CPU]fix mergeTransposeAndReorder when Transpose and Reorder do opposite permutation to each other as expected, but isOptimized is false due to some reason like inPlace memory. The permuation is asked because the dnnl  reorder primitive requires the source and destination tensors to have the same shape.

* add unit test

* Update src/plugins/intel_cpu/src/graph_optimizer.cpp

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* simplify unit test

* update comments

---------

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
2023-10-26 10:41:34 +02:00
cecilia peng 7fbd3a7ebf [CPU] Zero-copy optimizations for model outputs (#18476)
- Implement zero-copy output between plugin graph and infer request, thus eliminate memory copy overhead and optimize performance
- Implement double buffer for InferRequest outputs
2023-07-25 10:33:48 +04:00
cecilia peng a1b8a6a941 [CPU] Disable ConvertNMSToNMSIEInternal (#16128) 2023-03-27 11:22:53 +04:00
cecilia pengandMaksim Kutakov 86b50044cd [CPU] optimize TensorIterator DynamicBuffer (#15163)
* optimize TensorIterator DynamicBuffer by preallocating a large chunk of intermediate buffer.

code clean.

review update: always copy in transfer as it is not worthy.

review update: update mem_holder_buffer as dnnl::memory instead of shared_ptr of it.

review update: reuse mem_buffer_holder even if the shape changes.

review update: growth factor.

review update: bug fix.

* fix code style

* review update: rewrite the dynamic buffer using the cpu Memory class, instead of dnnl::memory

* Update src/plugins/intel_cpu/src/nodes/tensoriterator.cpp

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* Update src/plugins/intel_cpu/src/nodes/tensoriterator.cpp

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>

* review update: minor fix

---------

Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
2023-02-21 09:40:00 +01:00
cecilia peng 2d5fa2d164 fix heap-buffer-overflow issue. (#14648) 2022-12-21 09:12:08 +00:00
8ef6ad3665 [Paddle] Add paddle frontend developer guide. (#13464)
* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* [Paddle] Add paddle frontend developer guide.

* add png.

* Update src/frontends/paddle/docs/paddle_frontend_architecture.md

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update src/frontends/paddle/docs/paddle_frontend_architecture.md

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update src/frontends/paddle/docs/paddle_frontend_architecture.md

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update src/frontends/paddle/docs/tests.md

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update src/frontends/paddle/docs/paddle_frontend_architecture.md

Co-authored-by: mei, yang <yang.mei@intel.com>

* fix CR.

* unit test path

* Update src/frontends/paddle/docs/paddle_frontend_architecture.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/docs/tests.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/docs/paddle_frontend_architecture.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* fix with mermaid.

* fix

* fix

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* fix

* fix

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/docs/tests.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/docs/tests.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/docs/paddle_frontend_architecture.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/docs/tests.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update src/frontends/paddle/README.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* more specific

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: mei, yang <yang.mei@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-12-20 13:01:43 +04:00
cecilia peng 1f16015802 Cecilia/paddle/decoder (#14332)
* fix AddressSanitizer: stack-use-after-scope in ov::frontend::paddle::NodeContext::get_attribute_as_any

* fix cyclic reference of op place and decoder.

* fix code style

* fix code style.
2022-12-02 09:28:52 +08:00
cecilia peng b955e7e514 95436: sporadic failure (#14183)
* 95436: sporadic failure

* Update input_model.cpp
2022-11-28 14:03:51 +08:00
cecilia peng 3bdb9cae54 [CPU] add support for internal ops augrucell and augrusequence (#12647)
* [cpu] enable augru.

* initiate opset_private_tbl.hpp for private ops.

* fix ngraph_functions target_linker.

* temporaliy disable a failure test.
2022-11-09 05:58:04 +03:00
cecilia peng d91b8bd17c disable random unit tests for multiclass nms and matrix nsm. (#11839)
They sporadically impact CI... possible reason is the order of paddle and openvino is not guaranteed when more than
one bboxes have equal scores.
Actually there is no need for these random tests as the remainding cases have covered them.
2022-06-13 16:43:57 +08:00
cecilia peng 016c5f537a Cecilia/multiclass nms9/cpu impl (#11246)
* multiclass_nms opset9 spec, api, reference, paddle fe mapper, paddle fe unittest.

* multiclass_nms opset9 cpu node impl.

* multiclass_nms opset9 shape infer fix.

* multiclass_nms opset9: add transform ConvertMulticlassNms8ToMulticlassNms9.

* ConvertMulticlassNmsToMulticlassNmsIE: to MulticlassNmsIEInternal

* add test dependency package paddledet==2.1.0

* 1. fix for roisnum overflow. 2. common shape_infer private function.

Signed-off-by: jialipen <cecilia.peng@intel.com>

* 1. use common infer_shape helper. 2. fix roisnum overflow issue. 3. fix for nmsWithEta.

* test suite for opset9 multiclass_nms smoke tests pass, with both static and dynamic shapes.

code clean for unit test.

* decouple specification from this PR.

* op fuzzy: dynamic input/output

* reference impl refactor

* multiclass_nms_base no need clone_inputs.

* code clean

* restrict ppdet import

* fix clang format error

* change ppdet import to resolve CI fail issue related to its dependency.

* fix CI

* refactor: multiclass_nms_shape_inference for opset9 and reference impl.
TODO: could be applied to opset8 and even matrix_nms.

* fix CI build failure.

* CI fix for ambiguous namespace reference issue when
building static libs.

* update nms save_model python scripts.

* dynamic inputs for NMS with CPU plugin.

* copyright header for test scripts.

* op comformance test for multiclass_nms_9.

* minor update: is_type

* python opset9 and multiclass_nms

* flake8 CI fix

flake8 CI fix

flake8 CI fix

* remove NmsBase. stage1.

flake8 CI fix

remove NmsBase. stage 1 fix.

* rm NmsBase. stage2.

* more multiclass_nms prop tests and fix.

* remove unchanged ops from binding opset9.

* dependcy of paddle_tests.

* fix: add MulticlassNms to op mapper.

* clang format fix

* fix merge error.
2022-05-31 07:56:01 +08:00
cecilia peng e68613a2fc Specify MulticlassNonMaxSuppression-9 operation (#11083) 2022-05-05 10:27:47 +02:00
cecilia peng d5d85dae90 fix to pass sr_stridedslice_squeeze (#8977)
* 1. add test case to duplicate issue CVS-71981.

2. fix CVS-71981

* code clean.
2021-12-07 20:07:21 +03:00
cecilia peng d587fb2844 Cecilia/fix/slice decrease axis (#8342)
* 1. fix for CVS-69011 2.add more test cases for slice w/ decrease_axis

* add test case simulating the last reshape2 of ocrnet which accepts slice (with decrease_axes in all dims) as its parents.

* exportModel as a helper function.

* fix: rank get_length type
2021-11-17 07:25:10 +03:00
cecilia peng 1858fa3853 [frontend][paddle] It is possible that get_output_partial_shape returns dynamic shape. Then we cannot simply check if it is 1. In case of BERT which input shape is dynamic, this check will absolutely fail. (#8030) 2021-10-25 15:36:13 +03:00
cecilia peng eee22b6253 Temporarily disable some paddle test case which sporadically fail during CI. (#7757)
Further investigation required. JIRA tracking.
2021-09-30 12:56:10 +03:00
cecilia peng 8ce8697830 Cecilia/bert/op convert (#7462)
* [paddlepaddle] embedding test case generator.

* [FrontEnd][PaddlePaddle] add op convert embedding for lookup_table_v2.

* code clean.
2021-09-22 07:40:11 +03:00
cecilia peng 8eeee5e441 [FrontEnd][PaddlePaddle] fix fill_constant_batch_size_like when attri… (#7214)
* [FrontEnd][PaddlePaddle] fix fill_constant_batch_size_like when attribute str_value be empty.

This happens when export ppyolo with PaddleDetection release/2.2.

* code refactor.

* remove uncertain comments
2021-09-07 06:50:09 +03:00
cecilia peng 950d7b8597 pdpd frontend: enable deformable_conv, enable multiclass_nms and matrix_nms. (#6833) 2021-08-03 18:58:56 +03:00
cecilia peng 38bb6dc874 spec revise: add attribute "normalize" to Paddle NMS operators. (#6290) 2021-06-22 12:34:34 +03:00
cecilia pengandAnastasiya Ageeva ac01777166 MatrixNMS-8 spec. (#5948)
* Specification of a new operator called MatrixNMS.

This Op functionally equivalent to NonMaxSuppression-5, with an non max suppression algorithm called matrix_nms, and perform more post-processing phases, and lay out
the detection outputs in the way of PaddlePaddle detection.

* Update docs/ops/sort/MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/ops/sort/MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/ops/sort/MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/ops/sort/MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/ops/sort/MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/ops/sort/MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/ops/sort/MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update docs/ops/sort/MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>

* Update MatrixNMS_8.md

* Update MatrixNMS_8.md

Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
2021-06-18 17:39:23 +03:00
cecilia peng 73ef2ffb41 MulticlassNms-8 spec. (#5907)
* MulticlassNms-8 spec.

This Op functionally extends NonMaxSuppression-5, to perform more post-processing phases, and lay out
the detection outputs in the way of PaddlePaddle detection.

* Update MulticlassNMS_8.md

Clarify the meaning of "nms_top_k".

* Update MulticlassNMS_8.md

* Update MulticlassNMS_8.md

* Update MulticlassNMS_8.md

* Update MulticlassNMS_8.md

* Update MulticlassNMS_8.md
2021-06-18 09:20:00 +03:00