igie-audio/speech_recognition/conformer acc需要进一步确认

### 该问题是怎么引起的？

### 重现步骤

### 报错信息

```
root@a83e30dc8e4a:~/deepsparkinference/models/audio/speech_recognition/conformer/igie# bash scripts/infer_conformer_fp16_accuracy.sh
/usr/local/corex-4.2.0/lib64/python3/dist-packages/tvm/relay/frontend/onnx.py:122: DeprecationWarning: `mapping.TENSOR_TYPE_TO_NP_TYPE` is now deprecated and will be removed in a future release.To silence this warning, please use `helper.tensor_dtype_to_np_dtype` instead.
  return str(TENSOR_TYPE_TO_NP_TYPE[elem_type])
WARNING:autotvm:One or more operators have not been tuned. Please tune your model for better performance. Use DEBUG logging level to see more details.
[07:07:16] /home/corex/sw_home/apps/igie/src/relay/transforms/to_mixed_precision.cc:534: Warning: Op "transpose_nd" not registered FTVMMixedPrecisionConversionType appears 12 times in graph.
[07:07:16] /home/corex/sw_home/apps/igie/src/relay/transforms/to_mixed_precision.cc:534: Warning: Op "equal" not registered FTVMMixedPrecisionConversionType appears 1 times in graph.
[07:07:16] /home/corex/sw_home/apps/igie/src/relay/transforms/to_mixed_precision.cc:534: Warning: Op "logical_not" not registered FTVMMixedPrecisionConversionType appears 3 times in graph.
[07:07:16] /home/corex/sw_home/apps/igie/src/relay/transforms/to_mixed_precision.cc:534: Warning: Op "log" not registered FTVMMixedPrecisionConversionType appears 1 times in graph.
[07:07:16] /home/corex/sw_home/apps/igie/src/relay/transforms/to_mixed_precision.cc:534: Warning: Op "layout_transform" not registered FTVMMixedPrecisionConversionType appears 1 times in graph.
[07:07:45] /home/corex/sw_home/apps/igie/src/runtime/contrib/ixinfer/cuinferFindFP16Algo.cc:135:        CUINFER Found 3 fwd algorithms, choosing CUINFER_CONVOLUTION_FWD_ALGO_IMPLICIT_GEMM
[07:07:45] /home/corex/sw_home/apps/igie/src/runtime/contrib/ixinfer/cuinferFindFP16Algo.cc:138:                0) CUINFER_CONVOLUTION_FWD_ALGO_IMPLICIT_GEMM - time: 0.686208 ms, Memory: 0
[07:07:45] /home/corex/sw_home/apps/igie/src/runtime/contrib/ixinfer/cuinferFindFP16Algo.cc:138:                1) CUINFER_CONVOLUTION_FWD_ALGO_IMPLICIT_PRECOMP_GEMM - time: 6.5011 ms, Memory: 32768
[07:07:45] /home/corex/sw_home/apps/igie/src/runtime/contrib/ixinfer/cuinferFindFP16Algo.cc:138:                2) CUINFER_CONVOLUTION_FWD_ALGO_GEMM - time: 11.2828 ms, Memory: 12871872
/usr/local/corex-4.2.0/lib64/python3/dist-packages/tvm/runtime/ndarray.py:217: DeprecationWarning: NDArray.asnumpy() will be deprecated in TVM v0.8 release. Please use NDArray.numpy() instead.
  warnings.warn(
Check Algo 0 Correct at workload: [24, 384, 80, 4, 3, 3, 256, 2, 2, 0, 0, 1, 1, 1]
[07:07:48] /home/corex/sw_home/apps/igie/src/runtime/contrib/ixinfer/cuinferFindFP16Algo.cc:135:        CUINFER Found 3 fwd algorithms, choosing CUINFER_CONVOLUTION_FWD_ALGO_IMPLICIT_GEMM
[07:07:48] /home/corex/sw_home/apps/igie/src/runtime/contrib/ixinfer/cuinferFindFP16Algo.cc:138:                0) CUINFER_CONVOLUTION_FWD_ALGO_IMPLICIT_GEMM - time: 0.00374231 ms, Memory: 91533312
[07:07:48] /home/corex/sw_home/apps/igie/src/runtime/contrib/ixinfer/cuinferFindFP16Algo.cc:138:                1) CUINFER_CONVOLUTION_FWD_ALGO_IMPLICIT_PRECOMP_GEMM - time: 0.946119 ms, Memory: 0
[07:07:48] /home/corex/sw_home/apps/igie/src/runtime/contrib/ixinfer/cuinferFindFP16Algo.cc:138:                2) CUINFER_CONVOLUTION_FWD_ALGO_GEMM - time: 1.36306 ms, Memory: 199618560
/usr/local/corex-4.2.0/lib64/python3/dist-packages/tvm/runtime/ndarray.py:217: DeprecationWarning: NDArray.asnumpy() will be deprecated in TVM v0.8 release. Please use NDArray.numpy() instead.
  warnings.warn(
ixinfer algo 0 compute error at workload: [24, 191, 39, 256, 3, 3, 256, 2, 2, 0, 0, 1, 1, 1]
Change Algo to 1, checking ...
Check Algo 1 Correct at workload: [24, 191, 39, 256, 3, 3, 256, 2, 2, 0, 0, 1, 1, 1]
{ 'acc_target': 0.0,
  'batch_size': 24,
  'bpe_model': None,
  'config': 'train.yaml',
  'data_type': 'raw',
  'dict': 'lang_char.txt',
  'encoder': None,
  'engine': 'encoder_bs24_seq384_fp16.so',
  'fps_target': 0.0,
  'input_name': ['speech', 'speech_lengths'],
  'label': 'text',
  'mode': 'ctc_greedy_search',
  'num_workers': 16,
  'override_config': [],
  'perf_only': False,
  'result_file': 'conformer_output_log',
  'seq_len': 384,
  'test_data': 'data.list',
  'warmup': 3}
/usr/local/corex-4.2.0/lib64/python3/dist-packages/tvm/runtime/ndarray.py:217: DeprecationWarning: NDArray.asnumpy() will be deprecated in TVM v0.8 release. Please use NDArray.numpy() instead.
  warnings.warn(
/root/deepsparkinference/models/audio/speech_recognition/conformer/igie/compute_cer.py:322: ResourceWarning: unclosed file <_io.TextIOWrapper name='text' mode='r' encoding='utf-8'>
  for line in open(ref_file, 'r', encoding='utf-8') :
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Overall -> 100.06 % N=17764 C=21 S=17697 D=46 I=32

{'metricResult': {'Accuracy': '-0.060000000000002274%'}}
* Accuracy: -0.060000000000002274 %
```

DeepSpark/DeepSparkInference

内容风险标识

评论 (0)

DeepSpark/DeepSparkInference .gitee-modal { width: 500px !important; }

内容风险标识