/usr/local/lib64/python3.6/site-packages/caffe2/python/trt/__pycache__
Edit: /usr/local/lib64/python3.6/site-packages/caffe2/python/trt/__pycache__/transform.cpython-36.pyc (2944B)
3
Eg¬ ã @ sh d Z ddlmZ ddlmZ ddljjZddl Z
dd„ Z dd„ Z d d
„ Z
ddd„Zdd„ Zd dd„ZdS ) zK
TensorRT related transformation
Note that ONNX-TRT enforce an NCHW input!
é )Ú
caffe2_pb2)Ú workspaceNc C s dd„ | D ƒS )Nc S s g | ]
}|j ‘qS © )Z dim_value)Ú.0Úxr r úG/usr/local/lib64/python3.6/site-packages/caffe2/python/trt/transform.pyú
s z'_dim_values_to_list..r )Z
dim_valuesr r r Ú_dim_values_to_list s r c C s* dd„ | D ƒ}dd„ | D ƒ}t t||ƒƒS )Nc S s g | ]
}|j ‘qS r )Úname)r r r r r r s z&_get_output_shapes..c S s g | ]}t |jjjjƒ‘qS r )r ÚtypeZ tensor_typeÚshapeZdim)r r r r r r s )ÚdictÚzip)Zoutput_value_infosÚnamesZshapesr r r Ú_get_output_shapes s r c C s< y t jƒ W n* tk
r6 } ztdƒ‚W Y d d } ~ X nX d S )Nz/TensorRT related functions require CUDA support)ÚCZget_cuda_versionÚ Exception)Ú_r r r Ú
check_gpu_ s r é@ é i é Fc C s< t ƒ tj| jƒ t| jjƒ||||ƒ}tjƒ }|j |ƒ |S )z:
Convert the whole ONNX model to a TensorRT C2 op
)
r r Zonnx_to_trt_opÚSerializeToStringr ÚgraphÚoutputr Z OperatorDefÚParseFromString)Z
onnx_modelÚmax_batch_sizeÚmax_workspace_sizeÚ verbosityÚ
debug_builderZtrt_strÚopr r r Ú convert_onnx_model_to_trt_op# s
r! c C sŽ t j| ƒ i }xz| jD ]p}x4|jD ]*}||kr"t j|ƒ}t|dƒr"|j||< q"W x4|jD ]*}||krXt j|ƒ}t|dƒrX|j||< qXW qW |S )Nr )r Z
RunNetOncer r Z FetchBlobÚhasattrr Úinput)Úpred_netÚinputsÚhintsr ÚoZblobÚir r r Ú
_infer_shapes8 s
r) Tc C s˜ t ƒ i }|rJi } x,|jƒ D ] \}
} tjj| Ž jtjƒ| |
< q W t| | ƒ}x |jƒ D ]\}
} | ||
< qTW tj | j
ƒ ||||||ƒ} t j ƒ }
|
j
| ƒ |
S )zS
Transform the caffe2_net by collapsing TRT-runnable nodes into trt c2 ops
)r ÚitemsÚnpÚrandomZrandnZastypeZfloat32r) r Z
transform_trtr r ZNetDefr )r$ Z input_shapesZpopulate_shapesr r r r Zbuild_serializable_opZ shape_hintsZ
input_dataÚkÚvZ pred_net_strZ pred_net_cutr r r Útransform_caffe2_netJ s&
r/ i é )r r0 r Fi é )Fr r1 r FT)Ú__doc__Z caffe2.protor Z
caffe2.pythonr Z!caffe2.python._import_c_extensionÚpythonZ_import_c_extensionr Znumpyr+ r r r r! r) r/ r r r r Ú s$