/usr/local/lib/python3.6/site-packages/transformers/onnx/__pycache__
Edit: /usr/local/lib/python3.6/site-packages/transformers/onnx/__pycache__/convert.cpython-36.pyc (12845B)
3
Eg3J @ s d dl Z d dlmZ d dlmZ d dlmZ d dlmZm Z m
Z
m Z m Z d dl
Zd dlmZmZ ddlmZ dd lmZmZmZmZmZ d
d lmZ e rdd l m Z e rdd
l m Z erddl m!Z! ddl"m#Z# ej$e%Z&edZ'edddZ(d%e d& dee)ede e
e* e
e* f dddZ+d'e d( dee)ede e
e* e
e* f ddd Z,d)e d* e d+ ee)ede e
e* e
e* f dd d Z-d,ee d- e d. ee
e* e.dd d d!Z/e d/ e e* e e0e
e* f d"d#d$Z1dS )0 N) signature)chain)Path)
TYPE_CHECKINGIterableListTupleUnion)Versionparse )PreTrainedTokenizerBase)
TensorTypeis_tf_availableis_torch_available+is_torch_onnx_dict_inputs_support_availablelogging )
OnnxConfig)PreTrainedModel)TFPreTrainedModel)FeatureExtractionMixin)PreTrainedTokenizerz1.4.0)minimum_versionc C sX y6ddl }t|j}|tk r4td|j d| dW n tk
rR tdY nX dS )z
Check onnxruntime is installed and if the installed version match is recent enough
Raises:
ImportError: If onnxruntime is not installed or too old version is found
r Nz*We found an older version of onnxruntime (z&) but we require onnxruntime to be >= zp to enable all the conversions options.
Please update onnxruntime by running `pip install --upgrade onnxruntime`zonnxruntime doesn't seem to be currently installed. Please install the onnxruntime by running `pip install onnxruntime` and relaunch the conversion.) onnxruntimer __version__ ORT_QUANTIZE_MINIMUM_VERSION ImportError)r r Z ort_version r C/usr/local/lib/python3.6/site-packages/transformers/onnx/convert.py check_onnxruntime_requirements5 s
r r r r ) preprocessormodelconfigopsetoutput tokenizerreturnc C sF t | tr|dk rtd|dk r
ddl }ddl m
} tjd|j |j d|j_|j |jdk rtjd t|j d
x:|jj D ],\}} tjd | d | t|j|| qW |j| tjd
}
t||
j \} } t |j j }
| s*td|j t |jt dk ryV|||
f|j t |j!j |
dd t"|j!j |j j D d|j#|j$ d|d
W nH t%k
r } z*t&|}|dkrd}t%|n|W Y dd}~X nX nD|||
f|j t |j!j |
dd t"|j!j |j j D d|d |j' W dQ R X | |
fS )a
Export a PyTorch model to an ONNX Intermediate Representation (IR)
Args:
preprocessor: ([`PreTrainedTokenizer`] or [`FeatureExtractionMixin`]):
The preprocessor used for encoding the data.
model ([`PreTrainedModel`]):
The model to export.
config ([`~onnx.config.OnnxConfig`]):
The ONNX configuration associated with the exported model.
opset (`int`):
The version of the ONNX operator set to use.
output (`Path`):
Directory to store the exported ONNX model.
Returns:
`Tuple[List[str], List[str]]`: A tuple with an ordered list of the model's inputs, and the named inputs from
the ONNX configuration.
NzKYou cannot provide both a tokenizer and a preprocessor to export the model.ztThe `tokenizer` argument is deprecated and will be removed in version 5 of Transformers. Use `preprocessor` instead.zSOverwriting the `preprocessor` argument with `tokenizer` to generate dummmy inputs.r )exportzUsing framework PyTorch: Tz Overriding z configuration item(s)z - z -> ) frameworkz%Model and config inputs doesn't matchz1.10c S s i | ]\}}||qS r r ).0nameaxesr r r
s z"export_pytorch..)f input_names output_names dynamic_axesdo_constant_foldinguse_external_data_formatZenable_onnx_checker
opset_versionzExporting model exceed maximum protobuf size of 2GB. Please call torch.onnx.export without setting use_external_data_format parameter.zExporting model exceed maximum protobuf size of 2GB. Please call torch.onnx.export without setting use_external_data_format parameter or try with torch 1.10+.c S s i | ]\}}||qS r r )r* r+ r, r r r r- s )r. r/ r0 r1 r2 r4 )(
isinstancer
ValueErrorwarningswarn
FutureWarningloggerinfo
issubclasstyper torchZ
torch.onnxr( r Zno_gradr# return_dictevalvalues_overridelenitemssetattrgenerate_dummy_inputsr PYTORCH$ensure_model_and_config_inputs_matchkeyslistoutputsZ patch_opsr as_posixinputsr r3 Znum_parameters RuntimeErrorstr restore_ops)r! r" r# r$ r% r& r> Z onnx_exportoverride_config_keyoverride_config_value model_inputs inputs_matchmatched_inputs onnx_outputserrmessager r r export_pytorchR st
rX r c s6 ddl ddl}ddl}t| tr2|dk r2td|dk rTtjdt t j
d |} d|j _ |j
dk rt j
dt|j
d x:|j
j D ],\}} t j
d | d
| t|j || qW |j| tjd }
t||
j \} } t|jj }
fd d
|
j D }|jj|||d\}}|j||j |j | |
fS )a
Export a TensorFlow model to an ONNX Intermediate Representation (IR)
Args:
preprocessor: ([`PreTrainedTokenizer`] or [`FeatureExtractionMixin`]):
The preprocessor used for encoding the data.
model ([`TFPreTrainedModel`]):
The model to export.
config ([`~onnx.config.OnnxConfig`]):
The ONNX configuration associated with the exported model.
opset (`int`):
The version of the ONNX operator set to use.
output (`Path`):
Directory to store the exported ONNX model.
Returns:
`Tuple[List[str], List[str]]`: A tuple with an ordered list of the model's inputs, and the named inputs from
the ONNX configuration.
r NzIYou cannot provide both a tokenizer and preprocessor to export the model.ztThe `tokenizer` argument is deprecated and will be removed in version 5 of Transformers. Use `preprocessor` instead.zSOverwriting the `preprocessor` argument with `tokenizer` to generate dummmy inputs.Tz Overriding z configuration item(s)z - z -> )r) c s g | ]\}} j j||d qS ))r+ )Z
TensorSpecZ from_tensor)r* keyZtensor)tfr r
s z%export_tensorflow..)r$ ) Z
tensorflowonnxtf2onnxr5 r
r6 r7 r8 r9 r: r; r# r? rA rB rC rD rE r
TENSORFLOWrG rH rI rJ convertZ
from_kerassaverK rO )r! r" r# r$ r% r& r\ r] rP rQ rR rS rT rU Zinput_signature
onnx_model_r )rZ r export_tensorflow s2
rc c C s t p
t stdt| tr.|dk r.td|dk rPtjdt t j
d |} t rddl m } t
svtd| |jst jd |j d
| t rtt|trt| |||||d S t rtt|trt| |||||d S dS ) a
Export a Pytorch or TensorFlow model to an ONNX Intermediate Representation (IR)
Args:
preprocessor: ([`PreTrainedTokenizer`] or [`FeatureExtractionMixin`]):
The preprocessor used for encoding the data.
model ([`PreTrainedModel`] or [`TFPreTrainedModel`]):
The model to export.
config ([`~onnx.config.OnnxConfig`]):
The ONNX configuration associated with the exported model.
opset (`int`):
The version of the ONNX operator set to use.
output (`Path`):
Directory to store the exported ONNX model.
Returns:
`Tuple[List[str], List[str]]`: A tuple with an ordered list of the model's inputs, and the named inputs from
the ONNX configuration.
zrCannot convert because neither PyTorch nor TensorFlow are not installed. Please install torch or tensorflow first.NzKYou cannot provide both a tokenizer and a preprocessor to export the model.ztThe `tokenizer` argument is deprecated and will be removed in version 5 of Transformers. Use `preprocessor` instead.zSOverwriting the `preprocessor` argument with `tokenizer` to generate dummmy inputs.r )
torch_versionz=Unsupported PyTorch version, minimum required is 1.8.0, got: z@Unsupported PyTorch version for this model. Minimum required is z, got: )r& )r r r r5 r
r6 r7 r8 r9 r: r; utilsrd r AssertionErrorZis_torch_support_availablewarningZtorch_onnx_minimum_versionr< r= r rX r rc )r! r" r# r$ r% r& rd r r r r( s,
r( )r# r! reference_modelra onnx_named_outputsatolr& c C s ddl m}m} tjd t|tr4|d k r4td|d k rVtj dt
tjd |}t r|t t
|tr|| j|tjd} n| j|tjd} | }
||j |
dgd } |f | } i }
xN| j D ]B\}}|d
krd }t|ttfr| j||}|
j| q||
|< qW i }xX| j D ]L\}}t|ttfrP| j||}|jd d
|j D n |j ||< qW | j||}t|
j t| }}|j |stjd| d| td|j | ntjd| d xt ||D ]\}}t rt t
|tr|
| j j }n |
| j }tjd| d |j!|j!ksrtjd|j! d|j! td|j! d|j! dntjd|j! d|j! t"j#|||d stjd | d td t"j$t"j%|| ntjd | d qW d S ) Nr )InferenceSessionSessionOptionszValidating ONNX model...zTYou cannot provide both a tokenizer and a preprocessor to validatethe model outputs.ztThe `tokenizer` argument is deprecated and will be removed in version 5 of Transformers. Use `preprocessor` instead.zSOverwriting the `preprocessor` argument with `tokenizer` to generate dummmy inputs.)r) ZCPUExecutionProvider) providersZpast_key_valuesZpresentc S s i | ]\}}|j |qS r )numpy)r* Z tensor_nameZ pt_tensorr r r r- u s z*validate_model_outputs..z -[x] ONNX model output names z do not match reference model zGOutputs doesn't match between reference model and ONNX exported model: u7 -[✓] ONNX model output names match reference model ()z! - Validating ONNX Model output "z":z
-[x] shape z doesn't match zQOutputs shape doesn't match between reference model and ONNX exported model: Got z (reference) and z (ONNX)u -[✓] z matches )rj z& -[x] values not close enough (atol: znOutputs values doesn't match between reference model and ONNX exported model: Got max absolute difference of: u! -[✓] all values close (atol: )&r rk rl r: r; r5 r
r6 r7 r8 r9 r r< r= r rE r rF r^ rK rC rI tupleZ"flatten_output_collection_propertyupdatern runsetrH issubset
differencezipdetachshapenpZallcloseZamaxabs)r# r! rh ra ri rj r& rk rl Zreference_model_inputsoptionssessionZ ref_outputsZref_outputs_dictr+ valueZ onnx_inputsrU Zref_outputs_setZonnx_outputs_setZ ort_valueZ ref_valuer r r validate_model_outputs> sj
r~ )r" rR r' c st t r"tt| tr"t| jj}n t| jj}t|}t|j }|j
|}|j | fdd|j D }||fS )z>
:param model_inputs: :param config_inputs: :return:
c s g | ]}| kr|qS r r )r* parameter)matching_inputsr r r[ s z8ensure_model_and_config_inputs_match..) r r< r= r r Zforward
parameterscallrs rH rt intersection)r" rR Zforward_parametersZmodel_inputs_setZforward_inputs_setZis_okZordered_inputsr )r r rG s
rG )N)r r )N)r r )N)r r )r r )N)r r )r r )r r )2r7 inspectr itertoolsr pathlibr typingr r r r r rn ry Zpackaging.versionr
r Ztokenization_utils_baser
re r r r r r r# r Zmodeling_utilsr Zmodeling_tf_utilsr Zfeature_extraction_utilsr Ztokenization_utilsr
get_logger__name__r: r r intrN rX rc r( floatr~ boolrG r r r r s8
# o ? <(c