Name	Size	Mode	Actions
add_new_model.cpython-36.pyc	6531	0644	editdlrm
add_new_model_like.cpython-36.pyc	42688	0644	editdlrm
convert.cpython-36.pyc	4943	0644	editdlrm
download.cpython-36.pyc	1660	0644	editdlrm
env.cpython-36.pyc	2605	0644	editdlrm
lfs.cpython-36.pyc	7244	0644	editdlrm
run.cpython-36.pyc	3372	0644	editdlrm
serving.cpython-36.pyc	6748	0644	editdlrm
train.cpython-36.pyc	4589	0644	editdlrm
transformers_cli.cpython-36.pyc	1261	0644	editdlrm
user.cpython-36.pyc	8453	0644	editdlrm
__init__.cpython-36.pyc	794	0644	editdlrm

3 �Eg��@spdd
lm
Z

ddlmZmZmZmZ
ddlmZ
ddl m Z
eje�
Z ed�
dd �Zd d�ZGdd �d e �ZdS)�)
�ArgumentParser�)�Pipeline�PipelineDataFormat�get_supported_tasks�pipeline)
�logging�
)
�BaseTransformersCLICommand)
�pathc
Cs@|sd
Sxtj
D]}
|j|
�
r|
SqWtd|�dtj
���
�
dS)N�pipez4Unable to determine file format from file extension z-. Please provide the format through --format )r�SUPPORTED_FORMATS�endswith� Exception)r�ext�r�C/usr/local/lib/python3.6/site-packages/transformers/commands/run.py�try_infer_format_from_exts




rc
Csrt|j
|jr|jnd|j|j|jd
�}
|jdkr:t|j�
n|j}t j ||j|j|jrZ|jn|
j |jd�}t|
|�S)N)�task�model�config� tokenizer�device�infer)�formatZoutput_pathZ input_path�column� overwrite)rrrrrrrr�inputrZfrom_str�outputrZdefault_input_namesr� RunCommand)�args�nlpr�readerrrr�run_command_factory's











r#c@s6eZ
dZeed
�dd�Zeed�
dd��
Zdd�Z d S) r)r!r"cCs|
|_||_
dS)
N)�_nlp�_reader)�selfr!r"rrr�__init__;s

zRunCommand.__init__)
�parserc
Cs�|jd
dd�}
|
j
dt�dd�
|
j
dtdd �
|
j
d tdd �
|
j
dtd d �
|
j
dtdd �
|
j
dtdd �
|
j
dtdd �
|
j
dtdtjdd�
|
j
dtd!dd�
|
j
dddd�
|
jtd �

dS)"N�runzRun a pipeline through the CLI)
�helpz--taskzTask to run)�choicesr*z--inputz%Path to the file to use for inference)�typer*z--outputz9Path to the file that will be used post to write results.z--modelz)Name or path to the model to instantiate.z--configz2Name or path to the model's config to instantiate.z--tokenizerz?Name of the tokenizer to use. (default: same as the model name)z--columnzXName of the column to use as input. (For multi columns input as QA use column1,columns2)z--formatrzInput format to read from)r,�defaultr+r*z--devicer zSIndicate the device to run onto, -1 indicates CPU, >= 0 indicates GPU (default: -1))r,r-r*z--overwrite� store_truez"Allow overwriting the output file.)�actionr*)
�func�����) � add_parser�add_argumentr�strrr �int�set_defaultsr#)r(Z run_parserrrr�register_subcommand?s2



















zRunCommand.register_subcommandc
Cs�|jg}
}xF|j
D]<}|j
jr*|
f|�
n|
|�
}t|t�rH|j|�

q||7}qW|jjrz|j
j|�
}tj d
|���

n|j
j |�

dS)NzCCurrent pipeline requires output to be in binary format, saving at )r$r%Zis_multi_columns� isinstance�dict�appendZ binary_outputZsave_binary�logger�warning�save)r&r!�outputs�entryrZbinary_pathrrrr)_s





zRunCommand.runN) �__name__� __module__�__qualname__rrr'�staticmethodrr7r)rrrrr:s

rN)�argparserZ pipelinesrrrr�utilsr�r � get_loggerr@r;r4rr#rrrrr�s