Name	Size	Mode	Actions
add_new_model.cpython-36.pyc	6531	0644	editdlrm
add_new_model_like.cpython-36.pyc	42688	0644	editdlrm
convert.cpython-36.pyc	4943	0644	editdlrm
download.cpython-36.pyc	1660	0644	editdlrm
env.cpython-36.pyc	2605	0644	editdlrm
lfs.cpython-36.pyc	7244	0644	editdlrm
run.cpython-36.pyc	3372	0644	editdlrm
serving.cpython-36.pyc	6748	0644	editdlrm
train.cpython-36.pyc	4589	0644	editdlrm
transformers_cli.cpython-36.pyc	1261	0644	editdlrm
user.cpython-36.pyc	8453	0644	editdlrm
__init__.cpython-36.pyc	794	0644	editdlrm

3 �Eg��@s�dd
lZddl
mZmZ
ddlmZ
ddlmZ
ddl m Z mZmZ
ddl mZ
e �rhe�rhed �
�
d Zd Zed�
dd �ZGdd�de�Zd
S)�N)�ArgumentParser� Namespace�)
�%SingleSentenceClassificationProcessor)
�TextClassificationPipeline)�is_tf_available�is_torch_available�logging�
)
�BaseTransformersCLICommandzRAt least one of PyTorch or TensorFlow 2.0+ should be installed to use CLI trainingF)
�argsc

Cst|�
S)
z� Factory function used to instantiate training command from provided command line arguments. Returns: TrainCommand )
�TrainCommand)
r�r�E/usr/local/lib/python3.6/site-packages/transformers/commands/train.py�train_command_factory src@sDeZ
dZeed
�
dd��
Zed�
dd�Zdd�Zd d �Z dd�Z d S)r )
�parserc
Cs
|jd
dd�}
|
j
dtddd�
|
j
dtd d d�
|
j
dtd dd�
|
j
dtddd�
|
j
dddd�
|
j
dtddd�
|
j
dtddd�
|
j
dtddd�
|
j
dtd d!d�
|
j
d"td#d$d�
|
j
d%td&d'd�
|
j
d(td)d*d�
|
j
d+td,d-d�
|
j
d.td/d0d�
|
jtd1�

d2S)3z� Register this command to argparse so it's available for the transformer-cli Args: parser: Root parser to register command-specific arguments Ztrainz$CLI tool to train a model on a task.)
�helpz--train_dataTzcpath to train (and optionally evaluation) dataset as a csv with tab separated labels and sentences.)�type�requiredrz--column_labelr
z3Column of the dataset csv file with example labels.)r�defaultrz --column_textr z2Column of the dataset csv file with example texts.z--column_idrz0Column of the dataset csv file with example ids.z--skip_first_row� store_truez-Skip the first row of the csv file (headers).)�actionrz--validation_data�zpath to validation dataset.z--validation_splitg�������?z^if validation dataset is not provided, fraction of train dataset to use as validation dataset.z--outputz./z path to saved the trained model.z--task�text_classificationzTask to train the model on.z--modelzbert-base-uncasedz%Model's name or path to stored model.z--train_batch_size� zBatch size for training.z--valid_batch_size�@zBatch size for validation.z--learning_rategiUMu�>zLearning rate.z--adam_epsilong:�0�yE>zEpsilon for Adam optimizer.)
�funcN)� add_parser�add_argument�str�int�float�set_defaultsr)rZtrain_parserrrr�register_subcommand*s<


















z TrainCommand.register_subcommand)
rcCsB
tj
d
�
|_t�rdnd|_tj|
jdd�
|
j|_|
j|_|
j |_ |
j |_ |jjd|
j�d|
j ���

|
jdkr�tj|
j �
|_n|
jd kr�t�
n|
jd kr�t�
|jjd|
j���

tj|
j|
j|
j |
j |
jd�|_d|_|
j�
r|jjd |
j���

tj|
j|
j|
j |
j |
jd�|_|
j|_|
j|_|
j|_|
j|_|
j|_dS)Nztransformers-cli/training�tfZtorchT)
�exist_okzLoading z pipeline for rZtoken_classificationZquestion_answeringzLoading dataset from )�column_label�column_text� column_id�skip_first_rowz Loading validation dataset from )r � get_logger�loggerr� framework�os�makedirs�outputr&r'r(�info�task�modelrZfrom_pretrained�pipeline�NotImplementedErrorZ train_data� ProcessorZcreate_from_csvr)� train_dataset� valid_dataset�validation_data�validation_split�train_batch_size�valid_batch_size� learning_rate�adam_epsilon)�selfrrrr�__init__^sF



























zTrainCommand.__init__c

Cs|jd
kr|j
�S|j�S)Nr$)r,�run_tf� run_torch)
r>rrr�run�s


zTrainCommand.runc


Cst�
dS)
N)
r4)
r>rrrrA�s
zTrainCommand.run_torchc

Cs:|jj
|j|j|j|j|j|j|jd
�
|jj |j �

dS)N)r8r9r<r=r:r;)r3Zfitr6r7r9r<r=r:r;Zsave_pretrainedr/)
r>rrrr@�s







zTrainCommand.run_tfN)�__name__� __module__�__qualname__�staticmethodrr#rr?rBrAr@rrrrr )s

3-r )r-�argparserr�datarr5Z pipelinesr�utilsrrr rr�RuntimeErrorZUSE_XLAZUSE_AMPrr rrrr�s