Name	Size	Mode	Actions
glue.cpython-36.pyc	24167	0644	editdlrm
squad.cpython-36.pyc	20418	0644	editdlrm
utils.cpython-36.pyc	12111	0644	editdlrm
xnli.cpython-36.pyc	2552	0644	editdlrm
__init__.cpython-36.pyc	717	0644	editdlrm

3 �Eg� �@s^dZd
dl
Z
ddlmZ
ddlmZmZ
eje�
ZGdd�de�Z d e i
Z d d i
Zd di
ZdS)z, XNLI utils (dataset loading and evaluation)�N�)
�logging�
)� DataProcessor�InputExamplec@s2eZ
dZd
Zddd�
Zdd�Zdd�Zd d �ZdS)� XnliProcessorz� Processor for the XNLI dataset. Adapted from https://github.com/google-research/bert/blob/f39e881b169b9d53bea03d2d341b31707a6c052b/run_classifier.py#L207 NcCs|
|_||_
dS)
N)�language�train_language)�selfrr �r�K/usr/local/lib/python3.6/site-packages/transformers/data/processors/xnli.py�__init__"s

zXnliProcessor.__init__cCs�|jd
kr|j
n|j}|jtjj|
d|�d���
}g}x�t|�
D]�\}}|dkrRq@d|��}|d}|d} |ddkr|d n|d} t|t�s�t d |�d��
�
t| t�s�t d | �d��
�
t| t�s�t d| �d��
�
|j t||| | d ��

q@W|S)zSee base class.Nz$XNLI-MT-1.0/multinli/multinli.train.z.tsvr
ztrain-r�Z contradictory� contradictionzTraining input z is not a stringzTraining label )�guid�text_a�text_b�label)r r� _read_tsv�os�path�join� enumerate� isinstance�str� ValueError�appendr)r �data_dirZlg�lines�examples�
i�linerrrrrrr�get_train_examples&s$
















z XnliProcessor.get_train_examplescCs�|jt
jj|
d
��
}g}x�t|�
D]�\}}|dkr4q"|d}||jkrHq"d|��}|d}|d} |d} t|t�s�td|�d��
�
t| t�s�td| �d��
�
t| t�s�td | �d��
�
|j t ||| | d ��

q"W|S)zSee base class.zXNLI-1.0/xnli.test.tsvr
ztest-��rzTraining input z is not a stringzTraining label )rrrr)rrrrrrrrrrr)r rrrr r!rrrrrrrr�get_test_examples;s(


















zXnliProcessor.get_test_examplesc

Cs d
ddgS)zSee base class.rZ entailmentZneutralr)
r rrr� get_labelsRszXnliProcessor.get_labels)
N)�__name__� __module__�__qualname__�__doc__r r"r%r&rrrrrs  rZxnliZclassification) r*r�utilsrrr� get_loggerr'�loggerrZxnli_processorsZxnli_output_modesZxnli_tasks_num_labelsrrrr�s
 <