3
Eg3 @ s4 d dl Zd dlmZmZmZmZ G dd deZdS ) N)brewcore model_helper recurrentc @ sd e Zd ZdddZdddZdddZdd Zdd
d Zd d
Zdd Z e
dd Z e
dd Z dS ) CRFWithLossNc C s\ || _ || _|d | _|sB| j jjg tjdg| j| jgddd}|| _| j jj | j d S )N Zcrf_transitionsg ?)shapeminmaxg )
model num_classesnum_classes_paddedparam_init_netZ UniformFillr ScopedBlobReference transitionsparamsappend)selfr r Ztransitions_blob r =/usr/local/lib64/python3.6/site-packages/caffe2/python/crf.py__init__ s
zCRFWithLoss.__init__c C s4 | j jj| jtjd}| j||| j}tj || j j
| j j| j}tj || j j
| j j| j}| j |||}| j jj
||gtjd}| j j
jg dgdd}| j jj||gtjddd} | j jj|gddd d
\}
} | j jj|
gtjd dgd }
| j jj|tjd
} | j|
| | }
| j jj|
|gtjd}|S )Ntransitions_snapshotZ
path_total r )r valueZ rnn_initialT)dense_gradientr )
padding_widthend_padding_widthoutputsZrnn_input_data)dimstransitions_copycrf_loss)r netZCopyr r r _gather_entries_sumr r pad_predictionsr
pad_labels_path_binary_scoresAdd ConstantFillGather
RemovePadding
ExpandDims _crf_forwardSub)r predictionslabels seq_lengthsr Zpath_unary_scoreZpath_binary_scoreZpath_total_score
zero_index
initial_stateZ
input_data_r Zall_paths_scoresZlossr r r r s:
zCRFWithLoss.crf_lossc C s | j jj|gdddd\}}| j jj|gdddd\}}| j jj|g| jd}| j jj||g}| j jj||g}| j jj|g} | j jj| |gdd}
| j j |
S )Nr r r )r r r )r T)r )
r r! r) r' r
ZMulr& FlattenToVecr( ReduceFrontSum) r r. r r/ Z
column_idsr2 Zrow_idsZnum_columns_blobZ
flattened_idsZflattened_transitionsentriesr r r r% T s z CRFWithLoss._path_binary_scoresc
C s~ | j jj|gdd}| j jjg dg|d}| j jj||g}| j jj|}| j jj|}| j jj||g}| j jj|g} | S )Nint64)tor )r r ) r r! Castr r' ZOneHotr3 Z
DotProductr4 )
r Zin_dataindicesZ
index_sizeZindex_size_blobZ
query_one_hotZflattend_queryZ
flattend_dataZ query_scoresZ final_sumr r r r" i s z CRFWithLoss._gather_entries_sumc C sx | j |||}| jjj|gd| jfd\}}| jjjg d| jgtjj d}| jjj
||g}| jjj|df d\}}|S )Nr )r r r )r r dtype)
build_crf_netr r! Reshaper
r r' r DataTypeINT32SortedSegmentRangeLogSumExp) r
input_blobr1 r r/ out_lastr2 zero_segment_idZ accum_scorer r r r+ u s
zCRFWithLoss._crf_forwardc s d fdd}t jd| jd}|jjtjdtjd|\}}}|jjg |dgd | j gtj
j d
} |jj | t
j|||d gdd}
|jj|
|dg| j d d} |jj||dg| j d
d} |jj| | g|dg}
|jj|
|g|dgd
d
d}|jj||d|dg| j | j fd\}}|jj|| g|dg}|jj| |}tj| jj|j||fg||fg||i dd\}}|S ) a
Adds the crf_net recurrent operator to the model.
model: model_helper.ModelHelper object new operators would be added
to
input_blob: the input sequence in a format T x N x D
where T is sequence size, N - batch size and D - input dimension
##Only supports batch-size 1##
seq_lengths: blob containing sequence lengths (unused)
Zcrf_netc s dj t t| S ) z{}/{})formatstr)name)scoper r s s z$CRFWithLoss.build_crf_net.