/usr/local/lib64/python3.6/site-packages/caffe2/python/layers/__pycache__
Edit: /usr/local/lib64/python3.6/site-packages/caffe2/python/layers/__pycache__/layers.cpython-36.pyc (13722B)
3
EgD @ sD d dl Z d dlmZ d dlZd dlmZ d dlmZm Z m
Z
m Z m Z d dl
mZ e jeZeje j e jejZe jejejZe jejZe j ejejZ d(dd Z d
d Z d d
Z dd Z!dd Z"G dd de#Z$i Z%dd Z&dd Z'dd Z(dd Z)ed d d gZ*G d d d e#Z+d!d" Z,ed#d$d%gZ-G d&d' d'e#Z.dS )) N)
namedtuple)
caffe2_pb2)coreschemascopeutils workspace)
TagContextTFc C sp |t kr0tj| t |||dp.tj| t|||dS |tkr`tj| t|||dp^tj| t|||dS tj| |S d S )N)check_field_namescheck_field_typescheck_field_metas)IdListr Z
equal_schemasIdListWithEvicted IdScoreListIdScoreListWithEvicted)recordZoriginal_schemar
r r r G/usr/local/lib64/python3.6/site-packages/caffe2/python/layers/layers.pyalmost_equal_schemas s6 r c C s` t | trd}n"t | tddr$d}ntdj| | | jd k sXtdjt| | | | S )NvaluesF)r z values:keyszNot implemented for {}z Blob {} doesn't have metadata)r r
r NotImplementedErrorformatmetadataAssertionErrorstr)r keyr r r get_key? s
r c C s t | }|jjS )N)r r categorical_limit)r r r r r get_categorical_limitN s r c C s | d j jS )Nlengths)r expected_value)r r r r get_avg_lengthS s r! c C s x| j D ]}d\}}|js*tjdd}nb|jjsP|jj}|jj}tjdd}n<|jj}|jj}tj|jjj|jjj|jjj d|jjj
d}t j |j
t js|d kstd|jtj|||d q
W d S )NT)feature_is_request_only) feature_type
feature_names feature_idsr" desired_hash_sizez7categorical_limit shouldn't be set for no-integer field)r r
feature_specs)NN) all_scalarsr r Z FeatureSpecr' r r r# r$ r% r& npZ
issubdtypeZ
field_typeintegerr Z set_metadataZMetadata)fieldfr r r' r r r set_request_onlyW s0
r- c @ s e Zd ZdZdZdZdZdZdS )InstantiationContextz=
List of contexts where layer could be instantitated
Zaccumulate_predevalZ
predictionZtrainingN)__name__
__module__ __qualname____doc__ACCUMULATE_PREDEVAL
PREDICTIONTRAININGr r r r r. z s
r. c C s" | t kstdj| |t | < d S )Nz{0} already exists)_LAYER_REGISTRYr r )nameZlayerr r r register_layer s r: c C s | t kS )N)r8 )r9 r r r layer_exists s r; c C s t | S )N)r8 )r9 r r r get_layer_class s r< c O s t | ||S )N)r8 )Z
layer_nameargskwargsr r r create_layer s r? LayerPsParamZ
sparse_keyZaverage_lengthc @ sZ e Zd ZdddZedd Zejdd Zedd Zejd d Zd
d Zd d
Z dS )LayerParameterNc C sF t |tjs tdjt|d | _|| _|| _|| _ || _
|| _ d S )Nz!expect {0} to be a blob reference)
isinstancer Z
BlobReferencer r r _shape parameter optimizer initializerps_param regularizer)selfrD rE rF rG rH r r r __init__ s zLayerParameter.__init__c C s | j S )N) _initializer)rI r r r rF s zLayerParameter.initializerc C sH |d ks,t jt|dd s,tdjt||| _|d k rD| j | _d S )Ntypez-initializer expects an operator, got type: {}) r Z
IsOperatorgetattrr r rL rK _infer_shape_from_initializershape)rI opr r r rF s c C s | j S )N)rC )rI r r r rO s zLayerParameter.shapec C s2 | j d ks(| j |ks(tdj| | j ||| _d S )NzBinconsistent shape for layer parameter: {}, expect: {}, but got {})rO r r rC )rI rO r r r rO s c C s x$| j jD ]}|jdkr
t|jS q
W tjd y`tjd}|j j
j | j g |j | j
d }|j| j
g| tj| tj|j }tj |S tk
r } z&tjdj| j
| j j| tj d S d }~X nX W d Q R X d S )NrO Z model_init_by_loading_paramsZ
shape_checkerrC z6Cannot infer the shape of blob {} from operator {}: {})rF argr9 listintsr ZWorkspaceGuardr ZNet_netrP extendNextScopedBlobrD ZShapeZ
RunNetOnceZ FetchBlobtolistZResetWorkspace RuntimeErrorloggerwarningr rL )rI rQ netZ
shape_blobrO expr r r rN s&
z,LayerParameter._infer_shape_from_initializerc C s
t | jS )N)r rD )rI r r r __str__ s zLayerParameter.__str__)NNNNN)
r0 r1 r2 rJ propertyrF setterrO rN r] r r r r rA s
rA c C sF t | j dkrdS x,| j D ] }|o8|jo8t|jdds dS q W dS )Nr Fr" T)lenZfield_metadatar' rM )scalarr r r r is_request_only_scalar s rb AccessedFeaturesrL idsc @ s e Zd Zd0ddZdd Zdd Zedd Zed
d Zed d
Z e j
dd
Z edd Z e j
dd Z dd Z dd Z
dd Zdd Zdd Zd1d d Zd d Zdejfd d!Zd"d# Zd$d% Zd&d' Zd(d) Zd*d+ Zd,d- Zd.d/ Z dS )2
ModelLayerNc K s |j || _|| _|| _|| _|r@t|ts2|g}| j| | _nd| _d| _t |j
dkrbd| _x |j
D ]}t |sld| _P qlW d| _ d| _
d| _d| _d| _t|pg | _| jjtj j g | _d| _d| _dS )aw
Base class for model layers. Layer is an abstraction that allows to
provide model description in terms of meta-operators, where each of the
meta-operators can have different implementations for training,
evaluation and prediction, that are instantiated later. As an example
SampledSoftmax can do something related to sampling depending on
supervision during the training and just apply softmax if it's used for
prediction/evaluation.
All inputs/outputs from layers are represented as a record (instance of
schema bounded to blobs) and are accessible through input_record and
output_schema. If Layer needs to have only a subset of inputs/provides
subset of outputs during the inference - it should provide
predict_input_record and predict_output_schema correspondingly (those
records are expected to be a subset of input_record/output_schema).
Each layer has a list of Tags associated with it, that depends on
current context and arguments. It's possible to use those tags during
the instantiation time.
NTr F)Znext_layer_namer9 modelr>
_input_recordrB rR _predict_input_record request_onlyr` r( rb Zprecomputation_request_onlyZprecomputation_object_only_output_schema_predict_output_schemaZeval_output_schemasettagsupdater currentparams_export_output_for_metrics_export_params_for_metrics)rI rf prefix input_recordZpredict_input_record_fieldsrm r> ra r r r rJ s4
zModelLayer.__init__c C s | j jS )N) __class__r0 )rI r r r get_type9 s zModelLayer.get_typec C s8 | j d k std| jd ks4tj| j| j s4tdd S )NzSchema is not initializedz:predict_output_schema is not a subset of the output_schema)rj r rk r Zis_schema_subset)rI r r r _check_output_schema< s z ModelLayer._check_output_schemac C s | j p
| jS )N)rh rg )rI r r r predict_input_recordB s z ModelLayer.predict_input_recordc C s | j S )N)rg )rI r r r rt F s zModelLayer.input_recordc C s | j | jp| jS )N)rw rk rj )rI r r r predict_output_schemaJ s z ModelLayer.predict_output_schemac C s | j d kst|| _ d S )N)rk r )rI
output_schemar r r ry O s c C s | j rt| j | j | jS )N)ri r- rj rw )rI r r r rz T s
zModelLayer.output_schemac C s | j d kst|| _ d S )N)rj r )rI rz r r r rz [ s c C s | j S )N)rp )rI r r r get_parameters` s zModelLayer.get_parametersc C s g S )z
s z-ModelLayer.add_init_params..N)
rp rF r ZCurrentDeviceScopeZHasFieldr Z OperatorDefZCopyFromr anyrT rP rU )rI init_netparamZcurrent_device_scoper )r r add_init_paramsq s
zModelLayer.add_init_paramsc sb t j| jddH | jj||||||d t fdd| jD sFt| jj j S Q R X d S )NT)reset)
param_namerO rF rE rG rH c 3 s | ]} j |j kV qd S )N)rD )r p)r r r r s z*ModelLayer.create_param..)
r NameScoper9 rf create_paramallrp r appendrD )rI r rO rF rE rG rH r )r r r s zModelLayer.create_paramc C s* t j| jdd | jjj|S Q R X d S )NT)r )r r r9 rf r[ rV )rI r9 r r r get_next_blob_reference s z"ModelLayer.get_next_blob_referencec C s t j| j |tjtjtjhkr.|s.td|r<| j| |tj krR| j
| n6|tjkrh| j | n |tjkr~| j | n
| j
| |tj tjhkr| jr| j| W dQ R X dS )z
Adds layer trainig or initialization operators to the passed in net.
init_net can be None and can be called independently from add_init_params
z4Only prediction and eval context don't need init_netN)r r r9 r. r6 r5 r4 r r r7
add_train_ops add_eval_opsadd_ops_to_accumulate_predadd_opsrr add_param_copy_operators)rI r[ r contextr r r
add_operators s$
zModelLayer.add_operatorsc C s t d S )N)r )rI r[ r r r r s zModelLayer.add_opsc C s | j | d S )N)r )rI r[ r r r r s zModelLayer.add_eval_opsc C s | j | d S )N)r )rI r[ r r r r s zModelLayer.add_train_opsc C s | j | d S )N)r )rI r[ r r r r s z%ModelLayer.add_ops_to_accumulate_predc C s: x4| j D ]*}| jjt|j }|j|jg|j qW d S )N)rp rf Zmetrics_schemar rD ZCopyZ field_blobs)rI r[ r param_copy_refr r r r s z#ModelLayer.add_param_copy_operatorsc C s$ d| _ | jd }| jj|| j d S )NTz/output)rq r9 rf add_metric_fieldrz )rI Z export_namer r r export_output_for_metrics s
z$ModelLayer.export_output_for_metricsc C sJ d| _ x>| jD ]4}| jt|jdd d }| jjt|j| qW d S )NT/ _copy)rr rp r r splitrf r rD )rI r r r r r export_params_for_metrics s
z$ModelLayer.export_params_for_metrics)NN)NN) r0 r1 r2 rJ rv rw r^ rx rt ry r_ rz r{ r| r} r~ r r r r. r7 r r r r r r r r r r r r re s2
7 !
re )TTF)/logging collectionsr Znumpyr) Z caffe2.protor Z
caffe2.pythonr r r r r Zcaffe2.python.layers.tagsr getLoggerr0 rY setLevelINFOListZint64r
ZMapZfloat32r ZListWithEvictedr ZMapWithEvictedr r r r r! r- objectr. r8 r: r; r< r? r@ rA rb rc re r r r r s:
"#J