/usr/local/lib64/python3.6/site-packages/caffe2/python/helpers/__pycache__
Edit: /usr/local/lib64/python3.6/site-packages/caffe2/python/helpers/__pycache__/fc.cpython-36.pyc (3492B)
3
Eg @ s^ d dl mZ d dlmZ d dlmZ dddZdd Zd
d Zdd
dZ dddZ
dd Z dS ) )core) initializers)
ParameterTagsNFc K s t j||di f}t j| |di f} | js:t j }t j } |pF| jj }tjg}
d| krd|
jtj | j
|d ||g|tj d}| j
|d |g| |
d}|
rd| d< | rd | d
< ||||g|f| S ) N
XavierFill ConstantFillZ freeze_bias_w)
param_nameshape initializertags_bZ
TENSORCOREZengineTfloat16_compute) r update_initializer init_paramsZExternalInitializernetNextNamer ZBIASappendZCOMPUTED_PARAM create_paramZWEIGHT)modelZop_callblob_inblob_outdim_indim_out weight_init bias_initWeightInitializerBiasInitializerZenable_tensor_corer
kwargsZ bias_tagsweightbias r D/usr/local/lib64/python3.6/site-packages/caffe2/python/helpers/fc.py_FC_or_packed_FC
s4
r" c O s t | | jjf||S )N)r" r ZFC)r argsr r r r! fc9 s r$ c O s t | | jjf||S )N)r" r ZPackedFC)r r# r r r r! packed_fc= s r% c
K s t j||di f}t j| |di f} |p0| jj }| j|d ||g|d} | j|d ||g|d} | j|d |g| d}
| jj|| | |
g|f|
S )z[FC_Decomp version
Here we assume that the rank of original input is bigger than 5.
r r Z_u)r r r
Z_vr )r r r r r Z FC_Decomp)r r r r r Z rank_approxr r r r r uvr r r r! fc_decompA s$ r) h㈵>皙?c K s: |r|ndi f}|r|ndi f}|r(|ndi f}|p<| j j }|d } | jrV| jjg |d dg|
d}
| jj|d g |d fd ||gi|d }| jjg |d
||gd d}| jj|d g |d fd ||gi|d }| jj|d g |d
fd |gi|d }| jj|d g |d fd ||gi|d }| jjg |d dg|d}n~tj|d | j}
tj|d | j}tj|d
| j}tj|d
| j}tj|d | j}tj|d | j}tj|d | j}| j| | j| | r| j j ||||||||
g|| gf| S | j j ||||||||
g|f| S dS )z3FC_Prune version
Runnable so far. Great!:)
r r Z_compress_rateZ_lb )r valuer r r _mg ?Z_ag_dwr Z _mask_seqZ_thresN)
r r r Zparam_init_netr __getattr__r ZScopedBlobReference AddParameterZFC_Prune)r r r r r r r Z mask_init thresholdZneed_compress_rateZcomp_lbr Z
compress_rateZ compress_lbr maskZag_dwr Zmask_seqZthresr r r! fc_pruneb s
r3 c K s\ |o|o|o|st d | j| | j| | j| | j| | jj|||||g|f|S )z*FC_Sparse: Only takes in allocated weightsz
Warning...)printr0 r Z FC_Sparse)r r r Zw_csriwZjwr r r r r! fc_sparse s
r6 )NNNNFF)r& NNNN)NNNr* Fr+ ) Z
caffe2.pythonr Zcaffe2.python.modelingr Z%caffe2.python.modeling.parameter_infor r" r$ r% r) r3 r6 r r r r!
s
)
S