Name	Size	Mode	Actions
accelerator_partitioner.cpython-36.pyc	29211	0644	editdlrm
const_fold.cpython-36.pyc	5899	0644	editdlrm
graph_gradual_typechecker.cpython-36.pyc	26871	0644	editdlrm
merge_matmul.cpython-36.pyc	5747	0644	editdlrm
normalize.cpython-36.pyc	5001	0644	editdlrm
optimization.cpython-36.pyc	14105	0644	editdlrm
partitioner_utils.cpython-36.pyc	9275	0644	editdlrm
refinement_types.cpython-36.pyc	921	0644	editdlrm
rewriter.cpython-36.pyc	4813	0644	editdlrm
schema_type_annotation.cpython-36.pyc	4037	0644	editdlrm
unify_refinements.cpython-36.pyc	2900	0644	editdlrm
__init__.cpython-36.pyc	157	0644	editdlrm

3 EgO�@s�dd
lZdd
l
Z
dd
lZdd
lZdd
lZddlmZ
ddlmZm Z m Z mZmZm Z
ddlmZ
ddlmZ
ddlmZ
dd
lZGdd�dej�ZGd d �d e�Ze ejje fe ejje fd�dd �Zd
S)�N)
�FunctionType)�cast�Union�Callable�Dict�Optional�Any)
�Tracer)
�Graph)
�normalize_source_linesc@s.eZ
dZd
Zed�
dd�Zdd�Zdd�Zd S) �AST_Rewriterax
Take a FunctionType object representing a `forward` method, then perform an AST rewrite to swap out nodes that are not symbolically traceable with a callsite to the FX alternative. To support swapping out an AST node, define a new `visit` method on that node. For more details, see: https://docs.python.org/3/library/ast.html#ast.NodeTransformer )
�fncCs�tj
|
�
\}}t|�
}d
j|�
}tj|�
}tj|�
}tj|j |�
�
}t |d
d�}tj|
j�
} t | j��
} t|| �
tt | j��
| �
}t|�
dks�t�
| |d}dd�} | ||
jd�S)N��exec�
r
cSs8t|j
|
|j|j|jd
�}tj||�}tj|j�
|_|S)z?Based on https://stackoverflow.com/a/13503277/2988730 (@unutbu))�nameZargdefsZclosure) r�__code__�__name__�__defaults__�__closure__� functools�update_wrapper�copy�__kwdefaults__)�
f�globals�
g�r�J/usr/local/lib64/python3.6/site-packages/torch/fx/experimental/rewriter.py�change_func_globals.s






z1AST_Rewriter.rewrite..change_func_globals)
r)�inspect�getsourcelinesr�join�textwrap�dedent�ast�parse�fix_missing_locations�visit�compiler�__globals__�set�keysr�list�len�AssertionError)�selfr �sourcelines�
_�sourceZnormalized_strZ source_astZdest_ast�codeZglobals_dictZkeys_beforeZnew_keysZfn_compiledrrrr�rewrites









zAST_Rewriter.rewritecCsrtj
d
dd�}t|tj�st�
|j}t|tj�s4t�
|
jr@|
jntjddd�}|
j |g|_ tj|d�
}tj||
�S)z� Swap out the Assert node (Python's `assert`) with a callsite to the symbolically-traceable torch._assert function ztorch._assert()�eval)
�moderN)�value�kind)
r8) r%r&� isinstance� Expressionr/�body�Call�msg�Constant�test�args�Expr� copy_location)r0�node�
nZ call_noder>Zexpr_wrapperrrr�visit_Assert?s




zAST_Rewriter.visit_AssertcCs4tj
|
jg
tjtjd
tj�d�|
j|
jggd�d�S)a
Swap out Python's AnnAssign with an Assign node where the annotation function is called. Example: Original: y: Tensor_Type(1,2,3, Dyn) = f2(x) Output: y = annotate(f2(x),Tensor_Type((1,2,3,Dyn))) Zannotate)�id�ctx)�funcrA�keywords)�targetsr8)r%�Assign�targetr=�Name�Loadr8� annotation)r0rDrrr�visit_AnnAssignSs 

zAST_Rewriter.visit_AnnAssignN)r� __module__�__qualname__�__doc__rr5rFrQrrrrr s 'rcs@eZ
dZdeejjefee e efed��f
dd� Z �ZS)�RewritingTracerN)�root� concrete_args�returncst�j
t|
�
|�S)
N)�super�trace�_rewrite)r0rVrW)
� __class__rrrZbs
zRewritingTracer.trace)
N)rrRrSr�torch�nn�Modulerrr�strrr rZ� __classcell__rr)
r\rrUas
rU)r rXc

sBt|t
jj�r,t
jjd
�
�f
dd���|�
St�jtt|��
SdS)N)
�
mc
s6G�f
d
d�dtj
j�}
t�jtt|j��
|
_|
|�
S)NcseZ
dZ��
fd
d�Z�ZS)z9_rewrite..rewrite_module..RewrittenModulecsZt�j
�
xJ|
jj�D]<\}}t|tjj�rBtj�
|�
�
|j|<qtj|�
|j|<qWdS)
N) rY�__init__�__dict__�itemsr:r]r^r_r)r0�orig�
k�
v)r\�rewrite_modulerrrcms



zB_rewrite..rewrite_module..RewrittenModule.__init__)rrRrSrcrar)
ri)
r\r�RewrittenModulels
rj)r]r^r_rr5rrZforward)rbrj)
rirrriks

z _rewrite..rewrite_module)r:r]r^r_rr5rr)
r r)
rirr[fs
r[)r%r r#rr�typesr�typingrrrrrrZtorch.fx._symbolic_tracer Ztorch.fx.graphr Ztorch._sourcesrr]�NodeTransformerrrUr^r_r[rrrr�
s









T