/usr/local/lib64/python3.6/site-packages/torch/fx/__pycache__
Edit: /usr/local/lib64/python3.6/site-packages/torch/fx/__pycache__/proxy.cpython-36.pyc (14427B)
3
Eg9 @ sp d dl Z d dlZd dlZd dlZd dlZddlmZmZmZ d dl m
Z
m Z m Z m
Z
mZmZmZ ddlmZmZmZmZmZ ddlmZ ddlmZ edd G d
d d Zedd G d d
d
eZ edd G dd de Z edd G dd dZ edd G dd de Z edd G dd de Z!x eD ]Z"dd Z#e#e" q2W dd Z$xeD ]Z%e$e% qZW dS ) N )
magic_methodsreflectable_magic_methodsGraph)TupleDictOptionalIterableAnyIteratorCallable)TargetNodeArgument
base_types
map_aggregate)
compatibility)check_for_mutable_operationT)is_backward_compatiblec @ s2 e Zd ZU edZedZeeddd e e
e e df e
e e f ee ee edddZedded d
d d Zeddd e e
e edf e
e ef ee ee eegd f d
ddZdd Zeddee dddZeddd edddZeddd edddZeddd edddZdS )
TracerBaseFT)r N.)kindtargetargskwargsname type_exprreturnc C s0 |dkr| j rt||| | jj||||||S )a'
Inserts a graph node given target, args, kwargs, and name.
This method can be overridden to do extra checking, validation, or
modification of values used in node creation. For example, one might
want to disallow in-place operations from being recorded.
call_function)check_mutable_operationsr graph create_node)selfr r r r r r r" :/usr/local/lib64/python3.6/site-packages/torch/fx/proxy.pyr s zTracerBase.create_nodeProxy)noder c C s
t || S )N)r$ )r! r% r" r" r# proxy% s zTracerBase.proxy)r r r r r r proxy_factory_fnc C s | j |}| j |} t|ts"tt| ts0t| j|||| ||}
|sT| j|
} n||
} | jr| j } | rt j
| }
t j j |
}|j
}dj|| j_| S )ao
Create a Node from the given arguments, then return the Node
wrapped in a Proxy object.
If kind = 'placeholder', then we're creating a Node that
represents the parameter of a function. If we need to encode
a default parameter, we use the ``args`` tuple. ``args`` is
otherwise empty for ``placeholder`` Nodes.
)
create_arg
isinstancetupleAssertionErrordictr r& record_stack_traces_find_user_frame traceback
walk_stack StackSummaryextractformatjoinr% Z stack_trace)r! r r r r r r r' args_kwargs_r% r& Z
user_frameZwalk_stack_gensummaryZtb_linesr" r" r# create_proxy) s
zTracerBase.create_proxyc sH t j ddg}x* r: j rt fdd|D rP qW sDdS S )zf
Find the Python stack frame executing the user code during
symbolic tracing.
ztorch/fx/proxy.pyztorch/fx/symbolic_trace.pyc 3 s | ]} j jj| V qd S )N)f_code co_filenameendswith).0file)framer" r#
[ s z.TracerBase._find_user_frame..N)inspect currentframef_backall)r! Zfx_filesr" )r? r# r/ N s zTracerBase._find_user_frame)ar c sL t |t r t|dr |j S t |trVt|drVt fdd|D }t|| S t |ttfr~t| fdd|D S t |tri }x>|j D ]2\}} j |}dd }t
|| j |||< qW |S t |t r t j |j j |j
j |jS t |tr|jS t |ts2|dks2|d kr6|S td
t| dS ) z
A method that lowers the objects seen as arguments during symbolic evaluation
into Argument types that can be stored in IR.
Can be override to support more trace-specific types.
__fx_create_arg___fieldsc 3 s | ]} j |V qd S )N)r) )r= elem)r! r" r# r@ r s z(TracerBase.create_arg..c 3 s | ]} j |V qd S )N)r) )r= rH )r! r" r# r@ u s c S s t | trtdd S )NzMKeys for dictionaries used as an argument cannot contain a Node. Got key: {k})r* r RuntimeError)argr" r" r# no_node~ s
z&TracerBase.create_arg..no_nodeN.zargument of type: )r* r$ hasattrrF r+ typelistr- itemsr) r slicestartstopstepr% r NotImplementedError)r! rE r rkvrK r" )r! r# r) c s,
$ zTracerBase.create_arg)objr c C s t ddS )aF Called when a proxy object is being converted to a boolean, such as
when used in control flow. Normally we don't know what to do because
we don't know the value of the proxy, but a custom tracer can attach more
information to the graph node using create_node and can choose to return a value.
zFsymbolically traced variables cannot be used as inputs to control flowN)
TraceError)r! rX r" r" r# to_bool s zTracerBase.to_boolc C s t ddS )aA Called when a proxy object is being iterated over, such as
when used in control flow. Normally we don't know what to do because
we don't know the value of the proxy, but a custom tracer can attach more
information to the graph node using create_node and can choose to return an iterator.
aH Proxy object cannot be iterated. This can be attempted when the Proxy is used in a loop or as a *args or **kwargs function argument. See the torch.fx docs on pytorch.org for a more detailed explanation of what types of control flow can be traced, and check out the Proxy docstring for help troubleshooting Proxy iteration errorsN)rY )r! rX r" r" r# iter s zTracerBase.iterc C s t |d S )zCalled when a proxy object is has the keys() method called.
This is what happens when ** is called on a proxy. This should return an
iterator it ** is suppose to work in your custom tracer.
keys) Attribute)r! rX r" r" r# r\ s zTracerBase.keys)NN)NNN)__name__
__module__ __qualname__r r r. boolr r strr
r r r r r
r r r& r r9 r/ r) rZ r r[ r\ r" r" r" r# r
s(
6
@"-r c s" e Zd Zed fdd Z ZS )GraphAppendingTracer)r c s t j || _d S )N)super__init__r )r! r ) __class__r" r# re s
z GraphAppendingTracer.__init__)r^ r_ r` r re
__classcell__r" r" )rf r# rc s rc c @ s e Zd ZdS )rY N)r^ r_ r` r" r" r" r# rY s rY c @ s e Zd ZdZedddeddddZed d
d Zd d d
dZ d d ddZ
e d d ddZ e
d ddZedddd Zdd Zed ddZdS ) r$ a
``Proxy`` objects are ``Node`` wrappers that flow through the
program during symbolic tracing and record all the operations
(``torch`` function calls, method calls, operators) that they touch
into the growing FX Graph.
If you're doing graph transforms, you can wrap your own ``Proxy``
method around a raw ``Node`` so that you can use the overloaded
operators to add additional things to a ``Graph``.
``Proxy`` objects cannot be iterated. In other words, the symbolic
tracer will throw an error if a ``Proxy`` is used in a loop or as
an ``*args``/``**kwargs`` function argument.
There are two main ways around this:
1. Factor out the untraceable logic into a top-level function and
use ``fx.wrap`` on it.
2. If the control flow is static (i.e. the loop trip count is
based on some hyperparameter), the code can be kept in its original
position and refactored into something like::
for i in range(self.some_hyperparameter):
indexed_item = proxied_value[i]
For a more detailed description into the Proxy internals, check out
the "Proxy" section in `torch/fx/OVERVIEW.md`
T)r NzOptional[TracerBase])r% tracerc C s" |d krt |j}|| _|| _d S )N)rc r rh r% )r! r% rh r" r" r# re s
zProxy.__init__)r c C s d| j j dS )NzProxy())r% r )r! r" r" r# __repr__ s zProxy.__repr__r] c C s
t | |S )N)r] )r! rV r" r" r# __getattr__ s zProxy.__getattr__c O s | j jdd| f| |S )N call_method__call__)rh r9 )r! r r r" r" r# rm s zProxy.__call__c sn t j }|d k st|j}|d k s&tttj|j|jd }|j dkrb fddt
|j D S j j
S )N UNPACK_SEQUENCEc 3 s | ]} | V qd S )Nr" )r= i)r! r" r# r@ s z!Proxy.__iter__..)rA rB r, rC rN disget_instructionsr: f_lastiopnamerangeargvalrh r[ )r! r? Z
calling_frameinstr" )r! r# __iter__ s
zProxy.__iter__c C s | j j| S )N)rh rZ )r! r" r" r# __bool__ s zProxy.__bool__c C s | j j| S )N)rh r\ )r! r" r" r# r\ s z
Proxy.keysc C s t dd S )Nz'len' is not supported in symbolic tracing by default. If you want this call to be recorded, please call torch.fx.wrap('len') at module scope)rI )r! r" r" r# __len__ s z
Proxy.__len__c s |r|nf }|r|ni }i fdd}t jjj|| t jjj|| tdkrrtdtj d| tt j }t
|t j j r|j
f| }|jd|j||S t jj|r|jd|j||S |jd||||jj|jdS d S ) Nc s t | rd | j< d S )N)r* rh )rE )clstracersr" r# find_tracer
s
z-Proxy.__torch_function__..find_tracerr z!Found multiple different tracers z" while trying to trace operations rl r )r )torchZfxr% r lenrI rN r\ nextr[ r* _CZ ScriptMethodownerr9 r Z overridesZ is_tensor_method_or_propertyr^ r Z_target_to_str)r{ Z orig_methodtypesr r r} rh r" )r{ r| r# __torch_function__ s zProxy.__torch_function__)N)NN)r^ r_ r` __doc__r r re rb rj rk rm r rx ra ry r\ rz classmethodr r" r" r" r# r$ s r$ c @ s: e Zd ZeddeedddZedd Zdd Z d
S ) r] T)r )rootattrc C s || _ || _|j| _d | _d S )N)r r rh _node)r! r r r" r" r# re # s zAttribute.__init__c C s. | j d kr(| jjdt| j| jfi j| _ | j S )Nr )r rh r9 getattrr r r% )r! r" r" r# r% * s
zAttribute.nodec O s | j jd| j| jf| |S )Nrl )rh r9 r r )r! r r r" r" r# rm 2 s zAttribute.__call__N)
r^ r_ r` r r$ rb re propertyr% rm r" r" r" r# r] ! s r] Fc sn e Zd ZdZeed fdd ZedddZe dd Z
d
d Z d d
Z e dd Z
dd Zdd Z ZS )ParameterProxyz
A special proxy which lets "shape", "size", "dim", and a few other
attribute accesses pass through to the underlying module parameter object,
so that conditional tests on these attributes will not throw exception during tracing
)rh r% c s0 t j|| t|tjjs t|| _|| _d S )N) rd re r* r~ nn Parameterr, paramr )r! rh r% r r )rf r" r# re = s zParameterProxy.__init__)r c C s d| j dS )NzParameterProxy(ri )r )r! r" r" r# rj C s zParameterProxy.__repr__c C s | j jS )N)r shape)r! r" r" r# r F s zParameterProxy.shapec C s
| j j S )N)r size)r! r" r" r# r J s zParameterProxy.sizec C s
| j j S )N)r dim)r! r" r" r# r M s zParameterProxy.dimc C s | j jS )N)r ndim)r! r" r" r# r P s zParameterProxy.ndimc C s
| j j S )N)r numel)r! r" r" r# r T s zParameterProxy.numelc C s
| j j S )N)r nelement)r! r" r" r# r W s zParameterProxy.nelement)r^ r_ r` r r r re rb rj r r r r r r r rg r" r" )rf r# r 6 s r c s4 fdd} |_ d jd d}tt|| d S )Nc s$ | d j }tt }|jd|| |S )Nr r )rh r operatorr9 )r r rh r )methodr" r# impl] s
z_scope..impl___)r^ stripsetattrr$ )r r Zas_magicr" )r r# _scope\ s r c s: d j d d} fdd}||_||_tt|| d S )NZ__rr r c s t t }| jjd||| fi S )Nr )r r rh r9 )r! rhsr )orig_method_namer" r# r i s
z!_define_reflectable..impl)r r^ r` r r$ )r method_namer r" )r r# _define_reflectablef s
r )&rq r~ rA r r0 r r r r typingr r r r r
r r r% r
r r r r Z_compatibilityr Zoperator_schemasr r rc
ValueErrorrY r$ r] r r r r r r" r" r" r# s4 $ (c$