/usr/local/lib64/python3.6/site-packages/torch/nn/modules/__pycache__
NameSizeModeActions
activation.cpython-36.pyc476350644editdlrm
adaptive.cpython-36.pyc97250644editdlrm
batchnorm.cpython-36.pyc310390644editdlrm
channelshuffle.cpython-36.pyc19010644editdlrm
container.cpython-36.pyc279700644editdlrm
conv.cpython-36.pyc577890644editdlrm
distance.cpython-36.pyc36840644editdlrm
dropout.cpython-36.pyc103100644editdlrm
flatten.cpython-36.pyc58130644editdlrm
fold.cpython-36.pyc128070644editdlrm
instancenorm.cpython-36.pyc188080644editdlrm
lazy.cpython-36.pyc116900644editdlrm
linear.cpython-36.pyc101880644editdlrm
loss.cpython-36.pyc914650644editdlrm
module.cpython-36.pyc665300644editdlrm
normalization.cpython-36.pyc113600644editdlrm
padding.cpython-36.pyc222170644editdlrm
pixelshuffle.cpython-36.pyc43980644editdlrm
pooling.cpython-36.pyc532030644editdlrm
rnn.cpython-36.pyc446530644editdlrm
sparse.cpython-36.pyc209560644editdlrm
transformer.cpython-36.pyc207370644editdlrm
upsampling.cpython-36.pyc107800644editdlrm
utils.cpython-36.pyc25280644editdlrm
_functions.cpython-36.pyc54410644editdlrm
__init__.cpython-36.pyc52360644editdlrm
Edit: /usr/local/lib64/python3.6/site-packages/torch/nn/modules/__pycache__/conv.cpython-36.pyc (57789B)
3 Eg @sddlZddlZddlZddlmZddlmZmZddlmZ ddlm Z ddl m Z dd l mZdd lmZmZmZmZdd lmZdd lmZmZmZdd lmZmZmZmZdddZGdddeZ Gddde Z!Gddde Z"Gddde Z#Gddde Z$Gddde$Z%Gddde$Z&Gdd d e$Z'Gd!d"d"e$Z(Gd#d$d$e Z)Gd%d&d&e)e!Z*Gd'd(d(e)e"Z+Gd)d*d*e)e#Z,Gd+d,d,e)e%Z-Gd-d.d.e)e&Z.Gd/d0d0e)e'Z/dS)1N)Tensor) ParameterUninitializedParameter) functional)init)LazyModuleMixin)Module)_single_pair_triple_reverse_repeat_tuple)reproducibility_notes) _size_1_t _size_2_t _size_3_t)OptionalListTupleUniona* :attr:`groups` controls the connections between inputs and outputs. :attr:`in_channels` and :attr:`out_channels` must both be divisible by :attr:`groups`. For example, * At groups=1, all inputs are convolved to all outputs. * At groups=2, the operation becomes equivalent to having two conv layers side by side, each seeing half the input channels and producing half the output channels, and both subsequently concatenated. * At groups= :attr:`in_channels`, each input channel is convolved with its own set of filters (of size :math:`\frac{\text{out\_channels}}{\text{in\_channels}}`).aWhen `groups == in_channels` and `out_channels == K * in_channels`, where `K` is a positive integer, this operation is also known as a "depthwise convolution". In other words, for an input of size :math:`(N, C_{in}, L_{in})`, a depthwise convolution with a depthwise multiplier `K` can be performed with the arguments :math:`(C_\text{in}=C_\text{in}, C_\text{out}=C_\text{in} \times \text{K}, ..., \text{groups}=C_\text{in})`.)Z groups_noteZdepthwise_separable_notecs.eZdZUddddddddd g Zd eejiZeeeeed d d Ze  e e  e  ee dfee dfeeee dffee dfeee dfe eeeede e ee dfee dfee dfee dfeee dfe eedd fdd ZddddZddZfddZZ S)_ConvNdstridepaddingdilationgroups padding_modeoutput_padding in_channels out_channels kernel_sizebias)inputweightr!returncCsdS)N)selfr"r#r!r%r%A/usr/local/lib64/python3.6/site-packages/torch/nn/modules/conv.py _conv_forward2sz_ConvNd._conv_forward.N) rrr rrr transposedrrr!rr$cs| | d}tt|j|| dkr,td|| dkr@tdddh}t|tr||krjtdj|||dkrtdd |Drtd d d d dh}| |krtdj|| ||_||_ ||_ ||_ ||_ ||_ ||_||_| |_| |_t|j tr~ddgt||_|dkrxtt||tt|dddD]D\}}}||d}|d}||jd|<|||jd|d<q4Wnt|j d|_|rttj||| f|f||_n ttj||| f|f||_| rttj|f||_n |jdd|jdS)N)devicedtyperz'in_channels must be divisible by groupsz(out_channels must be divisible by groupsZsameZvalidz0Invalid padding string {!r}, should be one of {}css|]}|dkVqdS)rNr%).0sr%r%r' ]sz#_ConvNd.__init__..z8padding='same' is not supported for strided convolutionszerosZreflectZ replicateZcircularz9padding_mode must be one of {}, but got padding_mode='{}'rrr!r0)superr__init__ ValueError isinstancestrformatanyrrr rrrr)rrrlen _reversed_padding_repeated_twiceziprangerrtorchemptyr#r!Zregister_parameterreset_parameters)r&rrr rrrr)rrr!rr*r+factory_kwargsZvalid_padding_stringsZvalid_padding_modesdkiZ total_paddingZleft_pad) __class__r%r'r2Cs^           z_ConvNd.__init__)r$cCsTtj|jtjdd|jdk rPtj|j\}}dtj|}tj|j| |dS)N)ar)rZkaiming_uniform_r#mathsqrtr!Z_calculate_fan_in_and_fan_outZuniform_)r&Zfan_in_boundr%r%r'r>s  z_ConvNd.reset_parameterscCsd}|jd t|jkr |d7}|jd t|jkr<|d7}|jd t|jkrX|d7}|jdkrj|d7}|jdkr||d7}|jd kr|d 7}|jf|jS)NzI{in_channels}, {out_channels}, kernel_size={kernel_size}, stride={stride}rz, padding={padding}rz, dilation={dilation}z!, output_padding={output_padding}z, groups={groups}z , bias=Falser/z, padding_mode={padding_mode})r)r)r) rr8rrrr!rr6__dict__)r&r-r%r%r' extra_reprs   z_ConvNd.extra_reprcs$tt|j|t|ds d|_dS)Nrr/)r1r __setstate__hasattrr)r&state)rCr%r'rLs z_ConvNd.__setstate__)NN)!__name__ __module__ __qualname__Z __constants__rr<r__annotations__r(intZ _in_channelsrr9rrr rrr5rrboolr)rrrr#r!r2r>rKrL __classcell__r%r%)rCr'r+s.     R< rc s|eZdZddjfeedZdeeeee e efeee e dd fd d Z e e ee d d dZe e dddZZS)Conv1daApplies a 1D convolution over an input signal composed of several input planes. In the simplest case, the output value of the layer with input size :math:`(N, C_{\text{in}}, L)` and output :math:`(N, C_{\text{out}}, L_{\text{out}})` can be precisely described as: .. math:: \text{out}(N_i, C_{\text{out}_j}) = \text{bias}(C_{\text{out}_j}) + \sum_{k = 0}^{C_{in} - 1} \text{weight}(C_{\text{out}_j}, k) \star \text{input}(N_i, k) where :math:`\star` is the valid `cross-correlation`_ operator, :math:`N` is a batch size, :math:`C` denotes a number of channels, :math:`L` is a length of signal sequence. u- This module supports :ref:`TensorFloat32`. * :attr:`stride` controls the stride for the cross-correlation, a single number or a one-element tuple. * :attr:`padding` controls the amount of padding applied to the input. It can be either a string {{'valid', 'same'}} or a tuple of ints giving the amount of implicit padding applied on both sides. * :attr:`dilation` controls the spacing between the kernel points; also known as the à trous algorithm. It is harder to describe, but this `link`_ has a nice visualization of what :attr:`dilation` does. {groups_note} Note: {depthwise_separable_note} Note: {cudnn_reproducibility_note} Note: ``padding='valid'`` is the same as no padding. ``padding='same'`` pads the input so the output has the shape as the input. However, this mode doesn't support any stride values other than 1. Args: in_channels (int): Number of channels in the input image out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int, tuple or str, optional): Padding added to both sides of the input. Default: 0 padding_mode (string, optional): ``'zeros'``, ``'reflect'``, ``'replicate'`` or ``'circular'``. Default: ``'zeros'`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` a: Shape: - Input: :math:`(N, C_{in}, L_{in})` - Output: :math:`(N, C_{out}, L_{out})` where .. math:: L_{out} = \left\lfloor\frac{L_{in} + 2 \times \text{padding} - \text{dilation} \times (\text{kernel\_size} - 1) - 1}{\text{stride}} + 1\right\rfloor Attributes: weight (Tensor): the learnable weights of the module of shape :math:`(\text{out\_channels}, \frac{\text{in\_channels}}{\text{groups}}, \text{kernel\_size})`. The values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{in} * \text{kernel\_size}}` bias (Tensor): the learnable bias of the module of shape (out_channels). If :attr:`bias` is ``True``, then the values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{in} * \text{kernel\_size}}` Examples:: >>> m = nn.Conv1d(16, 33, 3, stride=2) >>> input = torch.randn(20, 16, 50) >>> output = m(input) .. _cross-correlation: https://en.wikipedia.org/wiki/Cross-correlation .. _link: https://github.com/vdumoulin/conv_arithmetic/blob/master/README.md rrTr/N) rrr rrrrr!rr$c  sh| | d} t|} t|}t|tr(|nt|}t|}tt|j||| |||dtd||| f | dS)N)r*r+Fr)r r4r5r1rVr2)r&rrr rrrrr!rr*r+r? kernel_size_stride_padding_ dilation_)rCr%r'r2 s   zConv1d.__init__)r"r#r!cCsX|jdkr:tjtj||j|jd|||jtd|j|jStj||||j|j |j|jS)Nr/)moder) rFZconv1dpadr9rr rrr)r&r"r#r!r%r%r'r($s  zConv1d._conv_forward)r"r$cCs|j||j|jS)N)r(r#r!)r&r"r%r%r'forward,szConv1d.forward)rrrrTr/NN)rOrPrQr6rconvolution_notes__doc__rSrrr5rTr2rrr(r^rUr%r%)rCr'rVs;! rVc s|eZdZddjfeedZdeeeee e efeee e dd fd d Z e e ee d d dZe e dddZZS)Conv2daApplies a 2D convolution over an input signal composed of several input planes. In the simplest case, the output value of the layer with input size :math:`(N, C_{\text{in}}, H, W)` and output :math:`(N, C_{\text{out}}, H_{\text{out}}, W_{\text{out}})` can be precisely described as: .. math:: \text{out}(N_i, C_{\text{out}_j}) = \text{bias}(C_{\text{out}_j}) + \sum_{k = 0}^{C_{\text{in}} - 1} \text{weight}(C_{\text{out}_j}, k) \star \text{input}(N_i, k) where :math:`\star` is the valid 2D `cross-correlation`_ operator, :math:`N` is a batch size, :math:`C` denotes a number of channels, :math:`H` is a height of input planes in pixels, and :math:`W` is width in pixels. u This module supports :ref:`TensorFloat32`. * :attr:`stride` controls the stride for the cross-correlation, a single number or a tuple. * :attr:`padding` controls the amount of padding applied to the input. It can be either a string {{'valid', 'same'}} or a tuple of ints giving the amount of implicit padding applied on both sides. * :attr:`dilation` controls the spacing between the kernel points; also known as the à trous algorithm. It is harder to describe, but this `link`_ has a nice visualization of what :attr:`dilation` does. {groups_note} The parameters :attr:`kernel_size`, :attr:`stride`, :attr:`padding`, :attr:`dilation` can either be: - a single ``int`` -- in which case the same value is used for the height and width dimension - a ``tuple`` of two ints -- in which case, the first `int` is used for the height dimension, and the second `int` for the width dimension Note: {depthwise_separable_note} Note: {cudnn_reproducibility_note} Note: ``padding='valid'`` is the same as no padding. ``padding='same'`` pads the input so the output has the shape as the input. However, this mode doesn't support any stride values other than 1. Args: in_channels (int): Number of channels in the input image out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int, tuple or str, optional): Padding added to all four sides of the input. Default: 0 padding_mode (string, optional): ``'zeros'``, ``'reflect'``, ``'replicate'`` or ``'circular'``. Default: ``'zeros'`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` a Shape: - Input: :math:`(N, C_{in}, H_{in}, W_{in})` - Output: :math:`(N, C_{out}, H_{out}, W_{out})` where .. math:: H_{out} = \left\lfloor\frac{H_{in} + 2 \times \text{padding}[0] - \text{dilation}[0] \times (\text{kernel\_size}[0] - 1) - 1}{\text{stride}[0]} + 1\right\rfloor .. math:: W_{out} = \left\lfloor\frac{W_{in} + 2 \times \text{padding}[1] - \text{dilation}[1] \times (\text{kernel\_size}[1] - 1) - 1}{\text{stride}[1]} + 1\right\rfloor Attributes: weight (Tensor): the learnable weights of the module of shape :math:`(\text{out\_channels}, \frac{\text{in\_channels}}{\text{groups}},` :math:`\text{kernel\_size[0]}, \text{kernel\_size[1]})`. The values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{in} * \prod_{i=0}^{1}\text{kernel\_size}[i]}` bias (Tensor): the learnable bias of the module of shape (out_channels). If :attr:`bias` is ``True``, then the values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{in} * \prod_{i=0}^{1}\text{kernel\_size}[i]}` Examples: >>> # With square kernels and equal stride >>> m = nn.Conv2d(16, 33, 3, stride=2) >>> # non-square kernels and unequal stride and with padding >>> m = nn.Conv2d(16, 33, (3, 5), stride=(2, 1), padding=(4, 2)) >>> # non-square kernels and unequal stride and with padding and dilation >>> m = nn.Conv2d(16, 33, (3, 5), stride=(2, 1), padding=(4, 2), dilation=(3, 1)) >>> input = torch.randn(20, 16, 50, 100) >>> output = m(input) .. _cross-correlation: https://en.wikipedia.org/wiki/Cross-correlation .. _link: https://github.com/vdumoulin/conv_arithmetic/blob/master/README.md rrTr/N) rrr rrrrr!rr$c  sh| | d} t|} t|}t|tr(|nt|}t|}tt|j||| |||dtd||| f | dS)N)r*r+Fr)r r4r5r1rar2)r&rrr rrrrr!rr*r+r?rWrXrYrZ)rCr%r'r2s   zConv2d.__init__)r"r#r!cCsX|jdkr:tjtj||j|jd|||jtd|j|jStj||||j|j |j|jS)Nr/)r[r) rr\Zconv2dr]r9rr rrr)r&r"r#r!r%r%r'r(s  zConv2d._conv_forward)r"r$cCs|j||j|jS)N)r(r#r!)r&r"r%r%r'r^szConv2d.forward)rrrrTr/NN)rOrPrQr6rr_r`rSrrr5rTr2rrr(r^rUr%r%)rCr'ra0sA+ rac s|eZdZddjfeedZdeeeee e efeee e dd fd d Z e e ee d d dZe e dddZZS)Conv3daApplies a 3D convolution over an input signal composed of several input planes. In the simplest case, the output value of the layer with input size :math:`(N, C_{in}, D, H, W)` and output :math:`(N, C_{out}, D_{out}, H_{out}, W_{out})` can be precisely described as: .. math:: out(N_i, C_{out_j}) = bias(C_{out_j}) + \sum_{k = 0}^{C_{in} - 1} weight(C_{out_j}, k) \star input(N_i, k) where :math:`\star` is the valid 3D `cross-correlation`_ operator uk This module supports :ref:`TensorFloat32`. * :attr:`stride` controls the stride for the cross-correlation. * :attr:`padding` controls the amount of padding applied to the input. It can be either a string {{'valid', 'same'}} or a tuple of ints giving the amount of implicit padding applied on both sides. * :attr:`dilation` controls the spacing between the kernel points; also known as the à trous algorithm. It is harder to describe, but this `link`_ has a nice visualization of what :attr:`dilation` does. {groups_note} The parameters :attr:`kernel_size`, :attr:`stride`, :attr:`padding`, :attr:`dilation` can either be: - a single ``int`` -- in which case the same value is used for the depth, height and width dimension - a ``tuple`` of three ints -- in which case, the first `int` is used for the depth dimension, the second `int` for the height dimension and the third `int` for the width dimension Note: {depthwise_separable_note} Note: {cudnn_reproducibility_note} Note: ``padding='valid'`` is the same as no padding. ``padding='same'`` pads the input so the output has the shape as the input. However, this mode doesn't support any stride values other than 1. Args: in_channels (int): Number of channels in the input image out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int, tuple or str, optional): Padding added to all six sides of the input. Default: 0 padding_mode (string, optional): ``'zeros'``, ``'reflect'``, ``'replicate'`` or ``'circular'``. Default: ``'zeros'`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` a Shape: - Input: :math:`(N, C_{in}, D_{in}, H_{in}, W_{in})` - Output: :math:`(N, C_{out}, D_{out}, H_{out}, W_{out})` where .. math:: D_{out} = \left\lfloor\frac{D_{in} + 2 \times \text{padding}[0] - \text{dilation}[0] \times (\text{kernel\_size}[0] - 1) - 1}{\text{stride}[0]} + 1\right\rfloor .. math:: H_{out} = \left\lfloor\frac{H_{in} + 2 \times \text{padding}[1] - \text{dilation}[1] \times (\text{kernel\_size}[1] - 1) - 1}{\text{stride}[1]} + 1\right\rfloor .. math:: W_{out} = \left\lfloor\frac{W_{in} + 2 \times \text{padding}[2] - \text{dilation}[2] \times (\text{kernel\_size}[2] - 1) - 1}{\text{stride}[2]} + 1\right\rfloor Attributes: weight (Tensor): the learnable weights of the module of shape :math:`(\text{out\_channels}, \frac{\text{in\_channels}}{\text{groups}},` :math:`\text{kernel\_size[0]}, \text{kernel\_size[1]}, \text{kernel\_size[2]})`. The values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{in} * \prod_{i=0}^{2}\text{kernel\_size}[i]}` bias (Tensor): the learnable bias of the module of shape (out_channels). If :attr:`bias` is ``True``, then the values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{in} * \prod_{i=0}^{2}\text{kernel\_size}[i]}` Examples:: >>> # With square kernels and equal stride >>> m = nn.Conv3d(16, 33, 3, stride=2) >>> # non-square kernels and unequal stride and with padding >>> m = nn.Conv3d(16, 33, (3, 5, 2), stride=(2, 1, 1), padding=(4, 2, 0)) >>> input = torch.randn(20, 16, 10, 50, 100) >>> output = m(input) .. _cross-correlation: https://en.wikipedia.org/wiki/Cross-correlation .. _link: https://github.com/vdumoulin/conv_arithmetic/blob/master/README.md rrTr/N) rrr rrrrr!rr$c  sh| | d} t|} t|}t|tr(|nt|}t|}tt|j||| |||dtd||| f | dS)N)r*r+Fr)r r4r5r1rbr2)r&rrr rrrrr!rr*r+r?rWrXrYrZ)rCr%r'r2%s   zConv3d.__init__)r"r#r!cCsX|jdkr:tjtj||j|jd|||jtd|j|jStj||||j|j |j|jS)Nr/)r[r) rr\Zconv3dr]r9rr rrr)r&r"r#r!r%r%r'r(<s zConv3d._conv_forward)r"r$cCs|j||j|jS)N)r(r#r!)r&r"r%r%r'r^MszConv3d.forward)rrrrTr/NN)rOrPrQr6rr_r`rSrrr5rTr2rrr(r^rUr%r%)rCr'rbs7, rbc s`eZdZdddfdd Zd eeeeeeeeeeeeeeedddZZ S) _ConvTransposeNdN)r$c sP| dkrtdj|jj| | d}tt|j||||||||| | | f |dS)Nr/z-Only "zeros" padding mode is supported for {})r*r+)r3r6rCrOr1rcr2)r&rrr rrrr)rrr!rr*r+r?)rCr%r'r2Ss  z_ConvTransposeNd.__init__)r" output_sizerrr rr$c Cs|dkrt|j}n|jd}t||dkr>|dd}t||krdtdj||dt|tjjt t g} tjjt t g} x~t |D]r} |j | dd|| d|| |dk r|| nd|| dd} | j | | j | | || dqWxbt t|D]R} || }| | }| | }||ksF||krtdj|| | |j ddqWtjjt t g}x(t |D]} |j || | | qW|}|S)Nrz0output_size must have {} or {} elements (got {})rzXrequested an output size of {}, but valid sizes range from {} to {} (for an input of {}))r rZdimr8r3r6r<ZjitZannotaterrSr;sizeappend)r&r"rdrrr rretrAZ min_sizesZ max_sizesr@Zdim_sizerBreZmin_sizemax_sizeresr%r%r'_output_paddingas8   J  z _ConvTransposeNd._output_padding)NN)N) rOrPrQr2rrrrSrjrUr%r%)rCr'rcRsrcc sheZdZdjfeedZdeeeeeeee ee dd fd d Z de e eee d d d ZZS)ConvTranspose1du Applies a 1D transposed convolution operator over an input image composed of several input planes. This module can be seen as the gradient of Conv1d with respect to its input. It is also known as a fractionally-strided convolution or a deconvolution (although it is not an actual deconvolution operation as it does not compute a true inverse of convolution). For more information, see the visualizations `here`_ and the `Deconvolutional Networks`_ paper. This module supports :ref:`TensorFloat32`. * :attr:`stride` controls the stride for the cross-correlation. * :attr:`padding` controls the amount of implicit zero padding on both sides for ``dilation * (kernel_size - 1) - padding`` number of points. See note below for details. * :attr:`output_padding` controls the additional size added to one side of the output shape. See note below for details. * :attr:`dilation` controls the spacing between the kernel points; also known as the à trous algorithm. It is harder to describe, but the link `here`_ has a nice visualization of what :attr:`dilation` does. {groups_note} Note: The :attr:`padding` argument effectively adds ``dilation * (kernel_size - 1) - padding`` amount of zero padding to both sizes of the input. This is set so that when a :class:`~torch.nn.Conv1d` and a :class:`~torch.nn.ConvTranspose1d` are initialized with same parameters, they are inverses of each other in regard to the input and output shapes. However, when ``stride > 1``, :class:`~torch.nn.Conv1d` maps multiple input shapes to the same output shape. :attr:`output_padding` is provided to resolve this ambiguity by effectively increasing the calculated output shape on one side. Note that :attr:`output_padding` is only used to find output shape, but does not actually add zero-padding to output. Note: In some circumstances when using the CUDA backend with CuDNN, this operator may select a nondeterministic algorithm to increase performance. If this is undesirable, you can try to make the operation deterministic (potentially at a performance cost) by setting ``torch.backends.cudnn.deterministic = True``. Please see the notes on :doc:`/notes/randomness` for background. Args: in_channels (int): Number of channels in the input image out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): ``dilation * (kernel_size - 1) - padding`` zero-padding will be added to both sides of the input. Default: 0 output_padding (int or tuple, optional): Additional size added to one side of the output shape. Default: 0 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 aC Shape: - Input: :math:`(N, C_{in}, L_{in})` - Output: :math:`(N, C_{out}, L_{out})` where .. math:: L_{out} = (L_{in} - 1) \times \text{stride} - 2 \times \text{padding} + \text{dilation} \times (\text{kernel\_size} - 1) + \text{output\_padding} + 1 Attributes: weight (Tensor): the learnable weights of the module of shape :math:`(\text{in\_channels}, \frac{\text{out\_channels}}{\text{groups}},` :math:`\text{kernel\_size})`. The values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{out} * \text{kernel\_size}}` bias (Tensor): the learnable bias of the module of shape (out_channels). If :attr:`bias` is ``True``, then the values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{out} * \text{kernel\_size}}` .. _`here`: https://github.com/vdumoulin/conv_arithmetic/blob/master/README.md .. _`Deconvolutional Networks`: https://www.matthewzeiler.com/mattzeiler/deconvolutionalnetworks.pdf rrTr/N) rrr rrrrr!rrr$c  s^| | d} t|}t|}t|}t| } t|}tt|j|||||| d|||| f | dS)N)r*r+T)r r1rkr2)r&rrr rrrrr!rrr*r+r?)rCr%r'r2s   zConvTranspose1d.__init__)r"rdr$c Csb|jdkrtdt|jts"t|j|||j|j|j|j }t j ||j |j |j|j||j|j S)Nr/z:Only `zeros` padding mode is supported for ConvTranspose1d)rr3r4rtupleAssertionErrorrjrr rr\Zconv_transpose1dr#r!r)r&r"rdrr%r%r'r^s zConvTranspose1d.forward) rrrrTrr/NN)N)rOrPrQr6rr_r`rSrrTr5r2rrrr^rUr%r%)rCr'rks; rkc sheZdZdjfeedZdeeeeeeee ee dd fd d Z de e eee d d d ZZS)ConvTranspose2du Applies a 2D transposed convolution operator over an input image composed of several input planes. This module can be seen as the gradient of Conv2d with respect to its input. It is also known as a fractionally-strided convolution or a deconvolution (although it is not an actual deconvolution operation as it does not compute a true inverse of convolution). For more information, see the visualizations `here`_ and the `Deconvolutional Networks`_ paper. This module supports :ref:`TensorFloat32`. * :attr:`stride` controls the stride for the cross-correlation. * :attr:`padding` controls the amount of implicit zero padding on both sides for ``dilation * (kernel_size - 1) - padding`` number of points. See note below for details. * :attr:`output_padding` controls the additional size added to one side of the output shape. See note below for details. * :attr:`dilation` controls the spacing between the kernel points; also known as the à trous algorithm. It is harder to describe, but the link `here`_ has a nice visualization of what :attr:`dilation` does. {groups_note} The parameters :attr:`kernel_size`, :attr:`stride`, :attr:`padding`, :attr:`output_padding` can either be: - a single ``int`` -- in which case the same value is used for the height and width dimensions - a ``tuple`` of two ints -- in which case, the first `int` is used for the height dimension, and the second `int` for the width dimension Note: The :attr:`padding` argument effectively adds ``dilation * (kernel_size - 1) - padding`` amount of zero padding to both sizes of the input. This is set so that when a :class:`~torch.nn.Conv2d` and a :class:`~torch.nn.ConvTranspose2d` are initialized with same parameters, they are inverses of each other in regard to the input and output shapes. However, when ``stride > 1``, :class:`~torch.nn.Conv2d` maps multiple input shapes to the same output shape. :attr:`output_padding` is provided to resolve this ambiguity by effectively increasing the calculated output shape on one side. Note that :attr:`output_padding` is only used to find output shape, but does not actually add zero-padding to output. Note: {cudnn_reproducibility_note} Args: in_channels (int): Number of channels in the input image out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): ``dilation * (kernel_size - 1) - padding`` zero-padding will be added to both sides of each dimension in the input. Default: 0 output_padding (int or tuple, optional): Additional size added to one side of each dimension in the output shape. Default: 0 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 a Shape: - Input: :math:`(N, C_{in}, H_{in}, W_{in})` - Output: :math:`(N, C_{out}, H_{out}, W_{out})` where .. math:: H_{out} = (H_{in} - 1) \times \text{stride}[0] - 2 \times \text{padding}[0] + \text{dilation}[0] \times (\text{kernel\_size}[0] - 1) + \text{output\_padding}[0] + 1 .. math:: W_{out} = (W_{in} - 1) \times \text{stride}[1] - 2 \times \text{padding}[1] + \text{dilation}[1] \times (\text{kernel\_size}[1] - 1) + \text{output\_padding}[1] + 1 Attributes: weight (Tensor): the learnable weights of the module of shape :math:`(\text{in\_channels}, \frac{\text{out\_channels}}{\text{groups}},` :math:`\text{kernel\_size[0]}, \text{kernel\_size[1]})`. The values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{out} * \prod_{i=0}^{1}\text{kernel\_size}[i]}` bias (Tensor): the learnable bias of the module of shape (out_channels) If :attr:`bias` is ``True``, then the values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{out} * \prod_{i=0}^{1}\text{kernel\_size}[i]}` Examples:: >>> # With square kernels and equal stride >>> m = nn.ConvTranspose2d(16, 33, 3, stride=2) >>> # non-square kernels and unequal stride and with padding >>> m = nn.ConvTranspose2d(16, 33, (3, 5), stride=(2, 1), padding=(4, 2)) >>> input = torch.randn(20, 16, 50, 100) >>> output = m(input) >>> # exact output size can be also specified as an argument >>> input = torch.randn(1, 16, 12, 12) >>> downsample = nn.Conv2d(16, 16, 3, stride=2, padding=1) >>> upsample = nn.ConvTranspose2d(16, 16, 3, stride=2, padding=1) >>> h = downsample(input) >>> h.size() torch.Size([1, 16, 6, 6]) >>> output = upsample(h, output_size=input.size()) >>> output.size() torch.Size([1, 16, 12, 12]) .. _`here`: https://github.com/vdumoulin/conv_arithmetic/blob/master/README.md .. _`Deconvolutional Networks`: https://www.matthewzeiler.com/mattzeiler/deconvolutionalnetworks.pdf rrTr/N) rrr rrrrr!rrr$c  s^| | d} t|}t|}t|}t| } t|}tt|j|||||| d|||| f | dS)N)r*r+T)r r1rnr2)r&rrr rrrrr!rrr*r+r?)rCr%r'r2xs   zConvTranspose2d.__init__)r"rdr$c Csb|jdkrtdt|jts"t|j|||j|j|j|j }t j ||j |j |j|j||j|j S)Nr/z:Only `zeros` padding mode is supported for ConvTranspose2d)rr3r4rrlrmrjrr rr\Zconv_transpose2dr#r!r)r&r"rdrr%r%r'r^s zConvTranspose2d.forward) rrrrTrr/NN)N)rOrPrQr6rr_r`rSrrTr5r2rrrr^rUr%r%)rCr'rn s<1 rnc sheZdZdjfeedZdeeeeeeee ee dd fd d Z de e eee d d d ZZS)ConvTranspose3du Applies a 3D transposed convolution operator over an input image composed of several input planes. The transposed convolution operator multiplies each input value element-wise by a learnable kernel, and sums over the outputs from all input feature planes. This module can be seen as the gradient of Conv3d with respect to its input. It is also known as a fractionally-strided convolution or a deconvolution (although it is not an actual deconvolution operation as it does not compute a true inverse of convolution). For more information, see the visualizations `here`_ and the `Deconvolutional Networks`_ paper. This module supports :ref:`TensorFloat32`. * :attr:`stride` controls the stride for the cross-correlation. * :attr:`padding` controls the amount of implicit zero padding on both sides for ``dilation * (kernel_size - 1) - padding`` number of points. See note below for details. * :attr:`output_padding` controls the additional size added to one side of the output shape. See note below for details. * :attr:`dilation` controls the spacing between the kernel points; also known as the à trous algorithm. It is harder to describe, but the link `here`_ has a nice visualization of what :attr:`dilation` does. {groups_note} The parameters :attr:`kernel_size`, :attr:`stride`, :attr:`padding`, :attr:`output_padding` can either be: - a single ``int`` -- in which case the same value is used for the depth, height and width dimensions - a ``tuple`` of three ints -- in which case, the first `int` is used for the depth dimension, the second `int` for the height dimension and the third `int` for the width dimension Note: The :attr:`padding` argument effectively adds ``dilation * (kernel_size - 1) - padding`` amount of zero padding to both sizes of the input. This is set so that when a :class:`~torch.nn.Conv3d` and a :class:`~torch.nn.ConvTranspose3d` are initialized with same parameters, they are inverses of each other in regard to the input and output shapes. However, when ``stride > 1``, :class:`~torch.nn.Conv3d` maps multiple input shapes to the same output shape. :attr:`output_padding` is provided to resolve this ambiguity by effectively increasing the calculated output shape on one side. Note that :attr:`output_padding` is only used to find output shape, but does not actually add zero-padding to output. Note: {cudnn_reproducibility_note} Args: in_channels (int): Number of channels in the input image out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): ``dilation * (kernel_size - 1) - padding`` zero-padding will be added to both sides of each dimension in the input. Default: 0 output_padding (int or tuple, optional): Additional size added to one side of each dimension in the output shape. Default: 0 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 a Shape: - Input: :math:`(N, C_{in}, D_{in}, H_{in}, W_{in})` - Output: :math:`(N, C_{out}, D_{out}, H_{out}, W_{out})` where .. math:: D_{out} = (D_{in} - 1) \times \text{stride}[0] - 2 \times \text{padding}[0] + \text{dilation}[0] \times (\text{kernel\_size}[0] - 1) + \text{output\_padding}[0] + 1 .. math:: H_{out} = (H_{in} - 1) \times \text{stride}[1] - 2 \times \text{padding}[1] + \text{dilation}[1] \times (\text{kernel\_size}[1] - 1) + \text{output\_padding}[1] + 1 .. math:: W_{out} = (W_{in} - 1) \times \text{stride}[2] - 2 \times \text{padding}[2] + \text{dilation}[2] \times (\text{kernel\_size}[2] - 1) + \text{output\_padding}[2] + 1 Attributes: weight (Tensor): the learnable weights of the module of shape :math:`(\text{in\_channels}, \frac{\text{out\_channels}}{\text{groups}},` :math:`\text{kernel\_size[0]}, \text{kernel\_size[1]}, \text{kernel\_size[2]})`. The values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{out} * \prod_{i=0}^{2}\text{kernel\_size}[i]}` bias (Tensor): the learnable bias of the module of shape (out_channels) If :attr:`bias` is ``True``, then the values of these weights are sampled from :math:`\mathcal{U}(-\sqrt{k}, \sqrt{k})` where :math:`k = \frac{groups}{C_\text{out} * \prod_{i=0}^{2}\text{kernel\_size}[i]}` Examples:: >>> # With square kernels and equal stride >>> m = nn.ConvTranspose3d(16, 33, 3, stride=2) >>> # non-square kernels and unequal stride and with padding >>> m = nn.ConvTranspose3d(16, 33, (3, 5, 2), stride=(2, 1, 1), padding=(0, 4, 2)) >>> input = torch.randn(20, 16, 10, 50, 100) >>> output = m(input) .. _`here`: https://github.com/vdumoulin/conv_arithmetic/blob/master/README.md .. _`Deconvolutional Networks`: https://www.matthewzeiler.com/mattzeiler/deconvolutionalnetworks.pdf rrTr/N) rrr rrrrr!rrr$c  s^| | d} t|}t|}t|}t| } t|}tt|j|||||| d|||| f | dS)N)r*r+T)r r1ror2)r&rrr rrrrr!rrr*r+r?)rCr%r'r2 s   zConvTranspose3d.__init__)r"rdr$c Csb|jdkrtdt|jts"t|j|||j|j|j|j }t j ||j |j |j|j||j|j S)Nr/z:Only `zeros` padding mode is supported for ConvTranspose3d)rr3r4rrlrmrjrr rr\Zconv_transpose3dr#r!r)r&r"rdrr%r%r'r^$s zConvTranspose3d.forward) rrrrTrr/NN)N)rOrPrQr6rr_r`rSrrTr5r2rrrr^rUr%r%)rCr'ros>+ rocseZdZfddZZS)_ConvTransposeMixincs tjdtt|j||dS)NzV_ConvTransposeMixin is a deprecated internal class. Please consider using public APIs.)warningswarnr1rpr2)r&argskwargs)rCr%r'r2Csz_ConvTransposeMixin.__init__)rOrPrQr2rUr%r%)rCr'rpBsrpcsVeZdZUeeeee edf e  e  ddfdd ZddddZZS)_LazyConvXdMixin.N)r$cs"|j r|jdkrtjdS)Nr)has_uninitialized_paramsrr1r>)r&)rCr%r'r>Xsz!_LazyConvXdMixin.reset_parameterscCs|jr|jd|_|j|jdkr,tdt|jts)r&r"r%r%r'initialize_parametersas  z&_LazyConvXdMixin.initialize_parameters)rOrPrQrSrrTr)rrrr rr#r!r>rxrUr%r%)rCr'ruOs   ruc s<eZdZdZeZd eeeeeeee dd fdd Z Z S) LazyConv1daA :class:`torch.nn.Conv1d` module with lazy initialization of the ``in_channels`` argument of the :class:`Conv1d` that is inferred from the ``input.size(1)``. The attributes that will be lazily initialized are `weight` and `bias`. Check the :class:`torch.nn.modules.lazy.LazyModuleMixin` for further documentation on lazy modules and their limitations. Args: out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): Zero-padding added to both sides of the input. Default: 0 padding_mode (string, optional): ``'zeros'``, ``'reflect'``, ``'replicate'`` or ``'circular'``. Default: ``'zeros'`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` .. seealso:: :class:`torch.nn.Conv1d` and :class:`torch.nn.modules.lazy.LazyModuleMixin` rrTr/N) rr rrrrr!rr$c sP| | d} tjdd|||||d|f | tf| |_||_|rLtf| |_dS)N)r*r+rF)r1r2rr#rr!) r&rr rrrrr!rr*r+r?)rCr%r'r2s  zLazyConv1d.__init__)rrrrTr/NN) rOrPrQr`rV cls_to_becomerSrrTr5r2rUr%r%)rCr'ryusryc s<eZdZdZeZd eeeeeeee dd fdd Z Z S) LazyConv2daA :class:`torch.nn.Conv2d` module with lazy initialization of the ``in_channels`` argument of the :class:`Conv2d` that is inferred from the ``input.size(1)``. The attributes that will be lazily initialized are `weight` and `bias`. Check the :class:`torch.nn.modules.lazy.LazyModuleMixin` for further documentation on lazy modules and their limitations. Args: out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): Zero-padding added to both sides of the input. Default: 0 padding_mode (string, optional): ``'zeros'``, ``'reflect'``, ``'replicate'`` or ``'circular'``. Default: ``'zeros'`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` .. seealso:: :class:`torch.nn.Conv2d` and :class:`torch.nn.modules.lazy.LazyModuleMixin` rrTr/N) rr rrrrr!rr$c sP| | d} tjdd|||||d|f | tf| |_||_|rLtf| |_dS)N)r*r+rF)r1r2rr#rr!) r&rr rrrrr!rr*r+r?)rCr%r'r2s  zLazyConv2d.__init__)rrrrTr/NN) rOrPrQr`rarzrSrrTr5r2rUr%r%)rCr'r{sr{c s<eZdZdZeZd eeeeeeee dd fdd Z Z S) LazyConv3daA :class:`torch.nn.Conv3d` module with lazy initialization of the ``in_channels`` argument of the :class:`Conv3d` that is inferred from the ``input.size(1)``. The attributes that will be lazily initialized are `weight` and `bias`. Check the :class:`torch.nn.modules.lazy.LazyModuleMixin` for further documentation on lazy modules and their limitations. Args: out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): Zero-padding added to both sides of the input. Default: 0 padding_mode (string, optional): ``'zeros'``, ``'reflect'``, ``'replicate'`` or ``'circular'``. Default: ``'zeros'`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` .. seealso:: :class:`torch.nn.Conv3d` and :class:`torch.nn.modules.lazy.LazyModuleMixin` rrTr/N) rr rrrrr!rr$c sP| | d} tjdd|||||d|f | tf| |_||_|rLtf| |_dS)N)r*r+rF)r1r2rr#rr!) r&rr rrrrr!rr*r+r?)rCr%r'r2s  zLazyConv3d.__init__)rrrrTr/NN) rOrPrQr`rbrzrSrrTr5r2rUr%r%)rCr'r|sr|c s>eZdZdZeZd eeeeeeeee dd fdd Z Z S) LazyConvTranspose1da'A :class:`torch.nn.ConvTranspose1d` module with lazy initialization of the ``in_channels`` argument of the :class:`ConvTranspose1d` that is inferred from the ``input.size(1)``. The attributes that will be lazily initialized are `weight` and `bias`. Check the :class:`torch.nn.modules.lazy.LazyModuleMixin` for further documentation on lazy modules and their limitations. Args: out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): ``dilation * (kernel_size - 1) - padding`` zero-padding will be added to both sides of the input. Default: 0 output_padding (int or tuple, optional): Additional size added to one side of the output shape. Default: 0 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 .. seealso:: :class:`torch.nn.ConvTranspose1d` and :class:`torch.nn.modules.lazy.LazyModuleMixin` rrTr/N) rr rrrrr!rrr$c sR| | d} tjdd|||||d|| f | tf| |_||_|rNtf| |_dS)N)r*r+rF)r1r2rr#rr!) r&rr rrrrr!rrr*r+r?)rCr%r'r2Ws"  zLazyConvTranspose1d.__init__) rrrrTrr/NN) rOrPrQr`rkrzrSrrTr5r2rUr%r%)rCr'r};sr}c s>eZdZdZeZd eeeeeeeee dd fdd Z Z S) LazyConvTranspose2daKA :class:`torch.nn.ConvTranspose2d` module with lazy initialization of the ``in_channels`` argument of the :class:`ConvTranspose2d` that is inferred from the ``input.size(1)``. The attributes that will be lazily initialized are `weight` and `bias`. Check the :class:`torch.nn.modules.lazy.LazyModuleMixin` for further documentation on lazy modules and their limitations. Args: out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): ``dilation * (kernel_size - 1) - padding`` zero-padding will be added to both sides of each dimension in the input. Default: 0 output_padding (int or tuple, optional): Additional size added to one side of each dimension in the output shape. Default: 0 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 .. seealso:: :class:`torch.nn.ConvTranspose2d` and :class:`torch.nn.modules.lazy.LazyModuleMixin` rrTr/N) rr rrrrr!rrr$c sR| | d} tjdd|||||d|| f | tf| |_||_|rNtf| |_dS)N)r*r+rF)r1r2rr#rr!) r&rr rrrrr!rrr*r+r?)rCr%r'r2s"  zLazyConvTranspose2d.__init__) rrrrTrr/NN) rOrPrQr`rnrzrSrrTr5r2rUr%r%)rCr'r~|sr~c s>eZdZdZeZd eeeeeeeee dd fdd Z Z S) LazyConvTranspose3daKA :class:`torch.nn.ConvTranspose3d` module with lazy initialization of the ``in_channels`` argument of the :class:`ConvTranspose3d` that is inferred from the ``input.size(1)``. The attributes that will be lazily initialized are `weight` and `bias`. Check the :class:`torch.nn.modules.lazy.LazyModuleMixin` for further documentation on lazy modules and their limitations. Args: out_channels (int): Number of channels produced by the convolution kernel_size (int or tuple): Size of the convolving kernel stride (int or tuple, optional): Stride of the convolution. Default: 1 padding (int or tuple, optional): ``dilation * (kernel_size - 1) - padding`` zero-padding will be added to both sides of each dimension in the input. Default: 0 output_padding (int or tuple, optional): Additional size added to one side of each dimension in the output shape. Default: 0 groups (int, optional): Number of blocked connections from input channels to output channels. Default: 1 bias (bool, optional): If ``True``, adds a learnable bias to the output. Default: ``True`` dilation (int or tuple, optional): Spacing between kernel elements. Default: 1 .. seealso:: :class:`torch.nn.ConvTranspose3d` and :class:`torch.nn.modules.lazy.LazyModuleMixin` rrTr/N) rr rrrrr!rrr$c sR| | d} tjdd|||||d|| f | tf| |_||_|rNtf| |_dS)N)r*r+rF)r1r2rr#rr!) r&rr rrrrr!rrr*r+r?)rCr%r'r2s"  zLazyConvTranspose3d.__init__) rrrrTrr/NN) rOrPrQr`rorzrSrrTr5r2rUr%r%)rCr'rsr)0rFrqr<rZtorch.nn.parameterrrrr\rZlazyr moduler utilsr r r rZtorch._torch_docsr common_typesrrrtypingrrrrr_rrVrarbrcrkrnrorpruryr{r|r}r~rr%r%r%r'sH      8# &BBBAA