Shape Inference

Shape Inference

Shape inference is the process by which you infer the shape of the intermediate layers given the input dimensions, the model connectivity, and the layer types. All is based on simple arithmetic manipulation of the input dimensions along with the layer parameters. For example, for the Convolution layer the following formula defines how to compute the output shape given the input shape and the layer paraamters:

  • Input: (N,Cin,Hin,Win)
  • Filter: (Cout,Cin,Hf,Wf)
  • Output: (N,Cout,Hout,Wout)

where

Hout=(Hin+2∗paddings[0]−(dilations[0]∗(Hf−1)+1))strides[0]+1Wout=(Win+2∗paddings[1]−(dilations[1]∗(Wf−1)+1))strides[1]+1 \begin{aligned}H_{out}&= \frac{(H_{in} + 2 * paddings[0] - (dilations[0] * (H_f - 1) + 1))}{strides[0]} + 1 \\W_{out}&= \frac{(W_{in} + 2 * paddings[1] - (dilations[1] * (W_f - 1) + 1))}{strides[1]} + 1\end{aligned}

The input models to Benanza do not have shape information, and Benanza traverses the graph, performs the shape inference, and augments the shape with the inferred shape information.

Create Graph

An easy way to view the model is by visualizing as a graph. A graph can be created of the model after shape inference using

benanza dot --model_path //ResNet50-v1 --format dot -o /tmp/resnet.dot --batch_size=256

This will create a plot of the Resnet50-v1 model using batch size 256. The output is a PDF (if the dot tool is available) and will generate a figure like (Note you may need to scroll down to view the graph)



%0



data

data



resnetv17_conv0_fwd

resnetv17_conv0_fwd

CONV

[256,64,112,112]



data->resnetv17_conv0_fwd





resnetv17_conv0_weight

resnetv17_conv0_weight



resnetv17_conv0_weight->resnetv17_conv0_fwd





resnetv17_batchnorm0_fwd

resnetv17_batchnorm0_fwd

BN

[[256,64,112,112],[64],[64],[64],[64]]



resnetv17_conv0_fwd->resnetv17_batchnorm0_fwd





resnetv17_batchnorm0_gamma

resnetv17_batchnorm0_gamma



resnetv17_batchnorm0_gamma->resnetv17_batchnorm0_fwd





resnetv17_batchnorm0_beta

resnetv17_batchnorm0_beta



resnetv17_batchnorm0_beta->resnetv17_batchnorm0_fwd





resnetv17_batchnorm0_running_mean

resnetv17_batchnorm0_running_mean



resnetv17_batchnorm0_running_mean->resnetv17_batchnorm0_fwd





resnetv17_batchnorm0_running_var

resnetv17_batchnorm0_running_var



resnetv17_batchnorm0_running_var->resnetv17_batchnorm0_fwd





resnetv17_relu0_fwd

resnetv17_relu0_fwd

RELU

[256,64,112,112]



resnetv17_batchnorm0_fwd->resnetv17_relu0_fwd





resnetv17_pool0_fwd

resnetv17_pool0_fwd

MXPL

[256,64,56,56]



resnetv17_relu0_fwd->resnetv17_pool0_fwd





resnetv17_stage1_conv0_fwd

resnetv17_stage1_conv0_fwd

CONV

[256,64,56,56]



resnetv17_pool0_fwd->resnetv17_stage1_conv0_fwd





resnetv17_stage1_conv3_fwd

resnetv17_stage1_conv3_fwd

CONV

[256,256,56,56]



resnetv17_pool0_fwd->resnetv17_stage1_conv3_fwd





resnetv17_stage1_conv0_weight

resnetv17_stage1_conv0_weight



resnetv17_stage1_conv0_weight->resnetv17_stage1_conv0_fwd





resnetv17_stage1_conv0_bias

resnetv17_stage1_conv0_bias



resnetv17_stage1_conv0_bias->resnetv17_stage1_conv0_fwd





resnetv17_stage1_batchnorm0_fwd

resnetv17_stage1_batchnorm0_fwd

BN

[[256,64,56,56],[64],[64],[64],[64]]



resnetv17_stage1_conv0_fwd->resnetv17_stage1_batchnorm0_fwd





resnetv17_stage1_batchnorm0_gamma

resnetv17_stage1_batchnorm0_gamma



resnetv17_stage1_batchnorm0_gamma->resnetv17_stage1_batchnorm0_fwd





resnetv17_stage1_batchnorm0_beta

resnetv17_stage1_batchnorm0_beta



resnetv17_stage1_batchnorm0_beta->resnetv17_stage1_batchnorm0_fwd





resnetv17_stage1_batchnorm0_running_mean

resnetv17_stage1_batchnorm0_running_mean



resnetv17_stage1_batchnorm0_running_mean->resnetv17_stage1_batchnorm0_fwd





resnetv17_stage1_batchnorm0_running_var

resnetv17_stage1_batchnorm0_running_var



resnetv17_stage1_batchnorm0_running_var->resnetv17_stage1_batchnorm0_fwd





resnetv17_stage1_relu0_fwd

resnetv17_stage1_relu0_fwd

RELU

[256,64,56,56]



resnetv17_stage1_batchnorm0_fwd->resnetv17_stage1_relu0_fwd





resnetv17_stage1_conv1_fwd

resnetv17_stage1_conv1_fwd

CONV

[256,64,56,56]



resnetv17_stage1_relu0_fwd->resnetv17_stage1_conv1_fwd





resnetv17_stage1_conv1_weight

resnetv17_stage1_conv1_weight



resnetv17_stage1_conv1_weight->resnetv17_stage1_conv1_fwd





resnetv17_stage1_batchnorm1_fwd

resnetv17_stage1_batchnorm1_fwd

BN

[[256,64,56,56],[64],[64],[64],[64]]



resnetv17_stage1_conv1_fwd->resnetv17_stage1_batchnorm1_fwd





resnetv17_stage1_batchnorm1_gamma

resnetv17_stage1_batchnorm1_gamma



resnetv17_stage1_batchnorm1_gamma->resnetv17_stage1_batchnorm1_fwd





resnetv17_stage1_batchnorm1_beta

resnetv17_stage1_batchnorm1_beta



resnetv17_stage1_batchnorm1_beta->resnetv17_stage1_batchnorm1_fwd





resnetv17_stage1_batchnorm1_running_mean

resnetv17_stage1_batchnorm1_running_mean



resnetv17_stage1_batchnorm1_running_mean->resnetv17_stage1_batchnorm1_fwd





resnetv17_stage1_batchnorm1_running_var

resnetv17_stage1_batchnorm1_running_var



resnetv17_stage1_batchnorm1_running_var->resnetv17_stage1_batchnorm1_fwd





resnetv17_stage1_relu1_fwd

resnetv17_stage1_relu1_fwd

RELU

[256,64,56,56]



resnetv17_stage1_batchnorm1_fwd->resnetv17_stage1_relu1_fwd





resnetv17_stage1_conv2_fwd

resnetv17_stage1_conv2_fwd

CONV

[256,256,56,56]



resnetv17_stage1_relu1_fwd->resnetv17_stage1_conv2_fwd





resnetv17_stage1_conv2_weight

resnetv17_stage1_conv2_weight



resnetv17_stage1_conv2_weight->resnetv17_stage1_conv2_fwd





resnetv17_stage1_conv2_bias

resnetv17_stage1_conv2_bias



resnetv17_stage1_conv2_bias->resnetv17_stage1_conv2_fwd





resnetv17_stage1_batchnorm2_fwd

resnetv17_stage1_batchnorm2_fwd

BN

[[256,256,56,56],[256],[256],[256],[256]]



resnetv17_stage1_conv2_fwd->resnetv17_stage1_batchnorm2_fwd





resnetv17_stage1_batchnorm2_gamma

resnetv17_stage1_batchnorm2_gamma



resnetv17_stage1_batchnorm2_gamma->resnetv17_stage1_batchnorm2_fwd





resnetv17_stage1_batchnorm2_beta

resnetv17_stage1_batchnorm2_beta



resnetv17_stage1_batchnorm2_beta->resnetv17_stage1_batchnorm2_fwd





resnetv17_stage1_batchnorm2_running_mean

resnetv17_stage1_batchnorm2_running_mean



resnetv17_stage1_batchnorm2_running_mean->resnetv17_stage1_batchnorm2_fwd





resnetv17_stage1_batchnorm2_running_var

resnetv17_stage1_batchnorm2_running_var



resnetv17_stage1_batchnorm2_running_var->resnetv17_stage1_batchnorm2_fwd





resnetv17_stage1__plus0

resnetv17_stage1__plus0

ADD

[256,256,56,56]



resnetv17_stage1_batchnorm2_fwd->resnetv17_stage1__plus0





resnetv17_stage1_conv3_weight

resnetv17_stage1_conv3_weight



resnetv17_stage1_conv3_weight->resnetv17_stage1_conv3_fwd





resnetv17_stage1_batchnorm3_fwd

resnetv17_stage1_batchnorm3_fwd

BN

[[256,256,56,56],[256],[256],[256],[256]]



resnetv17_stage1_conv3_fwd->resnetv17_stage1_batchnorm3_fwd





resnetv17_stage1_batchnorm3_gamma

resnetv17_stage1_batchnorm3_gamma



resnetv17_stage1_batchnorm3_gamma->resnetv17_stage1_batchnorm3_fwd





resnetv17_stage1_batchnorm3_beta

resnetv17_stage1_batchnorm3_beta



resnetv17_stage1_batchnorm3_beta->resnetv17_stage1_batchnorm3_fwd





resnetv17_stage1_batchnorm3_running_mean

resnetv17_stage1_batchnorm3_running_mean



resnetv17_stage1_batchnorm3_running_mean->resnetv17_stage1_batchnorm3_fwd





resnetv17_stage1_batchnorm3_running_var

resnetv17_stage1_batchnorm3_running_var



resnetv17_stage1_batchnorm3_running_var->resnetv17_stage1_batchnorm3_fwd





resnetv17_stage1_batchnorm3_fwd->resnetv17_stage1__plus0





resnetv17_stage1_activation0

resnetv17_stage1_activation0

RELU

[256,256,56,56]



resnetv17_stage1__plus0->resnetv17_stage1_activation0





resnetv17_stage1_conv4_fwd

resnetv17_stage1_conv4_fwd

CONV

[256,64,56,56]



resnetv17_stage1_activation0->resnetv17_stage1_conv4_fwd





resnetv17_stage1__plus1

resnetv17_stage1__plus1

ADD

[256,256,56,56]



resnetv17_stage1_activation0->resnetv17_stage1__plus1





resnetv17_stage1_conv4_weight

resnetv17_stage1_conv4_weight



resnetv17_stage1_conv4_weight->resnetv17_stage1_conv4_fwd





resnetv17_stage1_conv4_bias

resnetv17_stage1_conv4_bias



resnetv17_stage1_conv4_bias->resnetv17_stage1_conv4_fwd





resnetv17_stage1_batchnorm4_fwd

resnetv17_stage1_batchnorm4_fwd

BN

[[256,64,56,56],[64],[64],[64],[64]]



resnetv17_stage1_conv4_fwd->resnetv17_stage1_batchnorm4_fwd





resnetv17_stage1_batchnorm4_gamma

resnetv17_stage1_batchnorm4_gamma



resnetv17_stage1_batchnorm4_gamma->resnetv17_stage1_batchnorm4_fwd





resnetv17_stage1_batchnorm4_beta

resnetv17_stage1_batchnorm4_beta



resnetv17_stage1_batchnorm4_beta->resnetv17_stage1_batchnorm4_fwd





resnetv17_stage1_batchnorm4_running_mean

resnetv17_stage1_batchnorm4_running_mean



resnetv17_stage1_batchnorm4_running_mean->resnetv17_stage1_batchnorm4_fwd





resnetv17_stage1_batchnorm4_running_var

resnetv17_stage1_batchnorm4_running_var



resnetv17_stage1_batchnorm4_running_var->resnetv17_stage1_batchnorm4_fwd





resnetv17_stage1_relu2_fwd

resnetv17_stage1_relu2_fwd

RELU

[256,64,56,56]



resnetv17_stage1_batchnorm4_fwd->resnetv17_stage1_relu2_fwd





resnetv17_stage1_conv5_fwd

resnetv17_stage1_conv5_fwd

CONV

[256,64,56,56]



resnetv17_stage1_relu2_fwd->resnetv17_stage1_conv5_fwd





resnetv17_stage1_conv5_weight

resnetv17_stage1_conv5_weight



resnetv17_stage1_conv5_weight->resnetv17_stage1_conv5_fwd





resnetv17_stage1_batchnorm5_fwd

resnetv17_stage1_batchnorm5_fwd

BN

[[256,64,56,56],[64],[64],[64],[64]]



resnetv17_stage1_conv5_fwd->resnetv17_stage1_batchnorm5_fwd





resnetv17_stage1_batchnorm5_gamma

resnetv17_stage1_batchnorm5_gamma



resnetv17_stage1_batchnorm5_gamma->resnetv17_stage1_batchnorm5_fwd





resnetv17_stage1_batchnorm5_beta

resnetv17_stage1_batchnorm5_beta



resnetv17_stage1_batchnorm5_beta->resnetv17_stage1_batchnorm5_fwd





resnetv17_stage1_batchnorm5_running_mean

resnetv17_stage1_batchnorm5_running_mean



resnetv17_stage1_batchnorm5_running_mean->resnetv17_stage1_batchnorm5_fwd





resnetv17_stage1_batchnorm5_running_var

resnetv17_stage1_batchnorm5_running_var



resnetv17_stage1_batchnorm5_running_var->resnetv17_stage1_batchnorm5_fwd





resnetv17_stage1_relu3_fwd

resnetv17_stage1_relu3_fwd

RELU

[256,64,56,56]



resnetv17_stage1_batchnorm5_fwd->resnetv17_stage1_relu3_fwd





resnetv17_stage1_conv6_fwd

resnetv17_stage1_conv6_fwd

CONV

[256,256,56,56]



resnetv17_stage1_relu3_fwd->resnetv17_stage1_conv6_fwd





resnetv17_stage1_conv6_weight

resnetv17_stage1_conv6_weight



resnetv17_stage1_conv6_weight->resnetv17_stage1_conv6_fwd





resnetv17_stage1_conv6_bias

resnetv17_stage1_conv6_bias



resnetv17_stage1_conv6_bias->resnetv17_stage1_conv6_fwd





resnetv17_stage1_batchnorm6_fwd

resnetv17_stage1_batchnorm6_fwd

BN

[[256,256,56,56],[256],[256],[256],[256]]



resnetv17_stage1_conv6_fwd->resnetv17_stage1_batchnorm6_fwd





resnetv17_stage1_batchnorm6_gamma

resnetv17_stage1_batchnorm6_gamma



resnetv17_stage1_batchnorm6_gamma->resnetv17_stage1_batchnorm6_fwd





resnetv17_stage1_batchnorm6_beta

resnetv17_stage1_batchnorm6_beta



resnetv17_stage1_batchnorm6_beta->resnetv17_stage1_batchnorm6_fwd





resnetv17_stage1_batchnorm6_running_mean

resnetv17_stage1_batchnorm6_running_mean



resnetv17_stage1_batchnorm6_running_mean->resnetv17_stage1_batchnorm6_fwd





resnetv17_stage1_batchnorm6_running_var

resnetv17_stage1_batchnorm6_running_var



resnetv17_stage1_batchnorm6_running_var->resnetv17_stage1_batchnorm6_fwd





resnetv17_stage1_batchnorm6_fwd->resnetv17_stage1__plus1





resnetv17_stage1_activation1

resnetv17_stage1_activation1

RELU

[256,256,56,56]



resnetv17_stage1__plus1->resnetv17_stage1_activation1





resnetv17_stage1_conv7_fwd

resnetv17_stage1_conv7_fwd

CONV

[256,64,56,56]



resnetv17_stage1_activation1->resnetv17_stage1_conv7_fwd





resnetv17_stage1__plus2

resnetv17_stage1__plus2

ADD

[256,256,56,56]



resnetv17_stage1_activation1->resnetv17_stage1__plus2





resnetv17_stage1_conv7_weight

resnetv17_stage1_conv7_weight



resnetv17_stage1_conv7_weight->resnetv17_stage1_conv7_fwd





resnetv17_stage1_conv7_bias

resnetv17_stage1_conv7_bias



resnetv17_stage1_conv7_bias->resnetv17_stage1_conv7_fwd





resnetv17_stage1_batchnorm7_fwd

resnetv17_stage1_batchnorm7_fwd

BN

[[256,64,56,56],[64],[64],[64],[64]]



resnetv17_stage1_conv7_fwd->resnetv17_stage1_batchnorm7_fwd





resnetv17_stage1_batchnorm7_gamma

resnetv17_stage1_batchnorm7_gamma



resnetv17_stage1_batchnorm7_gamma->resnetv17_stage1_batchnorm7_fwd





resnetv17_stage1_batchnorm7_beta

resnetv17_stage1_batchnorm7_beta



resnetv17_stage1_batchnorm7_beta->resnetv17_stage1_batchnorm7_fwd





resnetv17_stage1_batchnorm7_running_mean

resnetv17_stage1_batchnorm7_running_mean



resnetv17_stage1_batchnorm7_running_mean->resnetv17_stage1_batchnorm7_fwd





resnetv17_stage1_batchnorm7_running_var

resnetv17_stage1_batchnorm7_running_var



resnetv17_stage1_batchnorm7_running_var->resnetv17_stage1_batchnorm7_fwd





resnetv17_stage1_relu4_fwd

resnetv17_stage1_relu4_fwd

RELU

[256,64,56,56]



resnetv17_stage1_batchnorm7_fwd->resnetv17_stage1_relu4_fwd





resnetv17_stage1_conv8_fwd

resnetv17_stage1_conv8_fwd

CONV

[256,64,56,56]



resnetv17_stage1_relu4_fwd->resnetv17_stage1_conv8_fwd





resnetv17_stage1_conv8_weight

resnetv17_stage1_conv8_weight



resnetv17_stage1_conv8_weight->resnetv17_stage1_conv8_fwd





resnetv17_stage1_batchnorm8_fwd

resnetv17_stage1_batchnorm8_fwd

BN

[[256,64,56,56],[64],[64],[64],[64]]



resnetv17_stage1_conv8_fwd->resnetv17_stage1_batchnorm8_fwd





resnetv17_stage1_batchnorm8_gamma

resnetv17_stage1_batchnorm8_gamma



resnetv17_stage1_batchnorm8_gamma->resnetv17_stage1_batchnorm8_fwd





resnetv17_stage1_batchnorm8_beta

resnetv17_stage1_batchnorm8_beta



resnetv17_stage1_batchnorm8_beta->resnetv17_stage1_batchnorm8_fwd





resnetv17_stage1_batchnorm8_running_mean

resnetv17_stage1_batchnorm8_running_mean



resnetv17_stage1_batchnorm8_running_mean->resnetv17_stage1_batchnorm8_fwd





resnetv17_stage1_batchnorm8_running_var

resnetv17_stage1_batchnorm8_running_var



resnetv17_stage1_batchnorm8_running_var->resnetv17_stage1_batchnorm8_fwd





resnetv17_stage1_relu5_fwd

resnetv17_stage1_relu5_fwd

RELU

[256,64,56,56]



resnetv17_stage1_batchnorm8_fwd->resnetv17_stage1_relu5_fwd





resnetv17_stage1_conv9_fwd

resnetv17_stage1_conv9_fwd

CONV

[256,256,56,56]



resnetv17_stage1_relu5_fwd->resnetv17_stage1_conv9_fwd





resnetv17_stage1_conv9_weight

resnetv17_stage1_conv9_weight



resnetv17_stage1_conv9_weight->resnetv17_stage1_conv9_fwd





resnetv17_stage1_conv9_bias

resnetv17_stage1_conv9_bias



resnetv17_stage1_conv9_bias->resnetv17_stage1_conv9_fwd





resnetv17_stage1_batchnorm9_fwd

resnetv17_stage1_batchnorm9_fwd

BN

[[256,256,56,56],[256],[256],[256],[256]]



resnetv17_stage1_conv9_fwd->resnetv17_stage1_batchnorm9_fwd





resnetv17_stage1_batchnorm9_gamma

resnetv17_stage1_batchnorm9_gamma



resnetv17_stage1_batchnorm9_gamma->resnetv17_stage1_batchnorm9_fwd





resnetv17_stage1_batchnorm9_beta

resnetv17_stage1_batchnorm9_beta



resnetv17_stage1_batchnorm9_beta->resnetv17_stage1_batchnorm9_fwd





resnetv17_stage1_batchnorm9_running_mean

resnetv17_stage1_batchnorm9_running_mean



resnetv17_stage1_batchnorm9_running_mean->resnetv17_stage1_batchnorm9_fwd





resnetv17_stage1_batchnorm9_running_var

resnetv17_stage1_batchnorm9_running_var



resnetv17_stage1_batchnorm9_running_var->resnetv17_stage1_batchnorm9_fwd





resnetv17_stage1_batchnorm9_fwd->resnetv17_stage1__plus2





resnetv17_stage1_activation2

resnetv17_stage1_activation2

RELU

[256,256,56,56]



resnetv17_stage1__plus2->resnetv17_stage1_activation2





resnetv17_stage2_conv0_fwd

resnetv17_stage2_conv0_fwd

CONV

[256,128,28,28]



resnetv17_stage1_activation2->resnetv17_stage2_conv0_fwd





resnetv17_stage2_conv3_fwd

resnetv17_stage2_conv3_fwd

CONV

[256,512,28,28]



resnetv17_stage1_activation2->resnetv17_stage2_conv3_fwd





resnetv17_stage2_conv0_weight

resnetv17_stage2_conv0_weight



resnetv17_stage2_conv0_weight->resnetv17_stage2_conv0_fwd





resnetv17_stage2_conv0_bias

resnetv17_stage2_conv0_bias



resnetv17_stage2_conv0_bias->resnetv17_stage2_conv0_fwd





resnetv17_stage2_batchnorm0_fwd

resnetv17_stage2_batchnorm0_fwd

BN

[[256,128,28,28],[128],[128],[128],[128]]



resnetv17_stage2_conv0_fwd->resnetv17_stage2_batchnorm0_fwd





resnetv17_stage2_batchnorm0_gamma

resnetv17_stage2_batchnorm0_gamma



resnetv17_stage2_batchnorm0_gamma->resnetv17_stage2_batchnorm0_fwd





resnetv17_stage2_batchnorm0_beta

resnetv17_stage2_batchnorm0_beta



resnetv17_stage2_batchnorm0_beta->resnetv17_stage2_batchnorm0_fwd





resnetv17_stage2_batchnorm0_running_mean

resnetv17_stage2_batchnorm0_running_mean



resnetv17_stage2_batchnorm0_running_mean->resnetv17_stage2_batchnorm0_fwd





resnetv17_stage2_batchnorm0_running_var

resnetv17_stage2_batchnorm0_running_var



resnetv17_stage2_batchnorm0_running_var->resnetv17_stage2_batchnorm0_fwd





resnetv17_stage2_relu0_fwd

resnetv17_stage2_relu0_fwd

RELU

[256,128,28,28]



resnetv17_stage2_batchnorm0_fwd->resnetv17_stage2_relu0_fwd





resnetv17_stage2_conv1_fwd

resnetv17_stage2_conv1_fwd

CONV

[256,128,28,28]



resnetv17_stage2_relu0_fwd->resnetv17_stage2_conv1_fwd





resnetv17_stage2_conv1_weight

resnetv17_stage2_conv1_weight



resnetv17_stage2_conv1_weight->resnetv17_stage2_conv1_fwd





resnetv17_stage2_batchnorm1_fwd

resnetv17_stage2_batchnorm1_fwd

BN

[[256,128,28,28],[128],[128],[128],[128]]



resnetv17_stage2_conv1_fwd->resnetv17_stage2_batchnorm1_fwd





resnetv17_stage2_batchnorm1_gamma

resnetv17_stage2_batchnorm1_gamma



resnetv17_stage2_batchnorm1_gamma->resnetv17_stage2_batchnorm1_fwd





resnetv17_stage2_batchnorm1_beta

resnetv17_stage2_batchnorm1_beta



resnetv17_stage2_batchnorm1_beta->resnetv17_stage2_batchnorm1_fwd





resnetv17_stage2_batchnorm1_running_mean

resnetv17_stage2_batchnorm1_running_mean



resnetv17_stage2_batchnorm1_running_mean->resnetv17_stage2_batchnorm1_fwd





resnetv17_stage2_batchnorm1_running_var

resnetv17_stage2_batchnorm1_running_var



resnetv17_stage2_batchnorm1_running_var->resnetv17_stage2_batchnorm1_fwd





resnetv17_stage2_relu1_fwd

resnetv17_stage2_relu1_fwd

RELU

[256,128,28,28]



resnetv17_stage2_batchnorm1_fwd->resnetv17_stage2_relu1_fwd





resnetv17_stage2_conv2_fwd

resnetv17_stage2_conv2_fwd

CONV

[256,512,28,28]



resnetv17_stage2_relu1_fwd->resnetv17_stage2_conv2_fwd





resnetv17_stage2_conv2_weight

resnetv17_stage2_conv2_weight



resnetv17_stage2_conv2_weight->resnetv17_stage2_conv2_fwd





resnetv17_stage2_conv2_bias

resnetv17_stage2_conv2_bias



resnetv17_stage2_conv2_bias->resnetv17_stage2_conv2_fwd





resnetv17_stage2_batchnorm2_fwd

resnetv17_stage2_batchnorm2_fwd

BN

[[256,512,28,28],[512],[512],[512],[512]]



resnetv17_stage2_conv2_fwd->resnetv17_stage2_batchnorm2_fwd





resnetv17_stage2_batchnorm2_gamma

resnetv17_stage2_batchnorm2_gamma



resnetv17_stage2_batchnorm2_gamma->resnetv17_stage2_batchnorm2_fwd





resnetv17_stage2_batchnorm2_beta

resnetv17_stage2_batchnorm2_beta



resnetv17_stage2_batchnorm2_beta->resnetv17_stage2_batchnorm2_fwd





resnetv17_stage2_batchnorm2_running_mean

resnetv17_stage2_batchnorm2_running_mean



resnetv17_stage2_batchnorm2_running_mean->resnetv17_stage2_batchnorm2_fwd





resnetv17_stage2_batchnorm2_running_var

resnetv17_stage2_batchnorm2_running_var



resnetv17_stage2_batchnorm2_running_var->resnetv17_stage2_batchnorm2_fwd





resnetv17_stage2__plus0

resnetv17_stage2__plus0

ADD

[256,512,28,28]



resnetv17_stage2_batchnorm2_fwd->resnetv17_stage2__plus0





resnetv17_stage2_conv3_weight

resnetv17_stage2_conv3_weight



resnetv17_stage2_conv3_weight->resnetv17_stage2_conv3_fwd





resnetv17_stage2_batchnorm3_fwd

resnetv17_stage2_batchnorm3_fwd

BN

[[256,512,28,28],[512],[512],[512],[512]]



resnetv17_stage2_conv3_fwd->resnetv17_stage2_batchnorm3_fwd





resnetv17_stage2_batchnorm3_gamma

resnetv17_stage2_batchnorm3_gamma



resnetv17_stage2_batchnorm3_gamma->resnetv17_stage2_batchnorm3_fwd





resnetv17_stage2_batchnorm3_beta

resnetv17_stage2_batchnorm3_beta



resnetv17_stage2_batchnorm3_beta->resnetv17_stage2_batchnorm3_fwd





resnetv17_stage2_batchnorm3_running_mean

resnetv17_stage2_batchnorm3_running_mean



resnetv17_stage2_batchnorm3_running_mean->resnetv17_stage2_batchnorm3_fwd





resnetv17_stage2_batchnorm3_running_var

resnetv17_stage2_batchnorm3_running_var



resnetv17_stage2_batchnorm3_running_var->resnetv17_stage2_batchnorm3_fwd





resnetv17_stage2_batchnorm3_fwd->resnetv17_stage2__plus0





resnetv17_stage2_activation0

resnetv17_stage2_activation0

RELU

[256,512,28,28]



resnetv17_stage2__plus0->resnetv17_stage2_activation0





resnetv17_stage2_conv4_fwd

resnetv17_stage2_conv4_fwd

CONV

[256,128,28,28]



resnetv17_stage2_activation0->resnetv17_stage2_conv4_fwd





resnetv17_stage2__plus1

resnetv17_stage2__plus1

ADD

[256,512,28,28]



resnetv17_stage2_activation0->resnetv17_stage2__plus1





resnetv17_stage2_conv4_weight

resnetv17_stage2_conv4_weight



resnetv17_stage2_conv4_weight->resnetv17_stage2_conv4_fwd





resnetv17_stage2_conv4_bias

resnetv17_stage2_conv4_bias



resnetv17_stage2_conv4_bias->resnetv17_stage2_conv4_fwd





resnetv17_stage2_batchnorm4_fwd

resnetv17_stage2_batchnorm4_fwd

BN

[[256,128,28,28],[128],[128],[128],[128]]



resnetv17_stage2_conv4_fwd->resnetv17_stage2_batchnorm4_fwd





resnetv17_stage2_batchnorm4_gamma

resnetv17_stage2_batchnorm4_gamma



resnetv17_stage2_batchnorm4_gamma->resnetv17_stage2_batchnorm4_fwd





resnetv17_stage2_batchnorm4_beta

resnetv17_stage2_batchnorm4_beta



resnetv17_stage2_batchnorm4_beta->resnetv17_stage2_batchnorm4_fwd





resnetv17_stage2_batchnorm4_running_mean

resnetv17_stage2_batchnorm4_running_mean



resnetv17_stage2_batchnorm4_running_mean->resnetv17_stage2_batchnorm4_fwd





resnetv17_stage2_batchnorm4_running_var

resnetv17_stage2_batchnorm4_running_var



resnetv17_stage2_batchnorm4_running_var->resnetv17_stage2_batchnorm4_fwd





resnetv17_stage2_relu2_fwd

resnetv17_stage2_relu2_fwd

RELU

[256,128,28,28]



resnetv17_stage2_batchnorm4_fwd->resnetv17_stage2_relu2_fwd





resnetv17_stage2_conv5_fwd

resnetv17_stage2_conv5_fwd

CONV

[256,128,28,28]



resnetv17_stage2_relu2_fwd->resnetv17_stage2_conv5_fwd





resnetv17_stage2_conv5_weight

resnetv17_stage2_conv5_weight



resnetv17_stage2_conv5_weight->resnetv17_stage2_conv5_fwd





resnetv17_stage2_batchnorm5_fwd

resnetv17_stage2_batchnorm5_fwd

BN

[[256,128,28,28],[128],[128],[128],[128]]



resnetv17_stage2_conv5_fwd->resnetv17_stage2_batchnorm5_fwd





resnetv17_stage2_batchnorm5_gamma

resnetv17_stage2_batchnorm5_gamma



resnetv17_stage2_batchnorm5_gamma->resnetv17_stage2_batchnorm5_fwd





resnetv17_stage2_batchnorm5_beta

resnetv17_stage2_batchnorm5_beta



resnetv17_stage2_batchnorm5_beta->resnetv17_stage2_batchnorm5_fwd





resnetv17_stage2_batchnorm5_running_mean

resnetv17_stage2_batchnorm5_running_mean



resnetv17_stage2_batchnorm5_running_mean->resnetv17_stage2_batchnorm5_fwd





resnetv17_stage2_batchnorm5_running_var

resnetv17_stage2_batchnorm5_running_var



resnetv17_stage2_batchnorm5_running_var->resnetv17_stage2_batchnorm5_fwd





resnetv17_stage2_relu3_fwd

resnetv17_stage2_relu3_fwd

RELU

[256,128,28,28]



resnetv17_stage2_batchnorm5_fwd->resnetv17_stage2_relu3_fwd





resnetv17_stage2_conv6_fwd

resnetv17_stage2_conv6_fwd

CONV

[256,512,28,28]



resnetv17_stage2_relu3_fwd->resnetv17_stage2_conv6_fwd





resnetv17_stage2_conv6_weight

resnetv17_stage2_conv6_weight



resnetv17_stage2_conv6_weight->resnetv17_stage2_conv6_fwd





resnetv17_stage2_conv6_bias

resnetv17_stage2_conv6_bias



resnetv17_stage2_conv6_bias->resnetv17_stage2_conv6_fwd





resnetv17_stage2_batchnorm6_fwd

resnetv17_stage2_batchnorm6_fwd

BN

[[256,512,28,28],[512],[512],[512],[512]]



resnetv17_stage2_conv6_fwd->resnetv17_stage2_batchnorm6_fwd





resnetv17_stage2_batchnorm6_gamma

resnetv17_stage2_batchnorm6_gamma



resnetv17_stage2_batchnorm6_gamma->resnetv17_stage2_batchnorm6_fwd





resnetv17_stage2_batchnorm6_beta

resnetv17_stage2_batchnorm6_beta



resnetv17_stage2_batchnorm6_beta->resnetv17_stage2_batchnorm6_fwd





resnetv17_stage2_batchnorm6_running_mean

resnetv17_stage2_batchnorm6_running_mean



resnetv17_stage2_batchnorm6_running_mean->resnetv17_stage2_batchnorm6_fwd





resnetv17_stage2_batchnorm6_running_var

resnetv17_stage2_batchnorm6_running_var



resnetv17_stage2_batchnorm6_running_var->resnetv17_stage2_batchnorm6_fwd





resnetv17_stage2_batchnorm6_fwd->resnetv17_stage2__plus1





resnetv17_stage2_activation1

resnetv17_stage2_activation1

RELU

[256,512,28,28]



resnetv17_stage2__plus1->resnetv17_stage2_activation1





resnetv17_stage2_conv7_fwd

resnetv17_stage2_conv7_fwd

CONV

[256,128,28,28]



resnetv17_stage2_activation1->resnetv17_stage2_conv7_fwd





resnetv17_stage2__plus2

resnetv17_stage2__plus2

ADD

[256,512,28,28]



resnetv17_stage2_activation1->resnetv17_stage2__plus2





resnetv17_stage2_conv7_weight

resnetv17_stage2_conv7_weight



resnetv17_stage2_conv7_weight->resnetv17_stage2_conv7_fwd





resnetv17_stage2_conv7_bias

resnetv17_stage2_conv7_bias



resnetv17_stage2_conv7_bias->resnetv17_stage2_conv7_fwd





resnetv17_stage2_batchnorm7_fwd

resnetv17_stage2_batchnorm7_fwd

BN

[[256,128,28,28],[128],[128],[128],[128]]



resnetv17_stage2_conv7_fwd->resnetv17_stage2_batchnorm7_fwd





resnetv17_stage2_batchnorm7_gamma

resnetv17_stage2_batchnorm7_gamma



resnetv17_stage2_batchnorm7_gamma->resnetv17_stage2_batchnorm7_fwd





resnetv17_stage2_batchnorm7_beta

resnetv17_stage2_batchnorm7_beta



resnetv17_stage2_batchnorm7_beta->resnetv17_stage2_batchnorm7_fwd





resnetv17_stage2_batchnorm7_running_mean

resnetv17_stage2_batchnorm7_running_mean



resnetv17_stage2_batchnorm7_running_mean->resnetv17_stage2_batchnorm7_fwd





resnetv17_stage2_batchnorm7_running_var

resnetv17_stage2_batchnorm7_running_var



resnetv17_stage2_batchnorm7_running_var->resnetv17_stage2_batchnorm7_fwd





resnetv17_stage2_relu4_fwd

resnetv17_stage2_relu4_fwd

RELU

[256,128,28,28]



resnetv17_stage2_batchnorm7_fwd->resnetv17_stage2_relu4_fwd





resnetv17_stage2_conv8_fwd

resnetv17_stage2_conv8_fwd

CONV

[256,128,28,28]



resnetv17_stage2_relu4_fwd->resnetv17_stage2_conv8_fwd





resnetv17_stage2_conv8_weight

resnetv17_stage2_conv8_weight



resnetv17_stage2_conv8_weight->resnetv17_stage2_conv8_fwd





resnetv17_stage2_batchnorm8_fwd

resnetv17_stage2_batchnorm8_fwd

BN

[[256,128,28,28],[128],[128],[128],[128]]



resnetv17_stage2_conv8_fwd->resnetv17_stage2_batchnorm8_fwd





resnetv17_stage2_batchnorm8_gamma

resnetv17_stage2_batchnorm8_gamma



resnetv17_stage2_batchnorm8_gamma->resnetv17_stage2_batchnorm8_fwd





resnetv17_stage2_batchnorm8_beta

resnetv17_stage2_batchnorm8_beta



resnetv17_stage2_batchnorm8_beta->resnetv17_stage2_batchnorm8_fwd





resnetv17_stage2_batchnorm8_running_mean

resnetv17_stage2_batchnorm8_running_mean



resnetv17_stage2_batchnorm8_running_mean->resnetv17_stage2_batchnorm8_fwd





resnetv17_stage2_batchnorm8_running_var

resnetv17_stage2_batchnorm8_running_var



resnetv17_stage2_batchnorm8_running_var->resnetv17_stage2_batchnorm8_fwd





resnetv17_stage2_relu5_fwd

resnetv17_stage2_relu5_fwd

RELU

[256,128,28,28]



resnetv17_stage2_batchnorm8_fwd->resnetv17_stage2_relu5_fwd





resnetv17_stage2_conv9_fwd

resnetv17_stage2_conv9_fwd

CONV

[256,512,28,28]



resnetv17_stage2_relu5_fwd->resnetv17_stage2_conv9_fwd





resnetv17_stage2_conv9_weight

resnetv17_stage2_conv9_weight



resnetv17_stage2_conv9_weight->resnetv17_stage2_conv9_fwd





resnetv17_stage2_conv9_bias

resnetv17_stage2_conv9_bias



resnetv17_stage2_conv9_bias->resnetv17_stage2_conv9_fwd





resnetv17_stage2_batchnorm9_fwd

resnetv17_stage2_batchnorm9_fwd

BN

[[256,512,28,28],[512],[512],[512],[512]]



resnetv17_stage2_conv9_fwd->resnetv17_stage2_batchnorm9_fwd





resnetv17_stage2_batchnorm9_gamma

resnetv17_stage2_batchnorm9_gamma



resnetv17_stage2_batchnorm9_gamma->resnetv17_stage2_batchnorm9_fwd





resnetv17_stage2_batchnorm9_beta

resnetv17_stage2_batchnorm9_beta



resnetv17_stage2_batchnorm9_beta->resnetv17_stage2_batchnorm9_fwd





resnetv17_stage2_batchnorm9_running_mean

resnetv17_stage2_batchnorm9_running_mean



resnetv17_stage2_batchnorm9_running_mean->resnetv17_stage2_batchnorm9_fwd





resnetv17_stage2_batchnorm9_running_var

resnetv17_stage2_batchnorm9_running_var



resnetv17_stage2_batchnorm9_running_var->resnetv17_stage2_batchnorm9_fwd





resnetv17_stage2_batchnorm9_fwd->resnetv17_stage2__plus2





resnetv17_stage2_activation2

resnetv17_stage2_activation2

RELU

[256,512,28,28]



resnetv17_stage2__plus2->resnetv17_stage2_activation2





resnetv17_stage2_conv10_fwd

resnetv17_stage2_conv10_fwd

CONV

[256,128,28,28]



resnetv17_stage2_activation2->resnetv17_stage2_conv10_fwd





resnetv17_stage2__plus3

resnetv17_stage2__plus3

ADD

[256,512,28,28]



resnetv17_stage2_activation2->resnetv17_stage2__plus3





resnetv17_stage2_conv10_weight

resnetv17_stage2_conv10_weight



resnetv17_stage2_conv10_weight->resnetv17_stage2_conv10_fwd





resnetv17_stage2_conv10_bias

resnetv17_stage2_conv10_bias



resnetv17_stage2_conv10_bias->resnetv17_stage2_conv10_fwd





resnetv17_stage2_batchnorm10_fwd

resnetv17_stage2_batchnorm10_fwd

BN

[[256,128,28,28],[128],[128],[128],[128]]



resnetv17_stage2_conv10_fwd->resnetv17_stage2_batchnorm10_fwd





resnetv17_stage2_batchnorm10_gamma

resnetv17_stage2_batchnorm10_gamma



resnetv17_stage2_batchnorm10_gamma->resnetv17_stage2_batchnorm10_fwd





resnetv17_stage2_batchnorm10_beta

resnetv17_stage2_batchnorm10_beta



resnetv17_stage2_batchnorm10_beta->resnetv17_stage2_batchnorm10_fwd





resnetv17_stage2_batchnorm10_running_mean

resnetv17_stage2_batchnorm10_running_mean



resnetv17_stage2_batchnorm10_running_mean->resnetv17_stage2_batchnorm10_fwd





resnetv17_stage2_batchnorm10_running_var

resnetv17_stage2_batchnorm10_running_var



resnetv17_stage2_batchnorm10_running_var->resnetv17_stage2_batchnorm10_fwd





resnetv17_stage2_relu6_fwd

resnetv17_stage2_relu6_fwd

RELU

[256,128,28,28]



resnetv17_stage2_batchnorm10_fwd->resnetv17_stage2_relu6_fwd





resnetv17_stage2_conv11_fwd

resnetv17_stage2_conv11_fwd

CONV

[256,128,28,28]



resnetv17_stage2_relu6_fwd->resnetv17_stage2_conv11_fwd





resnetv17_stage2_conv11_weight

resnetv17_stage2_conv11_weight



resnetv17_stage2_conv11_weight->resnetv17_stage2_conv11_fwd





resnetv17_stage2_batchnorm11_fwd

resnetv17_stage2_batchnorm11_fwd

BN

[[256,128,28,28],[128],[128],[128],[128]]



resnetv17_stage2_conv11_fwd->resnetv17_stage2_batchnorm11_fwd





resnetv17_stage2_batchnorm11_gamma

resnetv17_stage2_batchnorm11_gamma



resnetv17_stage2_batchnorm11_gamma->resnetv17_stage2_batchnorm11_fwd





resnetv17_stage2_batchnorm11_beta

resnetv17_stage2_batchnorm11_beta



resnetv17_stage2_batchnorm11_beta->resnetv17_stage2_batchnorm11_fwd





resnetv17_stage2_batchnorm11_running_mean

resnetv17_stage2_batchnorm11_running_mean



resnetv17_stage2_batchnorm11_running_mean->resnetv17_stage2_batchnorm11_fwd





resnetv17_stage2_batchnorm11_running_var

resnetv17_stage2_batchnorm11_running_var



resnetv17_stage2_batchnorm11_running_var->resnetv17_stage2_batchnorm11_fwd





resnetv17_stage2_relu7_fwd

resnetv17_stage2_relu7_fwd

RELU

[256,128,28,28]



resnetv17_stage2_batchnorm11_fwd->resnetv17_stage2_relu7_fwd





resnetv17_stage2_conv12_fwd

resnetv17_stage2_conv12_fwd

CONV

[256,512,28,28]



resnetv17_stage2_relu7_fwd->resnetv17_stage2_conv12_fwd





resnetv17_stage2_conv12_weight

resnetv17_stage2_conv12_weight



resnetv17_stage2_conv12_weight->resnetv17_stage2_conv12_fwd





resnetv17_stage2_conv12_bias

resnetv17_stage2_conv12_bias



resnetv17_stage2_conv12_bias->resnetv17_stage2_conv12_fwd





resnetv17_stage2_batchnorm12_fwd

resnetv17_stage2_batchnorm12_fwd

BN

[[256,512,28,28],[512],[512],[512],[512]]



resnetv17_stage2_conv12_fwd->resnetv17_stage2_batchnorm12_fwd





resnetv17_stage2_batchnorm12_gamma

resnetv17_stage2_batchnorm12_gamma



resnetv17_stage2_batchnorm12_gamma->resnetv17_stage2_batchnorm12_fwd





resnetv17_stage2_batchnorm12_beta

resnetv17_stage2_batchnorm12_beta



resnetv17_stage2_batchnorm12_beta->resnetv17_stage2_batchnorm12_fwd





resnetv17_stage2_batchnorm12_running_mean

resnetv17_stage2_batchnorm12_running_mean



resnetv17_stage2_batchnorm12_running_mean->resnetv17_stage2_batchnorm12_fwd





resnetv17_stage2_batchnorm12_running_var

resnetv17_stage2_batchnorm12_running_var



resnetv17_stage2_batchnorm12_running_var->resnetv17_stage2_batchnorm12_fwd





resnetv17_stage2_batchnorm12_fwd->resnetv17_stage2__plus3





resnetv17_stage2_activation3

resnetv17_stage2_activation3

RELU

[256,512,28,28]



resnetv17_stage2__plus3->resnetv17_stage2_activation3





resnetv17_stage3_conv0_fwd

resnetv17_stage3_conv0_fwd

CONV

[256,256,14,14]



resnetv17_stage2_activation3->resnetv17_stage3_conv0_fwd





resnetv17_stage3_conv3_fwd

resnetv17_stage3_conv3_fwd

CONV

[256,1024,14,14]



resnetv17_stage2_activation3->resnetv17_stage3_conv3_fwd





resnetv17_stage3_conv0_weight

resnetv17_stage3_conv0_weight



resnetv17_stage3_conv0_weight->resnetv17_stage3_conv0_fwd





resnetv17_stage3_conv0_bias

resnetv17_stage3_conv0_bias



resnetv17_stage3_conv0_bias->resnetv17_stage3_conv0_fwd





resnetv17_stage3_batchnorm0_fwd

resnetv17_stage3_batchnorm0_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv0_fwd->resnetv17_stage3_batchnorm0_fwd





resnetv17_stage3_batchnorm0_gamma

resnetv17_stage3_batchnorm0_gamma



resnetv17_stage3_batchnorm0_gamma->resnetv17_stage3_batchnorm0_fwd





resnetv17_stage3_batchnorm0_beta

resnetv17_stage3_batchnorm0_beta



resnetv17_stage3_batchnorm0_beta->resnetv17_stage3_batchnorm0_fwd





resnetv17_stage3_batchnorm0_running_mean

resnetv17_stage3_batchnorm0_running_mean



resnetv17_stage3_batchnorm0_running_mean->resnetv17_stage3_batchnorm0_fwd





resnetv17_stage3_batchnorm0_running_var

resnetv17_stage3_batchnorm0_running_var



resnetv17_stage3_batchnorm0_running_var->resnetv17_stage3_batchnorm0_fwd





resnetv17_stage3_relu0_fwd

resnetv17_stage3_relu0_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm0_fwd->resnetv17_stage3_relu0_fwd





resnetv17_stage3_conv1_fwd

resnetv17_stage3_conv1_fwd

CONV

[256,256,14,14]



resnetv17_stage3_relu0_fwd->resnetv17_stage3_conv1_fwd





resnetv17_stage3_conv1_weight

resnetv17_stage3_conv1_weight



resnetv17_stage3_conv1_weight->resnetv17_stage3_conv1_fwd





resnetv17_stage3_batchnorm1_fwd

resnetv17_stage3_batchnorm1_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv1_fwd->resnetv17_stage3_batchnorm1_fwd





resnetv17_stage3_batchnorm1_gamma

resnetv17_stage3_batchnorm1_gamma



resnetv17_stage3_batchnorm1_gamma->resnetv17_stage3_batchnorm1_fwd





resnetv17_stage3_batchnorm1_beta

resnetv17_stage3_batchnorm1_beta



resnetv17_stage3_batchnorm1_beta->resnetv17_stage3_batchnorm1_fwd





resnetv17_stage3_batchnorm1_running_mean

resnetv17_stage3_batchnorm1_running_mean



resnetv17_stage3_batchnorm1_running_mean->resnetv17_stage3_batchnorm1_fwd





resnetv17_stage3_batchnorm1_running_var

resnetv17_stage3_batchnorm1_running_var



resnetv17_stage3_batchnorm1_running_var->resnetv17_stage3_batchnorm1_fwd





resnetv17_stage3_relu1_fwd

resnetv17_stage3_relu1_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm1_fwd->resnetv17_stage3_relu1_fwd





resnetv17_stage3_conv2_fwd

resnetv17_stage3_conv2_fwd

CONV

[256,1024,14,14]



resnetv17_stage3_relu1_fwd->resnetv17_stage3_conv2_fwd





resnetv17_stage3_conv2_weight

resnetv17_stage3_conv2_weight



resnetv17_stage3_conv2_weight->resnetv17_stage3_conv2_fwd





resnetv17_stage3_conv2_bias

resnetv17_stage3_conv2_bias



resnetv17_stage3_conv2_bias->resnetv17_stage3_conv2_fwd





resnetv17_stage3_batchnorm2_fwd

resnetv17_stage3_batchnorm2_fwd

BN

[[256,1024,14,14],[1024],[1024],[1024],[1024]]



resnetv17_stage3_conv2_fwd->resnetv17_stage3_batchnorm2_fwd





resnetv17_stage3_batchnorm2_gamma

resnetv17_stage3_batchnorm2_gamma



resnetv17_stage3_batchnorm2_gamma->resnetv17_stage3_batchnorm2_fwd





resnetv17_stage3_batchnorm2_beta

resnetv17_stage3_batchnorm2_beta



resnetv17_stage3_batchnorm2_beta->resnetv17_stage3_batchnorm2_fwd





resnetv17_stage3_batchnorm2_running_mean

resnetv17_stage3_batchnorm2_running_mean



resnetv17_stage3_batchnorm2_running_mean->resnetv17_stage3_batchnorm2_fwd





resnetv17_stage3_batchnorm2_running_var

resnetv17_stage3_batchnorm2_running_var



resnetv17_stage3_batchnorm2_running_var->resnetv17_stage3_batchnorm2_fwd





resnetv17_stage3__plus0

resnetv17_stage3__plus0

ADD

[256,1024,14,14]



resnetv17_stage3_batchnorm2_fwd->resnetv17_stage3__plus0





resnetv17_stage3_conv3_weight

resnetv17_stage3_conv3_weight



resnetv17_stage3_conv3_weight->resnetv17_stage3_conv3_fwd





resnetv17_stage3_batchnorm3_fwd

resnetv17_stage3_batchnorm3_fwd

BN

[[256,1024,14,14],[1024],[1024],[1024],[1024]]



resnetv17_stage3_conv3_fwd->resnetv17_stage3_batchnorm3_fwd





resnetv17_stage3_batchnorm3_gamma

resnetv17_stage3_batchnorm3_gamma



resnetv17_stage3_batchnorm3_gamma->resnetv17_stage3_batchnorm3_fwd





resnetv17_stage3_batchnorm3_beta

resnetv17_stage3_batchnorm3_beta



resnetv17_stage3_batchnorm3_beta->resnetv17_stage3_batchnorm3_fwd





resnetv17_stage3_batchnorm3_running_mean

resnetv17_stage3_batchnorm3_running_mean



resnetv17_stage3_batchnorm3_running_mean->resnetv17_stage3_batchnorm3_fwd





resnetv17_stage3_batchnorm3_running_var

resnetv17_stage3_batchnorm3_running_var



resnetv17_stage3_batchnorm3_running_var->resnetv17_stage3_batchnorm3_fwd





resnetv17_stage3_batchnorm3_fwd->resnetv17_stage3__plus0





resnetv17_stage3_activation0

resnetv17_stage3_activation0

RELU

[256,1024,14,14]



resnetv17_stage3__plus0->resnetv17_stage3_activation0





resnetv17_stage3_conv4_fwd

resnetv17_stage3_conv4_fwd

CONV

[256,256,14,14]



resnetv17_stage3_activation0->resnetv17_stage3_conv4_fwd





resnetv17_stage3__plus1

resnetv17_stage3__plus1

ADD

[256,1024,14,14]



resnetv17_stage3_activation0->resnetv17_stage3__plus1





resnetv17_stage3_conv4_weight

resnetv17_stage3_conv4_weight



resnetv17_stage3_conv4_weight->resnetv17_stage3_conv4_fwd





resnetv17_stage3_conv4_bias

resnetv17_stage3_conv4_bias



resnetv17_stage3_conv4_bias->resnetv17_stage3_conv4_fwd





resnetv17_stage3_batchnorm4_fwd

resnetv17_stage3_batchnorm4_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv4_fwd->resnetv17_stage3_batchnorm4_fwd





resnetv17_stage3_batchnorm4_gamma

resnetv17_stage3_batchnorm4_gamma



resnetv17_stage3_batchnorm4_gamma->resnetv17_stage3_batchnorm4_fwd





resnetv17_stage3_batchnorm4_beta

resnetv17_stage3_batchnorm4_beta



resnetv17_stage3_batchnorm4_beta->resnetv17_stage3_batchnorm4_fwd





resnetv17_stage3_batchnorm4_running_mean

resnetv17_stage3_batchnorm4_running_mean



resnetv17_stage3_batchnorm4_running_mean->resnetv17_stage3_batchnorm4_fwd





resnetv17_stage3_batchnorm4_running_var

resnetv17_stage3_batchnorm4_running_var



resnetv17_stage3_batchnorm4_running_var->resnetv17_stage3_batchnorm4_fwd





resnetv17_stage3_relu2_fwd

resnetv17_stage3_relu2_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm4_fwd->resnetv17_stage3_relu2_fwd





resnetv17_stage3_conv5_fwd

resnetv17_stage3_conv5_fwd

CONV

[256,256,14,14]



resnetv17_stage3_relu2_fwd->resnetv17_stage3_conv5_fwd





resnetv17_stage3_conv5_weight

resnetv17_stage3_conv5_weight



resnetv17_stage3_conv5_weight->resnetv17_stage3_conv5_fwd





resnetv17_stage3_batchnorm5_fwd

resnetv17_stage3_batchnorm5_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv5_fwd->resnetv17_stage3_batchnorm5_fwd





resnetv17_stage3_batchnorm5_gamma

resnetv17_stage3_batchnorm5_gamma



resnetv17_stage3_batchnorm5_gamma->resnetv17_stage3_batchnorm5_fwd





resnetv17_stage3_batchnorm5_beta

resnetv17_stage3_batchnorm5_beta



resnetv17_stage3_batchnorm5_beta->resnetv17_stage3_batchnorm5_fwd





resnetv17_stage3_batchnorm5_running_mean

resnetv17_stage3_batchnorm5_running_mean



resnetv17_stage3_batchnorm5_running_mean->resnetv17_stage3_batchnorm5_fwd





resnetv17_stage3_batchnorm5_running_var

resnetv17_stage3_batchnorm5_running_var



resnetv17_stage3_batchnorm5_running_var->resnetv17_stage3_batchnorm5_fwd





resnetv17_stage3_relu3_fwd

resnetv17_stage3_relu3_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm5_fwd->resnetv17_stage3_relu3_fwd





resnetv17_stage3_conv6_fwd

resnetv17_stage3_conv6_fwd

CONV

[256,1024,14,14]



resnetv17_stage3_relu3_fwd->resnetv17_stage3_conv6_fwd





resnetv17_stage3_conv6_weight

resnetv17_stage3_conv6_weight



resnetv17_stage3_conv6_weight->resnetv17_stage3_conv6_fwd





resnetv17_stage3_conv6_bias

resnetv17_stage3_conv6_bias



resnetv17_stage3_conv6_bias->resnetv17_stage3_conv6_fwd





resnetv17_stage3_batchnorm6_fwd

resnetv17_stage3_batchnorm6_fwd

BN

[[256,1024,14,14],[1024],[1024],[1024],[1024]]



resnetv17_stage3_conv6_fwd->resnetv17_stage3_batchnorm6_fwd





resnetv17_stage3_batchnorm6_gamma

resnetv17_stage3_batchnorm6_gamma



resnetv17_stage3_batchnorm6_gamma->resnetv17_stage3_batchnorm6_fwd





resnetv17_stage3_batchnorm6_beta

resnetv17_stage3_batchnorm6_beta



resnetv17_stage3_batchnorm6_beta->resnetv17_stage3_batchnorm6_fwd





resnetv17_stage3_batchnorm6_running_mean

resnetv17_stage3_batchnorm6_running_mean



resnetv17_stage3_batchnorm6_running_mean->resnetv17_stage3_batchnorm6_fwd





resnetv17_stage3_batchnorm6_running_var

resnetv17_stage3_batchnorm6_running_var



resnetv17_stage3_batchnorm6_running_var->resnetv17_stage3_batchnorm6_fwd





resnetv17_stage3_batchnorm6_fwd->resnetv17_stage3__plus1





resnetv17_stage3_activation1

resnetv17_stage3_activation1

RELU

[256,1024,14,14]



resnetv17_stage3__plus1->resnetv17_stage3_activation1





resnetv17_stage3_conv7_fwd

resnetv17_stage3_conv7_fwd

CONV

[256,256,14,14]



resnetv17_stage3_activation1->resnetv17_stage3_conv7_fwd





resnetv17_stage3__plus2

resnetv17_stage3__plus2

ADD

[256,1024,14,14]



resnetv17_stage3_activation1->resnetv17_stage3__plus2





resnetv17_stage3_conv7_weight

resnetv17_stage3_conv7_weight



resnetv17_stage3_conv7_weight->resnetv17_stage3_conv7_fwd





resnetv17_stage3_conv7_bias

resnetv17_stage3_conv7_bias



resnetv17_stage3_conv7_bias->resnetv17_stage3_conv7_fwd





resnetv17_stage3_batchnorm7_fwd

resnetv17_stage3_batchnorm7_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv7_fwd->resnetv17_stage3_batchnorm7_fwd





resnetv17_stage3_batchnorm7_gamma

resnetv17_stage3_batchnorm7_gamma



resnetv17_stage3_batchnorm7_gamma->resnetv17_stage3_batchnorm7_fwd





resnetv17_stage3_batchnorm7_beta

resnetv17_stage3_batchnorm7_beta



resnetv17_stage3_batchnorm7_beta->resnetv17_stage3_batchnorm7_fwd





resnetv17_stage3_batchnorm7_running_mean

resnetv17_stage3_batchnorm7_running_mean



resnetv17_stage3_batchnorm7_running_mean->resnetv17_stage3_batchnorm7_fwd





resnetv17_stage3_batchnorm7_running_var

resnetv17_stage3_batchnorm7_running_var



resnetv17_stage3_batchnorm7_running_var->resnetv17_stage3_batchnorm7_fwd





resnetv17_stage3_relu4_fwd

resnetv17_stage3_relu4_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm7_fwd->resnetv17_stage3_relu4_fwd





resnetv17_stage3_conv8_fwd

resnetv17_stage3_conv8_fwd

CONV

[256,256,14,14]



resnetv17_stage3_relu4_fwd->resnetv17_stage3_conv8_fwd





resnetv17_stage3_conv8_weight

resnetv17_stage3_conv8_weight



resnetv17_stage3_conv8_weight->resnetv17_stage3_conv8_fwd





resnetv17_stage3_batchnorm8_fwd

resnetv17_stage3_batchnorm8_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv8_fwd->resnetv17_stage3_batchnorm8_fwd





resnetv17_stage3_batchnorm8_gamma

resnetv17_stage3_batchnorm8_gamma



resnetv17_stage3_batchnorm8_gamma->resnetv17_stage3_batchnorm8_fwd





resnetv17_stage3_batchnorm8_beta

resnetv17_stage3_batchnorm8_beta



resnetv17_stage3_batchnorm8_beta->resnetv17_stage3_batchnorm8_fwd





resnetv17_stage3_batchnorm8_running_mean

resnetv17_stage3_batchnorm8_running_mean



resnetv17_stage3_batchnorm8_running_mean->resnetv17_stage3_batchnorm8_fwd





resnetv17_stage3_batchnorm8_running_var

resnetv17_stage3_batchnorm8_running_var



resnetv17_stage3_batchnorm8_running_var->resnetv17_stage3_batchnorm8_fwd





resnetv17_stage3_relu5_fwd

resnetv17_stage3_relu5_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm8_fwd->resnetv17_stage3_relu5_fwd





resnetv17_stage3_conv9_fwd

resnetv17_stage3_conv9_fwd

CONV

[256,1024,14,14]



resnetv17_stage3_relu5_fwd->resnetv17_stage3_conv9_fwd





resnetv17_stage3_conv9_weight

resnetv17_stage3_conv9_weight



resnetv17_stage3_conv9_weight->resnetv17_stage3_conv9_fwd





resnetv17_stage3_conv9_bias

resnetv17_stage3_conv9_bias



resnetv17_stage3_conv9_bias->resnetv17_stage3_conv9_fwd





resnetv17_stage3_batchnorm9_fwd

resnetv17_stage3_batchnorm9_fwd

BN

[[256,1024,14,14],[1024],[1024],[1024],[1024]]



resnetv17_stage3_conv9_fwd->resnetv17_stage3_batchnorm9_fwd





resnetv17_stage3_batchnorm9_gamma

resnetv17_stage3_batchnorm9_gamma



resnetv17_stage3_batchnorm9_gamma->resnetv17_stage3_batchnorm9_fwd





resnetv17_stage3_batchnorm9_beta

resnetv17_stage3_batchnorm9_beta



resnetv17_stage3_batchnorm9_beta->resnetv17_stage3_batchnorm9_fwd





resnetv17_stage3_batchnorm9_running_mean

resnetv17_stage3_batchnorm9_running_mean



resnetv17_stage3_batchnorm9_running_mean->resnetv17_stage3_batchnorm9_fwd





resnetv17_stage3_batchnorm9_running_var

resnetv17_stage3_batchnorm9_running_var



resnetv17_stage3_batchnorm9_running_var->resnetv17_stage3_batchnorm9_fwd





resnetv17_stage3_batchnorm9_fwd->resnetv17_stage3__plus2





resnetv17_stage3_activation2

resnetv17_stage3_activation2

RELU

[256,1024,14,14]



resnetv17_stage3__plus2->resnetv17_stage3_activation2





resnetv17_stage3_conv10_fwd

resnetv17_stage3_conv10_fwd

CONV

[256,256,14,14]



resnetv17_stage3_activation2->resnetv17_stage3_conv10_fwd





resnetv17_stage3__plus3

resnetv17_stage3__plus3

ADD

[256,1024,14,14]



resnetv17_stage3_activation2->resnetv17_stage3__plus3





resnetv17_stage3_conv10_weight

resnetv17_stage3_conv10_weight



resnetv17_stage3_conv10_weight->resnetv17_stage3_conv10_fwd





resnetv17_stage3_conv10_bias

resnetv17_stage3_conv10_bias



resnetv17_stage3_conv10_bias->resnetv17_stage3_conv10_fwd





resnetv17_stage3_batchnorm10_fwd

resnetv17_stage3_batchnorm10_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv10_fwd->resnetv17_stage3_batchnorm10_fwd





resnetv17_stage3_batchnorm10_gamma

resnetv17_stage3_batchnorm10_gamma



resnetv17_stage3_batchnorm10_gamma->resnetv17_stage3_batchnorm10_fwd





resnetv17_stage3_batchnorm10_beta

resnetv17_stage3_batchnorm10_beta



resnetv17_stage3_batchnorm10_beta->resnetv17_stage3_batchnorm10_fwd





resnetv17_stage3_batchnorm10_running_mean

resnetv17_stage3_batchnorm10_running_mean



resnetv17_stage3_batchnorm10_running_mean->resnetv17_stage3_batchnorm10_fwd





resnetv17_stage3_batchnorm10_running_var

resnetv17_stage3_batchnorm10_running_var



resnetv17_stage3_batchnorm10_running_var->resnetv17_stage3_batchnorm10_fwd





resnetv17_stage3_relu6_fwd

resnetv17_stage3_relu6_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm10_fwd->resnetv17_stage3_relu6_fwd





resnetv17_stage3_conv11_fwd

resnetv17_stage3_conv11_fwd

CONV

[256,256,14,14]



resnetv17_stage3_relu6_fwd->resnetv17_stage3_conv11_fwd





resnetv17_stage3_conv11_weight

resnetv17_stage3_conv11_weight



resnetv17_stage3_conv11_weight->resnetv17_stage3_conv11_fwd





resnetv17_stage3_batchnorm11_fwd

resnetv17_stage3_batchnorm11_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv11_fwd->resnetv17_stage3_batchnorm11_fwd





resnetv17_stage3_batchnorm11_gamma

resnetv17_stage3_batchnorm11_gamma



resnetv17_stage3_batchnorm11_gamma->resnetv17_stage3_batchnorm11_fwd





resnetv17_stage3_batchnorm11_beta

resnetv17_stage3_batchnorm11_beta



resnetv17_stage3_batchnorm11_beta->resnetv17_stage3_batchnorm11_fwd





resnetv17_stage3_batchnorm11_running_mean

resnetv17_stage3_batchnorm11_running_mean



resnetv17_stage3_batchnorm11_running_mean->resnetv17_stage3_batchnorm11_fwd





resnetv17_stage3_batchnorm11_running_var

resnetv17_stage3_batchnorm11_running_var



resnetv17_stage3_batchnorm11_running_var->resnetv17_stage3_batchnorm11_fwd





resnetv17_stage3_relu7_fwd

resnetv17_stage3_relu7_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm11_fwd->resnetv17_stage3_relu7_fwd





resnetv17_stage3_conv12_fwd

resnetv17_stage3_conv12_fwd

CONV

[256,1024,14,14]



resnetv17_stage3_relu7_fwd->resnetv17_stage3_conv12_fwd





resnetv17_stage3_conv12_weight

resnetv17_stage3_conv12_weight



resnetv17_stage3_conv12_weight->resnetv17_stage3_conv12_fwd





resnetv17_stage3_conv12_bias

resnetv17_stage3_conv12_bias



resnetv17_stage3_conv12_bias->resnetv17_stage3_conv12_fwd





resnetv17_stage3_batchnorm12_fwd

resnetv17_stage3_batchnorm12_fwd

BN

[[256,1024,14,14],[1024],[1024],[1024],[1024]]



resnetv17_stage3_conv12_fwd->resnetv17_stage3_batchnorm12_fwd





resnetv17_stage3_batchnorm12_gamma

resnetv17_stage3_batchnorm12_gamma



resnetv17_stage3_batchnorm12_gamma->resnetv17_stage3_batchnorm12_fwd





resnetv17_stage3_batchnorm12_beta

resnetv17_stage3_batchnorm12_beta



resnetv17_stage3_batchnorm12_beta->resnetv17_stage3_batchnorm12_fwd





resnetv17_stage3_batchnorm12_running_mean

resnetv17_stage3_batchnorm12_running_mean



resnetv17_stage3_batchnorm12_running_mean->resnetv17_stage3_batchnorm12_fwd





resnetv17_stage3_batchnorm12_running_var

resnetv17_stage3_batchnorm12_running_var



resnetv17_stage3_batchnorm12_running_var->resnetv17_stage3_batchnorm12_fwd





resnetv17_stage3_batchnorm12_fwd->resnetv17_stage3__plus3





resnetv17_stage3_activation3

resnetv17_stage3_activation3

RELU

[256,1024,14,14]



resnetv17_stage3__plus3->resnetv17_stage3_activation3





resnetv17_stage3_conv13_fwd

resnetv17_stage3_conv13_fwd

CONV

[256,256,14,14]



resnetv17_stage3_activation3->resnetv17_stage3_conv13_fwd





resnetv17_stage3__plus4

resnetv17_stage3__plus4

ADD

[256,1024,14,14]



resnetv17_stage3_activation3->resnetv17_stage3__plus4





resnetv17_stage3_conv13_weight

resnetv17_stage3_conv13_weight



resnetv17_stage3_conv13_weight->resnetv17_stage3_conv13_fwd





resnetv17_stage3_conv13_bias

resnetv17_stage3_conv13_bias



resnetv17_stage3_conv13_bias->resnetv17_stage3_conv13_fwd





resnetv17_stage3_batchnorm13_fwd

resnetv17_stage3_batchnorm13_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv13_fwd->resnetv17_stage3_batchnorm13_fwd





resnetv17_stage3_batchnorm13_gamma

resnetv17_stage3_batchnorm13_gamma



resnetv17_stage3_batchnorm13_gamma->resnetv17_stage3_batchnorm13_fwd





resnetv17_stage3_batchnorm13_beta

resnetv17_stage3_batchnorm13_beta



resnetv17_stage3_batchnorm13_beta->resnetv17_stage3_batchnorm13_fwd





resnetv17_stage3_batchnorm13_running_mean

resnetv17_stage3_batchnorm13_running_mean



resnetv17_stage3_batchnorm13_running_mean->resnetv17_stage3_batchnorm13_fwd





resnetv17_stage3_batchnorm13_running_var

resnetv17_stage3_batchnorm13_running_var



resnetv17_stage3_batchnorm13_running_var->resnetv17_stage3_batchnorm13_fwd





resnetv17_stage3_relu8_fwd

resnetv17_stage3_relu8_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm13_fwd->resnetv17_stage3_relu8_fwd





resnetv17_stage3_conv14_fwd

resnetv17_stage3_conv14_fwd

CONV

[256,256,14,14]



resnetv17_stage3_relu8_fwd->resnetv17_stage3_conv14_fwd





resnetv17_stage3_conv14_weight

resnetv17_stage3_conv14_weight



resnetv17_stage3_conv14_weight->resnetv17_stage3_conv14_fwd





resnetv17_stage3_batchnorm14_fwd

resnetv17_stage3_batchnorm14_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv14_fwd->resnetv17_stage3_batchnorm14_fwd





resnetv17_stage3_batchnorm14_gamma

resnetv17_stage3_batchnorm14_gamma



resnetv17_stage3_batchnorm14_gamma->resnetv17_stage3_batchnorm14_fwd





resnetv17_stage3_batchnorm14_beta

resnetv17_stage3_batchnorm14_beta



resnetv17_stage3_batchnorm14_beta->resnetv17_stage3_batchnorm14_fwd





resnetv17_stage3_batchnorm14_running_mean

resnetv17_stage3_batchnorm14_running_mean



resnetv17_stage3_batchnorm14_running_mean->resnetv17_stage3_batchnorm14_fwd





resnetv17_stage3_batchnorm14_running_var

resnetv17_stage3_batchnorm14_running_var



resnetv17_stage3_batchnorm14_running_var->resnetv17_stage3_batchnorm14_fwd





resnetv17_stage3_relu9_fwd

resnetv17_stage3_relu9_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm14_fwd->resnetv17_stage3_relu9_fwd





resnetv17_stage3_conv15_fwd

resnetv17_stage3_conv15_fwd

CONV

[256,1024,14,14]



resnetv17_stage3_relu9_fwd->resnetv17_stage3_conv15_fwd





resnetv17_stage3_conv15_weight

resnetv17_stage3_conv15_weight



resnetv17_stage3_conv15_weight->resnetv17_stage3_conv15_fwd





resnetv17_stage3_conv15_bias

resnetv17_stage3_conv15_bias



resnetv17_stage3_conv15_bias->resnetv17_stage3_conv15_fwd





resnetv17_stage3_batchnorm15_fwd

resnetv17_stage3_batchnorm15_fwd

BN

[[256,1024,14,14],[1024],[1024],[1024],[1024]]



resnetv17_stage3_conv15_fwd->resnetv17_stage3_batchnorm15_fwd





resnetv17_stage3_batchnorm15_gamma

resnetv17_stage3_batchnorm15_gamma



resnetv17_stage3_batchnorm15_gamma->resnetv17_stage3_batchnorm15_fwd





resnetv17_stage3_batchnorm15_beta

resnetv17_stage3_batchnorm15_beta



resnetv17_stage3_batchnorm15_beta->resnetv17_stage3_batchnorm15_fwd





resnetv17_stage3_batchnorm15_running_mean

resnetv17_stage3_batchnorm15_running_mean



resnetv17_stage3_batchnorm15_running_mean->resnetv17_stage3_batchnorm15_fwd





resnetv17_stage3_batchnorm15_running_var

resnetv17_stage3_batchnorm15_running_var



resnetv17_stage3_batchnorm15_running_var->resnetv17_stage3_batchnorm15_fwd





resnetv17_stage3_batchnorm15_fwd->resnetv17_stage3__plus4





resnetv17_stage3_activation4

resnetv17_stage3_activation4

RELU

[256,1024,14,14]



resnetv17_stage3__plus4->resnetv17_stage3_activation4





resnetv17_stage3_conv16_fwd

resnetv17_stage3_conv16_fwd

CONV

[256,256,14,14]



resnetv17_stage3_activation4->resnetv17_stage3_conv16_fwd





resnetv17_stage3__plus5

resnetv17_stage3__plus5

ADD

[256,1024,14,14]



resnetv17_stage3_activation4->resnetv17_stage3__plus5





resnetv17_stage3_conv16_weight

resnetv17_stage3_conv16_weight



resnetv17_stage3_conv16_weight->resnetv17_stage3_conv16_fwd





resnetv17_stage3_conv16_bias

resnetv17_stage3_conv16_bias



resnetv17_stage3_conv16_bias->resnetv17_stage3_conv16_fwd





resnetv17_stage3_batchnorm16_fwd

resnetv17_stage3_batchnorm16_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv16_fwd->resnetv17_stage3_batchnorm16_fwd





resnetv17_stage3_batchnorm16_gamma

resnetv17_stage3_batchnorm16_gamma



resnetv17_stage3_batchnorm16_gamma->resnetv17_stage3_batchnorm16_fwd





resnetv17_stage3_batchnorm16_beta

resnetv17_stage3_batchnorm16_beta



resnetv17_stage3_batchnorm16_beta->resnetv17_stage3_batchnorm16_fwd





resnetv17_stage3_batchnorm16_running_mean

resnetv17_stage3_batchnorm16_running_mean



resnetv17_stage3_batchnorm16_running_mean->resnetv17_stage3_batchnorm16_fwd





resnetv17_stage3_batchnorm16_running_var

resnetv17_stage3_batchnorm16_running_var



resnetv17_stage3_batchnorm16_running_var->resnetv17_stage3_batchnorm16_fwd





resnetv17_stage3_relu10_fwd

resnetv17_stage3_relu10_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm16_fwd->resnetv17_stage3_relu10_fwd





resnetv17_stage3_conv17_fwd

resnetv17_stage3_conv17_fwd

CONV

[256,256,14,14]



resnetv17_stage3_relu10_fwd->resnetv17_stage3_conv17_fwd





resnetv17_stage3_conv17_weight

resnetv17_stage3_conv17_weight



resnetv17_stage3_conv17_weight->resnetv17_stage3_conv17_fwd





resnetv17_stage3_batchnorm17_fwd

resnetv17_stage3_batchnorm17_fwd

BN

[[256,256,14,14],[256],[256],[256],[256]]



resnetv17_stage3_conv17_fwd->resnetv17_stage3_batchnorm17_fwd





resnetv17_stage3_batchnorm17_gamma

resnetv17_stage3_batchnorm17_gamma



resnetv17_stage3_batchnorm17_gamma->resnetv17_stage3_batchnorm17_fwd





resnetv17_stage3_batchnorm17_beta

resnetv17_stage3_batchnorm17_beta



resnetv17_stage3_batchnorm17_beta->resnetv17_stage3_batchnorm17_fwd





resnetv17_stage3_batchnorm17_running_mean

resnetv17_stage3_batchnorm17_running_mean



resnetv17_stage3_batchnorm17_running_mean->resnetv17_stage3_batchnorm17_fwd





resnetv17_stage3_batchnorm17_running_var

resnetv17_stage3_batchnorm17_running_var



resnetv17_stage3_batchnorm17_running_var->resnetv17_stage3_batchnorm17_fwd





resnetv17_stage3_relu11_fwd

resnetv17_stage3_relu11_fwd

RELU

[256,256,14,14]



resnetv17_stage3_batchnorm17_fwd->resnetv17_stage3_relu11_fwd





resnetv17_stage3_conv18_fwd

resnetv17_stage3_conv18_fwd

CONV

[256,1024,14,14]



resnetv17_stage3_relu11_fwd->resnetv17_stage3_conv18_fwd





resnetv17_stage3_conv18_weight

resnetv17_stage3_conv18_weight



resnetv17_stage3_conv18_weight->resnetv17_stage3_conv18_fwd





resnetv17_stage3_conv18_bias

resnetv17_stage3_conv18_bias



resnetv17_stage3_conv18_bias->resnetv17_stage3_conv18_fwd





resnetv17_stage3_batchnorm18_fwd

resnetv17_stage3_batchnorm18_fwd

BN

[[256,1024,14,14],[1024],[1024],[1024],[1024]]



resnetv17_stage3_conv18_fwd->resnetv17_stage3_batchnorm18_fwd





resnetv17_stage3_batchnorm18_gamma

resnetv17_stage3_batchnorm18_gamma



resnetv17_stage3_batchnorm18_gamma->resnetv17_stage3_batchnorm18_fwd





resnetv17_stage3_batchnorm18_beta

resnetv17_stage3_batchnorm18_beta



resnetv17_stage3_batchnorm18_beta->resnetv17_stage3_batchnorm18_fwd





resnetv17_stage3_batchnorm18_running_mean

resnetv17_stage3_batchnorm18_running_mean



resnetv17_stage3_batchnorm18_running_mean->resnetv17_stage3_batchnorm18_fwd





resnetv17_stage3_batchnorm18_running_var

resnetv17_stage3_batchnorm18_running_var



resnetv17_stage3_batchnorm18_running_var->resnetv17_stage3_batchnorm18_fwd





resnetv17_stage3_batchnorm18_fwd->resnetv17_stage3__plus5





resnetv17_stage3_activation5

resnetv17_stage3_activation5

RELU

[256,1024,14,14]



resnetv17_stage3__plus5->resnetv17_stage3_activation5





resnetv17_stage4_conv0_fwd

resnetv17_stage4_conv0_fwd

CONV

[256,512,7,7]



resnetv17_stage3_activation5->resnetv17_stage4_conv0_fwd





resnetv17_stage4_conv3_fwd

resnetv17_stage4_conv3_fwd

CONV

[256,2048,7,7]



resnetv17_stage3_activation5->resnetv17_stage4_conv3_fwd





resnetv17_stage4_conv0_weight

resnetv17_stage4_conv0_weight



resnetv17_stage4_conv0_weight->resnetv17_stage4_conv0_fwd





resnetv17_stage4_conv0_bias

resnetv17_stage4_conv0_bias



resnetv17_stage4_conv0_bias->resnetv17_stage4_conv0_fwd





resnetv17_stage4_batchnorm0_fwd

resnetv17_stage4_batchnorm0_fwd

BN

[[256,512,7,7],[512],[512],[512],[512]]



resnetv17_stage4_conv0_fwd->resnetv17_stage4_batchnorm0_fwd





resnetv17_stage4_batchnorm0_gamma

resnetv17_stage4_batchnorm0_gamma



resnetv17_stage4_batchnorm0_gamma->resnetv17_stage4_batchnorm0_fwd





resnetv17_stage4_batchnorm0_beta

resnetv17_stage4_batchnorm0_beta



resnetv17_stage4_batchnorm0_beta->resnetv17_stage4_batchnorm0_fwd





resnetv17_stage4_batchnorm0_running_mean

resnetv17_stage4_batchnorm0_running_mean



resnetv17_stage4_batchnorm0_running_mean->resnetv17_stage4_batchnorm0_fwd





resnetv17_stage4_batchnorm0_running_var

resnetv17_stage4_batchnorm0_running_var



resnetv17_stage4_batchnorm0_running_var->resnetv17_stage4_batchnorm0_fwd





resnetv17_stage4_relu0_fwd

resnetv17_stage4_relu0_fwd

RELU

[256,512,7,7]



resnetv17_stage4_batchnorm0_fwd->resnetv17_stage4_relu0_fwd





resnetv17_stage4_conv1_fwd

resnetv17_stage4_conv1_fwd

CONV

[256,512,7,7]



resnetv17_stage4_relu0_fwd->resnetv17_stage4_conv1_fwd





resnetv17_stage4_conv1_weight

resnetv17_stage4_conv1_weight



resnetv17_stage4_conv1_weight->resnetv17_stage4_conv1_fwd





resnetv17_stage4_batchnorm1_fwd

resnetv17_stage4_batchnorm1_fwd

BN

[[256,512,7,7],[512],[512],[512],[512]]



resnetv17_stage4_conv1_fwd->resnetv17_stage4_batchnorm1_fwd





resnetv17_stage4_batchnorm1_gamma

resnetv17_stage4_batchnorm1_gamma



resnetv17_stage4_batchnorm1_gamma->resnetv17_stage4_batchnorm1_fwd





resnetv17_stage4_batchnorm1_beta

resnetv17_stage4_batchnorm1_beta



resnetv17_stage4_batchnorm1_beta->resnetv17_stage4_batchnorm1_fwd





resnetv17_stage4_batchnorm1_running_mean

resnetv17_stage4_batchnorm1_running_mean



resnetv17_stage4_batchnorm1_running_mean->resnetv17_stage4_batchnorm1_fwd





resnetv17_stage4_batchnorm1_running_var

resnetv17_stage4_batchnorm1_running_var



resnetv17_stage4_batchnorm1_running_var->resnetv17_stage4_batchnorm1_fwd





resnetv17_stage4_relu1_fwd

resnetv17_stage4_relu1_fwd

RELU

[256,512,7,7]



resnetv17_stage4_batchnorm1_fwd->resnetv17_stage4_relu1_fwd





resnetv17_stage4_conv2_fwd

resnetv17_stage4_conv2_fwd

CONV

[256,2048,7,7]



resnetv17_stage4_relu1_fwd->resnetv17_stage4_conv2_fwd





resnetv17_stage4_conv2_weight

resnetv17_stage4_conv2_weight



resnetv17_stage4_conv2_weight->resnetv17_stage4_conv2_fwd





resnetv17_stage4_conv2_bias

resnetv17_stage4_conv2_bias



resnetv17_stage4_conv2_bias->resnetv17_stage4_conv2_fwd





resnetv17_stage4_batchnorm2_fwd

resnetv17_stage4_batchnorm2_fwd

BN

[[256,2048,7,7],[2048],[2048],[2048],[2048]]



resnetv17_stage4_conv2_fwd->resnetv17_stage4_batchnorm2_fwd





resnetv17_stage4_batchnorm2_gamma

resnetv17_stage4_batchnorm2_gamma



resnetv17_stage4_batchnorm2_gamma->resnetv17_stage4_batchnorm2_fwd





resnetv17_stage4_batchnorm2_beta

resnetv17_stage4_batchnorm2_beta



resnetv17_stage4_batchnorm2_beta->resnetv17_stage4_batchnorm2_fwd





resnetv17_stage4_batchnorm2_running_mean

resnetv17_stage4_batchnorm2_running_mean



resnetv17_stage4_batchnorm2_running_mean->resnetv17_stage4_batchnorm2_fwd





resnetv17_stage4_batchnorm2_running_var

resnetv17_stage4_batchnorm2_running_var



resnetv17_stage4_batchnorm2_running_var->resnetv17_stage4_batchnorm2_fwd





resnetv17_stage4__plus0

resnetv17_stage4__plus0

ADD

[256,2048,7,7]



resnetv17_stage4_batchnorm2_fwd->resnetv17_stage4__plus0





resnetv17_stage4_conv3_weight

resnetv17_stage4_conv3_weight



resnetv17_stage4_conv3_weight->resnetv17_stage4_conv3_fwd





resnetv17_stage4_batchnorm3_fwd

resnetv17_stage4_batchnorm3_fwd

BN

[[256,2048,7,7],[2048],[2048],[2048],[2048]]



resnetv17_stage4_conv3_fwd->resnetv17_stage4_batchnorm3_fwd





resnetv17_stage4_batchnorm3_gamma

resnetv17_stage4_batchnorm3_gamma



resnetv17_stage4_batchnorm3_gamma->resnetv17_stage4_batchnorm3_fwd





resnetv17_stage4_batchnorm3_beta

resnetv17_stage4_batchnorm3_beta



resnetv17_stage4_batchnorm3_beta->resnetv17_stage4_batchnorm3_fwd





resnetv17_stage4_batchnorm3_running_mean

resnetv17_stage4_batchnorm3_running_mean



resnetv17_stage4_batchnorm3_running_mean->resnetv17_stage4_batchnorm3_fwd





resnetv17_stage4_batchnorm3_running_var

resnetv17_stage4_batchnorm3_running_var



resnetv17_stage4_batchnorm3_running_var->resnetv17_stage4_batchnorm3_fwd





resnetv17_stage4_batchnorm3_fwd->resnetv17_stage4__plus0





resnetv17_stage4_activation0

resnetv17_stage4_activation0

RELU

[256,2048,7,7]



resnetv17_stage4__plus0->resnetv17_stage4_activation0





resnetv17_stage4_conv4_fwd

resnetv17_stage4_conv4_fwd

CONV

[256,512,7,7]



resnetv17_stage4_activation0->resnetv17_stage4_conv4_fwd





resnetv17_stage4__plus1

resnetv17_stage4__plus1

ADD

[256,2048,7,7]



resnetv17_stage4_activation0->resnetv17_stage4__plus1





resnetv17_stage4_conv4_weight

resnetv17_stage4_conv4_weight



resnetv17_stage4_conv4_weight->resnetv17_stage4_conv4_fwd





resnetv17_stage4_conv4_bias

resnetv17_stage4_conv4_bias



resnetv17_stage4_conv4_bias->resnetv17_stage4_conv4_fwd





resnetv17_stage4_batchnorm4_fwd

resnetv17_stage4_batchnorm4_fwd

BN

[[256,512,7,7],[512],[512],[512],[512]]



resnetv17_stage4_conv4_fwd->resnetv17_stage4_batchnorm4_fwd





resnetv17_stage4_batchnorm4_gamma

resnetv17_stage4_batchnorm4_gamma



resnetv17_stage4_batchnorm4_gamma->resnetv17_stage4_batchnorm4_fwd





resnetv17_stage4_batchnorm4_beta

resnetv17_stage4_batchnorm4_beta



resnetv17_stage4_batchnorm4_beta->resnetv17_stage4_batchnorm4_fwd





resnetv17_stage4_batchnorm4_running_mean

resnetv17_stage4_batchnorm4_running_mean



resnetv17_stage4_batchnorm4_running_mean->resnetv17_stage4_batchnorm4_fwd





resnetv17_stage4_batchnorm4_running_var

resnetv17_stage4_batchnorm4_running_var



resnetv17_stage4_batchnorm4_running_var->resnetv17_stage4_batchnorm4_fwd





resnetv17_stage4_relu2_fwd

resnetv17_stage4_relu2_fwd

RELU

[256,512,7,7]



resnetv17_stage4_batchnorm4_fwd->resnetv17_stage4_relu2_fwd





resnetv17_stage4_conv5_fwd

resnetv17_stage4_conv5_fwd

CONV

[256,512,7,7]



resnetv17_stage4_relu2_fwd->resnetv17_stage4_conv5_fwd





resnetv17_stage4_conv5_weight

resnetv17_stage4_conv5_weight



resnetv17_stage4_conv5_weight->resnetv17_stage4_conv5_fwd





resnetv17_stage4_batchnorm5_fwd

resnetv17_stage4_batchnorm5_fwd

BN

[[256,512,7,7],[512],[512],[512],[512]]



resnetv17_stage4_conv5_fwd->resnetv17_stage4_batchnorm5_fwd





resnetv17_stage4_batchnorm5_gamma

resnetv17_stage4_batchnorm5_gamma



resnetv17_stage4_batchnorm5_gamma->resnetv17_stage4_batchnorm5_fwd





resnetv17_stage4_batchnorm5_beta

resnetv17_stage4_batchnorm5_beta



resnetv17_stage4_batchnorm5_beta->resnetv17_stage4_batchnorm5_fwd





resnetv17_stage4_batchnorm5_running_mean

resnetv17_stage4_batchnorm5_running_mean



resnetv17_stage4_batchnorm5_running_mean->resnetv17_stage4_batchnorm5_fwd





resnetv17_stage4_batchnorm5_running_var

resnetv17_stage4_batchnorm5_running_var



resnetv17_stage4_batchnorm5_running_var->resnetv17_stage4_batchnorm5_fwd





resnetv17_stage4_relu3_fwd

resnetv17_stage4_relu3_fwd

RELU

[256,512,7,7]



resnetv17_stage4_batchnorm5_fwd->resnetv17_stage4_relu3_fwd





resnetv17_stage4_conv6_fwd

resnetv17_stage4_conv6_fwd

CONV

[256,2048,7,7]



resnetv17_stage4_relu3_fwd->resnetv17_stage4_conv6_fwd





resnetv17_stage4_conv6_weight

resnetv17_stage4_conv6_weight



resnetv17_stage4_conv6_weight->resnetv17_stage4_conv6_fwd





resnetv17_stage4_conv6_bias

resnetv17_stage4_conv6_bias



resnetv17_stage4_conv6_bias->resnetv17_stage4_conv6_fwd





resnetv17_stage4_batchnorm6_fwd

resnetv17_stage4_batchnorm6_fwd

BN

[[256,2048,7,7],[2048],[2048],[2048],[2048]]



resnetv17_stage4_conv6_fwd->resnetv17_stage4_batchnorm6_fwd





resnetv17_stage4_batchnorm6_gamma

resnetv17_stage4_batchnorm6_gamma



resnetv17_stage4_batchnorm6_gamma->resnetv17_stage4_batchnorm6_fwd





resnetv17_stage4_batchnorm6_beta

resnetv17_stage4_batchnorm6_beta



resnetv17_stage4_batchnorm6_beta->resnetv17_stage4_batchnorm6_fwd





resnetv17_stage4_batchnorm6_running_mean

resnetv17_stage4_batchnorm6_running_mean



resnetv17_stage4_batchnorm6_running_mean->resnetv17_stage4_batchnorm6_fwd





resnetv17_stage4_batchnorm6_running_var

resnetv17_stage4_batchnorm6_running_var



resnetv17_stage4_batchnorm6_running_var->resnetv17_stage4_batchnorm6_fwd





resnetv17_stage4_batchnorm6_fwd->resnetv17_stage4__plus1





resnetv17_stage4_activation1

resnetv17_stage4_activation1

RELU

[256,2048,7,7]



resnetv17_stage4__plus1->resnetv17_stage4_activation1





resnetv17_stage4_conv7_fwd

resnetv17_stage4_conv7_fwd

CONV

[256,512,7,7]



resnetv17_stage4_activation1->resnetv17_stage4_conv7_fwd





resnetv17_stage4__plus2

resnetv17_stage4__plus2

ADD

[256,2048,7,7]



resnetv17_stage4_activation1->resnetv17_stage4__plus2





resnetv17_stage4_conv7_weight

resnetv17_stage4_conv7_weight



resnetv17_stage4_conv7_weight->resnetv17_stage4_conv7_fwd





resnetv17_stage4_conv7_bias

resnetv17_stage4_conv7_bias



resnetv17_stage4_conv7_bias->resnetv17_stage4_conv7_fwd





resnetv17_stage4_batchnorm7_fwd

resnetv17_stage4_batchnorm7_fwd

BN

[[256,512,7,7],[512],[512],[512],[512]]



resnetv17_stage4_conv7_fwd->resnetv17_stage4_batchnorm7_fwd





resnetv17_stage4_batchnorm7_gamma

resnetv17_stage4_batchnorm7_gamma



resnetv17_stage4_batchnorm7_gamma->resnetv17_stage4_batchnorm7_fwd





resnetv17_stage4_batchnorm7_beta

resnetv17_stage4_batchnorm7_beta



resnetv17_stage4_batchnorm7_beta->resnetv17_stage4_batchnorm7_fwd





resnetv17_stage4_batchnorm7_running_mean

resnetv17_stage4_batchnorm7_running_mean



resnetv17_stage4_batchnorm7_running_mean->resnetv17_stage4_batchnorm7_fwd





resnetv17_stage4_batchnorm7_running_var

resnetv17_stage4_batchnorm7_running_var



resnetv17_stage4_batchnorm7_running_var->resnetv17_stage4_batchnorm7_fwd





resnetv17_stage4_relu4_fwd

resnetv17_stage4_relu4_fwd

RELU

[256,512,7,7]



resnetv17_stage4_batchnorm7_fwd->resnetv17_stage4_relu4_fwd





resnetv17_stage4_conv8_fwd

resnetv17_stage4_conv8_fwd

CONV

[256,512,7,7]



resnetv17_stage4_relu4_fwd->resnetv17_stage4_conv8_fwd





resnetv17_stage4_conv8_weight

resnetv17_stage4_conv8_weight



resnetv17_stage4_conv8_weight->resnetv17_stage4_conv8_fwd





resnetv17_stage4_batchnorm8_fwd

resnetv17_stage4_batchnorm8_fwd

BN

[[256,512,7,7],[512],[512],[512],[512]]



resnetv17_stage4_conv8_fwd->resnetv17_stage4_batchnorm8_fwd





resnetv17_stage4_batchnorm8_gamma

resnetv17_stage4_batchnorm8_gamma



resnetv17_stage4_batchnorm8_gamma->resnetv17_stage4_batchnorm8_fwd





resnetv17_stage4_batchnorm8_beta

resnetv17_stage4_batchnorm8_beta



resnetv17_stage4_batchnorm8_beta->resnetv17_stage4_batchnorm8_fwd





resnetv17_stage4_batchnorm8_running_mean

resnetv17_stage4_batchnorm8_running_mean



resnetv17_stage4_batchnorm8_running_mean->resnetv17_stage4_batchnorm8_fwd





resnetv17_stage4_batchnorm8_running_var

resnetv17_stage4_batchnorm8_running_var



resnetv17_stage4_batchnorm8_running_var->resnetv17_stage4_batchnorm8_fwd





resnetv17_stage4_relu5_fwd

resnetv17_stage4_relu5_fwd

RELU

[256,512,7,7]



resnetv17_stage4_batchnorm8_fwd->resnetv17_stage4_relu5_fwd





resnetv17_stage4_conv9_fwd

resnetv17_stage4_conv9_fwd

CONV

[256,2048,7,7]



resnetv17_stage4_relu5_fwd->resnetv17_stage4_conv9_fwd





resnetv17_stage4_conv9_weight

resnetv17_stage4_conv9_weight



resnetv17_stage4_conv9_weight->resnetv17_stage4_conv9_fwd





resnetv17_stage4_conv9_bias

resnetv17_stage4_conv9_bias



resnetv17_stage4_conv9_bias->resnetv17_stage4_conv9_fwd





resnetv17_stage4_batchnorm9_fwd

resnetv17_stage4_batchnorm9_fwd

BN

[[256,2048,7,7],[2048],[2048],[2048],[2048]]



resnetv17_stage4_conv9_fwd->resnetv17_stage4_batchnorm9_fwd





resnetv17_stage4_batchnorm9_gamma

resnetv17_stage4_batchnorm9_gamma



resnetv17_stage4_batchnorm9_gamma->resnetv17_stage4_batchnorm9_fwd





resnetv17_stage4_batchnorm9_beta

resnetv17_stage4_batchnorm9_beta



resnetv17_stage4_batchnorm9_beta->resnetv17_stage4_batchnorm9_fwd





resnetv17_stage4_batchnorm9_running_mean

resnetv17_stage4_batchnorm9_running_mean



resnetv17_stage4_batchnorm9_running_mean->resnetv17_stage4_batchnorm9_fwd





resnetv17_stage4_batchnorm9_running_var

resnetv17_stage4_batchnorm9_running_var



resnetv17_stage4_batchnorm9_running_var->resnetv17_stage4_batchnorm9_fwd





resnetv17_stage4_batchnorm9_fwd->resnetv17_stage4__plus2





resnetv17_stage4_activation2

resnetv17_stage4_activation2

RELU

[256,2048,7,7]



resnetv17_stage4__plus2->resnetv17_stage4_activation2





resnetv17_pool1_fwd

resnetv17_pool1_fwd

GLBPL

[256,2048,1,1]



resnetv17_stage4_activation2->resnetv17_pool1_fwd





flatten_473

flatten_473

FLT

[256,2048,1,1]



resnetv17_pool1_fwd->flatten_473





resnetv17_dense0_fwd

resnetv17_dense0_fwd

GEMM

[256,1000]



flatten_473->resnetv17_dense0_fwd





resnetv17_dense0_weight

resnetv17_dense0_weight



resnetv17_dense0_weight->resnetv17_dense0_fwd





resnetv17_dense0_bias

resnetv17_dense0_bias



resnetv17_dense0_bias->resnetv17_dense0_fwd




Create Table

A table can be created to show the shapes of all tensors in the graph using

benanza layerstats --model_path //ResNet50-v1

This will create the following table:

Download as CSV