UNDERSTANDING TENSOR SHAPES, LEC - 20, INTRODUCTION TO TENSORS

[Manmath0108]

if torch.Size([1, 3, 3]) means that there is 1 dimension of 3 by 3, then what does torch.Size([1, 1, 3, 3]) or torch.Size([1, 1, 4, 4]) is supposed to mean?

[mwael-labs]

the numbers inside torch.Size just describe the shape of the tensor.

torch.Size([1, 3, 3]) → a batch of 1 matrix with shape 3 * 3.

torch.Size([1, 1, 3, 3]) → a batch of 1 image, with 1 channel (grayscale), and spatial size 3 * 3.

torch.Size([1, 1, 4, 4]) → same idea, but the image is 4 * 4 instead of 3 * 3.