No gradient through the cnn encoder

[FaisalAhmed0]

In CIC code the observations are encoded inside torch.no_grad which means that there is no gradient calculation for the CNN, which means that the CNN weights will not be updated during pre-training.

cic/agent/cic.py

Line 216 in b523c38

obs = self.aug_and_encode(obs)