Override super step function

[mimoralea]

No description provided.

[QasimWani]

if p.grad is None: continue always returns None.

See issue #11

[QasimWani]

Suggested change

	def step(self, closure=None):
	for group in self.param_groups:
	for p in group['params']:
	if p.grad is None: continue
	self.state[p]['shared_steps'] += 1
	self.state[p]['step'] = self.state[p]['shared_steps'][0] - 1 # a "step += 1" comes later

if p.grad is None: continue always returns None.

Therefore,

self.state[p]['shared_steps'] += 1
self.state[p]['step'] = self.state[p]['shared_steps'][0] - 1

is never executed.
why did u override this then in the first place step()? if you look at pytorch's default implementation, it doesn't seem to conflict with the general A3C model.
In reference to the following issue: #11