Edge Model Not converging

I am raising the question which has been raised multiple times before but I could into find a solution

I tried to train edge model but it not converging however the inpainting model training works.

I would appreciate if anyone can guide me to any other code to generate canny edges for masked regions similar to whats described in in this code
Thank You 