Were the Avos Punished if They Didn’t Keep the Torah or Was It Fully Voluntary?

From Parshas Derachim by R Yitzchok Gutterman.