[inference] Kill the ability to override a model's task (#1199)

[inference] Kill the ability to override a model's task (#1199) #3261