The problem is that physics majors aren't the only people who have to take differential equations, you also have chemistry majors, potentially some econ and biology majors, and various engineering majors if you're somewhere with engineering programs.