That is a totally fair argument actually. And they should absolutely consider that. I will actually be surprised if Republicans don't do it first. On the other hand, they will just do whatever they want, leave it in place, and then Ds will follow the rules.
Republicans have already gotten rid of the filibuster for anything they care about (Judicial appointments). They'll do it again if they ever actually needed to pass something they couldn't jam into an omnibus bill and for once "moderate" Democrats couldn't be bullied into caving.