You're right. I never thought that about train infrastructure (even though I've seen the new sleepers waiting to be laid down and the piles of discarded ones), but I think about it a lot about roads: it takes such effort to repave them, and they begin to deteriorate immediately.