Probably a policy that directs funds, every year, to building ships and other critical things. Possibly to state owned construction conglomerates. Essentially what already happens with Boeing, Lockheed etc for military aircraft.
The deeper problem is that, while the war isn't happening, the war products are not critical. It doesn't matter whether they work or are delivered. Even the medium scale wars the US did maintain over the past couple of decades to keep the machine going showed that various areas were just fleecing them for inadequate products or regular grift (like the vanishing Afghan government). Much of the Pacific fleet's maintenance budget was being stolen by one guy named "Fat Leonard". This sort of thing doesn't go away until the war is actually critical rather than something you can escape by turning off the news.