This slows down the release builds and in the worst case scenario
causes a single job failing meaning we need to rerun the entire build.

Problems with tests will have been caught we'll before we start
building release binaries.