build: go back to not caching pip

This reverts commit 2b53612e6ae4af875d386e6771c8e8b8325b7a38.
2 files changed