- Fix the setup step (the process has changed now that we're using
  pytest)

- Skip tests that are unstable

- Make better use of build caching
Signed-off-by: Aanand Prasad <aanand.prasad@gmail.com>