Add tests that check the VM can run, not just build
The current Travis and Appveyor jobs merely test that the VM can build. They should also run the Squeak or Pharo test suite or Newspeak bootstrap depending on flavor. Even just ignore the test results and merely checking the test suite can complete without crashing would be a huge improvement in coverage.
I've looked into making the Newspeak bootstrap process part of corresponding builds.
Unfortunately, [it fails at the moment](https://travis-ci.org/fniephaus/vm/jobs/172226635) for a reason that I don't understand (yet), but I've heard that there is at least one issue with the latest VMs and Newspeak anyway.
Also, the 64bit version of Newspeak [doesn't run](https://travis-ci.org/fniephaus/vm/jobs/172226633) on `macos64x64` because it seems incompatible.
Additionally, we need to find a way to run VMs that use a threaded heartbeat on Linux/Travis...
Thanks for looking into this!
The 32-bit failure is because the bootstrap requires both the 'nsboot' and 'newspeak' repositories as sibling directories. That build is missing the 'newspeak' repository and so missing all Newspeak sources.
The 64-bit failure is because one must use 'build64.sh' instead of 'build32.sh'. Unfortunately, Cog has separate image formats for 32-bit and 64-bit VMs. The two scripts differ in choosing what Squeak 5.1 image to start from.
Ah thanks! The build cloned the Newspeak repository but the directory name was actually different.
I am using `build64bit.sh` but the image header is different (`68019` vs `68021`).
BTW: I have managed to run threaded heartbeat VMs on TravisCI :)
[Check this out](https://travis-ci.org/fniephaus/vm/jobs/172329298) :)
That's it! Also it's nice to learn one can use ulimit to give threaded heartbeat VMs permission without needing to relog.
Ok, so I go [the `macos32x86` build working](https://travis-ci.org/fniephaus/vm/jobs/172886672), but I'm still having problems with the `linux32x86` build and the 64bit builds:
The `linux32x86` build [fails because it can't find `libc.so.6`](https://travis-ci.org/fniephaus/vm/jobs/172886670#L1778), even though [`libc6-i386` is installed](https://travis-ci.org/fniephaus/vm/jobs/172886670#L181).
The 64bit builds fail because the image can't be opened:
>[This interpreter (vers. 68021) cannot read image file (vers. 68019).](https://travis-ci.org/fniephaus/vm/jobs/172886671#L2296)
Any idea what to do to get it working?