John Resig and team ran into this problem while developing jQuery:
That blog post really defined the problem. We Front End Engineers needed some Continuous Integration love: An automated way of testing our JS libraries across multiple browser environments.
Resig also came up with a solution to the problem, and we’ve recently rolled it out here at Gilt: TestSwarm.
Users (on various browsers) connect to the server and run the test runner. The runner will wait for new suites to come in from a git hook.
The results are recorded for each commit and hopefully everything is green.
Mark Wunsch Gilt Groupe