Continuous Cross-browser Screenshots
Trying to check changes on multiple browsers and multiple devices is hard. In the old days shops kept old computers lying around to test against different OS’s and older browsers. A lot of that can be virtualized on your desktop now, but that’s still kind of a pain in the tuchus. And adding in tablets and mobile phones doesn’t make testing any easier. Thankfully, there’s a better way.
Virtualized browsers with BrowserStack
We use a service called BrowserStack for cross browser testing. It’s a little slower and less convenient than running a browser directly on your computer, but for running, say Internet Explorer on a Mac, it’s a lifesaver. This is to say nothing of multi OS and device support. We don’t keep old phones around just to test websites.
We started using live testing, allowing you to directly interact with the website in question through the virtualized browser. But for a lot of QA work what you really just want are screenshots to see how layouts behave in different browsers or different dimensions. That’s where we’ve made use of the screenshot feature, generating screenshots for one URL across numerous browsers at once.
Shooting from the hip
That’s fine and dandy but clicking on screens and filling out forms gets tedious fast. Screenshooter is a little Ruby gem I wrote last year that provides a convenient command line interface to BrowserStack’s screenshot API.
With a local
browsers.yaml file and some credentials in either a user dotfile
or environment variables, you can request screenshots right from your project.
To start, you’ll first want to list the available device, OS, and browser combinations so you can build your selection.
This simply prints out the direct hash of devices (this list continues quite a ways!).
Pick the browsers you want and edit your
browsers.yaml file to specify which
you want. We’ll keep this simple and just check two versions of IE and and iOS device.
The file does need a default URL, but this can be overridden on the command line.
Screenshooter will request the screenshots and then return the URL for the screenshot gallery while BrowserStack generates them.
CI: Robots in the sky
To complete the automation, we have CircleCI kick off the screenshot commands right after deployment. In this example, we have the CI service check a few key pages on the staging site after each deployment. The resulting screenshot URLs are then added to a file in CircleCI’s artifacts folder.
The screenshot URLs text file is now available for review against each build. Additionally in this example, we have the results sent to a HipChat room so that the dev team can grab them more conveniently.
Here’s the deployment snippet of an example
QA’s hard, let’s build websites!
Not only does this save the time and hassle of going to generate the screenshots, it ensures that they are generated for each new deployment. These can be shared with a wider team and the client, and everyone can get back to the business of building websites.
Originally published April 2014