After an initial warm-up, each test runs for a fixed period of time. Based on measurements of the browser’s frame rate, MotionMark adjusts the number of elements to draw, and concentrates around a narrow range where the browser starts to fail animating at 60 frames per second (fps). A piecewise linear regression is applied to the data, and the change point is reported as the test's score. The confidence interval is calculated through bootstrapping. MotionMark calculates the geometric mean of all of the tests’ scores to report the single score for the run.
MotionMark can be run on a wide variety of devices. Using the device’s screen dimensions it adjusts the drawing area into one of three sizes:
- Small (568 x 320), targeted at mobile phones
- Medium (900 x 600), targeted at tablets and laptops
- Large (1600 x 800), targeted at desktops
The design of the benchmark is modular. This makes it easy to write new tests and use different controllers, which can assist a developer working on improving the performance of a web engine. For the purpose of a public benchmark, the MotionMark master suite tests a variety of drawing operations using techniques including CSS, SVG, and Canvas:
- Multiply: CSS border radius, transforms, opacity
- Arcs and Fills: Canvas path fills and arcs
- Leaves: CSS-transformed elements, opacity
- Paths: Canvas line, quadratic, and Bezier paths
- Lines: Canvas line segments
- Focus: CSS blur filter, opacity
- Images: Canvas
- Design: HTML text rendering
- Suits: SVG clip paths, gradients and transforms
To achieve consistent results on mobile devices, put the device in landscape orientation. On laptops and desktops, use the default display resolution and make the browser window fullscreen. Make sure that screen automatic display sleep is turned off or set to longer than 8 minutes.
- 1.2: Fix bug, bug, and bug to reduce test variance and sensitivity to individual long frames.
- 1.1.1: Fix bug in the calculation of timestamps used for animation during warm up phase of tests.
- 1.1: Update Multiply test to increase max capacity and expand methods for hiding elements. Update Leaves test to use range of sizes and opacity.
- 1.0: Initial release.