We'd like to have a test framework and full front-to-back tests that include both the Qt Multimedia API and the backend. The tests should be written in a backend agnostic way so that they can be run on all platforms and backends.

For example, the tests could cover simple use cases like loading a test.mov file and checking that we can read the duration to making sure we get the frames we expect when rendering.

The tests and the test framework could cover both the API only (the same use case as the current mock tests) and the backends.

This approach would be similar to the media-tests in WebKit work: http://gitorious.org/webkit/webkit/trees/master/LayoutTests/media and QImageReader tests in Qt.

The benefits of such tests

• protection against regressions
• testing a new backend for conformance. This is crucial considering that backends are written by different teams
• clients such as WebKit can catch corner-cases that might prevent certain approaches at a low level