Trust but verify. Our road to robust multimedia and graphics stack verification (aka Multimedia testing on the budget for everyone)

As digital appliances become more sophisticated, quality of multimedia content presented to the user can be affected by problems nearly anywhere along the stack from transmission to presentation. What is worse, the problems might surface only in exotic multi-device setups, specific network conditions or user interaction patterns.

In this talk we will go into details of our black box verification approach based on GStreamer. How do we achieve robust and mostly setup independent regression testing. What types of defects can be addressed and how are user interaction patterns modelled. Finally we will talk about our plans for future improvements, Q&A session and hopefully some discussion on other available solutions or ways to improve presented one.

Michał Budzyński and Marcin Kidzinski are multimedia Engineers at Samsung R&D Institute Poland.