Testing of applications that employ fast moving graphics has long caused issues for many involved with automation, for different reasons.
Not going into depth with Image v Object based automation techniques (that is one for another time!), it is however important to say many object based tools are unable to penetrate these formats (Flash, Flex, HTML5, OpenGL etc.) in order to access the underlying objects and properties. Some image based tools also are not able to confidently automate such formats due to the nature of the fast moving screen.
Now however, the goalposts have been moved as T-Plan Robot is not just able to connect with such environments, but also to capture and automate them directly through the graphical user interface (GUI), exactly as they are intended to be used by the target audience.
Verify the game sequence is correct…. Verify the app menu’s are correct… Verify the gameplay is as expected… Verify your game/app across multiple platforms, browsers, devices! All with T-Plan Robot Enterprise.
The key point in being able to correctly test OpenGL, Flash etc. is first having the ability to analyse the fast moving display. Traditionally tools that rely on the ability to access the screen data have used methods such as “VNC” to connect to the test environment. However, VNC often falls way short in its ability to encode, transfer and decode the data fast enough, and therefore often results in the screen being partially displayed, if at all.
By leveraging the advances in technologies we are now able to offer specific connection methods targeted directly for such testing. Both iOS and Android mobile platforms allow the “screen mirroring” of their screen to a desktop computer. Performance of this mirroring protocol is unrivalled due to its very nature – intended for live streaming of video and audio. Utilising this feature allows Robot to access the device screen real-time, while also applying actions through the desktop mouse and keyboard.
Once connected to the test environment, the process with which you automate the application is not any different to the testing of standard applications. You must verify the presence, or not, of something on the screen followed by the delivery of a user action; i.e. Tap, Swipe, click, etc.
Although all of Robot’s standard commands can be applied across all test environments, it does also offer some custom commands specifically designed for mobile testing. Commands such as “Swipe” and “Pinch/Zoom” for example make use of the standard Click/Drag commands, but employ tailored timings to ensure they are applied correctly in each situation.
For some examples of T-Plan Robot automating mobile gaming applications please see the following:
Video: Automating 'Need for Speed' by EA Games
The following code is an example of how the script may look within T-Plan Robot, using it’s proprietary scripting language. This is also a cross-platform script that is valid for both iOS and Android. The code is based on the project from the above video - Automating "Need for Speed" by EA Games.
Video: Automating 'Where's My Water?' by Disney