What Is a Test Automation Framework?
January 25, 2019
We will discuss what the test automation frameworks are, how they help us, what are the different types and so on. In the first article of these mini-series, I will try to define what exactly is a test automation framework.
ApplicationThe first conclusion we can make after this definition is that our automated tests are applications. So, as I continuously state in my articles, the people working on these types of tests should be good programmers following the best coding practices in mind. Whoever tells you that you can create “good” test automation without this is just lying to you. Sorry, the unicorns don’t exist neither does the magical “codeless” / AI test automation tools.
DefinitionAPI or application programming interface is a set of functions and procedures that allow the creation of applications which access the features or data of an operating system, application, or other service. A good API makes it easier to develop a computer program by providing all the building blocks, which are then put together by the programmer.
DefinitionA software library (or just library) generally consists of pre-written code, classes, procedures, scripts, configuration data and more. All of the available functions within a software library can just be called/used within the program body without defining them explicitly.
Inversion of ControlIn a framework, unlike in libraries or normal user applications, the overall program’s flow of control is not dictated by the caller, but by the framework.
Default BehaviorA framework has a default behavior. This default behavior must actually be some useful behavior and not a series of no-ops.
ExtensibilityA framework can be extended by the user usually by selective overriding or specialized by user code providing specific functionality.
Non-modifiable Framework CodeThe framework code, in general, is not allowed to be modified. Users can extend the framework, but not modify its code.
Software frameworks have these distinguishing features that separate them from libraries:
DefinitionA sub-type of frameworks providing generic code for testing different aspects of our applications- UI, API, security, performance and many other.
Unit Testing FrameworkDoing tests and regression testing completely manually, repeating the same actions again and again like a monkey, is error prone and time consuming, and people seem to hate doing that as much as anything can be hated in software development. These problems are alleviated by tooling. Unit testing frameworks help developers write tests more quickly with a set of known APIs, execute those tests automatically, and review the results of those tests easily. Unit tests are written as code, using libraries from the unit testing framework. Then the tests are run from a separate unit testing tool or inside the IDE, and the results are reviewed.
ToolMany people refer to Selenium WebDriver as a test automation framework but cannot be more wrong. Here is the official definition on their website. So, Selenium WebDriver is mostly known as the standard for web automation testing but is actually a tool for controlling browsers that we later use in our software libraries and frameworks to write automated tests.
Library and API
An API is usually related to a software library. The API describes and prescribes the expected behavior (a specification) while the library is an actual implementation of this set of rules. A single API can have multiple implementations (or none, being abstract) in the form of different libraries that share the same programming interface. For example, because C# and VB.NET compile to compatible MSIL, .NET developers can take advantage of any .NET API. Scala and Java compile to compatible bytecode, Scala developers can take advantage of any Java API.
Framework and API
A framework can be based on several libraries implementing several APIs, but unlike the normal use of an API, the access to the behavior built into the framework is mediated by extending its content with new classes plugged into the framework itself. Moreover, the overall program flow of control can be out of the control of the caller and in the hands of the framework by inversion of control or a similar mechanism.
Test Automation FrameworkAll things that we said about software frameworks are valid for test automation frameworks as well.
In the next articles of these mini-series, we will talk about different types of test automation frameworks, what are the benefits of having one, what is the cost of building one yourself.