DevOps-QA era has been started!

So our traditional automation test model will be deprecated soon.

In our 1st gen of test automation efforts started as an “n-release” and Objective of Test automation to created Test data and reduced the manual effort for Regression testing, and Smoke testing. The automation script has been executed in the independent test environment and mostly commercial testing tools were recommended and used for script development.

Like Winrunner/QTP/UFT, IBM Rational, SilkTest and more …

Following challenges in the traditional test automation model. 

  • Manual test cases are automated and 20% to 35% functionality were covered through automation script and most of the time test automation is a kind of checking not an actual testing,
  • If the test scripts were failed, automation tester will check with the manual tester and revalidate that functionality again.
  • No matter how much we have been tested through automated script, there’s always functionality needs to be tested through the manual tester.
  • Automation tester always depends on manual tester inputs. such as test cases, test data and defect retesting. Automation tester does not have a domain knowledge since they are involved in the later stage in the SDLC.
  • Quality measured by Manual testing and around 70+% of test cases were executed by the manual tester in the each release and more rework/duplicate on both sides.
  • In the traditional testing model following defect(s) taking more time to investigate, such as Environment issue, Interface, Program /functional defects, most of the time defect(s) are fixed in the separate branch to branch and development and testing efforts are higher.

My analysis 60+% of defects are opened during the manual testing. In automation standpoint, mostly functional defects are identified and program defect(s) raised in the later stage and fixed.

Having a strong domain knowledge is an added advantage for manual testing. However, our market expectation has changed to tools and technology. In our testing market, open source tools are available and  Zero Cost and start-up companies promote their software testing tools with reasonable cost.

In current trends of testing, the Testing team has moved to DevOps-QA Model, “DevOps QA nothing but continues Integration testing”. The maximum no of test cases are executed on multiple time in the shared environment, So 50% to 60% of test cases can be covered on UI Automation and API level testing in the short span of time or within the sprint level. Cross browser testing in the multiple platforms and parallel executions are more effective way to test the functionality and identify the bugs as much early.

Continues Integration testing approach is a mindset, CI Tools major player for current automation, my favorite tool Jenkins is an extensible continuous integration tool, DevOps engineers(Dev and Automation Tester) have an easier time integrating changes to projects and have access to outputs to easily notice when something goes failed. The entire code base is integrated build and automated and tested constantly, the potential bugs are caught earlier in the life cycle which test results are transparency in the better quality and quick delivery to market.

Jenkins’ Key Features:

  • Distributed builds & Notification.
  • Integration with third party plugins.
  • JUnit/TestNG supports and reporting.
  • Scheduled and easy tracking.
  • Customized Dashboards.
  • Support version control.
  • Cross browser Test reports and more . . .

DevOps-QA effort will vary based on Industries and reason behind was business, domain, legacy application, Project timeline, budget, resources skills, infrastructure and more…

Following factors are more important for DevOps-QA ( Continues Integration testing).

  • Tester First: Don’t fill the headcount. Find the right people or Provide the training.   The tester must participate the project discussion from day 1. this will help to understand the domain and testing have to happen in parallel mode.
  • Technology: Complex web, mobile web, and mobile Native or hybrid applications is a right choice to start DevOps-QA (CI-Testing). if your company/business does not support the open source tools, choose the commercial tool(s) as per the company process.
  • Test Infrastructure: This includes the organization’s policies, procedures, culture, test processes, testing tools and resources and most of the time it was compromised by test leaders due to cost and project timeline.
  • Test data and test cases availability: Test Automation depends on Test data and detailed level test cases In test automation 30% of efforts has been depending on Test data identifications and creations and extensive test data is an entry point for test automation.
  • Process: This is a culture change, continues improvement and learning. A series of process steps taken in order to achieve the customer demands. it’s all about a quick and effective way to market

Benefits of DevOps-QA (Continues Integration testing).

  • CI-Test Automation becomes a critical part of business in the rapid changes in software.
  • More test automation coverage and find the bug as much early.
  • Reduce the manual effort both development and testing area
  • increase the productivity and more robust model.
  • Save the development effort and testing cost, High quality, and products always deliver on time.
  • Meet our market demands and get the feedback.

22 thoughts on “DevOps-QA era has been started!

  1. Fantastic site you have here but I was curious about if you knew of any
    forums that cover the same topics talked about in this article?
    I’d really love to be a part of online community where I
    can get comments from other experienced people that share the
    same interest. If you have any recommendations, please let me know.
    Many thanks!

  2. It’s perfect time to make some plans for the
    future and it is time to be happy. I have read this post and if I could I
    want to suggest you some interesting things or advice.

    Maybe you can write next articles referring to this article.
    I want to read even more things about it!

  3. Hi, I do think this is an excellent web site.
    I stumbledupon it 😉 I am going to revisit once again since i have saved as a favorite it.
    Money and freedom is the greatest way to change, may you be rich
    and continue to guide other people.

  4. Simply wish to say your article is as astounding. The clearness
    on your publish is just spectacular and that i could suppose
    you’re a professional on this subject. Fine along
    with your permission let me to snatch your feed to stay updated with
    drawing close post. Thanks a million and please keep up the enjoyable work.

  5. Hello, for all time i used to check webpage posts here early in the morning,
    for the reason that i love to learn more and more.

  6. Hello! I’m at work browsing your blog from my
    new iphone 3gs! Just wanted to say I love reading your blog and look forward to all your posts!
    Keep up the superb work!

  7. Howdy I am so grateful I found your weblog, I really found you by accident, while I was searching on Digg for something else, Regardless I am here now and
    would just like to say many thanks for a
    tremendous post and a all round exciting blog (I also love the theme/design), I don’t
    have time to browse it all at the moment but
    I have saved it and also included your RSS feeds, so when I have
    time I will be back to read much more, Please do keep up the superb jo.

  8. Hey there just wanted to give you a quick heads up. The words in your content seem to be
    running off the screen in Firefox. I’m not sure if this is
    a format issue or something to do with web browser compatibility but I figured I’d post
    to let you know. The layout look great though! Hope you get the issue fixed soon. Thanks

  9. Thanks for your personal marvelous posting! I really enjoyed reading
    it, you’re a great author.I will make sure to bookmark your blog and will come back down the road.
    I want to encourage yourself to continue your great posts, have a nice day!

  10. Hello to every body, it’s my first pay a quick visit of
    this webpage; this weblog carries amazing and in fact fine information in favor of

  11. Hey I know this is off topic but I was wondering if you knew of any widgets I could add to
    my blog that automatically tweet my newest twitter updates.

    I’ve been looking for a plug-in like this for quite some time and
    was hoping maybe you would have some experience with something like this.
    Please let me know if you run into anything. I truly enjoy reading your blog
    and I look forward to your new updates.

  12. Hello there! This post could not be written any better!
    Looking through this post reminds me of my previous roommate!
    He constantly kept preaching about this. I will forward this article to
    him. Fairly certain he’ll have a good read. Many thanks for sharing!

  13. A person essentially lend a hand to make severely articles I
    would state. That is the first time I frequented
    your web page and up to now? I surprised with the
    research you made to make this actual put up extraordinary.
    Excellent activity!

Leave a Reply

Your email address will not be published.