Mittwoch, 26. Juli 2017

Pathway Exploratory Testing

Katrina Clokie has a very good section on her blog she calls “pathways”, which are curated link lists and training exercises you can use to get started with certain software testing aspects. Katrina offers these pathways for Security Testing, Mobile Testing and many other topics. You should definitively check them out.

When a colleague asked me to send him an introduction into Exploratory Testing a while ago I created a list of useful blog posts I think are helpful to get started with Exploratory Testing. His answer was something along the lines “oh my, this is a complete pathway”. I think it was not, but it was not that far off from being one.

Therefore I added some more links and thought of some exercises to evolve this into a proper pathway. In the meantime, more people asked me for information about exploratory testing so from now on I can answer with a link and an offer for a joined coffee.

Just as Katrina's pathways, this is a rabbit hole: A lot of the articles below link to other articles, which will forward you to even more sources. I hope this will be a fun ride for you.


STEP 1: What is Exploratory Testing?

The questions often begin with what Exploratory Testing actually is. And perhaps, more importantly, why would you use it in the first place? Sometimes people have some negative bias as if exploratory testing is just toying with the software and can only be an addition to test case based approaches. Sometimes people seemingly have heard great things and now want in on this cool "new" method. Here are a few articles, that describe what Exploratory Testing is and how you can use it in your project:


Exercise: If you are currently not using exploratory testing techniques, but are testing based on test cases, watch your next test execution very carefully: Are you really performing only the specified steps and checking the specified expected results or are you doing more? Are you looking “left and right”? How do you tell people what you saw when you moved away from the script? How do you remember it yourself? Do you take notes that go beyond the test steps of your test cases? Are your cases/steps answering questions about risks?

STEP 2: How do I manage my Exploratory Testing?

Session-Based Test Management is the most popular method to introduce Exploratory Testing in projects. It helps to make Exploratory Testing manageable and reportable, especially towards people outside of the testing team. Michael Bolton used the metaphor of putting the clouds, that are bursts of performed Exploratory Testing, into boxes so you can count those boxes. 

Here are some articles about and experience reports on Session-Based Test Management:
If for whatever reason you cannot make Session-Based Test Management work James Lyndsay provides a lot of other ways to manage your Exploratory Testing:

STEP 3: How do I find test charters?

A topic, that troubles a lot of people starting out with Exploratory Testing and Session-Based Test Management is generating test charters in comparison to generating test cases. Most of them are used to derive test cases from any form of specification document, which verifies that the software works “as specified", which is not necessarily “as intended”. 
But how to create missions for exploration in addition, or instead of, test cases? 

A good idea is to think about the goal you want to achieve with your respective testing mission, Simons examples for different charter types can help you with this. I listed some more models and texts, which can help you in finding test charters:
Exercise: Chose one of the above approaches and write down down three test charters for the software you are currently working on. You can use the charter template provided in the link from STEP 2.

STEP 4: How do I come up with test ideas?

Once you have your testing mission for a session down, the interesting part is having ideas of what to actually test to serve your mission. I have seen testers, who suffered from some form of writer's block when they started their first test sessions. Especially when they were not involved with designing test cases and only executed them in the scripted testing world they knew.

Fortunately, there are a lot of methods and tools out there to help you come up with test ideas. I just listed a few down there, which you will hear or read often when deeper exploring the Exploratory Testing world, or which help me specifically. If you really, really want to go deep into this topic follow the link to Erik Brickarp's text below and be blown away. 
Exercise: Remember the test charters from the last STEP? Now it is time you perform these test sessions. As a first step, you don’t need to test the whole 90 minutes as described in the linked introduction tests, start with 30 minutes if you like to.


STEP 5: I've got to the end of my session. Now what?

After one or more sessions a Debriefing has to take place. I met several people, who skipped on these and asked: "Do I really need that Debriefing?". Short answer: yes. Long answer: Although a lot of people find it tedious to add yet another meeting to their schedule, the Debriefing is still absolutely crucial. It helps to identify new test charters, spread the testing results across teams, identify holes in documentation and processes, improve the overall testing. Regular Debriefings also help the testers to develop their testing skills. All in all, Debriefings belong to the important meetings you really should attend. Here are some helpful links how you can structure a debriefing:
Exercise: A Debriefing is usually a meeting and you should not do it alone and by yourself. I still want to ask you that you take your time and reflect on the test sessions you performed during the last exercise. Write down answers to the following questions: 
What happened during testing? What did you find out? Were there things, you wanted to test but couldn’t and why couldn’t you? What is left to test in maybe another session or did you find interesting new session ideas? What were they? And what were you feeling during the session as a tester or potential user of your software? Was something annoying you or were you positively surprised?


STEP 6: Are there tools, that can help me?

The most obvious tools for an Explorer is that of a classical Explorer: A notebook and a pen to write down what she finds during exploration. Still a lot of people ask about software tools.
There are tools, that help with Session-Based Test Management, for example by aggregating the session metadata in the TASK BREAKDOWN section. Since taking notes is a crucial part during a test session I choose a note-taking tool, Evernote, for my projects. This solution works best for me at the moment, especially with the Mac Client App.

I want to emphasise one tool in particular and that is TestBuddy: TestBuddy is still under development and is being designed specifically for Exploratory Testing and note taking by people, who really love this style of testing. The prototypes I saw look very promising. The link below will bring you to a “waiting list”. Please get in contact with the folks at Qeek, they are eagerly waiting for your feedback and insights. 


STEP 7: How do I document my testing?

In an environment that heavily uses scripted testing and test cases, testers usually document their testing by ticking off the steps of a test case as either "passed" or "failed". A test session in Session-Based Test Management does not work that way instead it reflects much more how a detective, a journalist or scientists take notes during an investigation or experiment. A lot of testers switching to Session-Based Test Management are quite surprised at the amount of writing they have to do during test execution and they struggle in finding the right balance.
My personal belief is that you do not write more documentation than you do when using test cases because those have to be written, too. Test cases tend to be heavily documented, a lot of people just don’t connect this to their test execution since they wrote them weeks before not close to or even during testing as they do with a test session. 
Another thing I want to add is that in test case based approaches testers often don’t correctly document their actual testing, for example by ticking all test steps in a test case because they “kind of did this” although they skipped several steps due to routine. They often don’t write down strange things (not bugs!) outside of the current test case scope and things get lost.

It's important to find a healthy balance when it comes to documenting your sessions. Here is a list of ideas or experience reports and don’t worry: Even experienced testers constantly question the way they take note as the last three links prove.
Exercise: Alan's 10 experiments in the last link are a great way to get started. How about giving it a go?

STEP 8: Will Exploratory Testing pass an audit?

I often hear people writing Exploratory Testing off as a just playing with the software, a non-structured testing approach, that does not survive the scrutiny of an audit. This is not true at all. Testers have been using Exploratory Testing techniques in heavily restricted environments. Here are a few links, which can help you to report your Exploratory Testing beyond a single session and to make it audit-prone:
Exercise: Try to come up with a low tech testing dashboard for your application and discuss it with your team members.

Books & Resources 

In addition to all these blog posts, pdfs or online articles there some books and a series of videos about Exploratory Testing, which I recommend to you:


93 Kommentare:

  1. Der Kommentar wurde von einem Blog-Administrator entfernt.

    AntwortenLöschen
    Antworten
    1. IEEE Final Year projects Project Centers in India are consistently sought after. Final Year Students Projects take a shot at them to improve their aptitudes, while specialists like the enjoyment in interfering with innovation. For experts, it's an alternate ball game through and through. Smaller than expected IEEE Final Year project centers ground for all fragments of CSE & IT engineers hoping to assemble. Final Year Projects for CSE It gives you tips and rules that is progressively critical to consider while choosing any final year project point.

      JavaScript Online Training in India

      JavaScript Training in India

      The Angular Training covers a wide range of topics including Components, Angular Directives, Angular Services, Pipes, security fundamentals, Routing, and Angular programmability. The new Angular TRaining will lay the foundation you need to specialise in Single Page Application developer. Angular Training

      Löschen
  2. Der Kommentar wurde von einem Blog-Administrator entfernt.

    AntwortenLöschen
  3. Hi Marcel!

    Excellent set of resources. I found that there is wrong link for:

    A Key for Test Session Note Taking During Software Testing

    video.

    Here is correct one:


    https://www.youtube.com/watch?v=H0rFIQe4Chs

    AntwortenLöschen
  4. Great post! I am actually getting ready to across this information, is very helpful for me. Lunch in Blaine

    AntwortenLöschen
  5. Thank you for the nice article here. Really nice and keep update to explore more gaming tips and ideas.

    Game Testing Compaies

    Android Game Tester

    Game Automated Testing

    Gameplay Testing

    AntwortenLöschen
  6. Nice post.

    Hi, Great.. Tutorial is just awesome..It is really helpful for a newbie like me.. I am a regular follower of your blog. Really very informative post you shared here. Kindly keep blogging.

    Security testing services

    AntwortenLöschen
  7. Needed to compose one simple thing yet thanks for the suggestions that you are contributed here. Would like to read this blog regularly to get more updates regarding Software Testing Company in India and Software Testing Services

    AntwortenLöschen
  8. Great Article. Kindly share more article on testing.

    Automation Testing Service

    AntwortenLöschen
  9. Migration of data center could become a serious issue due to its risky nature.

    AntwortenLöschen
  10. هوم کا یک مجموعه ارائه دهنده خدمات سلامت از جمله پرستاری، پزشکی و خدمات توانبخشی در منزل و محل شما است. هوم کا کادر مجرب مراقبت و درمانی خود را بسته به نوع درخواست به شما تخصیص می دهد. تنها با یک تماس و یا با چند کلیک می توانید از مشاوره و خدمات هوم کا استفاده کنید.
    پرستار کودک مبتلا به اوتیسم

    AntwortenLöschen
  11. وبسایت موسسه ستاره دانش پارسیان (اپلای استار) مرجع اطلاعات در خصوص تحصیل در آلمان، ویزای دانشجویی آلمان و کمک هزینه تحصیلی آلمان آماده خدمت رسانی و مشاوره به شما علاقه مندان به تحصیل در آلمان می باشد.
    تحصیل در اروپا
    تحصیل کارشناسی در کانادا

    AntwortenLöschen
  12. Good Post with valuable content. Thanks for Sharing. Looking forward to reading more such articles on your blog. Cheers!
    We provide best-in-class software testing services. Our website is www.stigentech.com

    AntwortenLöschen
  13. Thank you so much for this nice information. Hope so many people will get aware of this and useful as well. And please keep update like this.

    Game QA Solutions

    PC Game Testing Services

    AntwortenLöschen
  14. playrep is offer you to play lots of games like - fungame, funrep, playrep etc..

    AntwortenLöschen
  15. I was very interested in the article , it’s quite inspiring I should admit. I like visiting your site since I always come across interesting articles like this one. Keep sharing! Regards. Read more about

    Selenium Training in Chennai | Certification | Online Courses

    selenium training in chennai

    selenium training in chennai

    selenium online training in chennai

    selenium training in bangalore

    selenium training in hyderabad

    selenium training in coimbatore

    selenium online training

    AntwortenLöschen
  16. Awesome, I’m really thankful to you for this amazing blog. Visit Ogen Infosystem for creative website designing and development services in Delhi, India.
    Best Website Designing Company in Delhi

    AntwortenLöschen
  17. software testing company in India
    Thanks for sharing such a nice post about Pathway Exploratory Testing.
    very interesting and informative post.
    please keep sharing.

    AntwortenLöschen
  18. I use to read the blogs on daily bases, but today i found your blog quite interesting and unique, providing the great information and helpful to all. Keep it up and waiting for your latest updates thanks. We offers multiple services in digital marketing, some of our services are:
    Digital marketing Company
    SMM Services
    PPC Services in Delhi
    Website Design & Development Packages
    Web Development Packages
    Web Development Package
    Social Media Management Packages
    Social Media Management Services

    AntwortenLöschen
  19. software testing company in India
    software testing company in Hyderabad
    Nice and amazing blog.
    Thanks for sharing such an amazing blog with us.
    please keep sharing.

    AntwortenLöschen
  20. Thanks for sharing this post and the efforts you have made in writing this. If you have more info about Software testing companies, please share. Good to see such nice articulated post.

    AntwortenLöschen
  21. There are different methods to keep the web applications safe from being harmed. But before implementing the web application penetration testing services, here are some points which every web application penetration testing company in dubai considers

    AntwortenLöschen
  22. I think this is the best article today. Thanks for taking your own time to discuss this topic, I feel happy about that curiosity has increased to learn more about this topic. Keep sharing your information regularly for my future reference.Excellent blog admin. This is what I have looked. Check out the following links for QA services
    Test automation software
    Best automated testing software
    Mobile app testing services

    AntwortenLöschen
  23. I think this is the best article today. Thanks for taking your own time to discuss this topic, I feel happy about that curiosity has increased to learn more about this topic. Keep sharing your information regularly for my future reference.Excellent blog admin. This is what I have looked. Check out the following links for QA services
    Test automation software
    Best automated testing software
    Mobile app testing services

    AntwortenLöschen
  24. Thank you for sharing superb information. I am hoping the same best effort from you in the future as well. This is really a nice and informative, containing all information and also has a great impact on the new technology. Excellent blog admin. This is what I have looked. Check out the following links for Software Testing

    AntwortenLöschen
  25. We are used to the fact that we know only religious and public holidays and celebrate only them.Iamlinkfeeder Iamlinkfeeder Iamlinkfeeder

    AntwortenLöschen
  26. Nice Post.. really helpful to clear my small concepts. thanks :)Keep doing more, waiting to read your next blog security testing services. Visit here for more information about Vulnerability assessment services and penetration testing services.

    AntwortenLöschen


  27. Nice post. I used to be checking constantly this blog and I am impressed! Extremely useful info particularly the ultimate section 🙂 I take care of such information a lot. I was seeking this certain information for a long time. Thank you and best of luck.
    Impact of coronavirus on education in India Essay

    AntwortenLöschen
  28. Your work is very engaging! Amazing piece and is worth reading and sharing. Hoping for more of this kind of work of yours author. Meanwhile. If you are interested and looking for Software testing services Feel free to check and visit our site. Thank you!

    AntwortenLöschen
  29. igrs telangana portal is the all type services provide in telangana state

    AntwortenLöschen
  30. Our manufacturing unit at Sholinganallur, Chennai form here we are supplying all of Coimbatore, Madurai, Trichy, Tirunelveli, and Tamil Nadu as well as all over India. Our branch offices are OMR, Velachery, Anna Nagar

    AntwortenLöschen
  31. https://www.fhwa.dot.gov/reauthorization/reauexit.cfm?link=http%3A%2F%2koladblog.com.ng%2F

    AntwortenLöschen
  32. One of the best articles is this. I am looking for this article for a long time. At last, I found this on your website. Many many thanks for sharing your content.
    Bangla Calendar 2022
    Cool and beautiful stylish name

    AntwortenLöschen

  33. Teacup Poodles are an adorable, friendly and loving dog. Their small size means they can adapt to any environment and they don't teacup poodle for salehave a lot of care needs.hairless cats for sale Ensure that you give them the right amount of food,exercise them every day and play games with them and they will love you forever!
    https://www.poodlespring.com/

    AntwortenLöschen
  34. IT IS NICE TO BE IMPORTANT, BUT IT’S MORE IMPORTANT TO BE NICE.
    Those eyes! This rare Russian hairless breed goes by a few names including Russian Donskoy sphynx kittens for sale, Russian Hairless, Don Sphynx, and Don Hairless. Medium-sized, loyal, loving, affectionate, playful and smart are just a few of the reasons this is a much-loved breed. toy poodle for sale Fun fact: unlike the sphynx which gets its hairlessness from a recessive genetic mutation, gets its hairlessness from a dominant gene. https://www.sphynxcatsale.com/

    AntwortenLöschen
  35. Oppo launch First foldable smartphone .Oppo has teased the company’s first foldable phone.The image of the device is only shown from the spine side and we get a glimpse of the phone’s profile, revealing what appears to be a triple camera setup Article
    Click Here For website

    AntwortenLöschen
  36. Sir apki website par original content diya jata ha muje apke dyra di gyi jankari bhout acchi lagi agar ap moje yh bta ske ki agla airtical kab ayega your very very knowledge full airtical thanks sir:
    short story in hindi motivational

    AntwortenLöschen
  37. Nice post. I was checking constantly this blog and I am impressed! Extremely helpful information specially Self Storage care for such info a lot.
    Self Storage in Long Island City
    Self Storage in Forest Hills

    AntwortenLöschen
  38. Wow admin! An amazing way to help people. You have shared a very useful post I really love it keep going on, thanks for sharing such a wonderful post with us. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    Visit here for mobile app development services.

    AntwortenLöschen
  39. I am very happy when this blog post read because blog post written in good manner and write on good topic. Thanks for sharing valuable information…
    NIFT Coaching Center Delhi
    nift preparation institute in delhi
    NIFT situation test


    AntwortenLöschen
  40. This paragraph presents clear idea designed for the new people of blogging, that truly how to do blogging and site-building.

    바카라사이트
    야한소설
    대딸방
    출장안마
    타이마사지

    AntwortenLöschen
  41. Thank you for sharing this information. I read your blog and I can't stop my self to read your full blog. Again Thanks and Best of luck to your next Blog in future.
    바카라사이트

    AntwortenLöschen
  42. Great job for publishing such a beneficial web site
    카지노사이트

    AntwortenLöschen
  43. This is one of the best website I have seen in a long time thank you so much.
    토토

    AntwortenLöschen
  44. All your hard work is much appreciated. This content data gives truly quality and unique information. I’m definitely going to look into it. Really very beneficial tips are provided here and, Thank you so much. Keep up the good works.
    온라인카지노

    AntwortenLöschen
  45. Big data also helps a digital marketing agency in London tailor the landing page according to the type of customer. They are recommended the products they will most likely be interested in when they open the app or website. The customer journey becomes more convenient and also makes them feel more connected to the business.

    AntwortenLöschen
  46. Avez-vous un problème de spam sur ce blog? Je suis également blogueuse et je voulais connaître votre situation; beaucoup d'entre nous ont mis au point de belles méthodes et nous cherchons à échanger des techniques avec d'autres, n'hésitez pas à me envoyer un courriel si vous êtes intéressés.


    https://www.safecasinosite.net

    AntwortenLöschen
  47. Most valuable and fantastic blog I really appreciate your work which you have done about the electricians,many thanks and keep it up. Very useful info. Hope to see more posts soon! I really like to read this post, it shares lots of information to readers.a

    Graphic Design company in USA

    Label Design

    Box Packaging Design

    Packaging Host

    Die Cut Stickers

    Static Cling

    Lahore Smart City Payment Plan

    Hosting Mart

    Lahore Smart City

    AntwortenLöschen
  48. Aimore Technologies is the best Selenium training institute in Chennai with 6+ years of experience. We are offering online and classroom training.
    Visit Us: Selenium Training in Chennai

    AntwortenLöschen
  49. İnstagram takipçi satın al! İnstagram takipçi sitesi ile takipçi satın al sende sosyal medyada fenomen olmaya bir adım at. Sende hemen instagram takipçi satın almak istiyorsan tıkla:

    1- takipçi satın al

    2- takipçi satın al

    3- takipçi satın al

    AntwortenLöschen
  50. Techvki - Get the Latest and Trending Tech News, Internet Technology News, breaking news, Digital News, Mobile Technology, Tech Brands and more
    TECHVKI

    AntwortenLöschen
  51. This is my first time go to see at here and i am really happy to read everything at single place. 파친코사이트

    AntwortenLöschen
  52. It's really great. Thank you for providing a quality article. There is something you might be interested in. Do you know casino online ? If you have more questions, please come to my site and check it out!

    AntwortenLöschen
  53. Top Notch article, it is particularly valuable! I unobtrusively began in this, and I'm transforming into more familiar close by inside the focal point of it better! Delights, articulation war more and hauling continuing extraordinary! Memory Card Data Recovery Software With Crack

    AntwortenLöschen
  54. May this Independence Day bring unity and prosperity to Pakistan. May the stories of bravery of our heroes be recalled and may we join hands to make our country ...Independence Day Pakistan Quotes

    AntwortenLöschen
  55. This blog is really helpful for the public .easily understand,
    Thanks for published,hoping to see more high quality article like this.
    검증카지노

    AntwortenLöschen
  56. Read Complete Full Stack Developer Course in Chennai from Top Companies? Experience a unique integrated development course in Chennai with Infycle Technologies. They have also added many technical courses with more than 100 classes to create opportunities to join multinational companies with good salaries. For any other questions, please call us at 7504633633 or 7502633633.

    AntwortenLöschen
  57. I really appreciate your valuable efforts and it was very helpful for me. Thank you so much...!
    Spousal Support Calculator
    Spousal Support Virginia

    AntwortenLöschen

  58. Very innovative post! This post is very interesting and thanks for sharing it with us...
    Divorce in Virginia with Child
    Divorce Attorney in Fairfax

    AntwortenLöschen
  59. Awesome information! Likewise fantastic blog here, it is really useful for me. Keep doing...!
    lawyer for bankruptcy near me
    bankruptcy lawyers near me now

    AntwortenLöschen