OneStopTesting - Quality Testing Jobs, eBooks, Articles, FAQs, Training Institutes, Testing Software, Testing downloads, testing news, testing tools, learn testing, manual testing, automated testing, load runner, winrunner, test director, silk test, STLC

Forum| Contact Us| Testimonials| Sitemap| Employee Referrals| News| Articles| Feedback| Enquiry
Testing Resources
  • Testing Articles
  • Testing Books
  • Testing Certification
  • Testing FAQs
  • Testing Downloads
  • Testing Interview Questions
  • Career In Software Testing
  • Testing Jobs
  • Testing Job Consultants
  • Testing News
  • Testing Training Institutes
  • Introduction
  • Designing Test Cases
  • Developing Test Cases
  • Writing Test Cases
  • Test Case Templates
  • Purpose
  • What Is a Good Test Case?
  • Test Specifications
  • UML
  • Scenario Testing
  • Test Script
  • Test Summary Report
  • Test Data
  • Defect Tracking
    Software testing
  • Testing Forum
  • Introduction
  • Testing Start Process
  • Testing Stop Process
  • Testing Strategy
  • Risk Analysis
  • Software Listings
  • Test Metrics
  • Release Life Cycle
  • Interoperability Testing
  • Extreme Programming
  • Cyclomatic Complexity
  • Equivalence Partitioning
  • Error Guessing
  • Boundary Value Analysis
  • Traceability Matrix
    SDLC Models
  • Introduction
  • Waterfall Model
  • Iterative Model
  • V-Model
  • Spiral Model
  • Big Bang Model
  • RAD Model
  • Prototyping Model
    Software Testing Types
  • Static Testing
  • Dynamic Testing
  • Blackbox Testing
  • Whitebox Testing
  • Unit Testing
  • Requirements Testing
  • Regression Testing
  • Error Handling Testing
  • Manual support Testing
  • Intersystem Testing
  • Control Testing
  • Parallel Testing
  • Volume Testing
  • Stress Testing
  • Performance Testing
  • Agile Testing
  • Localization Testing
  • Globalization Testing
  • Internationalization Testing
    Test Plan
  • Introduction
  • Test Plan Development
  • Test Plan Template
  • Regional Differences
  • Criticism
  • Hardware Development
  • IEEE 829-1998
  • Testing Without a TestPlan
    Code Coverage
  • Introduction
  • Measures
  • Working
  • Statement Coverage
  • Branch Coverage
  • Path Coverage
  • Coverage criteria
  • Code coverage in practice
  • Tools
  • Features
    Quality Management
  • Introduction
  • Components
  • Capability Maturity Model
  • CMMI
  • Six Sigma
    Project Management
  • Introduction
  • PM Activities
  • Project Control Variables
  • PM Methodology
  • PM Phases
  • PM Templates
  • Agile PM
    Automated Testing Tools
  • Quick Test Professional
  • WinRunner
  • LoadRunner
  • Test Director
  • Silk Test
  • Test Partner
  • Rational Robot
    Performance Testing Tools
  • Apache JMeter
  • Rational Performance Tester
  • LoadRunner
  • NeoLoad
  • WAPT
  • WebLOAD
  • Loadster
  • OpenSTA
  • LoadUI
  • Appvance
  • Loadstorm
  • LoadImpact
  • QEngine
  • Httperf
  • CloudTest
  • Perl Testing
  • Python Testing
  • JUnit Testing
  • Unix Shell Scripting
    Automation Framework
  • Introduction
  • Keyword-driven Testing
  • Data-driven Testing
    Configuration Management
  • History
  • What is CM?
  • Meaning of CM
  • Graphically Representation
  • Traditional CM
  • CM Activities
  • Tools
  • What Is Software Testing?
  • Effective Defect Reports
  • Software Security
  • Tracking Defects
  • Bug Report
  • Web Testing
  • Exploratory Testing
  • Good Test Case
  • Write a Test
  • Code Coverage
  • WinRunner vs. QuickTest
  • Web Testing Tools
  • Automated Testing
  • Testing Estimation Process
  • Quality Assurance
  • The Interview Guide
  • Upgrade Path Testing
  • Priority and Severity of Bug
  • Three Questions About Bug
    Home » Testing Articles » Testing - General Articles » Automated vs manual testing

    Automated vs manual testing

    A D V E R T I S E M E N T

    A recent blog post from Sitemorse entitle "Why are sites ranked lower by Sitemorse than Shaw Trust and AbilityNet" addressed the issue of low scores for sites that are tested with their automated compliance checking tool. They explain that the low score their tool gives sites arises from the fact that their tool checks for issues in areas other than pure accessibility (WCAG2.0) compliance – for example valid HTML, Spelling, broken links etc.

    In fact any enterprise checking tool can scan for, and highlight, issues in these other areas (such as code compliance, privacy, and link validation etc). When you include more areas of compliance in your automated scan you are bound to get more issues highlighted than if you restricted your scan to one area alone.

    In addition, in any automated scan you will also get a raft of extra warnings – potential errors that need to be confirmed or rejected by a manual review. When scanning an entire website, comprising thousands of pages, the only way to confirm the status of these warnings (and weed out those that are false) is to do a full manual audit of a representative cross–section of the site and use this information as an indication of the compliance picture site–wide.

    Thus it's no wonder that you see a lower score for a site's overall compliance when you are doing a broad automated scan and taking the results on face value alone.

    To illustrate the need for a manual review to validate the findings of an automated scan we used our enterprise automated compliance checking tool of choice, 'Compliance Sheriff', and ran a scan on the very page where this blog post is to be found ( The scan highlighted 10 definite accessibility errors – 4 in priority level 1, 2 in level 2 and 4 in level 3. However, taking a manual audit approach (and making sure your methodology includes testing using actual assistive technologies) you find that this page is, in practice, not bad at all.

    Whilst automated checking tools, such as Compliance Sheriff, are invaluable for quick site–wide scans that can provide a wealth of information on areas such as accessibility, it is only when such a scan is followed up with a manual review that you can be sure you have the whole picture.

    We'd actually go one step further than this and say that a combined automated and manual auditing process needs to be augmented by disabled end user testing. Our testers, having a range of impairments and assistive technologies, recently tested a site that was strictly AA–compliant (and hence would have had a clean bill of health by any sensible auditing methodology) but almost every tester was unable to complete the majority of the tasks provided. This was because accessibility doesn't guarantee usability – neither for disabled testers nor able–bodied testers alike. There is no real substitute for testing accessibility with actual assistive technologies – preferably wielded by actual end users.

    So when you receive a report from AbilityNet you know the issues therein are the whole story and without superfluity. You have the best that an automated scan can offer, validated by an expert manual review, and augmented by real–life testing by disabled end users. You also get recommended solutions tailored to your content and not simply boilerplate text.

    Phew – what a relief there's such a service out there! Contact us right away and we'll get cracking on your site, intranet or app and together we'll really make things happen.

    More Testing - General Articles
    1 2 3 4 5 6 7 8 9 10 11 Next

    discussionDiscussion Center


    Yahoo Groups
    Y! Group
    Sirfdosti Groups
    Contact Us

    Looking for Software Testing eBooks and Interview Questions? Join now and get it FREE!
    A D V E R T I S E M E N T

    Members Login

    Email ID:

    Forgot Password
    New User
    Testing Interview Questions
  • General Testing
  • Automation Testing
  • Manual Testing
  • Software Development Life Cycle
  • Software Testing Life Cycle
  • Testing Models
  • Automated Testing Tools
  • Silk Test
  • Win Runner
    Testing Highlights

  • Software Testing Ebooks
  • Testing Jobs
  • Testing Frequently Asked Questions
  • Testing News
  • Testing Interview Questions
  • Testing Jobs
  • Testing Companies
  • Testing Job Consultants
  • ISTQB Certification Questions
    Interview Questions

  • WinRunner
  • LoadRunner
  • SilkTest
  • TestDirector
  • General Testing Questions

  • Testing Forum
  • Downloads
  • E-Books
  • Testing Jobs
  • Testing Interview Questions
  • Testing Tools Questions
  • Testing Jobs
  • A-Z Knowledge
    Study ABROAD ?

    Study Abroad

    Vyom Network : Free SMS, GRE, GMAT, MBA | Online Exams | Freshers Jobs | Software Downloads | Programming & Source Codes | Free eBooks | Job Interview Questions | Free Tutorials | Jokes, Songs, Fun | Free Classifieds | Free Recipes | Bangalore Info | GATE Preparation | MBA Preparation | Free SAP Training
    Privacy Policy | Terms and Conditions
    Sitemap | Sitemap (XML)
    Job Interview Questions | Placement Papers | SMS Jokes | C++ Interview Questions | C Interview Questions | Web Hosting
    German | French | Portugese | Italian