Basic Test Results

Running a test produces a result and displays it in the Test Results window. Some test results are common to every test type. Other results occur only for specific test types, or have specific meanings depending on the type of test that produced them.

Running tests also produces more in-depth results than the simple ones listed here. For more information, see Test Results Reported.

Test Results

These are the test results produced by the test types that are available in Team Edition for Testers:

  • Aborted. The tester stopped the test run. The test that was running at the time obtains the Aborted status. The rest of the tests in the test run obtain the status of Not Executed.

  • Not Executed. The tester stopped the test run. The test that was running at the time obtains the Aborted status. The rest of the tests in the test run obtain the status of Not Executed.

  • PassedButRunAborted. The individual test ran and passed. After the execution of that test completed, the tester stopped the test run.

  • NotRunnable. The test could not be run because of errors in the test definition. For example, a unit test is NotRunnable if it returns an integer; unit test methods must return void.

  • Disconnected. This is a remote run that you disconnect and then later connect. It reports this outcome when the remote run is disconnected. When the tester connects to that remote run, the tester can see the outcome of the tests.

  • Timeout. The test or the test run timed out.

  • Pending. The test run has started and is in progress, but execution of the individual test has not completed.

  • In Progress. The test is currently running.

  • Completed. The test run has completed; this result applies only to load tests.

  • Inconclusive. When the test ran, no Assert statement produced a Failed result, but at least one Assert.Inconclusive statement was satisfied. This result applies only to unit tests.

  • Failed. The exact meaning depends on the test type:

Test Type

Meaning

unit

When the test ran, at least one Assert statement produced a result of Failed, or the test threw an unexpected exception.

generic

The test returned a value other than 0.

manual

The tester set the result to Fail.

Web

At least one of the requests was unsuccessful.

load

At least one of the contained tests failed.

ordered

At least one of the contained tests failed.

  • Passed. The exact meaning depends on the test type:

Test Type

Meaning

unit

When the test ran, no Assert statements produced a result of Inconclusive or Failed, and the test did not throw an unexpected exception, and the test did not time out.

generic

The test returned a value of 0, and the test did not time out.

manual

The tester set the result to Pass, and the test run that contains this test did not time out.

Web

All the requests were successful, and the test did not time out.

load

All the contained tests passed.

ordered

All the contained tests passed, and the test did not time out.

See Also

Tasks

How to: Adjust Test Results Views

Concepts

Test Results Reported
Using the Assert Classes

Other Resources

Saving and Publishing Test Results