Testsuite

2010-07-19T06:32:41Z

Maria:

Existing tests URI: http://dev.w3.org/html5/tests/

== Requirements ==

* [http://www.superiorpapers.com/ custom research paper]
* Each test needs a "reviewed" marker of some sort
* It must be easy to find tests where the spec has changed under them
* The barrier to contribution must be as low as possible
* Testcases should have somewhat stable URIs
* If test can be done using JavaScript preferably require it to be in JavaScript so engines can be more efficiently tested (i.e. automated).
* It must be easy to review tests
* Standardize a test format?

== Non-requirements ==

* There does not need to be a single consistent test harness for the whole of HTML5. (When sections can be tested in isolation, each section should use a test harness that is suited to that section's testing requirements. E.g. there is little value in fitting canvas tests and parser tests into the same framework, and it may add a lot of complexity.)

== Format proposal ==

See http://omocha.w3.org/wiki/newformat for a format proposal that should meet most of these requirements. That format is based on the Mozilla Mochitest format for running JavaScript based client-side tests which can be run automatically.

== Existing tests ==
* [[Test cases]]
* [http://www.whatwg.org/html5 The specification] has links to test in the status boxes.
* [http://samples.msdn.microsoft.com/ietestcenter/ IE's tests]
* [http://tc.labs.opera.com/html/ Opera's tests]
* [http://trac.webkit.org/browser/trunk/LayoutTests (Some of?) WebKit's tests]
* [http://mxr.mozilla.org/mozilla-central/find?string=test_.*%28html|svg%29%24&tree=mozilla-central&hint= Some of Mozilla's mochitests]
** [[Testsuite/Mozilla]]
* [http://mxr.mozilla.org/mozilla-central/find?string=reftest.list Some of Mozilla's reftests]
* [http://philip.html5.org/tests/canvas/suite/tests/ Philip's canvas tests]
* [http://hixie.ch/tests/adhoc/html/ Hixie's ad-hoc tests]
* [http://lachy.id.au/dev/markup/tests/html5/ Lachlan's tests]
* [http://hg.gsnedders.com/php-html-5-direct/file/tip/tests/numbersTest gsnedders' number parsing tests]
* [http://simon.html5.org/test/html/ zcorpan's tests]
* [http://code.google.com/p/html5lib/source/browse/testdata html5lib tests]
* [http://hsivonen.iki.fi/test/moz/video-selection/ hsivonen's video tests]
* [http://www.w3.org/DOM/Test/ Document Object Model (DOM) Conformance Test Suites]
* [http://dev.w3.org/2006/webapi/WindowTestSuite/ Window test suite]

WHATWG Wiki - User contributions [en]

Testsuite