A user account is required in order to edit this wiki, but we've had to disable public user registrations due to spam.

To request an account, ask an autoconfirmed user on Chat (such as one of these permanent autoconfirmed members).

Testsuite: Difference between revisions

From WHATWG Wiki
Jump to navigation Jump to search
m (Reverted edits by Maria (talk) to last revision by Ms2ger)
(Add some links to W3C WG test suites)
Line 37: Line 37:
* [http://www.w3.org/DOM/Test/ Document Object Model (DOM) Conformance Test Suites]
* [http://www.w3.org/DOM/Test/ Document Object Model (DOM) Conformance Test Suites]
* [http://dev.w3.org/2006/webapi/WindowTestSuite/ Window test suite]
* [http://dev.w3.org/2006/webapi/WindowTestSuite/ Window test suite]
=== W3C ===
* [http://dev.w3.org/geo/api/test-suite/ Geolocation]
* [http://dvcs.w3.org/hg/webapps WebApps WG]
* [http://dvcs.w3.org/hg/html HTML WG]
* [http://hg.csswg.org/test CSS WG]

Revision as of 14:31, 15 November 2011

Existing tests URI: http://dev.w3.org/html5/tests/

Requirements

  • Each test needs a "reviewed" marker of some sort
  • It must be easy to find tests where the spec has changed under them
  • The barrier to contribution must be as low as possible
  • Testcases should have somewhat stable URIs
  • If test can be done using JavaScript preferably require it to be in JavaScript so engines can be more efficiently tested (i.e. automated).
  • It must be easy to review tests
  • Standardize a test format?

Non-requirements

  • There does not need to be a single consistent test harness for the whole of HTML5. (When sections can be tested in isolation, each section should use a test harness that is suited to that section's testing requirements. E.g. there is little value in fitting canvas tests and parser tests into the same framework, and it may add a lot of complexity.)

Format proposal

See http://omocha.w3.org/wiki/newformat for a format proposal that should meet most of these requirements. That format is based on the Mozilla Mochitest format for running JavaScript based client-side tests which can be run automatically.

Existing tests

W3C