Hash :
d775684a
Author :
Date :
2017-12-22T16:06:09
Added Documentation for running dEQP tests Old targets do not accept --deqp-case=<test> As they are written using google test To run individual dEQP test we need to use *_no_gtest targets angle_deqp_egl_no_gtest angle_deqp_gles2_no_gtest angle_deqp_gles31_no_gtest angle_deqp_gles3_no_gtest above targets accept -deqp-case=<test> wildcard Bug: angleproject:1944 Change-Id: I307a60c0cc41c446013bda42ccf0f909000f1ec8 Reviewed-on: https://chromium-review.googlesource.com/842284 Commit-Queue: Jamie Madill <jmadill@chromium.org> Reviewed-by: Jamie Madill <jmadill@chromium.org>
drawElements (dEQP) is a very robust and comprehensive set of open-source tests for GLES2, GLES3+ and EGL. They provide a huge net of coverage for almost every GL API feature. ANGLE by default builds dEQP testing targets for testing against GLES 2, GLES 3, EGL, and GLES 3.1 (on supported platforms).
You should have dEQP as a target if you followed the DevSetup instructions. Current targets:
angle_deqp_gles2_tests for GLES 2.0 tests angle_deqp_gles2_no_gtest for GLES 2.0 tests without google test suite angle_deqp_gles3_tests for GLES 3.0 tests angle_deqp_gles3_no_gtest for GLES 3.0 tests without google test suite angle_deqp_egl_tests for EGL 1.x tests angle_deqp_egl_no_gtest for EGL 1.x tests without google test suite angle_deqp_gles31_tests for GLES 3.1 tests (currently very experimental) angle_deqp_gles31_no_gtest for GLES 3.1 tests (currently very experimental) without google test suite
Note:
To run an individual test, use the --deqp-case flag on any of the no_gtest targets.
It supports simple wildcard support. For example: --deqp-case=dEQP- GLES2.functional.shaders.linkage.*.
The gtest targets support wildcards via the --gtest_filter argument,
but have different test names.
The tests lists are sourced from the Android CTS masters in
third_party/deqp/src/android/cts/master. See gles2-master.txt,
gles3-master.txt, gles31-master.txt and egl-master.txt.
If you’re running a full test suite, it might take very long time. Running in Debug is only useful to isolate and fix particular failures, Release will give a better sense of total passing rate.
By default Windows ANGLE tests with D3D11. To specify the exact platform for ANGLE + dEQP, use the arguments:
--deqp-egl-display-type=angle-d3d11 for D3D11 (highest available feature level) --deqp-egl-display-type=angle-d3d9 for D3D9 --deqp-egl-display-type=angle-d3d11-fl93 for D3D11 Feature level 9_3 --deqp-egl-display-type=angle-gl for OpenGL Desktop (OSX, Linux and Windows) --deqp-egl-display-type=angle-gles for OpenGL ES (Android/ChromeOS, some Windows platforms) --deqp-egl-display-type=angle-vulkan for Vulkan (Android, Linux, Windows)
If run from Visual Studio 2015, dEQP generates a test log to
out/sln/obj/src/tests/TestResults.qpa. To view the test log information, you’ll need to
use the open-source GUI
Cherry. ANGLE
checks out a copy of Cherry to angle/third_party/cherry when you sync with
gclient. Note, if you are using ninja or another build system, the qpa file
will be located in your working directory.
See the official Cherry README for instructions on how to run Cherry on Linux or Windows.
ANGLE also supports the same set of targets built with GoogleTest, for running
on the bots. We don’t currently recommend using these for local debugging, but
we do maintain lists of test expectations in src/tests/deqp_support. When
you fix tests, please remove the suppression(s) from the relevant files!
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69
# ANGLE + dEQP
drawElements (dEQP) is a very robust and comprehensive set of open-source
tests for GLES2, GLES3+ and EGL. They provide a huge net of coverage for
almost every GL API feature. ANGLE by default builds dEQP testing targets for
testing against GLES 2, GLES 3, EGL, and GLES 3.1 (on supported platforms).
## How to build dEQP
You should have dEQP as a target if you followed the [DevSetup](DevSetup.md)
instructions. Current targets:
* `angle_deqp_gles2_tests` for GLES 2.0 tests
* `angle_deqp_gles2_no_gtest` for GLES 2.0 tests without google test suite
* `angle_deqp_gles3_tests` for GLES 3.0 tests
* `angle_deqp_gles3_no_gtest` for GLES 3.0 tests without google test suite
* `angle_deqp_egl_tests` for EGL 1.x tests
* `angle_deqp_egl_no_gtest` for EGL 1.x tests without google test suite
* `angle_deqp_gles31_tests` for GLES 3.1 tests (currently very experimental)
* `angle_deqp_gles31_no_gtest` for GLES 3.1 tests (currently very experimental) without google test suite
## How to use dEQP
Note:
To run an individual test, use the `--deqp-case` flag on any of the `no_gtest` targets.
It supports simple wildcard support. For example: `--deqp-case=dEQP-
GLES2.functional.shaders.linkage.*`.
The `gtest` targets support wildcards via the `--gtest_filter` argument,
but have different test names.
The tests lists are sourced from the Android CTS masters in
`third_party/deqp/src/android/cts/master`. See `gles2-master.txt`,
`gles3-master.txt`, `gles31-master.txt` and `egl-master.txt`.
If you're running a full test suite, it might take very long time. Running in
Debug is only useful to isolate and fix particular failures, Release will give
a better sense of total passing rate.
### Choosing a Renderer on Windows
By default Windows ANGLE tests with D3D11. To specify the exact platform for
ANGLE + dEQP, use the arguments:
* `--deqp-egl-display-type=angle-d3d11` for D3D11 (highest available feature level)
* `--deqp-egl-display-type=angle-d3d9` for D3D9
* `--deqp-egl-display-type=angle-d3d11-fl93` for D3D11 Feature level 9_3
* `--deqp-egl-display-type=angle-gl` for OpenGL Desktop (OSX, Linux and Windows)
* `--deqp-egl-display-type=angle-gles` for OpenGL ES (Android/ChromeOS, some Windows platforms)
* `--deqp-egl-display-type=angle-vulkan` for Vulkan (Android, Linux, Windows)
### Check your results
If run from Visual Studio 2015, dEQP generates a test log to
`out/sln/obj/src/tests/TestResults.qpa`. To view the test log information, you'll need to
use the open-source GUI
[Cherry](https://android.googlesource.com/platform/external/cherry). ANGLE
checks out a copy of Cherry to `angle/third_party/cherry` when you sync with
gclient. Note, if you are using ninja or another build system, the qpa file
will be located in your working directory.
See the [official Cherry README](https://android.googlesource.com/platform/external/cherry/+/master/README)
for instructions on how to run Cherry on Linux or Windows.
### GoogleTest, ANGLE and dEQP
ANGLE also supports the same set of targets built with GoogleTest, for running
on the bots. We don't currently recommend using these for local debugging, but
we do maintain lists of test expectations in `src/tests/deqp_support`. When
you fix tests, please remove the suppression(s) from the relevant files!