scripts/generate_stats.py


Log

Author Commit Date CI Message
Yuly Novikov 00d872d0 2021-03-30T16:08:00 Replace Win x86 dEQP GPU.FYI bot with chromium.angle bot Bug: angleproject:4483 Change-Id: Ibc240cc239f3c769df300b8bd07b0ca6687e943b Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/2795165 Reviewed-by: Yuly Novikov <ynovikov@chromium.org> Commit-Queue: Yuly Novikov <ynovikov@chromium.org>
Yuly Novikov 27e12398 2021-03-12T18:08:48 Remove usages of obsolete Mac bots Bug: angleproject:4483 Change-Id: I9d4d94d42ddab26b40e780ad04479ac470af7a52 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/2757517 Reviewed-by: Yuly Novikov <ynovikov@chromium.org> Reviewed-by: Jonah Ryan-Davis <jonahr@google.com> Commit-Queue: Yuly Novikov <ynovikov@chromium.org>
Yuly Novikov 8b55a3e5 2021-03-03T16:35:53 Replace Win x64 dEQP GPU.FYI bots with chromium.angle bots Bug: angleproject:4483 Change-Id: I6b09f2c97e07eca90c71211e23ddd931637e7dda Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/2733270 Reviewed-by: Jonah Ryan-Davis <jonahr@google.com> Commit-Queue: Yuly Novikov <ynovikov@chromium.org>
Jonah Ryan-Davis 17bc7bcd 2020-05-04T12:05:26 Fix issue with missing step info in generate_stats.py When the script has trouble parsing info for a step, it's supposed to remove that step from the list of steps to not cause further problems with the script (and log an error). Instead, it was being removed while iterating the same list which caused malformed tables. Bug: angleproject:4610 Change-Id: Iff8bfd77eae227907e78660183c79221d4d305a8 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/2180342 Reviewed-by: Shahbaz Youssefi <syoussefi@chromium.org> Commit-Queue: Jonah Ryan-Davis <jonahr@google.com>
Jonah Ryan-Davis 5335faae 2019-10-21T15:46:46 Robust validate_step_info in generate_stats.py If there is a warning during validate_step_info and the step_info is None, the script should not attempt to update that step in the Spreadsheet object. Bug: angleproject:4030 Change-Id: Ib94ba82219745ee4ab36c52e9b1d3a04a76a05d2 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1872569 Reviewed-by: Jamie Madill <jmadill@chromium.org> Commit-Queue: Jamie Madill <jmadill@chromium.org>
Yuly Novikov 74e7a315 2019-08-01T21:49:56 Switch all Win10 GPU.FYI bots and related trybots to 64-bit Splits Windows CQ bots into 32 and 64 bit. Update changed dEQP bot names. Bug: 988833 Change-Id: I4cbb8836ca03b781ccd4c3f6059620bb2c97855e Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1732671 Reviewed-by: Geoff Lang <geofflang@chromium.org> Reviewed-by: Yuly Novikov <ynovikov@chromium.org> Commit-Queue: Yuly Novikov <ynovikov@chromium.org>
Jonah Ryan-Davis dfe141f0 2019-05-28T11:06:40 Addition of dEQP "KHR" test variants to generate_stats Generate_stats should handle new step names and put them on new sheets. Also update the docs to show the KHR tests. Bug: angleproject:3486 Change-Id: I4fef774d98b0e622182686506376f788a7568376 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1632529 Reviewed-by: Jamie Madill <jmadill@chromium.org> Reviewed-by: Shahbaz Youssefi <syoussefi@chromium.org> Commit-Queue: Jonah Ryan-Davis <jonahr@google.com>
Jonah Ryan-Davis cd3011fb 2019-05-13T13:55:25 Fix formatting issue in generate_stats Update to new (public) sheet in chromium account. Fix issue with python newline on concatenated string. Ensure all tables are sorted by date. Bug: angleproject:3435 Change-Id: I5de178409dec1e0dcf1467e4f0fe8cf85ea23c08 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1609939 Reviewed-by: Jamie Madill <jmadill@chromium.org> Commit-Queue: Jonah Ryan-Davis <jonahr@google.com>
Jonah Ryan-Davis 29f4ba7d 2019-05-10T13:12:59 generate_stats filters duplicate neighboring rows. The charts tend to be static for many days in a row, which will now be filtered to be more succinct. Also fixes issue parsing when a message interrupts the formatted *RESULT token. Bug: angleproject:3435 Change-Id: I9ed213844de469c7a8240ee95aab82451888edf1 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1606029 Reviewed-by: Jamie Madill <jmadill@chromium.org> Reviewed-by: Shahbaz Youssefi <syoussefi@chromium.org> Commit-Queue: Jonah Ryan-Davis <jonahr@google.com>
Jonah Ryan-Davis a10b2d07 2019-05-08T10:28:55 Modify 'bb ls' command for generate_stats for more precision. We were using 'bb ls ... -A' which combines '-p' and '-steps', but we only parse information from '-p'. Updates the script to only call what it needs. Also works around current issue with '-A'. Bug: angleproject:3429 Change-Id: I10d412885663feefd300eb135dae70b499fedd7f Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1600334 Reviewed-by: Shahbaz Youssefi <syoussefi@chromium.org> Reviewed-by: Geoff Lang <geofflang@chromium.org> Commit-Queue: Jonah Ryan-Davis <jonahr@google.com>
Jonah Ryan-Davis b62fce15 2019-05-02T14:26:02 Use VPython for dependency management of scripts/generate_stats.py Instead of installing all dependencies manually, the script should run with the dependencies specified by the wheels listed in the VPYTHON section of the header comments. Bug: angleproject:3415 Change-Id: Ie969ada3ec2550ae2a809164b01930e1590d5db1 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1593736 Commit-Queue: Jonah Ryan-Davis <jonahr@google.com> Reviewed-by: Geoff Lang <geofflang@chromium.org>
Jonah Ryan-Davis ed4feb35 2019-04-29T10:06:28 Add generated dEQP charts to the ANGLE doc. Also clean up the comments formatting for generate_stats.py Bug: angleproject:3369 Change-Id: Ifaa26cb898915038cf47e88341db5057b59dd937 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1588315 Commit-Queue: Jonah Ryan-Davis <jonahr@google.com> Reviewed-by: Geoff Lang <geofflang@chromium.org> Reviewed-by: Yuly Novikov <ynovikov@chromium.org>
Jonah Ryan-Davis 1ad7a072 2019-04-26T14:05:25 Clean up unexpected passed/failed test behavior for generate_stats The lists of tests can't be added to the sheets if more than 50,000 lines. Since the goal is to get rid of all unexpected passes/failures, it's reasonable to clip the lists by length. Other formatting changes too. Bug: angleproject:3398 Change-Id: Ice461862fb4266e0ad1280f20de85224fc6d7e97 Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1585612 Reviewed-by: Geoff Lang <geofflang@chromium.org> Reviewed-by: Yuly Novikov <ynovikov@chromium.org> Commit-Queue: Jonah Ryan-Davis <jonahr@google.com>
Jonah Ryan-Davis cddf6416 2019-04-24T14:30:39 Clean up generate_stats.py script Add more explicit comments and change some behavior slightly. Bug: angleproject:3369 Change-Id: I76f9054564e8d33127e8ff8233b317e82e06c7de Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1582760 Reviewed-by: Yuly Novikov <ynovikov@chromium.org> Reviewed-by: Geoff Lang <geofflang@chromium.org> Commit-Queue: Jonah Ryan-Davis <jonahr@google.com>
Jonah Ryan-Davis 3c369d19 2019-04-17T18:13:42 Add Sheets generation to dEQP visualization script. Script will parse the output from bb and format it and append to a Sheet. The sheet ID can be set with the 'spreadsheet' arg, or it defaults to a shared sheet on go/angle-status-generated. The user credentials must be pointed to with the 'auth_path' arg. Bug: angleproject:3369 Change-Id: Iafc9f3f96610f2ea01a9802526282cf5f14e1b2e Reviewed-on: https://chromium-review.googlesource.com/c/angle/angle/+/1572482 Commit-Queue: Jonah Ryan-Davis <jonahr@google.com> Reviewed-by: Geoff Lang <geofflang@chromium.org>