Details
-
Task
-
Resolution: Done
-
P2: Important
-
None
-
None
Description
Performance results for symbian devices produced by Tieto should be uploaded to the current BM database. (Note: Uploading to the old database should have ceased by now.)
These are some new considerations:
- To increase statistical confidence, each benchmark should be executed multiple times (preferably 5, but 3 could also do) for any given host/platform/branch/SHA-1 combination.
- The sequence of SHA-1s to be tested should be a subsequence of the SHA-1s tested by our own test runner script (currently testing Linux, Windows, and Mac). This is to enable proper cross-platform comparison (a feature to be implemented soon).