Megatest

Artifact [79f25d7e04]
Login

Artifact 79f25d7e046d9027d2ca645751214c1a4cc6d093:

Wiki page [Plans] by matt on 2013-03-06 13:04:27.
D 2013-03-06T20:04:27.511
L Plans
P c75f5bc4934fcc95bb2d85c73438e3c36fcf2097
U matt
W 2726
In no particular order:

Documentation
  *  Convert to asciidoc
  *  Getting going docs, initial setup
  *  Getting going docs, writing tests

Tests and QA
  *  Release procedure (non-automated tests to run, binary releases)
  *  Whitebox unit tests need to be re-enabled
  *  Inter-area tests, referring to tests in external areas
  *  Performance test

Misc
  *  Binary build for release using chicken deploy mechanism
  *  Microsoft windows port (mostly convert system calls to native posix)
    
Megatest
  *  Refactor, some code has gotten a bit crufty
  *  Log free space in /tmp in the database. Tests often use /tmp and this can help debug problems
  *  Record free memory (account for buffers etc.)
  *  Implement ssh method for calling home (eliminates need for network filesystem).

Dashboard
  *  Add filters to tests
  *  Add visual monitoring of cpu, memory, diskspace etc. for tests
  *  Clean up the threads, reduce to one plus the iup gui thread
  *  Scrolling indicators (currently no visual clue that there <b>are/are not</b> more tests

[Implementation changes]


<table border=1 cellspacing=0>
<tr><td>Feature</td><td>Status</td></tr>
<tr><td>rpc "phone home" basic implementation</td><td>90% of the heavy hitting db accesses can now use rpc when available. </td></tr>
<tr><td>rpc "phone home" 98% converted</td><td>ETA: Feb 27</td></tr>
<tr><td>rpc on 64 bit</td><td>Currently fails to work reliably. Test case generation in progress</td></tr>
<tr><td>rpc some writes to db go into queue </td><td>Many writes are not time critical and can be queued up freeing the test processes: ETA Feb 27</td></tr>
<tr><td>rpc server start up at any time</td><td>Works fine. Server can be started after a run is in place</td></tr>
<tr><td>rpc server  shut down at any time</td><td>Not complete. Shutdown clean wrt the db but race condition exists for in flight queries. Fix is easy</td></tr>
<tr><td>rpc server  independent of run(s)</td><td>Untested but all functions ported to use rpc were inspected and none use globals, should be fine</td></tr>
<tr><td>rpc server auto launch</td><td>Not implemented</td></tr>
<tr><td>rpc server 100% with fallback to direct</td><td>Wish list item, ROI is small for those with NFS or similar network fs available.</td></tr>
<tr><td>rpc server support for dashboard</td><td>High priority as this will ameliorate the reader starvation issue, ETA Mar 5.</td></tr>
<tr><td>===============================</td><td></td></tr>
<tr><td>Button to change state globally for a run</td><td>Not implemented, ETA: Feb 27</td></tr>
<tr><td>Auto create linkstree</td><td></td></tr>
<tr><td>Fix -rerun </td><td></td></tr>
<tr><td>.</td><td>
</table>
Z bba79e63a5396b113fffc12ed36c9c87