Megatest

Hex Artifact Content
Login

Artifact 7c075bb80d4a34c40a88c48eebb849dff3c3d265:


0000: 23 20 20 43 6f 70 79 72 69 67 68 74 20 32 30 30  #  Copyright 200
0010: 36 2d 32 30 31 37 2c 20 4d 61 74 74 68 65 77 20  6-2017, Matthew 
0020: 57 65 6c 6c 61 6e 64 2e 0a 23 20 0a 23 20 54 68  Welland..# .# Th
0030: 69 73 20 66 69 6c 65 20 69 73 20 70 61 72 74 20  is file is part 
0040: 6f 66 20 4d 65 67 61 74 65 73 74 2e 0a 23 20 0a  of Megatest..# .
0050: 23 20 20 20 20 20 4d 65 67 61 74 65 73 74 20 69  #     Megatest i
0060: 73 20 66 72 65 65 20 73 6f 66 74 77 61 72 65 3a  s free software:
0070: 20 79 6f 75 20 63 61 6e 20 72 65 64 69 73 74 72   you can redistr
0080: 69 62 75 74 65 20 69 74 20 61 6e 64 2f 6f 72 20  ibute it and/or 
0090: 6d 6f 64 69 66 79 0a 23 20 20 20 20 20 69 74 20  modify.#     it 
00a0: 75 6e 64 65 72 20 74 68 65 20 74 65 72 6d 73 20  under the terms 
00b0: 6f 66 20 74 68 65 20 47 4e 55 20 47 65 6e 65 72  of the GNU Gener
00c0: 61 6c 20 50 75 62 6c 69 63 20 4c 69 63 65 6e 73  al Public Licens
00d0: 65 20 61 73 20 70 75 62 6c 69 73 68 65 64 20 62  e as published b
00e0: 79 0a 23 20 20 20 20 20 74 68 65 20 46 72 65 65  y.#     the Free
00f0: 20 53 6f 66 74 77 61 72 65 20 46 6f 75 6e 64 61   Software Founda
0100: 74 69 6f 6e 2c 20 65 69 74 68 65 72 20 76 65 72  tion, either ver
0110: 73 69 6f 6e 20 33 20 6f 66 20 74 68 65 20 4c 69  sion 3 of the Li
0120: 63 65 6e 73 65 2c 20 6f 72 0a 23 20 20 20 20 20  cense, or.#     
0130: 28 61 74 20 79 6f 75 72 20 6f 70 74 69 6f 6e 29  (at your option)
0140: 20 61 6e 79 20 6c 61 74 65 72 20 76 65 72 73 69   any later versi
0150: 6f 6e 2e 0a 23 20 0a 23 20 20 20 20 20 4d 65 67  on..# .#     Meg
0160: 61 74 65 73 74 20 69 73 20 64 69 73 74 72 69 62  atest is distrib
0170: 75 74 65 64 20 69 6e 20 74 68 65 20 68 6f 70 65  uted in the hope
0180: 20 74 68 61 74 20 69 74 20 77 69 6c 6c 20 62 65   that it will be
0190: 20 75 73 65 66 75 6c 2c 0a 23 20 20 20 20 20 62   useful,.#     b
01a0: 75 74 20 57 49 54 48 4f 55 54 20 41 4e 59 20 57  ut WITHOUT ANY W
01b0: 41 52 52 41 4e 54 59 3b 20 77 69 74 68 6f 75 74  ARRANTY; without
01c0: 20 65 76 65 6e 20 74 68 65 20 69 6d 70 6c 69 65   even the implie
01d0: 64 20 77 61 72 72 61 6e 74 79 20 6f 66 0a 23 20  d warranty of.# 
01e0: 20 20 20 20 4d 45 52 43 48 41 4e 54 41 42 49 4c      MERCHANTABIL
01f0: 49 54 59 20 6f 72 20 46 49 54 4e 45 53 53 20 46  ITY or FITNESS F
0200: 4f 52 20 41 20 50 41 52 54 49 43 55 4c 41 52 20  OR A PARTICULAR 
0210: 50 55 52 50 4f 53 45 2e 20 20 53 65 65 20 74 68  PURPOSE.  See th
0220: 65 0a 23 20 20 20 20 20 47 4e 55 20 47 65 6e 65  e.#     GNU Gene
0230: 72 61 6c 20 50 75 62 6c 69 63 20 4c 69 63 65 6e  ral Public Licen
0240: 73 65 20 66 6f 72 20 6d 6f 72 65 20 64 65 74 61  se for more deta
0250: 69 6c 73 2e 0a 23 20 0a 23 20 20 20 20 20 59 6f  ils..# .#     Yo
0260: 75 20 73 68 6f 75 6c 64 20 68 61 76 65 20 72 65  u should have re
0270: 63 65 69 76 65 64 20 61 20 63 6f 70 79 20 6f 66  ceived a copy of
0280: 20 74 68 65 20 47 4e 55 20 47 65 6e 65 72 61 6c   the GNU General
0290: 20 50 75 62 6c 69 63 20 4c 69 63 65 6e 73 65 0a   Public License.
02a0: 23 20 20 20 20 20 61 6c 6f 6e 67 20 77 69 74 68  #     along with
02b0: 20 4d 65 67 61 74 65 73 74 2e 20 20 49 66 20 6e   Megatest.  If n
02c0: 6f 74 2c 20 73 65 65 20 3c 68 74 74 70 3a 2f 2f  ot, see <http://
02d0: 77 77 77 2e 67 6e 75 2e 6f 72 67 2f 6c 69 63 65  www.gnu.org/lice
02e0: 6e 73 65 73 2f 3e 2e 0a 0a 3d 3d 3d 3d 3d 3d 3d  nses/>...=======
02f0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0300: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0310: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0320: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 4e  ==============.N
0330: 4f 54 45 53 20 66 72 6f 6d 20 6c 6f 6f 6b 69 6e  OTES from lookin
0340: 67 20 61 74 20 62 72 61 6e 63 68 20 76 31 2e 36  g at branch v1.6
0350: 32 2d 72 70 63 0a 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  2-rpc.==========
0360: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0370: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0380: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0390: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a 2a 6c 61  ===========..*la
03a0: 73 74 2d 64 62 2d 61 63 63 65 73 73 2a 20 6f 72  st-db-access* or
03b0: 20 2a 64 62 2d 6c 61 73 74 2d 61 63 63 65 73 73   *db-last-access
03c0: 2a 20 3d 3d 3e 20 77 68 69 63 68 20 69 73 20 69  * ==> which is i
03d0: 74 20 74 6f 20 62 65 3f 0a 73 65 65 6e 20 69 6e  t to be?.seen in
03e0: 20 73 69 6e 67 6c 65 74 65 73 74 3a 20 45 52 52   singletest: ERR
03f0: 4f 52 3a 20 55 6e 72 65 63 6f 67 6e 69 73 65 64  OR: Unrecognised
0400: 20 61 72 67 75 6d 65 6e 74 73 3a 20 3a 66 69 72   arguments: :fir
0410: 73 74 5f 65 72 72 20 54 68 69 73 20 69 73 20 74  st_err This is t
0420: 68 65 20 66 69 72 73 74 20 65 72 72 6f 72 0a 0a  he first error..
0430: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0440: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0450: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0460: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0470: 3d 3d 3d 3d 3d 3d 0a 4e 65 77 20 77 61 79 20 6f  ======.New way o
0480: 66 20 6c 61 75 6e 63 68 69 6e 67 20 6e 65 65 64  f launching need
0490: 65 64 20 74 6f 20 61 63 63 6f 6d 6f 64 61 74 65  ed to accomodate
04a0: 20 64 69 66 66 65 72 65 6e 74 20 74 61 72 67 65   different targe
04b0: 74 20 68 6f 73 74 74 79 70 65 73 0a 66 6f 72 20  t hosttypes.for 
04c0: 69 74 65 6d 73 0a 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  items.==========
04d0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
04e0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
04f0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0500: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a 5b 66  ============..[f
0510: 6c 61 76 6f 72 73 5d 0a 67 65 6e 65 72 61 6c 20  lavors].general 
0520: 73 73 68 20 23 7b 67 65 74 62 65 73 74 68 6f 73  ssh #{getbesthos
0530: 74 20 67 65 6e 65 72 61 6c 7d 0a 6e 62 67 65 6e  t general}.nbgen
0540: 65 72 61 6c 20 6e 62 6a 6f 62 20 72 75 6e 20 4a  eral nbjob run J
0550: 4f 42 43 4f 4d 4d 41 4e 44 20 2d 6c 6f 67 20 24  OBCOMMAND -log $
0560: 4d 54 5f 4c 49 4e 4b 54 52 45 45 2f 24 4d 54 5f  MT_LINKTREE/$MT_
0570: 54 41 52 47 45 54 2f 24 4d 54 5f 52 55 4e 4e 41  TARGET/$MT_RUNNA
0580: 4d 45 2e 24 4d 54 5f 54 45 53 54 4e 41 4d 45 2d  ME.$MT_TESTNAME-
0590: 24 4d 54 5f 49 54 45 4d 5f 50 41 54 48 2e 6c 67  $MT_ITEM_PATH.lg
05a0: 6f 0a 0a 5b 68 6f 73 74 73 5d 0a 67 65 6e 65 72  o..[hosts].gener
05b0: 61 6c 20 63 75 62 69 61 6e 20 78 65 6e 61 0a 0a  al cubian xena..
05c0: 5b 6c 61 75 6e 63 68 65 72 73 5d 0a 65 6e 76 73  [launchers].envs
05d0: 65 74 75 70 20 67 65 6e 65 72 61 6c 0a 78 6f 72  etup general.xor
05e0: 2f 25 2f 6e 20 34 43 31 36 47 0a 25 20 6e 62 67  /%/n 4C16G.% nbg
05f0: 65 6e 65 72 61 6c 0a 0a 5b 6a 6f 62 74 6f 6f 6c  eneral..[jobtool
0600: 73 5d 0a 6c 61 75 6e 63 68 65 72 20 69 6e 74 65  s].launcher inte
0610: 72 6e 61 6c 0a 0a 0a 0a 3d 3d 3d 3d 3d 3d 3d 3d  rnal....========
0620: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0630: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0640: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0650: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 54  ==============.T
0660: 72 79 20 77 72 69 74 69 6e 67 20 74 6f 20 69 6e  ry writing to in
0670: 2d 6d 65 6d 6f 72 79 20 64 62 20 61 6e 64 20 65  -memory db and e
0680: 76 65 72 79 20 32 2d 35 20 73 65 63 6f 6e 64 73  very 2-5 seconds
0690: 20 73 79 6e 63 69 6e 67 20 74 6f 20 6d 65 67 61   syncing to mega
06a0: 74 65 73 74 2e 64 62 0a 3d 3d 3d 3d 3d 3d 3d 3d  test.db.========
06b0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
06c0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
06d0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
06e0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a  ==============..
06f0: 46 69 72 73 74 2c 20 68 6f 77 20 6d 75 63 68 20  First, how much 
0700: 74 69 6d 65 20 77 69 6c 6c 20 69 74 20 74 61 6b  time will it tak
0710: 65 20 74 6f 20 77 72 69 74 65 20 62 61 63 6b 20  e to write back 
0720: 74 68 65 20 63 68 61 6e 67 65 73 3a 0a 0a 31 2e  the changes:..1.
0730: 20 47 65 74 20 74 68 65 20 72 75 6e 20 74 61 62   Get the run tab
0740: 6c 65 0a 0a 28 64 65 66 69 6e 65 20 28 67 65 74  le..(define (get
0750: 2d 61 6c 6c 20 64 62 29 28 6c 65 74 20 28 28 72  -all db)(let ((r
0760: 65 73 20 27 28 29 29 29 28 66 6f 72 2d 65 61 63  es '()))(for-eac
0770: 68 2d 72 6f 77 20 28 6c 61 6d 62 64 61 20 28 61  h-row (lambda (a
0780: 20 2e 20 62 29 28 73 65 74 21 20 72 65 73 20 28   . b)(set! res (
0790: 63 6f 6e 73 20 28 61 70 70 6c 79 20 76 65 63 74  cons (apply vect
07a0: 6f 72 20 61 20 62 29 20 72 65 73 29 29 29 20 64  or a b) res))) d
07b0: 62 20 22 53 45 4c 45 43 54 20 2a 20 46 52 4f 4d  b "SELECT * FROM
07c0: 20 74 65 73 74 73 3b 22 29 20 72 65 73 29 29 0a   tests;") res)).
07d0: 28 64 65 66 69 6e 65 20 74 64 61 74 61 20 28 6c  (define tdata (l
07e0: 65 74 20 28 28 73 74 61 72 74 20 28 63 75 72 72  et ((start (curr
07f0: 65 6e 74 2d 6d 69 6c 6c 69 73 65 63 6f 6e 64 73  ent-milliseconds
0800: 29 29 28 72 65 73 20 28 67 65 74 2d 61 6c 6c 20  ))(res (get-all 
0810: 2a 64 62 2a 29 29 29 28 70 72 69 6e 74 20 28 2d  *db*)))(print (-
0820: 20 28 63 75 72 72 65 6e 74 2d 6d 69 6c 6c 69 73   (current-millis
0830: 65 63 6f 6e 64 73 29 20 73 74 61 72 74 29 29 72  econds) start))r
0840: 65 73 29 29 0a 0a 52 65 73 75 6c 74 20 72 61 6e  es))..Result ran
0850: 67 65 73 20 66 72 6f 6d 20 33 34 6d 73 20 74 6f  ges from 34ms to
0860: 20 38 39 6d 73 20 62 75 74 20 6d 6f 73 74 6c 79   89ms but mostly
0870: 20 61 72 6f 75 6e 64 20 34 30 6d 73 20 66 6f 72   around 40ms for
0880: 20 36 32 33 20 72 65 63 6f 72 64 73 20 6f 6e 20   623 records on 
0890: 6d 6f 6f 73 65 66 73 0a 0a 50 72 6f 6a 65 63 74  moosefs..Project
08a0: 69 6e 67 20 74 6f 20 31 35 30 30 30 20 72 65 63  ing to 15000 rec
08b0: 6f 72 64 73 3a 0a 0a 20 20 53 6c 6f 77 20 20 20  ords:..  Slow   
08c0: 32 20 73 65 63 6f 6e 64 73 20 74 6f 20 72 65 61  2 seconds to rea
08d0: 64 20 61 6c 6c 0a 20 20 4d 65 64 69 61 6e 20 31  d all.  Median 1
08e0: 20 73 65 63 6f 6e 64 20 74 6f 20 72 65 61 64 20   second to read 
08f0: 61 6c 6c 0a 0a 54 68 69 73 20 73 65 65 6d 73 20  all..This seems 
0900: 6c 69 6b 65 20 69 74 20 77 6f 75 6c 64 20 77 6f  like it would wo
0910: 72 6b 20 77 69 74 68 20 61 6e 20 75 70 64 61 74  rk with an updat
0920: 65 20 70 65 72 69 6f 64 20 6f 66 20 32 2d 35 20  e period of 2-5 
0930: 73 65 63 6f 6e 64 73 0a 0a 54 4f 44 4f 0a 2d 2d  seconds..TODO.--
0940: 2d 2d 0a 0a 31 2e 20 6f 70 65 6e 2d 64 62 20 6f  --..1. open-db o
0950: 70 65 6e 73 20 69 6e 2d 6d 65 6d 6f 72 79 20 64  pens in-memory d
0960: 62 20 61 6e 64 20 6d 65 67 61 74 65 73 74 2e 64  b and megatest.d
0970: 62 2c 20 70 75 74 20 68 61 6e 64 6c 65 73 20 69  b, put handles i
0980: 6e 20 2a 6d 65 6d 64 62 2a 20 61 6e 64 20 2a 64  n *memdb* and *d
0990: 62 2a 2c 20 2a 6d 65 6d 64 62 2a 20 69 73 20 3c  b*, *memdb* is <
09a0: 20 72 75 6e 2d 69 64 20 64 62 68 20 3e 0a 32 2e   run-id dbh >.2.
09b0: 20 53 65 72 76 65 72 20 69 73 20 70 61 72 74 20   Server is part 
09c0: 6f 66 20 72 75 6e 74 65 73 74 73 20 0a 20 20 20  of runtests .   
09d0: 61 2e 20 73 65 72 76 65 72 20 73 74 61 72 74 20  a. server start 
09e0: 63 79 63 6c 65 20 2d 20 61 64 61 70 74 20 74 6f  cycle - adapt to
09f0: 20 70 65 72 20 72 75 6e 2d 69 64 0a 20 20 20 20   per run-id.    
0a00: 20 20 69 2e 20 73 74 61 74 65 73 3b 20 73 74 61    i. states; sta
0a10: 72 74 69 6e 67 2c 20 73 74 61 72 74 65 64 2c 20  rting, started, 
0a20: 73 74 6f 70 70 69 6e 67 2c 20 73 74 6f 70 70 65  stopping, stoppe
0a30: 64 0a 20 20 20 62 2e 20 74 75 72 6e 20 6f 66 66  d.   b. turn off
0a40: 20 77 72 69 74 65 20 63 6f 61 6c 65 73 69 6e 67   write coalesing
0a50: 0a 33 2e 20 43 61 6c 6c 73 20 74 6f 20 2d 72 75  .3. Calls to -ru
0a60: 6e 74 65 73 74 73 2c 20 2d 72 65 6d 6f 76 65 2d  ntests, -remove-
0a70: 72 75 6e 73 20 65 74 63 2e 20 0a 20 20 20 61 2e  runs etc. .   a.
0a80: 20 4d 69 67 68 74 20 74 61 6c 6b 20 74 6f 20 72   Might talk to r
0a90: 75 6e 6e 69 6e 67 20 73 65 72 76 65 72 20 69 66  unning server if
0aa0: 20 72 75 6e 20 73 70 65 63 69 66 69 63 0a 20 20   run specific.  
0ab0: 20 62 2e 20 43 61 6e 20 74 61 6c 6b 20 74 6f 20   b. Can talk to 
0ac0: 6d 65 67 61 74 65 73 74 2e 64 62 20 62 75 74 20  megatest.db but 
0ad0: 6e 6f 74 20 61 20 67 65 6e 65 72 61 6c 6c 79 20  not a generally 
0ae0: 67 6f 6f 64 20 69 64 65 61 0a 20 20 20 63 2e 20  good idea.   c. 
0af0: 43 61 6e 20 73 74 61 72 74 20 61 20 72 75 6e 73  Can start a runs
0b00: 65 72 76 65 72 20 0a 34 2e 20 44 61 73 68 62 6f  erver .4. Dashbo
0b10: 61 72 64 20 69 73 20 66 69 6e 65 20 65 78 63 65  ard is fine exce
0b20: 70 74 20 66 6f 72 20 77 72 69 74 65 73 3f 0a 0a  pt for writes?..
0b30: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b40: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b50: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b60: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
0b70: 3d 3d 3d 3d 3d 3d 0a 52 6f 75 74 69 6e 65 73 20  ======.Routines 
0b80: 74 6f 20 63 6f 6e 76 65 72 74 20 66 6f 72 20 72  to convert for r
0b90: 75 6e 73 2e 73 63 6d 0a 0a 63 64 62 3a 72 65 6d  uns.scm..cdb:rem
0ba0: 6f 74 65 2d 72 75 6e 20 64 62 3a 72 65 67 69 73  ote-run db:regis
0bb0: 74 65 72 2d 72 75 6e 0a 0a 63 64 62 3a 64 65 6c  ter-run..cdb:del
0bc0: 65 74 65 2d 74 65 73 74 73 2d 69 6e 2d 73 74 61  ete-tests-in-sta
0bd0: 74 65 20 2a 72 75 6e 72 65 6d 6f 74 65 2a 0a 63  te *runremote*.c
0be0: 64 62 3a 67 65 74 2d 74 65 73 74 2d 69 6e 66 6f  db:get-test-info
0bf0: 2d 62 79 2d 69 64 20 2a 72 75 6e 72 65 6d 6f 74  -by-id *runremot
0c00: 65 2a 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75  e*.cdb:remote-ru
0c10: 6e 20 64 62 3a 64 65 6c 65 74 65 2d 6f 6c 64 2d  n db:delete-old-
0c20: 64 65 6c 65 74 65 64 2d 74 65 73 74 2d 72 65 63  deleted-test-rec
0c30: 6f 72 64 73 0a 63 64 62 3a 72 65 6d 6f 74 65 2d  ords.cdb:remote-
0c40: 72 75 6e 20 64 62 3a 64 65 6c 65 74 65 2d 72 75  run db:delete-ru
0c50: 6e 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e  n.cdb:remote-run
0c60: 20 64 62 3a 64 65 6c 65 74 65 2d 74 65 73 74 2d   db:delete-test-
0c70: 72 65 63 6f 72 64 73 0a 63 64 62 3a 72 65 6d 6f  records.cdb:remo
0c80: 74 65 2d 72 75 6e 20 64 62 3a 64 65 6c 65 74 65  te-run db:delete
0c90: 2d 74 65 73 74 73 2d 66 6f 72 2d 72 75 6e 0a 63  -tests-for-run.c
0ca0: 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 64 62  db:remote-run db
0cb0: 3a 66 69 6e 64 2d 61 6e 64 2d 6d 61 72 6b 2d 69  :find-and-mark-i
0cc0: 6e 63 6f 6d 70 6c 65 74 65 0a 63 64 62 3a 72 65  ncomplete.cdb:re
0cd0: 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 67 65 74 2d  mote-run db:get-
0ce0: 63 6f 75 6e 74 2d 74 65 73 74 73 2d 72 75 6e 6e  count-tests-runn
0cf0: 69 6e 67 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72  ing.cdb:remote-r
0d00: 75 6e 20 64 62 3a 67 65 74 2d 63 6f 75 6e 74 2d  un db:get-count-
0d10: 74 65 73 74 73 2d 72 75 6e 6e 69 6e 67 2d 69 6e  tests-running-in
0d20: 2d 6a 6f 62 67 72 6f 75 70 0a 63 64 62 3a 72 65  -jobgroup.cdb:re
0d30: 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 67 65 74 2d  mote-run db:get-
0d40: 6b 65 79 73 0a 63 64 62 3a 72 65 6d 6f 74 65 2d  keys.cdb:remote-
0d50: 72 75 6e 20 64 62 3a 67 65 74 2d 72 75 6e 2d 69  run db:get-run-i
0d60: 6e 66 6f 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72  nfo.cdb:remote-r
0d70: 75 6e 20 64 62 3a 67 65 74 2d 72 75 6e 2d 6b 65  un db:get-run-ke
0d80: 79 2d 76 61 6c 0a 63 64 62 3a 72 65 6d 6f 74 65  y-val.cdb:remote
0d90: 2d 72 75 6e 20 64 62 3a 67 65 74 2d 72 75 6e 2d  -run db:get-run-
0da0: 6e 61 6d 65 2d 66 72 6f 6d 2d 69 64 0a 63 64 62  name-from-id.cdb
0db0: 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 67  :remote-run db:g
0dc0: 65 74 2d 73 74 65 70 73 2d 66 6f 72 2d 74 65 73  et-steps-for-tes
0dd0: 74 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e  t.cdb:remote-run
0de0: 20 64 62 3a 67 65 74 2d 74 65 73 74 2d 69 64 2d   db:get-test-id-
0df0: 63 61 63 68 65 64 0a 63 64 62 3a 72 65 6d 6f 74  cached.cdb:remot
0e00: 65 2d 72 75 6e 20 64 62 3a 67 65 74 2d 74 65 73  e-run db:get-tes
0e10: 74 73 2d 66 6f 72 2d 72 75 6e 73 2d 6d 69 6e 64  ts-for-runs-mind
0e20: 61 74 61 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72  ata.cdb:remote-r
0e30: 75 6e 20 64 62 3a 6c 6f 63 6b 2f 75 6e 6c 6f 63  un db:lock/unloc
0e40: 6b 2d 72 75 6e 0a 63 64 62 3a 72 65 6d 6f 74 65  k-run.cdb:remote
0e50: 2d 72 75 6e 20 64 62 3a 73 65 74 2d 73 79 6e 63  -run db:set-sync
0e60: 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e 20  .cdb:remote-run 
0e70: 64 62 3a 73 65 74 2d 74 65 73 74 73 2d 73 74 61  db:set-tests-sta
0e80: 74 65 2d 73 74 61 74 75 73 0a 63 64 62 3a 72 65  te-status.cdb:re
0e90: 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 73 65 74 2d  mote-run db:set-
0ea0: 76 61 72 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72  var.cdb:remote-r
0eb0: 75 6e 20 64 62 3a 74 65 73 74 6d 65 74 61 2d 61  un db:testmeta-a
0ec0: 64 64 2d 72 65 63 6f 72 64 0a 63 64 62 3a 72 65  dd-record.cdb:re
0ed0: 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 74 65 73 74  mote-run db:test
0ee0: 6d 65 74 61 2d 67 65 74 2d 72 65 63 6f 72 64 0a  meta-get-record.
0ef0: 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 64  cdb:remote-run d
0f00: 62 3a 74 65 73 74 6d 65 74 61 2d 75 70 64 61 74  b:testmeta-updat
0f10: 65 2d 66 69 65 6c 64 0a 63 64 62 3a 72 65 6d 6f  e-field.cdb:remo
0f20: 74 65 2d 72 75 6e 20 64 62 3a 75 70 64 61 74 65  te-run db:update
0f30: 2d 72 75 6e 2d 65 76 65 6e 74 5f 74 69 6d 65 0a  -run-event_time.
0f40: 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 69  cdb:remote-run i
0f50: 6e 73 74 65 61 64 0a 63 64 62 3a 72 65 6d 6f 74  nstead.cdb:remot
0f60: 65 2d 72 75 6e 20 73 65 72 76 65 72 3a 73 74 61  e-run server:sta
0f70: 72 74 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75  rt.cdb:remote-ru
0f80: 6e 20 74 65 73 74 3a 67 65 74 2d 6d 61 74 63 68  n test:get-match
0f90: 69 6e 67 2d 70 72 65 76 69 6f 75 73 2d 74 65 73  ing-previous-tes
0fa0: 74 2d 72 75 6e 2d 72 65 63 6f 72 64 73 0a 63 64  t-run-records.cd
0fb0: 62 3a 74 65 73 74 73 2d 72 65 67 69 73 74 65 72  b:tests-register
0fc0: 2d 74 65 73 74 20 2a 72 75 6e 72 65 6d 6f 74 65  -test *runremote
0fd0: 2a 0a 28 64 65 66 69 6e 65 20 28 72 75 6e 73 3a  *.(define (runs:
0fe0: 73 68 72 69 6e 6b 2d 63 61 6e 2d 72 75 6e 2d 6d  shrink-can-run-m
0ff0: 6f 72 65 2d 74 65 73 74 73 2d 63 6f 75 6e 74 29  ore-tests-count)
1000: 20 3b 3b 20 74 68 65 20 64 62 20 69 73 20 61 20   ;; the db is a 
1010: 64 75 6d 6d 79 20 76 61 72 20 73 6f 20 77 65 20  dummy var so we 
1020: 63 61 6e 20 75 73 65 20 63 64 62 3a 72 65 6d 6f  can use cdb:remo
1030: 74 65 2d 72 75 6e 0a 0a 3d 3d 3d 3d 3d 3d 3d 3d  te-run..========
1040: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
1050: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
1060: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
1070: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a  ==============..
1080: 5b 38 37 63 62 65 36 38 66 33 31 5d 20 0a 5b 62  [87cbe68f31] .[b
1090: 65 34 30 35 65 38 65 32 65 5d 0a 0a 23 20 46 52  e405e8e2e]..# FR
10a0: 4f 4d 20 61 6e 64 79 6a 70 67 20 6f 6e 20 23 63  OM andyjpg on #c
10b0: 68 69 63 6b 65 6e 0a 0a 28 6c 65 74 20 28 28 6f  hicken..(let ((o
10c0: 72 69 67 69 6e 61 6c 2d 65 78 69 74 20 28 65 78  riginal-exit (ex
10d0: 69 74 2d 68 61 6e 64 6c 65 72 29 29 29 0a 20 20  it-handler))).  
10e0: 28 65 78 69 74 2d 68 61 6e 64 6c 65 72 20 28 6c  (exit-handler (l
10f0: 61 6d 62 64 61 20 28 23 21 6f 70 74 69 6f 6e 61  ambda (#!optiona
1100: 6c 20 28 65 78 69 74 2d 63 6f 64 65 20 30 29 29  l (exit-code 0))
1110: 0a 09 09 20 20 28 70 72 69 6e 74 66 20 22 50 72  ...  (printf "Pr
1120: 65 70 61 72 69 6e 67 20 74 6f 20 65 78 69 74 2e  eparing to exit.
1130: 2e 2e 5c 6e 22 20 65 78 69 74 2d 63 6f 64 65 29  ..\n" exit-code)
1140: 0a 09 09 20 20 28 66 6f 72 2d 65 61 63 68 20 28  ...  (for-each (
1150: 6c 61 6d 62 64 61 20 28 70 69 64 29 0a 09 09 09  lambda (pid)....
1160: 20 20 20 20 20 20 28 70 72 69 6e 74 66 20 22 53        (printf "S
1170: 65 6e 64 69 6e 67 20 73 69 67 6e 61 6c 2f 74 65  ending signal/te
1180: 72 6d 20 74 6f 20 7e 41 5c 6e 22 20 70 69 64 29  rm to ~A\n" pid)
1190: 0a 09 09 09 20 20 20 20 20 20 28 70 72 6f 63 65  ....      (proce
11a0: 73 73 2d 73 69 67 6e 61 6c 20 70 69 64 20 73 69  ss-signal pid si
11b0: 67 6e 61 6c 2f 74 65 72 6d 29 29 20 28 63 68 69  gnal/term)) (chi
11c0: 6c 64 72 65 6e 29 29 0a 09 09 20 20 28 6f 72 69  ldren))...  (ori
11d0: 67 69 6e 61 6c 2d 65 78 69 74 20 65 78 69 74 2d  ginal-exit exit-
11e0: 63 6f 64 65 29 29 29 29 0a 0a 0a 0a 31 2e 20 41  code))))....1. A
11f0: 6c 6c 20 72 75 6e 20 63 6f 6e 74 72 6f 6c 20 61  ll run control a
1200: 63 63 65 73 73 20 74 6f 20 64 62 20 69 73 20 64  ccess to db is d
1210: 69 72 65 63 74 2e 0a 32 2e 20 41 6c 6c 20 74 65  irect..2. All te
1220: 73 74 20 6d 61 63 68 69 6e 65 73 20 6d 75 73 74  st machines must
1230: 20 68 61 76 65 20 6d 65 67 61 74 65 73 74 20 61   have megatest a
1240: 76 61 69 6c 61 62 6c 65 0a 33 2e 20 54 65 73 74  vailable.3. Test
1250: 73 20 6d 61 79 20 6f 72 20 6d 61 79 20 6e 6f 74  s may or may not
1260: 20 68 61 76 65 20 66 69 6c 65 20 73 79 73 74 65   have file syste
1270: 6d 20 61 63 63 65 73 73 20 74 6f 20 74 68 65 20  m access to the 
1280: 6f 72 69 67 69 6e 61 74 69 6e 67 0a 20 20 20 72  originating.   r
1290: 75 6e 20 61 72 65 61 2e 20 72 73 79 6e 63 20 69  un area. rsync i
12a0: 73 20 75 73 65 64 20 74 6f 20 70 75 6c 6c 20 74  s used to pull t
12b0: 68 65 20 74 65 73 74 20 61 72 65 61 20 74 6f 20  he test area to 
12c0: 74 68 65 20 68 6f 6d 65 20 68 6f 73 74 0a 20 20  the home host.  
12d0: 20 69 66 20 61 6e 64 20 6f 6e 6c 79 20 69 66 20   if and only if 
12e0: 74 68 65 20 6f 72 69 67 69 6e 61 74 69 6e 67 20  the originating 
12f0: 61 72 65 61 20 63 61 6e 20 6e 6f 74 20 62 65 20  area can not be 
1300: 73 65 65 6e 20 76 69 61 20 66 69 6c 65 20 0a 20  seen via file . 
1310: 20 20 73 79 73 74 65 6d 2e 20 4e 4f 20 4c 4f 4e    system. NO LON
1320: 47 45 52 20 54 52 55 45 2e 20 52 73 79 6e 63 20  GER TRUE. Rsync 
1330: 69 73 20 75 73 65 64 20 62 75 74 20 66 69 6c 65  is used but file
1340: 20 73 79 73 74 65 6d 20 6d 75 73 74 20 62 65 20   system must be 
1350: 76 69 73 69 62 6c 65 2e 0a 34 2e 20 41 6c 6c 20  visible..4. All 
1360: 64 62 20 61 63 63 65 73 73 20 69 73 20 64 6f 6e  db access is don
1370: 65 20 76 69 61 20 74 68 65 20 68 6f 6d 65 20 68  e via the home h
1380: 6f 73 74 2e 20 4e 4f 54 20 49 4d 50 4c 45 4d 45  ost. NOT IMPLEME
1390: 4e 54 45 44 20 59 45 54 2e 0a 0a 52 45 4d 4f 54  NTED YET...REMOT
13a0: 45 20 41 43 43 45 53 53 20 44 42 20 4c 4f 41 44  E ACCESS DB LOAD
13b0: 53 0a 0a 49 4e 46 4f 3a 20 28 30 29 20 4d 61 78  S..INFO: (0) Max
13c0: 20 63 61 63 68 65 64 20 71 75 65 72 69 65 73 20   cached queries 
13d0: 77 61 73 20 20 20 20 31 30 0a 49 4e 46 4f 3a 20  was    10.INFO: 
13e0: 28 30 29 20 4e 75 6d 62 65 72 20 6f 66 20 63 61  (0) Number of ca
13f0: 63 68 65 64 20 77 72 69 74 65 73 20 20 20 32 37  ched writes   27
1400: 30 34 33 0a 49 4e 46 4f 3a 20 28 30 29 20 41 76  043.INFO: (0) Av
1410: 65 72 61 67 65 20 63 61 63 68 65 64 20 77 72 69  erage cached wri
1420: 74 65 20 74 69 6d 65 20 31 35 2e 30 36 33 34 35  te time 15.06345
1430: 34 34 39 38 33 39 31 35 20 6d 73 0a 49 4e 46 4f  44983915 ms.INFO
1440: 3a 20 28 30 29 20 4e 75 6d 62 65 72 20 6e 6f 6e  : (0) Number non
1450: 2d 63 61 63 68 65 64 20 71 75 65 72 69 65 73 20  -cached queries 
1460: 37 31 39 32 38 0a 49 4e 46 4f 3a 20 28 30 29 20  71928.INFO: (0) 
1470: 41 76 65 72 61 67 65 20 6e 6f 6e 2d 63 61 63 68  Average non-cach
1480: 65 64 20 74 69 6d 65 20 20 20 35 2e 31 35 35 34  ed time   5.1554
1490: 37 34 39 31 39 33 36 33 38 31 20 6d 73 0a 49 4e  7491936381 ms.IN
14a0: 46 4f 3a 20 28 30 29 20 53 65 72 76 65 72 20 73  FO: (0) Server s
14b0: 68 75 74 64 6f 77 6e 20 63 6f 6d 70 6c 65 74 65  hutdown complete
14c0: 2e 20 45 78 69 74 69 6e 67 0a 0a 0a 66 64 6b 74  . Exiting...fdkt
14d0: 65 73 74 71 61 20 6f 6e 20 41 70 72 20 32 39 2c  estqa on Apr 29,
14e0: 20 32 30 31 33 3a 20 31 38 31 32 20 74 65 73 74   2013: 1812 test
14f0: 73 0a 0a 49 4e 46 4f 3a 20 28 30 29 20 4d 61 78  s..INFO: (0) Max
1500: 20 63 61 63 68 65 64 20 71 75 65 72 69 65 73 20   cached queries 
1510: 77 61 73 20 20 20 20 31 30 0a 49 4e 46 4f 3a 20  was    10.INFO: 
1520: 28 30 29 20 4e 75 6d 62 65 72 20 6f 66 20 63 61  (0) Number of ca
1530: 63 68 65 64 20 77 72 69 74 65 73 20 20 20 34 31  ched writes   41
1540: 33 33 35 0a 49 4e 46 4f 3a 20 28 30 29 20 41 76  335.INFO: (0) Av
1550: 65 72 61 67 65 20 63 61 63 68 65 64 20 77 72 69  erage cached wri
1560: 74 65 20 74 69 6d 65 20 32 30 36 2e 30 38 31 35  te time 206.0815
1570: 35 33 31 36 33 31 37 39 20 6d 73 0a 49 4e 46 4f  53163179 ms.INFO
1580: 3a 20 28 30 29 20 4e 75 6d 62 65 72 20 6e 6f 6e  : (0) Number non
1590: 2d 63 61 63 68 65 64 20 71 75 65 72 69 65 73 20  -cached queries 
15a0: 37 34 32 38 39 0a 49 4e 46 4f 3a 20 28 30 29 20  74289.INFO: (0) 
15b0: 41 76 65 72 61 67 65 20 6e 6f 6e 2d 63 61 63 68  Average non-cach
15c0: 65 64 20 74 69 6d 65 20 20 20 31 30 35 35 2e 30  ed time   1055.0
15d0: 39 38 32 36 34 38 38 34 34 34 20 6d 73 0a 49 4e  9826488444 ms.IN
15e0: 46 4f 3a 20 28 30 29 20 53 65 72 76 65 72 20 73  FO: (0) Server s
15f0: 68 75 74 64 6f 77 6e 20 63 6f 6d 70 6c 65 74 65  hutdown complete
1600: 2e 20 45 78 69 74 69 6e 67 0a 0a 53 74 61 72 74  . Exiting..Start
1610: 3a 20 30 20 61 74 20 53 75 6e 20 41 70 72 20 32  : 0 at Sun Apr 2
1620: 38 20 32 32 3a 31 38 3a 32 35 20 4d 53 54 20 32  8 22:18:25 MST 2
1630: 30 31 33 0a 4d 61 78 3a 20 20 35 32 20 61 74 20  013.Max:  52 at 
1640: 53 75 6e 20 41 70 72 20 32 38 20 32 33 3a 30 36  Sun Apr 28 23:06
1650: 3a 35 39 20 4d 53 54 20 32 30 31 33 0a 45 6e 64  :59 MST 2013.End
1660: 3a 20 20 20 36 20 61 74 20 53 75 6e 20 41 70 72  :   6 at Sun Apr
1670: 20 32 38 20 32 33 3a 34 37 3a 35 31 20 4d 53 54   28 23:47:51 MST
1680: 20 32 30 31 33 0a 0a 3d 3d 3d 3d 3d 3d 3d 3d 3d   2013..=========
1690: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
16a0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
16b0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d  ================
16c0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a  ===============.
16d0: 0a 0a                                            ..