Artifact
0b75f67e744e214b1aa40123cb54154da780bd38:
0000: 23 20 20 43 6f 70 79 72 69 67 68 74 20 32 30 30 # Copyright 200
0010: 36 2d 32 30 31 37 2c 20 4d 61 74 74 68 65 77 20 6-2017, Matthew
0020: 57 65 6c 6c 61 6e 64 2e 0a 23 20 0a 23 20 54 68 Welland..# .# Th
0030: 69 73 20 66 69 6c 65 20 69 73 20 70 61 72 74 20 is file is part
0040: 6f 66 20 4d 65 67 61 74 65 73 74 2e 0a 23 20 0a of Megatest..# .
0050: 23 20 20 20 20 20 4d 65 67 61 74 65 73 74 20 69 # Megatest i
0060: 73 20 66 72 65 65 20 73 6f 66 74 77 61 72 65 3a s free software:
0070: 20 79 6f 75 20 63 61 6e 20 72 65 64 69 73 74 72 you can redistr
0080: 69 62 75 74 65 20 69 74 20 61 6e 64 2f 6f 72 20 ibute it and/or
0090: 6d 6f 64 69 66 79 0a 23 20 20 20 20 20 69 74 20 modify.# it
00a0: 75 6e 64 65 72 20 74 68 65 20 74 65 72 6d 73 20 under the terms
00b0: 6f 66 20 74 68 65 20 47 4e 55 20 47 65 6e 65 72 of the GNU Gener
00c0: 61 6c 20 50 75 62 6c 69 63 20 4c 69 63 65 6e 73 al Public Licens
00d0: 65 20 61 73 20 70 75 62 6c 69 73 68 65 64 20 62 e as published b
00e0: 79 0a 23 20 20 20 20 20 74 68 65 20 46 72 65 65 y.# the Free
00f0: 20 53 6f 66 74 77 61 72 65 20 46 6f 75 6e 64 61 Software Founda
0100: 74 69 6f 6e 2c 20 65 69 74 68 65 72 20 76 65 72 tion, either ver
0110: 73 69 6f 6e 20 33 20 6f 66 20 74 68 65 20 4c 69 sion 3 of the Li
0120: 63 65 6e 73 65 2c 20 6f 72 0a 23 20 20 20 20 20 cense, or.#
0130: 28 61 74 20 79 6f 75 72 20 6f 70 74 69 6f 6e 29 (at your option)
0140: 20 61 6e 79 20 6c 61 74 65 72 20 76 65 72 73 69 any later versi
0150: 6f 6e 2e 0a 23 20 0a 23 20 20 20 20 20 4d 65 67 on..# .# Meg
0160: 61 74 65 73 74 20 69 73 20 64 69 73 74 72 69 62 atest is distrib
0170: 75 74 65 64 20 69 6e 20 74 68 65 20 68 6f 70 65 uted in the hope
0180: 20 74 68 61 74 20 69 74 20 77 69 6c 6c 20 62 65 that it will be
0190: 20 75 73 65 66 75 6c 2c 0a 23 20 20 20 20 20 62 useful,.# b
01a0: 75 74 20 57 49 54 48 4f 55 54 20 41 4e 59 20 57 ut WITHOUT ANY W
01b0: 41 52 52 41 4e 54 59 3b 20 77 69 74 68 6f 75 74 ARRANTY; without
01c0: 20 65 76 65 6e 20 74 68 65 20 69 6d 70 6c 69 65 even the implie
01d0: 64 20 77 61 72 72 61 6e 74 79 20 6f 66 0a 23 20 d warranty of.#
01e0: 20 20 20 20 4d 45 52 43 48 41 4e 54 41 42 49 4c MERCHANTABIL
01f0: 49 54 59 20 6f 72 20 46 49 54 4e 45 53 53 20 46 ITY or FITNESS F
0200: 4f 52 20 41 20 50 41 52 54 49 43 55 4c 41 52 20 OR A PARTICULAR
0210: 50 55 52 50 4f 53 45 2e 20 20 53 65 65 20 74 68 PURPOSE. See th
0220: 65 0a 23 20 20 20 20 20 47 4e 55 20 47 65 6e 65 e.# GNU Gene
0230: 72 61 6c 20 50 75 62 6c 69 63 20 4c 69 63 65 6e ral Public Licen
0240: 73 65 20 66 6f 72 20 6d 6f 72 65 20 64 65 74 61 se for more deta
0250: 69 6c 73 2e 0a 23 20 0a 23 20 20 20 20 20 59 6f ils..# .# Yo
0260: 75 20 73 68 6f 75 6c 64 20 68 61 76 65 20 72 65 u should have re
0270: 63 65 69 76 65 64 20 61 20 63 6f 70 79 20 6f 66 ceived a copy of
0280: 20 74 68 65 20 47 4e 55 20 47 65 6e 65 72 61 6c the GNU General
0290: 20 50 75 62 6c 69 63 20 4c 69 63 65 6e 73 65 0a Public License.
02a0: 23 20 20 20 20 20 61 6c 6f 6e 67 20 77 69 74 68 # along with
02b0: 20 4d 65 67 61 74 65 73 74 2e 20 20 49 66 20 6e Megatest. If n
02c0: 6f 74 2c 20 73 65 65 20 3c 68 74 74 70 3a 2f 2f ot, see <http://
02d0: 77 77 77 2e 67 6e 75 2e 6f 72 67 2f 6c 69 63 65 www.gnu.org/lice
02e0: 6e 73 65 73 2f 3e 2e 0a 0a 28 73 65 72 76 65 72 nses/>...(server
02f0: 3a 77 72 69 74 61 62 6c 65 2d 77 61 74 63 68 64 :writable-watchd
0300: 6f 67 2d 62 72 75 74 65 66 6f 72 63 65 20 64 62 og-bruteforce db
0310: 73 74 72 75 63 74 29 0a 0a 28 73 65 72 76 65 72 struct)..(server
0320: 3a 77 72 69 74 61 62 6c 65 2d 77 61 74 63 68 64 :writable-watchd
0330: 6f 67 2d 64 65 6c 74 61 73 79 6e 63 20 64 62 73 og-deltasync dbs
0340: 74 72 75 63 74 29 0a 0a 0a 3d 3d 3d 3d 3d 3d 3d truct)...=======
0350: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0360: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0370: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0380: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 4e ==============.N
0390: 4f 54 45 53 20 66 72 6f 6d 20 6c 6f 6f 6b 69 6e OTES from lookin
03a0: 67 20 61 74 20 62 72 61 6e 63 68 20 76 31 2e 36 g at branch v1.6
03b0: 32 2d 72 70 63 0a 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 2-rpc.==========
03c0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
03d0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
03e0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
03f0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a 2a 6c 61 ===========..*la
0400: 73 74 2d 64 62 2d 61 63 63 65 73 73 2a 20 6f 72 st-db-access* or
0410: 20 2a 64 62 2d 6c 61 73 74 2d 61 63 63 65 73 73 *db-last-access
0420: 2a 20 3d 3d 3e 20 77 68 69 63 68 20 69 73 20 69 * ==> which is i
0430: 74 20 74 6f 20 62 65 3f 0a 73 65 65 6e 20 69 6e t to be?.seen in
0440: 20 73 69 6e 67 6c 65 74 65 73 74 3a 20 45 52 52 singletest: ERR
0450: 4f 52 3a 20 55 6e 72 65 63 6f 67 6e 69 73 65 64 OR: Unrecognised
0460: 20 61 72 67 75 6d 65 6e 74 73 3a 20 3a 66 69 72 arguments: :fir
0470: 73 74 5f 65 72 72 20 54 68 69 73 20 69 73 20 74 st_err This is t
0480: 68 65 20 66 69 72 73 74 20 65 72 72 6f 72 0a 0a he first error..
0490: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
04a0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
04b0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
04c0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
04d0: 3d 3d 3d 3d 3d 3d 0a 4e 65 77 20 77 61 79 20 6f ======.New way o
04e0: 66 20 6c 61 75 6e 63 68 69 6e 67 20 6e 65 65 64 f launching need
04f0: 65 64 20 74 6f 20 61 63 63 6f 6d 6f 64 61 74 65 ed to accomodate
0500: 20 64 69 66 66 65 72 65 6e 74 20 74 61 72 67 65 different targe
0510: 74 20 68 6f 73 74 74 79 70 65 73 0a 66 6f 72 20 t hosttypes.for
0520: 69 74 65 6d 73 0a 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d items.==========
0530: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0540: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0550: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0560: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a 5b 66 ============..[f
0570: 6c 61 76 6f 72 73 5d 0a 67 65 6e 65 72 61 6c 20 lavors].general
0580: 73 73 68 20 23 7b 67 65 74 62 65 73 74 68 6f 73 ssh #{getbesthos
0590: 74 20 67 65 6e 65 72 61 6c 7d 0a 6e 62 67 65 6e t general}.nbgen
05a0: 65 72 61 6c 20 6e 62 6a 6f 62 20 72 75 6e 20 4a eral nbjob run J
05b0: 4f 42 43 4f 4d 4d 41 4e 44 20 2d 6c 6f 67 20 24 OBCOMMAND -log $
05c0: 4d 54 5f 4c 49 4e 4b 54 52 45 45 2f 24 4d 54 5f MT_LINKTREE/$MT_
05d0: 54 41 52 47 45 54 2f 24 4d 54 5f 52 55 4e 4e 41 TARGET/$MT_RUNNA
05e0: 4d 45 2e 24 4d 54 5f 54 45 53 54 4e 41 4d 45 2d ME.$MT_TESTNAME-
05f0: 24 4d 54 5f 49 54 45 4d 5f 50 41 54 48 2e 6c 67 $MT_ITEM_PATH.lg
0600: 6f 0a 0a 5b 68 6f 73 74 73 5d 0a 67 65 6e 65 72 o..[hosts].gener
0610: 61 6c 20 63 75 62 69 61 6e 20 78 65 6e 61 0a 0a al cubian xena..
0620: 5b 6c 61 75 6e 63 68 65 72 73 5d 0a 65 6e 76 73 [launchers].envs
0630: 65 74 75 70 20 67 65 6e 65 72 61 6c 0a 78 6f 72 etup general.xor
0640: 2f 25 2f 6e 20 34 43 31 36 47 0a 25 20 6e 62 67 /%/n 4C16G.% nbg
0650: 65 6e 65 72 61 6c 0a 0a 5b 6a 6f 62 74 6f 6f 6c eneral..[jobtool
0660: 73 5d 0a 6c 61 75 6e 63 68 65 72 20 69 6e 74 65 s].launcher inte
0670: 72 6e 61 6c 0a 0a 0a 0a 3d 3d 3d 3d 3d 3d 3d 3d rnal....========
0680: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0690: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
06a0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
06b0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 54 ==============.T
06c0: 72 79 20 77 72 69 74 69 6e 67 20 74 6f 20 69 6e ry writing to in
06d0: 2d 6d 65 6d 6f 72 79 20 64 62 20 61 6e 64 20 65 -memory db and e
06e0: 76 65 72 79 20 32 2d 35 20 73 65 63 6f 6e 64 73 very 2-5 seconds
06f0: 20 73 79 6e 63 69 6e 67 20 74 6f 20 6d 65 67 61 syncing to mega
0700: 74 65 73 74 2e 64 62 0a 3d 3d 3d 3d 3d 3d 3d 3d test.db.========
0710: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0720: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0730: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0740: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a ==============..
0750: 46 69 72 73 74 2c 20 68 6f 77 20 6d 75 63 68 20 First, how much
0760: 74 69 6d 65 20 77 69 6c 6c 20 69 74 20 74 61 6b time will it tak
0770: 65 20 74 6f 20 77 72 69 74 65 20 62 61 63 6b 20 e to write back
0780: 74 68 65 20 63 68 61 6e 67 65 73 3a 0a 0a 31 2e the changes:..1.
0790: 20 47 65 74 20 74 68 65 20 72 75 6e 20 74 61 62 Get the run tab
07a0: 6c 65 0a 0a 28 64 65 66 69 6e 65 20 28 67 65 74 le..(define (get
07b0: 2d 61 6c 6c 20 64 62 29 28 6c 65 74 20 28 28 72 -all db)(let ((r
07c0: 65 73 20 27 28 29 29 29 28 66 6f 72 2d 65 61 63 es '()))(for-eac
07d0: 68 2d 72 6f 77 20 28 6c 61 6d 62 64 61 20 28 61 h-row (lambda (a
07e0: 20 2e 20 62 29 28 73 65 74 21 20 72 65 73 20 28 . b)(set! res (
07f0: 63 6f 6e 73 20 28 61 70 70 6c 79 20 76 65 63 74 cons (apply vect
0800: 6f 72 20 61 20 62 29 20 72 65 73 29 29 29 20 64 or a b) res))) d
0810: 62 20 22 53 45 4c 45 43 54 20 2a 20 46 52 4f 4d b "SELECT * FROM
0820: 20 74 65 73 74 73 3b 22 29 20 72 65 73 29 29 0a tests;") res)).
0830: 28 64 65 66 69 6e 65 20 74 64 61 74 61 20 28 6c (define tdata (l
0840: 65 74 20 28 28 73 74 61 72 74 20 28 63 75 72 72 et ((start (curr
0850: 65 6e 74 2d 6d 69 6c 6c 69 73 65 63 6f 6e 64 73 ent-milliseconds
0860: 29 29 28 72 65 73 20 28 67 65 74 2d 61 6c 6c 20 ))(res (get-all
0870: 2a 64 62 2a 29 29 29 28 70 72 69 6e 74 20 28 2d *db*)))(print (-
0880: 20 28 63 75 72 72 65 6e 74 2d 6d 69 6c 6c 69 73 (current-millis
0890: 65 63 6f 6e 64 73 29 20 73 74 61 72 74 29 29 72 econds) start))r
08a0: 65 73 29 29 0a 0a 52 65 73 75 6c 74 20 72 61 6e es))..Result ran
08b0: 67 65 73 20 66 72 6f 6d 20 33 34 6d 73 20 74 6f ges from 34ms to
08c0: 20 38 39 6d 73 20 62 75 74 20 6d 6f 73 74 6c 79 89ms but mostly
08d0: 20 61 72 6f 75 6e 64 20 34 30 6d 73 20 66 6f 72 around 40ms for
08e0: 20 36 32 33 20 72 65 63 6f 72 64 73 20 6f 6e 20 623 records on
08f0: 6d 6f 6f 73 65 66 73 0a 0a 50 72 6f 6a 65 63 74 moosefs..Project
0900: 69 6e 67 20 74 6f 20 31 35 30 30 30 20 72 65 63 ing to 15000 rec
0910: 6f 72 64 73 3a 0a 0a 20 20 53 6c 6f 77 20 20 20 ords:.. Slow
0920: 32 20 73 65 63 6f 6e 64 73 20 74 6f 20 72 65 61 2 seconds to rea
0930: 64 20 61 6c 6c 0a 20 20 4d 65 64 69 61 6e 20 31 d all. Median 1
0940: 20 73 65 63 6f 6e 64 20 74 6f 20 72 65 61 64 20 second to read
0950: 61 6c 6c 0a 0a 54 68 69 73 20 73 65 65 6d 73 20 all..This seems
0960: 6c 69 6b 65 20 69 74 20 77 6f 75 6c 64 20 77 6f like it would wo
0970: 72 6b 20 77 69 74 68 20 61 6e 20 75 70 64 61 74 rk with an updat
0980: 65 20 70 65 72 69 6f 64 20 6f 66 20 32 2d 35 20 e period of 2-5
0990: 73 65 63 6f 6e 64 73 0a 0a 54 4f 44 4f 0a 2d 2d seconds..TODO.--
09a0: 2d 2d 0a 0a 31 2e 20 6f 70 65 6e 2d 64 62 20 6f --..1. open-db o
09b0: 70 65 6e 73 20 69 6e 2d 6d 65 6d 6f 72 79 20 64 pens in-memory d
09c0: 62 20 61 6e 64 20 6d 65 67 61 74 65 73 74 2e 64 b and megatest.d
09d0: 62 2c 20 70 75 74 20 68 61 6e 64 6c 65 73 20 69 b, put handles i
09e0: 6e 20 2a 6d 65 6d 64 62 2a 20 61 6e 64 20 2a 64 n *memdb* and *d
09f0: 62 2a 2c 20 2a 6d 65 6d 64 62 2a 20 69 73 20 3c b*, *memdb* is <
0a00: 20 72 75 6e 2d 69 64 20 64 62 68 20 3e 0a 32 2e run-id dbh >.2.
0a10: 20 53 65 72 76 65 72 20 69 73 20 70 61 72 74 20 Server is part
0a20: 6f 66 20 72 75 6e 74 65 73 74 73 20 0a 20 20 20 of runtests .
0a30: 61 2e 20 73 65 72 76 65 72 20 73 74 61 72 74 20 a. server start
0a40: 63 79 63 6c 65 20 2d 20 61 64 61 70 74 20 74 6f cycle - adapt to
0a50: 20 70 65 72 20 72 75 6e 2d 69 64 0a 20 20 20 20 per run-id.
0a60: 20 20 69 2e 20 73 74 61 74 65 73 3b 20 73 74 61 i. states; sta
0a70: 72 74 69 6e 67 2c 20 73 74 61 72 74 65 64 2c 20 rting, started,
0a80: 73 74 6f 70 70 69 6e 67 2c 20 73 74 6f 70 70 65 stopping, stoppe
0a90: 64 0a 20 20 20 62 2e 20 74 75 72 6e 20 6f 66 66 d. b. turn off
0aa0: 20 77 72 69 74 65 20 63 6f 61 6c 65 73 69 6e 67 write coalesing
0ab0: 0a 33 2e 20 43 61 6c 6c 73 20 74 6f 20 2d 72 75 .3. Calls to -ru
0ac0: 6e 74 65 73 74 73 2c 20 2d 72 65 6d 6f 76 65 2d ntests, -remove-
0ad0: 72 75 6e 73 20 65 74 63 2e 20 0a 20 20 20 61 2e runs etc. . a.
0ae0: 20 4d 69 67 68 74 20 74 61 6c 6b 20 74 6f 20 72 Might talk to r
0af0: 75 6e 6e 69 6e 67 20 73 65 72 76 65 72 20 69 66 unning server if
0b00: 20 72 75 6e 20 73 70 65 63 69 66 69 63 0a 20 20 run specific.
0b10: 20 62 2e 20 43 61 6e 20 74 61 6c 6b 20 74 6f 20 b. Can talk to
0b20: 6d 65 67 61 74 65 73 74 2e 64 62 20 62 75 74 20 megatest.db but
0b30: 6e 6f 74 20 61 20 67 65 6e 65 72 61 6c 6c 79 20 not a generally
0b40: 67 6f 6f 64 20 69 64 65 61 0a 20 20 20 63 2e 20 good idea. c.
0b50: 43 61 6e 20 73 74 61 72 74 20 61 20 72 75 6e 73 Can start a runs
0b60: 65 72 76 65 72 20 0a 34 2e 20 44 61 73 68 62 6f erver .4. Dashbo
0b70: 61 72 64 20 69 73 20 66 69 6e 65 20 65 78 63 65 ard is fine exce
0b80: 70 74 20 66 6f 72 20 77 72 69 74 65 73 3f 0a 0a pt for writes?..
0b90: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0ba0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0bb0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0bc0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
0bd0: 3d 3d 3d 3d 3d 3d 0a 52 6f 75 74 69 6e 65 73 20 ======.Routines
0be0: 74 6f 20 63 6f 6e 76 65 72 74 20 66 6f 72 20 72 to convert for r
0bf0: 75 6e 73 2e 73 63 6d 0a 0a 63 64 62 3a 72 65 6d uns.scm..cdb:rem
0c00: 6f 74 65 2d 72 75 6e 20 64 62 3a 72 65 67 69 73 ote-run db:regis
0c10: 74 65 72 2d 72 75 6e 0a 0a 63 64 62 3a 64 65 6c ter-run..cdb:del
0c20: 65 74 65 2d 74 65 73 74 73 2d 69 6e 2d 73 74 61 ete-tests-in-sta
0c30: 74 65 20 2a 72 75 6e 72 65 6d 6f 74 65 2a 0a 63 te *runremote*.c
0c40: 64 62 3a 67 65 74 2d 74 65 73 74 2d 69 6e 66 6f db:get-test-info
0c50: 2d 62 79 2d 69 64 20 2a 72 75 6e 72 65 6d 6f 74 -by-id *runremot
0c60: 65 2a 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 e*.cdb:remote-ru
0c70: 6e 20 64 62 3a 64 65 6c 65 74 65 2d 6f 6c 64 2d n db:delete-old-
0c80: 64 65 6c 65 74 65 64 2d 74 65 73 74 2d 72 65 63 deleted-test-rec
0c90: 6f 72 64 73 0a 63 64 62 3a 72 65 6d 6f 74 65 2d ords.cdb:remote-
0ca0: 72 75 6e 20 64 62 3a 64 65 6c 65 74 65 2d 72 75 run db:delete-ru
0cb0: 6e 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e n.cdb:remote-run
0cc0: 20 64 62 3a 64 65 6c 65 74 65 2d 74 65 73 74 2d db:delete-test-
0cd0: 72 65 63 6f 72 64 73 0a 63 64 62 3a 72 65 6d 6f records.cdb:remo
0ce0: 74 65 2d 72 75 6e 20 64 62 3a 64 65 6c 65 74 65 te-run db:delete
0cf0: 2d 74 65 73 74 73 2d 66 6f 72 2d 72 75 6e 0a 63 -tests-for-run.c
0d00: 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 64 62 db:remote-run db
0d10: 3a 66 69 6e 64 2d 61 6e 64 2d 6d 61 72 6b 2d 69 :find-and-mark-i
0d20: 6e 63 6f 6d 70 6c 65 74 65 0a 63 64 62 3a 72 65 ncomplete.cdb:re
0d30: 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 67 65 74 2d mote-run db:get-
0d40: 63 6f 75 6e 74 2d 74 65 73 74 73 2d 72 75 6e 6e count-tests-runn
0d50: 69 6e 67 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 ing.cdb:remote-r
0d60: 75 6e 20 64 62 3a 67 65 74 2d 63 6f 75 6e 74 2d un db:get-count-
0d70: 74 65 73 74 73 2d 72 75 6e 6e 69 6e 67 2d 69 6e tests-running-in
0d80: 2d 6a 6f 62 67 72 6f 75 70 0a 63 64 62 3a 72 65 -jobgroup.cdb:re
0d90: 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 67 65 74 2d mote-run db:get-
0da0: 6b 65 79 73 0a 63 64 62 3a 72 65 6d 6f 74 65 2d keys.cdb:remote-
0db0: 72 75 6e 20 64 62 3a 67 65 74 2d 72 75 6e 2d 69 run db:get-run-i
0dc0: 6e 66 6f 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 nfo.cdb:remote-r
0dd0: 75 6e 20 64 62 3a 67 65 74 2d 72 75 6e 2d 6b 65 un db:get-run-ke
0de0: 79 2d 76 61 6c 0a 63 64 62 3a 72 65 6d 6f 74 65 y-val.cdb:remote
0df0: 2d 72 75 6e 20 64 62 3a 67 65 74 2d 72 75 6e 2d -run db:get-run-
0e00: 6e 61 6d 65 2d 66 72 6f 6d 2d 69 64 0a 63 64 62 name-from-id.cdb
0e10: 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 67 :remote-run db:g
0e20: 65 74 2d 73 74 65 70 73 2d 66 6f 72 2d 74 65 73 et-steps-for-tes
0e30: 74 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e t.cdb:remote-run
0e40: 20 64 62 3a 67 65 74 2d 74 65 73 74 2d 69 64 2d db:get-test-id-
0e50: 63 61 63 68 65 64 0a 63 64 62 3a 72 65 6d 6f 74 cached.cdb:remot
0e60: 65 2d 72 75 6e 20 64 62 3a 67 65 74 2d 74 65 73 e-run db:get-tes
0e70: 74 73 2d 66 6f 72 2d 72 75 6e 73 2d 6d 69 6e 64 ts-for-runs-mind
0e80: 61 74 61 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 ata.cdb:remote-r
0e90: 75 6e 20 64 62 3a 6c 6f 63 6b 2f 75 6e 6c 6f 63 un db:lock/unloc
0ea0: 6b 2d 72 75 6e 0a 63 64 62 3a 72 65 6d 6f 74 65 k-run.cdb:remote
0eb0: 2d 72 75 6e 20 64 62 3a 73 65 74 2d 73 79 6e 63 -run db:set-sync
0ec0: 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 .cdb:remote-run
0ed0: 64 62 3a 73 65 74 2d 74 65 73 74 73 2d 73 74 61 db:set-tests-sta
0ee0: 74 65 2d 73 74 61 74 75 73 0a 63 64 62 3a 72 65 te-status.cdb:re
0ef0: 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 73 65 74 2d mote-run db:set-
0f00: 76 61 72 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 var.cdb:remote-r
0f10: 75 6e 20 64 62 3a 74 65 73 74 6d 65 74 61 2d 61 un db:testmeta-a
0f20: 64 64 2d 72 65 63 6f 72 64 0a 63 64 62 3a 72 65 dd-record.cdb:re
0f30: 6d 6f 74 65 2d 72 75 6e 20 64 62 3a 74 65 73 74 mote-run db:test
0f40: 6d 65 74 61 2d 67 65 74 2d 72 65 63 6f 72 64 0a meta-get-record.
0f50: 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 64 cdb:remote-run d
0f60: 62 3a 74 65 73 74 6d 65 74 61 2d 75 70 64 61 74 b:testmeta-updat
0f70: 65 2d 66 69 65 6c 64 0a 63 64 62 3a 72 65 6d 6f e-field.cdb:remo
0f80: 74 65 2d 72 75 6e 20 64 62 3a 75 70 64 61 74 65 te-run db:update
0f90: 2d 72 75 6e 2d 65 76 65 6e 74 5f 74 69 6d 65 0a -run-event_time.
0fa0: 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 6e 20 69 cdb:remote-run i
0fb0: 6e 73 74 65 61 64 0a 63 64 62 3a 72 65 6d 6f 74 nstead.cdb:remot
0fc0: 65 2d 72 75 6e 20 73 65 72 76 65 72 3a 73 74 61 e-run server:sta
0fd0: 72 74 0a 63 64 62 3a 72 65 6d 6f 74 65 2d 72 75 rt.cdb:remote-ru
0fe0: 6e 20 74 65 73 74 3a 67 65 74 2d 6d 61 74 63 68 n test:get-match
0ff0: 69 6e 67 2d 70 72 65 76 69 6f 75 73 2d 74 65 73 ing-previous-tes
1000: 74 2d 72 75 6e 2d 72 65 63 6f 72 64 73 0a 63 64 t-run-records.cd
1010: 62 3a 74 65 73 74 73 2d 72 65 67 69 73 74 65 72 b:tests-register
1020: 2d 74 65 73 74 20 2a 72 75 6e 72 65 6d 6f 74 65 -test *runremote
1030: 2a 0a 28 64 65 66 69 6e 65 20 28 72 75 6e 73 3a *.(define (runs:
1040: 73 68 72 69 6e 6b 2d 63 61 6e 2d 72 75 6e 2d 6d shrink-can-run-m
1050: 6f 72 65 2d 74 65 73 74 73 2d 63 6f 75 6e 74 29 ore-tests-count)
1060: 20 3b 3b 20 74 68 65 20 64 62 20 69 73 20 61 20 ;; the db is a
1070: 64 75 6d 6d 79 20 76 61 72 20 73 6f 20 77 65 20 dummy var so we
1080: 63 61 6e 20 75 73 65 20 63 64 62 3a 72 65 6d 6f can use cdb:remo
1090: 74 65 2d 72 75 6e 0a 0a 3d 3d 3d 3d 3d 3d 3d 3d te-run..========
10a0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
10b0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
10c0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
10d0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a 0a ==============..
10e0: 5b 38 37 63 62 65 36 38 66 33 31 5d 20 0a 5b 62 [87cbe68f31] .[b
10f0: 65 34 30 35 65 38 65 32 65 5d 0a 0a 23 20 46 52 e405e8e2e]..# FR
1100: 4f 4d 20 61 6e 64 79 6a 70 67 20 6f 6e 20 23 63 OM andyjpg on #c
1110: 68 69 63 6b 65 6e 0a 0a 28 6c 65 74 20 28 28 6f hicken..(let ((o
1120: 72 69 67 69 6e 61 6c 2d 65 78 69 74 20 28 65 78 riginal-exit (ex
1130: 69 74 2d 68 61 6e 64 6c 65 72 29 29 29 0a 20 20 it-handler))).
1140: 28 65 78 69 74 2d 68 61 6e 64 6c 65 72 20 28 6c (exit-handler (l
1150: 61 6d 62 64 61 20 28 23 21 6f 70 74 69 6f 6e 61 ambda (#!optiona
1160: 6c 20 28 65 78 69 74 2d 63 6f 64 65 20 30 29 29 l (exit-code 0))
1170: 0a 09 09 20 20 28 70 72 69 6e 74 66 20 22 50 72 ... (printf "Pr
1180: 65 70 61 72 69 6e 67 20 74 6f 20 65 78 69 74 2e eparing to exit.
1190: 2e 2e 5c 6e 22 20 65 78 69 74 2d 63 6f 64 65 29 ..\n" exit-code)
11a0: 0a 09 09 20 20 28 66 6f 72 2d 65 61 63 68 20 28 ... (for-each (
11b0: 6c 61 6d 62 64 61 20 28 70 69 64 29 0a 09 09 09 lambda (pid)....
11c0: 20 20 20 20 20 20 28 70 72 69 6e 74 66 20 22 53 (printf "S
11d0: 65 6e 64 69 6e 67 20 73 69 67 6e 61 6c 2f 74 65 ending signal/te
11e0: 72 6d 20 74 6f 20 7e 41 5c 6e 22 20 70 69 64 29 rm to ~A\n" pid)
11f0: 0a 09 09 09 20 20 20 20 20 20 28 70 72 6f 63 65 .... (proce
1200: 73 73 2d 73 69 67 6e 61 6c 20 70 69 64 20 73 69 ss-signal pid si
1210: 67 6e 61 6c 2f 74 65 72 6d 29 29 20 28 63 68 69 gnal/term)) (chi
1220: 6c 64 72 65 6e 29 29 0a 09 09 20 20 28 6f 72 69 ldren))... (ori
1230: 67 69 6e 61 6c 2d 65 78 69 74 20 65 78 69 74 2d ginal-exit exit-
1240: 63 6f 64 65 29 29 29 29 0a 0a 0a 0a 31 2e 20 41 code))))....1. A
1250: 6c 6c 20 72 75 6e 20 63 6f 6e 74 72 6f 6c 20 61 ll run control a
1260: 63 63 65 73 73 20 74 6f 20 64 62 20 69 73 20 64 ccess to db is d
1270: 69 72 65 63 74 2e 0a 32 2e 20 41 6c 6c 20 74 65 irect..2. All te
1280: 73 74 20 6d 61 63 68 69 6e 65 73 20 6d 75 73 74 st machines must
1290: 20 68 61 76 65 20 6d 65 67 61 74 65 73 74 20 61 have megatest a
12a0: 76 61 69 6c 61 62 6c 65 0a 33 2e 20 54 65 73 74 vailable.3. Test
12b0: 73 20 6d 61 79 20 6f 72 20 6d 61 79 20 6e 6f 74 s may or may not
12c0: 20 68 61 76 65 20 66 69 6c 65 20 73 79 73 74 65 have file syste
12d0: 6d 20 61 63 63 65 73 73 20 74 6f 20 74 68 65 20 m access to the
12e0: 6f 72 69 67 69 6e 61 74 69 6e 67 0a 20 20 20 72 originating. r
12f0: 75 6e 20 61 72 65 61 2e 20 72 73 79 6e 63 20 69 un area. rsync i
1300: 73 20 75 73 65 64 20 74 6f 20 70 75 6c 6c 20 74 s used to pull t
1310: 68 65 20 74 65 73 74 20 61 72 65 61 20 74 6f 20 he test area to
1320: 74 68 65 20 68 6f 6d 65 20 68 6f 73 74 0a 20 20 the home host.
1330: 20 69 66 20 61 6e 64 20 6f 6e 6c 79 20 69 66 20 if and only if
1340: 74 68 65 20 6f 72 69 67 69 6e 61 74 69 6e 67 20 the originating
1350: 61 72 65 61 20 63 61 6e 20 6e 6f 74 20 62 65 20 area can not be
1360: 73 65 65 6e 20 76 69 61 20 66 69 6c 65 20 0a 20 seen via file .
1370: 20 20 73 79 73 74 65 6d 2e 20 4e 4f 20 4c 4f 4e system. NO LON
1380: 47 45 52 20 54 52 55 45 2e 20 52 73 79 6e 63 20 GER TRUE. Rsync
1390: 69 73 20 75 73 65 64 20 62 75 74 20 66 69 6c 65 is used but file
13a0: 20 73 79 73 74 65 6d 20 6d 75 73 74 20 62 65 20 system must be
13b0: 76 69 73 69 62 6c 65 2e 0a 34 2e 20 41 6c 6c 20 visible..4. All
13c0: 64 62 20 61 63 63 65 73 73 20 69 73 20 64 6f 6e db access is don
13d0: 65 20 76 69 61 20 74 68 65 20 68 6f 6d 65 20 68 e via the home h
13e0: 6f 73 74 2e 20 4e 4f 54 20 49 4d 50 4c 45 4d 45 ost. NOT IMPLEME
13f0: 4e 54 45 44 20 59 45 54 2e 0a 0a 52 45 4d 4f 54 NTED YET...REMOT
1400: 45 20 41 43 43 45 53 53 20 44 42 20 4c 4f 41 44 E ACCESS DB LOAD
1410: 53 0a 0a 49 4e 46 4f 3a 20 28 30 29 20 4d 61 78 S..INFO: (0) Max
1420: 20 63 61 63 68 65 64 20 71 75 65 72 69 65 73 20 cached queries
1430: 77 61 73 20 20 20 20 31 30 0a 49 4e 46 4f 3a 20 was 10.INFO:
1440: 28 30 29 20 4e 75 6d 62 65 72 20 6f 66 20 63 61 (0) Number of ca
1450: 63 68 65 64 20 77 72 69 74 65 73 20 20 20 32 37 ched writes 27
1460: 30 34 33 0a 49 4e 46 4f 3a 20 28 30 29 20 41 76 043.INFO: (0) Av
1470: 65 72 61 67 65 20 63 61 63 68 65 64 20 77 72 69 erage cached wri
1480: 74 65 20 74 69 6d 65 20 31 35 2e 30 36 33 34 35 te time 15.06345
1490: 34 34 39 38 33 39 31 35 20 6d 73 0a 49 4e 46 4f 44983915 ms.INFO
14a0: 3a 20 28 30 29 20 4e 75 6d 62 65 72 20 6e 6f 6e : (0) Number non
14b0: 2d 63 61 63 68 65 64 20 71 75 65 72 69 65 73 20 -cached queries
14c0: 37 31 39 32 38 0a 49 4e 46 4f 3a 20 28 30 29 20 71928.INFO: (0)
14d0: 41 76 65 72 61 67 65 20 6e 6f 6e 2d 63 61 63 68 Average non-cach
14e0: 65 64 20 74 69 6d 65 20 20 20 35 2e 31 35 35 34 ed time 5.1554
14f0: 37 34 39 31 39 33 36 33 38 31 20 6d 73 0a 49 4e 7491936381 ms.IN
1500: 46 4f 3a 20 28 30 29 20 53 65 72 76 65 72 20 73 FO: (0) Server s
1510: 68 75 74 64 6f 77 6e 20 63 6f 6d 70 6c 65 74 65 hutdown complete
1520: 2e 20 45 78 69 74 69 6e 67 0a 0a 0a 66 64 6b 74 . Exiting...fdkt
1530: 65 73 74 71 61 20 6f 6e 20 41 70 72 20 32 39 2c estqa on Apr 29,
1540: 20 32 30 31 33 3a 20 31 38 31 32 20 74 65 73 74 2013: 1812 test
1550: 73 0a 0a 49 4e 46 4f 3a 20 28 30 29 20 4d 61 78 s..INFO: (0) Max
1560: 20 63 61 63 68 65 64 20 71 75 65 72 69 65 73 20 cached queries
1570: 77 61 73 20 20 20 20 31 30 0a 49 4e 46 4f 3a 20 was 10.INFO:
1580: 28 30 29 20 4e 75 6d 62 65 72 20 6f 66 20 63 61 (0) Number of ca
1590: 63 68 65 64 20 77 72 69 74 65 73 20 20 20 34 31 ched writes 41
15a0: 33 33 35 0a 49 4e 46 4f 3a 20 28 30 29 20 41 76 335.INFO: (0) Av
15b0: 65 72 61 67 65 20 63 61 63 68 65 64 20 77 72 69 erage cached wri
15c0: 74 65 20 74 69 6d 65 20 32 30 36 2e 30 38 31 35 te time 206.0815
15d0: 35 33 31 36 33 31 37 39 20 6d 73 0a 49 4e 46 4f 53163179 ms.INFO
15e0: 3a 20 28 30 29 20 4e 75 6d 62 65 72 20 6e 6f 6e : (0) Number non
15f0: 2d 63 61 63 68 65 64 20 71 75 65 72 69 65 73 20 -cached queries
1600: 37 34 32 38 39 0a 49 4e 46 4f 3a 20 28 30 29 20 74289.INFO: (0)
1610: 41 76 65 72 61 67 65 20 6e 6f 6e 2d 63 61 63 68 Average non-cach
1620: 65 64 20 74 69 6d 65 20 20 20 31 30 35 35 2e 30 ed time 1055.0
1630: 39 38 32 36 34 38 38 34 34 34 20 6d 73 0a 49 4e 9826488444 ms.IN
1640: 46 4f 3a 20 28 30 29 20 53 65 72 76 65 72 20 73 FO: (0) Server s
1650: 68 75 74 64 6f 77 6e 20 63 6f 6d 70 6c 65 74 65 hutdown complete
1660: 2e 20 45 78 69 74 69 6e 67 0a 0a 53 74 61 72 74 . Exiting..Start
1670: 3a 20 30 20 61 74 20 53 75 6e 20 41 70 72 20 32 : 0 at Sun Apr 2
1680: 38 20 32 32 3a 31 38 3a 32 35 20 4d 53 54 20 32 8 22:18:25 MST 2
1690: 30 31 33 0a 4d 61 78 3a 20 20 35 32 20 61 74 20 013.Max: 52 at
16a0: 53 75 6e 20 41 70 72 20 32 38 20 32 33 3a 30 36 Sun Apr 28 23:06
16b0: 3a 35 39 20 4d 53 54 20 32 30 31 33 0a 45 6e 64 :59 MST 2013.End
16c0: 3a 20 20 20 36 20 61 74 20 53 75 6e 20 41 70 72 : 6 at Sun Apr
16d0: 20 32 38 20 32 33 3a 34 37 3a 35 31 20 4d 53 54 28 23:47:51 MST
16e0: 20 32 30 31 33 0a 0a 3d 3d 3d 3d 3d 3d 3d 3d 3d 2013..=========
16f0: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
1700: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
1710: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d ================
1720: 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 3d 0a ===============.
1730: 0a 0a ..