Megatest

Timeline
Login

200 most recent check-ins by user matt occurring on or after 2021-12-18 05:45:07.

More ↑
2023-01-19
04:14
Removed added attempt to save server info in runremote. check-in: b290688bbb user: matt tags: v1.80-toomanyfiles
03:46
client setup was not updating runremote in some scenarios check-in: 3f4bf437c0 user: matt tags: v1.80-toomanyfiles
2023-01-18
22:17
Missing fix check-in: c608ac13c7 user: matt tags: v1.80
22:13
Missing fix check-in: ff975ecd14 user: matt tags: v1.80
22:11
Pulled in two needed fixes. check-in: 3936bce446 user: matt tags: v1.80
21:53
corrected misnamed funciton Leaf check-in: a9180a343b user: matt tags: v1.80-refactor-fix1
21:46
Removed bad call to close-connection! check-in: 463fffbd79 user: matt tags: v1.80-refactor-fix1
18:21
Normalize toppath for /tmp db area to address weird csh /home/matt/data/megatest vs. pwd.

Get DEADs after a while. There is a crash related to connection handling. check-in: e2a27caa33 user: matt tags: v1.80

2023-01-16
21:42
v1.80-notbetter Leaf check-in: 5287e50105 user: matt tags: v1.80-refactor
15:53
Most sqlite3: calls now prepared and cached. check-in: bcf8145611 user: matt tags: v1.80-refactor
14:09
Cleaned up prepared db statements handling. check-in: 2639de81a8 user: matt tags: v1.80-refactor
12:17
last of overt connection issues addressed. TCP connections growing very slowly. However now the db issues are manifesting. check-in: 22f2c33711 user: matt tags: v1.80-transport-cleanish, v1.80-refactor
10:00
Major refactor/clean up of client connection stuff. Removed old crufty approach of having both client and server side calls in http-transport. Plan would be to eventually get rid of http-transport.

Open files slowly grows. bad argument type in http-transport. Line 285 (close-connection! fullurl) is wrong. check-in: 67b18cc991 user: matt tags: v1.80-refactor

04:20
Original call to close-connections! was correct check-in: 883ba16e82 user: matt tags: v1.80
03:32
Isolated fix from v1.80-disconnected-tests for TCP ports issue (not tested yet) check-in: da2bac2043 user: matt tags: v1.80
03:21
Merged v1.80 Leaf check-in: ccccfdb50a user: matt tags: v1.80-disconnect-tests
2023-01-15
21:45
Appear to have fixed the growing connections issue check-in: f78750d901 user: matt tags: v1.80-disconnect-tests
18:27
Disconnecting tests from servers where possible to save connections. check-in: cdac5f3909 user: matt tags: v1.80-disconnect-tests
2023-01-13
08:22
Yet another db in transaction problem fixed. check-in: 95b6039c92 user: matt tags: v1.80
05:07
New logic on delaying when can't run more tests. One more case of dbstruct used inside transaction found and fixed. check-in: a67d8dbadb user: matt tags: v1.80
2023-01-12
21:49
Calling db:with-db inside a transaction was bad. Disallowed calling db:with-db with db and factored out few calls to take db. TCP connections seems stable. Fingers crossed. check-in: fb48802dd5 user: matt tags: v1.80
20:02
More close-connections fixes. check-in: 3e016c5af5 user: matt tags: v1.80
07:26
Reduce noise check-in: 2ec14a566d user: matt tags: v1.80
07:11
Oops. Was setting conn to #f before cleaning up connections. Not 100% sure but suspect that was a bad thing. check-in: 0ee24d5747 user: matt tags: v1.80
2023-01-11
06:20
Added cond-expand to mtargs so it can be chicken-5 and chicken-4 check-in: 4e5c67b31e user: matt tags: v1.80
05:52
Merged fork check-in: 74f81f69c1 user: matt tags: v1.80
2022-12-11
13:51
Use low-noise-print to make the summary view more stable check-in: 2b7b20907b user: matt tags: v1.80
10:22
Added periodic sync from mtrah area into tmp area to reduce chances of an issue from servers running from more than one host if NFS is super slow. check-in: e9d6ea9e8d user: matt tags: v1.80
2022-12-10
21:42
Don't start servers if not on the host selected for home or there are more than 20 servers running check-in: c1bbcec340 user: matt tags: v1.80
2022-11-23
20:16
Merged in nohomehost since multi-area dashboard will depend on nohomehost Leaf check-in: aac724292e user: matt tags: v1.70-ndboard
2022-11-22
09:06
Turn the handler for opening server info files back on since those files can disappear without warning. Closed-Leaf check-in: abb42df5ef user: matt tags: v1.70-nohomehost
08:59
Some more tweaks and output reduction. Still get crashes due to db lock but system seems to keep going pretty well. This is with 300 tests running on one machine. check-in: 4dcb84418f user: matt tags: v1.70-nohomehost
07:49
Keep more servers around but let them also expire quickly if not used check-in: c0ef1c5bfa user: matt tags: v1.70-nohomehost
06:36
Remove case 6 from rmt:send-receive. This was pinging the server constantly and opening addtional connections that don't appear to being closed. Also, just let the connection die, it should retry. check-in: 08646db430 user: matt tags: v1.70-nohomehost
02:57
sixyfivek is running pretty good check-in: d1ac2665ef user: matt tags: v1.70-nohomehost
2022-11-21
22:20
Server usage in dashboard mostly working check-in: 3ce83ed77c user: matt tags: v1.70-nohomehost
07:14
Basic auto server start working check-in: 42bfe6fba7 user: matt tags: v1.70-nohomehost
07:14
Makefile fixed check-in: 4c8c2cf803 user: matt tags: v1.70-nohomehost
2022-11-20
21:27
wip check-in: 9972980bfa user: matt tags: v1.70-nohomehost
19:44
Pulled in latest changes from v1.70 check-in: e966c3ef7e user: matt tags: v1.70-nohomehost
16:15
possible improvement, untested. check-in: 4f0aa04874 user: matt tags: v1.70
08:34
Couple minor changes to where client connections are cleared. check-in: ae21734c5e user: matt tags: v1.70
2022-11-15
05:27
junk lines in mtargs.scm check-in: b70c9cc8dc user: matt tags: v2.0001
2022-11-13
04:53
wip check-in: 87b6d8cf0e user: matt tags: v1.70-nohomehost
2022-11-12
19:25
Most routines needed for no-homehost updated. check-in: ed25403d77 user: matt tags: v1.70-nohomehost
18:34
server:choose-server now working. check-in: cc546c7dfe user: matt tags: v1.70-nohomehost
07:03
Steps towards eliminating homehost check-in: a0384d728b user: matt tags: v1.70-nohomehost
2022-11-11
09:42
Partial implementation of homehost-free check-in: ac69021df7 user: matt tags: v1.70-nohomehost
2022-11-10
13:37
Fixed server/client signature. I think. check-in: bf877ecde8 user: matt tags: v1.70
2022-11-08
22:15
Added stop-the-train, crowbar switch check-in: bf43672760 user: matt tags: v1.70
2022-11-05
21:04
Merged check-in: a4c88b57c9 user: matt tags: v1.70
21:04
Removed or updated prints to get bare-prints passing in ext-tests. check-in: 429f76ae7e user: matt tags: v1.70
2022-11-04
02:12
Some cleanup on the run-away open files fix check-in: 505cde89e4 user: matt tags: v1.70
2022-11-03
20:36
Possible fixes to run-away open files check-in: 38e7dc2f46 user: matt tags: v1.70
2022-10-31
09:47
If .megatest does not exist but megatest.db does, try using it. NOTE: can't work with current calls creating .megatest area. Abandon this but keep the code for now. check-in: 533667efde user: matt tags: v1.70-ndboard
2022-10-30
22:59
info from -show commands should go to stdout. Misc progress on newdashboard check-in: e4d1922be4 user: matt tags: v1.70-ndboard
21:56
Clean up output of -show-keys. Use struct for keeping all the misc data associated with an area check-in: b0b795e94c user: matt tags: v1.70-ndboard
20:55
Switch dashboard.scm to use treemod. Updated Makefile deps for newdashboard. check-in: f09a7b7261 user: matt tags: v1.70-ndboard
19:42
Some basics in place check-in: a28c78bc9e user: matt tags: v1.70-ndboard
18:11
Another attempt at newdashboard check-in: 8cb7f297ed user: matt tags: v1.70-ndboard
2022-10-29
21:53
Possible performance improvement for dashboard check-in: 793c96fa5f user: matt tags: v1.70
2022-10-23
19:40
Hack to turn off multi-db-handles check-in: ffc3c2a09d user: matt tags: v1.70
10:57
Improved db stats collection and switch to using WAL in /tmp check-in: 2180fd1986 user: matt tags: v1.70
2022-10-05
09:39
Missed a commit check-in: aad68ae1ed user: matt tags: v2.0001
2022-09-18
19:31
Added brute-force-salvage-db back. It seems to work, at least sometimes. check-in: fb8df28768 user: matt tags: v1.70
18:12
Add back and improve waiting for journal plus few other performance helpers check-in: 76fac9ef30 user: matt tags: v1.70
12:50
Moved close-all-connections! to better spot. check-in: a847a95748 user: matt tags: v1.70
10:48
Wrap dbfile:open-db call with mutex to minimize over-opening of db's check-in: 53f35f5363 user: matt tags: v1.70
2022-09-04
20:11
Merging forward. Leaf check-in: d64a152659 user: matt tags: v1.70-ck5-round2
20:10
wip Leaf check-in: 5ff7f64267 user: matt tags: v1.70-ck5
19:34
blind merge from latest v1.70 check-in: 9154f466d1 user: matt tags: v1.70-ck5
2022-08-02
10:59
Merged fork check-in: abb8b3c79e user: matt tags: v1.70
10:40
Moved pragmas sync to always be called for no-sync.db check-in: 69b8acfb9f user: matt tags: v1.70
07:59
Throttle polling in runs.scm when we are just waiting for tests to complete running check-in: 090d26210c user: matt tags: v1.70
07:56
Remove info printing of parallel-api-requests check-in: 4bec7c5319 user: matt tags: v1.70
07:17
turn off discard of dbdats check-in: 76a1ae1920 user: matt tags: v1.70
07:16
Improved message for Run id required asserts check-in: 203b01f1fa user: matt tags: v1.70
2022-08-01
21:56
Added bunch of asserts to rmt.scm to catch any calls where run-id should be specified but it is not. check-in: 6f9cc73a2e user: matt tags: v1.70
14:48
Added some dependencies and a hack to get a clean from clean build check-in: e4e809c99c user: matt tags: v1.70
2022-06-28
21:49
bit more done on ck5 check-in: 04ee759e4a user: matt tags: v1.70-ck5
2022-06-27
12:52
Compiles check-in: 786ae4bacc user: matt tags: v1.70-ck5
11:34
Migrate to ck5 (again) check-in: da6fbf9f56 user: matt tags: v1.70-ck5
09:00
Merged forward the beginnings of nohome Leaf check-in: 3b3dbdec4b user: matt tags: v1.70-nohome
2022-06-08
20:09
Turn off runremote reset of 180 sec check-in: 27718f7cf5 user: matt tags: v1.70, v1.7002
2022-06-07
08:30
Added with-lock options for both simple and no-sync locking systems. Leaf check-in: 024073632a user: matt tags: v1.70-refactor-procedures
2022-06-06
20:25
Fixed (kind-of) not working no-sync db based lock check-in: 79a7f8d883 user: matt tags: v1.70-refactor-procedures
18:02
Added double locking for opening db's check-in: 7b9e186d63 user: matt tags: v1.70-refactor-procedures
12:29
quiet down the is-trigger-dropped messages check-in: 8a05ecdb52 user: matt tags: v1.70-refactor-procedures
2022-06-01
21:14
speculative fix check-in: 2f1850785d user: matt tags: v1.70-refactor-procedures
06:08
Add forced reconnect to allow old servers to gracefully die check-in: f1ba33210e user: matt tags: v1.70-refactor-procedures
2022-05-31
06:01
Stop touching log after 600 seconds, clobber *runremote* on client side insteade of setting the remote in the record check-in: a732b9439d user: matt tags: v1.70-refactor-procedures
2022-05-30
20:10
Disable handle-exceptions in api and rmt, minor cleanup in dbfile.scm check-in: 633906ee94 user: matt tags: v1.70-refactor-procedures
2022-05-28
09:23
Fixed few things. check-in: 3f484757d1 user: matt tags: v1.70-refactor-procedures
2022-05-27
21:36
Bunch of little fixes check-in: 9a621a8bdc user: matt tags: v1.70-refactor-procedures
20:23
Move bunch of functions from db.scm to dbfile.scm check-in: ed0f0698ab user: matt tags: v1.70-refactor-procedures
19:21
Commented out some not-used fuctions, removed the server start every 120 seconds and added dbfile handle count check-in: b1db729de1 user: matt tags: v1.70
2022-05-22
20:20
Some awful hacks to keep the system running. There is something causing servers to crash, I suspect sync is the problem. This work-around just constantly replaces the servers with new ones. check-in: 3cdcb8c138 user: matt tags: v1.70
18:02
Cleaned up some gratuitous database opens, quietened some debug messages check-in: a6be57bfc9 user: matt tags: v1.70
15:42
Ensure that db opens are only done once per process per db file. Put out messages if this is not the case. check-in: d0bca99717 user: matt tags: v1.70
2022-05-20
19:49
Fixed two cases where dbdats were not being pushed back on stack when done check-in: 4fedbd6b6f user: matt tags: v1.70
2022-05-15
05:01
Rebased v1.7001-multi-db forward to tip of v1.65, old branch is hidden check-in: 820ac9a873 user: matt tags: v1.70
2022-02-20
19:17
Added dbmod.scm and build support check-in: 996af79a27 user: matt tags: v1.65
2022-02-15
20:20
Added check for correct data - might be some bad records are retrieved. check-in: 6eb5f36a74 user: matt tags: v2.0001
19:01
Removed redunant definitions. check-in: bb4f913f24 user: matt tags: v2.0001
2022-02-12
20:16
Protect all transactions with mutex. check-in: 3454f1583b user: matt tags: v2.0001
2022-01-30
20:12
Added rmt:get-servers-info, removed remote logging, misc other tweaks. check-in: 52c2bf27f4 user: matt tags: v2.0001
2022-01-26
18:31
For the runner loop apply small delay on too-rapid calls, then more delay when no tests are launching check-in: 8f71552216 user: matt tags: v2.0001
18:20
Wait five seconds after launching a test before throttling the runner loop. check-in: 682af2eb81 user: matt tags: v2.0001
2022-01-20
07:35
Add exception handler to decoder and reduce some noise check-in: 5ce7b7ae18 user: matt tags: v2.0001
2022-01-19
18:58
Rewire inputs and outputs to address tcp-server stuff. check-in: c6f20213d4 user: matt tags: v2.0001
16:40
Convert (print ...) to (debug:print ...) Leaf check-in: 57f679f8db user: matt tags: v2.0001-fix-prints
13:27
Added inmem check-in: f1db41ee97 user: matt tags: v2.0001
13:25
Added very conservative (and slow) encode/decode serialization to be resiliant over transport problems. Fixed transport problem created by use of print. Leaf check-in: e4218567cc user: matt tags: v2.0001-inmem
2022-01-18
19:14
WIP: Enabled inmem. Works for somecases, smashes the heap on megatest -run check-in: 871f527729 user: matt tags: v2.0001-inmem
08:43
Make simple the default check-in: 27444d9beb user: matt tags: v2.0001
08:36
Added more missing files Leaf check-in: 880bf0094c user: matt tags: v2.0001-configurable-transport
08:31
Added missing file check-in: 455df0180e user: matt tags: v2.0001-configurable-transport
2022-01-17
18:32
ulex-simple now working well. check-in: ae15b052c0 user: matt tags: v2.0001-configurable-transport
18:07
wip, ulex-simple server starts for main.db check-in: 5a981df3db user: matt tags: v2.0001-configurable-transport
16:42
wip check-in: 7f7a2e36c5 user: matt tags: v2.0001-configurable-transport
16:07
wip check-in: b7b88f7d43 user: matt tags: v2.0001-configurable-transport
14:06
wip, ulex-simple progressing a bit check-in: 337ae6b713 user: matt tags: v2.0001-configurable-transport
2022-01-16
12:24
no transport option basically working (db locks after a while). check-in: 63c4fcc524 user: matt tags: v2.0001-configurable-transport
08:55
Added none as transport option check-in: d8959da4df user: matt tags: v2.0001-configurable-transport
08:05
configurability working ok check-in: ac3127fbf2 user: matt tags: v2.0001-configurable-transport
06:46
Compile time configurable transport check-in: 52ee3494cc user: matt tags: v2.0001-configurable-transport
2022-01-15
20:34
Moved all the database management logic from rmtmod into new module dbmgrmod. check-in: 42c6e0e1be user: matt tags: v2.0001
2022-01-14
19:09
Changed ULEX warning to give info on round trip time when excessive. check-in: 05dacbc68b user: matt tags: v2.0001
17:57
merged work for using csm for compiling check-in: fc3edb2f32 user: matt tags: v2.0001
08:15
Merged changes from v2.0001 check-in: 3253e6faaa user: matt tags: v2.0001-ulex-one-shot
08:13
wip check-in: eccf4ded3f user: matt tags: v2.0001-ulex-one-shot
08:13
This combo of (no) mutexes seems to work best but the blocking still happens check-in: 09d825a5e1 user: matt tags: v2.0001
06:25
Fixed serialize to be compatible with scm check-in: 829acf0839 user: matt tags: v2.0001
05:49
Move close-output-port to right after sending serialize data Leaf check-in: ec82c7ffc8 user: matt tags: v2.0001-blocking-fix
02:19
Does megatest.scm work as a pure module? Leaf check-in: 3406c84170 user: matt tags: v2.0001-scm-prep
02:00
Break megatest into module and top file. check-in: cdb3e61c40 user: matt tags: v2.0001-scm-prep
00:43
Break serialize-env into two files for scm check-in: 445f1a1231 user: matt tags: v2.0001
00:35
Missed hostinfo.scm check-in: b542bf1f82 user: matt tags: v2.0001
00:34
Removed need for old hostinfo egg check-in: c3e3d94576 user: matt tags: v2.0001
2022-01-13
23:56
Merged Leaf check-in: caf99578ef user: matt tags: v2.0001-ulex-one-shot
22:57
Removed qrykey from some calls check-in: b40bfb8bf8 user: matt tags: v2.0001-ulex-one-shot
18:50
Merged fork check-in: 6bbd0fa9a2 user: matt tags: v2.0001, ulex-smoketest
06:18
wip check-in: fb2aca7823 user: matt tags: v2.0001-ulex-one-shot
2022-01-12
17:49
Switched back to tcp6 check-in: 1b8dcc586b user: matt tags: v2.0001-ulex-one-shot
16:52
Sync up with v2.0001 check-in: d7b4fe7a7f user: matt tags: v2.0001-ulex-one-shot
16:40
wip, misc cleanup and reduce some messages. check-in: 20b4054f76 user: matt tags: v2.0001
2022-01-11
09:00
Go back to single log for a server. The splitting of the logs was not proving useful check-in: b4ff9e2f1d user: matt tags: v2.0001
2022-01-10
17:46
Just randomly tried mailbox/mailbox and it seems to be working pretty well. Wierd. check-in: 3d29ed0bb1 user: matt tags: v2.0001
12:54
wip check-in: 9ae53d1765 user: matt tags: v2.0001-ulex-one-shot
12:45
Try one-shot tcp transport check-in: cbc1276205 user: matt tags: v2.0001-ulex-one-shot
07:55
Use ulex-simple to explore using tcp-server egg check-in: f885e8c541 user: matt tags: v2.0001
06:42
Added support to switch between various methods of handling call loops check-in: 10af298b33 user: matt tags: v2.0001
2022-01-08
20:46
Switch to using threads instead of mailbox for worker calls. Seems to not block as much. check-in: ba5884c651 user: matt tags: v2.0001
2022-01-07
17:11
wip. not much improvement... check-in: 49f0afc304 user: matt tags: v2.0001
2022-01-06
18:18
Ensure api calls to db do NOT occur on non-server processes. check-in: 7696fcfff8 user: matt tags: v2.0001
08:36
Added simple ulex (used as a sanity checker check-in: acda13e7e1 user: matt tags: v2.0001
08:10
Tweaked debug.scm check-in: 6e2f351dc9 user: matt tags: v2.0001
2022-01-05
20:59
wip check-in: 94e8e9f0b5 user: matt tags: v2.0001
17:36
Experiments in bypassing parts of the ulex flow. Leaf check-in: 51f97e7aaf user: matt tags: v2.0001-ulex-experiment
11:48
Put megatest main call into thread so that mailboxes work check-in: a4d8d9166c user: matt tags: v2.0001
10:38
wip. still blocking issues check-in: 1e01693b9c user: matt tags: v2.0001
2022-01-04
21:11
wip check-in: 8e478a8774 user: matt tags: v2.0001
07:58
wip check-in: 3881155cc5 user: matt tags: v2.0001
2022-01-03
18:31
Switch to s11n for serialization in place of read/write. check-in: 939ef5990f user: matt tags: v2.0001
18:24
wip, more tests passing check-in: 3333a49fd4 user: matt tags: v2.0001
17:38
wip. rmt:get-keys now works check-in: 3541d27302 user: matt tags: v2.0001
12:01
main.db and <run>.db servers working with ulex check-in: 2f2d804be0 user: matt tags: v2.0001
09:34
wip check-in: db564d80d9 user: matt tags: v2.0001
2022-01-02
20:49
wip check-in: 844a9d0924 user: matt tags: v2.0001
18:44
wip check-in: 9579cb5f06 user: matt tags: v2.0001
18:09
wip, merged remotedat and servdat and put single copy in *db-serv-info* check-in: e7444b7d34 user: matt tags: v2.0001
2021-12-31
21:50
updates, wip check-in: 3b9599228a user: matt tags: v2.0001
19:24
wip check-in: 4622e2fbb0 user: matt tags: v2.0001
2021-12-30
07:39
Correct params for setup-listener and fix make deps for ulex check-in: 48b4e09917 user: matt tags: v2.0001
2021-12-29
08:18
Compiles! check-in: 0c8311b49b user: matt tags: v2.0001
2021-12-28
20:01
Moved server shutdown stuff to on-exit check-in: 696298f9a4 user: matt tags: v2.0001
2021-12-27
20:55
wip - doesn't compile check-in: 0e7ed315a4 user: matt tags: v2.0001
2021-12-26
20:14
Attempt to switch from nng to ulex check-in: 6c52169286 user: matt tags: v2.0001
2021-12-23
20:16
get host name automatically in test Leaf check-in: e80ba42389 user: matt tags: v2.001, Uses-nng-nanomsg
19:36
Fixed typo, added a bit to the test check-in: a0652877c1 user: matt tags: v2.001
18:49
Loop back test passes for ulex check-in: be9a24b8c3 user: matt tags: v2.001
18:46
Loop back test passes for ulex check-in: bd0896dbd6 user: matt tags: v2.001
16:33
ulex compiles check-in: 8860d05092 user: matt tags: v2.001
2021-12-22
19:51
Looking a resurecting ulex - but without all the stuff beyond a transport layer. check-in: f88b668106 user: matt tags: v2.001
2021-12-21
18:54
Added beginnings of stress test for nng transport check-in: 421c5670ac user: matt tags: v2.001
17:47
all-rmt unit tests pass check-in: 9f85a4b1dd user: matt tags: v2.001
12:46
wip check-in: 58cfc286d8 user: matt tags: v2.001
2021-12-20
18:48
wip check-in: a9fa8512c8 user: matt tags: v2.001
18:34
More working check-in: 24be385550 user: matt tags: v2.001
16:26
Basic listing of servers working check-in: 4e80b340f3 user: matt tags: v2.001
15:57
fixed get-servers-info check-in: a486adf12f user: matt tags: v2.001
15:09
wip, closer ... check-in: 38752283aa user: matt tags: v2.001
15:00
wip, closer ... check-in: d45dbac9d7 user: matt tags: v2.001
2021-12-19
20:28
wip check-in: 9f1a2f71d3 user: matt tags: v2.001
2021-12-18
20:09
Improved results from unit tests. WIP check-in: bb1843a1b0 user: matt tags: v2.001
20:07
Improved results from unit tests. WIP check-in: e2e75e9fde user: matt tags: v2.001
17:53
fixed bad call check-in: 90f865fbd4 user: matt tags: v2.001
14:47
fixed bad call check-in: 7d2dde810d user: matt tags: v2.001
14:33
wip check-in: c74886dad6 user: matt tags: v2.001
05:45
WIP - doesn't compile check-in: 9607b06dff user: matt tags: v2.001
More ↓