Megatest

Timeline
Login

200 descendants of 883ba16e82b6bacd

2023-04-10
19:36
Improved run away server throttling check-in: 4115ca72bc user: matt tags: v1.80
16:16
Some updates from code review check-in: 448f45b91b user: mrwellan tags: v1.80
11:58
Merged fork check-in: 962cf22780 user: mrwellan tags: v1.80
07:58
fixed start up wedging check-in: ce4cc8997a user: matt tags: v1.80
06:09
load control is working but servers are still getting wedged over time check-in: 9771b5d5a9 user: matt tags: v1.80
2023-04-09
22:14
flag loaded at 50 threads. check-in: 4c1e85ecfb user: matt tags: v1.80
21:51
Partial implementation of using the loaded flag to throttle on client side. Need to turn off all server side throttling check-in: b79f855fba user: matt tags: v1.80
21:07
Use run-id in queries looking for test info. Can't assume test-ids are unique. Added separate exception handler for serialization to help with debug (still causes grief when hit but at least you can find the issue but looking in server logs). check-in: ea060a034b user: matt tags: v1.80
14:45
Clean up uses of tcp. tcp6 did not seem to work. Increased tcp backlog (didn't seem to help) and improved backoff check-in: 4860a4e6aa user: matt tags: v1.80
13:27
Added host name to messages about server not started check-in: 21f45d51cf user: mmgraham tags: v1.80
2023-04-08
11:48
Added better fallback on communication failure. check-in: 7dcbd017e3 user: matt tags: v1.80
02:45
Removed assert from simple lock. Removed use of statement cache which fixed bind issues check-in: 532f050f93 user: matt tags: v1.80
2023-04-07
08:25
Added switchable support for db on /tmp instead of inmem. Added couple asserts to help find why run-id and servers are not aligned in some cases. check-in: cfcc13973c user: matt tags: v1.80
03:56
For /tmp db cache disambiguate the db with pid check-in: 481acc5191 user: matt tags: v1.80
2023-04-06
22:32
Moved few functions around. Added beginnings of being able to use /tmp/ db in place of inmem check-in: 5e665a1f75 user: matt tags: v1.80
20:25
Cherrypicked fix for ticket c10775f9d83a4e29f50f9ccdbfc9fd326f493e2e from e37f check-in: 8982b550f7 user: matt tags: v1.80
20:22
Cherrypick forward 07ba2e and 3e5f, chicken 5 work Leaf check-in: 3d39f8f19d user: matt tags: v1.80-chicken5-stuff
20:00
cleanup - 57d44 check-in: 5dac6d2e49 user: matt tags: v1.80
19:26
Some cleanup and more added to plot units as graph (c1077 and 198ba). check-in: 2336d19a47 user: matt tags: v1.80
19:19
Bunch of cleanup. Ran pretty well, no worse than last commit and maybe bit better. Got as far as y/b/a and w/b/a check-in: 7bfbd68003 user: matt tags: v1.80
16:37
merge-fork check-in: c574c7b21b user: matt tags: v1.80
16:25
Added asserts, improved message/assert on lock failure check-in: eca566d9f9 user: mmgraham tags: v1.80
13:32
Make server logs not overlap on server.log - this makes debug easier check-in: 3053005860 user: matt tags: v1.80
09:23
Fixed performance issue with append in runs.scm check-in: 0dc6c83d6e user: matt tags: v1.80
08:01
Fixed MTLOWEST load check-in: 71f876d389 user: matt tags: v1.80
06:35
Turn on portlogger check-in: 5cf2865c15 user: matt tags: v1.80
06:25
Return to using portlogger for getting candidate port numbers. Got dependencies fixed so make -j now works check-in: c8631e33de user: matt tags: v1.80
01:48
Changed a missed .megatest to .mtdb. Removed useless thread. Removed old commented code. check-in: 909cd71d01 user: matt tags: v1.80
2023-04-03
18:41
Changed tmpdir path to toppath in dashboard:database-changed? to correct run control tab slowness. Removed 2 duplicate functions. check-in: 8a59e78cc4 user: mmgraham tags: v1.80
15:22
Cherrypicked fix for remove-keep check-in: 5bfcab67c7 user: matt tags: v1.80
15:08
Fixed ticket c10775f9d83a4e29f50f9ccdbfc9fd326f493e2e Closed-Leaf check-in: e37f1ded41 user: matt tags: v1.80-mbi
2023-04-01
21:20
Another file (mostly) ported to chicken 5 check-in: 3e5fcece74 user: matt tags: v1.80-mbi
18:08
Converted couple more files to ck5 check-in: 07ba2ed8da user: matt tags: v1.80-mbi
2023-03-31
21:32
More cleanup check-in: 57d442213a user: matt tags: v1.80-mbi
17:56
Add filter to plot-uses check-in: 198baf1267 user: mrwellan tags: v1.80-mbi
16:30
Minor clean up of units check-in: c10775f9d8 user: mrwellan tags: v1.80-mbi
09:26
Expanding refactoring, not compilable. Closed-Leaf check-in: c390ddefd1 user: matt tags: v1.80-refactor1, v1.80-mbi
2023-03-30
09:28
Added rmtmod where needed check-in: 5aedc5c5f0 user: matt tags: v1.80-mbi
2023-03-29
21:59
Remove some (most?) of http-transport, client and server stuff check-in: c43db14a6d user: matt tags: v1.80-mbi
2023-03-27
19:33
Changed version to 1.8012. check-in: bcc22ebf3c user: mmgraham tags: v1.80, v1.8012
18:15
Lots of proper use of debugprint and mtargs plus some small cleanup. check-in: 7060a6d776 user: mrwellan tags: v1.80
15:51
merged fork check-in: f7059c9604 user: mrwellan tags: v1.80
15:49
Removed use of margs check-in: fba5bad548 user: mrwellan tags: v1.80
13:06
changed more cases of .megatest to .mtdb check-in: 85ebde8764 user: mmgraham tags: v1.80
2023-03-22
19:40
Changed .megatest to .mtdb in several places check-in: 332dd9df31 user: mmgraham tags: v1.80
13:01
Merged fork check-in: 9fe68a8fb2 user: mrwellan tags: v1.80, v1.8011
09:05
Merged mtdb change. check-in: a50d34f842 user: mrwellan tags: v1.80
2023-03-21
21:09
Converted .megatest to .mtdb Leaf check-in: f00c7b0bd9 user: matt tags: v1.80-mtdb
20:07
Change .megatest -> .mtdb check-in: 8bd0fd0763 user: mrwellan tags: v1.80-mtdb
16:10
disabled syncing of test steps and test data check-in: c2e29b696d user: mmgraham tags: v1.80, v1.8009
08:46
Merged fork check-in: 747321a245 user: mrwellan tags: v1.80
08:35
Merged fork check-in: 664605b88d user: mrwellan tags: v1.80
08:22
Fixed dashboard refresh and test control panel setting of state/status check-in: 35a835818f user: matt tags: v1.80
2023-03-20
10:17
changed version to 1.8009. check-in: 901bbd55b3 user: icfadm tags: v1.80, v1.8009
07:31
Make nfs mode default for dashboard check-in: aaa4fca591 user: matt tags: v1.80
07:09
Added run-id to test output on import-sexpr for sanity checking by user check-in: 78ea3ef6e3 user: matt tags: v1.80
2023-03-19
22:16
Added -import-sexpr check-in: 996a9b8e3d user: matt tags: v1.80
2023-03-17
11:31
Partial implementation on import sexpr check-in: 7d130344e0 user: matt tags: v1.80
2023-03-16
21:18
Added skeleton of sexpr run importer check-in: dd23dd3b14 user: matt tags: v1.80
06:13
Beginnings of dual ck5/ck4 build support. check-in: fdfdc48e5f user: matt tags: v1.80
2023-03-15
10:03
I saw a couple tcp errors with threads in flight of 500. Reducing to 200 and got clean sixtyfivek fast run. check-in: 34fa77c2e3 user: matt tags: v1.80
2023-03-14
21:42
This combo seemed about as robust as any check-in: 80c20a647d user: matt tags: v1.80
11:17
Merged fork check-in: d8ef55d077 user: mrwellan tags: v1.80
09:26
Fixed couple issues with setting server timeout. Reverted viewscreen to start in background as it didn't work properly without that. check-in: dda2fe1e9e user: matt tags: v1.80
08:06
Make server timeout configurable using existing settings check-in: ad08451b0a user: matt tags: v1.80
2023-03-13
12:16
Changed version to 1.8008 check-in: d917a7ad37 user: mmgraham tags: v1.80, v1.8008
08:37
Updated transport-mode templates check-in: 83e24c295f user: matt tags: v1.80
2023-03-12
12:47
Got original sync working again check-in: 21debe6bae user: matt tags: v1.80
08:54
Fixed no-sync-db crash check-in: d79897a765 user: matt tags: v1.80
2023-03-11
20:47
Remove noise check-in: 49abec32c1 user: matt tags: v1.80
17:12
This seems to be working but it should not. check-in: ab6d2aae1a user: matt tags: v1.80
14:40
Bit better check-in: 3db414f444 user: matt tags: v1.80
13:10
Partially complete update to configuration' check-in: 0f8bf614e9 user: matt tags: v1.80
12:39
fixed unprotected vector-length check-in: c2a555afb1 user: matt tags: v1.80
10:37
WIP, getting nfs working again check-in: 79f9af8364 user: matt tags: v1.80
2023-03-03
18:32
no crashes (yet) check-in: 349234dd61 user: mrwellan tags: v1.80
17:37
wip check-in: abb2c73974 user: mrwellan tags: v1.80
02:16
Speculative fix for wrong server access issue check-in: 0f348aa84b user: mrwellan tags: v1.80
2023-03-02
21:32
Improve some of the logic around servers check-in: 87813c75d2 user: mrwellan tags: v1.80
19:19
Better message check-in: c3879943f0 user: mrwellan tags: v1.80
19:12
Locking of db check-in: 494cb9b035 user: mrwellan tags: v1.80
2023-03-01
21:29
Speculative fix for transaction crash. Check if there is a transaction before proceeding. check-in: e8d8a38e49 user: mrwellan tags: v1.80
10:22
Added template for dashboard-transport-mode.scm check-in: 50f20490df user: mrwellan tags: v1.80
07:41
ATTACH sync working ok. check-in: f803cb519f user: matt tags: v1.80
2023-02-28
20:27
ATTACH Sync not working. check-in: 692ebd2f40 user: mrwellan tags: v1.80
2023-02-27
21:25
Added function for using ATTACH for sync between db's. Not yet in use. check-in: dca3a45c98 user: mrwellan tags: v1.80
10:54
Added suicide mode to db:with-db for development. It has been very hard to isolate threaded crashes under the tcp-server. check-in: 3b54f22608 user: mrwellan tags: v1.80
2023-02-23
11:53
Fixed get-target check-in: 78fc9c5443 user: matt tags: v1.80
08:46
configf ext-tests fixed. check-in: 5cb7bf9076 user: matt tags: v1.80
06:04
rmt:get-key-val-pairs was using wrong db. check-in: 335653cb5f user: matt tags: v1.80
2023-02-22
12:27
Improved messages on -list-runs check-in: c8040a78fa user: matt tags: v1.80
11:42
bumped allowed number of running servers check-in: 5fca83553e user: mrwellan tags: v1.80
11:12
Merged tcp-inmem check-in: 47a4f89869 user: mrwellan tags: v1.80
11:05
Oops. Was not creating .megatest directory. Leaf check-in: 0386246065 user: mrwellan tags: v1.80-tcp-inmem
2023-02-21
21:35
Silence noise from tcp-server. Turn on throttling. check-in: a8b8aa106f user: matt tags: v1.80-tcp-inmem
20:25
Fixed few minor issues and got creation of temporary no-sync in .megatest dir working ok. check-in: 6e2393b843 user: matt tags: v1.80-tcp-inmem
17:58
Switching default to tcp/inmem on build check-in: 2b61f8385c user: matt tags: v1.80-tcp-inmem
17:47
Fixed sync back check-in: 5e7e64a893 user: matt tags: v1.80-tcp-inmem
17:02
merged fork check-in: d8fae05b29 user: matt tags: v1.80-tcp-inmem
16:54
Fixed run-id issue that caused wrong db to be addressed. check-in: c2f5ef0caf user: matt tags: v1.80-tcp-inmem
15:40
wip check-in: b51df9a459 user: matt tags: v1.80-tcp-inmem
11:39
server start smooth, but initial data load to inmem broken. check-in: 677b6ef8e8 user: matt tags: v1.80-tcp-inmem
2023-02-20
22:58
corrected match-let args in server:kill check-in: 8a443df8a9 user: mmgraham tags: v1.80-tcp-inmem
20:05
Hacky solution for no-sync db check-in: b8f2578046 user: matt tags: v1.80-tcp-inmem
14:17
wip. better but now there are run-away issues in ext-tests: check-in: 94e5d1fb43 user: matt tags: v1.80-tcp-inmem
10:32
wip check-in: 0ac0c8e72f user: matt tags: v1.80-tcp-inmem
08:35
wip, dashboard and list-runs work check-in: 4eb82b3919 user: matt tags: v1.80-tcp-inmem
07:16
Removed dbmemmod.scm check-in: 74ff6cc920 user: matt tags: v1.80-tcp-inmem
2023-02-19
22:01
misc needed fixes check-in: 263e0fe253 user: matt tags: v1.80-tcp-inmem
21:23
Sync back implemented, compiles but not tested check-in: c70de6806c user: matt tags: v1.80-tcp-inmem
20:14
list runs now working with data sync'd from ondisk to inmem (but no last_update support). check-in: 12db00e83a user: matt tags: v1.80-tcp-inmem
19:19
Couple fixes. basic queries, register-test, get-test-id, login, working and starting a server on demand check-in: 9e78ced13a user: matt tags: v1.80-tcp-inmem
18:41
Basic communication working, ping, get-keys. check-in: e01a10845a user: matt tags: v1.80-tcp-inmem
10:37
rmt:send-receive -> tt:handler -> tcp -> api:tcp-dispatch-request -> api:dispatch-request and back implemented and compiles. check-in: a91d15ac06 user: matt tags: v1.80-tcp-inmem
2023-02-18
20:32
server registation and timeout working check-in: 743e63bc9e user: matt tags: v1.80-tcp-inmem
2023-02-17
16:27
Fixed megatest -list-servers. Handled the changes in the server info list returned by choose-server check-in: c9e2a1cd70 user: mmgraham tags: v1.80-tcp-inmem
06:02
Merged fork check-in: f756aa00cd user: matt tags: v1.80-tcp-inmem
2023-02-16
22:05
wip check-in: 2c448364b3 user: matt tags: v1.80-tcp-inmem
21:40
wip check-in: 372980efb7 user: matt tags: v1.80-tcp-inmem
21:16
Mixed up tt:handler and tt:client-connect-to-server. tt:handler is a bad name. check-in: 3970f89cba user: matt tags: v1.80-tcp-inmem
20:52
wip check-in: 0cc9990634 user: matt tags: v1.80-tcp-inmem
19:53
Removed last 2 args from definition of http-transport-handler check-in: 4193a11be6 user: mmgraham tags: v1.80-tcp-inmem
19:07
added mtargs declaration and import check-in: 4a7d4f4801 user: mmgraham tags: v1.80-tcp-inmem
13:24
wip, compiles check-in: 12dfb79088 user: matt tags: v1.80-tcp-inmem
11:21
wip check-in: 36613fed83 user: matt tags: v1.80-tcp-inmem
2023-02-15
21:37
wip check-in: 0588f96563 user: matt tags: v1.80-tcp-inmem
19:57
wip check-in: 3528bbcf9e user: matt tags: v1.80-tcp-inmem
19:28
wip. compiles. check-in: 24ddf5d235 user: matt tags: v1.80-tcp-inmem
19:21
wip. compiles. check-in: 4c52a47431 user: matt tags: v1.80-tcp-inmem
15:39
Make tcp vs. http compile time configurable. check-in: 3ca4260740 user: matt tags: v1.80-tcp-inmem
14:17
wip check-in: e0ef4cda9d user: matt tags: v1.80-tcp-inmem
08:22
wip - does not compile check-in: ab238c7c30 user: matt tags: v1.80-tcp-inmem
2023-02-13
04:56
missing param setting Leaf check-in: 5c56271302 user: matt tags: v1.80-debugprint
2023-02-12
20:21
wip check-in: 278a10af86 user: matt tags: v1.80-tcp-inmem
16:39
wip check-in: 444956dd03 user: matt tags: v1.80-tcp-inmem
10:52
wip - start tcp/inmem check-in: 1a2eb25cb6 user: matt tags: v1.80-tcp-inmem
2023-02-10
21:22
rebased v1.80-debugprint forward check-in: 9d2772b077 user: matt tags: v1.80-debugprint
21:16
Merge v1.80-cleanup as it passed QA check-in: 34c5263e66 user: matt tags: v1.80
21:06
Merging pretty good branch v1.80-dbperf to v1.80 check-in: 7170e5f43b user: matt tags: v1.80
20:19
Use debugprint module in dbfile module as stepping stone to replacing old debug:print calls with new. Closed-Leaf check-in: 0e8fa15f1d user: matt tags: v1.80-debugprint
09:48
Factor out http-transport aspect of rmt.scm in preparation for adding tcp-transport.scm Closed-Leaf check-in: bce6a00a70 user: matt tags: v1.80-dbperf
2023-02-09
11:02
Made wait-for-qif remove all old queries Leaf check-in: 93c1073c06 user: mmgraham tags: v1.80-close-idle-connections
2023-02-07
16:24
fix for assert check-in: a7577f7a9b user: pjhatwal tags: v1.80-close-idle-connections
2023-02-06
19:35
Squashed v1.80-dbperformance into one commit check-in: 6c7b8be468 user: matt tags: v1.80-dbperf
2023-02-05
11:47
Minor clean up. There were a couple communication errors in sixtyfivek but they looked likely to be host related. Closed-Leaf check-in: e973b1fb77 user: matt tags: v1.80-cleanup
08:36
wip, close idle db connections check-in: 97a3c4ad11 user: matt tags: v1.80-close-idle-connections
2023-02-04
20:00
Change default number of db's to 10, couple minor fixes. Closed-Leaf check-in: 7b86032d25 user: matt tags: v1.80-dbperformance
2023-02-03
21:51
Reduce zombie cleanup, not clear it helps check-in: c8ec459e79 user: matt tags: v1.80-dbperformance
21:50
Cleanup droop curve a bit check-in: 07b36fe461 user: matt tags: v1.80-dbperformance
18:48
Bumped the default to four dbs and changed the droop curve to an exponential. check-in: 7f96283a66 user: matt tags: v1.80-dbperformance
17:29
control # of dbs with parameter num-run-dbs, default=2. check-in: cd56c55e6a user: matt tags: v1.80-dbperformance
07:11
attempt to reduce load on db by requesting state/status instead of entire record check-in: 88116f8ed3 user: matt tags: v1.80-dbperformance
02:16
Reduce load from get-state-status-and-roll-up-run. check-in: 4e634eb46a user: matt tags: v1.80-dbperformance
2023-02-02
12:54
Use an actual droop check-in: 19861e6399 user: matt tags: v1.80
09:27
Change couple queries to use prepared statements check-in: a2e41e0613 user: matt tags: v1.80
07:55
Bumped version check-in: 3a1cd3629b user: matt tags: v1.80
07:22
Enable disabling of condition-case around db access. Default is off for now. check-in: 7444f60c97 user: matt tags: v1.80
06:39
improved droop curved for queries in flight (qif). check-in: d1dc75ffab user: matt tags: v1.80
2023-02-01
23:41
added qif check-in: 7e09817061 user: matt tags: v1.80
20:38
Convert one statement to prepared, test and do more check-in: 87e172c693 user: matt tags: v1.80
15:22
Fixed ping not cleaning up connections check-in: 48aa93366a user: matt tags: v1.80
06:11
Pulled in ulex from v2.0 check-in: 69eb6e4304 user: matt tags: v1.80
2023-01-31
21:17
Fixed old conninfo record not being properly removed from runremote check-in: 676fe7701a user: matt tags: v1.80
18:42
converging on imports done right (but not there yet). Leaf check-in: c1e0d8251a user: matt tags: v1.80-reshape
08:23
Rearranged imports and uses and now past the dreaded can't import debugprint. check-in: 474192c412 user: matt tags: v1.80-reshape
06:47
Re-arranged uses and imports and it worked better Leaf check-in: f308bbcbc0 user: matt tags: v1.80-reshape-no-debugprint
2023-01-30
22:06
removed all imports of debugprint and still can't run megatest exe check-in: 5de6734970 user: matt tags: v1.80-reshape-no-debugprint
20:20
wip check-in: a51a5d6058 user: matt tags: v1.80-reshape
2023-01-29
22:01
wip-no-compile check-in: 9f479c2454 user: matt tags: v1.80-reshape
21:32
Beginnings of client implemented check-in: bd65c3fcb5 user: matt tags: v1.80-reshape
20:04
wip check-in: ce20e5667d user: matt tags: v1.80-reshape
19:13
Server side coded up and compiles. Not actually tested. check-in: 194a7192cf user: matt tags: v1.80-reshape
2023-01-27
18:32
Merged from v1.80 check-in: 3d8270b891 user: matt tags: v1.80-reshape
17:01
server:setup additions check-in: ff7e665911 user: mrwellan tags: v1.80-reshape
2023-01-26
04:01
Added some reference docs on servers check-in: f6037c5e9e user: matt tags: v1.80
2023-01-25
07:34
Synced in ulex from v2.0001 check-in: 6e38a56108 user: mrwellan tags: v1.80-reshape
2023-01-23
09:04
wip check-in: 74613be421 user: matt tags: v1.80-reshape
2023-01-22
17:48
cherrypicked change to fix args to db:caution-open-database check-in: 458bd9aea8 user: mmgraham tags: v1.80, v1.8006
16:58
Uncommented (remote-conndat runremote) to fix crash when dashboard left idle check-in: 610857aa28 user: mmgraham tags: v1.80
01:45
wip check-in: d78cc9a775 user: matt tags: v1.80-reshape
2023-01-20
07:35
Added artifacts.scm check-in: 5a12983c80 user: matt tags: v1.80
07:30
Merged v1.80 check-in: 0859376e2d user: matt tags: v1.80-reshape
07:29
Added artifacts (will replace pkts) check-in: 7fa5291a80 user: matt tags: v1.80
2023-01-19
20:54
Added mtserv check-in: cd59e5a125 user: matt tags: v1.80-reshape
19:52
Refactor start check-in: f7272f26b7 user: matt tags: v1.80-reshape
04:32
Print info on closing connections always Leaf check-in: f5f9bc5c6c user: matt tags: v1.80-toomanyfiles
04:14
Removed added attempt to save server info in runremote. check-in: b290688bbb user: matt tags: v1.80-toomanyfiles
03:46
client setup was not updating runremote in some scenarios check-in: 3f4bf437c0 user: matt tags: v1.80-toomanyfiles
2023-01-18
22:17
Missing fix check-in: c608ac13c7 user: matt tags: v1.80
22:13
Missing fix check-in: ff975ecd14 user: matt tags: v1.80
22:11
Pulled in two needed fixes. check-in: 3936bce446 user: matt tags: v1.80
21:53
corrected misnamed funciton Leaf check-in: a9180a343b user: matt tags: v1.80-refactor-fix1
21:46
Removed bad call to close-connection! check-in: 463fffbd79 user: matt tags: v1.80-refactor-fix1
18:34
Changed version to 1.8006 check-in: 302c2637e5 user: mmgraham tags: v1.80
18:21
Normalize toppath for /tmp db area to address weird csh /home/matt/data/megatest vs. pwd.

Get DEADs after a while. There is a crash related to connection handling. check-in: e2a27caa33 user: matt tags: v1.80

2023-01-16
21:42
v1.80-notbetter Leaf check-in: 5287e50105 user: matt tags: v1.80-refactor
15:53
Most sqlite3: calls now prepared and cached. check-in: bcf8145611 user: matt tags: v1.80-refactor
14:09
Cleaned up prepared db statements handling. check-in: 2639de81a8 user: matt tags: v1.80-refactor
12:17
last of overt connection issues addressed. TCP connections growing very slowly. However now the db issues are manifesting. check-in: 22f2c33711 user: matt tags: v1.80-transport-cleanish, v1.80-refactor
10:00
Major refactor/clean up of client connection stuff. Removed old crufty approach of having both client and server side calls in http-transport. Plan would be to eventually get rid of http-transport.

Open files slowly grows. bad argument type in http-transport. Line 285 (close-connection! fullurl) is wrong. check-in: 67b18cc991 user: matt tags: v1.80-refactor

04:20
Original call to close-connections! was correct check-in: 883ba16e82 user: matt tags: v1.80