Megatest

Check-in [7f0234156e]
Login
☰Home Timeline Files Branches Tags Tickets Wiki Login
Overview
Comment:Updated docs
Downloads: Tarball | ZIP archive | SQL archive
Timelines: family | ancestors | descendants | both | trunk
Files: files | file ages | folders
SHA1: 7f0234156e5751bc260aa53df368ff513b3ccd90
User & Date: matt on 2012-01-29 18:08:20
Other Links: manifest | tags
Context
2012-01-29
18:31
Fixed pdf generation check-in: ad6b10c9ae user: matt tags: trunk
18:08
Updated docs check-in: 7f0234156e user: matt tags: trunk
18:07
Fixed handling of runname in test path search check-in: 3dbc84ebdc user: matt tags: trunk
Changes
Hide Diffs Side-by-Side Diffs Ignore Whitespace Patch

Modified docs/Makefile from [5dc57d7419] to [f4090be0f6]. 

1
2
3
4
5
6
7
8
9
10

11

1
2
3
4
5
6
7
8
9

10
11










-
+


all : html/megatest.html megatest.lyx

html/megatest.html : megatest.lyx
	rm -rf megatest.html.LyXconv
	lyx -e html megatest.lyx
	cp megatest.html.LyXconv/* html/
	fossil add html/*

megatest.pdf : megatest.lyx
	lyx -e pdf megatest.pdf
	lyx -e pdf megatest.lyx

Modified docs/html/dashboard-test.png from [ebb55ccc44] to [c539143ccf].

cannot compute difference between binary files

Modified docs/html/dashboard.png from [b70293a297] to [12ba87e86e].

cannot compute difference between binary files

Modified docs/html/megatest.html from [8244fd728a] to [fbcbf168b7]. 

1
2
3
4
5
6
7

8
9
10
11
12
13
14

1
2
3
4
5
6

7
8
9
10
11
12
13
14







-
+








<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>
<meta name="generator" content="http://www.nongnu.org/elyxer/"/>
<meta name="create-date" content="2011-12-15"/>
<meta name="create-date" content="2012-01-29"/>
<link rel="stylesheet" href="http://elyxer.nongnu.org/lyx.css" type="text/css" media="all"/>
<title>Megatest User Manual</title>
</head>
<body>
<div id="globalWrapper">
<div class="Standard">
︙
22
23
24
25
26
27
28
29

30
31
32
33
34
35
36
37
38
39
40

22
23
24
25
26
27
28

29
30



31
32
33
34
35
36
37








-
+

-
-
-








<h1 class="title">
Megatest User Manual
</h1>
<h2 class="author">
Matthew Welland
</h2>
<h2 class="Date">
Sept. 20, 
Jan. 29, 2012 
</h2>
<div class="Standard">
<span class="unknown">\thispagestyle</span>empty
</div>
<div class="Standard">
<p><br/>
</p>
©2011 Matthew Welland. All rights reserved. 
</div>
<div class="Standard">
Megatest is free software released under the General Public License v2.0. Please see the file COPYING in the source distribution for details.
︙
211
212
213
214
215
216
217
218

219
220
221
222
223
224
225

226

227
228

229
230
231
232

233
234
235
236

237


238

239
240

241
242
243
244

245




246
247
248

249

250
251

252
253
254

255
256
257

258
259



260

261
262
263
264

265
266
267

268
269
270

271
272
273

274
275
276
277

278
279
280

281
282
283
284
285
286
287

208
209
210
211
212
213
214

215
216



217
218

219
220
221
222

223
224

225

226
227
228
229

230
231
232
233
234
235
236

237
238
239
240

241
242
243
244
245
246
247
248

249
250
251
252

253
254
255

256
257
258

259
260
261
262
263
264

265
266
267
268

269
270
271

272
273
274

275
276
277

278
279
280
281

282
283
284

285
286
287
288
289
290
291
292








-
+

-
-
-


-
+

+

-
+

-

-
+



-
+

+
+

+

-
+



-
+

+
+
+
+


-
+

+

-
+


-
+


-
+


+
+
+
-
+



-
+


-
+


-
+


-
+



-
+


-
+








<div class="toc">
<a class="Link" href="#toc-Section-8">Section 8: Dashboard</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Section-9">Section 9: Generating an OpenDocument Spreadsheet from the Database</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Section-10">Section 10: Flows</a>
<a class="Link" href="#toc-Section-10">Section 10: Introspection</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Section-11">Section 11: Flow Specification and Running (Not released yet)</a>
</div>
<div class="tocindent">
<div class="toc">
<a class="Link" href="#toc-Subsection-11.1">Subsection 11.1: Write your flow file</a>
<a class="Link" href="#toc-Subsection-10.1">Subsection 10.1: Getting previous test paths</a>
</div>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsection-11.2">Subsection 11.2: Run the flow</a>
<a class="Link" href="#toc-Section-11">Section 11: Flows</a>
</div>
</div>
<div class="toc">
<a class="Link" href="#toc-Section-12">Section 12: Monitor based running</a>
<a class="Link" href="#toc-Section-12">Section 12: Flow Specification and Running (Not released yet)</a>
</div>
<div class="tocindent">
<div class="toc">
<a class="Link" href="#toc-Subsection-12.1">Subsection 12.1: Monitor logic</a>
<a class="Link" href="#toc-Subsection-12.1">Subsection 12.1: Write your flow file</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsection-12.2">Subsection 12.2: Run the flow</a>
</div>
</div>
<div class="toc">
<a class="Link" href="#toc-Section-13">Section 13: Reference</a>
<a class="Link" href="#toc-Section-13">Section 13: Monitor based running</a>
</div>
<div class="tocindent">
<div class="toc">
<a class="Link" href="#toc-Subsection-13.1">Subsection 13.1: Configuration file Syntax</a>
<a class="Link" href="#toc-Subsection-13.1">Subsection 13.1: Monitor logic</a>
</div>
</div>
<div class="toc">
<a class="Link" href="#toc-Section-14">Section 14: Reference</a>
</div>
<div class="tocindent">
<div class="toc">
<a class="Link" href="#toc-Subsubsection-13.1.1">Subsubsection 13.1.1: Sections</a>
<a class="Link" href="#toc-Subsection-14.1">Subsection 14.1: Configuration file Syntax</a>
</div>
<div class="tocindent">
<div class="toc">
<a class="Link" href="#toc-Subsubsection-13.1.2">Subsubsection 13.1.2: Variables</a>
<a class="Link" href="#toc-Subsubsection-14.1.1">Subsubsection 14.1.1: Sections</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsubsection-13.1.3">Subsubsection 13.1.3: Includes</a>
<a class="Link" href="#toc-Subsubsection-14.1.2">Subsubsection 14.1.2: Variables</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsubsection-13.1.4">Subsubsection 13.1.4: Setting a variable by running a command</a>
<a class="Link" href="#toc-Subsubsection-14.1.3">Subsubsection 14.1.3: Includes</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsubsection-14.1.4">Subsubsection 14.1.4: Setting a variable by running a command</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsubsection-13.1.5">Subsubsection 13.1.5: Notes</a>
<a class="Link" href="#toc-Subsubsection-14.1.5">Subsubsection 14.1.5: Notes</a>
</div>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsection-13.2">Subsection 13.2: Environment variables</a>
<a class="Link" href="#toc-Subsection-14.2">Subsection 14.2: Environment variables</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsection-13.3">Subsection 13.3: megatest.config</a>
<a class="Link" href="#toc-Subsection-14.3">Subsection 14.3: megatest.config</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsection-13.4">Subsection 13.4: runconfigs.config file</a>
<a class="Link" href="#toc-Subsection-14.4">Subsection 14.4: runconfigs.config file</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsection-13.5">Subsection 13.5: Writing tests</a>
<a class="Link" href="#toc-Subsection-14.5">Subsection 14.5: Writing tests</a>
</div>
<div class="tocindent">
<div class="toc">
<a class="Link" href="#toc-Subsubsection-13.5.1">Subsubsection 13.5.1: testconfig file</a>
<a class="Link" href="#toc-Subsubsection-14.5.1">Subsubsection 14.5.1: testconfig file</a>
</div>
<div class="toc">
<a class="Link" href="#toc-Subsubsection-13.5.2">Subsubsection 13.5.2: Command line</a>
<a class="Link" href="#toc-Subsubsection-14.5.2">Subsubsection 14.5.2: Command line</a>
</div>
</div>
</div>
<div class="toc">
<a class="Link" href="#toc-Appendix-A">Appendix A: Data</a>
</div>
<div class="toc">
︙
704
705
706
707
708
709
710
711














712
713
714
715
716
717

718
719
720

721
722
723
724
725
726
727

709
710
711
712
713
714
715

716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734

735
736
737

738
739
740
741
742
743
744
745








-
+
+
+
+
+
+
+
+
+
+
+
+
+
+





-
+


-
+








</div>

</div>
<div class="Standard">
You can optionally specify the keys for your database to limit further the runs to extract into the spreadsheet. The first sheet contains all the run data and subsequent sheets contain data rolled up for the individual tests.
</div>
<h1 class="Section">
<a class="toc" name="toc-Section-10">10</a> Flows
<a class="toc" name="toc-Section-10">10</a> Introspection
</h1>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-10.1">10.1</a> Getting previous test paths
</h2>
<div class="Standard">
<div class="listing">
<pre class="listing">megatest -test-paths -target %/%/% :runname % -testpatt % -itempatt % :status PASS 
</pre>
</div>

</div>
<h1 class="Section">
<a class="toc" name="toc-Section-11">11</a> Flows
</h1>
<div class="Standard">
A flow specifies the tests to run, the order and dependencies and is managed by a running megatest process.
</div>
<h1 class="Section">
<a class="toc" name="toc-Section-11">11</a> Flow Specification and Running (Not released yet)
<a class="toc" name="toc-Section-12">12</a> Flow Specification and Running (Not released yet)
</h1>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-11.1">11.1</a> Write your flow file
<a class="toc" name="toc-Subsection-12.1">12.1</a> Write your flow file
</h2>
<div class="Standard">
flows/&lt;flowname&gt;.config
</div>
<div class="Standard">
<div class="listing">
<pre class="listing"># Flow: &lt;flowname&gt;
︙
743
744
745
746
747
748
749
750

751
752
753
754
755
756
757
758
759
760

761
762
763

764
765
766
767
768
769
770
771
772
773

774
775
776

777
778
779
780
781
782

783
784
785
786
787
788
789
790
791
792
793
794
795

796
797
798
799
800
801
802
803
804
805
806
807
808

809
810
811
812
813
814
815
816
817
818
819
820
821

822
823
824
825
826
827
828
829
830
831
832
833
834

835
836
837
838
839
840
841
842
843
844
845
846

847
848
849
850
851
852
853

761
762
763
764
765
766
767

768
769
770
771
772
773
774
775
776
777

778
779
780

781
782
783
784
785
786
787
788
789
790

791
792
793

794
795
796
797
798
799

800
801
802
803
804
805
806
807
808
809
810
811
812

813
814
815
816
817
818
819
820
821
822
823
824
825

826
827
828
829
830
831
832
833
834
835
836
837
838

839
840
841
842
843
844
845
846
847
848
849
850
851

852
853
854
855
856
857
858
859
860
861
862
863

864
865
866
867
868
869
870
871








-
+









-
+


-
+









-
+


-
+





-
+












-
+












-
+












-
+












-
+











-
+








sim2,setup
sim3,setup
</pre>
</div>

</div>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-11.2">11.2</a> Run the flow
<a class="toc" name="toc-Subsection-12.2">12.2</a> Run the flow
</h2>
<div class="Standard">
<div class="listing">
<pre class="listing">megatest -runflow &lt;flowname&gt; :FIELD1 val1 :FIELD2 val2 :runname wk32.4
</pre>
</div>

</div>
<h1 class="Section">
<a class="toc" name="toc-Section-12">12</a> Monitor based running
<a class="toc" name="toc-Section-13">13</a> Monitor based running
</h1>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-12.1">12.1</a> Monitor logic
<a class="toc" name="toc-Subsection-13.1">13.1</a> Monitor logic
</h2>
<div class="Standard">
Note: The monitor is usable but incomplete as of Megatest v1.31. Click on the &ldquo;Monitor&rdquo; button on the dashboard to start the monitor and give it a try.
</div>
<div class="Standard">
<img class="embedded" src="monitor-state-diagram.png" alt="figure monitor-state-diagram.png" style="max-width: 383px; max-height: 335px;"/>

</div>
<h1 class="Section">
<a class="toc" name="toc-Section-13">13</a> Reference
<a class="toc" name="toc-Section-14">14</a> Reference
</h1>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-13.1">13.1</a> Configuration file Syntax
<a class="toc" name="toc-Subsection-14.1">14.1</a> Configuration file Syntax
</h2>
<div class="Standard">
Note: whitespace is preserved including at the end of line. Ensure your entries only have whitespace at the end of line when needed to avoid problems.
</div>
<h3 class="Subsubsection">
<a class="toc" name="toc-Subsubsection-13.1.1">13.1.1</a> Sections
<a class="toc" name="toc-Subsubsection-14.1.1">14.1.1</a> Sections
</h3>
<div class="Standard">
<div class="listing">
<pre class="listing">[section name]
</pre>
</div>

</div>
<div class="Standard">
This creates a section named “section name”
</div>
<h3 class="Subsubsection">
<a class="toc" name="toc-Subsubsection-13.1.2">13.1.2</a> Variables
<a class="toc" name="toc-Subsubsection-14.1.2">14.1.2</a> Variables
</h3>
<div class="Standard">
<div class="listing">
<pre class="listing">VARX has this value
</pre>
</div>

</div>
<div class="Standard">
The variable “VARX” will have the value “has this value”
</div>
<h3 class="Subsubsection">
<a class="toc" name="toc-Subsubsection-13.1.3">13.1.3</a> Includes
<a class="toc" name="toc-Subsubsection-14.1.3">14.1.3</a> Includes
</h3>
<div class="Standard">
<div class="listing">
<pre class="listing">[include filename]
</pre>
</div>

</div>
<div class="Standard">
The file named “filename” will be included as if part of the calling file. NOTE: This means no section can be named “include “ (with the whitespace).
</div>
<h3 class="Subsubsection">
<a class="toc" name="toc-Subsubsection-13.1.4">13.1.4</a> Setting a variable by running a command
<a class="toc" name="toc-Subsubsection-14.1.4">14.1.4</a> Setting a variable by running a command
</h3>
<div class="Standard">
<div class="listing">
<pre class="listing">VARNAME [system ls /tmp]
</pre>
</div>

</div>
<div class="Standard">
The variable “VARNAME” will get a value created by the Unix command “ls /tmp”. All lines of output from the command will be joined with a space.
</div>
<h3 class="Subsubsection">
<a class="toc" name="toc-Subsubsection-13.1.5">13.1.5</a> Notes
<a class="toc" name="toc-Subsubsection-14.1.5">14.1.5</a> Notes
</h3>
<ul>
<li>
Some variables are infered as lists. Each token on the line separated by whitespace will be member of the list.
</li>
<li>
Comments (lines starting with #) and blank lines are ignored.
</li>

</ul>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-13.2">13.2</a> Environment variables
<a class="toc" name="toc-Subsection-14.2">14.2</a> Environment variables
</h2>
<div class="Standard">
<table>
<tr>
<td align="left" valign="top" style="width: 10%;">
Variable
</td>
︙
929
930
931
932
933
934
935
936

937
938
939
940
941
942
943

947
948
949
950
951
952
953

954
955
956
957
958
959
960
961








-
+









</tr>

</table>

</div>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-13.3">13.3</a> megatest.config
<a class="toc" name="toc-Subsection-14.3">14.3</a> megatest.config
</h2>
<div class="Standard">
<table>
<tr>
<td align="left" valign="top" style="width: 10%;">
section
</td>
︙
1118
1119
1120
1121
1122
1123
1124
1125

1126
1127
1128
1129
1130
1131
1132

1136
1137
1138
1139
1140
1141
1142

1143
1144
1145
1146
1147
1148
1149
1150








-
+









</tr>

</table>

</div>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-13.4">13.4</a> runconfigs.config file
<a class="toc" name="toc-Subsection-14.4">14.4</a> runconfigs.config file
</h2>
<div class="Standard">
<table>
<tr>
<td align="left" valign="top" style="width: 20%;">
section
</td>
︙
1221
1222
1223
1224
1225
1226
1227
1228

1229
1230
1231

1232
1233
1234
1235
1236
1237
1238

1239
1240
1241
1242
1243
1244
1245

1246
1247
1248

1249
1250
1251
1252
1253
1254
1255
1256








-
+


-
+








<div class="Code">
ENCRYPTION true
</div>
<div class="Code">
TESTPATH /nfs/testing/megacorp_runs
</div>
<h2 class="Subsection">
<a class="toc" name="toc-Subsection-13.5">13.5</a> Writing tests
<a class="toc" name="toc-Subsection-14.5">14.5</a> Writing tests
</h2>
<h3 class="Subsubsection">
<a class="toc" name="toc-Subsubsection-13.5.1">13.5.1</a> testconfig file
<a class="toc" name="toc-Subsubsection-14.5.1">14.5.1</a> testconfig file
</h3>
<div class="Standard">
<table>
<tr>
<td align="left" valign="top" style="width: 8%;">
section
</td>
︙
1341
1342
1343
1344
1345
1346
1347
1348

1349
1350
1351
1352
1353
1354
1355

1359
1360
1361
1362
1363
1364
1365

1366
1367
1368
1369
1370
1371
1372
1373








-
+









</tr>

</table>

</div>
<h3 class="Subsubsection">
<a class="toc" name="toc-Subsubsection-13.5.2">13.5.2</a> Command line
<a class="toc" name="toc-Subsubsection-14.5.2">14.5.2</a> Command line
</h3>
<div class="Standard">
<table>
<tr>
<td align="left" valign="top">
switch or param
</td>
︙
1688
1689
1690
1691
1692
1693
1694
1695

1696
1697
1698
1699

1706
1707
1708
1709
1710
1711
1712

1713
1714
1715
1716
1717








-
+





</h1>
<h1 class="Section">
<a class="toc" name="toc-Appendix-B">B</a> References
</h1>

<hr class="footer"/>
<div class="footer" id="generated-by">
Document generated by <a href="http://elyxer.nongnu.org/">eLyXer 1.2.2 (2011-06-12)</a> on <span class="create-date">2011-12-15T21:53:21.527506</span>
Document generated by <a href="http://elyxer.nongnu.org/">eLyXer 1.2.2 (2011-06-12)</a> on <span class="create-date">2012-01-29T18:02:18.423972</span>
</div>
</div>
</body>
</html>

Modified docs/html/monitor-state-diagram.png from [47d4851333] to [18d6897d4f].

cannot compute difference between binary files

Modified docs/megatest.lyx from [8cf3af19a7] to [2e56021d96].

︙
201
202
203
204
205
206
207
208

209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228

229
230
231
232

233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249

201
202
203
204
205
206
207

208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224




225




226










227
228
229
230
231
232
233








-
+
















-
-
-
-
+
-
-
-
-
+
-
-
-
-
-
-
-
-
-
-









\begin_layout Plain Layout


\backslash
renewcommand{
\backslash
revisionNumber}{v1.25}
revisionNumber}{v1.36}
\end_layout

\end_inset


\end_layout

\begin_layout Title
Megatest User Manual
\end_layout

\begin_layout Author
Matthew Welland
\end_layout

\begin_layout Date
Sept.
 20, 
\end_layout

Jan.
\begin_layout Standard
\begin_inset ERT
status open

 29, 2012 
\begin_layout Plain Layout


\backslash
thispagestyle{empty}
\end_layout

\end_inset


\end_layout

\begin_layout Standard
\begin_inset Newpage newpage
\end_inset
︙
402
403
404
405
406
407
408
409

410
411
412
413
414
415
416

386
387
388
389
390
391
392

393
394
395
396
397
398
399
400








-
+








\end_inset
</cell>
<cell alignment="center" valignment="top" topline="true" bottomline="true" leftline="true" rightline="true" usebox="none">
\begin_inset Text

\begin_layout Plain Layout
\begin_inset ERT
status collapsed
status open

\begin_layout Plain Layout


\backslash
thedate
\end_layout
︙
1526
1527
1528
1529
1530
1531
1532
























1533
1534
1535
1536
1537
1538
1539

1510
1511
1512
1513
1514
1515
1516
1517
1518
1519
1520
1521
1522
1523
1524
1525
1526
1527
1528
1529
1530
1531
1532
1533
1534
1535
1536
1537
1538
1539
1540
1541
1542
1543
1544
1545
1546
1547








+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+








\end_layout

\begin_layout Standard
You can optionally specify the keys for your database to limit further the
 runs to extract into the spreadsheet.
 The first sheet contains all the run data and subsequent sheets contain
 data rolled up for the individual tests.
\end_layout

\begin_layout Section
Introspection
\end_layout

\begin_layout Subsection
Getting previous test paths
\end_layout

\begin_layout Standard
\begin_inset listings
inline false
status open

\begin_layout Plain Layout

megatest -test-paths -target %/%/% :runname % -testpatt % -itempatt % :status
 PASS 
\end_layout

\end_inset


\end_layout

\begin_layout Section
Flows
\end_layout

\begin_layout Standard
︙

This page was generated in about 0.129s by Fossil 2.24 [452f8e1ffc] 2024-03-26 15:36:00