Mercurial > octave
annotate scripts/testfun/runtests.m @ 24483:dac2ad033c43
use same wording and order for individual test results and summary
* __run_test_suite__.m, runtests.m: Use SKIP instead of SKIPPED and
same order for printing number of failed and skipped tests.
author | John W. Eaton <jwe@octave.org> |
---|---|
date | Thu, 28 Dec 2017 10:17:01 -0500 |
parents | 04d1a3ea26a3 |
children | 194eb4bd202b |
rev | line source |
---|---|
23219
3ac9f9ecfae5
maint: Update copyright dates.
John W. Eaton <jwe@octave.org>
parents:
23083
diff
changeset
|
1 ## Copyright (C) 2010-2017 John W. Eaton |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
2 ## |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
3 ## This file is part of Octave. |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
4 ## |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
5 ## Octave is free software; you can redistribute it and/or modify it |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
6 ## under the terms of the GNU General Public License as published by |
22755
3a2b891d0b33
maint: Standardize Copyright formatting.
Rik <rik@octave.org>
parents:
22323
diff
changeset
|
7 ## the Free Software Foundation; either version 3 of the License, or |
3a2b891d0b33
maint: Standardize Copyright formatting.
Rik <rik@octave.org>
parents:
22323
diff
changeset
|
8 ## (at your option) any later version. |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
9 ## |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
10 ## Octave is distributed in the hope that it will be useful, but |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
11 ## WITHOUT ANY WARRANTY; without even the implied warranty of |
22755
3a2b891d0b33
maint: Standardize Copyright formatting.
Rik <rik@octave.org>
parents:
22323
diff
changeset
|
12 ## MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the |
3a2b891d0b33
maint: Standardize Copyright formatting.
Rik <rik@octave.org>
parents:
22323
diff
changeset
|
13 ## GNU General Public License for more details. |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
14 ## |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
15 ## You should have received a copy of the GNU General Public License |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
16 ## along with Octave; see the file COPYING. If not, see |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
17 ## <http://www.gnu.org/licenses/>. |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
18 |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
19 ## -*- texinfo -*- |
20852
516bb87ea72e
2015 Code Sprint: remove class of function from docstring for all m-files.
Rik <rik@octave.org>
parents:
20726
diff
changeset
|
20 ## @deftypefn {} {} runtests () |
516bb87ea72e
2015 Code Sprint: remove class of function from docstring for all m-files.
Rik <rik@octave.org>
parents:
20726
diff
changeset
|
21 ## @deftypefnx {} {} runtests (@var{directory}) |
19025
f27140dd13a6
doc: Update documentation for assert, rundemos, runtests.
Rik <rik@octave.org>
parents:
18110
diff
changeset
|
22 ## Execute built-in tests for all m-files in the specified @var{directory}. |
f27140dd13a6
doc: Update documentation for assert, rundemos, runtests.
Rik <rik@octave.org>
parents:
18110
diff
changeset
|
23 ## |
f27140dd13a6
doc: Update documentation for assert, rundemos, runtests.
Rik <rik@octave.org>
parents:
18110
diff
changeset
|
24 ## Test blocks in any C++ source files (@file{*.cc}) will also be executed |
f27140dd13a6
doc: Update documentation for assert, rundemos, runtests.
Rik <rik@octave.org>
parents:
18110
diff
changeset
|
25 ## for use with dynamically linked oct-file functions. |
17148
fa14aa77b514
Allow relative directory name for rundemos/runtests.
Rik <rik@octave.org>
parents:
16724
diff
changeset
|
26 ## |
20162
2645f9ef8c88
doc: Update more docstrings to have one sentence summary as first line.
Rik <rik@octave.org>
parents:
19865
diff
changeset
|
27 ## If no directory is specified, operate on all directories in Octave's search |
2645f9ef8c88
doc: Update more docstrings to have one sentence summary as first line.
Rik <rik@octave.org>
parents:
19865
diff
changeset
|
28 ## path for functions. |
19025
f27140dd13a6
doc: Update documentation for assert, rundemos, runtests.
Rik <rik@octave.org>
parents:
18110
diff
changeset
|
29 ## @seealso{rundemos, test, path} |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
30 ## @end deftypefn |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
31 |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
32 ## Author: jwe |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
33 |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
34 function runtests (directory) |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
35 |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
36 if (nargin == 0) |
16724
b7667fcb9fbc
Substitute ostrsplit() for strsplit().
Ben Abbott <bpabbott@mac.com>
parents:
16403
diff
changeset
|
37 dirs = ostrsplit (path (), pathsep ()); |
17457
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
38 do_class_dirs = true; |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
39 elseif (nargin == 1) |
18059
b675665ce328
Simplify directory testing code for rundemos, runtests.
Rik <rik@octave.org>
parents:
18054
diff
changeset
|
40 dirs = {canonicalize_file_name(directory)}; |
21570
faa23d2161f8
Stricter input validation for rundemos, runtests.
Rik <rik@octave.org>
parents:
20852
diff
changeset
|
41 if (isempty (dirs{1}) || ! isdir (dirs{1})) |
18059
b675665ce328
Simplify directory testing code for rundemos, runtests.
Rik <rik@octave.org>
parents:
18054
diff
changeset
|
42 ## Search for directory name in path |
b675665ce328
Simplify directory testing code for rundemos, runtests.
Rik <rik@octave.org>
parents:
18054
diff
changeset
|
43 if (directory(end) == '/' || directory(end) == '\') |
b675665ce328
Simplify directory testing code for rundemos, runtests.
Rik <rik@octave.org>
parents:
18054
diff
changeset
|
44 directory(end) = []; |
17148
fa14aa77b514
Allow relative directory name for rundemos/runtests.
Rik <rik@octave.org>
parents:
16724
diff
changeset
|
45 endif |
18110
2217bc116aa9
maint: Dummy merge with gui-release, ignoring all recent backout merges
Jordi Gutiérrez Hermoso <jordigh@octave.org>
parents:
18105
diff
changeset
|
46 fullname = dir_in_loadpath (directory); |
18054
70e83c641b48
Accept a bare directory name for rundemos and runtests.
Rik <rik@octave.org>
parents:
18053
diff
changeset
|
47 if (isempty (fullname)) |
11472
1740012184f9
Use uppercase for variable names in error() strings to match Info documentation. Only m-files done.
Rik <octave@nomad.inbox5.com>
parents:
11032
diff
changeset
|
48 error ("runtests: DIRECTORY argument must be a valid pathname"); |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
49 endif |
18054
70e83c641b48
Accept a bare directory name for rundemos and runtests.
Rik <rik@octave.org>
parents:
18053
diff
changeset
|
50 dirs = {fullname}; |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
51 endif |
17457
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
52 do_class_dirs = false; |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
53 else |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
54 print_usage (); |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
55 endif |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
56 |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
57 for i = 1:numel (dirs) |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
58 d = dirs{i}; |
17457
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
59 run_all_tests (d, do_class_dirs); |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
60 endfor |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
61 |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
62 endfunction |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
63 |
17457
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
64 function run_all_tests (directory, do_class_dirs) |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
65 |
17459
f271fa40074d
runtests.m, rundemos.m: Use readdir, rather than dir, for ~700X speed-up.
Rik <rik@octave.org>
parents:
17458
diff
changeset
|
66 flist = readdir (directory); |
17457
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
67 dirs = {}; |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
68 no_tests = {}; |
21634
96518f623c91
Backed out changeset dcf8922b724b
Mike Miller <mtmiller@octave.org>
parents:
21633
diff
changeset
|
69 printf ("Processing files in %s:\n\n", directory); |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
70 fflush (stdout); |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
71 for i = 1:numel (flist) |
17459
f271fa40074d
runtests.m, rundemos.m: Use readdir, rather than dir, for ~700X speed-up.
Rik <rik@octave.org>
parents:
17458
diff
changeset
|
72 f = flist{i}; |
19865
e9f89866074c
maint: Cleanup some .m files to follow Octave coding conventions.
John W. Eaton <jwe@octave.org>
parents:
19697
diff
changeset
|
73 if ((length (f) > 2 && strcmpi (f((end-1):end), ".m")) |
e9f89866074c
maint: Cleanup some .m files to follow Octave coding conventions.
John W. Eaton <jwe@octave.org>
parents:
19697
diff
changeset
|
74 || (length (f) > 3 && strcmpi (f((end-2):end), ".cc"))) |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
75 ff = fullfile (directory, f); |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
76 if (has_tests (ff)) |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
77 print_test_file_name (f); |
24480
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
78 [p, n, xf, xb, sk, rtsk, rgrs] = test (ff, "quiet"); |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
79 print_pass_fail (p, n, xf, xb, sk, rtsk, rgrs); |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
80 fflush (stdout); |
17456
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
81 elseif (has_functions (ff)) |
17459
f271fa40074d
runtests.m, rundemos.m: Use readdir, rather than dir, for ~700X speed-up.
Rik <rik@octave.org>
parents:
17458
diff
changeset
|
82 no_tests(end+1) = f; |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
83 endif |
17459
f271fa40074d
runtests.m, rundemos.m: Use readdir, rather than dir, for ~700X speed-up.
Rik <rik@octave.org>
parents:
17458
diff
changeset
|
84 elseif (f(1) == "@") |
17457
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
85 f = fullfile (directory, f); |
17459
f271fa40074d
runtests.m, rundemos.m: Use readdir, rather than dir, for ~700X speed-up.
Rik <rik@octave.org>
parents:
17458
diff
changeset
|
86 if (isdir (f)) |
f271fa40074d
runtests.m, rundemos.m: Use readdir, rather than dir, for ~700X speed-up.
Rik <rik@octave.org>
parents:
17458
diff
changeset
|
87 dirs(end+1) = f; |
f271fa40074d
runtests.m, rundemos.m: Use readdir, rather than dir, for ~700X speed-up.
Rik <rik@octave.org>
parents:
17458
diff
changeset
|
88 endif |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
89 endif |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
90 endfor |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
91 if (! isempty (no_tests)) |
21634
96518f623c91
Backed out changeset dcf8922b724b
Mike Miller <mtmiller@octave.org>
parents:
21633
diff
changeset
|
92 printf ("\nThe following files in %s have no tests:\n\n", directory); |
96518f623c91
Backed out changeset dcf8922b724b
Mike Miller <mtmiller@octave.org>
parents:
21633
diff
changeset
|
93 printf ("%s", list_in_columns (no_tests)); |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
94 endif |
17457
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
95 |
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
96 ## Recurse into class directories since they are implied in the path |
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
97 if (do_class_dirs) |
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
98 for i = 1:numel (dirs) |
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
99 d = dirs{i}; |
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
100 run_all_tests (d, false); |
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
101 endfor |
a4f86f459744
rundemos.m, runtests.m: Include class directories in path (bug #40053)
Mike Miller <mtmiller@ieee.org>
parents:
17456
diff
changeset
|
102 endif |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
103 |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
104 endfunction |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
105 |
17456
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
106 function retval = has_functions (f) |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
107 |
17456
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
108 n = length (f); |
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
109 if (n > 3 && strcmpi (f((end-2):end), ".cc")) |
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
110 fid = fopen (f); |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
111 if (fid < 0) |
20726
25d676f9619c
Preface error() messages with name of function when possible.
Rik <rik@octave.org>
parents:
20162
diff
changeset
|
112 error ("runtests: fopen failed: %s", f); |
17456
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
113 endif |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
114 str = fread (fid, "*char")'; |
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
115 fclose (fid); |
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
116 retval = ! isempty (regexp (str,'^(?:DEFUN|DEFUN_DLD|DEFUNX)\>', |
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
117 'lineanchors', 'once')); |
17456
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
118 elseif (n > 2 && strcmpi (f((end-1):end), ".m")) |
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
119 retval = true; |
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
120 else |
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
121 retval = false; |
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
122 endif |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
123 |
17456
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
124 endfunction |
2c2a6801cb57
rundemos.m, runtests.m: Operate on .cc files (bug #40052)
Mike Miller <mtmiller@ieee.org>
parents:
17148
diff
changeset
|
125 |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
126 function retval = has_tests (f) |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
127 |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
128 fid = fopen (f); |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
129 if (fid < 0) |
10635
d1978e7364ad
Print name of function in error() string messages.
Rik <octave@nomad.inbox5.com>
parents:
10549
diff
changeset
|
130 error ("runtests: fopen failed: %s", f); |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
131 endif |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
132 |
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
133 str = fread (fid, "*char").'; |
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
134 fclose (fid); |
24480
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
135 retval = ! isempty (regexp (str, |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
136 '^%!(assert|error|fail|test|xtest|warning)', |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
137 'lineanchors', 'once')); |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
138 |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
139 endfunction |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
140 |
24480
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
141 function print_pass_fail (p, n, xf, xb, sk, rtsk, rgrs) |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
142 |
24480
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
143 if ((n + sk + rtsk + rgrs) > 0) |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
144 printf (" PASS %4d/%-4d", p, n); |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
145 nfail = n - p - xf - xb - rgrs; |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
146 if (nfail > 0) |
24480
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
147 printf ("\n%71s %3d", "FAIL ", nfail); |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
148 endif |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
149 if (rgrs > 0) |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
150 printf ("\n%71s %3d", "REGRESSION", rgrs); |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
151 endif |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
152 if (xb > 0) |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
153 printf ("\n%71s %3d", "(reported bug) XFAIL", xb); |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
154 endif |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
155 if (xf > 0) |
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
156 printf ("\n%71s %3d", "(expected failure) XFAIL", xf); |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
157 endif |
24483
dac2ad033c43
use same wording and order for individual test results and summary
John W. Eaton <jwe@octave.org>
parents:
24480
diff
changeset
|
158 if (sk > 0) |
dac2ad033c43
use same wording and order for individual test results and summary
John W. Eaton <jwe@octave.org>
parents:
24480
diff
changeset
|
159 printf ("\n%71s %3d", "(missing feature) SKIP", sk); |
dac2ad033c43
use same wording and order for individual test results and summary
John W. Eaton <jwe@octave.org>
parents:
24480
diff
changeset
|
160 endif |
dac2ad033c43
use same wording and order for individual test results and summary
John W. Eaton <jwe@octave.org>
parents:
24480
diff
changeset
|
161 if (rtsk > 0) |
dac2ad033c43
use same wording and order for individual test results and summary
John W. Eaton <jwe@octave.org>
parents:
24480
diff
changeset
|
162 printf ("\n%71s %3d", "(run-time condition) SKIP", rtsk); |
dac2ad033c43
use same wording and order for individual test results and summary
John W. Eaton <jwe@octave.org>
parents:
24480
diff
changeset
|
163 endif |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
164 endif |
21634
96518f623c91
Backed out changeset dcf8922b724b
Mike Miller <mtmiller@octave.org>
parents:
21633
diff
changeset
|
165 puts ("\n"); |
21758
ffad2baa90f7
maint: Use newlines to make code more readable.
Rik <rik@octave.org>
parents:
21634
diff
changeset
|
166 |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
167 endfunction |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
168 |
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
169 function print_test_file_name (nm) |
24480
04d1a3ea26a3
runtests.m: Update printing of output.
Rik <rik@octave.org>
parents:
23220
diff
changeset
|
170 filler = repmat (".", 1, 60-length (nm)); |
21634
96518f623c91
Backed out changeset dcf8922b724b
Mike Miller <mtmiller@octave.org>
parents:
21633
diff
changeset
|
171 printf (" %s %s", nm, filler); |
10496
3b77db443cc0
scripts/testfun/runtests.m: new function
John W. Eaton <jwe@octave.org>
parents:
diff
changeset
|
172 endfunction |
17148
fa14aa77b514
Allow relative directory name for rundemos/runtests.
Rik <rik@octave.org>
parents:
16724
diff
changeset
|
173 |
fa14aa77b514
Allow relative directory name for rundemos/runtests.
Rik <rik@octave.org>
parents:
16724
diff
changeset
|
174 |
fa14aa77b514
Allow relative directory name for rundemos/runtests.
Rik <rik@octave.org>
parents:
16724
diff
changeset
|
175 %!error runtests ("foo", 1) |
fa14aa77b514
Allow relative directory name for rundemos/runtests.
Rik <rik@octave.org>
parents:
16724
diff
changeset
|
176 %!error <DIRECTORY argument> runtests ("#_TOTALLY_/_INVALID_/_PATHNAME_#") |