Mercurial > octave-nkf

annotate scripts/testfun/__run_test_suite__.m @ 16030:1af8d21608b7

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
rename all test files in the test directory from test_X.m to X.tst * Use - instead of _ for .tst file names. Fix all file lists in module.mk and Makefile.am files. * __run_test_suite__.m: Adapt to new naming convention.
author John W. Eaton <jwe@octave.org>
date Sat, 09 Feb 2013 21:35:55 -0500
parents 5b2126a8c84f
children 12005245b645
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
16019
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
1 ## Copyright (C) 2005-2012 David Bateman
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
2 ##
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
3 ## This file is part of Octave.
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
4 ##
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
5 ## Octave is free software; you can redistribute it and/or modify it
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
6 ## under the terms of the GNU General Public License as published by
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
7 ## the Free Software Foundation; either version 3 of the License, or (at
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
8 ## your option) any later version.
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
9 ##
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
10 ## Octave is distributed in the hope that it will be useful, but
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
11 ## WITHOUT ANY WARRANTY; without even the implied warranty of
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
12 ## MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
13 ## General Public License for more details.
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
14 ##
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
15 ## You should have received a copy of the GNU General Public License
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
16 ## along with Octave; see the file COPYING. If not, see
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
17 ## <http://www.gnu.org/licenses/>.
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
18
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
19 ## -*- texinfo -*-
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
20 ## @deftypefn {Function File} {} __run_test_suite__ (@var{fcndirs}, @var{fixedtestdirs})
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
21 ## Undocumented internal function.
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
22 ## @end deftypefn
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
23
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
24 function __run_test_suite__ (fcndirs, fixedtestdirs)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
25 testsdir = octave_config_info ("octtestsdir");
16030
1af8d21608b7 rename all test files in the test directory from test_X.m to X.tst
John W. Eaton <jwe@octave.org>
parents: 16019
diff changeset
26 libinterptestdir = fullfile (testsdir, "libinterp");
1af8d21608b7 rename all test files in the test directory from test_X.m to X.tst
John W. Eaton <jwe@octave.org>
parents: 16019
diff changeset
27 liboctavetestdir = fullfile (testsdir, "liboctave");
16019
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
28 fixedtestdir = fullfile (testsdir, "fixed");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
29 fcnfiledir = octave_config_info ("fcnfiledir");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
30 if (nargin == 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
31 fcndirs = { libinterptestdir, liboctavetestdir, fcnfiledir };
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
32 fixedtestdirs = { fixedtestdir };
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
33 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
34 global files_with_no_tests = {};
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
35 global files_with_tests = {};
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
36 ## FIXME -- these names don't really make sense if we are running
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
37 ## tests for an installed copy of Octave.
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
38 global topsrcdir = fcnfiledir;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
39 global topbuilddir = testsdir;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
40 pso = page_screen_output ();
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
41 warn_state = warning ("query", "quiet");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
42 warning ("on", "quiet");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
43 try
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
44 page_screen_output (0);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
45 warning ("off", "Octave:deprecated-function");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
46 fid = fopen ("fntests.log", "wt");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
47 if (fid < 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
48 error ("could not open fntests.log for writing");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
49 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
50 test ("", "explain", fid);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
51 dp = dn = dxf = dsk = 0;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
52 puts ("\nIntegrated test scripts:\n\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
53 for i = 1:length (fcndirs)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
54 [p, n, xf, sk] = run_test_script (fid, fcndirs{i});
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
55 dp += p;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
56 dn += n;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
57 dxf += xf;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
58 dsk += sk;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
59 endfor
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
60 puts ("\nFixed test scripts:\n\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
61 for i = 1:length (fixedtestdirs)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
62 [p, n, xf, sk] = run_test_dir (fid, fixedtestdirs{i});
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
63 dp += p;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
64 dn += n;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
65 dxf += xf;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
66 dsk += sk;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
67 endfor
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
68 puts ("\nSummary:\n\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
69 nfail = dn - dp;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
70 printf (" PASS %6d\n", dp);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
71 printf (" FAIL %6d\n", nfail);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
72 if (dxf > 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
73 printf (" XFAIL %6d\n", dxf);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
74 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
75 if (dsk > 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
76 printf (" SKIPPED %6d\n", dsk);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
77 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
78 puts ("\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
79 puts ("See the file test/fntests.log for additional details.\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
80 if (dxf > 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
81 puts ("\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
82 puts ("Expected failures (listed as XFAIL above) are known bugs.\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
83 puts ("Please help improve Octave by contributing fixes for them.\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
84 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
85 if (dsk > 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
86 puts ("\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
87 puts ("Tests are most often skipped because the features they require\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
88 puts ("have been disabled. Features are most often disabled because\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
89 puts ("they require dependencies that were not present when Octave\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
90 puts ("was built. The configure script should have printed a summary\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
91 puts ("at the end of its run indicating which dependencies were not found.\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
92 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
93
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
94 ## Weed out deprecated and private functions
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
95 weed_idx = cellfun (@isempty, regexp (files_with_tests, '\bdeprecated\b|\bprivate\b', 'once'));
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
96 files_with_tests = files_with_tests(weed_idx);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
97 weed_idx = cellfun (@isempty, regexp (files_with_no_tests, '\bdeprecated\b|\bprivate\b', 'once'));
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
98 files_with_no_tests = files_with_no_tests(weed_idx);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
99
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
100 report_files_with_no_tests (files_with_tests, files_with_no_tests, ".m");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
101
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
102 puts ("\nPlease help improve Octave by contributing tests for\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
103 puts ("these files (see the list in the file fntests.log).\n\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
104
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
105 fprintf (fid, "\nFiles with no tests:\n\n%s",
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
106 list_in_columns (files_with_no_tests, 80));
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
107 fclose (fid);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
108
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
109 page_screen_output (pso);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
110 warning (warn_state.state, "quiet");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
111 catch
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
112 page_screen_output (pso);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
113 warning (warn_state.state, "quiet");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
114 disp (lasterr ());
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
115 end_try_catch
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
116 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
117
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
118 function print_test_file_name (nm)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
119 filler = repmat (".", 1, 55-length (nm));
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
120 printf (" %s %s", nm, filler);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
121 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
122
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
123 function print_pass_fail (n, p)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
124 if (n > 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
125 printf (" PASS %4d/%-4d", p, n);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
126 nfail = n - p;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
127 if (nfail > 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
128 printf (" FAIL %d", nfail);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
129 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
130 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
131 puts ("\n");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
132 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
133
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
134 function retval = has_functions (f)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
135 n = length (f);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
136 if (n > 3 && strcmp (f((end-2):end), ".cc"))
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
137 fid = fopen (f);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
138 if (fid >= 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
139 str = fread (fid, "*char")';
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
140 fclose (fid);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
141 retval = ! isempty (regexp (str,'^(DEFUN|DEFUN_DLD)\b', 'lineanchors'));
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
142 else
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
143 error ("fopen failed: %s", f);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
144 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
145 elseif (n > 2 && strcmp (f((end-1):end), ".m"))
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
146 retval = true;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
147 else
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
148 retval = false;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
149 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
150 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
151
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
152 function retval = has_tests (f)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
153 fid = fopen (f);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
154 if (fid >= 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
155 str = fread (fid, "*char")';
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
156 fclose (fid);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
157 retval = ! isempty (regexp (str, '^%!(assert|error|fail|test|warning)', "lineanchors"));
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
158 else
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
159 error ("fopen failed: %s", f);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
160 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
161 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
162
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
163 function retval = has_demos (f)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
164 fid = fopen (f);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
165 if (fid >= 0)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
166 str = fread (fid, "*char")';
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
167 fclose (fid);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
168 retval = ! isempty (regexp (str, '^%!demo', "lineanchors"));
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
169 else
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
170 error ("fopen failed: %s", f);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
171 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
172 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
173
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
174 function [dp, dn, dxf, dsk] = run_test_dir (fid, d);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
175 global files_with_tests;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
176 global files_with_no_tests;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
177 lst = dir (d);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
178 dp = dn = dxf = dsk = 0;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
179 for i = 1:length (lst)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
180 nm = lst(i).name;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
181 if (lst(i).isdir
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
182 && ! strcmp (nm, ".") && ! strcmp (nm, "..")
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
183 && ! strcmp (nm, "private") && nm(1) != "@"
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
184 && ! strcmp (nm, "CVS"))
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
185 [p, n, xf, sk] = run_test_dir (fid, [d, filesep, nm]);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
186 dp += p;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
187 dn += n;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
188 dxf += xf;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
189 dsk += sk;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
190 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
191 endfor
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
192 saved_dir = pwd ();
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
193 unwind_protect
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
194 chdir (d);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
195 for i = 1:length (lst)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
196 nm = lst(i).name;
16030
1af8d21608b7 rename all test files in the test directory from test_X.m to X.tst
John W. Eaton <jwe@octave.org>
parents: 16019
diff changeset
197 if (length (nm) > 4 && strcmp (nm((end-3):end), ".tst"))
16019
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
198 p = n = xf = sk = 0;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
199 ffnm = fullfile (d, nm);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
200 if (has_tests (ffnm))
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
201 print_test_file_name (nm);
16030
1af8d21608b7 rename all test files in the test directory from test_X.m to X.tst
John W. Eaton <jwe@octave.org>
parents: 16019
diff changeset
202 [p, n, xf, sk] = test (nm, "quiet", fid);
16019
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
203 print_pass_fail (n, p);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
204 files_with_tests(end+1) = ffnm;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
205 ##elseif (has_demos (ffnm))
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
206 ## files_with_tests(end+1) = ffnm;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
207 else
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
208 files_with_no_tests(end+1) = ffnm;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
209 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
210 dp += p;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
211 dn += n;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
212 dxf += xf;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
213 dsk += sk;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
214 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
215 endfor
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
216 unwind_protect_cleanup
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
217 chdir (saved_dir);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
218 end_unwind_protect
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
219 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
220
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
221 function [dp, dn, dxf, dsk] = run_test_script (fid, d);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
222 global files_with_tests;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
223 global files_with_no_tests;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
224 global topsrcdir;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
225 global topbuilddir;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
226 lst = dir (d);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
227 dp = dn = dxf = dsk = 0;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
228 for i = 1:length (lst)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
229 nm = lst(i).name;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
230 if (lst(i).isdir && ! strcmp (nm, ".") && ! strcmp (nm, "..")
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
231 && ! strcmp (nm, "CVS"))
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
232 [p, n, xf, sk] = run_test_script (fid, [d, filesep, nm]);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
233 dp += p;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
234 dn += n;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
235 dxf += xf;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
236 dsk += sk;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
237 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
238 endfor
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
239 for i = 1:length (lst)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
240 nm = lst(i).name;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
241 ## Ignore hidden files
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
242 if (nm(1) == '.')
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
243 continue
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
244 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
245 f = fullfile (d, nm);
16030
1af8d21608b7 rename all test files in the test directory from test_X.m to X.tst
John W. Eaton <jwe@octave.org>
parents: 16019
diff changeset
246 if ((length (nm) > 2 && strcmp (nm((end-1):end), ".m"))
1af8d21608b7 rename all test files in the test directory from test_X.m to X.tst
John W. Eaton <jwe@octave.org>
parents: 16019
diff changeset
247 || (length (nm) > 4
1af8d21608b7 rename all test files in the test directory from test_X.m to X.tst
John W. Eaton <jwe@octave.org>
parents: 16019
diff changeset
248 && (strcmp (nm((end-3):end), "-tst")
1af8d21608b7 rename all test files in the test directory from test_X.m to X.tst
John W. Eaton <jwe@octave.org>
parents: 16019
diff changeset
249 || strcmp (nm((end-3):end), ".tst"))))
16019
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
250 p = n = xf = 0;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
251 ## Only run if it contains %!test, %!assert %!error or %!warning
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
252 if (has_tests (f))
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
253 tmp = strrep (f, [topsrcdir, filesep], "");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
254 tmp = strrep (tmp, [topbuilddir, filesep], "");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
255 print_test_file_name (tmp);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
256 [p, n, xf, sk] = test (f, "quiet", fid);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
257 print_pass_fail (n, p);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
258 dp += p;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
259 dn += n;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
260 dxf += xf;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
261 dsk += sk;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
262 files_with_tests(end+1) = f;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
263 ##elseif (has_demos (f))
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
264 ## files_with_tests(end+1) = f;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
265 else
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
266 ## To reduce the list length, only mark .cc files that contain
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
267 ## DEFUN definitions.
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
268 files_with_no_tests(end+1) = f;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
269 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
270 endif
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
271 endfor
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
272 ## printf("%s%s -> passes %d of %d tests\n", ident, d, dp, dn);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
273 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
274
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
275 function n = num_elts_matching_pattern (lst, pat)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
276 n = sum (cellfun (@(x) !isempty (x), regexp (lst, pat, 'once')));
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
277 endfunction
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
278
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
279 function report_files_with_no_tests (with, without, typ)
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
280 pat = cstrcat ('\', typ, "$");
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
281 n_with = num_elts_matching_pattern (with, pat);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
282 n_without = num_elts_matching_pattern (without, pat);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
283 n_tot = n_with + n_without;
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
284 printf ("\n%d (of %d) %s files have no tests.\n", n_without, n_tot, typ);
5b2126a8c84f install tests and functions to run them
John W. Eaton <jwe@octave.org>
parents:
diff changeset
285 endfunction