Yang Tse
2d15ac3d4e
server start and verification time as well as test preparation time
...
data is required in order to closer match total test execution time.
2009-12-18 19:17:14 +00:00
Yang Tse
53deae3781
Added test harness simple time execution stats
2009-12-18 15:23:18 +00:00
Yang Tse
002ed5f298
Test harness process control enhancements
2009-12-16 19:55:35 +00:00
Yang Tse
3802d027cd
Test harness process control enhancements
2009-12-16 15:16:06 +00:00
Yang Tse
a6abbb120e
Adjust uppercase protocol string usage
2009-12-14 14:42:48 +00:00
Daniel Stenberg
ec3bb8f727
introducing IMAP, POP3 and SMTP support (still lots of polish left to do)
2009-12-12 21:54:01 +00:00
Yang Tse
a72ce23f16
- In order to better reflect that the returned pid is extracted from the
...
given file, serverpid sub is renamed to pidfromfile. In addition it is
enhanced to make sure that it always returns zero unless a numerical
positive value is returned.
- To better reflect that only process existance is actually checked,
checkserver sub is renamed to processexists. In addition it is enhanced
making it remove the given pid file when the extracted pid is no longer
alive.
2009-11-30 13:48:51 +00:00
Daniel Stenberg
e73fe837a8
- Peter Sylvester made the HTTPS test server use specific certificates for
...
each test, so that the test suite can now be used to actually test the
verification of cert names etc. This made an error show up in the OpenSSL-
specific code where it would attempt to match the CN field even if a
subjectAltName exists that doesn't match. This is now fixed and verified
in test 311.
2009-08-11 21:48:58 +00:00
Gunter Knauf
f671d0513c
renamed generated config.h to curl_config.h in order to avoid clashes when libcurl is used with other projects which also have a config.h.
2009-07-14 13:25:14 +00:00
Yang Tse
2c16681225
Adjusted to take in account that...
...
With the curl memory tracking feature decoupled from the debug build feature,
CURLDEBUG and DEBUGBUILD preprocessor symbol definitions are used as follows:
CURLDEBUG used for curl debug memory tracking specific code (--enable-curldebug)
DEBUGBUILD used for debug enabled specific code (--enable-debug)
2009-06-10 02:49:42 +00:00
Yang Tse
b8e73495a5
Extend displaying of logfiles upon first server start-up failure for http, https, ftp, ftps and tftp test harness servers.
2009-05-15 11:59:24 +00:00
Yang Tse
187cfc1594
Displaying of logfiles on ftp server satrtup failure for test case #100 becomes standard.
2009-05-15 11:14:03 +00:00
Yang Tse
86f043a66c
temporary debug trace for ftp server satrtup failure on testcase #100
2009-05-12 19:18:54 +00:00
Yang Tse
36b397be9f
Fetch curl's 'CharConv' feature information, used by TPF.
2009-05-11 17:20:41 +00:00
Daniel Stenberg
1f340a262f
support --help to do the same as -h
2009-05-11 11:39:42 +00:00
Yang Tse
75585f771a
Fix name of tool shown upon error.
2009-05-11 01:16:28 +00:00
Daniel Stenberg
d1ba4324de
introduce VCURL for verify calls, so that it can be changed to use a different
...
binary than the one that gets tested, if need be
2009-05-10 21:20:15 +00:00
Yang Tse
9ef7b6afe2
Remove temporary and HP-UX autobuild specific change to debug SSH server start-up failures
2009-05-08 02:18:49 +00:00
Yang Tse
7c6e0d5981
Temporary and HP-UX autobuild specific change to debug SSH server start-up failures
2009-05-06 10:32:06 +00:00
Yang Tse
a840cc700a
Revert change committed on Mon May 4 09:30:23 2009 UTC.
...
The origin of the problem with test case #251 was the --ftp-port not being the CLIENTIP address.
2009-05-05 08:46:31 +00:00
Yang Tse
ff3e574187
David McCreedy's patch to fix test suite harness to allow test FTP server and client on different machines, providing FTP client address when running the FTP test server.
2009-05-04 10:30:23 +00:00
Yang Tse
8aa88f4d36
re-enable all tests for all icc autobuilds
2009-04-17 07:30:56 +00:00
Daniel Stenberg
4741e64c89
Josef Wolf's extension that allows a $TESTDIR/gdbinit$testnum file that when
...
you use runtests.pl -g, will be sourced by gdb to allow additional fancy
or whatever you see fit
2008-11-19 21:56:11 +00:00
Dan Fandrich
cdd6054e08
Display the time in verbose mode during the torture tests to help determine
...
when the tests stall.
2008-11-17 20:24:13 +00:00
Yang Tse
9230708e47
don't skip tests 558 and 559 on i686 icc autobuilds
2008-10-27 20:09:35 +00:00
Yang Tse
6db8f53445
test #558 verifies loop operation using malloc() and free()
2008-10-26 03:03:29 +00:00
Yang Tse
81e48ada47
For i686 icc autobuilds:
...
Re-enable all tests for debug-enabled builds.
For debug-disabled builds only 8 tests are enabled.
2008-10-22 15:03:15 +00:00
Dan Fandrich
357383159e
A <precheck> command is considered to have failed if it returns a non-zero
...
return code. This way, if the precheck command can't be run at all for
whatever reason, it's treated as a precheck failure which causes the
test to be skipped.
2008-10-15 17:41:02 +00:00
Yang Tse
a632f6d5b1
if a test execution is aborted due to a signal, and the process
...
returns no other exitcode, use 2000 + signal number as return code
2008-09-26 18:56:56 +00:00
Yang Tse
42271ad463
use shift right. Division result is not integral.
2008-09-26 14:08:33 +00:00
Yang Tse
82107a02f5
Re-enable test #100 on i686 icc autobuilds
2008-09-24 01:29:23 +00:00
Yang Tse
1e076a4ae0
Re-enable tests #1 on i686 icc autobuilds
2008-09-22 18:55:42 +00:00
Yang Tse
eae27d1788
Disable all tests on i686 icc autobuilds to inspect build messages
2008-09-08 16:50:04 +00:00
Yang Tse
d744c85310
Re-enable all tests on x86_64 and ia64.
2008-08-24 23:26:07 +00:00
Yang Tse
71d3c5bf41
Disable all tests except #557 on x86_64 and ia64 to debug trace curl_mprintf() on these systems.
2008-08-24 15:57:52 +00:00
Daniel Stenberg
a604682805
Andy Tsouladze's fix to kill the knowledge of servers properly after they have
...
been killed.
2008-08-23 11:25:14 +00:00
Daniel Stenberg
14a5596346
- Andy Tsouladze fixed runtests.pl to not attempt to execute the stunnel
...
_directory_ if that happened to appear in the path!
2008-08-12 07:21:39 +00:00
Dan Fandrich
b6b03c8ab9
Added feature in runtests.pl to select tests based on key word.
2008-07-27 02:34:27 +00:00
Dan Fandrich
932b589780
Changed the long logfile elision code in runtests.pl to properly handle
...
lines ending in \r.
2008-07-24 02:16:48 +00:00
Dan Fandrich
70d834c512
Always use $LOGDIR when referring to the log directory.
2008-06-19 01:12:02 +00:00
Daniel Stenberg
2d0fea2650
fixed the language somewhat
2008-06-13 20:45:34 +00:00
Daniel Stenberg
5abfdc0140
- curl the tool now deals with its command line options somewhat differently!
...
All boolean options (such as -O, -I, -v etc), both short and long versions,
now always switch on/enable the option named. Using the same option multiple
times thus make no difference. To switch off one of those options, you need
to use the long version of the option and type --no-OPTION. Like to disable
verbose mode you use --no-verbose!
- Added --remote-name-all to curl, which if used changes the default for all
given URLs to be dealt with as if -O is used. So if you want to disable that
for a specific URL after --remote-name-all has been used, you muse use -o -
or --no-remote-name.
2008-06-08 20:53:49 +00:00
Daniel Stenberg
7b2531da24
do variable replacement in the stdout data read from the test case
2008-05-01 10:51:16 +00:00
Yang Tse
113d0937de
Add 'timeout' and 'delay' attributes support for the test harness <command> subsection
2008-04-25 04:19:50 +00:00
Yang Tse
96edebf4d9
improve synchronization between test harness runtests.pl script
...
and test harness servers to minimize risk of false test failures.
http://curl.haxx.se/mail/lib-2008-04/0392.html
2008-04-23 23:55:34 +00:00
Dan Fandrich
768e3e796e
Ignore the result of the postcheck command in torture mode
2008-04-21 17:19:44 +00:00
Dan Fandrich
80cec5a62a
Fixed the test harness so it will write out zero-length data files.
2008-03-06 01:11:43 +00:00
Daniel Stenberg
2c80bcbc81
made the non-matching error code output nicer since we know it is a number
...
and the string contains a newline...
2008-02-20 12:14:31 +00:00
Yang Tse
cf9259dd92
verifyserver() actually returns the pid of the unsecure http and ftp servers
...
when verifying the https and ftps servers
2008-02-13 06:06:57 +00:00
Yang Tse
6634e3c3a3
On heavily loaded systems any test server start up can take longer than the
...
timeout passed to startnew, when this happens startnew completes without being
able to read the pidfile and consequently returns a zero pid2.
To fix the above posibility the server pid is recovered from the verification
stage which will actually return the server pid when verification is valid.
2008-02-12 13:47:56 +00:00
Dan Fandrich
75c369dcca
Disable test due to keyword before disabling due to bad server.
2008-02-11 20:10:36 +00:00
Yang Tse
6942d313ff
Verify only once test harness sftp server connectivity and functionality.
...
Make sure that the sftp client tool uses the ssh client binary that we have
used to generate the configuration files, otherwise sftp might be using one
located in the preferred path compiled into sftp.
2008-02-10 02:52:17 +00:00
Yang Tse
1a340de0e5
To verify that the sftp server is actually running, responsive and that
...
all curl's tests generated configuration and key files are fine, a real
connection is established to the test harness sftp server authenticating
and running a simple sftp remote pwd command.
The verification is done using OpenSSH's or SunSSH's sftp client tool with
a configuration file with the same options as the test harness socks server
with the exception that dynamic forwarding is not used for sftp.
2008-02-08 13:54:02 +00:00
Yang Tse
01d95b56a0
fix failure to properly detect SSH and SOCKS servers start up on loaded systems
2008-01-18 09:18:59 +00:00
Daniel Stenberg
6893fcaa9b
remove trailing comma too, even though I don't think it does any harm
2008-01-16 22:09:51 +00:00
Daniel Stenberg
301ae1ae1b
Nathan Coulter's patch that makes runtests.pl respect the PATH when figuring
...
out what valgrind to run.
2008-01-16 22:08:37 +00:00
Yang Tse
69f685056d
startnew() shouldn't return a positive pid as reported in the pidfile
...
by the spawned server itself unless it is actually alive
2008-01-14 19:28:54 +00:00
Yang Tse
2b63eb8511
Ooops
2008-01-12 00:12:16 +00:00
Yang Tse
f09fe4b49f
Ooops
2008-01-11 21:59:05 +00:00
Yang Tse
35be09cf58
When verifying that test harness's SSH and SOCKS servers have been
...
started check also that the process is actually alive, since they
could have died once the pidfile was written out
2008-01-11 20:17:33 +00:00
Yang Tse
14ff7e75e0
Temporary change to help debugging SSH server verification failures
2008-01-10 16:19:14 +00:00
Yang Tse
32cc75d6cb
Partially cleanup debugging messages in test harness, introduced for
...
new minimum SSH version support for SCP, SFTP and SOCKS tests.
Some verbosity which still remains, will go out before next release.
2008-01-08 20:12:43 +00:00
Yang Tse
2408b236ca
Display ssh server log and configuration upon socks server failure
2008-01-08 00:39:31 +00:00
Daniel Stenberg
fe0d7aee49
Daniel Egger provided 'nonewline=yes' support for the <stdout> section
2008-01-04 23:31:04 +00:00
Yang Tse
a4945fe687
Missing newline at end of message
2008-01-04 19:56:56 +00:00
Yang Tse
7a2177dc42
- Display curl_ssh_config when socks server fails to start.
...
- Capability of running socks5 tests must be based on ssh daemon version
and not on ssh client version.
2008-01-04 13:00:40 +00:00
Yang Tse
bf6e2f28ba
Make sure @INC is modified before 'using' the sshhelp module.
2008-01-04 03:05:33 +00:00
Yang Tse
fd8d862c37
Modify test harness so that the minimum SSH version required to run
...
SCP, SFTP and SOCKS4 tests is now OpenSSH 2.9.9 or SunSSH 1.0
For SOCKS5 tests minimum versions are OpenSSH 3.7 or SunSSH 1.0
2008-01-03 20:48:22 +00:00
Dan Fandrich
9cd30c2012
Use getcwd() to get the directory, which works even if one of the directory
...
components doesn't have read permission set.
2007-12-22 18:25:43 +00:00
Yang Tse
08cb30801c
Stop ssh and socks servers when verification fails
2007-11-26 14:26:40 +00:00
Yang Tse
788de4f7ba
Providing an explicit bind address besides the port for dynamic application-level
...
port forwarding, our socks port, prevents ssh from running on some systems.
By default, ssh binds local port forwardings to the loopback address, since this
was the address being given as the explicit bind address, now it isn't given.
2007-11-26 14:07:09 +00:00
Yang Tse
d59841618d
Temporary change to better debug startup failures
...
of test suite ssh and socks servers.
2007-11-26 02:45:24 +00:00
Yang Tse
8d3964782a
Allow different start timeout specification for each server
2007-11-25 03:55:53 +00:00
Yang Tse
5b809a3104
make 'checkdied' in runtests.pl more robust
2007-11-23 12:18:45 +00:00
Yang Tse
3daa54d636
Revert last change since it breaks running the test suite
...
when builddir is different from srcdir.
2007-11-23 09:50:44 +00:00
Yang Tse
8f1829d1d2
Improve chance of running runtests.pl from outside the
...
source tree 'tests' directory
2007-11-23 04:03:46 +00:00
Yang Tse
6efb6addf2
Debugging messages to trace startnew failures
2007-11-22 19:56:38 +00:00
Yang Tse
61e2e86aef
Temporary change adding additional debugging messages to better pinpoint
...
startup failures of test suite ssh and socks servers.
2007-11-21 19:33:09 +00:00
Yang Tse
5376d1047c
This is a temporary change to test if OpenSSH 3.6 and SunSSH 1.1
...
are good/compatible enough to run the test suite ssh server and
socks tests
2007-11-19 17:20:32 +00:00
Daniel Stenberg
59dcc7e191
Michal Marek made the test suite remember what test servers that fail to
...
start so that subsequent tries are simply skipped.
2007-11-16 23:06:53 +00:00
Daniel Stenberg
44d408204a
Michal Marek fixed the test suite to better deal with the case when the HTTP
...
ipv6 server can't run.
2007-11-15 22:41:31 +00:00
Dan Fandrich
8be493296d
Make postcheck failure message more like the others
2007-11-01 17:42:39 +00:00
Dan Fandrich
3f55ed0ef7
Check that all servers in the <server> section are supported, not just
...
the first.
2007-10-26 19:26:04 +00:00
Dan Fandrich
b7dd186d36
When valgrind is disabled in the test file, don't run it at all (as opposed
...
to running it and ignoring its output).
2007-10-25 19:39:52 +00:00
Yang Tse
26c1c8b2ad
Don't show valgrind log files of other tests
2007-10-25 18:07:13 +00:00
Daniel Stenberg
824aa5f918
Michal Marek fixed the test script to be able to use valgrind even when the
...
lib is built shared with libtool.
2007-10-25 14:30:51 +00:00
Dan Fandrich
2fce1f3e97
Fixed the -l option of runtests.pl
...
Added support for skipping tests based on key words.
2007-10-11 21:15:09 +00:00
Dan Fandrich
4686adb433
Added variable substitution to the <verify><file> section.
...
Made a few more tests work remotely.
2007-09-20 20:39:17 +00:00
Dan Fandrich
048c74f2fa
Added %CLIENTIP and %CLIENT6IP data file substitution variables.
...
Added hooks to the test suite to make it possible to test a curl running
on a remote host.
2007-09-17 21:42:01 +00:00
Daniel Stenberg
c7e0d8c30b
add some better logging when HTTP server start fails, and make the failure
...
really hard if the test server can't be resolved (like for ::1 ipv6)
2007-07-14 22:33:46 +00:00
Dan Fandrich
c45d44fee9
Wait longer for servers to start up since the ssh server needs to generate
...
keys the first time (which can take a while on a slow or loaded host).
Enforce a longer startup wait time for the ssh client SOCKS server, too.
Check for an error code from startnew() when starting any server.
2007-06-11 17:53:10 +00:00
Dan Fandrich
477e27f99d
Fixed the test harness so that it actually kills the ssh being used as
...
the SOCKS server.
2007-06-08 18:56:05 +00:00
Dan Fandrich
873d95a34c
Incorporated Daniel Black's test706 and test707 SOCKS test cases.
2007-06-08 17:21:40 +00:00
Dan Fandrich
1500e95839
Improved compatibility with perl 5.0 on the 'open' calls.
2007-06-08 17:03:50 +00:00
Dan Fandrich
ad80490711
Changed the opens to work on older versions of perl.
...
Redirect ssh output to ssh.log
2007-06-07 22:42:26 +00:00
Dan Fandrich
f0ffb35d55
Fixed some problems in starting SSH for use in SOCKS.
2007-06-07 19:49:09 +00:00
Daniel Stenberg
a466b31574
Daniel Black's test suite fixes and initial test cases for SOCKS4/5 using
...
openssh
2007-06-05 13:50:59 +00:00
Yang Tse
9583b51d80
In case of test failure, try not to show log files of other tests
2007-05-30 17:15:05 +00:00
Dan Fandrich
5187faeeb9
Improved the test harness to allow running test servers on other than
...
the default port numbers, allowing more than one test suite to run
simultaneously on the same host.
2007-04-30 20:15:33 +00:00
Dan Fandrich
f213d0db98
Added support in runtests.pl for "!n" test numbers to disable individual tests.
2007-04-25 23:18:52 +00:00
