2001-09-13 08:51:32 -04:00
|
|
|
|
The file format of the test suite is a very simple and extendable format. All
|
|
|
|
|
data for a single test case resides in a single ASCII file. Labels mark the
|
|
|
|
|
beginning and the end of all sections. Each label must be written in its own
|
|
|
|
|
line and is resembling XML/HTML.
|
|
|
|
|
|
|
|
|
|
Each file is split up in three main sections: reply, client and verify. The
|
|
|
|
|
reply section is used for the server to know what to send as a reply for the
|
|
|
|
|
requests curl sends, the client section defines how the client should behave
|
|
|
|
|
while the verify section defines how to verify that the data stored after a
|
|
|
|
|
command has been run ended up correctly.
|
|
|
|
|
|
|
|
|
|
Each main section has a number of available subsections that can be
|
|
|
|
|
specified, that will be checked/used if specified. This document includes all
|
|
|
|
|
the subsections currently supported.
|
|
|
|
|
|
|
|
|
|
<reply>
|
2004-08-23 10:40:43 -04:00
|
|
|
|
<data [nocheck=1] [sendzero=yes]>
|
|
|
|
|
<EFBFBD>data to sent to the client on its request and later verified that it arrived
|
2002-01-08 04:32:21 -05:00
|
|
|
|
safely. Set the nocheck=1 to prevent the test script to verify the arrival
|
|
|
|
|
of this data.
|
2003-07-19 19:56:44 -04:00
|
|
|
|
|
2004-03-31 07:24:08 -05:00
|
|
|
|
If the data contains 'swsclose' anywhere within the start and end tag, and
|
2003-07-19 19:56:44 -04:00
|
|
|
|
this is a HTTP test, then the connection will be closed by the server after
|
|
|
|
|
this response is sent. If not, the connection will be kept persistant.
|
2004-03-31 07:24:08 -05:00
|
|
|
|
|
|
|
|
|
If the data contains 'swsbounce' anywhere within the start and end tag, the
|
|
|
|
|
HTTP server will detect if this is a second request using the same test and
|
|
|
|
|
part number and will then increase the part number with one. This is useful
|
|
|
|
|
for auth tests and similar.
|
2004-08-23 10:40:43 -04:00
|
|
|
|
|
|
|
|
|
'sendzero' set to yes means that the (FTP) server will "send" the data even if
|
|
|
|
|
the size is zero bytes. Used to verify curl's behaviour on zero bytes
|
|
|
|
|
transfers.
|
2001-09-13 08:51:32 -04:00
|
|
|
|
</data>
|
2003-05-22 18:37:00 -04:00
|
|
|
|
<dataNUM>
|
|
|
|
|
Send back this contents instead of the <data> one. The num is set by:
|
|
|
|
|
A) The test number in the request line is >10000 and this is the remainder
|
|
|
|
|
of [test case number]%10000.
|
2003-09-15 17:43:03 -04:00
|
|
|
|
B) The request was HTTP and included digest details, which adds 1000 to NUM
|
|
|
|
|
C) If a HTTP request is NTLM type-1, it adds 1001 to num
|
|
|
|
|
D) If a HTTP request is NTLM type-3, it adds 1002 to num
|
2003-05-22 18:37:00 -04:00
|
|
|
|
</dateNUM>
|
2002-06-11 11:11:41 -04:00
|
|
|
|
<datacheck [nonewline=yes]>
|
|
|
|
|
if the data is sent but this is what should be checked afterwards. If
|
|
|
|
|
'nonewline' is set, we will cut off the trailing newline of this given data
|
|
|
|
|
before comparing with the one actually received by the client
|
2001-09-13 08:51:32 -04:00
|
|
|
|
</datacheck>
|
|
|
|
|
<size>
|
2003-02-28 02:55:01 -05:00
|
|
|
|
number to return on a ftp SIZE command (set to -1 to make this command fail)
|
2001-09-13 08:51:32 -04:00
|
|
|
|
</size>
|
2003-04-09 07:53:09 -04:00
|
|
|
|
<mdtm>
|
|
|
|
|
what to send back if the client sends a (FTP) MDTM command, set to -1 to
|
|
|
|
|
have it return that the file doesn't exist
|
|
|
|
|
</mdtm>
|
2004-10-12 14:20:36 -04:00
|
|
|
|
<servercmd>
|
2001-11-02 18:09:25 -05:00
|
|
|
|
special purpose server-command to control its behavior *before* the
|
2004-10-12 14:20:36 -04:00
|
|
|
|
reply is sent:
|
|
|
|
|
|
|
|
|
|
auth_required - server fails if no auth is provided
|
|
|
|
|
</servercmd>
|
2001-11-02 18:09:25 -05:00
|
|
|
|
<postcmd>
|
|
|
|
|
special purpose server-command to control its behavior *after* the
|
|
|
|
|
reply is sent
|
2002-01-08 04:32:21 -05:00
|
|
|
|
</postcmd>
|
2004-03-31 07:24:08 -05:00
|
|
|
|
<servercmd>
|
|
|
|
|
equivalent to <cmd> but for HTTP, one specified command is supported:
|
|
|
|
|
"auth_required" - if this is set and a POST/PUT is made without auth, the
|
|
|
|
|
server will NOT wait for the full request body to get sent
|
|
|
|
|
</servercmd>
|
2001-09-13 08:51:32 -04:00
|
|
|
|
</reply>
|
|
|
|
|
|
|
|
|
|
<client>
|
2003-04-01 03:43:09 -05:00
|
|
|
|
|
2002-12-12 07:15:02 -05:00
|
|
|
|
<server>
|
|
|
|
|
protocols as in 'http' 'ftp' etc. Give only one per line. Used for test cases
|
|
|
|
|
500+ (at this point) to specify which servers the test case requires. In the
|
|
|
|
|
future all test cases should use this. Makes us independent of the test
|
|
|
|
|
case number.
|
2003-04-01 03:43:09 -05:00
|
|
|
|
</server>
|
|
|
|
|
|
2003-06-12 12:22:52 -04:00
|
|
|
|
<features>
|
|
|
|
|
A list of features that must be present in the client/library for this test
|
|
|
|
|
to be able to run. Features testable here are:
|
|
|
|
|
SSL
|
2003-06-12 12:38:14 -04:00
|
|
|
|
netrc_debug
|
2004-03-01 11:25:24 -05:00
|
|
|
|
large_file
|
2004-04-30 04:00:42 -04:00
|
|
|
|
idn
|
2004-11-22 17:26:46 -05:00
|
|
|
|
getrlimit
|
2004-11-25 17:21:49 -05:00
|
|
|
|
ipv6
|
2003-06-12 12:22:52 -04:00
|
|
|
|
</features>
|
|
|
|
|
|
2003-04-01 03:43:09 -05:00
|
|
|
|
<killserver>
|
|
|
|
|
Using the same syntax as in <server> but when mentioned here these servers
|
|
|
|
|
are explicitly KILLED when this test case is completed. Only use this if there
|
|
|
|
|
is no other alternatives. Using this of course requires subsequent tests to
|
|
|
|
|
restart servers.
|
|
|
|
|
</killserver>
|
|
|
|
|
|
2004-11-23 04:50:16 -05:00
|
|
|
|
<precheck>
|
|
|
|
|
A command line that if set gets run by the test script before the test. If an
|
|
|
|
|
output is displayed by the command line, the test will be skipped and the
|
|
|
|
|
(single-line) output will be displayed as reason for not running the test.
|
|
|
|
|
</precheck>
|
|
|
|
|
|
2002-12-12 07:15:02 -05:00
|
|
|
|
<tool>
|
|
|
|
|
Name of tool to use instead of "curl". This tool must be built and exist
|
|
|
|
|
in the libtest/ directory.
|
|
|
|
|
</tool>
|
2003-04-01 03:43:09 -05:00
|
|
|
|
|
2001-09-13 08:51:32 -04:00
|
|
|
|
<name>
|
|
|
|
|
test case description
|
|
|
|
|
</name>
|
2003-04-01 03:43:09 -05:00
|
|
|
|
|
2003-05-19 09:06:10 -04:00
|
|
|
|
<setenv>
|
|
|
|
|
variable1=contents1
|
|
|
|
|
variable2=contents2
|
|
|
|
|
|
|
|
|
|
Set the given environment variables to the specified value before the actual
|
2004-04-30 04:00:42 -04:00
|
|
|
|
command is run, they are cleared again after the command has been run.
|
2003-05-19 09:06:10 -04:00
|
|
|
|
</setenv>
|
|
|
|
|
|
2002-01-08 04:32:21 -05:00
|
|
|
|
<command [option=no-output]>
|
2001-09-13 08:51:32 -04:00
|
|
|
|
command line to run, there's a bunch of %variables that get replaced
|
2003-08-06 18:47:55 -04:00
|
|
|
|
accordingly.
|
|
|
|
|
|
|
|
|
|
Note that the URL that gets passed to the server actually controls what data
|
|
|
|
|
that is returned. The last slash in the URL must be followed by a number. That
|
|
|
|
|
number (N) will be used by the test-server to load test case N and return the
|
|
|
|
|
data that is defined within the <reply><data></data></reply> section.
|
2002-01-08 04:32:21 -05:00
|
|
|
|
|
2003-11-24 11:12:41 -05:00
|
|
|
|
If a CONNECT is used to the server (to emulate HTTPS etc over proxy), the port
|
|
|
|
|
number given in the CONNECT request will be used to identify which test that
|
|
|
|
|
is being run, if the proxy host name is said to start with 'test'.
|
|
|
|
|
|
2002-01-08 04:32:21 -05:00
|
|
|
|
Set 'option=no-output' to prevent the test script to slap on the --output
|
|
|
|
|
argument that directs the output to a file. The --output is also not added if
|
|
|
|
|
the client/stdout section is used.
|
2002-12-13 11:25:39 -05:00
|
|
|
|
|
|
|
|
|
Available substitute variables include:
|
|
|
|
|
%HOSTIP - IP address of the host running this test
|
|
|
|
|
%HOSTPORT - Port number of the HTTP server
|
|
|
|
|
%HTTPSPORT - Port number of the HTTPS server
|
|
|
|
|
%FTPPORT - Port number of the FTP server
|
|
|
|
|
%FTPSPORT - Port number of the FTPS server
|
|
|
|
|
%SRCDIR - Full path to the source dir
|
|
|
|
|
%PWD - Current directory
|
2001-09-13 08:51:32 -04:00
|
|
|
|
</command>
|
2003-04-01 03:43:09 -05:00
|
|
|
|
|
2001-09-13 08:51:32 -04:00
|
|
|
|
<file name="log/filename">
|
|
|
|
|
this creates the named file with this content before the test case is run
|
|
|
|
|
which is useful if the test case needs a file to act on.
|
|
|
|
|
</file>
|
2003-04-01 03:43:09 -05:00
|
|
|
|
|
2004-02-05 16:51:45 -05:00
|
|
|
|
<stdin>
|
|
|
|
|
Pass this given data on stdin to the tool.
|
|
|
|
|
</stdin>
|
|
|
|
|
|
2001-09-13 08:51:32 -04:00
|
|
|
|
</client>
|
|
|
|
|
|
|
|
|
|
<verify>
|
|
|
|
|
<errorcode>
|
|
|
|
|
numerical error code curl is supposed to return
|
|
|
|
|
</errorcode>
|
2001-09-14 08:02:02 -04:00
|
|
|
|
<strip>
|
|
|
|
|
One regex per line that is removed from the protocol dumps before the
|
|
|
|
|
comparison is made. This is very useful to remove dependencies on dynamicly
|
|
|
|
|
changing protocol data such as port numbers or user-agent strings.
|
|
|
|
|
</strip>
|
2004-11-25 17:21:49 -05:00
|
|
|
|
<strippart>
|
|
|
|
|
One perl op per line that operates on the protocol dump. This is pretty
|
|
|
|
|
advanced. Example: "s/^EPRT .*/EPRT stripped/"
|
|
|
|
|
</strippart>
|
2002-02-22 05:50:36 -05:00
|
|
|
|
<protocol [nonewline=yes]>
|
|
|
|
|
the protocol dump curl should transmit, if 'nonewline' is set, we will cut
|
|
|
|
|
off the trailing newline of this given data before comparing with the one
|
|
|
|
|
actually sent by the client
|
2001-09-13 08:51:32 -04:00
|
|
|
|
</protocol>
|
2002-01-08 04:32:21 -05:00
|
|
|
|
<stdout>
|
|
|
|
|
This verfies that this data was passed to stdout.
|
|
|
|
|
</stdout>
|
2001-09-26 03:05:00 -04:00
|
|
|
|
<file name="log/filename">
|
|
|
|
|
the file's contents must be identical to this
|
|
|
|
|
</file>
|
2001-09-13 08:51:32 -04:00
|
|
|
|
<upload>
|
|
|
|
|
the contents of the upload data curl should have sent
|
|
|
|
|
</upload>
|
|
|
|
|
</verify>
|