curl/lib
Daniel Stenberg ec4f6e93c2 - Emil Romanus found a problem and helped me repeat it. It occured when using
the curl_multi_socket() API with HTTP pipelining enabled and could lead to
  the pipeline basically stalling for a very long period of time until it took
  off again.
2008-05-28 20:56:19 +00:00
..
.cvsignore Removed the generated ca-bundle.h file. The verbatim value of $ca and 2008-03-31 12:09:43 +00:00
Makefile.Watcom Internal time differences now use monotonic time source if available. 2008-05-09 16:31:51 +00:00
Makefile.am Dan Fandrich pointed out that this is the way we should increase the number 2008-05-23 17:56:03 +00:00
Makefile.b32 Static lib is libcurl.lib and import lib libcurl_imp.lib. 2004-11-14 13:48:15 +00:00
Makefile.inc Removed the generated ca-bundle.h file. The verbatim value of $ca and 2008-03-31 12:09:43 +00:00
Makefile.m32 Internal time differences now use monotonic time source if available. 2008-05-09 16:31:51 +00:00
Makefile.netware moved CURL_CA_BUNDLE define to generated config.h. 2008-03-31 12:51:44 +00:00
Makefile.riscos GnuTLS updates 2005-04-07 21:10:31 +00:00
Makefile.vc6 Internal time differences now use monotonic time source if available. 2008-05-09 16:31:51 +00:00
README.ares When transferring 500 downloads in parallel with a c-ares enabled build only 2007-05-31 11:34:32 +00:00
README.curlx updated with more and new info 2004-04-30 08:51:19 +00:00
README.encoding Fixed a lingering omission of gzip support. 2005-12-08 18:59:19 +00:00
README.hostip Added README.hostip 2005-01-14 13:43:29 +00:00
README.httpauth HTTP "auth done right". See lib/README.httpauth 2004-11-24 16:11:35 +00:00
README.memoryleak corrected how tests/memanalyze.pl is used 2006-10-29 23:00:52 +00:00
README.multi_socket updated to current status 2006-10-29 09:18:32 +00:00
README.pipelining updated to reflect reality 2006-10-29 09:11:44 +00:00
amigaos.c proper symbol definition check for all AmigaOS flavours 2007-02-28 14:45:48 +00:00
amigaos.h proper symbol definition check for all AmigaOS flavours 2007-02-28 14:45:48 +00:00
arpa_telnet.h Make some more arrays of pointers const. 2004-12-20 18:23:43 +00:00
base64.c removed space after if and while before the parenthesis for better source code 2007-11-05 09:45:09 +00:00
base64.h - David McCreedy made changes to allow base64 encoding/decoding to work on 2007-01-03 23:04:38 +00:00
config-amigaos.h proper symbol definition check for all AmigaOS flavours 2007-02-28 14:45:48 +00:00
config-mac.h Make sure RETSIGTYPE is properly defined 2006-11-25 01:02:52 +00:00
config-os400.h fix: socklen_t definition comment 2008-05-21 13:57:50 +00:00
config-riscos.h fix: socklen_t definition comment 2008-05-21 13:57:50 +00:00
config-symbian.h fix: socklen_t definition comment 2008-05-21 13:57:50 +00:00
config-tpf.h fix: socklen_t definition comment 2008-05-21 13:57:50 +00:00
config-win32.h Remove fflush() + fsync() previously introduced accelerated writing of 2008-04-22 12:40:05 +00:00
config-win32ce.h Internal time differences now use monotonic time source if available. 2008-05-09 16:31:51 +00:00
config.dos DOS targets do have setmode(). 2007-04-03 10:18:38 +00:00
connect.c Removed some duplicated #includes 2008-05-21 21:08:31 +00:00
connect.h - Introducing curl_easy_send() and curl_easy_recv(). They can be used to send 2008-05-12 21:43:24 +00:00
content_encoding.c struct HandleData is now called struct SingleRequest, and is only for data that 2007-11-24 23:16:55 +00:00
content_encoding.h struct HandleData is now called struct SingleRequest, and is only for data that 2007-11-24 23:16:55 +00:00
cookie.c - Niklas Angebrand made the cookie support in libcurl properly deal with the 2008-01-31 12:21:57 +00:00
cookie.h - Niklas Angebrand made the cookie support in libcurl properly deal with the 2008-01-31 12:21:57 +00:00
curl_ldap.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
curllib.dsw Hanno L. Kranzhoff fixed them 2002-06-14 09:36:09 +00:00
curlx.h Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
dict.c All static functions that were previously name Curl_* something no longer 2007-12-08 22:50:55 +00:00
dict.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
easy.c - Introducing curl_easy_send() and curl_easy_recv(). They can be used to send 2008-05-12 21:43:24 +00:00
easyif.h Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
escape.c if () => if() 2007-11-07 09:21:35 +00:00
escape.h First commit of David McCreedy's EBCDIC and TPF changes. 2006-04-07 21:50:47 +00:00
file.c Renamed MSDOS_FILESYSTEM to avoid conflict with MIT GSS 2008-05-21 21:36:42 +00:00
file.h Fixed an OOM problem with file: URLs 2007-10-30 23:00:40 +00:00
formdata.c - Added CURLFORM_STREAM as a supported option to curl_formadd() to allow an 2008-03-31 10:02:23 +00:00
formdata.h - Added CURLFORM_STREAM as a supported option to curl_formadd() to allow an 2008-03-31 10:02:23 +00:00
ftp.c - Liam Healy filed the debian bug report #480044 2008-05-07 21:02:21 +00:00
ftp.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
getenv.c if () => if() 2007-11-07 09:21:35 +00:00
getinfo.c - Introducing curl_easy_send() and curl_easy_recv(). They can be used to send 2008-05-12 21:43:24 +00:00
getinfo.h updated year in the copyright string 2004-01-07 09:19:33 +00:00
gtls.c Added support for server name indication (RFC 4366). 2008-02-26 10:30:13 +00:00
gtls.h Renamed a few variables to avoid shadowing global declarations. 2007-09-27 02:45:58 +00:00
hash.c if () => if() 2007-11-07 09:21:35 +00:00
hash.h Robert Iakobashvili re-arranged the internal hash code to work with a custom 2007-06-26 21:09:28 +00:00
hostares.c improve easy interface resolving timeout handling in c-ares enabled builds 2008-04-29 04:18:02 +00:00
hostasyn.c Adapted the c-ares code to the API change c-ares 1.5.0 brings in the 2007-09-28 21:48:28 +00:00
hostip.c - Dmitry Popov filed bug report #1911069 2008-03-11 22:55:23 +00:00
hostip.h Woops, partly revert my previous commit and do it slightly differently instead. 2008-01-15 22:44:12 +00:00
hostip4.c if () => if() 2007-11-07 09:21:35 +00:00
hostip6.c if () => if() 2007-11-07 09:21:35 +00:00
hostsyn.c update copyright year 2007-04-03 18:25:18 +00:00
hostthre.c Bug report #1888932 (http://curl.haxx.se/bug/view.cgi?id=1888932) points 2008-02-10 04:20:09 +00:00
http.c when the multi handle was in DO and DOING states, the HTTP and HTTPS protocol 2008-05-19 20:57:28 +00:00
http.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
http_chunks.c - Dmitry Kurochkin moved several struct fields from the connectdata struct to 2008-01-31 12:04:33 +00:00
http_chunks.h - Ravi Pratap provided work on libcurl making pipelining more robust and 2007-02-21 21:59:40 +00:00
http_digest.c Nikitinskit Dmitriy filed bug report #1868255 2008-01-10 09:17:07 +00:00
http_digest.h Fixed some minor type mismatches and missing consts mainly found by splint. 2007-08-27 06:31:28 +00:00
http_negotiate.c David Rosenstrauch reported that header files spnegohelp.h and 2008-05-26 03:10:34 +00:00
http_negotiate.h Mark Davies fixed Negotiate authentication over proxy, and also introduced 2007-09-21 11:05:31 +00:00
http_ntlm.c removed space after if and while before the parenthesis for better source code 2007-11-05 09:45:09 +00:00
http_ntlm.h Fixed some minor type mismatches and missing consts mainly found by splint. 2007-08-27 06:31:28 +00:00
if2ip.c Added support for running on Symbian OS. 2008-04-22 22:53:53 +00:00
if2ip.h build fix for Interix 2006-03-04 22:39:31 +00:00
inet_ntoa_r.h provide the proper copyright texts for these 2005-05-26 20:56:25 +00:00
inet_ntop.c if () => if() 2007-11-07 09:21:35 +00:00
inet_ntop.h Yang Tse: fixes the use of Curl_inet_ntop and Curl_inet_pton with no 2005-11-25 22:20:02 +00:00
inet_pton.c if () => if() 2007-11-07 09:21:35 +00:00
inet_pton.h Yang Tse's changes to provide an inet_pton() proto for the platforms who 2005-11-28 20:21:35 +00:00
krb4.c - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
krb4.h - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
krb5.c Fixed some include file problems on Windows reported by David Rosenstrauch 2008-05-22 19:44:10 +00:00
ldap.c reqdata doesn't exist anymore and the path moved to the UrlState struct 2007-11-24 23:18:21 +00:00
libcurl.def Yang Tse: msvc7+ has deprecated the 'DESCRIPTION' section in 2005-11-14 07:48:05 +00:00
libcurl.framework.make Nir Soffer updated libcurl.framework.make: fix symlinks, should link to 2006-11-09 21:58:28 +00:00
libcurl.imp there's an curl_easy_unescape too now 2006-04-18 09:23:03 +00:00
libcurl.plist Matt Veenstra updated to 7.12.3. Starting now, we'll update the version number 2004-12-08 23:09:23 +00:00
libcurl.rc use copyright define instead of hardcoded string. 2008-01-24 14:10:59 +00:00
llist.c Dmitry Kurochkin worked a lot on improving the HTTP Pipelining support that 2008-01-16 12:24:00 +00:00
llist.h Dmitry Kurochkin worked a lot on improving the HTTP Pipelining support that 2008-01-16 12:24:00 +00:00
makefile.amiga Diego Casorran patches to make (lib)curl build fine on Amiga again 2005-07-13 18:06:40 +00:00
makefile.dj Added TOPDIR variable. Put dependencies in external file. 2007-02-27 15:24:32 +00:00
md5.c if () => if() 2007-11-07 09:21:35 +00:00
md5.h Add 'const' to immutable arrays. 2004-12-15 01:38:25 +00:00
memdebug.c Move the CURLDEBUG check after setup.h so it can be set there if necessary. 2008-05-14 23:36:26 +00:00
memdebug.h Using fdopen() is a more correct way to implement the CURLOPT_NEW_FILE_PREMS 2007-06-28 11:11:29 +00:00
memory.h removed tabs and trailing whitespace from source 2004-10-06 07:50:18 +00:00
mk-ca-bundle.pl fixed version var. 2008-02-15 00:41:54 +00:00
mprintf.c fix the treatment of the parameter-based precision, as in "%.*s%s" as 2007-11-20 10:03:33 +00:00
msvcproj.foot new attempt at an improved DSP-file generation 2004-05-11 07:54:55 +00:00
msvcproj.head Internal time differences now use monotonic time source if available. 2008-05-09 16:31:51 +00:00
multi.c - Emil Romanus found a problem and helped me repeat it. It occured when using 2008-05-28 20:56:19 +00:00
multiif.h Fixed some minor mismatched types found by splint. 2007-08-26 05:53:26 +00:00
netrc.c if () => if() 2007-11-07 09:21:35 +00:00
netrc.h updated year in the copyright string 2004-01-07 09:19:33 +00:00
nss.c fix: preprocessor complaining about macro redefinition 2008-05-26 01:59:00 +00:00
nssg.h Renamed a few variables to avoid shadowing global declarations. 2007-09-27 02:45:58 +00:00
nwlib.c happy new year 2008-01-23 02:12:13 +00:00
nwos.c if () => if() 2007-11-07 09:21:35 +00:00
parsedate.c Jeff Johnson filed bug report #1863171 2008-01-06 10:50:57 +00:00
parsedate.h Updated the copyright year since changes have been this year. 2005-03-31 07:02:02 +00:00
progress.c struct HandleData is now called struct SingleRequest, and is only for data that 2007-11-24 23:16:55 +00:00
progress.h clean up start time and t_startsingle use so that redirect_time works properly 2004-11-15 11:27:03 +00:00
qssl.c Adapting last changes to OS400: 2008-05-20 10:21:50 +00:00
qssl.h Adapting last changes to OS400: 2008-05-20 10:21:50 +00:00
security.c fix: preprocessor complaining about macro redefinition 2008-05-26 01:59:00 +00:00
select.c Andreas Faerber and Scott McCreary made (lib)curl build for the Haiku OS 2008-05-26 15:09:28 +00:00
select.h check availability of poll.h header at configuration time, and include 2008-01-22 14:52:54 +00:00
sendf.c - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
sendf.h - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
setup-os400.h Adapting last changes to OS400: 2008-05-20 10:21:50 +00:00
setup.h Added support for running on Symbian OS. 2008-04-22 22:53:53 +00:00
setup_once.h fix: remove need and definition of HAVE_SOCKLEN_T symbol 2008-05-21 14:04:14 +00:00
share.c - Added curl_easy_getinfo typechecker. 2008-03-18 08:14:37 +00:00
share.h Added support for Salford-C under Win32 (scc). HAVE_MALLOC_H and 2006-04-26 17:11:05 +00:00
sockaddr.h oops * 2 2005-11-12 22:13:20 +00:00
socks.c Yang Tse pointed out a few remaining quirks from my timeout refactoring from 2008-02-11 22:03:31 +00:00
socks.h Richard Atterer brought a patch that added support for SOCKS4a proxies, which 2008-01-02 21:40:11 +00:00
speedcheck.c Renamed several libcurl error codes and options to make them more general 2007-08-30 20:34:57 +00:00
speedcheck.h updated year in the copyright string 2004-01-07 09:19:33 +00:00
splay.c fix compiler warning: format '%ld' expects type 'long int' 2008-05-08 05:45:01 +00:00
splay.h Christopher Palow provided the patch (edited by me) that introduces 2008-05-07 15:41:41 +00:00
ssh.c - Jeff Weber reported memory leaks with aborted SCP and SFTP transfers and 2008-05-28 20:31:28 +00:00
ssh.h - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
sslgen.c - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
sslgen.h - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
ssluse.c fix: preprocessor complaining about macro redefinition 2008-05-26 01:59:00 +00:00
ssluse.h - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
strdup.c Fix problem in strdup replacement when dealing with absolutely huge strings. 2008-02-06 19:01:13 +00:00
strdup.h Moved strdup replacement from src/main.c into src/strdup.c so it's available 2006-07-11 17:02:06 +00:00
strequal.c if () => if() 2007-11-07 09:21:35 +00:00
strequal.h modified this year 2005-04-22 20:48:07 +00:00
strerror.c - Introducing curl_easy_send() and curl_easy_recv(). They can be used to send 2008-05-12 21:43:24 +00:00
strerror.h removed trailing whitespace 2004-10-11 17:26:24 +00:00
strtok.c if () => if() 2007-11-07 09:21:35 +00:00
strtok.h updated year in the copyright string 2004-01-07 09:19:33 +00:00
strtoofft.c removed space after if and while before the parenthesis for better source code 2007-11-05 09:45:09 +00:00
strtoofft.h Added prototype for _strtoi64(). 2007-11-06 16:20:54 +00:00
telnet.c All static functions that were previously name Curl_* something no longer 2007-12-08 22:50:55 +00:00
telnet.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
tftp.c Yang Tse pointed out a few remaining quirks from my timeout refactoring from 2008-02-11 22:03:31 +00:00
tftp.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
timeval.c configure script will now define HAVE_CLOCK_GETTIME_MONOTONIC symbol only 2008-05-12 02:04:21 +00:00
timeval.h update copyright year 2007-04-03 18:25:18 +00:00
transfer.c - Bug report #1973352 (http://curl.haxx.se/bug/view.cgi?id=1973352) identified 2008-05-26 20:39:41 +00:00
transfer.h - To make it easier for applications that want lots of magic stuff done on 2008-04-30 21:20:08 +00:00
url.c - To make it easier for applications that want lots of magic stuff done on 2008-04-30 21:20:08 +00:00
url.h provide CURL_DEFAULT_PROXY_PORT set to 1080 for the default port libcurl 2008-04-05 21:13:31 +00:00
urldata.h - To make it easier for applications that want lots of magic stuff done on 2008-04-30 21:20:08 +00:00
vc8proj.foot Use DOS line-endings. 2007-01-29 19:08:04 +00:00
vc8proj.head Use DOS line-endings. 2007-01-29 19:08:04 +00:00
version.c if () => if() 2007-11-07 09:21:35 +00:00

README.pipelining

HTTP Pipelining with libcurl
============================

Background

Since pipelining implies that one or more requests are sent to a server before
the previous response(s) have been received, we only support it for multi
interface use.

Considerations

When using the multi interface, you create one easy handle for each transfer.
Bascially any number of handles can be created, added and used with the multi
interface - simultaneously. It is an interface designed to allow many
simultaneous transfers while still using a single thread. Pipelining does not
change any of these details.

API

We've added a new option to curl_multi_setopt() called CURLMOPT_PIPELINING
that enables "attempted pipelining" and then all easy handles used on that
handle will attempt to use an existing pipeline.

Details

- A pipeline is only created if a previous connection exists to the same IP
  address that the new request is being made to use.

- Pipelines are only supported for HTTP(S) as no other currently supported
  protocol has features resemembling this, but we still name this feature
  plain 'pipelining' to possibly one day support it for other protocols as
  well.

- HTTP Pipelining is for GET and HEAD requests only.

- When a pipeline is in use, we must take precautions so that when used easy
  handles (i.e those who still wait for a response) are removed from the multi
  handle, we must deal with the outstanding response nicely.

- Explicitly asking for pipelining handle X and handle Y won't be supported.
  It isn't easy for an app to do this association. The lib should probably
  still resolve the second one properly to make sure that they actually _can_
  be considered for pipelining. Also, asking for explicit pipelining on handle
  X may be tricky when handle X get a closed connection.

- We need options to control max pipeline length, and probably how to behave
  if we reach that limit. As was discussed on the list, it can probably be
  made very complicated, so perhaps we can think of a way to pass all
  variables involved to a callback and let the application decide how to act
  in specific situations. Either way, these fancy options are only interesting
  to work on when everything is working and we have working apps to test with.