curl/lib
Daniel Stenberg 03ca98b0df - SCP and SFTP with the multi interface had the same flaw: the 'DONE'
operation didn't complete properly if the EAGAIN equivalent was returned but
  libcurl would simply continue with a half-completed close operation
  performed. This ruined persistent connection re-use and cause some
  SSH-protocol errors in general. The correction is unfortunately adding a
  blocking function - doing it entirely non-blocking should be considered for
  a better fix.
2008-12-17 12:32:41 +00:00
..
.cvsignore ignore *.dist files 2008-07-29 02:05:07 +00:00
Makefile.Watcom Updated dependencies based on "gcc -MM". 2008-12-16 09:12:46 +00:00
Makefile.am I liked Daniel Johnson's simplified version bumper guide so I modified the 2008-11-03 08:50:58 +00:00
Makefile.b32 Static lib is libcurl.lib and import lib libcurl_imp.lib. 2004-11-14 13:48:15 +00:00
Makefile.inc Use our Curl_addrinfo definition even when an addrinfo struct is available. 2008-10-30 13:45:25 +00:00
Makefile.m32 changed to latest libidn version. 2008-11-13 01:39:10 +00:00
Makefile.netware Refactor configure script detection of functions used to set sockets into 2008-11-13 18:56:55 +00:00
Makefile.riscos Related with bug #2230535 (http://curl.haxx.se/bug/view.cgi?id=2230535) 2008-11-11 01:12:17 +00:00
Makefile.vc6 Add missing curl_addrinfo, and sort the list. 2008-11-06 18:50:32 +00:00
README.NSS Added README.NSS to describe the current NSS situation. 2008-06-24 08:52:35 +00:00
README.ares When transferring 500 downloads in parallel with a c-ares enabled build only 2007-05-31 11:34:32 +00:00
README.curl_off_t spell! (most of it fixed by Tor Arntsen) 2008-08-27 06:10:47 +00:00
README.curlx updated with more and new info 2004-04-30 08:51:19 +00:00
README.encoding Fixed a lingering omission of gzip support. 2005-12-08 18:59:19 +00:00
README.hostip Added README.hostip 2005-01-14 13:43:29 +00:00
README.httpauth HTTP "auth done right". See lib/README.httpauth 2004-11-24 16:11:35 +00:00
README.memoryleak corrected how tests/memanalyze.pl is used 2006-10-29 23:00:52 +00:00
README.multi_socket updated to current status 2006-10-29 09:18:32 +00:00
README.pipelining updated to reflect reality 2006-10-29 09:11:44 +00:00
amigaos.c proper symbol definition check for all AmigaOS flavours 2007-02-28 14:45:48 +00:00
amigaos.h ntoa() and inet_ntoa_r() no longer used 2008-09-24 12:22:16 +00:00
arpa_telnet.h Make some more arrays of pointers const. 2004-12-20 18:23:43 +00:00
base64.c Remove a chunk of unused code that was #ifdef'de on defines we never set. 2008-11-14 16:22:18 +00:00
config-amigaos.h Refactor configure script detection of functions used to set sockets into 2008-11-13 18:56:55 +00:00
config-mac.h Refactor configure script detection of functions used to set sockets into 2008-11-13 18:56:55 +00:00
config-os400.h _ Use getaddrinfo/getnameinfo ascii wrappers on OS400. 2008-12-11 19:20:03 +00:00
config-riscos.h the IP address we want/request/use from the interface is the 'local' 2008-11-17 19:08:35 +00:00
config-symbian.h Refactor configure script detection of functions used to set sockets into 2008-11-13 18:56:55 +00:00
config-tpf.h Refactor configure script detection of functions used to set sockets into 2008-11-13 18:56:55 +00:00
config-win32.h Added the use of Watt-32 tcp/ip stack for Win32 targets. 2008-12-16 08:25:55 +00:00
config-win32ce.h Refactor configure script detection of functions used to set sockets into 2008-11-13 18:56:55 +00:00
config.dos Refactor configure script detection of functions used to set sockets into 2008-11-13 18:56:55 +00:00
connect.c Added the use of Watt-32 tcp/ip stack for Win32 targets. 2008-12-16 08:25:55 +00:00
connect.h - Bug #2218480 (http://curl.haxx.se/bug/view.cgi?id=2218480) pointed out a 2008-11-03 16:24:56 +00:00
content_encoding.c remove unnecessary typecasting of malloc() 2008-09-06 05:29:05 +00:00
content_encoding.h Added missing multiple header inclusion prevention definition 2008-07-11 18:42:30 +00:00
cookie.c - Pawel Kierski pointed out a mistake in the cookie code that could lead to a 2008-12-03 15:08:09 +00:00
cookie.h - Niklas Angebrand made the cookie support in libcurl properly deal with the 2008-01-31 12:21:57 +00:00
curl_addrinfo.c Merged existing IPv4 and IPv6 Curl_ip2addr functions into a single one 2008-11-06 17:19:56 +00:00
curl_addrinfo.h Merged existing IPv4 and IPv6 Curl_ip2addr functions into a single one 2008-11-06 17:19:56 +00:00
curl_base64.h libcurl internal base64.h header file renamed to curl_base64.h 2008-08-17 00:25:38 +00:00
curl_ldap.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
curl_md5.h libcurl internal md5.h header file renamed to curl_md5.h 2008-08-17 00:01:26 +00:00
curllib.dsw Hanno L. Kranzhoff fixed them 2002-06-14 09:36:09 +00:00
curlx.h Renamed Curl_ascii_equal to Curl_raw_equal and bugfixed the my_toupper function 2008-10-16 08:23:48 +00:00
dict.c Added some #ifdefs around header files and change the EAGAIN test to 2008-11-14 23:17:32 +00:00
dict.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
easy.c - Bug report #2416182 titled "crash in ConnectionExists when using 2008-12-11 23:52:56 +00:00
easyif.h Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
escape.c Added const to some pointer variables 2008-10-08 01:17:51 +00:00
escape.h First commit of David McCreedy's EBCDIC and TPF changes. 2006-04-07 21:50:47 +00:00
file.c Added some #ifdefs around header files and change the EAGAIN test to 2008-11-14 23:17:32 +00:00
file.h Fixed an OOM problem with file: URLs 2007-10-30 23:00:40 +00:00
firefox-db2pem.sh - Running 'make ca-firefox' in the root build dir will now run the new 2008-08-23 22:02:41 +00:00
formdata.c Avoid creating garbage on an OOM error 2008-11-18 19:58:44 +00:00
formdata.h - Added CURLFORM_STREAM as a supported option to curl_formadd() to allow an 2008-03-31 10:02:23 +00:00
ftp.c Added the use of Watt-32 tcp/ip stack for Win32 targets. 2008-12-16 08:25:55 +00:00
ftp.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
getenv.c ANSI C compatibility adjustment 2008-09-12 11:18:17 +00:00
getinfo.c fix compiler warning: dereferencing type-punned pointer will break strict-aliasing rules 2008-10-07 18:28:24 +00:00
getinfo.h updated year in the copyright string 2004-01-07 09:19:33 +00:00
gtls.c Made an array static const 2008-11-18 09:11:34 +00:00
gtls.h Forgot it's a struct 2008-10-17 22:33:08 +00:00
hash.c add null-pointer check 2008-10-27 05:29:17 +00:00
hash.h Robert Iakobashvili re-arranged the internal hash code to work with a custom 2007-06-26 21:09:28 +00:00
hostares.c Merged existing IPv4 and IPv6 Curl_ip2addr functions into a single one 2008-11-06 17:19:56 +00:00
hostasyn.c Use our Curl_addrinfo definition even when an addrinfo struct is available. 2008-10-30 13:45:25 +00:00
hostip.c Merged existing IPv4 and IPv6 Curl_ip2addr functions into a single one 2008-11-06 17:19:56 +00:00
hostip.h Merged existing IPv4 and IPv6 Curl_ip2addr functions into a single one 2008-11-06 17:19:56 +00:00
hostip4.c Merged existing IPv4 and IPv6 Curl_ip2addr functions into a single one 2008-11-06 17:19:56 +00:00
hostip6.c Move curl_dofreeaddrinfo() and curl_dofreeaddrinfo() 2008-10-30 19:02:23 +00:00
hostsyn.c Removed unneeded includes of signal.h and setjmp.h 2008-09-29 21:44:50 +00:00
hostthre.c Merged existing IPv4 and IPv6 Curl_ip2addr functions into a single one 2008-11-06 17:19:56 +00:00
http.c - Christian Krause filed bug #2221237 2008-12-08 13:52:20 +00:00
http.h - Test cases 1051, 1052 and 1055 were added by Daniel Fandrich on July 30 and 2008-08-04 22:00:22 +00:00
http_chunks.c fix compiler warning 2008-10-24 01:27:00 +00:00
http_chunks.h - Ravi Pratap provided work on libcurl making pipelining more robust and 2007-02-21 21:59:40 +00:00
http_digest.c - Internet Explorer had a broken HTTP digest authentication before v7 and 2008-12-10 23:13:31 +00:00
http_digest.h Fixed some minor type mismatches and missing consts mainly found by splint. 2007-08-27 06:31:28 +00:00
http_negotiate.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
http_negotiate.h Mark Davies fixed Negotiate authentication over proxy, and also introduced 2007-09-21 11:05:31 +00:00
http_ntlm.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
http_ntlm.h fix compiler warning: function declaration isn't a prototype 2008-09-30 15:06:03 +00:00
if2ip.c Fixed the getifaddrs version of Curl_if2ip to work on systems without IPv6 2008-12-04 06:24:00 +00:00
if2ip.h the IP address we want/request/use from the interface is the 'local' 2008-11-17 19:08:35 +00:00
inet_ntop.c Remove usage of inet_ntoa and inet_ntoa_r 2008-09-23 19:17:19 +00:00
inet_ntop.h Yang Tse: fixes the use of Curl_inet_ntop and Curl_inet_pton with no 2005-11-25 22:20:02 +00:00
inet_pton.c backport fix for failures to reject certain malformed literals 2008-11-17 02:40:41 +00:00
inet_pton.h HAVE_INET_PTON will only be defined when an IPv6 capable working 2008-09-24 19:13:01 +00:00
krb4.c fix OOM problem reported by Jim Meyering 2008-11-16 12:26:50 +00:00
krb4.h - Make Curl_write and it's callees accept a const pointer, in preparation 2008-05-09 11:27:54 +00:00
krb5.c libcurl internal base64.h header file renamed to curl_base64.h 2008-08-17 00:25:38 +00:00
ldap.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
libcurl.def Yang Tse: msvc7+ has deprecated the 'DESCRIPTION' section in 2005-11-14 07:48:05 +00:00
libcurl.framework.make Related with bug #2230535 (http://curl.haxx.se/bug/view.cgi?id=2230535) 2008-11-11 01:12:17 +00:00
libcurl.imp there's an curl_easy_unescape too now 2006-04-18 09:23:03 +00:00
libcurl.plist Matt Veenstra updated to 7.12.3. Starting now, we'll update the version number 2004-12-08 23:09:23 +00:00
libcurl.rc use copyright define instead of hardcoded string. 2008-01-24 14:10:59 +00:00
llist.c remove debug-code which zero-filled some structures before free()ing them 2008-10-20 23:24:35 +00:00
llist.h Dmitry Kurochkin worked a lot on improving the HTTP Pipelining support that 2008-01-16 12:24:00 +00:00
makefile.amiga Related with bug #2230535 (http://curl.haxx.se/bug/view.cgi?id=2230535) 2008-11-11 01:12:17 +00:00
makefile.dj Added rule to generate '../include/curl/curlbuild.h'. 2008-08-21 13:51:07 +00:00
md5.c Adjust usage of conditional definition of USE_OPENSSL 2008-08-17 01:57:10 +00:00
memdebug.c Really old gcc doesn't like parenthesis around the names of functions that 2008-10-23 08:05:40 +00:00
memdebug.h Move curl_dofreeaddrinfo() and curl_dofreeaddrinfo() 2008-10-30 19:02:23 +00:00
memory.h removed tabs and trailing whitespace from source 2004-10-06 07:50:18 +00:00
mk-ca-bundle.pl removed obsolete slash in URL. 2008-08-23 21:31:09 +00:00
mprintf.c fix compiler warning: external declaration in primary source file 2008-09-13 16:37:16 +00:00
msvcproj.foot This file must be kept in CVS with DOS style CR+LF line endings. 2008-08-28 03:31:54 +00:00
msvcproj.head This file must be kept in CVS with DOS style CR+LF line endings. 2008-08-28 03:31:54 +00:00
multi.c - More work with Igor Novoseltsev to first fix the remaining stuff for 2008-12-12 12:21:11 +00:00
multiif.h fix compiler warning: defined but not used 2008-09-13 15:59:14 +00:00
netrc.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
netrc.h Made a parameter const 2008-08-01 00:49:29 +00:00
nss.c based on a report by Jim Meyering, I went over and added checks for return 2008-11-15 23:43:10 +00:00
nssg.h Forgot it's a struct 2008-10-17 22:33:08 +00:00
nwlib.c remove unnecessary typecasting of malloc() 2008-09-06 05:29:05 +00:00
nwos.c if () => if() 2007-11-07 09:21:35 +00:00
parsedate.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
parsedate.h fix multiple header inclusion prevention definition 2008-07-11 18:59:00 +00:00
progress.c fix compiler warning: explicit conversion of a 64-bit integral type to a smaller integral type 2008-10-11 01:56:04 +00:00
progress.h Introcuding a new timestamp for curl_easy_getinfo(): 2008-07-03 06:56:03 +00:00
qssl.c Adapting last changes to OS400: 2008-05-20 10:21:50 +00:00
qssl.h New options added to OS400 wrapper and ILERPG definitions. 2008-07-07 10:39:46 +00:00
rawstr.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
rawstr.h moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
security.c Marked with TODO comments a number of problems in the Kerberos code detected 2008-11-02 05:01:39 +00:00
select.c Andreas Faerber and Scott McCreary made (lib)curl build for the Haiku OS 2008-05-26 15:09:28 +00:00
select.h Peter Lamberg filed bug report #2015126: "poll gives WSAEINVAL when POLLPRI 2008-07-10 18:01:44 +00:00
sendf.c Christian Krause fixed a build failure when building with gss support 2008-11-16 12:42:53 +00:00
sendf.h made Curl_read_plain() return an 'int' instead of CURLcode since it actually 2008-09-29 11:13:37 +00:00
setup-os400.h the IP address we want/request/use from the interface is the 'local' 2008-11-17 19:08:35 +00:00
setup.h if2ip.c related preprocessor cleanup 2008-11-17 14:24:15 +00:00
setup_once.h Don't abort configuration if recvfrom() is not available. 2008-08-27 00:25:02 +00:00
share.c attempt to fix or allow further detection of an elusive icc SIGSEGV 2008-10-19 20:17:16 +00:00
share.h Added support for Salford-C under Win32 (scc). HAVE_MALLOC_H and 2006-04-26 17:11:05 +00:00
sockaddr.h oops * 2 2005-11-12 22:13:20 +00:00
socks.c - Daniel Egger provided a patch that allows you to disable proxy support in 2008-09-29 21:46:04 +00:00
socks.h Richard Atterer brought a patch that added support for SOCKS4a proxies, which 2008-01-02 21:40:11 +00:00
speedcheck.c Renamed several libcurl error codes and options to make them more general 2007-08-30 20:34:57 +00:00
speedcheck.h updated year in the copyright string 2004-01-07 09:19:33 +00:00
splay.c remove unnecessary typecasting of malloc() 2008-09-06 05:29:05 +00:00
splay.h Christopher Palow provided the patch (edited by me) that introduces 2008-05-07 15:41:41 +00:00
ssh.c - SCP and SFTP with the multi interface had the same flaw: the 'DONE' 2008-12-17 12:32:41 +00:00
ssh.h Further adjust a libssh2 preprocessor function-symbol definition check 2008-11-29 17:45:16 +00:00
sslgen.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
sslgen.h - Rainer Canavan filed bug #2255627 2008-11-11 22:19:27 +00:00
ssluse.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
ssluse.h - Introducing CURLOPT_CERTINFO and the corresponding CURLINFO_CERTINFO. By 2008-09-05 14:29:21 +00:00
strdup.c remove unnecessary typecasting of malloc() 2008-09-06 05:29:05 +00:00
strdup.h move multiple header inclusion prevention definition to top of file 2008-07-11 18:52:35 +00:00
strequal.c moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
strequal.h moved the Curl_raw_ functions into the new lib/rawstr.c file for easier curlx_ 2008-10-23 11:49:19 +00:00
strerror.c ensure that errno is not modified inside Curl_strerror() 2008-09-12 10:51:57 +00:00
strerror.h removed trailing whitespace 2004-10-11 17:26:24 +00:00
strtok.c if () => if() 2007-11-07 09:21:35 +00:00
strtok.h move multiple header inclusion prevention definition to top of file 2008-07-11 18:52:35 +00:00
strtoofft.c removed space after if and while before the parenthesis for better source code 2007-11-05 09:45:09 +00:00
strtoofft.h MSVC's __int64 data type is only available when _INTEGRAL_MAX_BITS >= 64 2008-08-21 06:58:12 +00:00
telnet.c Added some #ifdefs around header files and change the EAGAIN test to 2008-11-14 23:17:32 +00:00
telnet.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
tftp.c Added some #ifdefs around header files and change the EAGAIN test to 2008-11-14 23:17:32 +00:00
tftp.h Added per-protocol callback static tables, replacing callback ptr storage 2007-10-12 13:36:37 +00:00
timeval.c fallback to gettimeofday when monotonic clock is unavailable at run-time 2008-07-02 03:04:56 +00:00
timeval.h update copyright year 2007-04-03 18:25:18 +00:00
transfer.c Added some #ifdefs around header files and change the EAGAIN test to 2008-11-14 23:17:32 +00:00
transfer.h - To make it easier for applications that want lots of magic stuff done on 2008-04-30 21:20:08 +00:00
url.c Make the getoff all pipelines function only set _inuse to FALSE if the 2008-12-12 12:04:10 +00:00
url.h - Igor Novoseltsev filed bug #2351645 2008-12-03 15:20:27 +00:00
urldata.h - Internet Explorer had a broken HTTP digest authentication before v7 and 2008-12-10 23:13:31 +00:00
vc8proj.foot Use DOS line-endings. 2007-01-29 19:08:04 +00:00
vc8proj.head Use DOS line-endings. 2007-01-29 19:08:04 +00:00
version.c Use SIZEOF_OFF_T definition from config file 2008-08-26 01:40:19 +00:00

README.pipelining

HTTP Pipelining with libcurl
============================

Background

Since pipelining implies that one or more requests are sent to a server before
the previous response(s) have been received, we only support it for multi
interface use.

Considerations

When using the multi interface, you create one easy handle for each transfer.
Bascially any number of handles can be created, added and used with the multi
interface - simultaneously. It is an interface designed to allow many
simultaneous transfers while still using a single thread. Pipelining does not
change any of these details.

API

We've added a new option to curl_multi_setopt() called CURLMOPT_PIPELINING
that enables "attempted pipelining" and then all easy handles used on that
handle will attempt to use an existing pipeline.

Details

- A pipeline is only created if a previous connection exists to the same IP
  address that the new request is being made to use.

- Pipelines are only supported for HTTP(S) as no other currently supported
  protocol has features resemembling this, but we still name this feature
  plain 'pipelining' to possibly one day support it for other protocols as
  well.

- HTTP Pipelining is for GET and HEAD requests only.

- When a pipeline is in use, we must take precautions so that when used easy
  handles (i.e those who still wait for a response) are removed from the multi
  handle, we must deal with the outstanding response nicely.

- Explicitly asking for pipelining handle X and handle Y won't be supported.
  It isn't easy for an app to do this association. The lib should probably
  still resolve the second one properly to make sure that they actually _can_
  be considered for pipelining. Also, asking for explicit pipelining on handle
  X may be tricky when handle X get a closed connection.

- We need options to control max pipeline length, and probably how to behave
  if we reach that limit. As was discussed on the list, it can probably be
  made very complicated, so perhaps we can think of a way to pass all
  variables involved to a callback and let the application decide how to act
  in specific situations. Either way, these fancy options are only interesting
  to work on when everything is working and we have working apps to test with.