On Sun, Feb 16, 2014 at 01:18:52PM +0100, Daniel Stenberg wrote:
> On Sat, 15 Feb 2014, Kyle J. McKay wrote:
>
> >If pipelining is off (the default) and total connections is not 1
> >it sounds to me from the description above that the requests will
> >be executed on separate connections until the maximum number of
> >connections is in use and then there might be some reuse.
>
> Not exactly. When about to do a request, libcurl will always try to
> find an existing idle but open connection in its connection pool to
> re-use. With the multi interface you can of course easily start N
> requests at once to the same host and then they'll only re-use
> connections to the extent there are connections to pick, otherwise
> it'll create new connections.
Right; I'd expect multiple connections for parallel requests, but in
this case we are completing the first and removing the handle before
starting the second. Digging further, I was able to reproduce the
behavior with a simple program:
-- >8 --
#include <stdio.h>
#include <stdlib.h>
#include <curl/curl.h>
int main(int argc, char **argv)
{
CURL *curl = curl_easy_init();
CURLM *multi = curl_multi_init();
int want_multi = atoi(argv[2]);
int i;
curl_easy_setopt(curl, CURLOPT_URL, argv[1]);
curl_easy_setopt(curl, CURLOPT_VERBOSE, 1L);
for (i = 0; i < 2; i++) {
if (i < want_multi) {
int nr;
curl_multi_add_handle(multi, curl);
do {
curl_multi_perform(multi, &nr);
} while (nr);
curl_multi_remove_handle(multi, curl);
}
else
curl_easy_perform(curl);
}
return 0;
}
-- 8< --
The program just requests the same URL twice using the same curl handle,
optionally using the multi interface for zero, one, or both of the
requests. For "0" and "2" (i.e., either both curl_easy or both
curl_multi), the connection is reused. But for "1" (in which we use
multi for the first request, but easy for the second), we do not reuse
the connection.
The manpage for curl_multi_add_handle does say:
When an easy handle has been added to a multi stack, you can not
and you must not use curl_easy_perform(3) on that handle!
Does that apply to the handle after it has finished its transaction and
been removed from the multi object (in which case git is Doing It
Wrong)? Is the program above failing to take some step to finalize the
first request, so that the second one knows its connection can be
reused? Or should curl be handling this?
-Peff
--
To unsubscribe from this list: send the line "unsubscribe git" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html