I am using squid as a proxy and one of the tasks using the proxy is upload some large files to S3 in AWS.
I'm trying to later on aggregate how much data was going through to S3 by looking through the squid access log files. The reality is, any way I can tell how much traffic is going through to squid to S3 would be great, I was going after the access file as it seemed most obvious. However my logfiles don't seem to show this information. I'm wondering if it's possible to show this. I thought that <st and >st would get me there. I tried a few different config settings for logging here's what it's at now:
logformat squid %ts.%03tu %6tr %>a %>A %Ss/%03>Hs %<st %>st %rm %ru %un %Sh/%<A %mt
And my logs for a 200MB upload look like (this is broken into a multipart upload):
1510181731.211 53953 <ip> <vpn> TCP_TUNNEL/200 3521 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181731.991 54721 <ip> <vpn> TCP_TUNNEL/200 3865 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181733.884 56646 <ip> <vpn> TCP_TUNNEL/200 3865 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.049 59783 <ip> <vpn> TCP_TUNNEL/200 4209 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.794 61246 <ip> <vpn> TCP_TUNNEL/200 5592 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.796 60537 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.799 60529 <ip> <vpn> TCP_TUNNEL/200 3834 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.800 60535 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.801 60531 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.807 60542 <ip> <vpn> TCP_TUNNEL/200 4209 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
Obviously there's nothing indicating the real size of the file that I can tell, besides the fact that the connection is open awhile.
Any help would be appreciated!
_______________________________________________ squid-users mailing list squid-users@xxxxxxxxxxxxxxxxxxxxx http://lists.squid-cache.org/listinfo/squid-users
