Search squid archive

Re: squid-users Digest, Vol 13, Issue 62

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I need database to store sanitized websites (cleaned from _javascript_ malicious parts). If CRC changes webpage should be resanitized, otherwise serve proxy version of the website.

Von: squid-users-request@xxxxxxxxxxxxxxxxxxxxx
Gesendet: ‎Montag‎, ‎21‎. ‎September‎ ‎2015 ‎13‎:‎59
An: squid-users@xxxxxxxxxxxxxxxxxxxxx

Send squid-users mailing list submissions to
        squid-users@xxxxxxxxxxxxxxxxxxxxx

To subscribe or unsubscribe via the World Wide Web, visit
        http://lists.squid-cache.org/listinfo/squid-users
or, via email, send a message with subject or body 'help' to
        squid-users-request@xxxxxxxxxxxxxxxxxxxxx

You can reach the person managing the list at
        squid-users-owner@xxxxxxxxxxxxxxxxxxxxx

When replying, please edit your Subject line so it is more specific
than "Re: Contents of squid-users digest..."


Today's Topics:

   1. Squid not following 302 (Ashish Mukherjee)
   2. Database dilema (Mumin Coder)
   3. Re: Database dilema (Eliezer Croitoru)
   4. Re: Squid not following 302 (Antony Stone)
   5. Re: Lots of "Vary object loop!" (Eliezer Croitoru)
   6. Re: Squid not following 302 (Amos Jeffries)


----------------------------------------------------------------------

Message: 1
Date: Mon, 21 Sep 2015 14:50:56 +0530
From: Ashish Mukherjee <ashish.mukherjee@xxxxxxxxx>
To: Squid Users <squid-users@xxxxxxxxxxxxxxxxxxxxx>
Subject: [squid-users] Squid not following 302
Message-ID:
        <CACgMzfwVAabOrx__YxRJg3VEXda9zY3_7jYNarow+DUHadyckQ@xxxxxxxxxxxxxx>
Content-Type: text/plain; charset="utf-8"

Hello,

Squid does not follow 302 and sends back the 302 header to the client. I am
aware it is so as it would be bad to hide the ultimate url from the client
and for reasons of cache poisoning etc.

However, I have a scenario where I need to implement a proxy browsing
pattern for a controlled audience such that I would like Squid to follow
redirections. How can I configure Squid to do so?

Regards,
Ashish
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20150921/f6b51a90/attachment-0001.html>

------------------------------

Message: 2
Date: Tue, 15 Sep 2015 09:23:01 +0000
From: Mumin Coder <mumincoder@xxxxxxxxxxx>
To: "=?utf-8?Q?squid-users@xxxxxxxxxxxxxxxxxxxxx?="
        <squid-users@xxxxxxxxxxxxxxxxxxxxx>
Subject: [squid-users] Database dilema
Message-ID: <SNT406-EAS398B813270931CE94F54CCBD1460@xxxxxxx>
Content-Type: text/plain; charset="utf-8"


I want to make some kind of safe transparent proxy using ubuntu, squid, icap or ecap, database (MongoDB or MySql) and XSS prevention module. I want to be able to inspect URL and _javascript_/xml inside web page with my sandboxed module (_javascript_ engine) which will be connected to squid and database using content adaptation. I want to make it optimal when it comes to processing/analysing of  requested webpage. Thus I want to use database in order to store visited safe or unsafe URLs and _javascript_ code. Currently I am using Greasyspoon as ICAP server, which I am adapting to my needs. I am not sure which database should I use to fit my needs and how to connect/configure it?


Thank you in advance.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20150915/17737051/attachment-0001.html>

------------------------------

Message: 3
Date: Mon, 21 Sep 2015 12:56:26 +0300
From: Eliezer Croitoru <eliezer@xxxxxxxxxxxx>
To: squid-users@xxxxxxxxxxxxxxxxxxxxx
Subject: Re: [squid-users] Database dilema
Message-ID: <55FFD44A.8050901@xxxxxxxxxxxx>
Content-Type: text/plain; charset=utf-8; format=flowed

Hey Mumin,

What do you need from the db?
If you need a blacklist I can offer you to use SquidBlocker which I wrote:
http://ngtech.co.il/squidblocker/
The DB is not fully documented but it works under a very heavy load and
seems to give good results.

Eliezer

On 15/09/2015 12:23, Mumin Coder wrote:
>
> I want to make some kind of safe transparent proxy using ubuntu, squid, icap or ecap, database (MongoDB or MySql) and XSS prevention module. I want to be able to inspect URL and _javascript_/xml inside web page with my sandboxed module (_javascript_ engine) which will be connected to squid and database using content adaptation. I want to make it optimal when it comes to processing/analysing of  requested webpage. Thus I want to use database in order to store visited safe or unsafe URLs and _javascript_ code. Currently I am using Greasyspoon as ICAP server, which I am adapting to my needs. I am not sure which database should I use to fit my needs and how to connect/configure it?
>
>
> Thank you in advance.



------------------------------

Message: 4
Date: Mon, 21 Sep 2015 11:56:43 +0200
From: Antony Stone <Antony.Stone@xxxxxxxxxxxxxxxxxxxx>
To: squid-users@xxxxxxxxxxxxxxxxxxxxx
Subject: Re: [squid-users] Squid not following 302
Message-ID: <201509211156.43947.Antony.Stone@xxxxxxxxxxxxxxxxxxxx>
Content-Type: Text/Plain;  charset="iso-8859-15"

On Monday 21 September 2015 at 11:20:56, Ashish Mukherjee wrote:

> Squid does not follow 302 and sends back the 302 header to the client. I am
> aware it is so as it would be bad to hide the ultimate url from the client
> and for reasons of cache poisoning etc.
>
> However, I have a scenario where I need to implement a proxy browsing
> pattern for a controlled audience such that I would like Squid to follow
> redirections. How can I configure Squid to do so?

1. Why not just let the browser handle the 302 as normal?

2. I suggest you look at
http://squid-web-proxy-cache.1019090.n4.nabble.com/302-td4658091.html

Regards,


Antony.

--
This email was created using 100% recycled electrons.

                                                   Please reply to the list;
                                                         please *don't* CC me.


------------------------------

Message: 5
Date: Mon, 21 Sep 2015 13:03:08 +0300
From: Eliezer Croitoru <eliezer@xxxxxxxxxxxx>
To: squid-users@xxxxxxxxxxxxxxxxxxxxx
Subject: Re: [squid-users] Lots of "Vary object loop!"
Message-ID: <55FFD5DC.2020201@xxxxxxxxxxxx>
Content-Type: text/plain; charset=utf-8; format=flowed

Is it happening also with ram cahce only? no disk cache?

Eliezer

On 04/09/2015 00:02, Sebastián Goicochea wrote:
> But still seeing all those Vary loops all the time
>
> :(
>
> Thanks,
> Sebastian



------------------------------

Message: 6
Date: Mon, 21 Sep 2015 23:08:39 +1200
From: Amos Jeffries <squid3@xxxxxxxxxxxxx>
To: squid-users@xxxxxxxxxxxxxxxxxxxxx
Subject: Re: [squid-users] Squid not following 302
Message-ID: <55FFE537.20307@xxxxxxxxxxxxx>
Content-Type: text/plain; charset=utf-8

On 21/09/2015 9:20 p.m., Ashish Mukherjee wrote:
> Hello,
>
> Squid does not follow 302 and sends back the 302 header to the client. I am
> aware it is so as it would be bad to hide the ultimate url from the client
> and for reasons of cache poisoning etc.

Then why do you expect Squid would be allowed to be configured to do that?

Besides the corruption problems 302 messages contain a payload/body
which some clients need to display and/or process instead of the
Location header.


>
> However, I have a scenario where I need to implement a proxy browsing
> pattern for a controlled audience such that I would like Squid to follow
> redirections. How can I configure Squid to do so?

You would need a ICAP or eCAP RESPMOD adaptor to do that. Since you are
requesting whole-message adaptation.


PS. any server which is fooled by the behaviour you are trying to
achieve is violating the HTTP requirenment:
"
   server MUST NOT assume that two requests on the same connection are
   from the same user agent
"

Amos



------------------------------

Subject: Digest Footer

_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users


------------------------------

End of squid-users Digest, Vol 13, Issue 62
*******************************************
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users

[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux