Re: Sending a lot of data to remote site

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hey,
Thanks for replying.



> Ok dude, braindump coming up - just some random
> thoughts and ideas,
> no concrete answers:

Thats ok, still in the planning stage, not a line of
code written so am open to ideas instead of just
concrete answers.


> 
> 5000 * 100 = 500000 bytes - i.e. on average about
> half a meg,
> that less than many image uploads. so a POST could
> be acceptable.
> serialize will add to the ammount sent (and there is
> the
> security issue of unserlizing data) but you can POST
> serialized
> data as easily as anything else...


Ok.... after looking at this more carefully I see that
I can actually throttle the data...
eg: 1/10 of 5000, so send just a string of 500


 
> what options do you have for the having over the
> data?
> what is the structure of the data you need to send?

The _closest_ I can describe the data is like just
plain usernames, no passwords, so the array would  be
something like:

('hugo_the_boss','james007bond','max_power','etc')
in "peak season" I expect the array to go upto 5k
entries but very unlikely as I will be transferring
data every minute of only new entries.

Still, its better to be over protected and plan for a
higher volume than plan for lower and then be
surprised.






> send( join('|', $arr) );
> 
> // instead of
> 
> send( serialize($arr) );


Interesting...


> yuo could consider JSON notation (probably more
> compact than serialize) -
> and in the process maybe even be the first guy to
> use JSON for server to
> server comms :-P

Yep, and the first to run into any problems ;-D

 
> you could setup an XML feed that they can request at
> their leasure.

Good idea! See? I didnt think of that.

> you could also skip the webserver and go directly to
> using FTP or SCP
> or something like that (would require a line or 2 of
> shellscript - using gzip
> to compact the data can also be very helpful

Cant do that, no idea how the clients machine will be
setup and need to make this as compatable as possible
as I wont have access to the remote machines, the
clients have to install the scripts by themselves.



> the question as too whether this is alot to send
> depends on how
> often you need to send it 

Every 2 mins max, usually every min.


> > Can you suggest the best method of doing this?
> 
> well the answer is probably not pigeons. or
> hedgehogs ;-)

Damn! there go my TOP 2 ideas...... killjoy... :-)




Cheers!
Ryan







------
- The faulty interface lies between the chair and the keyboard.
- Creativity is great, but plagiarism is faster!
- Smile, everyone loves a moron. :-)
-----
Fight back spam! Download the Blue Frog.
http://www.bluesecurity.com/register/s?user=bXVzaWNndTc%3D

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

-- 
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php


[Index of Archives]     [PHP Home]     [Apache Users]     [PHP on Windows]     [Kernel Newbies]     [PHP Install]     [PHP Classes]     [Pear]     [Postgresql]     [Postgresql PHP]     [PHP on Windows]     [PHP Database Programming]     [PHP SOAP]

  Powered by Linux