Re: limiting the amount of emails sent at a time in a batch send

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Andrew Ballard wrote:
On Thu, Jul 31, 2008 at 4:24 PM, brian <php@xxxxxxx> wrote:
Andrew Ballard wrote:
On Thu, Jul 31, 2008 at 1:27 PM, brian <php@xxxxxxx> wrote:
Richard Kurth wrote:
I want to limit these script two send 100 email and then pause for a few
seconds and then send another 100 emails and repeat this tell it has
sent
all the emails that are dated for today. This script is runs by cron so
it
is running in the background.

How would I do this and is it the best way to do it. I am using swift
mailer to send the mail.

I think I would use limit 100 in the query but how would I tell it to
get
the next 100.
There's no need to limit the DB query, nor to track what's been sent by
updating the DB. Grab all of the addresses at once and let SwiftMailer
deal
with the throttling:

require('Swift/lib/Swift.php');
require('Swift/lib/Swift/Connection/SMTP.php');

/* this handles the throttling
 */
require('Swift/lib/Swift/Plugin/AntiFlood.php');


/* this holds all of your addresses
 */
$recipients = new Swift_RecipientList();


/* Grab the addresses from the DB (this is using MDB2)
 */
$result = ...

while ($row = $result->fetchRow())
{
      $recipients->addTo($row['address'], $row['name']);
}
@$result->free();

try
{
      $swift = new Swift(new Swift_Connection_SMTP('localhost'),
'your_domain');

      set_time_limit(0);
      $swift->log->enable();

      /* 100 mails per batch with a 60 second pause between batches
       */
      $swift->attachPlugin(new Swift_Plugin_AntiFlood(100, 60),
'anti-flood');

      flush();

      $message = new Swift_Message('your subject');

      $message->setCharset('utf-8');
      $message->setReplyTo(...);
      $message->setReturnPath(...);
      $message->headers->set('Errors-To', ...);

      $message->attach(new Swift_Message_Part($plain_content));
      $message->attach(new Swift_Message_Part($html_content,
'text/html'));

      $num_sent = $swift->batchSend($message, $recipients, new
Swift_Address(..., '...'));

      $swift->disconnect();

...


This is a rough example taken from my own script. This would need to be
modified if you're not sending the same message to all recipients, of
course. It's not clear to me from your example.

b

Nice! I'll have to look into this library some time. How do you
control it to prevent sending the same message though?
I'm not sure about that. Mine is for a newsletter (not personalised) so
Swift just needs a list of addresses. I can't remember if AntiFlood can be
used for many unique mails. I suspect that it doesn't.

I can't imagine
this is called from a web page, because I'm guessing it would take a
few minutes to finish.
cron. But, if you wanted it fired from an admin page (I can't imagine a good
situation where something like this would be public) you could add
ignore_user_abort() and then jazz up the page with some async JS.

If it's called from a cron job, don't you still
have to somehow flag the message as having been delivered so that the
next process doesn't come along and send the same thing all over
again?
Yeah, I just twigged to the fact that your messages are stored in the
database. This is some kind of messaging system? As opposed to a
newsletter-type thing, I mean. As above, I don't know that AntiFlood  is
what you want. That's meant for multiple-recipient mails.

There's also a Throttler plugin, though, again, it's meant for batches.

You might also look at the IMAP functions. Instead of storing the messages
in the DB, you can let the MTA deal with pushing them out and cut Swift (and
the cro0n job) out of the loop.

b


The case I have in mind is for a newsletter, and in this instance they
are all the same. In this instance, I am limited by the host to 2500
messages/hour. (Originally it was 900). At this point, 2500 is more
than enough for this group, but I'd still like to play kindly with the
server resources since this is a shared host. I just set up a generic
message queue and dump mail there rather than sending it real time.
For now, all the messages in a given batch are the same, but I was
leaving flexibility in case I hit a situation where that changed.

It looks like this would work pretty well when I'm up for a rewrite. :)

I understand the general idea:

1. read message body from storage (file, database, etc.)
2. get result set containing addresses from database
3. build recipient list from result set
4. send everything to sendBatch()

It seems to me that step 5 still has to either (a) delete the message
body from storage or else (b) flag it as sent so that the next process
spawned via cron sees that there is no work to do and dies rather than
repeating the whole process again.

Andrew

Thanks to everybody.
I have figured this out. I am using swift but I am limiting the send by a 100 and setting the table with the date sent. Then the crontab runes again and grabs another 100 that have not had the date set. This works just fine and it does not over amp the system. I am also sending the data out through 2 smpt servers.


--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php


[Index of Archives]     [PHP Home]     [Apache Users]     [PHP on Windows]     [Kernel Newbies]     [PHP Install]     [PHP Classes]     [Pear]     [Postgresql]     [Postgresql PHP]     [PHP on Windows]     [PHP Database Programming]     [PHP SOAP]

  Powered by Linux