Re: Re: Can this be done?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



can try the foreach, put all the urls in one array....

something like this might work:

<?php
include("inc/dbconn_open.php");
include("inc/dom.php");
error_reporting(E_ALL);
$TESTING = TRUE;
$targets[] = "http://www.greenecountymo.org/sheriff/warrants.php";;
$targets[] = "http://www.greenecountymo.org/sheriff/page2.php";;
$targets[] = "http://www.greenecountymo.org/sheriff/page3.php";;
foreach ($targets as $target_url){
 $userAgent = 'Googlebot/2.1 (http://www.googlebot.com/bot.html)';
 $ch = curl_init(); curl_setopt($ch, CURLOPT_USERAGENT, $userAgent);
 curl_setopt($ch, CURLOPT_URL,$target_url);
 curl_setopt($ch, CURLOPT_FAILONERROR, true);
 curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);
 curl_setopt($ch, CURLOPT_AUTOREFERER, true);
 curl_setopt($ch, CURLOPT_RETURNTRANSFER,true);
 curl_setopt($ch, CURLOPT_TIMEOUT, 300);
 $html = curl_exec($ch); if (!$html) {
  echo "<br />cURL error number:" .curl_errno($ch);
  echo "<br />cURL error:" . curl_error($ch);
  exit;
 } // Create DOM from URL or file
$html = file_get_html('http://www.greenecountymo.org/sheriff/warrants.php?search=C'); // Find table
 foreach($html->find('table') as $table) {
foreach($table->find('tr') as $tr) { // Grab children
   $cells = $tr->children();
   if($cells[0]->plaintext != "Name") {
    for ($i = 0; $i < count($cells); $i++) {
     switch ($i){
      case 0: // Name
       $name = $cells[$i]->plaintext;
       echo $cells[$i]->plaintext;
       break;
      case 1: // Age
       $age = $cells[$i]->plaintext;
       break;
      case 2: // Warrant type
       $warrant = $cells[$i]->plaintext;
       break;
      case 3: // Bond amount
       $bond = $cells[$i]->plaintext;
       break;
      case 4: // Warrant number
       $wnumber = $cells[$i]->plaintext;
       break;
      case 5: // Offence description
       $crime = $cells[$i]->plaintext;
       break;
      Default:
       echo "Uh-oh<br />";
} } }
   // Build your INSERT statement here
$query = "INSERT into warrants (wid, name, age, warrant, bond, wnumber, crime) VALUES ("; $query .= " '$wid', '$name', '$age', '$warrant', '$bond', '$wnumber', '$crime' )";
   //$wid = mysql_insert_id();
   echo $query;
   // run query
   mysql_query($query) or die (mysql_error());
  }
 }
}
?>


""Miller, Terion"" <tmiller@xxxxxxxxxxxxxxxxxxxx> wrote in message news:C625AAE1.E9B%kmiller13@xxxxxxxxxxxxxxxxxxxxxxx



On 5/5/09 8:31 AM, "php news feed" <maartensc@xxxxxxxxxxxxx> wrote:

post the script, and example of data

""Miller, Terion"" <tmiller@xxxxxxxxxxxxxxxxxxxx> wrote in message
news:C6259E7B.E91%kmiller13@xxxxxxxxxxxxxxxxxxxxxxx
Ok I have a script that grabs data from a page and puts it in a db, I need
to run this script 26 times on 26 different pages on the same site, is there
a way to do this without making 26 different scripts load? Should I post the
script?

Thanks,
T.Miller


__________ Information from ESET Smart Security, version of virus signature
database 4053 (20090505) __________

The message was checked by ESET Smart Security.

http://www.eset.com




__________ Information from ESET Smart Security, version of virus signature database 4053 (20090505) __________

The message was checked by ESET Smart Security.

http://www.eset.com




--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Here is the script:
<?php include("inc/dbconn_open.php"); include("inc/dom.php"); error_reporting(E_ALL); $TESTING = TRUE; $target_url = "http://www.greenecountymo.org/sheriff/warrants.php";; $userAgent = 'Googlebot/2.1 (http://www.googlebot.com/bot.html)'; $ch = curl_init(); curl_setopt($ch, CURLOPT_USERAGENT, $userAgent); curl_setopt($ch, CURLOPT_URL,$target_url); curl_setopt($ch, CURLOPT_FAILONERROR, true); curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true); curl_setopt($ch, CURLOPT_AUTOREFERER, true); curl_setopt($ch, CURLOPT_RETURNTRANSFER,true); curl_setopt($ch, CURLOPT_TIMEOUT, 300); $html = curl_exec($ch); if (!$html) { echo "<br />cURL error number:" .curl_errno($ch); echo "<br />cURL error:" . curl_error($ch); exit; } // Create DOM from URL or file $html = file_get_html('http://www.greenecountymo.org/sheriff/warrants.php?search=C'); // Find table foreach($html->find('table') as $table) { foreach($table->find('tr') as $tr) { // Grab children $cells = $tr->children(); if($cells[0]->plaintext != "Name") { for ($i = 0; $i < count($cells); $i++) { switch ($i){ case 0: // Name $name = $cells[$i]->plaintext; echo $cells[$i]->plaintext; break; case 1: // Age $age = $cells[$i]->plaintext; break; case 2: // Warrant type $warrant = $cells[$i]->plaintext; break; case 3: // Bond amount $bond = $cells[$i]->plaintext; break; case 4: // Warrant number $wnumber = $cells[$i]->plaintext; break; case 5: // Offence description $crime = $cells[$i]->plaintext; break; Default: echo "Uh-oh<br } } // Build your INSERT statement here $query = "INSERT into warrants (wid, name, age, warrant, bond, wnumber, crime) VALUES ("; $query .= " '$wid', '$name', '$age', '$warrant', '$bond', '$wnumber', '$crime' )"; //$wid = mysql_insert_id(); echo $query; // run query mysql_query($query) or die } } ?>



__________ Information from ESET Smart Security, version of virus signature database 4053 (20090505) __________

The message was checked by ESET Smart Security.

http://www.eset.com




__________ Information from ESET Smart Security, version of virus signature database 4053 (20090505) __________

The message was checked by ESET Smart Security.

http://www.eset.com




--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php


[Index of Archives]     [PHP Home]     [Apache Users]     [PHP on Windows]     [Kernel Newbies]     [PHP Install]     [PHP Classes]     [Pear]     [Postgresql]     [Postgresql PHP]     [PHP on Windows]     [PHP Database Programming]     [PHP SOAP]

  Powered by Linux