Paul Scott wrote:
On Thu, 2007-09-20 at 08:03 -0400, Robert Cummings wrote:
Post some samples of the data you are parsing and a sample of the code
you've written to parse them. If you're parsing 750 megs of data then
it's quite likely you could squeeze some performance out of the parse
routines themselves.
Today's dataset is in a CSV (tab separated) , so I am using fgetcsv, it
looks like this (geo data):
936374 Roodepoort Roodepoort Roodeport-Maraisburg -26.1666667 27.8666667
P PPL ZA ZA 06 0 1759 Africa/Johannesburg 2004-05-11
Code:
[SNIP]
$row = 1;
$handle = fopen($csvfile, "r");
while (($data = fgetcsv($handle, 1000, "\t")) !== FALSE) {
$num = count($data);
$row++;
What's $num and $row for?
$insarr = array('userid' => $userid,
'geonameid' => $data[0],
'name' => $data[1],
'asciiname' => $data[2],
'alternatenames' => $data[3],
'latitude' => $data[4],
'longitude' => $data[5],
'featureclass' => $data[6],
'featurecode' => $data[7],
'countrycode' => $data[8],
'cc2' => $data[9],
'admin1code' => $data[10],
'admin2code' => $data[11],
'population' => $data[12],
'elevation' => $data[13],
'gtopo30' => $data[14],
'timezoneid' => $data[15],
'moddate' => $data[16]
);
$this->objDbGeo->insertRecord($insarr);
Those objDbGeo->insertRecord() do some sort of control over the data
that is passed in the array?
If not, you should just use the COPY command of PostgreSQL (you are
using PostgreSQL if I remember correctly) or simply do a bash script
using psql and the \copy command.
--
21:50:04 up 2 days, 9:07, 0 users, load average: 0.92, 0.37, 0.18
---------------------------------------------------------
Lic. Martín Marqués | SELECT 'mmarques' ||
Centro de Telemática | '@' || 'unl.edu.ar';
Universidad Nacional | DBA, Programador,
del Litoral | Administrador
---------------------------------------------------------
--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
