Search Postgresql Archives

Re: Creating 2D arrays for pg_copy_from, reading tab-delimted text file that contains comma and double quotes

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello Daniel!

This afternoon, I tried it again, and yes, your suggestion that I use a tab 
delimited symbol ("\t") instead of a space for the implode works flawlessly.

Yesterday, I reported I got "Warning: pg_copy_from(): Copy command failed: ERROR: extra data after last expected..".
That was because while reading file, I had used this:
     while (($line = fgetcsv($fileRead, "\t")) !== FALSE) {


Today, I used this:
     while (($line = fgetcsv($fileRead, 0, "\t")) !== FALSE) {


.. and now I can see my data saved in the database without those extra double quotes.

It made my day!

Thank you.





----- Original Message -----
> From: Daniel Verite <daniel@xxxxxxxxxxxxxxxx>
> To: s400t@xxxxxxxxxxx
> Cc: pgsql-general@xxxxxxxxxxxxxxxxxxxx
> Date: 2018/12/18, Tue 00:35
> Subject: Re: Creating 2D arrays for pg_copy_from, reading tab-delimted text file  that contains comma and double quotes
> 
>       <s400t@xxxxxxxxxxx> wrote:
> 
>>  When I save that Excel as a tab delimited text file, I get this:rec_no  
>>  item1    item2    item3    item4    item5
>>  1    Denny's    orange juice    "1,500 yen"    
> """Dear John"""    "32""
>>  TV"(As seen when I opened that file with Notepad)
> 
> This looks good. Fields are properly enclosed and double quotes
> in contents are doubled, as expected in CSV.
> 
>>  5.while (($line = fgetcsv($fileRead, 0, "\t")) !== FALSE) { 
> //0 means I can
>>  read row whatever its length
>>  6.    if($row == 1){ $row++; continue; } //skip header
>>  7.    $line = implode(" ",$line). "\n";
>>  8.    $twoDarray[] = $line;
>>  ...
>>  14.if (pg_copy_from($con, $tableName, $twoDarray) !== FALSE) {
> 
> It goes wrong at line 7. pg_copy_from() expects lines in the 
> COPY "text format" documented at
> https://www.postgresql.org/docs/current/sql-copy.html 
> 
> It implies that:
> - since your call to pg_copy_from() doesn't specify a delimiter
> it uses tab, not a space, so implode() must be passed a tab,
> not a space.
> - if there are backslashes in the contents they must be quoted
> by doubling them.
> - if there are newline or carriage return characters in the contents
> they must be replaced by \n and \r respectively, so as to
> not be confused with an end of record.
> - if there are tabs in the contents they must be replaced by \t.
> 
> These replacements can all be done by a single strtr() call in php.
> 
> 
> Best regards,
> -- 
> Daniel Vérité
> PostgreSQL-powered mailer: http://www.manitou-mail.org 
> Twitter: @DanielVerite
> 






[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Postgresql Jobs]     [Postgresql Admin]     [Postgresql Performance]     [Linux Clusters]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Postgresql & PHP]     [Yosemite]

  Powered by Linux