Search Postgresql Archives

Re: tsvector string representation and parsing

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




Thanks, Tom.

On 23/02/2022 23.30, Tom Lane wrote:
=?UTF-8?Q?Johannes_Gra=c3=abn?= <johannes@xxxxxxxxxx> writes:
This is a minimal example that goes wrong (but shouldn't IMHO:

SELECT format('%L:1', '\:')::tsvector

format(%L) is designed to produce a SQL literal, which does not
have the same requirements as a tsvector element ... yeah, they're
close, but not close enough.  In this particular example,
what you get is

=# SELECT format('%L:1', '\:');
   format
----------
  E'\\:':1
(1 row)

because format() adds an E prefix for the avoidance of doubt about
what to do with the backslashes.  tsvector doesn't like that.

I see.


I don't think we have any prefab function that does what you're
looking for here, and TBH I'm not sure I see the point of it.
Pretty much any tsvector you'd be dealing with in practice is
going to have come from one of the to_tsvector family of
functions, and those tend to drop punctuation.

Applied to normal texts in a standard language, I believe that's true. I'd like to use FTS in a setting where I need to control the positional attributes as I'm specifying more than one lexeme at the same position (which works great btw). That's why I can't use to_tsvector() but need to cast it from a string to tsvector.


My understanding is that everything inside
single quotes is taken as a lexeme. From the documentation:

To represent lexemes containing whitespace or punctuation, surround them with quotes

See also the next bit about having to double quotes and backslashes
within those quotes.  So what you'd actually need is

=# select $$'\\:':1$$::tsvector;
  tsvector
----------
  '\\:':1
(1 row)

If you write just one backslash, it has the effect of quoting
the next character, which in this case doesn't need quoting.

Before using format(), I tried just generating those strings by doubling any single quote or backslash and enclosing the whole string in single quotes, but that didn't seem a safe way, though it works in principle:

SELECT format($$'%s':%s$$, replace(replace(s, $$'$$, $$''$$), '\', '\\'), i)::tsvector
FROM (SELECT $$\:$$ s, 1 i) x;

Would that be the way to go if to_tsvector is not an option?

Regards
  Johannes





[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Postgresql Jobs]     [Postgresql Admin]     [Postgresql Performance]     [Linux Clusters]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Databases]     [Postgresql & PHP]     [Yosemite]

  Powered by Linux