Search Postgresql Archives

Re: vacuumdb --analyze-only scans all pages?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 29.12.2016 16:10, Tom Lane wrote:
Adrian Klaver <adrian.klaver@xxxxxxxxxxx> writes:
On 12/28/2016 11:54 PM, Gerhard Wiesinger wrote:
vacuumdb --analyze-only --all --verbose
INFO:  analyzing "public.log"
INFO:  "log": scanned 30000 of 30851 pages, containing 3599899 live rows
and 0 dead rows; 30000 rows in sample, 3702016 estimated total rows
INFO:  analyzing "public.log_details"
INFO:  "log_details": scanned 2133350 of 2133350 pages, containing
334935843 live rows and 0 dead rows; 3000000 rows in sample, 334935843
estimated total rows
INFO:  analyzing "public.log_details_str"
INFO:  "log_details_str": scanned 30000 of 521126 pages, containing
3601451 live rows and 0 dead rows; 30000 rows in sample, 62560215
estimated total rows

Any ideas why?
I would say because the '3000000 rows in sample' where spread out over
all 2133350 pages.
Worth pointing out here is that you must have a custom statistics target
set on log_details to make it want a sample so much larger than the
default.  If you feel ANALYZE is taking too long, you should reconsider
whether you need such a large target.

Thanx Tom and Adrian

Yes, there is a custom statistic target of 10000 set, I guess for some reasons some time ago to overcome a performance problem after upgrade from 8.3 to 8.4.
Thanx Tom for pointing that out.

Good query to find it out:
SELECT
  n.nspname AS schemaname,
  CASE
       WHEN cl.relkind = 'r' THEN CAST('TABLE' AS VARCHAR(20))
       WHEN cl.relkind = 'i' THEN CAST('INDEX' AS VARCHAR(20))
       WHEN cl.relkind = 'S' THEN CAST('SEQUENCE' AS VARCHAR(20))
       WHEN cl.relkind = 's' THEN CAST('SPECIAL' AS VARCHAR(20))
       WHEN cl.relkind = 'v' THEN CAST('VIEW' AS VARCHAR(20))
       WHEN cl.relkind = 't' THEN CAST('TOAST TABLE' AS VARCHAR(18))
       ELSE null
  END AS object_type,
  cl.relname,
  attname,
  attstattarget
FROM
  pg_attribute a
LEFT OUTER JOIN pg_class cl ON a.attrelid = cl.oid
LEFT OUTER JOIN pg_namespace n ON n.oid = cl.relnamespace
WHERE
  (cl.relkind = 'r' OR cl.relkind = 'i' OR cl.relkind = 't')
  AND attnum > 0 -- only regular columns
  AND n.nspname = 'public'  -- public schema only
  AND NOT(relname ILIKE 'pgstatspack_%')
  AND cl.relkind = 'r' -- TABLE
  AND attstattarget <> -1 -- non default values only
ORDER BY
  n.nspname,
  cl.relname,
  attnum
;

BTW: It looks like that the statistics target is multiplied by 300 to get the number of rows, is that true (didn't find any documentation about that)?
https://www.postgresql.org/docs/current/static/planner-stats.html
-- ALTER TABLE public.log_details ALTER COLUMN fk_id SET STATISTICS 10000;
-- ALTER TABLE public.log_details ALTER COLUMN fk_keyid SET STATISTICS 10000;
-- Default is 100, means 300*100=30000 rows (30k)
-- Max ss 10000, means 300*10000=3000000 rows (3 Mio)
ALTER TABLE public.log_details ALTER COLUMN fk_id SET STATISTICS -1;
ALTER TABLE public.log_details ALTER COLUMN fk_keyid SET STATISTICS -1;
https://www.postgresql.org/docs/current/static/runtime-config-query.html#GUC-DEFAULT-STATISTICS-TARGET

Thnx.

Ciao,
Gerhard



--
Sent via pgsql-general mailing list (pgsql-general@xxxxxxxxxxxxxx)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general



[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Postgresql Jobs]     [Postgresql Admin]     [Postgresql Performance]     [Linux Clusters]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Postgresql & PHP]     [Yosemite]
  Powered by Linux