Re: Autovacuum issues with truncate and create index ...

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




> Would it be possible for you to create such a situation and capture
> the contents of pg_stat_activity and pg_locks while it is going on?
> What messages related to autovacuum or deadlocks do you see in the
> server log while this is going on?

Before the change we can only see only automatic analyze logs on first kind of tables.

After the change I can see automatic analyze logs on both kind of tables.

Here's the pg_stat_activity during the issue :
 datid | datname | procpid | usesysid | usename  |                              current_query                              | waiting |          xact_start           |          query_start          |         backend_start         |  client_addr  | client_port 
-------+---------+---------+----------+----------+-------------------------------------------------------------------------+---------+-------------------------------+-------------------------------+-------------------------------+---------------+-------------
 42539 | flows   |   13792 |    16384 | asa      | TRUNCATE flowpool_24_segment_221                                        | f       | 2012-12-20 16:55:01.346986+01 | 2012-12-20 16:55:01.347051+01 | 2012-12-20 16:50:22.073586+01 | 10.48.168.160 |       33550
 42539 | flows   |   12443 |    16384 | asa      | <IDLE>                                                                  | f       |                               | 2012-12-20 15:51:32.787359+01 | 2012-12-20 13:00:09.968633+01 | 10.48.168.163 |       58799
 42539 | flows   |   13804 |       10 | postgres | autovacuum: ANALYZE public.agg_t1406_outgoing_a3_src_net_and_dst_net_f5 | f       | 2012-12-20 16:56:00.919196+01 | 2012-12-20 16:56:00.919196+01 | 2012-12-20 16:51:27.079612+01 |               |            
 42539 | flows   |   12444 |    16384 | asa      | <IDLE>                                                                  | f       |                               | 2012-12-20 16:09:53.123326+01 | 2012-12-20 13:00:16.82323+01  | 10.48.168.163 |       58800
 42539 | flows   |   12453 |    16384 | asa      | <IDLE>                                                                  | f       |                               | 2012-12-20 13:01:15.019182+01 | 2012-12-20 13:01:15.015847+01 | 10.48.168.163 |       58801
 42539 | flows   |   13629 |    16384 | asa      | TRUNCATE flowpool_15_segment_216                                        | f       | 2012-12-20 16:55:01.783653+01 | 2012-12-20 16:55:01.783725+01 | 2012-12-20 16:30:22.331191+01 | 10.48.168.160 |       33495
 42539 | flows   |   13793 |    16384 | asa      | TRUNCATE flowpool_19_segment_215                                        | f       | 2012-12-20 16:55:01.296588+01 | 2012-12-20 16:55:01.297449+01 | 2012-12-20 16:50:22.095245+01 | 10.48.168.160 |       33551
 42539 | flows   |   13822 |       10 | postgres | autovacuum: ANALYZE public.agg_t449_incoming_a3_src_net_and_dst_net_f5  | f       | 2012-12-20 16:53:34.720815+01 | 2012-12-20 16:53:34.720815+01 | 2012-12-20 16:51:57.097049+01 |               |            
 42539 | flows   |   13658 |    16384 | asa      | TRUNCATE flowpool_2_segment_218                                         | f       | 2012-12-20 16:55:01.606198+01 | 2012-12-20 16:55:01.606266+01 | 2012-12-20 16:35:30.327792+01 | 10.48.168.160 |       33505
 42539 | flows   |   13680 |    16384 | asa      | TRUNCATE flowpool_16_segment_228                                        | f       | 2012-12-20 16:55:01.710645+01 | 2012-12-20 16:55:01.713793+01 | 2012-12-20 16:40:21.689958+01 | 10.48.168.160 |       33512
 42539 | flows   |   13870 |    16384 | asa      | select * from pg_stat_activity;                                         | f       | 2012-12-20 16:56:05.58373+01  | 2012-12-20 16:56:05.58373+01  | 2012-12-20 16:56:03.432322+01 |               |          -1
 42539 | flows   |   13770 |    16384 | asa      | TRUNCATE flowpool_31_segment_208                                        | f       | 2012-12-20 16:55:01.782363+01 | 2012-12-20 16:55:01.791481+01 | 2012-12-20 16:45:24.082223+01 | 10.48.168.160 |       33544
 42539 | flows   |   13771 |    16384 | asa      | TRUNCATE flowpool_17_segment_211                                        | f       | 2012-12-20 16:55:01.729515+01 | 2012-12-20 16:55:01.736037+01 | 2012-12-20 16:45:24.147856+01 | 10.48.168.160 |       33545
 42539 | flows   |   13849 |       10 | postgres | autovacuum: ANALYZE public.agg_t1251_incoming_a7_src_port_and_proto_f5  | f       | 2012-12-20 16:56:01.00984+01  | 2012-12-20 16:56:01.00984+01  | 2012-12-20 16:52:27.111586+01 |               |            
 42539 | flows   |   13795 |    16384 | asa      | TRUNCATE flowpool_22_segment_217                                        | f       | 2012-12-20 16:55:01.342442+01 | 2012-12-20 16:55:01.345095+01 | 2012-12-20 16:50:22.159256+01 | 10.48.168.160 |       33553



Here's the pg_locks during the issue :
  locktype    | database | relation | page | tuple | virtualxid | transactionid | classid | objid | objsubid | virtualtransaction |  pid  |
           mode           | granted 
---------------+----------+----------+------+-------+------------+---------------+---------+-------+----------+--------------------+-------+
--------------------------+---------
 transactionid |          |          |      |       |            |      27720953 |         |       |          | 12/0               | 13770 |
 ExclusiveLock            | t
 virtualxid    |          |          |      |       | 11/3140    |               |         |       |          | 11/3140            | 13870 |
 ExclusiveLock            | t
 relation      |    42539 |   106752 |      |       |            |               |         |       |          | 13/0               | 13771 |
 ShareLock                | t
 relation      |    42539 |   106752 |      |       |            |               |         |       |          | 13/0               | 13771 |
 AccessExclusiveLock      | t
 relation      |    42539 |    88542 |      |       |            |               |         |       |          | 12/0               | 13770 |
 ShareLock                | t
 relation      |    42539 |    88542 |      |       |            |               |         |       |          | 12/0               | 13770 |
 AccessExclusiveLock      | t
 transactionid |          |          |      |       |            |      27720938 |         |       |          | 1/0                | 13792 |
 ExclusiveLock            | t
 transactionid |          |          |      |       |            |      27720969 |         |       |          | 7/2476             | 13793 |
 ExclusiveLock            | t
 virtualxid    |          |          |      |       | 13/2821    |               |         |       |          | 13/0               | 13771 |
 ExclusiveLock            | t
 relation      |    42539 |   106755 |      |       |            |               |         |       |          | 13/0               | 13771 |
 ShareLock                | t
 relation      |    42539 |   106755 |      |       |            |               |         |       |          | 13/0               | 13771 |
 AccessExclusiveLock      | t
 relation      |    42539 |   112041 |      |       |            |               |         |       |          | 1/0                | 13792 |
 ShareLock                | t
 relation      |    42539 |   112041 |      |       |            |               |         |       |          | 1/0                | 13792 |
 AccessExclusiveLock      | t
 virtualxid    |          |          |      |       | 1/15720    |               |         |       |          | 1/0                | 13792 |
 ExclusiveLock            | t
 virtualxid    |          |          |      |       | 7/2476     |               |         |       |          | 7/2476             | 13793 |
 ExclusiveLock            | t
 relation      |    42539 |    88544 |      |       |            |               |         |       |          | 12/0               | 13770 |
 AccessExclusiveLock      | t
 transactionid |          |          |      |       |            |      27720971 |         |       |          | 9/2935             | 13658 |
 ExclusiveLock            | t
 relation      |    42539 |    10969 |      |       |            |               |         |       |          | 11/3140            | 13870 |
 AccessShareLock          | t
 relation      |    42539 |  6697688 |      |       |            |               |         |       |          | 14/2459            | 13849 |
 AccessShareLock          | t
 relation      |    42539 |    49499 |      |       |            |               |         |       |          | 8/15669            | 13822 |
 AccessShareLock          | t
 relation      |    42539 |    88539 |      |       |            |               |         |       |          | 12/0               | 13770 | ShareLock                | t
 relation      |    42539 |    88539 |      |       |            |               |         |       |          | 12/0               | 13770 | AccessExclusiveLock      | t
 relation      |    42539 |   112038 |      |       |            |               |         |       |          | 1/0                | 13792 | ShareLock                | t
 relation      |    42539 |   112038 |      |       |            |               |         |       |          | 1/0                | 13792 | AccessExclusiveLock      | t
relation      |    42539 |   106757 |      |       |            |               |         |       |          | 13/0               | 13771 | AccessExclusiveLock      | t
 virtualxid    |          |          |      |       | 6/2974     |               |         |       |          | 6/2974             | 13629 | ExclusiveLock            | t
 relation      |    42539 |    50023 |      |       |            |               |         |       |          | 3/3137             | 13804 | ShareUpdateExclusiveLock | t
 virtualxid    |          |          |      |       | 3/3137     |               |         |       |          | 3/3137             | 13804 | ExclusiveLock            | t
 relation      |    42539 |    80808 |      |       |            |               |         |       |          | 7/2476             | 13793 | RowExclusiveLock         | t
 transactionid |          |          |      |       |            |      27720951 |         |       |          | 13/0               | 13771 | ExclusiveLock            | t
 virtualxid    |          |          |      |       | 9/2935     |               |         |       |          | 9/2935             | 13658 | ExclusiveLock            | t
 relation      |    42539 |    49492 |      |       |            |               |         |       |          | 8/15669            | 13822 | ShareUpdateExclusiveLock | t
 virtualxid    |          |          |      |       | 15/2206    |               |         |       |          | 15/2206            | 13795 | ExclusiveLock            | t
 relation      |    42539 |    91227 |      |       |            |               |         |       |          | 9/2935             | 13658 | RowExclusiveLock         | t
 relation      |    42539 |    49498 |      |       |            |               |         |       |          | 8/15669            | 13822 | AccessShareLock          | t
 relation      |    42539 |   112043 |      |       |            |               |         |       |          | 1/0                | 13792 | AccessExclusiveLock      | t
 relation      |    42539 |  6697685 |      |       |            |               |         |       |          | 14/2459            | 13849 | ShareUpdateExclusiveLock | t
 virtualxid    |          |          |      |       | 14/2459    |               |         |       |          | 14/2459            | 13849 | ExclusiveLock            | t
 relation      |    42539 |    50026 |      |       |            |               |         |       |          | 3/3137             | 13804 | RowExclusiveLock         | t
 relation      |    42539 |  6697689 |      |       |            |               |         |       |          | 14/2459            | 13849 | AccessShareLock          | t
 relation      |    42539 |    86013 |      |       |            |               |         |       |          | 6/2974             | 13629 | RowExclusiveLock         | t
 virtualxid    |          |          |      |       | 8/15669    |               |         |       |          | 8/15669            | 13822 | ExclusiveLock            | t
 virtualxid    |          |          |      |       | 12/14901   |               |         |       |          | 12/0               | 13770 | ExclusiveLock            | t
 transactionid |          |          |      |       |            |      27720970 |         |       |          | 6/2974             | 13629 | ExclusiveLock            | t
 relation      |    42539 |    50027 |      |       |            |               |         |       |          | 3/3137             | 13804 | RowExclusiveLock         | t
(45 rows)



> Would it be possible to update your 8.4 installation to the latest
> bug fix (currently 8.4.15) to rule out the influence of any bugs
> which have already been fixed?

Is there a way to upgrade without having to dump all data and restore them after the upgrade ?

Best regards, Baptiste.

--- 
Baptiste LHOSTE 
blhoste@xxxxxxxxxxx 

ALALOOP S.A.S. - Technopole Izarbel - 64210 Bidart 
Téléphone : +33 (0) 5 59 41 51 10 
www.alaloop.com 


-- 
Sent via pgsql-admin mailing list (pgsql-admin@xxxxxxxxxxxxxx)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



[Index of Archives]     [KVM ARM]     [KVM ia64]     [KVM ppc]     [Virtualization Tools]     [Spice Development]     [Libvirt]     [Libvirt Users]     [Linux USB Devel]     [Linux Audio Users]     [Yosemite Questions]     [Linux Kernel]     [Linux SCSI]     [XFree86]

  Powered by Linux