Tomas, thank you. This machine is abare metal server running only a staging postgresql 10.3 instance. Nobody is using it beside me.
I'm attaching 4 files.
every_30_seconds_top_stats_during_query.txt - this is a caputure of the top command every 30 seconds(more or less) for 10+ minutes while I'm running the query. Let me know if this helps to answere your question.
EXPLAIN_WITH_LIMIT_AND_max_parallel_workers_per_gather_SET_TO_0.txt -
query plan with full query and
max_parallel_workers_per_gather force to 0. Full output.
EXPLAIN_WITH_LIMIT_AND_DEFAULT_PARALLEL_PROCESSING_SETTINGS.txt -
query plan
with full query and default parellel processing settings.
Full output.
EXPLAIN_WITHOUT_LIMIT_AND_DEFAULT_PARALLEL_PROCESSING_SETTINGS.tx - query plan of the query omitting the LIMIT clause and
default parellel processing settings.
Full output.
For what concerns the self-contained test case - I'll do my best to prepare it.
Thank you very much, please let me know if this answer your questions.
Il 22 mar 2018 3:04 AM, "Tomas Vondra" <tomas.vondra@xxxxxxxxxxxxxxx> ha scritto:
On 03/21/2018 08:44 PM, Alessandro Aste wrote:
> Thanks for your reply Tomas. The query just got stuck for forever. I
> observed no CPU spikes, it is currently running and I see 89 of the CPU
> idle. I'm using a relative powerfull machine (120 GB ram, 56 CPU).
>
That doesn't really answer the question, I'm afraid. I suppose "89 of
CPU" means that 89% idle in total, but 11% with 56 CPUs still means
about 6 cores 100% busy. But maybe you meant something else?
Is there something else running on the machine? If you look at "top" are
the processes (the one you're connected to and the parallel workers)
doing something on the CPU?
>
> Plain analyze as requested. :
>
I don't see anything obviously broken with the query plan, and it's
difficult to compare with the other plans because they are quite different.
But there's one part of the plan interesting:
Limit (cost=253523.56..253523.57 rows=1 width=176)
-> Sort (cost=253523.56..253523.57 rows=1 width=176)
Sort Key: c_2.gii_circuitid, c_1.id
-> Nested Loop (cost=33190.89..253523.55 rows=1 width=176)
Join Filter: (c_1.id = c.id)
-> Nested Loop (cost=31724.87..31736.29 rows=1 ...)
...
-> Gather (cost=1466.02..221787.23 rows=3 width=75)
Workers Planned: 5
-> Hash Join (cost=466.02..220786.93 rows=1 ...)
...
That is, there's a Gather on the inner side of a Nested Loop. I wonder
if that might cause issues in case of under-estimate (in which case we'd
be restarting the Gather many times) ...
BTW one of the plans you sent earlier is incomplete, because it ends
like this:
-> Nested Loop (cost=42469.41..42480.82 rows=1 width=85) (...)
Join Filter: (c.status = cst.id)
Time: 3016.688 ms (00:03.017)
That is, it's missing the part below the join.
That being said, I'm not sure what's the issue here. Can you prepare a
self-contained test case that we might use to reproduce the issue? For
example by dumping the relevant part of the tables?
regards
--
Tomas Vondra http://www.2ndQuadrant.com
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
QUERY PLAN Sort (cost=253514.80..253514.81 rows=1 width=176) Sort Key: c_2.gii_circuitid, c_1.id -> Hash Join (cost=33193.56..253514.79 rows=1 width=176) Hash Cond: (c_1.id = c.id) -> Gather (cost=1466.02..221787.23 rows=3 width=75) Workers Planned: 5 -> Hash Join (cost=466.02..220786.93 rows=1 width=75) Hash Cond: (c_1.id = vendor_gtt_pop.gtt_pop_id) -> Hash Join (cost=444.07..219779.19 rows=157724 width=63) Hash Cond: (c_1.pop_support_vendor_id = v.id) -> Merge Join (cost=5.02..217348.87 rows=157724 width=40) Merge Cond: (cl.circuit_id = c_1.id) -> Nested Loop (cost=0.86..171314.49 rows=157724 width=32) -> Parallel Index Only Scan using circuit_layout_idx on circuit_layout cl (cost=0.43..55430.93 rows=157724 width=8) Index Cond: (ordinal = 1) -> Index Scan using uniqid on segment sg (cost=0.43..0.73 rows=1 width=32) Index Cond: (id = cl.segment_id) -> Index Scan using circuit_id_key on circuit c_1 (cost=0.42..41790.58 rows=909014 width=8) -> Hash (cost=325.69..325.69 rows=9069 width=27) -> Seq Scan on vendor v (cost=0.00..325.69 rows=9069 width=27) -> Hash (cost=21.91..21.91 rows=3 width=12) -> Seq Scan on vendor_gtt_pop (cost=0.00..21.91 rows=3 width=12) Filter: (vendor_id = 12346) -> Hash (cost=31727.53..31727.53 rows=1 width=85) -> Nested Loop (cost=31725.15..31727.53 rows=1 width=85) -> Nested Loop (cost=31725.02..31727.38 rows=1 width=74) -> Nested Loop Left Join (cost=31724.59..31726.89 rows=1 width=70) -> Nested Loop Left Join (cost=31724.45..31726.73 rows=1 width=68) -> Nested Loop (cost=31724.02..31726.27 rows=1 width=30) -> GroupAggregate (cost=31723.60..31723.62 rows=1 width=26) Group Key: c_2.gii_circuitid -> Sort (cost=31723.60..31723.60 rows=1 width=26) Sort Key: c_2.gii_circuitid -> Gather (cost=1000.85..31723.59 rows=1 width=26) Workers Planned: 3 -> Nested Loop (cost=0.85..30723.49 rows=1 width=26) -> Nested Loop (cost=0.42..30722.56 rows=2 width=30) -> Parallel Seq Scan on circuit c_2 (cost=0.00..30714.61 rows=3 width=26) Filter: ((status >= 20) AND (status <> ALL ('{160,999}'::integer[])) AND (status <> 160) AND (service_description = 28)) -> Index Scan using so_pid_idx on service_order so_1 (cost=0.42..2.65 rows=1 width=12) Index Cond: (product_id = c_2.product_id) Filter: (((ordertype_id <> 2) OR (status = 999)) AND ((ordertype_id <> 3) OR (status = 999))) -> Index Scan using master_service_order_id_key on master_service_order mso (cost=0.42..0.46 rows=1 width=4) Index Cond: (id = so_1.master_service_order_id) Filter: (client_id = 11615) -> Index Scan using service_order_id_key on service_order so (cost=0.42..2.64 rows=1 width=12) Index Cond: (id = (max(so_1.id))) -> Index Scan using client_site_pkey on client_site cs (cost=0.42..0.46 rows=1 width=46) Index Cond: (id = so.a_site_id) -> Index Scan using country_pkey on country csc (cost=0.14..0.16 rows=1 width=6) Index Cond: (id = cs.country_id) -> Index Scan using circuit_product_id_idx on circuit c (cost=0.42..0.49 rows=1 width=12) Index Cond: (product_id = so.product_id) -> Index Scan using cs_id_c on circuit_status cst (cost=0.14..0.16 rows=1 width=19) Index Cond: (id = c.status)
Limit (cost=433508.77..433508.77 rows=1 width=176) -> Sort (cost=433508.77..433508.77 rows=1 width=176) Sort Key: c_2.gii_circuitid, c_1.id -> Nested Loop (cost=168438.04..433508.76 rows=1 width=176) Join Filter: (c_1.id = vendor_gtt_pop.gtt_pop_id) -> Hash Join (cost=168438.04..433486.80 rows=1 width=148) Hash Cond: (c_1.id = c.id) -> Hash Join (cost=125957.20..388048.64 rows=788618 width=63) Hash Cond: (c_1.pop_support_vendor_id = v.id) -> Hash Join (cost=125518.15..377653.28 rows=788618 width=40) Hash Cond: (sg.id = cl.segment_id) -> Seq Scan on segment sg (cost=0.00..231189.42 rows=3482542 width=32) -> Hash (cost=115660.43..115660.43 rows=788618 width=16) -> Merge Join (cost=4.59..115660.43 rows=788618 width=16) Merge Cond: (cl.circuit_id = c_1.id) -> Index Only Scan using circuit_layout_idx on circuit_layout cl (cost=0.43..61739.87 rows=788618 width=8) Index Cond: (ordinal = 1) -> Index Scan using circuit_id_key on circuit c_1 (cost=0.42..41790.58 rows=909014 width=8) -> Hash (cost=325.69..325.69 rows=9069 width=27) -> Seq Scan on vendor v (cost=0.00..325.69 rows=9069 width=27) -> Hash (cost=42480.82..42480.82 rows=1 width=85) -> Nested Loop (cost=42469.41..42480.82 rows=1 width=85) Join Filter: (c.status = cst.id) -> Nested Loop (cost=42469.41..42479.37 rows=1 width=74) -> Nested Loop Left Join (cost=42468.98..42478.89 rows=1 width=70) Join Filter: (csc.id = cs.country_id) -> Nested Loop Left Join (cost=42468.98..42471.26 rows=1 width=68) -> Nested Loop (cost=42468.56..42470.81 rows=1 width=30) -> GroupAggregate (cost=42468.13..42468.15 rows=1 width=26) Group Key: c_2.gii_circuitid -> Sort (cost=42468.13..42468.14 rows=1 width=26) Sort Key: c_2.gii_circuitid -> Nested Loop (cost=6063.84..42468.12 rows=1 width=26) -> Nested Loop (cost=6063.41..42465.82 rows=5 width=30) -> Bitmap Heap Scan on circuit c_2 (cost=6062.99..42439.29 rows=10 width=26) Recheck Cond: (status >= 20) Filter: ((status <> ALL ('{160,999}'::integer[])) AND (status <> 160) AND (service_description = 28)) -> Bitmap Index Scan on ckt_stat_idx (cost=0.00..6062.99 rows=576315 width=0) Index Cond: (status >= 20) -> Index Scan using so_pid_idx on service_order so_1 (cost=0.42..2.65 rows=1 width=12) Index Cond: (product_id = c_2.product_id) Filter: (((ordertype_id <> 2) OR (status = 999)) AND ((ordertype_id <> 3) OR (status = 999))) -> Index Scan using master_service_order_id_key on master_service_order mso (cost=0.42..0.46 rows=1 width=4) Index Cond: (id = so_1.master_service_order_id) Filter: (client_id = 11615) -> Index Scan using service_order_id_key on service_order so (cost=0.42..2.64 rows=1 width=12) Index Cond: (id = (max(so_1.id))) -> Index Scan using client_site_pkey on client_site cs (cost=0.42..0.46 rows=1 width=46) Index Cond: (id = so.a_site_id) -> Seq Scan on country csc (cost=0.00..4.50 rows=250 width=6) -> Index Scan using circuit_product_id_idx on circuit c (cost=0.42..0.49 rows=1 width=12) Index Cond: (product_id = so.product_id) -> Seq Scan on circuit_status cst (cost=0.00..1.20 rows=20 width=19) -> Seq Scan on vendor_gtt_pop (cost=0.00..21.91 rows=3 width=12) Filter: (vendor_id = 12346)
QUERY PLAN Limit (cost=253523.56..253523.57 rows=1 width=176) -> Sort (cost=253523.56..253523.57 rows=1 width=176) Sort Key: c_2.gii_circuitid, c_1.id -> Nested Loop (cost=33190.89..253523.55 rows=1 width=176) Join Filter: (c_1.id = c.id) -> Nested Loop (cost=31724.87..31736.29 rows=1 width=85) Join Filter: (c.status = cst.id) -> Nested Loop (cost=31724.87..31734.84 rows=1 width=74) -> Nested Loop Left Join (cost=31724.45..31734.35 rows=1 width=70) Join Filter: (csc.id = cs.country_id) -> Nested Loop Left Join (cost=31724.45..31726.73 rows=1 width=68) -> Nested Loop (cost=31724.02..31726.27 rows=1 width=30) -> GroupAggregate (cost=31723.60..31723.62 rows=1 width=26) Group Key: c_2.gii_circuitid -> Sort (cost=31723.60..31723.60 rows=1 width=26) Sort Key: c_2.gii_circuitid -> Gather (cost=1000.85..31723.59 rows=1 width=26) Workers Planned: 3 -> Nested Loop (cost=0.85..30723.49 rows=1 width=26) -> Nested Loop (cost=0.42..30722.56 rows=2 width=30) -> Parallel Seq Scan on circuit c_2 (cost=0.00..30714.61 rows=3 width=26) Filter: ((status >= 20) AND (status <> ALL ('{160,999}'::integer[])) AND (status <> 160) AND (service_description = 28)) -> Index Scan using so_pid_idx on service_order so_1 (cost=0.42..2.65 rows=1 width=12) Index Cond: (product_id = c_2.product_id) Filter: (((ordertype_id <> 2) OR (status = 999)) AND ((ordertype_id <> 3) OR (status = 999))) -> Index Scan using master_service_order_id_key on master_service_order mso (cost=0.42..0.46 rows=1 width=4) Index Cond: (id = so_1.master_service_order_id) Filter: (client_id = 11615) -> Index Scan using service_order_id_key on service_order so (cost=0.42..2.64 rows=1 width=12) Index Cond: (id = (max(so_1.id))) -> Index Scan using client_site_pkey on client_site cs (cost=0.42..0.46 rows=1 width=46) Index Cond: (id = so.a_site_id) -> Seq Scan on country csc (cost=0.00..4.50 rows=250 width=6) -> Index Scan using circuit_product_id_idx on circuit c (cost=0.42..0.49 rows=1 width=12) Index Cond: (product_id = so.product_id) -> Seq Scan on circuit_status cst (cost=0.00..1.20 rows=20 width=19) -> Gather (cost=1466.02..221787.23 rows=3 width=75) Workers Planned: 5 -> Hash Join (cost=466.02..220786.93 rows=1 width=75) Hash Cond: (c_1.id = vendor_gtt_pop.gtt_pop_id) -> Hash Join (cost=444.07..219779.19 rows=157724 width=63) Hash Cond: (c_1.pop_support_vendor_id = v.id) -> Merge Join (cost=5.02..217348.87 rows=157724 width=40) Merge Cond: (cl.circuit_id = c_1.id) -> Nested Loop (cost=0.86..171314.49 rows=157724 width=32) -> Parallel Index Only Scan using circuit_layout_idx on circuit_layout cl (cost=0.43..55430.93 rows=157724 width=8) Index Cond: (ordinal = 1) -> Index Scan using uniqid on segment sg (cost=0.43..0.73 rows=1 width=32) Index Cond: (id = cl.segment_id) -> Index Scan using circuit_id_key on circuit c_1 (cost=0.42..41790.58 rows=909014 width=8) -> Hash (cost=325.69..325.69 rows=9069 width=27) -> Seq Scan on vendor v (cost=0.00..325.69 rows=9069 width=27) -> Hash (cost=21.91..21.91 rows=3 width=12) -> Seq Scan on vendor_gtt_pop (cost=0.00..21.91 rows=3 width=12) Filter: (vendor_id = 12346)
top - 08:39:32 up 10 days, 1:20, 5 users, load average: 3.76, 1.71, 1.52 Tasks: 1093 total, 7 running, 1086 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104390972k used, 27654420k free, 183748k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292232k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 92.0 1.5 15:15.60 postmaster 111732 postgres 20 0 30.8g 476m 473m R 88.2 0.4 0:00.47 postmaster 111730 postgres 20 0 30.8g 473m 470m R 86.4 0.4 0:00.46 postmaster 111731 postgres 20 0 30.8g 476m 473m R 86.4 0.4 0:00.46 postmaster 111733 postgres 20 0 30.8g 476m 473m R 86.4 0.4 0:00.46 postmaster 111734 postgres 20 0 30.8g 476m 473m R 86.4 0.4 0:00.46 postmaster 111728 root 20 0 15824 1912 828 R 3.8 0.0 0:00.04 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.60 watchdog/0 top - 08:40:06 up 10 days, 1:21, 5 users, load average: 3.93, 1.94, 1.60 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104394028k used, 27651364k free, 183804k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292252k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 95.9 1.5 15:48.48 postmaster 111926 postgres 20 0 30.8g 623m 620m R 95.9 0.5 0:00.65 postmaster 111927 postgres 20 0 30.8g 637m 634m R 95.9 0.5 0:00.65 postmaster 111928 postgres 20 0 30.8g 628m 625m R 95.9 0.5 0:00.65 postmaster 111930 postgres 20 0 30.8g 627m 624m R 95.9 0.5 0:00.65 postmaster 111929 postgres 20 0 30.8g 639m 636m R 94.1 0.5 0:00.65 postmaster 111933 root 20 0 15824 1912 828 R 3.7 0.0 0:00.05 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.60 watchdog/0 top - 08:40:39 up 10 days, 1:21, 5 users, load average: 4.07, 2.20, 1.70 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104398256k used, 27647136k free, 183844k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292256k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 112149 postgres 20 0 30.8g 828m 825m R 100.0 0.6 0:00.87 postmaster 112150 postgres 20 0 30.8g 833m 830m R 100.0 0.6 0:00.87 postmaster 112151 postgres 20 0 30.8g 820m 817m R 100.0 0.6 0:00.87 postmaster 112152 postgres 20 0 30.8g 839m 836m R 100.0 0.7 0:00.87 postmaster 112153 postgres 20 0 30.8g 818m 815m R 100.0 0.6 0:00.87 postmaster 104880 postgres 20 0 30.8g 1.9g 1.9g R 98.1 1.5 16:21.32 postmaster 112155 root 20 0 15824 1912 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.60 watchdog/0 top - 08:41:13 up 10 days, 1:22, 5 users, load average: 4.38, 2.48, 1.81 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104384600k used, 27660792k free, 183876k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292256k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 94.6 1.5 16:54.15 postmaster 112342 postgres 20 0 30.8g 312m 309m R 59.8 0.2 0:00.31 postmaster 112344 postgres 20 0 30.8g 312m 309m R 59.8 0.2 0:00.31 postmaster 112346 postgres 20 0 30.8g 316m 313m R 59.8 0.2 0:00.31 postmaster 112343 postgres 20 0 30.8g 313m 310m R 57.9 0.2 0:00.30 postmaster 112345 postgres 20 0 30.8g 313m 310m R 57.9 0.2 0:00.30 postmaster 112340 root 20 0 15824 1912 828 R 3.9 0.0 0:00.03 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.60 watchdog/0 top - 08:41:46 up 10 days, 1:22, 5 users, load average: 4.74, 2.77, 1.93 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104394528k used, 27650864k free, 183892k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292260k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 100.0 1.5 17:27.00 postmaster 112528 postgres 20 0 30.8g 730m 727m R 100.0 0.6 0:00.73 postmaster 112529 postgres 20 0 30.8g 713m 710m R 100.0 0.6 0:00.73 postmaster 112525 postgres 20 0 30.8g 726m 723m R 98.2 0.6 0:00.73 postmaster 112526 postgres 20 0 30.8g 723m 720m R 98.2 0.6 0:00.73 postmaster 112527 postgres 20 0 30.8g 716m 713m R 98.2 0.6 0:00.73 postmaster 112531 root 20 0 15824 1912 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.60 watchdog/0 top - 08:42:20 up 10 days, 1:23, 5 users, load average: 4.60, 2.92, 2.01 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104380752k used, 27664640k free, 183916k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292260k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 96.5 1.5 17:59.83 postmaster 112718 postgres 20 0 30.8g 166m 163m R 38.6 0.1 0:00.20 postmaster 112719 postgres 20 0 30.8g 166m 163m R 38.6 0.1 0:00.20 postmaster 112720 postgres 20 0 30.8g 167m 164m R 38.6 0.1 0:00.20 postmaster 112721 postgres 20 0 30.8g 168m 165m R 38.6 0.1 0:00.20 postmaster 112722 postgres 20 0 30.8g 166m 163m R 38.6 0.1 0:00.20 postmaster 112716 root 20 0 15824 1912 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:42:54 up 10 days, 1:24, 5 users, load average: 4.71, 3.13, 2.11 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104390956k used, 27654436k free, 183948k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292264k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 100.0 1.5 18:32.67 postmaster 112902 postgres 20 0 30.8g 577m 574m R 100.0 0.4 0:00.57 postmaster 112904 postgres 20 0 30.8g 573m 570m R 100.0 0.4 0:00.57 postmaster 112905 postgres 20 0 30.8g 578m 575m R 100.0 0.4 0:00.58 postmaster 112906 postgres 20 0 30.8g 572m 569m R 100.0 0.4 0:00.57 postmaster 112903 postgres 20 0 30.8g 577m 574m R 98.3 0.4 0:00.57 postmaster 112908 root 20 0 15824 1912 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:43:27 up 10 days, 1:24, 5 users, load average: 5.09, 3.40, 2.24 Tasks: 1095 total, 7 running, 1087 sleeping, 0 stopped, 1 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104383828k used, 27661564k free, 183980k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292268k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 91.4 1.5 19:05.55 postmaster 113186 postgres 20 0 30.8g 42m 39m R 7.3 0.0 0:00.04 postmaster 113188 postgres 20 0 30.8g 43m 40m R 7.3 0.0 0:00.04 postmaster 113185 postgres 20 0 30.8g 42m 39m R 5.5 0.0 0:00.03 postmaster 113187 postgres 20 0 30.8g 42m 39m R 5.5 0.0 0:00.03 postmaster 113189 postgres 20 0 30.8g 42m 39m R 5.5 0.0 0:00.03 postmaster 113183 root 20 0 15824 1912 828 R 3.7 0.0 0:00.06 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:44:01 up 10 days, 1:25, 5 users, load average: 4.97, 3.53, 2.32 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104390796k used, 27654596k free, 184068k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292272k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 94.2 1.5 19:38.42 postmaster 113408 postgres 20 0 30.8g 351m 348m R 62.2 0.3 0:00.33 postmaster 113409 postgres 20 0 30.8g 353m 350m R 62.2 0.3 0:00.33 postmaster 113410 postgres 20 0 30.8g 351m 348m R 62.2 0.3 0:00.33 postmaster 113411 postgres 20 0 30.8g 354m 351m R 62.2 0.3 0:00.33 postmaster 113412 postgres 20 0 30.8g 351m 348m R 62.2 0.3 0:00.33 postmaster 113406 root 20 0 15824 1916 828 R 3.8 0.0 0:00.04 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:44:34 up 10 days, 1:25, 5 users, load average: 4.89, 3.68, 2.41 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104395992k used, 27649400k free, 184116k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292276k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 100.0 1.5 20:11.26 postmaster 113636 postgres 20 0 30.8g 679m 676m R 100.0 0.5 0:00.69 postmaster 113637 postgres 20 0 30.8g 675m 672m R 100.0 0.5 0:00.69 postmaster 113638 postgres 20 0 30.8g 685m 682m R 100.0 0.5 0:00.69 postmaster 113639 postgres 20 0 30.8g 673m 670m R 100.0 0.5 0:00.69 postmaster 113635 postgres 20 0 30.8g 678m 675m R 98.4 0.5 0:00.68 postmaster 113641 root 20 0 15824 1916 828 R 3.9 0.0 0:00.03 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:45:08 up 10 days, 1:26, 5 users, load average: 4.93, 3.82, 2.50 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104384252k used, 27661140k free, 184156k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292276k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 92.8 1.5 20:44.11 postmaster 113837 postgres 20 0 30.8g 110m 107m R 26.0 0.1 0:00.14 postmaster 113838 postgres 20 0 30.8g 110m 107m R 26.0 0.1 0:00.14 postmaster 113839 postgres 20 0 30.8g 110m 107m R 26.0 0.1 0:00.14 postmaster 113840 postgres 20 0 30.8g 111m 108m R 26.0 0.1 0:00.14 postmaster 113841 postgres 20 0 30.8g 110m 107m R 26.0 0.1 0:00.14 postmaster 113835 root 20 0 15824 1912 828 R 3.7 0.0 0:00.04 top 159 root RT 0 0 0 0 S 1.9 0.0 0:01.10 migration/39 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 top - 08:45:41 up 10 days, 1:26, 5 users, load average: 4.71, 3.87, 2.57 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104393228k used, 27652164k free, 184196k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292276k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 96.1 1.5 21:16.96 postmaster 114061 postgres 20 0 30.8g 486m 483m R 90.3 0.4 0:00.47 postmaster 114062 postgres 20 0 30.8g 490m 487m R 90.3 0.4 0:00.47 postmaster 114059 postgres 20 0 30.8g 488m 485m R 88.4 0.4 0:00.46 postmaster 114060 postgres 20 0 30.8g 490m 487m R 88.4 0.4 0:00.46 postmaster 114063 postgres 20 0 30.8g 485m 482m R 88.4 0.4 0:00.46 postmaster 114057 root 20 0 15824 1912 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:46:15 up 10 days, 1:27, 5 users, load average: 4.85, 3.98, 2.64 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.3%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104396216k used, 27649176k free, 184220k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292280k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 99.6 1.5 21:49.81 postmaster 114242 postgres 20 0 30.8g 674m 671m R 99.6 0.5 0:00.69 postmaster 114243 postgres 20 0 30.8g 663m 660m R 99.6 0.5 0:00.69 postmaster 114244 postgres 20 0 30.8g 679m 676m R 99.6 0.5 0:00.69 postmaster 114245 postgres 20 0 30.8g 662m 659m R 99.6 0.5 0:00.69 postmaster 114241 postgres 20 0 30.8g 673m 670m R 97.6 0.5 0:00.68 postmaster 114247 root 20 0 15824 1912 828 R 3.8 0.0 0:00.03 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:46:49 up 10 days, 1:27, 5 users, load average: 4.86, 4.08, 2.72 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104383260k used, 27662132k free, 184236k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292284k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 96.4 1.5 22:22.64 postmaster 114436 postgres 20 0 30.8g 76m 73m R 15.4 0.1 0:00.08 postmaster 114438 postgres 20 0 30.8g 74m 71m R 15.4 0.1 0:00.08 postmaster 114440 postgres 20 0 30.8g 75m 72m R 15.4 0.1 0:00.08 postmaster 114437 postgres 20 0 30.8g 75m 72m R 13.5 0.1 0:00.07 postmaster 114439 postgres 20 0 30.8g 76m 73m R 13.5 0.1 0:00.07 postmaster 114434 root 20 0 15824 1916 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:47:22 up 10 days, 1:28, 5 users, load average: 4.63, 4.10, 2.78 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104393024k used, 27652368k free, 184268k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292288k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 96.3 1.5 22:55.49 postmaster 114621 postgres 20 0 30.8g 476m 473m R 88.6 0.4 0:00.46 postmaster 114622 postgres 20 0 30.8g 473m 470m R 88.6 0.4 0:00.46 postmaster 114620 postgres 20 0 30.8g 476m 473m R 86.7 0.4 0:00.45 postmaster 114623 postgres 20 0 30.8g 479m 476m R 86.7 0.4 0:00.45 postmaster 114624 postgres 20 0 30.8g 476m 473m R 86.7 0.4 0:00.45 postmaster 114618 root 20 0 15824 1912 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:47:56 up 10 days, 1:29, 5 users, load average: 4.62, 4.15, 2.84 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104400644k used, 27644748k free, 184300k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292288k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 114804 postgres 20 0 30.8g 785m 782m R 100.0 0.6 0:00.81 postmaster 114805 postgres 20 0 30.8g 784m 781m R 100.0 0.6 0:00.81 postmaster 114807 postgres 20 0 30.8g 795m 792m R 100.0 0.6 0:00.81 postmaster 104880 postgres 20 0 30.8g 1.9g 1.9g R 98.4 1.5 23:28.33 postmaster 114806 postgres 20 0 30.8g 763m 760m R 98.4 0.6 0:00.80 postmaster 114808 postgres 20 0 30.8g 768m 765m R 98.4 0.6 0:00.80 postmaster 114810 root 20 0 15824 1912 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:48:29 up 10 days, 1:29, 5 users, load average: 4.52, 4.19, 2.90 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104388648k used, 27656744k free, 184324k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292292k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 96.3 1.5 24:01.16 postmaster 115008 postgres 20 0 30.8g 160m 157m R 38.5 0.1 0:00.20 postmaster 115009 postgres 20 0 30.8g 161m 158m R 38.5 0.1 0:00.20 postmaster 115010 postgres 20 0 30.8g 159m 156m R 36.6 0.1 0:00.19 postmaster 115011 postgres 20 0 30.8g 161m 158m R 36.6 0.1 0:00.19 postmaster 115012 postgres 20 0 30.8g 160m 157m R 36.6 0.1 0:00.19 postmaster 115006 root 20 0 15824 1916 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:49:03 up 10 days, 1:30, 5 users, load average: 4.33, 4.18, 2.94 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104397400k used, 27647992k free, 184444k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292296k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 115298 postgres 20 0 30.8g 542m 539m R 99.2 0.4 0:00.53 postmaster 115299 postgres 20 0 30.8g 537m 534m R 99.2 0.4 0:00.53 postmaster 115300 postgres 20 0 30.8g 543m 540m R 99.2 0.4 0:00.53 postmaster 115301 postgres 20 0 30.8g 546m 543m R 99.2 0.4 0:00.53 postmaster 115302 postgres 20 0 30.8g 537m 534m R 99.2 0.4 0:00.53 postmaster 104880 postgres 20 0 30.8g 1.9g 1.9g R 97.3 1.5 24:34.06 postmaster 115296 root 20 0 15824 1900 828 R 3.7 0.0 0:00.04 top 177 root 20 0 0 0 0 S 1.9 0.0 0:00.16 ksoftirqd/43 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 top - 08:49:36 up 10 days, 1:30, 5 users, load average: 4.55, 4.26, 3.01 Tasks: 1094 total, 6 running, 1088 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104394916k used, 27650476k free, 184492k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292304k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 115525 postgres 20 0 0 0 0 R 100.0 0.0 0:00.90 postmaster 115526 postgres 20 0 0 0 0 R 100.0 0.0 0:00.90 postmaster 104880 postgres 20 0 30.8g 1.9g 1.9g S 98.3 1.5 25:06.90 postmaster 115527 postgres 20 0 0 0 0 R 98.3 0.0 0:00.90 postmaster 115528 postgres 20 0 0 0 0 R 98.3 0.0 0:00.90 postmaster 115529 postgres 20 0 0 0 0 R 98.3 0.0 0:00.90 postmaster 115531 root 20 0 15824 1912 828 R 3.9 0.0 0:00.03 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:50:10 up 10 days, 1:31, 5 users, load average: 4.58, 4.28, 3.06 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104393904k used, 27651488k free, 184548k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292312k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 89.1 1.5 25:39.78 postmaster 115732 postgres 20 0 30.8g 345m 342m R 58.8 0.3 0:00.33 postmaster 115733 postgres 20 0 30.8g 345m 342m R 58.8 0.3 0:00.33 postmaster 115734 postgres 20 0 30.8g 344m 341m R 58.8 0.3 0:00.33 postmaster 115735 postgres 20 0 30.8g 345m 342m R 58.8 0.3 0:00.33 postmaster 115736 postgres 20 0 30.8g 343m 340m R 58.8 0.3 0:00.33 postmaster 115730 root 20 0 15824 1916 828 R 3.6 0.0 0:00.07 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:50:44 up 10 days, 1:31, 5 users, load average: 4.12, 4.21, 3.08 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104402516k used, 27642876k free, 184596k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292316k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 100.0 1.5 26:12.64 postmaster 115948 postgres 20 0 30.8g 665m 662m R 100.0 0.5 0:00.68 postmaster 115950 postgres 20 0 30.8g 660m 657m R 100.0 0.5 0:00.68 postmaster 115951 postgres 20 0 30.8g 664m 661m R 100.0 0.5 0:00.68 postmaster 115952 postgres 20 0 30.8g 655m 652m R 100.0 0.5 0:00.68 postmaster 115949 postgres 20 0 30.8g 667m 664m R 98.2 0.5 0:00.67 postmaster 115954 root 20 0 15824 1916 828 R 1.9 0.0 0:00.02 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:51:17 up 10 days, 1:32, 5 users, load average: 4.10, 4.20, 3.12 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104388628k used, 27656764k free, 184628k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292312k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 96.3 1.5 26:45.47 postmaster 116145 postgres 20 0 30.8g 65m 62m R 13.5 0.1 0:00.07 postmaster 116147 postgres 20 0 30.8g 64m 61m R 13.5 0.1 0:00.07 postmaster 116144 postgres 20 0 30.8g 65m 62m R 11.6 0.1 0:00.06 postmaster 116146 postgres 20 0 30.8g 64m 61m R 11.6 0.1 0:00.06 postmaster 116148 postgres 20 0 30.8g 64m 61m R 11.6 0.1 0:00.06 postmaster 116142 root 20 0 15824 1912 828 R 3.9 0.0 0:00.03 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0 top - 08:51:51 up 10 days, 1:32, 5 users, load average: 4.77, 4.36, 3.20 Tasks: 1094 total, 7 running, 1087 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3%us, 0.3%sy, 0.0%ni, 99.2%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 132045392k total, 104394856k used, 27650536k free, 184644k buffers Swap: 131071996k total, 78604k used, 130993392k free, 47292320k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 104880 postgres 20 0 30.8g 1.9g 1.9g R 96.3 1.5 27:18.32 postmaster 116331 postgres 20 0 30.8g 353m 350m R 65.5 0.3 0:00.34 postmaster 116333 postgres 20 0 30.8g 353m 350m R 65.5 0.3 0:00.34 postmaster 116335 postgres 20 0 30.8g 354m 351m R 65.5 0.3 0:00.34 postmaster 116332 postgres 20 0 30.8g 356m 353m R 63.5 0.3 0:00.33 postmaster 116334 postgres 20 0 30.8g 355m 352m R 63.5 0.3 0:00.33 postmaster 116329 root 20 0 15824 1912 828 R 3.9 0.0 0:00.03 top 1 root 20 0 21452 968 716 S 0.0 0.0 0:04.81 init 2 root 20 0 0 0 0 S 0.0 0.0 0:02.32 kthreadd 3 root RT 0 0 0 0 S 0.0 0.0 0:08.69 migration/0 4 root 20 0 0 0 0 S 0.0 0.0 0:03.83 ksoftirqd/0 5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0 6 root RT 0 0 0 0 S 0.0 0.0 0:00.61 watchdog/0