I'm back with more details.
First, I've deleted the smaller sslentry database, since I don't need it, just so that it doesn't somehow spoil the picture. Now there is only 1 user database - bof (OID=16400). After that I've ran the pg_upgrade on a clean 10.4 cluster and it failed in the same way.
Now, the answers to your queries.
>> 2) The upgrade stops because of transaction ID wraparound, which is strange as that is not showing up in the 9.6 cluster I presume. You might want the queries found below on the 9.6 and 10 clusters to help figure this out:
>> SELECT c.oid::regclass as table_name,
>> greatest(age(c.relfrozenxid),age(t.relfrozenxid)) as age
>> FROM pg_class c
>> LEFT JOIN pg_class t ON c.reltoastrelid = t.oid
>> WHERE c.relkind IN ('r', 'm');
9.6 result - see attached 96-query1.txt
10.4 result - see attached 104-query1.txt
>> SELECT datname, age(datfrozenxid) FROM pg_database;
9.6 result - see attached 96-query2.txt
10.4 result - see attached 104-query2.txt
>> It might be useful
>> to see pg_controldata output for the old cluster, as well as
>> "select datname, datfrozenxid from pg_database" output from the
>> old cluster.
for the query - see above, for pg_controldata:
9.6 - see attached 96-pg_controldata.txt
10.4 - see attached 104-pg_controldata.txt
>> Alexander, could you hack things up so autovacuum logging is enabled
>> (log_autovacuum_min_duration=0), and see whether it's triggered?
I'll be happy to, but that will require to run pg_upgrade once more and that takes more that half a day and during this time clusters are not available to me. Given the data I'm attaching it may happen that the colleagues will want to see something else from my clusters or maybe change some settings before running the pg_upgrade again. Therefore, I'll wait 12 hours after this message in case there will be any more requests and the I'll run the pg_upgrade again.
Thank you all for trying to solve this matter, this is much appreciated! :)
2018-06-11 20:29 GMT+03:00 Andres Freund <andres@xxxxxxxxxxx>:
On 2018-06-11 13:14:12 -0400, Tom Lane wrote:
> Andres Freund <andres@xxxxxxxxxxx> writes:
> > I suspect the issue is that pg_resetwal does:
> > if (set_xid != 0)
> > {
> > ControlFile.checkPointCopy.nextXid = set_xid; Well, what could it do otherwise? ForceTransactionIdLimitUpdate(
>
> > /*
> > * For the moment, just set oldestXid to a value that will force
> > * immediate autovacuum-for-wraparound. It's not clear whether adding
> > * user control of this is useful, so let's just do something that's
> > * reasonably safe. The magic constant here corresponds to the
> > * maximum allowed value of autovacuum_freeze_max_age.
> > */
> > ControlFile.checkPointCopy.oldestXid = set_xid - 2000000000;
> > if (ControlFile.checkPointCopy.oldestXid < FirstNormalTransactionId)
> > ControlFile.checkPointCopy.oldestXid += FirstNormalTransactionId;
> > ControlFile.checkPointCopy.oldestXidDB = InvalidOid;
> > }
>
> > but we have codepath that doesn't check for oldestXidDB being
> > InvalidOid. Not great.
>
> Hm, I think I'd define the problem as "pg_resetwal is violating the
> expectation that oldestXidDB be valid".
)
currently does a syscache check for database existence. That'll just
return a lookup failure for InvalidOid, so we're reasonably good on that
front.
Using a hardcoded 2000000000 seems worse, will have funny results if
running with a smaller autovacuum_freeze_max_age...
> However, this just explains the basically-cosmetic issue that the
> complaint message mentions OID 0. It doesn't really get us to the
> answer to why Alexander is seeing a failure. It might be useful
> to see pg_controldata output for the old cluster, as well as
> "select datname, datfrozenxid from pg_database" output from the
> old cluster.
pg_upgrade starts the server with autovacuum disabled, I suspect
restoring all the large objects ends up using a lot of transaction
ids. GetNewTransactionId() should start autovacuum, but I'd guess that's
where things are going wrong for some reason.
Alexander, could you hack things up so autovacuum logging is enabled
(log_autovacuum_min_duration=0), and see whether it's triggered?
I'm not entirely clear why pg_restore appears to use a separate
transaction for each large object, surely exascerbating the problem.
Greetings,
Andres Freund
pg_control version number: 960 Catalog version number: 201608131 Database system identifier: 6341258630649216079 Database cluster state: in production pg_control last modified: Mon 11 Jun 2018 09:10:28 PM MSK Latest checkpoint location: 811B/24CA0B40 Prior checkpoint location: 811B/24CA0AD0 Latest checkpoint's REDO location: 811B/24CA0B40 Latest checkpoint's REDO WAL file: 000000030000811B00000024 Latest checkpoint's TimeLineID: 3 Latest checkpoint's PrevTimeLineID: 3 Latest checkpoint's full_page_writes: on Latest checkpoint's NextXID: 0:1982110603 Latest checkpoint's NextOID: 1763738656 Latest checkpoint's NextMultiXactId: 78 Latest checkpoint's NextMultiOffset: 136 Latest checkpoint's oldestXID: 1871522205 Latest checkpoint's oldestXID's DB: 12438 Latest checkpoint's oldestActiveXID: 0 Latest checkpoint's oldestMultiXid: 78 Latest checkpoint's oldestMulti's DB: 12439 Latest checkpoint's oldestCommitTsXid:0 Latest checkpoint's newestCommitTsXid:0 Time of latest checkpoint: Mon 11 Jun 2018 11:54:29 AM MSK Fake LSN counter for unlogged rels: 0/1 Minimum recovery ending location: 0/0 Min recovery ending loc's timeline: 0 Backup start location: 0/0 Backup end location: 0/0 End-of-backup record required: no wal_level setting: minimal wal_log_hints setting: off max_connections setting: 1500 max_worker_processes setting: 8 max_prepared_xacts setting: 0 max_locks_per_xact setting: 1024 track_commit_timestamp setting: off Maximum data alignment: 8 Database block size: 8192 Blocks per segment of large relation: 131072 WAL block size: 8192 Bytes per WAL segment: 16777216 Maximum length of identifiers: 64 Maximum columns in an index: 32 Maximum size of a TOAST chunk: 1996 Size of a large-object chunk: 2048 Date/time type storage: 64-bit integers Float4 argument passing: by value Float8 argument passing: by value Data page checksum version: 0
table_name | age -----------------------------------------------------+----- pg_authid | 771 pg_shseclabel | 767 pg_transform | 766 information_schema.sql_languages | 765 information_schema.sql_packages | 763 pg_description | 761 pg_cast | 759 pg_largeobject | 757 pg_largeobject_metadata | 755 pg_amop | 753 pg_amproc | 751 pg_language | 749 pg_aggregate | 747 pg_rewrite | 745 pg_trigger | 743 pg_event_trigger | 741 pg_enum | 740 pg_namespace | 739 pg_conversion | 737 pg_depend | 735 pg_database | 733 pg_auth_members | 729 pg_shdepend | 728 pg_shdescription | 726 pg_ts_config_map | 722 pg_ts_dict | 720 pg_ts_parser | 718 pg_ts_template | 716 pg_extension | 714 pg_foreign_data_wrapper | 712 pg_foreign_server | 710 pg_foreign_table | 708 pg_policy | 706 information_schema.sql_parts | 705 alfastrahexchangedocumentindexdata | 703 information_schema.sql_sizing | 701 information_schema.sql_sizing_profiles | 699 pg_user_mapping | 698 pg_index | 696 pg_operator | 694 pg_opfamily | 692 pg_opclass | 690 pg_am | 688 aclroleindexdata | 686 acluserdata | 684 pg_statistic | 682 cluster_qrtz_simple_triggers | 679 cluster_qrtz_job_details | 677 cluster_qrtz_simprop_triggers | 675 financedocumentrecordindexdata | 672 farerulesdocumentindexdata | 670 gdsbookabilityitemindexdata | 668 locks | 664 notificationmaildocumenttemplateindexdata | 663 notificationschemeindexdata | 661 amadeusexchangedocumentindexdata | 658 ssodexchangedocumentindexdata | 656 templatereportdescriptionindexdata | 655 userwebsettingsdata | 653 pg_constraint | 649 productvoidingindexdata | 647 debitslipindexdata | 645 teletrainexchangedocumentindexdata | 644 suxmlexchangedocumentindexdata | 643 commissionpropertiesindexdata | 642 vctcostsexchangedocumentindexdata | 640 aclregistryassetdata | 638 inmobexchangedocumentindexdata | 636 creditslipindexdata | 635 aeroexpressticketindexdata | 633 aclaspectindexdata | 630 aclgroupdata | 628 agencymemoproductitemgroupindexdata | 626 aclmodificatorindexdata | 625 basicdocumentindexdata | 623 agencymemoindexdata | 621 agentgroupindexdata | 620 acquainteddata | 618 aeroexpressreportdocumentindexdata | 615 athxmlorganizationexchangedocumentindexdata | 614 airlinecardcodesexchangedocumentindexdata | 613 agencymemoproductindexdata | 612 basicbugreportindexdata | 611 agenttemplatereportdocumentindexdata | 609 archivedproductindexdata | 608 baggagelimitsstatisticsdata | 606 basiccommonconnectionsettingsindexdata | 604 cluster_qrtz_calendars | 602 bookabilityreportdocumentindexdata | 601 bookingfileexchangedocumentindexdata | 600 basiccommonexportsettingsindexdata | 599 billingtransactionchangeindexdata | 597 cluster_qrtz_blob_triggers | 596 aviacentrconsolidatedreportdocumentindexdata | 595 brandedfareinformationindexdata | 593 cashindexdata | 592 billingtransactionindexdata | 591 basicexportsettingsindexdata | 589 blockcharterappendixindexdata | 587 mcoexchangedocumentindexdata | 585 branchexchangedocumentindexdata | 584 billing1cexchangedocumentindexdata | 583 chartofaccountselementindexdata | 580 cashregisterindexdata | 578 bulklongrunningtaskentrydata | 577 charterscitypairsexchangedocumentindexdata | 576 clientexchangedocumentindexdata | 574 cccexchangedocumentindexdata | 573 charterstraveldocumentexchangedocumentindexdata | 572 cluster_qrtz_cron_triggers | 570 cluster_qrtz_fired_triggers | 568 contractordescriptionindexdata | 566 cluster_qrtz_triggers | 564 combdata | 562 complexorderindexdata | 560 deliveryitemindexdata | 558 combincrementdata | 557 contractrelationdescriptionindexdata | 555 deletedobjectreferencedata | 553 dictionarydata | 551 credithistorydata | 549 deskentrydata | 547 bnch2exchangedocumentindexdata | 545 insuranceaccidentindexdata | 543 deliveryindexdata | 541 dbexchangedocumentindexdata | 540 dictupdateitemindexdata | 539 divergencereportdocumentindexdata | 537 discountpropertiesindexdata | 536 hotelproductreportdocumentindexdata | 534 excessbagageexchangedocumentindexdata | 533 exportdocumentindexdata | 532 financedocumentstemplatereportdocumentindexdata | 530 gdsaccountindexdata | 529 gdstracingdocumentindexdata | 527 gabrielmaskexchangedocumentindexdata | 525 openingbalancedata | 523 mainhotelproductguestindexdata | 521 hotexchangedocumentindexdata | 519 geoiprangedata | 518 hotelproductindexdata | 516 holdingexchangedocumentindexdata | 514 ibankexportdataindexdata | 513 insuranceaccidentreportdocumentindexdata | 511 insurancetripcancelindexdata | 510 issuetemplatesindexdata | 508 penaltypropertiesindexdata | 506 organizationexchangedocumentindexdata | 504 iurexchangedocumentindexdata | 503 gdsreferenceindexdata | 501 organizationbalanceindexdata | 499 personmetadataindexdata | 498 modifiedobjectreferencedata | 496 payment1cexchangedocumentindexdata | 494 mcofeesindexdata | 493 mytable | 492 mytmptable | 490 paytureregistryexchangedocumentindexdata | 488 notificationtemplategroupindexdata | 486 personexchangedocumentindexdata | 484 passnflycheckinproductindexdata | 482 pgpaymentindexdata | 481 retexchangedocumentindexdata | 479 refundeventindexdata | 478 userotpassetdata | 477 pg_db_role_setting | 772 productreportdocumentindexdata | 475 renaissanceinsuranceexchangedocumentindexdata | 474 s7excelexchangedocumentindexdata | 473 reportassetdata | 472 rootagentindexdata | 470 rulesmigrationexchangedocumentindexdata | 468 railwayreportdocumentindexdata | 466 retarchiveexchangedocumentindexdata | 465 rapidaexchangedocumentindexdata | 464 scheduledtasksettingsindexdata | 463 sirenamtdfaresettingsindexdata | 461 sabrecsvexchangedocumentindexdata | 458 searchcityfilterassetdata | 457 transactionsplitindexdata | 456 saleschaindescriptionindexdata | 454 salesreportdocumentindexdata | 452 sequencenumbersdata | 450 sirenaxmlexchangedocumentindexdata | 448 skyagentexchangedocumentindexdata | 446 soficlientsexchangedocumentindexdata | 445 travelpolicyauthorizationschemeindexdata | 444 terminalcreditreportdocumentindexdata | 442 spgdarchiveexchangedocumentindexdata | 441 subagentbalancereportdocumentindexdata | 440 tchdirectcontractindexdata | 439 subagentreportdocumentindexdata | 438 productsearchindexdata | 437 bulkdictionarydata | 411 sslentrylockassetdata | 435 stockblankreportdocumentindexdata | 434 tmp | 433 tchxmlcommissionsexchangedocumentindexdata | 431 tripartitereportdocumentindexdata | 429 trashbinitemindexdata | 428 triprequestindexdata | 426 shipmentautoprocessingexchangedocumentindexdata | 424 stockorderindexdata | 422 pg_inherits | 421 universalproductdescriptionindexdata | 420 utsitineraryexchangedocumentindexdata | 418 validatorindexdata | 417 vctpassengersexchangedocumentindexdata | 415 vip1cudidsexchangedocumentindexdata | 413 worklogindexdata | 412 cluster_qrtz_scheduler_state | 410 deletedassetreferencedata | 408 ufsexchangedocumentindexdata | 406 sabretokenindexdata | 405 accountingentryindexdata | 403 basemtdfaresettingsindexdata | 402 agentreportdocumentindexdata | 400 holdingindexdata | 399 personemploymentindexdata | 397 auraexchangedocumentindexdata | 395 rulesmigrationsettingsindexdata | 394 termindexdata | 390 paymentfeepropertiesindexdata | 388 paymentindexdata | 383 noticeindexdata | 392 organizationcontractindexdata | 386 hotelbookexchangedocumentindexdata | 384 tripartitecontractindexdata | 381 loginhistorydata | 379 pg_init_privs | 769 cluster_qrtz_paused_trigger_grps | 378 agencymemoitemindexdata | 377 organizationmetadataindexdata | 376 specialtariffindexdata | 374 templatereportdocumentindexdata | 372 branchindexdata | 370 avianovaitineraryreceiptexchangedocindexdata | 369 eticketquotaindexdata | 368 requestindexdata | 367 pg_replication_origin | 365 pg_collation | 364 pg_tablespace | 362 information_schema.sql_implementation_info | 360 pg_attrdef | 358 dbproperties | 356 crmaccountsexchangedocumentindexdata | 354 placeofsalesindexdata | 352 directcontractindexdata | 350 stockblankindexdata | 348 passengerpassportindexdata | 345 bookingfileindexdata | 343 liaisonexchangedocumentindexdata | 341 issueindexdata | 347 ssodarchiveexchangedocumentindexdata | 340 pg_default_acl | 339 tripindexdata | 337 railwayproductindexdata | 335 insurancetouristicindexdata | 333 commonproductfopindexdata | 331 universalproductindexdata | 329 entityeventnotificationindexdata | 327 pg_range | 325 pg_seclabel | 323 pg_attribute | 322 pg_proc | 320 productindexdata | 314 feepropertiesindexdata | 312 pg_type | 318 sftppersonsexchangedocumentindexdata | 310 personindexdata | 308 portraitpersonsexchangedocumentindexdata | 306 visaproductindexdata | 305 personbalanceindexdata | 303 invoiceexchangedocumentindexdata | 301 cwtgeneralproductindexdata | 299 seatblocksindexdata | 297 contractindexdata | 295 bronevikexchangedocumentindexdata | 293 mainhotelproductindexdata | 292 taisexchangedocumentindexdata | 290 contractcustomerindexdata | 289 pg_pltemplate | 731 pg_ts_config | 724 financeinitializationdataindexdata | 287 cardindexdata | 285 carrentalproductindexdata | 283 modelcontractindexdata | 281 basicsystemsettingsindexdata | 279 salespointindexdata | 277 basicpaymentdocumentindexdata | 275 transferproductindexdata | 273 cluster_qrtz_locks | 681 pccindexdata | 674 financedocumentindexdata | 666 statisticsdocumentindexdata | 659 information_schema.sql_features | 651 entitydata | 269 asynccommandinfodata | 267 versiondata | 266 vipstatisticspdoassetdata | 264 temporalobjectdata | 263 aclassetdata | 261 keypairentrydata | 259 fxworkspacedata | 257 aclentrydata | 255 exportreferencedata | 253 templatedocumentindexdata | 251 longrunningtaskinfodata | 249 syslogitemdata | 247 workspacedata | 245 activityitemdata | 243 shipmentautoprocessingexchangedocumentreferencedata | 241 phonecalldata | 240 keybindingsdata | 239 gdsstatentrydata | 235 storagesyncrecorddata | 234 asynctaskassignmentdata | 233 sslsessionentryassetdata | 231 transferindexdata | 230 iwayexchangedocumentindexdata | 229 shipmentindexdata | 228 questionrecorddata | 226 carlson1cinvoicerecordindexdata | 225 commonproductindexdata | 223 expressexchangedocumentindexdata | 646 athxmlpersonexchangedocumentindexdata | 631 aggregatedentityindexdata | 616 clientdebtreportdocumentindexdata | 594 cashregisterworkplaceindexdata | 581 spgdexchangedocumentindexdata | 459 pg_class | 316 organizationindexdata | 271 useraccountdata | 237 (333 rows)
datname | age -----------+----------- template1 | 216 template0 | 110588398 bof | 772 postgres | 110 (4 rows)
pg_control version number: 1002 Catalog version number: 201707211 Database system identifier: 6565566377704503227 Database cluster state: in production pg_control last modified: Mon 11 Jun 2018 09:20:32 PM MSK Latest checkpoint location: 8125/B7DEC5C0 Prior checkpoint location: 8125/8877C950 Latest checkpoint's REDO location: 8125/B738E100 Latest checkpoint's REDO WAL file: 0000000100008125000000B7 Latest checkpoint's TimeLineID: 1 Latest checkpoint's PrevTimeLineID: 1 Latest checkpoint's full_page_writes: on Latest checkpoint's NextXID: 0:2128594259 Latest checkpoint's NextOID: 24781 Latest checkpoint's NextMultiXactId: 78 Latest checkpoint's NextMultiOffset: 136 Latest checkpoint's oldestXID: 1982109846 Latest checkpoint's oldestXID's DB: 16400 Latest checkpoint's oldestActiveXID: 2128594259 Latest checkpoint's oldestMultiXid: 78 Latest checkpoint's oldestMulti's DB: 16400 Latest checkpoint's oldestCommitTsXid:0 Latest checkpoint's newestCommitTsXid:0 Time of latest checkpoint: Mon 11 Jun 2018 09:20:28 PM MSK Fake LSN counter for unlogged rels: 0/1 Minimum recovery ending location: 0/0 Min recovery ending loc's timeline: 0 Backup start location: 0/0 Backup end location: 0/0 End-of-backup record required: no wal_level setting: replica wal_log_hints setting: off max_connections setting: 1500 max_worker_processes setting: 20 max_prepared_xacts setting: 0 max_locks_per_xact setting: 1024 track_commit_timestamp setting: off Maximum data alignment: 8 Database block size: 8192 Blocks per segment of large relation: 131072 WAL block size: 8192 Bytes per WAL segment: 16777216 Maximum length of identifiers: 64 Maximum columns in an index: 32 Maximum size of a TOAST chunk: 1996 Size of a large-object chunk: 2048 Date/time type storage: 64-bit integers Float4 argument passing: by value Float8 argument passing: by value Data page checksum version: 0 Mock authentication nonce: 2535ee631c6be3ddcf78f52d21a10ba1694e4d96a396f265f5a6013b2c5931ee
table_name | age -----------------------------------------------------+----------- pg_statistic | 146483656 pg_type | 146483656 amadeusexchangedocumentindexdata | 146484314 agenttemplatereportdocumentindexdata | 146484265 aggregatedentityindexdata | 146484272 airlinecardcodesexchangedocumentindexdata | 146484269 archivedproductindexdata | 146484264 alfastrahexchangedocumentindexdata | 146484359 asynctaskassignmentdata | 146483889 asynccommandinfodata | 146483923 athxmlorganizationexchangedocumentindexdata | 146484270 auraexchangedocumentindexdata | 146484051 athxmlpersonexchangedocumentindexdata | 146484287 aviacentrconsolidatedreportdocumentindexdata | 146484251 avianovaitineraryreceiptexchangedocindexdata | 146484025 pg_policy | 146483656 pg_authid | 146483656 pg_largeobject_metadata | 146484411 baggagelimitsstatisticsdata | 146484262 pg_amop | 146483656 pg_amproc | 146483656 pg_language | 146483656 pg_aggregate | 146483656 pg_user_mapping | 146483656 pg_subscription | 146483656 pg_attribute | 146483656 pg_proc | 146483656 pg_class | 146483656 pg_attrdef | 146483656 pg_constraint | 146483656 basiccommonexportsettingsindexdata | 146484255 basemtdfaresettingsindexdata | 146484058 basicbugreportindexdata | 146484267 basiccommonconnectionsettingsindexdata | 146484260 basicdocumentindexdata | 146484279 pg_inherits | 146483656 aeroexpressreportdocumentindexdata | 146484271 activityitemdata | 146483899 agencymemoindexdata | 146484277 aeroexpressticketindexdata | 146484289 agencymemoitemindexdata | 146484033 agencymemoproductindexdata | 146484268 agentgroupindexdata | 146484276 agencymemoproductitemgroupindexdata | 146484282 agentreportdocumentindexdata | 146484056 pg_index | 146483656 pg_operator | 146483656 pg_opfamily | 146483656 pg_opclass | 146483656 pg_am | 146483656 pg_statistic_ext | 146483656 pg_rewrite | 146483656 pg_trigger | 146483656 pg_event_trigger | 146483656 pg_description | 146483656 pg_cast | 146483656 pg_enum | 146483656 pg_namespace | 146483656 pg_conversion | 146483656 pg_depend | 146483656 pg_database | 146483656 pg_db_role_setting | 146483656 pg_tablespace | 146483656 pg_pltemplate | 146483656 pg_auth_members | 146483656 pg_shdepend | 146483656 pg_shdescription | 146483656 pg_ts_config | 146483656 pg_ts_config_map | 146483656 pg_ts_dict | 146483656 pg_ts_parser | 146483656 pg_ts_template | 146483656 pg_extension | 146483656 pg_foreign_data_wrapper | 146483656 pg_foreign_server | 146483656 pg_foreign_table | 146483656 pg_replication_origin | 146483656 pg_default_acl | 146483656 pg_init_privs | 146483656 pg_seclabel | 146483656 pg_shseclabel | 146483656 pg_collation | 146483656 pg_partitioned_table | 146483656 pg_range | 146483656 pg_transform | 146483656 pg_sequence | 146483656 pg_publication | 146483656 pg_publication_rel | 146483656 pg_subscription_rel | 146483656 information_schema.sql_parts | 146483656 information_schema.sql_languages | 146483656 information_schema.sql_features | 146483656 information_schema.sql_implementation_info | 146483656 information_schema.sql_packages | 146483656 information_schema.sql_sizing | 146483656 information_schema.sql_sizing_profiles | 146483656 pg_largeobject | 146484413 aclentrydata | 146483911 accountingentryindexdata | 146484059 aclaspectindexdata | 146484286 aclassetdata | 146483917 aclmodificatorindexdata | 146484281 aclgroupdata | 146484284 aclregistryassetdata | 146484294 acluserdata | 146484340 aclroleindexdata | 146484342 acquainteddata | 146484274 basicexportsettingsindexdata | 146484245 basicpaymentdocumentindexdata | 146483931 billingtransactionindexdata | 146484247 basicsystemsettingsindexdata | 146483935 billing1cexchangedocumentindexdata | 146484239 branchexchangedocumentindexdata | 146484240 bookabilityreportdocumentindexdata | 146484257 billingtransactionchangeindexdata | 146484253 blockcharterappendixindexdata | 146484243 bnch2exchangedocumentindexdata | 146484201 bookingfileindexdata | 146483999 bookingfileexchangedocumentindexdata | 146484256 branchindexdata | 146484026 brandedfareinformationindexdata | 146484249 bronevikexchangedocumentindexdata | 146483949 bulkdictionarydata | 146484067 bulklongrunningtaskentrydata | 146484233 cashindexdata | 146484248 cardindexdata | 146483941 carlson1cinvoicerecordindexdata | 146483881 chartofaccountselementindexdata | 146484236 cccexchangedocumentindexdata | 146484229 carrentalproductindexdata | 146483939 cashregisterindexdata | 146484234 cashregisterworkplaceindexdata | 146484237 charterstraveldocumentexchangedocumentindexdata | 146484228 charterscitypairsexchangedocumentindexdata | 146484232 clientdebtreportdocumentindexdata | 146484250 clientexchangedocumentindexdata | 146484230 cluster_qrtz_blob_triggers | 146484252 cluster_qrtz_paused_trigger_grps | 146484034 cluster_qrtz_triggers | 146484220 cluster_qrtz_calendars | 146484258 cluster_qrtz_scheduler_state | 146484066 cluster_qrtz_cron_triggers | 146484226 cluster_qrtz_fired_triggers | 146484224 cluster_qrtz_simple_triggers | 146484335 cluster_qrtz_job_details | 146484333 cluster_qrtz_locks | 146484337 combincrementdata | 146484213 cluster_qrtz_simprop_triggers | 146484331 combdata | 146484218 commonproductfopindexdata | 146483987 commissionpropertiesindexdata | 146484298 commonproductindexdata | 146483879 complexorderindexdata | 146484216 contractcustomerindexdata | 146483945 contractindexdata | 146483951 creditslipindexdata | 146484291 contractordescriptionindexdata | 146484222 contractrelationdescriptionindexdata | 146484211 credithistorydata | 146484205 crmaccountsexchangedocumentindexdata | 146484010 dbexchangedocumentindexdata | 146484196 cwtgeneralproductindexdata | 146483955 dbproperties | 146484012 deletedobjectreferencedata | 146484209 debitslipindexdata | 146484301 deletedassetreferencedata | 146484064 deliveryindexdata | 146484197 deliveryitemindexdata | 146484214 discountpropertiesindexdata | 146484192 deskentrydata | 146484203 dictionarydata | 146484207 dictupdateitemindexdata | 146484195 entityeventnotificationindexdata | 146483983 divergencereportdocumentindexdata | 146484193 directcontractindexdata | 146484006 entitydata | 146483925 exportdocumentindexdata | 146484188 excessbagageexchangedocumentindexdata | 146484189 eticketquotaindexdata | 146484024 exportreferencedata | 146483909 expressexchangedocumentindexdata | 146484302 farerulesdocumentindexdata | 146484326 gdsstatentrydata | 146483891 financeinitializationdataindexdata | 146483943 feepropertiesindexdata | 146483968 financedocumentindexdata | 146484322 financedocumentrecordindexdata | 146484328 gdsaccountindexdata | 146484185 fxworkspacedata | 146483913 financedocumentstemplatereportdocumentindexdata | 146484186 gabrielmaskexchangedocumentindexdata | 146484181 gdsreferenceindexdata | 146484157 gdsbookabilityitemindexdata | 146484324 gdstracingdocumentindexdata | 146484183 geoiprangedata | 146484174 holdingexchangedocumentindexdata | 146484170 holdingindexdata | 146484055 hotelbookexchangedocumentindexdata | 146484040 ibankexportdataindexdata | 146484169 hotelproductindexdata | 146484172 hotelproductreportdocumentindexdata | 146484190 hotexchangedocumentindexdata | 146484175 inmobexchangedocumentindexdata | 146484292 insuranceaccidentreportdocumentindexdata | 146484167 insuranceaccidentindexdata | 146484199 insurancetouristicindexdata | 146483989 issueindexdata | 146484003 insurancetripcancelindexdata | 146484166 invoiceexchangedocumentindexdata | 146483957 issuetemplatesindexdata | 146484164 iurexchangedocumentindexdata | 146484159 iwayexchangedocumentindexdata | 146483885 keybindingsdata | 146483895 loginhistorydata | 146484035 keypairentrydata | 146483915 liaisonexchangedocumentindexdata | 146483997 locks | 146484320 mainhotelproductindexdata | 146483948 longrunningtaskinfodata | 146483905 mainhotelproductguestindexdata | 146484177 mcoexchangedocumentindexdata | 146484241 modifiedobjectreferencedata | 146484152 mcofeesindexdata | 146484149 modelcontractindexdata | 146483937 mytable | 146484148 mytmptable | 146484146 noticeindexdata | 146484048 notificationmaildocumenttemplateindexdata | 146484319 organizationbalanceindexdata | 146484155 notificationschemeindexdata | 146484317 notificationtemplategroupindexdata | 146484142 passnflycheckinproductindexdata | 146484138 organizationindexdata | 146483927 openingbalancedata | 146484179 organizationcontractindexdata | 146484042 organizationexchangedocumentindexdata | 146484160 passengerpassportindexdata | 146484001 organizationmetadataindexdata | 146484032 payment1cexchangedocumentindexdata | 146484150 paymentfeepropertiesindexdata | 146484044 paymentindexdata | 146484039 placeofsalesindexdata | 146484008 personemploymentindexdata | 146484053 paytureregistryexchangedocumentindexdata | 146484144 pccindexdata | 146484330 penaltypropertiesindexdata | 146484162 personmetadataindexdata | 146484154 personexchangedocumentindexdata | 146484140 personbalanceindexdata | 146483959 personindexdata | 146483964 phonecalldata | 146483896 pgpaymentindexdata | 146484137 portraitpersonsexchangedocumentindexdata | 146483962 productindexdata | 146483970 productreportdocumentindexdata | 146484131 productsearchindexdata | 146484093 productvoidingindexdata | 146484303 rapidaexchangedocumentindexdata | 146484120 questionrecorddata | 146483882 railwayproductindexdata | 146483991 railwayreportdocumentindexdata | 146484122 refundeventindexdata | 146484134 reportassetdata | 146484128 renaissanceinsuranceexchangedocumentindexdata | 146484130 requestindexdata | 146484023 rootagentindexdata | 146484126 retarchiveexchangedocumentindexdata | 146484121 retexchangedocumentindexdata | 146484135 rulesmigrationexchangedocumentindexdata | 146484124 rulesmigrationsettingsindexdata | 146484050 s7excelexchangedocumentindexdata | 146484129 salespointindexdata | 146483933 sabrecsvexchangedocumentindexdata | 146484114 sabretokenindexdata | 146484061 sftppersonsexchangedocumentindexdata | 146483966 searchcityfilterassetdata | 146484113 saleschaindescriptionindexdata | 146484110 salesreportdocumentindexdata | 146484108 scheduledtasksettingsindexdata | 146484119 sequencenumbersdata | 146484106 seatblocksindexdata | 146483953 shipmentautoprocessingexchangedocumentindexdata | 146484080 shipmentautoprocessingexchangedocumentreferencedata | 146483897 shipmentindexdata | 146483884 ssodexchangedocumentindexdata | 146484312 specialtariffindexdata | 146484030 sirenamtdfaresettingsindexdata | 146484117 sirenaxmlexchangedocumentindexdata | 146484104 skyagentexchangedocumentindexdata | 146484102 sslentrylockassetdata | 146484091 spgdarchiveexchangedocumentindexdata | 146484097 soficlientsexchangedocumentindexdata | 146484101 spgdexchangedocumentindexdata | 146484115 ssodarchiveexchangedocumentindexdata | 146483996 sslsessionentryassetdata | 146483887 statisticsdocumentindexdata | 146484315 stockblankindexdata | 146484004 stockblankreportdocumentindexdata | 146484090 stockorderindexdata | 146484078 storagesyncrecorddata | 146483890 syslogitemdata | 146483903 subagentbalancereportdocumentindexdata | 146484096 subagentreportdocumentindexdata | 146484094 suxmlexchangedocumentindexdata | 146484299 taisexchangedocumentindexdata | 146483946 tchxmlcommissionsexchangedocumentindexdata | 146484087 tchdirectcontractindexdata | 146484095 teletrainexchangedocumentindexdata | 146484300 templatereportdocumentindexdata | 146484028 templatedocumentindexdata | 146483907 templatereportdescriptionindexdata | 146484311 temporalobjectdata | 146483919 terminalcreditreportdocumentindexdata | 146484098 transferproductindexdata | 146483929 termindexdata | 146484046 tmp | 146484089 transactionsplitindexdata | 146484112 tripartitecontractindexdata | 146484037 trashbinitemindexdata | 146484084 transferindexdata | 146483886 travelpolicyauthorizationschemeindexdata | 146484100 triprequestindexdata | 146484082 tripindexdata | 146483993 tripartitereportdocumentindexdata | 146484085 ufsexchangedocumentindexdata | 146484062 universalproductdescriptionindexdata | 146484076 universalproductindexdata | 146483985 visaproductindexdata | 146483961 validatorindexdata | 146484073 useraccountdata | 146483893 userotpassetdata | 146484133 userwebsettingsdata | 146484309 versiondata | 146483922 vctcostsexchangedocumentindexdata | 146484296 utsitineraryexchangedocumentindexdata | 146484074 vctpassengersexchangedocumentindexdata | 146484071 vipstatisticspdoassetdata | 146483920 vip1cudidsexchangedocumentindexdata | 146484069 worklogindexdata | 146484068 workspacedata | 146483901 (340 rows)
datname | age -----------+----------- template0 | 146483656 bof | 146484413 postgres | 146483656 template1 | 146483656 (4 rows)
