Re: PostgreSQL Volume Question

[Melvin Davidson <melvin6925@xxxxxxxxx>]

On Fri, Jun 15, 2018 at 12:26 PM, Data Ace <dataace9@xxxxxxxxx> wrote:

Well I think my question is somewhat away from my intention cause of my poor understanding and questioning :( 

 

Actually, I have 1TB data and have hardware spec enough to handle this amount of data, but the problem is that it needs too many join operations and the analysis process is going too slow right now.

 

I've searched and found that graph model nicely fits for network data like social data in query performance.

 

Should I change my DB (I mean my DB for analysis)? or do I need some other solutions or any extension?

Thanks

On Thu, Jun 14, 2018 at 3:36 PM, Melvin Davidson <melvin6925@xxxxxxxxx> wrote:

On Thu, Jun 14, 2018 at 6:30 PM, Adrian Klaver <adrian.klaver@xxxxxxxxxxx> wrote:

On 06/14/2018 02:33 PM, Data Ace wrote:

Hi, I'm new to the community.

Recently, I've been involved in a project that develops a social network data analysis service (and my client's DBMS is based on PostgreSQL).
I need to gather huge volume of unstructured raw data for this project, and the problem is that with PostgreSQL, it would be so dfficult to handle this kind of data. Are there any PG extension modules or methods that are recommended for my project?

In addition to Ravi's questions:

What does the data look like?

What Postgres version?

How is the data going to get from A <--> B, local or remotely or both?

Is there another database or program involved in the process?

Thanks in advance.

--
Adrian Klaver
adrian.klaver@xxxxxxxxxxx

In addition to Ravi's and Adrian's questions: 

What is the hardware configuration?

--

Melvin Davidson
Maj. Database & Exploration Specialist
Universe Exploration Command – UXC
Employment by invitation only!

At  this point, your are still giving general instead of specific answers.

It is most important to answer Adrian's and my quesions:

What does the data look like?
What Postgres version?
How is the data going to get from A <--> B, local or remotely or both?
Is there another database or program involved in the process?

What is the O/S?

What does the hardware configuration look like?

>the problem is that it needs too many join operations and the analysis process is going too slow right now.

 So what is the structure of the tables involved, including indexes?

What is the actual query?

We cannot help unless you give us specifics to work with.

--

Melvin Davidson
Maj. Database & Exploration Specialist
Universe Exploration Command – UXC
Employment by invitation only!