Re: [389-users] CoS imports slow

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Rich Megginson wrote:
Edward "Koko" Konetzko wrote:
Rich Megginson wrote:
Edward "Koko" Konetzko wrote:
I have a set of CoS objects I am importing in and their add times are extremely slow about 1 a second.
What platform? What 389-ds-base version? By import do you mean ldif2db or ldap add?
RHEL 5 64 bit, RHDS 8.1 and using ldapadd. Hardware is HP DL385 with 16 gigs of ram, raid1 for os and raid 10 for /var/lib/dirsrv. I have tried with the import buffer(?) set to auto and 2 gigs.
Since you are using Red Hat Directory Server, you should contact Red Hat support.

import buffer is only when using ldif2db. LDAP Add is much slower than ldif2db. I think part of it is that CoS is optimized for searching, but not so much for adding new CoS definitions - it builds a cache in memory to make searches go very quickly, but building the cache takes time during each add or modify operation.

Can't call Redhat as its centos-ds, I screwed up calling it RHDS since they are the same. Thanks for the help Ill try a few other things.




There are about 500k objects in the directory currently and its broken down in a hierarchical format.
A simple ASCII drawing would be.

ou=top
   |
   - ou=First
      |
      + ou=Second
            |
            + cn=Final


This is representation of the data but for ease of explanation this should work.

There are lots of "First" object and they have the possibility of lots of "second" objects. Its the also the same for "Second" object they could have a lot of "Final" objects. The idea is to use CoS at the First and Second level to reduce the amount look ups and redundant data as final objects need some info from the second objects and first objects.
Hopefully I explained that in a way it is easy to understand.

My question is are CoS objects not supposed to be used this way? Also are lots of CoS objects used in a hierarchical tree this way bad? Is there a way to make these imports faster? And last am I just doing something completely wrong and there is a better way that I should work to my end goal.

Thanks
Edward



--
389 users mailing list
389-users@xxxxxxxxxx
https://www.redhat.com/mailman/listinfo/fedora-directory-users




--
389 users mailing list
389-users@xxxxxxxxxx
https://www.redhat.com/mailman/listinfo/fedora-directory-users

[Index of Archives]     [Fedora Directory Users]     [Fedora Directory Devel]     [Fedora Announce]     [Fedora Legacy Announce]     [Kernel]     [Fedora Legacy]     [Share Photos]     [Fedora Desktop]     [PAM]     [Red Hat Watch]     [Red Hat Development]     [Big List of Linux Books]     [Gimp]     [Yosemite News]

  Powered by Linux