Re: Re layout help: need chassis local io to minimize net links

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



What does “traffic” mean?  Reads?   Writes will have to hit the net regardless of any machinations.   

> On Jun 29, 2020, at 7:31 PM, Harry G. Coin <hgcoin@xxxxxxxxx> wrote:
> 
> I need exactly what ceph is for a whole lot of work, that work just
> doesn't represent a large fraction of the total local traffic.  Ceph is
> the right choice.  Plainly ceph has tremendous support for replication
> within a chassis, among chassis and among racks.  I just need
> intra-chassis traffic to not hit the net much.   Seems not such an
> unreasonable thing given the intra-chassis crush rules and all.  After
> all.. ceph's name wasn't chosen for where it can't go....
> 
>>>> On 6/29/20 1:57 PM, Marc Roos wrote:
>> I wonder if you should not have chosen a different product? Ceph is
>> meant to distribute data across nodes, racks, data centers etc. For a
>> nail use a hammer, for a screw use a screw driver.
>> -----Original Message-----
>> To: ceph-users@xxxxxxx
>> Subject: *****SPAM*****  layout help: need chassis local io
>> to minimize net links
>> Hi
>> I have a few servers each with 6 or more disks, with a storage workload
>> that's around 80% done entirely within each server.   From a
>> work-to-be-done perspective there's no need for 80% of the load to
>> traverse network interfaces, the rest needs what ceph is all about.   So
>> I cooked up a set of crush maps and pools, one map/pool for each server
>> and one map/pool for the whole.  Skipping the long story, the
>> performance remains network link speed bound and has got to change.
>> "Chassis local" io is too slow.   I even tried putting a mon within each
>> server.    I'd like to avoid having to revert to some other HA
>> filesystem per server with ceph at the chassis layer if I can help
>> it.   
>> Any notions that would allow 'chassis local' rbd traffic to avoid or
>> mostly avoid leaving the box?
>> Thanks!
>> _______________________________________________
>> ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an
>> email to ceph-users-leave@xxxxxxx
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux