Re: [PATCH 1/1] prevent the race of incoming work during teardown

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Sage and Elder,

  I know you guys are very busy.So thank you very much to take a view to
the following patch.

Your replys would be very appreciated!

best,
Guanjun
	

>>> On 6/26/2012 at 04:41 PM, in message
<1340700088-9556-1-git-send-email-gjhe@xxxxxxxx>, Guanjun He
<heguanbo@xxxxxxxxx> wrote: 
> As you suggested in last e_mail: "The trick here is that I think 
> we want to set a flag to discard incoming messages and then flush the 
> workqueue, 
> do all this other tear down for osd_client etc., and then tear down the 
> messenger.  
> I don't think we can tear down the msgr fully before that, though, because 
> osd_client etc have their fingers in it.  We just need to prevent the race 
> of incoming work during teardown..."
> 
> 	We can not tear down the msgr fully, but we can set flag to discard the 
> incoming messages. And the following is the description of this patch:
> 	Add a bool variable 'teardowning' as flag in struct ceph_messenger, init 
> value
> is set to false, and set this flag to true in function 
> ceph_destroy_client(), and add 
> the condition code in function ceph_data_ready() to test the flag value, if 
> true, just return.
> 
> Signed-off-by: Guanjun He <gjhe@xxxxxxxx>
> ---
>  include/linux/ceph/messenger.h |    1 +
>  net/ceph/ceph_common.c         |    4 +++-
>  net/ceph/messenger.c           |    6 ++++++
>  3 files changed, 10 insertions(+), 1 deletions(-)
> 
> diff --git a/include/linux/ceph/messenger.h b/include/linux/ceph/messenger.h
> index 2521a95..61bb8e5 100644
> --- a/include/linux/ceph/messenger.h
> +++ b/include/linux/ceph/messenger.h
> @@ -54,6 +54,7 @@ struct ceph_messenger {
>  	struct ceph_entity_addr my_enc_addr;
>  
>  	bool nocrc;
> +	bool teardowning;
>  
>  	/*
>  	 * the global_seq counts connections i (attempt to) initiate
> diff --git a/net/ceph/ceph_common.c b/net/ceph/ceph_common.c
> index a776f75..3756afc 100644
> --- a/net/ceph/ceph_common.c
> +++ b/net/ceph/ceph_common.c
> @@ -501,6 +501,9 @@ void ceph_destroy_client(struct ceph_client *client)
>  {
>  	dout("destroy_client %p\n", client);
>  
> +	client->msgr->teardowning = true;
> +	ceph_msgr_flush();
> +
>  	/* unmount */
>  	ceph_osdc_stop(&client->osdc);
>  
> @@ -509,7 +512,6 @@ void ceph_destroy_client(struct ceph_client *client)
>  	 * auth module, which is needed to free those connections'
>  	 * ceph_authorizers.
>  	 */
> -	ceph_msgr_flush();
>  
>  	ceph_monc_stop(&client->monc);
>  
> diff --git a/net/ceph/messenger.c b/net/ceph/messenger.c
> index 524f4e4..fe8881e 100644
> --- a/net/ceph/messenger.c
> +++ b/net/ceph/messenger.c
> @@ -157,6 +157,10 @@ static void ceph_data_ready(struct sock *sk, int 
> count_unused)
>  {
>  	struct ceph_connection *con = sk->sk_user_data;
>  
> +	if (con->msgr->teardowning) {
> +		return;
> +	}
> +
>  	if (sk->sk_state != TCP_CLOSE_WAIT) {
>  		dout("ceph_data_ready on %p state = %lu, queueing work\n",
>  		     con, con->state);
> @@ -2281,6 +2285,8 @@ struct ceph_messenger *ceph_messenger_create(struct 
> ceph_entity_addr *myaddr,
>  	get_random_bytes(&msgr->inst.addr.nonce, sizeof(msgr->inst.addr.nonce));
>  	encode_my_addr(msgr);
>  
> +	msgr->teardowning = false;
> +
>  	dout("messenger_create %p\n", msgr);
>  	return msgr;
>  }



--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux