Hello again, I'm sorry, I forgot attach file... :-( Sincerely Jan Dne Út, led 30, 2024 at 11:09:44 CET napsal(a) Jan Marek: > Hello Sridhar, > > at Saturday I've finished upgrade proces to 18.2.1. > > Cluster is now in HEALTH_OK state and performs well. > > According to my colleagues there are lower latences and good > throughput. > > On OSD nodes there is relative low I/O activity. > > I still have mClock profile "high_client_ops". > > When I was stucked in the upgrade process, I had in logs so many > records, see attached file. Since upgrade is complete, this > messages went away... Can be this reason of poor > performance? > > Sincerely > Jan Marek > > Dne Čt, led 25, 2024 at 02:31:41 CET napsal(a) Jan Marek: > > Hello Sridhar, > > > > Dne Čt, led 25, 2024 at 09:53:26 CET napsal(a) Sridhar Seshasayee: > > > Hello Jan, > > > > > > Meaning of my previous post was, that CEPH cluster didn't fulfill > > > my needs and, although I had set mClock profile to > > > "high_client_ops" (because I have a plenty of time to rebalancing > > > and scrubbing), my clients went to problems. > > > > > > As far as the question around mClock is concerned, there are further > > > improvements in the works to handle QoS between client ops and > > > background scrub ops. This should help address the issue you are > > > currently facing. See PR: https://github.com/ceph/ceph/pull/51171 > > > for more information. > > > Also, it would be helpful to know the Ceph version you are currently using. > > > > thanks for your reply. > > > > I've just in process upgrade between 17.2.6 and 18.2.1 (you can > > see my previous posts about stuck in upgrade to reef). > > > > Maybe this was cause of my problem... > > > > Now I've tried give rest to the cluster to do some "background" > > tasks (and it seems, that this was correct, because on my hosts > > there is around 50-100MBps read and cca 10-50MBps write traffic - > > cca 1/4-1/2 of previous load). > > > > At Saturday I will change some settings on networking and I will > > try to start upgrade process, maybe with --limit=1, to be "soft" > > for cluster and for our clients... > > > > > -Sridhar > > > > Sincerely > > Jan Marek > > -- > > Ing. Jan Marek > > University of South Bohemia > > Academic Computer Centre > > Phone: +420389032080 > > http://www.gnu.org/philosophy/no-word-attachments.cs.html > > > > > _______________________________________________ > > ceph-users mailing list -- ceph-users@xxxxxxx > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > -- > Ing. Jan Marek > University of South Bohemia > Academic Computer Centre > Phone: +420389032080 > http://www.gnu.org/philosophy/no-word-attachments.cs.html > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx -- Ing. Jan Marek University of South Bohemia Academic Computer Centre Phone: +420389032080 http://www.gnu.org/philosophy/no-word-attachments.cs.html
2024-01-27T18:46:25.152544+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773745 with expected crc 2024-01-27T18:46:25.154758+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773745 with expected crc 2024-01-27T18:49:00.248561+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773746 with expected crc 2024-01-27T18:49:02.294944+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773748 with expected crc 2024-01-27T18:49:03.281543+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773749 with expected crc 2024-01-27T18:49:03.281894+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773749 with expected crc 2024-01-27T18:49:06.611229+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773752 with expected crc 2024-01-27T18:49:06.612924+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773752 with expected crc 2024-01-27T18:49:07.634638+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773753 with expected crc 2024-01-27T18:49:08.635094+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773754 with expected crc 2024-01-27T18:49:11.698700+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773757 with expected crc 2024-01-27T18:49:12.935850+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773758 with expected crc 2024-01-27T18:49:18.050429+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773761 with expected crc 2024-01-27T18:49:20.072799+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773763 with expected crc 2024-01-27T18:49:25.130966+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773768 with expected crc 2024-01-27T18:49:26.143437+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773769 with expected crc 2024-01-27T18:49:27.169226+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773770 with expected crc 2024-01-27T18:49:29.109478+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773772 with expected crc 2024-01-27T18:49:30.143336+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773773 with expected crc 2024-01-27T18:49:30.145672+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773773 with expected crc 2024-01-27T18:49:31.156645+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773774 with expected crc 2024-01-27T18:49:33.091121+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773776 with expected crc 2024-01-27T18:49:34.131002+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773777 with expected crc 2024-01-27T18:49:36.155677+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773779 with expected crc 2024-01-27T18:49:40.198616+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773783 with expected crc 2024-01-27T18:49:41.378590+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773784 with expected crc 2024-01-27T18:49:41.379829+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773784 with expected crc 2024-01-27T18:49:55.150475+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773798 with expected crc 2024-01-27T18:50:01.563979+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773804 with expected crc 2024-01-27T18:50:02.411187+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773805 with expected crc 2024-01-27T18:50:03.422114+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773806 with expected crc 2024-01-27T18:50:05.461799+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773807 with expected crc 2024-01-27T18:50:07.506839+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773809 with expected crc 2024-01-27T18:50:09.251843+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773811 with expected crc 2024-01-27T18:50:15.690691+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773815 with expected crc 2024-01-27T18:50:20.782015+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773816 with expected crc 2024-01-27T18:50:31.028240+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773820 with expected crc 2024-01-27T18:50:50.548008+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773827 with expected crc 2024-01-27T18:50:57.160703+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773828 with expected crc 2024-01-27T18:57:07.974972+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773832 with expected crc 2024-01-27T18:57:08.977299+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773833 with expected crc 2024-01-27T18:57:08.977961+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773833 with expected crc 2024-01-27T18:57:10.106872+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773834 with expected crc 2024-01-27T18:59:35.365525+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773836 with expected crc 2024-01-27T18:59:36.115179+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773837 with expected crc 2024-01-27T18:59:36.121682+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773837 with expected crc 2024-01-27T18:59:36.126054+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773837 with expected crc 2024-01-27T18:59:37.140657+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773838 with expected crc 2024-01-27T18:59:38.165279+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773839 with expected crc 2024-01-27T18:59:38.167150+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773839 with expected crc 2024-01-27T18:59:39.195725+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773840 with expected crc 2024-01-27T18:59:40.219951+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773841 with expected crc 2024-01-27T18:59:41.236661+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773842 with expected crc 2024-01-27T18:59:41.246948+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773842 with expected crc 2024-01-27T18:59:43.266357+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773844 with expected crc 2024-01-27T18:59:45.338603+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773845 with expected crc 2024-01-27T18:59:53.590320+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773854 with expected crc 2024-01-27T18:59:54.768655+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773855 with expected crc 2024-01-27T18:59:57.700582+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773858 with expected crc 2024-01-27T18:59:57.755930+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773858 with expected crc 2024-01-27T18:59:58.599427+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773859 with expected crc 2024-01-27T18:59:59.631843+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773860 with expected crc 2024-01-27T19:00:01.722655+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773862 with expected crc 2024-01-27T19:00:02.717369+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773863 with expected crc 2024-01-27T19:00:06.672502+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773867 with expected crc 2024-01-27T19:00:08.628745+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773869 with expected crc 2024-01-27T19:00:09.641572+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773870 with expected crc 2024-01-27T19:00:11.665647+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773872 with expected crc 2024-01-27T19:00:11.715656+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773872 with expected crc 2024-01-27T19:00:12.677192+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773873 with expected crc 2024-01-27T19:00:13.639557+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773874 with expected crc 2024-01-27T19:00:14.649512+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773875 with expected crc 2024-01-27T19:00:15.660282+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773876 with expected crc 2024-01-27T19:00:17.701838+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773878 with expected crc 2024-01-27T19:00:18.637912+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773879 with expected crc 2024-01-27T19:00:20.685280+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773881 with expected crc 2024-01-27T19:00:23.770910+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773884 with expected crc 2024-01-27T19:00:27.129302+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773887 with expected crc 2024-01-27T19:00:28.806827+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773889 with expected crc 2024-01-27T19:00:29.676350+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773890 with expected crc 2024-01-27T19:00:32.187204+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773891 with expected crc 2024-01-27T19:00:35.255799+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773894 with expected crc 2024-01-27T19:00:44.398783+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773899 with expected crc 2024-01-27T19:01:27.051247+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773912 with expected crc 2024-01-27T19:01:38.931064+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773915 with expected crc 2024-01-27T19:02:21.587155+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773923 with expected crc 2024-01-27T19:02:29.826955+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773929 with expected crc 2024-01-27T19:02:39.882744+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773932 with expected crc 2024-01-27T19:02:43.113192+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773933 with expected crc 2024-01-27T19:02:44.797468+01:00 osd1 ceph-osd[1115858]: log_channel(cluster) log [WRN] : failed to encode map e15773935 with expected crc 2024-01-27T19:02:52.168804+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773938 with expected crc 2024-01-27T19:02:53.821406+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773940 with expected crc 2024-01-27T19:10:14.367326+01:00 osd1 ceph-osd[1128137]: log_channel(cluster) log [WRN] : failed to encode map e15773947 with expected crc
Attachment:
signature.asc
Description: PGP signature
_______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
