--On Monday, November 9, 2020 07:08 -0800 ned+ietf@xxxxxxxxxxxxxxxxx wrote: >... >> We can see from Datatracker how many submissions there have >> been over the same period and bucket those in the same way as >> the survey. Then we can compare the data from the survey to >> see what coverage we have. i.e. if there are 500+ who >> submitted >20 times and we only captured data from 5 of them >> then that's a concern. > > Apparently you missed my main point, which was that the > pepople who have learned over time to operate the process in a > fashion that lets them produce lots of documents may not be > the best source of information about how to improve the > process for those who have not managed to do this. And, for the record, as the person who started this thread, I agree with this. I wouldn't wish my particular method of producing documents on anyone and it probably wouldn't work for many people other than me anyway. Today's situation is almost certainly better than the one we had a decade or two ago because there are more choices. However for a relative newcomer, having enough knowledge to make the best choice for themselves of those methods is, itself, a somewhat daunting task that creates a bit of a chicken-and-egg problem. At least in part, we have done as well as we have with relative newcomers producing drafts because volunteers from the community have quietly helped them structure things, put mailing list comments into outline drafts, etc., _and_ because of extraordinary patience on the part of the secretariat when drafts are rejected by the automated systems and the would-be author tries to post manually. A different way to look at the issues with the survey instrument is that it captures none of that from either the standpoint of those first starting out or those providing the assistance. john