Re: [PATCH v3] ALSA: control: Add memory consumption limit to user controls

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Fri, 09 Apr 2021 04:27:35 +0200,
Takashi Sakamoto wrote:
> 
> Hi,
> 
> On Thu, Apr 08, 2021 at 01:33:41PM +0200, Takashi Iwai wrote:
> > On Thu, 08 Apr 2021 12:50:25 +0200, Takashi Sakamoto wrote:
> > > On Thu, Apr 08, 2021 at 07:31:49PM +0900, Takashi Sakamoto wrote:
> > > > ALSA control interface allows users to add arbitrary control elements
> > > > (called "user controls" or "user elements"), and its resource usage is
> > > > limited just by the max number of control sets (currently 32).  This
> > > > limit, however, is quite loose: each allocation of control set may
> > > > have 1028 elements, and each element may have up to 512 bytes (ILP32) or
> > > > 1024 bytes (LP64) of value data. Moreover, each control set may contain
> > > > the enum strings and TLV data, which can be up to 64kB and 128kB,
> > > > respectively.  Totally, the whole memory consumption may go over 38MB --
> > > > it's quite large, and we'd rather like to reduce the size.
> > > > 
> > > > OTOH, there have been other requests even to increase the max number
> > > > of user elements; e.g. ALSA firewire stack require the more user
> > > > controls, hence we want to raise the bar, too.
> > > > 
> > > > For satisfying both requirements, this patch changes the management of
> > > > user controls: instead of setting the upper limit of the number of
> > > > user controls, we check the actual memory allocation size and set the
> > > > upper limit of the total allocation in bytes.  As long as the memory
> > > > consumption stays below the limit, more user controls are allowed than
> > > > the current limit 32. At the same time, we set the lower limit (8MB)
> > > > as default than the current theoretical limit, in order to lower the
> > > > risk of DoS.
> > > > 
> > > > As a compromise for lowering the default limit, now the actual memory
> > > > limit is defined as a module option, 'max_user_ctl_alloc_size', so that
> > > > user can increase/decrease the limit if really needed, too.
> > > > 
> > > > Co-developed-by: Takashi Iwai <tiwai@xxxxxxx>
> > > > Reviewed-by: Takashi Sakamoto <o-takashi@xxxxxxxxxxxxx>
> > > > Tested-by: Takashi Sakamoto <o-takashi@xxxxxxxxxxxxx>
> > > > Signed-off-by: Takashi Sakamoto <o-takashi@xxxxxxxxxxxxx>
> > > > ---
> > > > v1->v2: Drop alloc_size field from user_element, calculate at private_free
> > > > v2->v3: Rebase. Fix boundary error. Obsolete macro usage relying on modern
> > > >         compiler optimization. Change comment style by modern coding
> > > >         convention. Rename module parameter so that users get it easily.
> > > >         Patch comment improvements.
> > > > ---
> > > >  include/sound/core.h |  2 +-
> > > >  sound/core/control.c | 75 ++++++++++++++++++++++++++++++--------------
> > > >  2 files changed, 52 insertions(+), 25 deletions(-)
> > > 
> > > The original content of patch comes from Iwai-san[1]. I have no clear
> > > idea to handle the case so add 'Co-developed-by' tag to the patch. If
> > > this is not good, I apologize the lack of my understanding to the
> > > development process in Linux kernel.
> > 
> > It depends.  In some cases, you just carry the patch with the original
> > authorship (From address) and put your sign-off.  In some cases,
> > Co-developed-by can be used.  I don't mind much either way, so I took
> > your v3 patch now (with the addition of the Link URL to v2 patch).
> 
> Thanks for applying the patch as is. I would post it just with my sign-off
> without no changes to your patch, However in the case I added some changes,
> so I have no conviction to it...
> 
> Well, relevant to the function, I have some ideas to refactor ALSA control
> core. If you have room to discuss about them, I'd like to ask your opinion.
> 
> At present, I have five ideas:
> 
> 1. Split code relevant to user-defined element set into new module
> 
> Although the function is itself useful to me, it's useless in the case
> to use driver in which every functions are in kernel land, especially in
> embedded systems. The layering function introduced recently (and ctl ioctl
> registration function) enables to capsulate it into module. This results
> in building the function according to kernel configuration and reduction
> of the size of snd.ko for embedded systems. (But I wish usual desktop
> environment enables it...)
> 
> In my plan, the name of new module is snd_ctl_user_elem_set.ko and the
> configuration is CONFIG_SND_CTL_USER_ELEM_SETS. I've already written
> patchset in my hand and find some negative points:
> 
>  * Comparing environments in which the function is enable or disabled,
>    we have difference about the system behaviour against some ioctl
>    requests (ELEM_ADD, ELEM_REPLACE, ELEM_REMOVE). I have no idea to
>    judge whether this is evil or not.
>  * Some internal functions and tables in snd.ko should be expoted to the
>    new module; e.g. 'value_sizes' or 'snd_ctl_new()'. The symbol table
>    is increased.
>  * Some code should be moved from compatibility layer of ALSA control
>    core. This seems to increate the cost of maintenance for the layer.

The module would be useful if this can work additionally on top of the
others.  And, in the case of user-element, it has nothing to do with
the driver, so if the module is split, user would have to load the
module manually -- which is inconvenient.

If your concern is about the driver size, the needed change isn't
about splitting to another module but the conditional builds either
with ifdef or factor out to another file (and conditionally build via
Makefile).

> 2. Introduce control component structure and move codes from card structure
> 
> This is just an idea and preparation for following items. Historically,
> ALSA card structure includes some control-related stuffs. The card has
> two Linux device structures for pseudo card (card_dev) and control
> cdev (ctl_dev).  The card also aggregates the list of the other
> components such as pcm, hwdep. In this item, I add a new control
> structure and split control related stuffs from card structure. As a
> result, the control component becomes to be equivalent to the other
> components, in a point of both relationship to pseudo card device and
> relationship to cdev.
> 
> The change results in the reduction of size of card structure somehow. I
> expect it to be friendly to memory object allocator, and to be clear
> view of code structure.

Well, moving the control-related fields into another allocated object
wouldn't reduce the size in total, so I don't see any big merit by
that.  Note that the control API is mandatory for each card, hence it
can be never optional; that's the difference from other components.

Though, moving control-related fields into another struct and embed it
in snd_card would be fine if it improves the readability.  It'll be
essentially just grouping and renaming.


> At present, I don't prepare any patch. But I guess some negative
> points:
>  * I don't get the range of code influenced by the change yet. If it's
>    huge, I would give up the idea itself...
>  * Theoretically, the new control structure is released as the same way
>    as the other components such as PCM. However I'm afraid of
>    fatal regressions comes from structural problems in complicated release
>    process of ALSA core...
>  * Any change of behaviour relevant to kobject in a view of userspace.
> 
> 3. Add kobject attributes into the control device
> 
> At present, card structure has kobject attributes. Some kernel APIs are
> exposed to in-kernel drivers and some drivers already use it; e.g. the
> series of line6 drivers.
> 
> In this item, referring to the idea of case for card structure, I add
> kobject attributes into the control device, and add mechanism for
> in-kernel drivers to register own attributes as well as common
> attributes.
> 
> As you know, kobject attributes exposed via sysfs node is often abused,
> like recent patch for any name of card structure. It should be done with
> enough care of future change, since it's a part of interface to
> userspace once exposed to userspace,

Do you mean to add some sysfs files under /sys/class/control*/?
That should be easy, just a few lines of the code.  For creating files
at the device instantiation, just setting the groups like the card
object should work.


> 4. Add `max_user_ctl_alloc_size` kobject attribute to the control device
> 
> In the patch, a new module parameter 'max_user_ctl_alloc_size' is added.
> In the item, I use the value of this parameter as initial value per
> control device. The value per control device can be changed via sysfs
> node.
> 
> The `max_user_ctl_alloc_size` is really the attribute of control device,
> so I think it acceptable. Additionally, 'curr_user_ctl_alloc_size' is
> also added so that userspace applications get current status.

So that's the primary purpose?  Then it makes sense, yeah.


> 5. add any mechanism to bind lifetime of user-defined element set to user
>    process
> 
> At present, the lifetime of user-defined element set is bound to card
> itself. However, it's convenient to user processes to bind the lifetime
> to process itself. I add any mechanism for it.
> 
> For recent years I've made some patches in house but never arrive at the
> best one. In the patches, I utilize access flags but in general the
> maintenance of lifetime is not easy issue. I tackle again in this time.

It sounds interesting, but I don't know how easily you can manage it.
The driver doesn't care much about the user process lifetime, but
mostly concentrate on the file handle...


thanks,

Takashi



[Index of Archives]     [ALSA User]     [Linux Audio Users]     [Pulse Audio]     [Kernel Archive]     [Asterisk PBX]     [Photo Sharing]     [Linux Sound]     [Video 4 Linux]     [Gimp]     [Yosemite News]

  Powered by Linux