On Sun, Mar 13, 2011 at 8:31 AM, Hans Verkuil <hverkuil@xxxxxxxxx> wrote: > Agenda for V4L2 brainstorm meeting in Warsaw, March 16-18 2011. > > Purpose of the meeting: to brainstorm about current V4L2 API limitations > with regards to required functionality. Ideally the results of the meeting > are actual solutions to these problems, but at the very least we should > have a concensus of what direction to take and who will continue working > on each problem. The hope is that this meeting will save us endless email > and irc discussions. > > It is *not* a summit meeting, so any conclusions need to be discussed and > approved on the mailinglist. > > The basic outline is the same as during previous meetings: the first day we > go through all the agenda points and make sure everyone understands the > problem. Smaller issues will be discussed and decided, more complex issues > are just discussed. > > The second day we go in depth into the complex issues and try to come up with > ideas that might work. The last day we translate the all agenda items into > actions. > > This approach worked well in the past and it ensures that we end up with > something concrete. > > Those who have a vested interest in an agenda item should be prepared to > explain their take on it and if necessary have a presentation ready. > > Besides the main agenda I also added a few items falling under the category > 'if time permits'. > > Attendees: > > Samsung Poland R&D Center: > Kamil Debski <k.debski@xxxxxxxxxxx> > Sylwester Nawrocki <s.nawrocki@xxxxxxxxxxx> > Tomasz Stanislawski <t.stanislaws@xxxxxxxxxxx> > Marek Szyprowski (Organizer) <m.szyprowski@xxxxxxxxxxx> > > Cisco Systems Norway: > Martin Bugge <marbugge@xxxxxxxxx> > Hans Verkuil (Chair) <hverkuil@xxxxxxxxx> > > Nokia: > Sakari Ailus <sakari.ailus@xxxxxxxxxxxxxxxxxxxxxxxxxx> > > Ideas On Board: > Laurent Pinchart <laurent.pinchart@xxxxxxxxxxxxxxxx> > > ST-Ericsson: > Willy Poisson <willy.poisson@xxxxxxxxxxxxxx> > > Samsung System.LSI Korea > Jonghun Han <jonghun.han@xxxxxxxxxxx> > Jaeryul Oh <jaeryul.oh@xxxxxxxxxxx> > > Samsung DMC Korea: > Seung-Woo Kim <sw0312.kim@xxxxxxxxxxx> > > Freelance: > Guennadi Liakhovetski <g.liakhovetski@xxxxxx> > > > Agenda: > > 1) Compressed format API for MPEG, H.264, etc. Also need to discuss what to > do with weird 'H.264 inside MJPEG' muxed formats. > (Hans, Laurent, Samsung) > > 2) Small architecture enhancements: > - Acquiring subdevs from other devices using subdev pool > http://www.mail-archive.com/linux-media@xxxxxxxxxxxxxxx/msg21831.html > (Tomasz) > - Introducing subdev hierarchy. Below there is a link to driver using it: > http://thread.gmane.org/gmane.linux.drivers.video-input-infrastructure/28885/focus=28890 > (Tomasz) > - Allow per-filehandle control handlers. > http://www.spinics.net/lists/linux-media/msg27975.html > (Jaeryul) > - How to control FrameBuffer device as v4l2 sub-device? > http://thread.gmane.org/gmane.linux.drivers.video-input-infrastructure/29442/focus=29570 > (Jaeryul) > - Which interface is better for Mixer of Exynos, frame buffer or V4l2? > http://www.mail-archive.com/linux-media@xxxxxxxxxxxxxxx/msg28549.html > (Jaeryul) > - Entity information ioctl > Some drivers (namely the uvcvideo driver) will need to report driver-specific > information about each entity (the UVC entity GUID, the UVC controls it > supports, ...). We need an API for that. > (Laurent) > > 3) Pipeline configuration, cropping and scaling: > > http://www.mail-archive.com/linux-media@xxxxxxxxxxxxxxx/msg27956.html > http://www.mail-archive.com/linux-media@xxxxxxxxxxxxxxx/msg26630.html > > (Everyone) > > 4) HDMI receiver/transmitter API support > > Some hotplug/CEC code can be found here: > > http://www.mail-archive.com/linux-media@xxxxxxxxxxxxxxx/msg28549.html > > CEC RFC from Cisco Systems Norway: > > http://www.mail-archive.com/linux-media@xxxxxxxxxxxxxxx/msg29241.html > > Hopefully we can post an initial HDMI RFC as well on Monday. > > (Martin, Hans, Samsung, ST-Ericsson) > > 5) Sensor/Flash/Snapshot functionality. > > http://www.mail-archive.com/linux-media@xxxxxxxxxxxxxxx/msg28192.html > http://www.mail-archive.com/linux-media@xxxxxxxxxxxxxxx/msg28490.html > > - Sensor blanking/pixel-clock/frame-rate settings (including > enumeration/discovery) > > - Multiple video buffer queues per device (currently implemented in the > OMAP 3 ISP driver in non-standard way). > > - Synchronising parameters (e.g. exposure time and gain) on given > frames. Some sensors support this on hardware. There are many use cases > which benefit from this, for example this one: > > <URL:http://fcam.garage.maemo.org/> > > - Flash synchronisation (might fall under the above topic). > > - Frame metadata. It is important for the control algorithms (exposure, > white balance, for example), to know which sensor settings have been > used to expose a given frame. Many sensors do support this. Do we want > to parse this in the kernel or does it belong to user space? The > metadata formats are mostly sensor dependent. > (Everyone) > > > Items 3 and 5 are 'the big ones'. Past experience indicates that we can't go > through all items on the first day and so I expect that item 5 (and perhaps > even 4) will have to move to the second day. > > > If time permits, then we can also look at these items: > > A) Buffer Pool (HWMEM, GEM, CMA) > (ST-Ericsson, Samsung) > > B) Use of V4L2 as a frontend for SW/DSP codecs > (Laurent) > > C) Userspace drivers (OMX) > This is a follow-up of the "v4l2 vs omx for camera" discussion. I'd like to > discuss whether we need an API for userspace drivers, like OMX has. > (Laurent) > > D) GL/ES in V4L2 devices > Devices are becoming hybrid. GPUs are supported through DRM and OpenGL > (OpenGL/ES is embedded devices), and video output with V4L2. What about a > video output device with OpenGL/ES capabilities ? We'll need to think about it > at some point. > (Laurent) This is what I've been worried about. v4l grows it's own output and modesetting API and now we have multiple incompatible stacks for graphics. Maybe the existing drm and v4l APIs can come to some common agreement for video output. Otherwise we are going to end up with two or more stacks depending on which HW the oem or user wants to use. This seems like a good topic for LPC or something similar where both v4l and drm developers will be present. Alex > > The reason I put these items here is that I think that these are not quite as > urgent as the others, and given that we only have three days we have to make > a choice. I also think that these items are probably worth a full three-day > meeting all by themselves. > > I do want to discuss at the end of the last day how we should proceed with the > buffer pool et al. Do we need additional meetings? Who is going to guide this > work? What resources are available? Etc. > > Regards, > > Hans > > -- > Hans Verkuil - video4linux developer - sponsored by Cisco > -- > To unsubscribe from this list: send the line "unsubscribe linux-media" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html > -- To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
