Hi all, I've been looking into multiplanar support recently, and I ran into some API ambiguities. In the examples below I stick to the capture case, but the same applies to output and m2m. There are two capabilities: V4L2_CAP_VIDEO_CAPTURE and V4L2_CAP_VIDEO_CAPTURE_MPLANE. These caps tell the application whether the single and/or multiplanar API is implemented by the driver. If the hardware only supports single planar formats, then only V4L2_CAP_VIDEO_CAPTURE is present. If the hardware only supports multiplanar formats, then only V4L2_CAP_VIDEO_CAPTURE_MPLANE is present. The problems occurs when the hardware supports both single and multiplanar formats. The first question is if we want to allow drivers to implement both. The advantages of that are: - easy to implement: if the hardware supports one or more multiplanar formats, then the driver must implement only the multiplanar API. Applications will only see V4L2_CAP_VIDEO_CAPTURE or V4L2_CAP_VIDEO_CAPTURE_MPLANE and never both. - no confusion: what should be done if a multiplanar format is set up and an application asks for the current single planar format? Return a fake format? Some error? This is currently undefined. The disadvantages are: - it won't work with most/all existing applications since they only understand single planar at the moment. However, all multiplanar drivers are for Samsung embedded SoCs, so is this a real problem? If we would want to allow mixing the two, then we need to solve two problems: - Determine the behavior when calling G_FMT for a single planar buffer type when the current format is a multiplanar format. - We probably want to make a bunch of helper functions that do the job of handling the single planar case without requiring the driver to actually implement both. The first is actually a major problem. Returning an error here is completely unexpected behavior. The only reasonable solution I see is to remember the last single planar format and return that. But then G_FMT for a single or a multiplanar format will return different things. The second problem is also difficult, in particular when dealing with the streaming I/O ioctls. It's doable, but a fair amount of work. A conversion from multiplanar to singleplanar might be something that can be done in libv4l2. But that too is a substantial amount of work. I am inclined to disallow mixing of single and multiplanar APIs in a driver. Let's keep things simple. Comments? Hans -- To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html