Hi all With the ability to arbitrarily combine (video) data sources and sinks we have to be able to suitably configure both parties. This includes setting bus parameters, which is discussed elsewhere, and selecting a data format, which is discussed in this RFC. Video data, coming from a source (e.g., a camera sensor) to a sink (e.g., a bridge) can be processed in two ways: (1) as raw data, and (2) as formatted data. Definition 1: Raw Data Sampling means storing frames, consisting of a certain number of lines, consisting of a certain number of samples (which may or may not represent pixels) in memory. Each sample contains a certain number of bits of useful information, multiple samples can be packed together according to some rule. In case (1) the sink has no specific knowledge about the format, so it can only sample data on its data bus and store it in memory in some specific manner. This "manner" is completely defined by the following three parameters: (a) how many bits are sampled, (b) in which order they will be stored in memory, (c) how samples have to be packed. To provide such "raw" data to the user the bridge driver also has to know what format the data represents if stored in memory as required by the source. In case (2) the sink "knows" this specific format and can handle it accordingly, e.g., convert to some other format. It is therefore proposed to describe a data format on-the-bus using the following parameters: enum V4L2_DATA_PACKING { V4L2_DATA_PACKING_NONE = 0, }; enum V4L2_DATA_ORDER { V4L2_DATA_ORDER_LE = 0, V4L2_DATA_ORDER_BE = 1, }; /** * struct v4l2_subdev_bus_pixelfmt - Data format on the image bus * @sourceformat: Format identification for sinks, capable to process this * specific format * @pixelformat: Fourcc code... * @colorspace: and colorspace, that will be obtained if the data is * stored in memory in the following way: * @bits_per_sample: How many bits the bridge has to sample * @packing: Type of sample-packing, that has to be used * @order: Sample order when storing in memory */ struct v4l2_subdev_bus_pixelfmt { u32 sourceformat; u32 pixelformat; enum v4l2_colorspace colorspace; int index; u8 bits_per_sample; enum V4L2_DATA_PACKING packing; enum V4L2_DATA_ORDER order; }; The .sourceformat field above is a new enumeration, similar to currently defined in include/linux/videodev2.h fourcc codes, but combining the fourcc, bits-per-sample, packing and order information in one. If an existing Fourcc code already uniquely defines this combination, the new code might coincide with it. In principle, this code is redundant, because the data format is completely described by the "raw" parameters, but it can be useful for some (simple) source-sink combinations. The sink driver can then use the following new method from struct v4l2_subdev_video_ops: int (*enum_bus_pixelfmt)(struct v4l2_subdev *sd, const struct v4l2_subdev_bus_pixelfmt **fmt); to enumerate formats, provided by the source and to decide, which of them it can support in raw mode, which as formatted data, and which of them it cannot support at all, e.g., because it does not support the requested packing type. This enumeration can either take place upon reception of a S_FMT ioctl, or during probing to build a list of formats, that this specific source-sink pair can provide to the user. Comments welcome. Thanks Guennadi --- Guennadi Liakhovetski, Ph.D. Freelance Open-Source Software Developer http://www.open-technology.de/ -- To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html