Hi all, I agree that we should first merge the GSOC code from this year before we start thinking of a new segmenter. Let me know if you need any help. However, I think both a graph-cut-based segmenter and SIOX could have a place in GIMP side-by-side. Graphcut-based segmenters and SIOX have different complementary properties. It is going to be a GUI challenge though because it requires expert knowledge to know when to use which. Thiago: I can give you a couple of pictures that you should try with your segmenter and then compare against SIOX... especially those with a lot of texture and semi-transparent layers. The new version of SIOX can cope with them very well. Graph-based segmentation algorithms can't because they look for a minimum cut, which is a problem because especially those highly complicated pictures require a lot of time to do manually. Gerald -- Dr. Gerald Friedland International Computer Science Institute 1947 Center Street, Suite 600 CA-94704 Berkeley, USA http://www.gerald-friedland.org -- On Sun, Feb 28, 2010 at 5:54 PM, Thiago Spina <thiago.spina@xxxxxxxxx> wrote: > Hey guys, sorry about the delay. It's been a bit of a busy week. > > On 21 February 2010 14:05, Sven Neumann <sven@xxxxxxxx> wrote: >> >> Did you compare against SIOX as in the master branch or against the >> improved version that resulted from last year's GSoC ? It would also be >> interesting if you could benchmark your algorithm using the benchmark >> proposed in "GrabCut": interactive foreground extraction using iterated >> graph cuts" published in the Proceedings of the 2004 SIGGRAPH >> Conference. There's a Python script shipped with the GIMP source code >> that does this with the SIOX tool. > > I compared against both branches and the results were about the same. > Regarding the benchmark, on the papers that I mentioned in my first email > [1,2] we used the whole GrabCut segmentation dataset considering the > F-measure over the groundtruths (because our approach does not use trimaps). > The accuracy result was of over 98% on every paper. In fact, on another work > [3] seven users segmented a subset with 20 images from the GrabCut dataset, > using different pattern classifiers for one stage of our framework, and the > results were still above 97.7%. Also, we used the average number of drawn > markers as an indication of user interaction, and part of our current > approach (described in [2]) required about 5 markers in average (foreground > + background). We are currently working on a paper to detail our final > framework, because what was proposed on [2] was further improved to make > user interaction even more effective and simple, while maintaining the > segmentation quality. > I made a video comparing what I am going to implement for GIMP (currently on > our research software) and the soc-2009-siox-drb branch, which can be seen > here: http://vimeo.com/9803589. In my comparison, I used two images from the > GrabCut dataset and one from the Berkeley dataset [4] that present > increasing degree of difficulty. I believe that the foreground selection > tool requires a lot more user interaction for most common images, because it > usually does not handle well cases where foreground and background have > similar texture/color (as pointed out on the SIOX paper). > >> >> In my opinion we should at this point concentrate on merging last year's >> work on the SIOX tool. If we start to add other segmentation methods >> before this work is merged, then it will become very difficult to ever >> get the soc-2009-siox-drb branch merged. >> > > I agree that it should be a concern to merge that branch, but I think my > framework could be released as a minor version in the future. So, it would > be nice to have GSoC support for that. > [1] - http://portal.acm.org/citation.cfm?id=1700473 > [2] - http://www.springerlink.com/content/7415482725175nm7/ > [3] - Spina, T. V.; Montoya-Zegarra, J. A.; Andrijauskas, F.; Faria, F. A.; > Zampieri, C. E. A.; Pinto-Cáceres, S. M.; Carvalho, T. J. and Falcão, A. > X. "A comparative study among pattern classifiers in interactive image > segmentation". Brazilian Symposium on Computer Graphics and > Image Processing, 22 (SIBGRAPI), Oct 2009, IEEE. To appear in IEEE Xplore. > [4] - http://www.eecs.berkeley.edu/Research/Projects/CS/vision/bsds/ > > -- > Thiago Vallin Spina > MSc student > Laboratory of Visual Informatics > Institute of Computing -- Unicamp > www.liv.ic.unicamp.br > > _______________________________________________ > Gimp-developer mailing list > Gimp-developer@xxxxxxxxxxxxxxxxxxxxxx > https://lists.XCF.Berkeley.EDU/mailman/listinfo/gimp-developer > > _______________________________________________ Gimp-developer mailing list Gimp-developer@xxxxxxxxxxxxxxxxxxxxxx https://lists.XCF.Berkeley.EDU/mailman/listinfo/gimp-developer
