Video calling with PJSIP on an iphone

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I am using an iphone 4. I finally resorted to using the H264 decoder in
ffmeg (there is an iphone port available).
My test app decodes an H.264 movie while at the same time, encoding a raw
camera feed. I've just about got things to work - but my FPS for the
decoding (while encoding is going on) drops to around 7fps....
While not encoding, its great.


On Mon, Dec 6, 2010 at 12:47 PM, Jeff Brower <jbrower at signalogic.com> wrote:

> Dzmitry-
>
> > I said nothing about encoding, only about decoding.
>
> Ok.  I think for single-channel H264 decode the ARM core is fine.  My
> concern is with multiple concurrent decodes, for
> example video conference, and also encode.  I think this will be too much
> for the ARM core.  I can't figure out yet
> how to utilize the media (DSP) core, for example make API calls that
> offload the ARM.
>
> -Jeff
>
> > On 06.12.2010, at 8:58, Jeff Brower wrote:
> >
> >> Dzmitry-
> >>
> >>> Yes, we use x264 ( from http://www.videolan.org/developers/x264.html)
> >>> for decode h264.
> >>
> >> This is using the ARM core?  I would think that using the ARM core
> instead of the media (DSP) core would overload
> >> the
> >> ARM and cut battery life.  Maybe decode is more feasible, but encode is
> CPU intensive.
> >>
> >> -Jeff
> >>
> >>> On 04.12.2010, at 16:41, bo shi wrote:
> >>>
> >>>> Hi Dima,
> >>>>  I learned that the iPhone sdk does not publish the H.264 codec API,
> >>>> so developer can not use hardware decoder to decode raw H.264 stream
> >>>> directly, how can you do that? You decode video in soft way?
> >>>>
> >>>> Thanks in advance!
> >>>> Bo
> >>>>
> >>>>
> >>>> On Saturday, December 4, 2010, Dzmitry Yablonski <grizlik at gmail.com>
> wrote:
> >>>>> Hello Rob
> >>>>> We have implemented video call with PjSip 1.8.5 on iPhone.
> >>>>> Best regards, Dima.
> >>>>>
> >>>>>
> >>>>> On 04.12.2010, at 15:26, Rob Wilkes wrote:
> >>>>> I also noticed that your roadmap says it will initially be for
> windows. My requirement is for iphone. I guess my
> >>>>> question is not really a PJSIP question, but rather to developers who
> may have used PJ to make video work on
> >>>>> iPhone
> >>>>> - just wanted to check if it is doable or impossible today due to
> some iphone restriction :)
> >>>>>
> >>>>> On Sat, Dec 4, 2010 at 8:42 AM, Rob Wilkes <wilkrob at gmail.com>
> wrote:
> >>>>>
> >>>>> Hi Benny, Yes, I know PJSIP also plans to support it - but for this
> project, I cannot wait for that update, so I
> >>>>> plan to do it myself. Since you may be ahead of me, I was curious if
> there are any restrictions in the iPhone
> >>>>> APIs
> >>>>> itself that will inhibit PJSIP (or any other stack) to not work with
> video. For example, it looks like I cannot
> >>>>> use
> >>>>> the Movie Player class as it expects a URL.For  this to work, we will
> need frame/frame encode/decode and display
> >>>>> support on the iPhone.
> >>>>>
> >>>>>
> >>>>> thanks!
> >>>>>
> >>>>> On Fri, Dec 3, 2010 at 10:12 PM, Benny Prijono <bennylp at teluu.com>
> wrote:
> >>>>>
> >>>>> Hi, FYI we are also working on video and it is planned for the
> >>>>> upcoming 2.0 release. Have a look at our roadmap in the trac site.
> >>>>>
> >>>>> Best regards,
> >>>>> Benny
> >>>>>
> >>>>>
> >>>>> On Sat, Dec 4, 2010 at 3:51 AM, Rob Wilkes <wilkrob at gmail.com>
> wrote:
> >>>>>> Hi, I have started on an activity to get a basic Video call working
> on
> >>>>>> iPhone. It needs be be over RTP, preferably with H.264 codec. Has
> anyone
> >>>>>> written a video client with PJSIP specifically for the iphone? Are
> there any
> >>>>>> road blocks? ( I know PJSIP doesnt support video for now, but I plan
> to
> >>>>>> extend it - my question is more in the iPhone side). Prelim.
> analysis shows
> >>>>>> I can pass H.264 streams to the iphone media player framework and it
> can
> >>>>>> instantiate the appropriate player. My approximate plan is to send
> audio +
> >>>>>> video data using PJSIP, then extend PJSIP to support video decoding
> and pass
> >>>>>> the decoded H264 buffer to the media framework of iphone.
> >>>>>>
> >>>>>>
> >>>>>> _______________________________________________
> >>>>>> Visit our blog: http://blog.pjsip.org <http://blog.pjsip.org/>
> >>>>>>
> >>>>>> pjsip mailing list
> >>>>>> pjsip at lists.pjsip.org
> >>>>>> http://lists.pjsip.org/mailman/listinfo/pjsip_lists.pjsip.org
> >>>>>>
> >>>>>>
> >>>>>
> >>>>> _______________________________________________
> >>>>> Visit our blog: http://blog.pjsip.org <http://blog.pjsip.org/>
> >>>>>
> >>>>> pjsip mailing list
> >>>>> pjsip at lists.pjsip.org
> >>>>> http://lists.pjsip.org/mailman/listinfo/pjsip_lists.pjsip.org
> >>>>>
> >>>>>
> >>>>>
> >>>>> _______________________________________________
> >>>>> Visit our blog: http://blog.pjsip.org
> >>>>>
> >>>>> pjsip mailing list
> >>>>> pjsip at lists.pjsip.org
> >>>>> http://lists.pjsip.org/mailman/listinfo/pjsip_lists.pjsip.org
> >>>>>
> >>>>>
> >>>>
> >>>> _______________________________________________
> >>>> Visit our blog: http://blog.pjsip.org
> >>>>
> >>>> pjsip mailing list
> >>>> pjsip at lists.pjsip.org
> >>>> http://lists.pjsip.org/mailman/listinfo/pjsip_lists.pjsip.org
> >>>
> >>>
> >>> _______________________________________________
> >>> Visit our blog: http://blog.pjsip.org
> >>>
> >>> pjsip mailing list
> >>> pjsip at lists.pjsip.org
> >>> http://lists.pjsip.org/mailman/listinfo/pjsip_lists.pjsip.org
> >>>
> >>
> >
> >
>
>
> _______________________________________________
> Visit our blog: http://blog.pjsip.org
>
> pjsip mailing list
> pjsip at lists.pjsip.org
> http://lists.pjsip.org/mailman/listinfo/pjsip_lists.pjsip.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.pjsip.org/pipermail/pjsip_lists.pjsip.org/attachments/20101206/fa84996d/attachment-0001.html>


[Index of Archives]     [Asterisk Users]     [Asterisk App Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Security]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [Linux API]
  Powered by Linux