Video calling with PJSIP on an iphone

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Rob-

> I am using an iphone 4. I finally resorted to using the H264 decoder in
> ffmeg (there is an iphone port available).
> My test app decodes an H.264 movie while at the same time, encoding a raw
> camera feed. I've just about got things to work - but my FPS for the
> decoding (while encoding is going on) drops to around 7fps....
> While not encoding, its great.

Ya I'm not surprised that encoding took a bite out of available CPU time.  What is the resolution of your camera feed?

-Jeff

> On Mon, Dec 6, 2010 at 12:47 PM, Jeff Brower <jbrower at signalogic.com> wrote:
>
>> Dzmitry-
>>
>> > I said nothing about encoding, only about decoding.
>>
>> Ok.  I think for single-channel H264 decode the ARM core is fine.  My
>> concern is with multiple concurrent decodes, for
>> example video conference, and also encode.  I think this will be too much
>> for the ARM core.  I can't figure out yet
>> how to utilize the media (DSP) core, for example make API calls that
>> offload the ARM.
>>
>> -Jeff
>>
>> > On 06.12.2010, at 8:58, Jeff Brower wrote:
>> >
>> >> Dzmitry-
>> >>
>> >>> Yes, we use x264 ( from http://www.videolan.org/developers/x264.html)
>> >>> for decode h264.
>> >>
>> >> This is using the ARM core?  I would think that using the ARM core
>> instead of the media (DSP) core would overload
>> >> the
>> >> ARM and cut battery life.  Maybe decode is more feasible, but encode is
>> CPU intensive.
>> >>
>> >> -Jeff
>> >>
>> >>> On 04.12.2010, at 16:41, bo shi wrote:
>> >>>
>> >>>> Hi Dima,
>> >>>>  I learned that the iPhone sdk does not publish the H.264 codec API,
>> >>>> so developer can not use hardware decoder to decode raw H.264 stream
>> >>>> directly, how can you do that? You decode video in soft way?
>> >>>>
>> >>>> Thanks in advance!
>> >>>> Bo
>> >>>>
>> >>>>
>> >>>> On Saturday, December 4, 2010, Dzmitry Yablonski <grizlik at gmail.com>
>> wrote:
>> >>>>> Hello Rob
>> >>>>> We have implemented video call with PjSip 1.8.5 on iPhone.
>> >>>>> Best regards, Dima.
>> >>>>>
>> >>>>>
>> >>>>> On 04.12.2010, at 15:26, Rob Wilkes wrote:
>> >>>>> I also noticed that your roadmap says it will initially be for
>> windows. My requirement is for iphone. I guess my
>> >>>>> question is not really a PJSIP question, but rather to developers who
>> may have used PJ to make video work on
>> >>>>> iPhone
>> >>>>> - just wanted to check if it is doable or impossible today due to
>> some iphone restriction :)
>> >>>>>
>> >>>>> On Sat, Dec 4, 2010 at 8:42 AM, Rob Wilkes <wilkrob at gmail.com>
>> wrote:
>> >>>>>
>> >>>>> Hi Benny, Yes, I know PJSIP also plans to support it - but for this
>> project, I cannot wait for that update, so I
>> >>>>> plan to do it myself. Since you may be ahead of me, I was curious if
>> there are any restrictions in the iPhone
>> >>>>> APIs
>> >>>>> itself that will inhibit PJSIP (or any other stack) to not work with
>> video. For example, it looks like I cannot
>> >>>>> use
>> >>>>> the Movie Player class as it expects a URL.For  this to work, we will
>> need frame/frame encode/decode and display
>> >>>>> support on the iPhone.
>> >>>>>
>> >>>>>
>> >>>>> thanks!
>> >>>>>
>> >>>>> On Fri, Dec 3, 2010 at 10:12 PM, Benny Prijono <bennylp at teluu.com>
>> wrote:
>> >>>>>
>> >>>>> Hi, FYI we are also working on video and it is planned for the
>> >>>>> upcoming 2.0 release. Have a look at our roadmap in the trac site.
>> >>>>>
>> >>>>> Best regards,
>> >>>>> Benny
>> >>>>>
>> >>>>>
>> >>>>> On Sat, Dec 4, 2010 at 3:51 AM, Rob Wilkes <wilkrob at gmail.com>
>> wrote:
>> >>>>>> Hi, I have started on an activity to get a basic Video call working
>> on
>> >>>>>> iPhone. It needs be be over RTP, preferably with H.264 codec. Has
>> anyone
>> >>>>>> written a video client with PJSIP specifically for the iphone? Are
>> there any
>> >>>>>> road blocks? ( I know PJSIP doesnt support video for now, but I plan
>> to
>> >>>>>> extend it - my question is more in the iPhone side). Prelim.
>> analysis shows
>> >>>>>> I can pass H.264 streams to the iphone media player framework and it
>> can
>> >>>>>> instantiate the appropriate player. My approximate plan is to send
>> audio +
>> >>>>>> video data using PJSIP, then extend PJSIP to support video decoding
>> and pass
>> >>>>>> the decoded H264 buffer to the media framework of iphone.




[Index of Archives]     [Asterisk Users]     [Asterisk App Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Security]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [Linux API]
  Powered by Linux