Build in camera support

Home / Forums / Marmalade Archive / Marmalade System / Build in camera support
31 replies [Last post]
by: Nu2
Status: Offline
Joined: 2009-11-01
Points: 80

Is it possible to access the built in camera and the photo library on the iphone ?

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Hi, We have a Camera API in

Hi,

We have a Camera API in development but its not yet part of our public SDK.

Using the native iPhone SDK its currently only possible to access pictures from the photo library - you can't get a live framebuffer from the camera device. I think Apple will allow developers to access this framebuffer via new APIs fairly soon.

Its likely that the Camera API will be in the next Airplay release, and it'll work on iPhone when apple release their Camera framebuffer API.

by: Deepankar
Status: Offline
Joined: 2009-12-09
Points: 40
Any updates on the camera API

Any updates on the camera API ?

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Hi Deepankar, Apple aren't

Hi Deepankar,

Apple aren't allowing access to the framebuffer from the camera on the iPhone (even on 3.1) which is a core component of our API. So its unlikely iPhone will support s3eCamera for our next release.

However its likely we'll release the header and support for other platforms (primarily Symbian, BREW and Windows Mobile) in 4.1, Q1 next year.

Regards,

Dave

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
And what is about

And what is about camera-preview over which can draw anything? (for augmented-reality, for example)

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Well the s3eCamera API gives

Well the s3eCamera API gives you access to the raw pixels from the camera device, so you can do what you like with those, including composing a framebuffer consisting of the original pixels and your own 3d stuff.

by: gromtron
Status: Offline
Joined: 2009-12-27
Points: 40
Hello Dave, I'm somewhat

Hello Dave,

I'm somewhat confused about your comment on the iPhone's camera access. There are numerous applications in the App Store, which obviously use the camera (e.g. Red laser and all the Augmented Reality apps). Do they use some hacks not allowed by Apple?

Thanks

by: Salman
Status: Offline
Joined: 2009-12-20
Points: 26720
I think its because the way

I think its because the way you access video in the apple sdk today, and what you can do with it, is really non-standard and incompatible with the way it is traditionally done on any other device or platform. I am guessing airplay is waiting for Apple to release a similar api that allows direct access to the pixels from the camera.

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Hi gromtron, I think some of

Hi gromtron,

I think some of these apps are using hacks - not something we'd necessarily be comfortable with putting into Airplay as we risk all Airplay built apps being rejected from Appstore!

see
http://www.readwriteweb.com/archives/iphone_augmented_reality_hack.php

As far as I know doing realtime analysis of the camera data isn't possible using public APIs. As soon as this isn't the case we'll have a camera API implementation for iPhone.

Dave

by: Nu2
Status: Offline
Joined: 2009-11-01
Points: 80
Hi all, My original question

Hi all,

My original question was not about accessing the camera at low level but rather be able to make a photo or get a photo from the iphone photo library. There are supported sdk calls for this functionality.

Martin.

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Hi Martin, We're considering

Hi Martin,

We're considering allowing access to ImagePicker etc via either extensions or separate APIs. Its unlikely to make it into 4.1 though.

Dave

by: deadlineproof.
Status: Offline
Joined: 2009-12-20
Points: 3600
i'm really interesting in

i'm really interesting in accessing photo library to upload photolibrary photo in textures.

probably more of interest if you can pvr/ati compress bitmap data directly from device.Probably it would be very slow to create a 512x512 compressed texture from a 480x320 image but needed if you want to upload a screensize image to use as a background or as a most used texture.

why jpg is not included as normal image format but trough te use of an external lib?
Cannot you include jpg support as you just support other formats?

by: Mark S
Status: Offline
Joined: 2009-10-23
Points: 81040
Hi deadlineproof, We've

Hi deadlineproof,

We've agreed to support photo library at some point, but we haven't nailed down a schedule yet.

Compressing textures on device is probably not possible, the standard pvrtc compressor implementation uses many megs of ram on win32 and I don't think the atitc one is even available.

However, the iphone is perfectly capable of rendering 512x512 uncompressed textures, it'll just use up a chunk of memory and may cause some texture cache issues if you have a few of them.

We didn't include jpg as a standard iwimage format because libjpeg adds a fair bit of size to the build. This decision may be looking a bit out of date now (it was taken back when a typical install target was around 1mb).

Mark.

by: Matthijs
Status: Offline
Joined: 2010-02-19
Points: 200
Hi, Any news on camera

Hi,

Any news on camera support or support for the image picker API ?

I really need either one for my current project ...

Matthijs

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Hi Matthjs, They're both

Hi Matthjs,

They're both currently scheduled for 4.2, mid-May

Dave

by: Joe_2
Status: Offline
Joined: 2009-12-28
Points: 1840
I am waiting for this too, is

I am waiting for this too, is it included in 4.2?

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
I'm afraid we've scoped these

I'm afraid we've scoped these out of 4.2 to hit our current release date. Rest assured they are a priority to us though for future releases.

by: Kurt Leucht
Status: Offline
Joined: 2010-09-04
Points: 80
I have an app under

I have an app under consideration that needs to capture from the camera or at least pick an image from the camera roll. How soon will airplay support this capability?

by: Tim C
Status: Offline
Joined: 2009-10-26
Points: 6940
It would be nice to think we

It would be nice to think we could make this available in the 4.3 release during October. We can't promise anything though. Sorry not to be more specific.

by: MattSa
Status: Offline
Joined: 2010-08-09
Points: 840
Could you guys include an

Could you guys include an example on the RAW pixels or make a frame buffer for the s3e library? Or link to an example somewhere?

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Hi MattSa, This functionality

Hi MattSa,
This functionality isn't in the SDK yet, so 'not really' is the answer I'm afraid

Dave

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Hi MattSa, This functionality

Hi MattSa,
This functionality isn't in the SDK yet, so 'not really' is the answer I'm afraid

Dave

by: Frédéric Lopez
Status: Offline
Joined: 2010-11-11
Points: 120
The new API of the AV

The new API of the AV Foundation Framework available in iOS 4 does now support media capture and access to camera. It would be nice if you could add this support to Airplay since it's now officially supported by the Apple SDK.

See :
http://developer.apple.com/library/ios/#documentation/AudioVideo/Concept...

by: drupaluser
Status: Offline
Joined: 2011-12-01
Points: 124350
Thanks for pointing this out

Thanks for pointing this out - we do intend to support s3eCamera properly 'at some point'

Dave

by: Beaker_2
Status: Offline
Joined: 2010-12-14
Points: 8390
Sorry to dredge this old

Sorry to dredge this old chestnut up again, but I notice that 4.4 beta 3 still doesn't provide camera support. I have an app in development for which this is a crucial feature. I'm just wondering if s3eCamera is still under active development or whether the intention is that developers take the EDK route and roll their own camera support? Also, is there any form of the s3eCamera API available to pro licensees?

Thanks,
Daragh.

by: Guy
Status: Offline
Joined: 2011-01-24
Points: 7720
Hi Daragh, s3eCamera should

Hi Daragh,

s3eCamera should make it into the upcoming 4.4 major release. It should make it into the 4.4 beta 4 release in a few weeks (we just released 4.4 beta 3). This should include camera capture using the native app, an image picker, and video streaming.

So bear with us :)

by: Beaker_2
Status: Offline
Joined: 2010-12-14
Points: 8390
Thanks Guy - you've made my

Thanks Guy - you've made my day :-)

by: Arbalest57
Status: Offline
Joined: 2010-12-12
Points: 80
Hi guys, any updates on this?

Hi guys, any updates on this? I noticed this is not mentioned in the 4.4 beta 4 changelog. What's the plan for this? Cheers.

by: glebedev
Status: Offline
Joined: 2009-10-29
Points: 14730
Arbalest57, check this

Arbalest57, check this folders for examples:
C:\Airplay SDK\4.4\examples\s3e\s3eCameraBasic\
C:\Airplay SDK\4.4\examples\s3e\s3eCameraCapture\

by: Arbalest57
Status: Offline
Joined: 2010-12-12
Points: 80
Hey awesome! Thanks for the

Hey awesome! Thanks for the info glebedev. Glad to know this is finally coming. Though I have yet to become a pro licensee with support in order to get these changes lol. May I know what's the planned date for the 4.4 major release? Thanks.

by: Garfinkle
Status: Offline
Joined: 2011-01-28
Points: 240
Hi all Do you know if the

Hi all

Do you know if the latest addition of the camera functionality for IOS will restrict the app to IOS 4.x devices or does the s3eCamera make use for pre IOS 4.x API functions?

Thanks

Matt

by: Anz
Status: Offline
Joined: 2011-03-15
Points: 1080
Hi everybody! I'm also VERY

Hi everybody!

I'm also VERY interested in knowing when is the camera stream support coming for the iPhone!
Else, how can one make Augmented Reality Apps ?

Cheers!

Latest Posts

Latest Comments

Top Contributors

  • Chris D : 27,010
  • MonRoyals : 26,970
  • Salman : 26,720
  • Jez Hammond : 20,130
  • pjan : 11,150
  • gjw : 10,350
  • Paolo Oliverio : 9,640
  • Beaker_2 : 8,390
  • Kite : 8,210
  • bluescrn : 7,810