FR: Update camera APIs in the MLKit samples and improve performance

[samtstern]

This bug is meant to track all of the other bugs about making the MLKit camera samples perform better, so that it can be discussed in one place.

[samtstern]

Camera preview FPS very low: firebase/quickstart-android#841

[samtstern]

OutOfMemoryError in ML Kit samples: firebase/quickstart-android#775

[samtstern]

Low camera preview quality: firebase/quickstart-android#832

[samtstern]

Update sample to Camera2 API: firebase/quickstart-android#677

[samtstern]

Image processing is super battery hungry: firebase/quickstart-android#703

[nhattv18]

Camera preview FPS very low: firebase/quickstart-android#841

Hi samtstern,
We will discuss the issue here?

[samtstern]

@nhattv18 yep! A lot of these issues are basically the same, we need to re-write most of the camera code in these samples to improve performance and use a more modern API.

[dev-gloomyfox]

OOM issue caused by convertBitmapToByteBuffer method.

When this method call, Direct ByteBuffer allocate every time. When this ByteBuffer moved local variable, oom is not occurs.

[MrGilberts]

Where the normal people could see the progress. I was working in a solution but, it only works good in galaxy s9. the galaxy s7 its too slow , And i would like to see the progress.

[samtstern]

Our plan is to move directly from Camera1 to the new camerax library as soon as it gets out of alpha and into a beta (or higher) release. This should improve the sample and hopefully remove a lot of code.

[bembem1011]

When does your team finish upgrading to cameraX to improve performance ? @samtstern

[samtstern]

We're working on it but the APIs for CameraX are still in alpha so we need some more stability (and feature completeness) before we can release it.

…

On Tue, Jul 16, 2019 at 10:01 PM bembem1011 ***@***.***> wrote: When does your team finish upgrading to cameraX to improve performance ? @samtstern <https://github.com/samtstern> — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <https://github.com/firebase/quickstart-android/issues/842?email_source=notifications&email_token=ACATB2V32ZP45PJCICSCNHTP72RTTA5CNFSM4HAG4Y42YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD2DBCYI#issuecomment-512102753>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ACATB2SNBJJVJFDQGK6WMOTP72RTTANCNFSM4HAG4Y4Q> .

[KaidoNinja]

Would really love to see this example with CameraX, any progress?

[aantelov87]

any progress?

[KaidoNinja]

CameraX is in Beta, so it's time to upgrade. :)
https://developer.android.com/jetpack/androidx/releases/camera

[Anasmirza20]

Could you please let me know how much time it will take to upgrade the project using CameraX API.

[kriefsacha]

Hi, there is update on this ?

[cs-googler]

We made some changes to Firebase ML Kit to better distinguish the on-device APIs from cloud based APIs. "ML Kit"(without firebase branding) contains all the on-device APIs. Here's the migration guide from firebase mlkit to mlkit.

For the standalone MLKit, the sample app demonstrate how cameraX can be used, please refer to this quickstart app