Pose Detection while recording video

Hey everyone,

I’m currently using the camera package along with Google ML Kit Pose Detection in my Flutter app. I’m using the image stream to analyze frames in real-time. The issue I’m facing is that pose detection stops working as soon as I start recording video using the same image stream.

It seems like this limitation is actually programmed into plugin, as not all devices support recording video while analyzing the stream (I think I’ve read somewhere). However, I’ve noticed that if I start a screen recording before launching my app on my Samsung S24, I’m able to capture both the video and the pose detection simultaneously, which indicates the device itself can handle both tasks.

I’m wondering if anyone has found a workaround or alternative solution. Maybe there’s a way to implement screen capture within the app or use another package that supports recording the camera widget while performing pose detection? I’m a bit stuck and would appreciate any advice or insights!

Thanks in advance!

1 Like

hey did u find a solution? i am creating an android and ios app with pose detection api and everything is working normally on ios but on android everytime the recording starts the skeleton from pose detection api just freezes on screen

Unfortunately not. I’m working on other parts of the app at the moment, but I need to revisit this. I changed to Camerwesome that is said to support this, but it doesn’t work on my S24 (which makes me think it wont work on others either.)

I did a small hack on the camera package that actually made it possible to record, so somehow this seems to be something that is stopped by devices with flags that these packages are looking at. When I made the camera skip the check, it just recorded. I don’t remember how I did now, but I had a bunch of other problems too.

I’ll get back on it soon. I’ll keep you posted if I figure anything out!

And out of curiosity, what kind of app are you making :grinning_face:? Mine is a training app.

Hi! :blush:
I am creating an app that enables automatic tracking of joints during selected exercise and then the user receives a score based on functional movement screening test (from 0 to 3). It is a part of my bachelor thesis.

Wow, that sound really interesting! Please report back if you publish your thesis anywhere when you’re done.

1 Like

I will but its in croatian haha!