Android SurfaceTexture updateTexImage takes long time?

I am using Android MediaCodec class to play video on a Surface that uses a SurfaceTexture. Now on some of the devices the call to updateTexImage takes a very long time ~20ms on average? Any idea why that could happen? If I use Android MediaPlayer to play on the same surface the same call take very short time (0-1ms on average). Could it be related to the data size that I am passing to codec?