Cool.
I’ve got a new version pushed up and making a new image right now that has all of the improvements. I’ve also prescaled all of the software encoders to 576p (1024x576) which is just shy of vertical rotation in a 1080p canvas. With a couple of tweaks I think I was able to get it pretty close to stable 60fps (or high 50s at least).
I’m testing out some tweaks to the gstreamer command too that will hopefully speed things up a bit too. Mine is currently:
rtspsrc location=rtsp://pi4cam:8554/hd60 latency=0 is-live=1 drop-on-latency=1 do-retransmission=0 ! rtpjpegdepay ! queue max-size-buffers=4 leaky=downstream ! jpegdec ! video.
There’s a hidden latency of 200 inside the rtspsrc that I can’t seem to get rid of but I don’t so this should get the stream down to ~200ms. Some of the other things are to try and make sure everything goes through as fast as possible.
I have had some success moderately overclocking the Pi4 to 1750MHz (and 1800) and that seems to help it reach high 50’s for a 720p downscale, otherwise I see it in the 40s.