Screen touch detection and pixel coordinate upload via Mavlink

Hello everyone!

I am making a project with Herelink and Jetson Nano. I would like to capture the screen touch coordinates on the Herelink controller and send them via Mavlink to the drone and the Jetson.

The project is to make a YOLO-type recognition, tracking and physical following, using the bounding boxes of people visible on the video stream for tracking on video and following with the drone. I could make an overlay on the controller, but then the touches wouldn’t register on the original control surface, only the overlay. As I have read, Herelink doesn’t allow rooting or admin users, so I have a problem of transferring the touch effect to the normal screen (Qgroundcontrol). Is there a workaround for this? I am not really into Android programming, the Jetson python coding is more than enough for me to fight with… I would be extremely grateful if anyone knows a solution for this problem!