in the current project im working on is to create a Dashboard based on the selected customer in a seperate Application. But it doesnt have much support regarding API or third party development.
My Goal is to create within an transparent overlay, marking an area which can either be read its content (Text) or a button be inserted for the user to interact.
I found a German Document Management System (DMS) provider online, facing a similar challenge. They need to extract data from a third-party application (ERP system) via parameters and pass it to their software. Below is a video so you can see what I mean.
I would like to use the correct terms of the corresponding subjects. But I can only vaguely describe and share the video which exactly does what I need to implement.
My current approaches:
First Approach: Transparent Background Application, DrawRectange for rough position. (this approach wasnt throguhly planned/thought)
Second Approach: Making a screenshot for text recognition and note the position of marked areas. But you wouldnt be able to interact with the application at the same time.