How can we do "segmentation" on a UI to find buttons or clickable areas ?
The traditional sliding window is great to find if the picture contains an item of interest.
How do we do this for pixel accurate detection of a button ? We use a sliding sliding window that only says "true" if the pixel at the center of the picture is "clickable" ?
Is this done with several levels of zoom, to first find large areas that contains clickable parts, then with smaller sliding windows in the clickable areas to find smaller areas and ultimately pixel accurate classification ?
[link][4 comments]