ChatGPT will soon be able to see everything happening on your screen

Yesterday in its spring update, OpenAI launched a fully-native Mac app for ChatGPT and also debuted its new flagship model, GPT-4o. There was no shortage of remarkable demos and excitement, especially for Apple users mulling the rumored Apple-OpenAI partnership for iOS 18.

One key thing that caught my interest in the full event video was a forthcoming ChatGPT app feature that was demoed but without any real details shared. What feature? The ability for ChatGPT to see everything happening on your device’s screen.

more…