ChatGPT now has access to the contents of apps on macOS. This new feature is designed to make it easier to get AI's opinion on what other apps are doing without having to take screenshots or copy and paste text.
Since launching the ChatGPT desktop app for macOS in May, OpenAI has gradually improved it, including bringing Advanced Voice to the desktop for the first time.
Initially, this new functionality will only work with developer applications such as Apple's own developer environment Xcode and Microsoft-supported Visual Studio Code. It will also be accessible to Terminal, so all users will soon be power users.
The App Insight feature is only available in ChatGPT Desktop on Mac. It will be accessible to anyone with a paid account, but it will take a few weeks for corporate and educational users.
A spokesperson for OpenAI told Tom's Guide that for now ChatGPT only looks at what you are doing in the app and makes suggestions, but they are exploring ways to apply those suggestions more seamlessly.
OpenAI stressed that this is an “early beta” and that the focus is on making it easier for developers to work on projects using ChatGPT. However, the company said it plans to add more apps soon, and could integrate with Word and games.
The spokesperson explained that the main use case is to reduce copy-pasting between ChatGPT and other apps. For developers, connecting a device or developer environment to ChatGPT allows them to “reference that app's content and give faster, more contextual answers to questions.”
This brings ChatGPT closer to providing some of the same functionality that developers and programming novices love from Cursor and similar apps.
In the future, ChatGPT may be expanded to provide live information during Zoom meetings and give gameplay tips for Civilization 7, which will be released on the Mac on the first day of release.
According to OpenAI, users will always know what ChatGPT is looking at, a feature that cannot be changed in the app in any way and must be explicitly enabled. The feature also needs to be explicitly enabled. How well the feature works with the app will be improved soon.
ChatGPT Desktop for Windows is currently free for all users. Anyone with a free or paid account can use the app on Windows 10 or 11. Previously, it was limited to those paying $20 or more per month for AI fixes.
According to OpenAI, its windows desktop app allows you to “seamlessly integrate ChatGPT into everything you do on your computer. This includes an Alt + Space shortcut that brings up a companion window for mini-windows and quick access.
Windows Desktop includes Advanced Voice, ChatGPT Search, and the ability to share screenshots with ChatGPT.
Comments