October 25, 2024 – According to a report published by tech media outlet 9to5Mac on October 24th, Apple has integrated the ChatGPT AI chat experience into Siri in the first beta version update of iOS 18.2. This update has unlocked a variety of new capabilities for Siri, one of which allows users to inquire about the content currently displayed on their screens.
With this new feature, Siri can read the content on the screens of iPhones, iPads, or Macs. For instance, when users are watching a video or viewing a photo, they can ask questions such as “Where is this place?”, “Which phone is the main character using in the show?”, or “What building is in that photo?”
In terms of privacy protection, Siri will ask for the user’s permission before capturing a screenshot of the screen and sending it to ChatGPT, ensuring the user’s privacy security.
Additionally, Apple has introduced the Visual Intelligence AI feature in iOS 18.2, which combines Apple Intelligence, ChatGPT, and Google to provide answers. However, there are some differences between devices. For iPhone 16 series users, they can access real-time information about the content in the camera viewfinder by opening the camera controls. On the other hand, iPhone 15 Pro or compatible iPad users need to take a photo and then ask Siri and ChatGPT questions about it.
