Member-only story
Siri is Finally Getting “Eyes”: How On-Screen Awareness Changes Everything in iOS 26.4.
Within the next few months, we should be seeing the first glimpse of this completely new AI-enabled Siri. Apple’s launch of this completely new version of Siri over a year and a half ago came up against numerous engineering hurdles, but this should soon change.
Siri assistant upgrades in the near future
At WWDC 2024, Apple introduced three main enhancements for Siri with Apple Intelligence:
Personal context: You can converse with Siri because it has the “context of the information on your device,” so “you don’t need to be able to locate it precisely so-and-so on the screen” since it knows what it can see.
On screen awareness: This function allows Siri to see what is on the screen as it relates to the question or task being asked, giving a user less description of the question or task being asked since the screen provides
more information Acting within apps: Instead of having to launch an app every time you want to accomplish a trivial task, you can simply ask Siri to handle the task for you
First, these improvements to Siri were originally set to debut in the iOS 18.4 update. Later, Apple faced some technicalities with the engineering stack…
