iOS 11 Gets Smarter in Small Ways
If you were hoping for massive changes to iOS, such as a redesigned Home screen, iOS 11 will disappoint you, at least on the iPhone. While the iPad will receive many terrific (and much-needed) big-screen features (see “iPad Pro Gets More Professional,” 5 June 2017), the rest of iOS 11 focuses on UI refinement, artificial intelligence, and developer capabilities. Regardless, some big changes are coming when iOS 11 is released this fall.
Control Center and Lock Screen — Whenever you install iOS 11, the first big thing you’ll likely notice immediately is the new Control Center, which had ballooned to up to three pages in iOS 10. For iOS 11, Apple has compressed it back down to one page, in a grid that takes up more of the screen.
Despite being squeezed into a single page, Control Center will offer more options than before. You’ll be able to 3D Touch a Control Center “platter,” as Apple called them, or presumably long-press it on devices that don’t support 3D Touch, to pop open a panel with more options.
The other big front-facing change is that Notification Center is going away in iOS 11. Instead, you’ll be able to scroll through all of your notifications on the Lock screen. It wasn’t quite clear how you’d be able to see your older notifications without locking the device.
Messages — In iOS 11, Apple is finally fixing Messages with Messages in iCloud. Your messages will be synced across devices via iCloud, so you won’t have unsynced or jumbled messages. If you delete a message on one device, it disappears on all devices. Also, your older messages will be stored in iCloud so they won’t hog precious storage space on your devices. Of course, your messages will still be end-to-end encrypted to ensure your privacy.
Apple is also redesigning the Message app drawer for iOS 11. The company introduced Message apps in iOS 10, but they’ve been underwhelming so far. A better-designed app drawer may make these mini-apps more accessible. That will also be key for a new feature coming to Apple Pay…
Apple Pay — Apple is becoming a financial services company of sorts, since Apple Pay will support person-to-person payments in iOS 11. To store the money you receive, you’ll have an Apple Cash Card in Wallet, and you can transfer money from it to your bank.
Apple was a bit skimpy on details, but it seems that the primary way of making person-to-person transactions will be with a Message app that can send money via iMessage.
Siri — Siri will receive some major enhancements in iOS 11. In addition to new, more natural voices and a new look, Siri will now sync the data it knows about you between devices to better help personalize your queries.
Siri is also getting smarter. Thanks to what Apple calls Siri Intelligence, Siri will better understand your interests and the contexts in which you are speaking. For instance, if you search for Iceland in Safari, Apple News will recommend articles about Iceland, and the keyboard will intelligently suggest related terms.
Apple has spread this intelligence throughout iOS 11. For instance, Calendar can now extract events from Safari. This is one of those features that’s difficult to demo or describe, so we’re anxious to get our hands on it to see how it works in reality.
Unhappy with the results Siri usually gives you? In iOS 11, Siri will offer alternative answers that you can choose by tapping the screen. Presumably, Apple will use this to tailor its recommendations.
Perhaps the coolest new feature coming to Siri is translation. You’ll be able to say something like “How do you say what the most popular dishes in your restaurant in Chinese,” and Siri will speak what you said in Chinese. Apple emphasized that this is a beta feature, so we don’t quite have the Babel fish from “Hitchhiker’s Guide to the Galaxy” yet.
Finally, the SiriKit API for developers is gaining some new features, such as photo search, car controls, task management, and banking. That should mean that we’ll be able to use Siri to control many more apps than in iOS 10.
App Store — Apple is totally revamping the App Store in iOS 11. The old top charts seem to be gone. Instead, there are tabs for daily featured apps, games, and apps.
Apple seems to be moving toward curating the App Store more. Apps featured in the Today tab will include short articles and how-to videos. Likewise, the other new tabs will feature highlighted apps every day. The idea seems to be to get users to check in with the App Store every day to see what’s new. That may be great for developers, but we’re horrified that Apple seems to think you should waste vast amounts of time browsing the App Store for new apps daily.
Developers will appreciate the App Store’s new “phased releases,” which roll out a new or updated app slowly instead of all at once. That’ll be especially welcome for developers whose apps require a lot of server resources.
Camera — Have you noticed that the file sizes for photos are growing with each new iPhone model? Apple is tackling that with two new technologies: HEVC H.265 video compression and a new image format called HEIF. Apple claims that HEVC compression can cut the size of videos by half. HEIF, or High Efficiency Image File Format, is a new file format standard that will replace JPEG for iOS photos. Apple claims that images in HEIF will be easy to share with others, but we’re waiting to see how well that pans out.
Portrait Mode for the iPhone 7 Plus is also getting some much-needed enhancements: improved image quality, better low-light performance, and optical image stabilization.
Photos — The Memories feature that Apple introduced in iOS 10 is getting smarter and better able to identify different objects and people, but the change you’re most likely to notice is that Memories in iOS 11 will be able to switch from landscape to portrait orientation.
But the most impressive new stuff coming to Photos in iOS 11 is all the things you’ll be able to do with Live Photos. You’ll be able to trim and edit Live Photos, pick a different key photo, and create loops. You’ll even be able to reverse the directions of loops if you want a bounce effect. But perhaps the coolest new feature with Live Photos is being able to combine all the frames together to form a long exposure shot.
Maps — As always, Apple’s Maps is playing catchup. Maps in iOS 11 will inform you of speed limits and offer lane guidance — standard features on most standalone GPS units.
However, more interesting is that Maps will begin offering indoor maps of large places like malls and airports. Support will be limited to a small number of major cities at first, but that will hopefully grow over time.
CarPlay for the Rest of Us — Even Apple admits that CarPlay hasn’t been widely adopted, so that’s why the most interesting new automotive feature will be available to all iOS 11 devices: Do Not Disturb While Driving. When your iPhone detects, either via Bluetooth or the Wi-Fi Doppler effect, that you are in a car, it will shut off notifications to your phone. You’ll be able to set an auto-reply text message in case anyone messages you, which the sender can break through by stating that the message is urgent. You can also turn off Do Not Disturb While Driving if you’re riding in a car instead of driving. We strongly hope this feature will help cut down on the
number of accidents caused by texting and inappropriate iPhone use while driving.
HomeKit — Apple’s home automation platform will gain some more capabilities, but the key thing Apple wanted to discuss is the new AirPlay 2 protocol and its integration with HomeKit. If you have multiple AirPlay 2 enhanced speakers, you’ll be able to use the Home app to broadcast music throughout your house. A number of manufacturers have signed on to produce AirPlay 2-compatible speakers, and we presume Apple’s own HomePod will do so as well. Apple TVs running tvOS will also be able to act as AirPlay 2 receivers.
I hope this musical HomeKit integration will let me do things like play a song in response to an event or even sync my lights to music.
Apple Music — Remember Ping? Or Apple Music Connect? Well, Apple just won’t give up on the dream of a social music experience, so Apple Music in iOS 11 will let you see what your friends are listening to. We hope you can turn that feature off; there’s a reason each of Apple’s previous attempts in this area has failed.
Apple is also offering developers an API for Apple Music, so developers of apps like Shazam can tie into Apple Music. It will be interesting to see what developers do with that.
Behind the Curtain — WWDC being a developer conference, Apple announced some new technologies that could lead to new, exciting apps. The two most interesting ones for end users are Core ML and ARKit.
Core ML is a developer framework to make machine learning readily available to developers. Developers can use it to handle things like face detection and tracking, text detection, object tracking, palm rejection, and barcode scanning. Apple claims that with Core ML, iOS image recognition will be six times faster than with Google’s Pixel phone.
ARKit is a framework to help develop apps using augmented reality, which mixes the real and virtual worlds. The example most people are probably familiar with is Pokémon Go, which lets players capture and battle with pocket monsters around the world (see “What the Heck Is Pokémon Go?,” 17 July 2016). Apple even demonstrated how ARKit will make Pokémon Go better by showing that a thrown pokéball will bounce around on a real-life sidewalk.
Apple senior vice president Craig Federighi also showed how an ARKit app lets him place virtual objects on a table.
And Alasdair Coull, head of director Peter Jackson’s Wingnut AR studio, showed off an entire battle overlaid over the auditorium.
AR is an interesting technology, but it has yet to find a killer app. Pokémon Go seemed to be the app, but its luster has quickly faded. However, if Apple ever did develop a car, AR could be an essential technology.
Where is iOS Going? — iOS 11 has no marquee feature, but that’s not really a problem. As with many recent iOS releases, iOS 11 instead provides a series of refinements, many of which should improve the user experience in real ways. We’ll be poring over the beta releases in the next few months to find and share the most useful of these changes.
If there is one central thread, it’s that of artificial intelligence, as Siri becomes more robust and better integrated throughout iOS and independent apps. It’s clear that, for Apple, this is a year to establish the building blocks necessary for whatever comes next in technology.
DND in car: It's not easy to confirm someone's a driver in a car. You could just as easily be on public transit, air (as long as devices can be on), or even riding in a skyscraper elevator, besides just being a passenger in a car. People will learn to keep DND off.
Drivers already have the choice to not respond to texts or calls and check them later. Making it another toggle for DND is no different than silencing the device and putting it away.
If it's acceptable for a driver to have messages read aloud by a passenger, or to talk to another person in the car, then it's no appreciable difference to engage in the same activity via carplay or Siri by handsfree device or BT connection. Often enroute messages or calls are received about changes in plans, updates to arrival ETAs, and the like.
What IOS devices might do is record video of what's happening in the car at the time of communication, and either interpret that activity (and limit it) or save +/or cloud upload for forensic analysis.
The simple fact is that too many people use their iPhones when driving now, despite the fact that there are plenty of ways of NOT using them. So I think it's a very good move on Apple's part to build in an optional technology that could prevent much of this use.
We'll see how good it is about detecting actual car use, but connecting to a Bluetooth car system or moving horizontally at car-like speeds should be possible to detect with decent accuracy.
And Apple was very clear about how there's an override for passengers, plus a way for people to break through the cone of silence for urgent messages. So I think it's an entirely positive feature, at least based on what we know now.
I agree it is positive, but agree with the original commenter's basic gist...I just don't know how positive it will really be since it is optional and can likely easily be bypassed. After all, there is a very simple and elegant solution now for the issue of things like reading texts/using your phone in the car now...it is call DO NOT DO IT. But, since the "DO NOT DO IT" option is optional and easily bypassed, most people do not employ it. So, Apple's approach might help some, but it still is optional and likely can be easily bypassed (due to the dilemma of the "need" to still allow passengers to use their phones), so it is entirely proper to wonder how effective it really will be.
Do not get me wrong, I think it is a good thing to have. I just don't know how much it will really help. But, then any improvement is better than none. So, even if just one person enables that feature that actively used their phone while driving before, then it is worth it.
The new feature that stuck me as "killer" from the perspective of iOS productivity is the file manager. I hope that it will provide expanded options to solve the "Where can I put this?" or "Where did it go?" questions.
I think the Maps improvements are awesome. Speed limits and lane guidance are two of the three remaining features I preferred about my expensive GPS app (offline maps being the third). But since I so much prefer Maps' graphics and its audio directions to my GPS app, I've been anxious to switch to Maps for driving full time. Looks like it will finally happen with iOS 11. :)
Any idea about other Maps improvements? Trails in national parks for example still seem to be much better represented in Google Maps? Any news if Apple is also improving walking/transit instead of just focusing on roads and driving?
I would imagine other improvements are happening continuously at the back end.
Finally, while I understand where Apple is coming from by disabling old 32 bit apps, it does mean I will lose my beloved encrypted notes storage app Firebox.
Can anybody make good suggestions for a secure encrypted notes app? I know Notes offers encryption, but my understanding is these encrypted notes get sync'ed over iCloud and I'd prefer using a totally local encrypted storage on a single device of my own (even if that means no cross-device syncing). I don't trust loading my most secret information up to iCloud - encrypted or not. Especially not these days - FBI, Patriot Act, circumventing privacy rights, etc. (I back up to my Mac too, not iCloud).
You can store notes in Notes locally.
That's true. But can I mix locally stored notes and iCloud-synced notes? For simple stuff like grocery lists I don't mind syncing to my other devices over iCloud. In fact, I use it a lot. In my notes list, I only see one available iCloud account.
Yes. The "folder" of notes can be on iCloud or on your device. You can't mix messages within a folder, but entire folders are what they are. Also, moving notes between categories with different storage settings have been difficult historically.
Try making a new folder and it should ask whether you want it to iCloud sync.
Now I see. Thanks!
I had to activate the "on my phone" account first in settings. Then I can create notes only on the iPhone. I suspect I can then create an encrypted note on that account to keep it local to the device.
If you store locally, is there any way to get them out as Notes files (packages?), and move them to Notes on a different device?
I really like what I'm hearing so far about iOS 11. Refine things, but don't add to the feature bloat. Focus on adding iPad features that specifically leverage those devices' larger size and their use while improving already sufficient functionality on the iPhone side. This sounds like Snow Leopard for iOS and I really like that.
I read elsewhere about the option to use Siri 'silently', i.e. by typing/reading. I would appreciate that a lot as I currently don't want to use (loud) Siri. Can anybody confirm?
I enjoyed reading about improvements to Photos too. Any idea if users will get some kind of control over what 'special' albums get displayed? I'm not interested in groupings such as People, Selfies, Screenshots, etc. But iOS 10 offers no way to hide these. Any changes with iOS 11?
Yes, it appears that you can type to Siri in iOS 11. I'm super excited about that! Not sure about the albums yet.
Thanks, Josh. If you type to Siri, will she also reply silently, i.e. with text on the screen?
The feature is designed as an accessibility feature for people with low or no hearing, so I would assume that the feature supports fully silent use.
Great. Thanks, Robert.
Any idea what kind of iPhone/iPad hardware will be required for HEVC/H.265 hardware encoding support?
VLC on iOS can obviously do more formats than those built in to iOS, but you really notice the battery life take a hit when things aren't hardware accelerated.
Edit: I just noticed Apple had originally advertised using HEVC on iPhone 6 for FaceTime. Does that indicate an iPhone 6 should be able to do hardware decoding of HEVC material under iOS 11?
Upgrading or not? This is going to become a dilemma! There are more downsides than andvatages for me it seems (there are quite a few 32-bit apps that I use on a daily basis). What is Apple's policy regarding security updates for older iOSs?
With iOS, Apple hasn't provided security updates for older versions at all, as far as I can remember. So you'll want to upgrade at some point for security reasons.
I want to say that Apple has provided an update (don't recall if it is was a security update or bug update or both) to an older version once or twice after a new iOS version came out, but it was typically only for older devices that could NOT run the new iOS version. I remember this frustrating me on a device that I had not upgraded to the new iOS version yet (I typically wait a bit so that Apple can beta test on other people), but there was an update to the older iOS version that I could not get as the new iOS update was the only thing offered.
Has there been any indication so far that iOS 11 might allow prioritization for wifi networks like macOS does?
I have a iPhone 6S and am wondering if I'll be able to enjoy all the bells and whistles of iOS 11 and, if not, which features will be compromised by the 6S' hardware. It would be really nice if an article on iOS 11 could be published outlining which features function without compromise, which features are compromised, and which features are non functional. This would also be useful in deciding when to upgrade hardware.
iOS 11 will run on the iPhone 6s, but it's too early to know if there will be any real-world slowdowns. That can't be determined until we're fairly close to release.