Skip to content
Thoughtful, detailed coverage of everything Apple for 33 years
and the TidBITS Content Network for Apple professionals
7 comments

Digitize Any Text with Live Text in iOS 15 and iPadOS 15

One of the coolest features in iOS 15 and iPadOS 15 is Live Text. Once you’re running these operating systems, the Camera, Photos, Notes, and Safari apps—and undoubtedly more soon—can recognize text in photos and let you select it just as you would any other text. You can then copy it and paste it into any other app. The system-wide search finds text in photos, too. (And if you can’t upgrade or haven’t yet upgraded to iOS 15 or iPadOS 15, or want similar capabilities on the Mac before macOS 12 Monterey ships, see “Work with Text in Images with TextSniper and Photos Search,” 23 August 2021. Even after Live Text is available everywhere, I suspect the developers of these and similar utilities will look for ways of going beyond what Apple provides.)

Live Text is immediately useful. Whenever I need a spare part for some appliance, I take a picture of the sticker inside it to figure out its model number. I can now directly copy the model number and paste it into a search engine without manually transcribing it. Took a photo of a business card but can’t find it? You can search for it. Read a passage in a book that you’d like to research? Take a picture and then paste the text into Notes to refer to later.

Live Text grabbing a model number

Our own Michael Cohen figured out a clever use for this feature. If you’re reading something in Libby or another app that doesn’t let you copy text, you can take a screenshot and then copy the text from a screenshot.

To use Live Text, you need an iPhone or iPad with an A12 Bionic processor or better. That means you need:

  • iPhone XR, XS, XS Max, and later, including the iPhone SE (2nd generation)
  • iPad Pro 12.9-inch (3rd generation) and later
  • iPad Pro 11-inch
  • iPad Air (3rd generation) and later
  • iPad (8th generation)
  • iPad mini (5th generation)

See “The Real System Requirements for Apple’s 2021 Operating Systems” (11 June 2021) for more specifics on iOS 15 and iPadOS 15’s requirements.

Most Live Text use happens in the Photos and Camera apps, Safari, and within the system-wide search. You can also use Live Text with the device’s camera to import real-world text directly into any app that accepts text input. Here’s how to use each. See my book, Take Control of iOS 15 and iPadOS 15, for more tips on new features in those operating systems.

Live Text in Photos

You select text in a photo like any other text: touch and hold the text until it highlights in blue. Then you can move the blue drag handles to adjust the selection. After you select text, the familiar popover appears with options to copy text, select all text, or look up a term.

If you’re having trouble, tap the Detect Text button in the lower-right corner of the photo, which darkens the image apart from the detected text, which is highlighted.

Detect Text in Photos

Detect Text usually works pretty well, but if the text is angled, odd things can happen, like being forced to select text you’re trying to exclude or preventing you from adjusting the text selection.

Awkward text selection in Photos
I can’t select a single line from this song without selecting text from the other two lines.

You may wonder how Live Text interacts with Live Photos that contain text since you touch and hold to animate a Live Photo, and you also touch and hold to select text. The trick is to touch and hold somewhere away from text to animate the Live Photo.

Live Text in Camera

If you don’t want to clutter up your camera roll, you can copy text directly in the Camera app. Aim your viewfinder over the text. A yellow outline appears around any text the Camera app detects.

Text detection in Camera

Tap the Detect Text button to zoom in on the text, which is frozen so you can easily copy it.

Zoomed text in Photos

I find this more awkward than snapping a photo and copying text later, so I don’t use it often.

Search for Live Text

iOS 15 and iPadOS 15 index all of the text they recognize in photos so you can search for it. Bizarrely, you can’t search for Live Text in the Photos app. Instead, you have to swipe down from the middle of the Home screen to activate the system-wide search (Apple doesn’t call it Spotlight in iOS and iPadOS anymore). Scroll down to the Text Found in Photos heading.

Searching for text in Photos
Searching for “model” reveals every appliance sticker I’ve taken a picture of, and although it finds some other photos too, it narrows the results considerably.

Live Text in Safari (And Other Web Browsers)

Just as in Photos, you can touch and hold an image in Safari to select text. As you might expect, given Apple’s requirement that all Web browsers rely on WebKit in iOS and iPadOS, it also works in Brave and Firefox and likely in other browsers, too.

Selecting text in an image in Safari

Also, as in Photos, if you need to touch and hold an image to invoke another action (like seeing a preview of the page the image links to), touch and hold away from any text.

Import Live Text Directly into Apps

It may take some time before we become accustomed to this capability, but you can use Live Text with the device’s camera to import real-world text directly into any app that accepts text input. Tap in a text field to reveal the popover and tap the Scan Text icon.

Scan Text in the text popover

A viewfinder appears on the bottom half of the screen, with a yellow outline around the text. Detected text floods into the text field, but only as a preview. If it’s what you want, tap the “insert” button. (We have no idea why its name is lowercase.)

Scanning text

As you can see, text input via Live Text works pretty darn well, even if using it may take some getting used to.

VoiceOver for Live Text

Live Text is also a great feature for accessibility because it enables VoiceOver to read the text in images. Go to Settings > Accessibility > VoiceOver > VoiceOver Recognition and turn on Text Recognition to enable it.

When viewing a photo with text while VoiceOver is enabled, tap the text in the photo to have VoiceOver read it to you.

Translating Live Text

One last tip. The Translate app is now a system service, so you can translate any text you select, including text in photos or picked up by the camera. It’s one of the options in the popover that appears when you select text.

Translating Live Text

What are your favorite uses for Live Text so far? Let us know in the comments!

Subscribe today so you don’t miss any TidBITS articles!

Every week you’ll get tech tips, in-depth reviews, and insightful news analysis for discerning Apple users. For over 33 years, we’ve published professional, member-supported tech journalism that makes you smarter.

Registration confirmation will be emailed to you.

This site is protected by reCAPTCHA. The Google Privacy Policy and Terms of Service apply.

Comments About Digitize Any Text with Live Text in iOS 15 and iPadOS 15

Notable Replies

  1. I haven’t used Live Text yet but I will be using this great tool plenty. One thing I would also like to see is the option to retain columns, and perhaps other formatting.

  2. I’ve already found the feature useful and was disappointed that my 6th generation iPad didn’t support it. On the other hand, I can pick up my new iPhone and use the camera on the iPad screen, so there’s that :face_with_monocle:

  3. Live Text doesn’t work on my iPhone 8, so I will have to resort to TextSniper and Photos Search for now. How do they compare to Live Text?

  4. I already stumbled upon this just the other day, quite by accident. Most useful especially since my brother just sent me the photo of a business card of a company — which will be replacing the HVAC at my very elderly parents’ house. Whew!

  5. PS This is hilarious, I just tried it on a letter that… Marie Antoinette had written to her “dear Swedish Count” https://www.nytimes.com/2021/10/01/science/marie-antoinette-letters.html, and the speech, though in perfect French, doesn’t quite get the words right from her calligraphy!

    Thus instead of “confiance” (confidence), the Frenchman says “confinée” (confined), which is utterly appropriate — because she was under house arrest when she wrote this particular letter!

  6. Reading about Live Text in Camera made me wonder if you could do the same in the Magnifier app. You can’t, you have to save a captured image to the roll.

  7. I haven’t upgraded to iOS 15 yet due to slow DSL internet here at home. If you scan a document and save it as a PDF does it embed the text?

Join the discussion in the TidBITS Discourse forum

Participants

Avatar for jcenters Avatar for mac Avatar for cwilcox Avatar for peter6 Avatar for fredbrock Avatar for eccparis Avatar for Gary_J