Use Lookout To Explore Your Surroundings

Before we dive into all of the features of this app, I would like to let you know that this is an Android only app. With that out of the way, let’s begin!

When I started using this app, I thought at first that this was just another object recognition and text scanning app. I was very surprised to discover that this app instantly began describing what was around me without me needing to take a picture first. When you first open the app, you’re in a kind of exploration mode that allows you to move your Android phone around, and either read text as the camera sees it, or describe what it sees, such as “computer monitor.”

Since this app was first released, Google has added Gemini AI-powered image descriptions, which means the descriptions you get are significantly more detailed and conversational than before. You can even ask follow-up questions about what the camera sees.

Here is an audio described video showing the Lookout app.

Getting started

Step 1: Install Lookout

Download Lookout on Google Play. Lookout requires Android 6.0 or later with at least 2 GB of RAM.

Step 2: Start Lookout

Say “OK Google, start Lookout,” or tap the Lookout app icon.

Lookout automatically starts when you open the app. You’ll hear a start-up tone indicating that Lookout is active.

Lookout modes

Lookout has several modes that you can use while you’re doing different activities:

Explore, for daily tasks, chores, and new places. By default, Lookout starts in Explore mode.

Shopping, for barcodes and currency.

Quick Read, for sorting mail, reading signs and labels.

Images, uses Gemini AI to provide detailed, contextual descriptions. In this mode you can ask follow-up questions about what the camera sees.

Documents, for reading longer text like letters and forms.

Food Labels, for identifying packaged food items.

To choose a mode, go to the Select Mode tab. From the Camera tab, swipe left. If TalkBack is on, use a 2-finger swipe.

Place your camera facing out

Find a comfortable place to put your device. The back of the device should point away from you, so the camera faces outward. You don’t need to frame objects with your camera. Lookout uses a continuous vision system as your device hangs around your neck or sits in your pocket. From whatever position you choose, Lookout watches for objects and automatically speaks them to you.

Pause and resume Lookout

If you’re wearing your device, pause Lookout by holding your hand flat against the camera for 2 seconds until you hear the pause tone. Resume Lookout by knocking twice on the back of your device, near the top.

If you’re holding your device, tap the Stop button to pause or resume. If TalkBack is on, double-tap. You’ll hear the pause tone when Lookout is paused.

Fingerprint sensor controls

To turn on fingerprint controls for Lookout, open your device’s Settings, select Accessibility, then Lookout, turn on Lookout, and accept the permissions.

Once enabled, the fingerprint sensor works for the following:

Swipe the fingerprint sensor left from the Camera view to scroll through modes. To select a mode, knock twice on your device.

Swipe the fingerprint sensor right from the Camera view to scroll through recent results. To hear details, swipe up on the sensor.

Change the detail level

You can change how much information Lookout speaks about each item.

In the Camera tab, select Change Detail Level.

Choose Low, Medium, or High. High is the default.

At the low detail level, Lookout might only read a few words of text. To get the rest, go to the Recents tab.

FAQ

Is Lookout available on iPhone?

No. Lookout is an Android only app. iPhone users can try similar features through the Magnifier app’s Detection Mode or third-party apps like Seeing AI.

What’s the Gemini AI Images mode?

This is a newer mode that uses Google’s Gemini AI to provide richer, more detailed descriptions of what the camera sees. You can also ask follow-up questions about the image, making it more conversational than the other modes.

Does Lookout need an internet connection?

Some features work offline, but the AI-powered image descriptions require an internet connection for best results.

How do I get the latest version?

Download or update Lookout from Google Play.

Conclusion

As I said before, I’ve had a wonderful experience using this app. I find it very intuitive, one example being the controls to start and stop description. Lookout has come a long way since its initial release, and the addition of Gemini AI makes the descriptions significantly more useful. I’m eager to see what Google does with it next.

Qapla!