Sensors and Perception

What Is Depth Estimation? How AI Calculates Distance From Images.

By Rodolfo Garcia Calderoni, CFA ·

On this pageWhat Is Depth Estimation?Key TakeawaysHow Does Depth Estimation Work?What Is Monocular Depth Estimation?Depth Estimation vs. Depth CameraWhy Does Depth Estimation Matter for Robotics?Frequently Asked QuestionsThe Bottom LineSourcesRelated terms

What Is Depth Estimation?

Depth estimation is the process of determining how far objects or surfaces are from a camera or another reference point.

It allows computer vision systems to interpret the three-dimensional structure of a scene rather than relying only on two-dimensional visual information.

For robots, estimating depth is essential for navigating obstacles, locating objects, and planning movements.

For example, a warehouse robot approaching a stack of boxes needs information about their distance to determine whether it can pass safely.

Key Takeaways

  • Depth estimation calculates distances or relative spatial relationships from visual or sensor information.
  • Methods include stereo vision, time-of-flight sensing, structured light, and machine learning.
  • Some depth-estimation methods provide metric distances, while others estimate only relative depth unless additional scale information is available.

How Does Depth Estimation Work?

One common approach uses stereo vision.

Two cameras observe the same scene from slightly different positions.

An object appears at different horizontal locations in the two images.

Software compares corresponding visual features and measures their displacement.

Using the known camera geometry, the system estimates the object's distance.

This process is called triangulation.

Other systems use active sensors that emit light and measure how it returns.

AI models can also learn visual patterns associated with depth.

What Is Monocular Depth Estimation?

Monocular depth estimation uses a single camera image to predict depth.

A model may learn relationships involving perspective, object appearance, and scene structure.

For example, an image showing a person beside a distant building contains visual clues about their relative positions.

A trained model can use such clues to estimate depth.

However, a single image generally does not uniquely determine absolute physical scale without additional information or assumptions.

Some models estimate relative depth, while others are trained to predict metric distances.

Their reliability depends on the training data and operating environment.

Depth Estimation vs. Depth Camera

Depth estimation is the computational task of determining distance.

A depth camera is a device designed to provide depth measurements or estimates.

For example, a stereo depth camera performs depth estimation using images from two sensors.

A conventional RGB camera can also be used with an AI depth-estimation model.

The concepts are related, but one describes a process and the other describes hardware.

Why Does Depth Estimation Matter for Robotics?

Recognizing an object is not enough to manipulate it.

A robot also needs to know where the object is located in physical space.

Depth information helps estimate suitable grasping positions, avoid collisions, and plan movements.

Errors in depth estimation can lead to missed grasps or incorrect navigation decisions.

Frequently Asked Questions

Can AI estimate depth from one photograph?

Yes. Monocular depth-estimation models can predict depth using learned visual information, although absolute scale and accuracy may be uncertain.

Does greater image resolution always improve depth accuracy?

Not necessarily. Accuracy also depends on calibration, sensor geometry, lighting, algorithms, and distance.

The Bottom Line

Depth estimation helps machines convert visual information into an understanding of distance and three-dimensional structure. It is a fundamental capability for robots that must navigate and interact with physical objects.

Sources

  1. Stereolabs — How 3D Perception Works
  2. Stereolabs — Depth Sensing

Black Scarab Weekly

Follow the physical AI economy

Get Black Scarab news, deep research, and practical analysis in one clear Thursday briefing.

Weekly reporting and deep dives. Unsubscribe anytime. See our privacy notice.