Field: Calculus
Image Created By: Golden Software
Website: [1]

This image shows gradient vectors at different points on a contour map. These vectors show the paths of steepest descent at different points on the landscape.

# Basic Description

Graph and contour map of a function: Click to enlarge

A contour map utilizes the concept of level sets. A level set is the set of all points generated when a function is made equal to a constant. For example, one level set of the function $z = x^2 -y^2$ is $3=x^2-y^2$. Setting a function from 2 variables to one variable equal to a constant in this way yields a contour curve. These curves are curves with constant z-component. If we use such a function to represent a landscape with the z-axis for altitude, then a contour curve shows constant height.

A contour map is simply a collection of contour curves, each with the given function set equal to a different constant, meaning each curve represents a different constant height.

Now suppose instead of seeking curves of constant height, we wish to find directions along which height changes most rapidly. Intuitively, we travel perpendicular to contour curves, since even partially traveling along contour curves would involve traveling along a level set. This page's main image shows a number of vectors perpendicular to contours, meaning they represent the most rapid change of height from the point at the tail of the vector. (If the image represents mountains, then the vectors are actually pointing in the direction of steepest descent, and are thus the negatives of the gradient vectors, which by definition always point in the direction of steepest ascent.)

# A More Mathematical Explanation

The gradient is a useful idea for finding the path of steepest descent or ascent. For a scalar [...]

The gradient is a useful idea for finding the path of steepest descent or ascent. For a scalar function f with three input variables, the gradient vector is defined as $\nabla f = (\partial{f}/\partial{x} , \partial{f}/\partial{y} ,\partial{f}/\partial{z})$. Intuitively, this definition means that if our function has a high rate of change in a certain direction, the gradient vector will have a large component in that direction, as shown in the directional derivative section.

The gradient thus has a domain of scalar functions, such as a function for height in terms of horizontal position, and a codomain of vectors. Each vector points in the direction of steepest ascent from the point the vector originates, with the vector's magnitude corresponding to the rate of ascent one would experience if one followed the vector. Traveling along gradient vectors in the opposite direction gives a path of steepest descent, as in this page's main image.

So to change height most rapidly, we travel along gradient vectors, and to remain at the same height, we follow a level set. We can also analyze intermediate cases: given a direction of travel, how will our height change?

### Directional Derivatives

The concept of directional derivative is useful for finding the rate of height change along any path. To do so, we simply take the dot product of the unit vector in the direction of the path with the gradient vector.

Rate of height change along a path $\vec{v}$ is $\nabla f \cdot \frac{\vec{v}}{\mid\vec{v}\mid}$

By nature of the dot project, this rate is maximized when we travel along the gradient, and is minimized to zero when we travel perpendicular to the gradient, along a level set.

For a level set (blue), the magnitude of the directional derivative (black) is shown. It is the component of the gradient (purple) in the direction of the path (red). Note that the directional derivative is in fact a scalar; the length of the black arrow here is equal to the directional derivative.
Directional derivative of a surface, which is the level set of a four-dimensional function. Gradient vector is blue, direction of path is purple, and the magnitude of the directional derivative is green. Again, the directional derivative is in fact a scalar, with the length of the green arrow here equal to the directional derivative.

# Teaching Materials

  [[Description::This image shows gradient vectors at different points on a contour map.  These vectors show the paths of steepest descent at different points on the landscape.|]]