# Difference between revisions of "Gradients and Directional Derivatives"

Field: Calculus
Image Created By: Golden Software
Website: [1]

This image shows gradient vectors at different points on a contour map. These vectors show the paths of steepest descent at different points on the landscape.

# Basic Description

*Contour Maps and How they Relate the Gradients and Directional Derivatives

Graph and contour map of a function: Click to enlarge

A contour map utilizes the concept of level sets. A level set is the set of all points generated when a function is set equal to a constant. For example, one level set of the function

$z = x^2 -y^2$ is

$3=x^2-y^2$.

Setting a function from two variables to one variable equal to a constant in this way yields a contour curve. These curves are curves with constant z-component. If we use such a function to represent a landscape with the z-axis for altitude, then a contour curve shows constant height.

A contour map is simply a collection of contour curves, each with the given function set equal to a different constant, meaning each curve represents a different constant height. Most importantly, it "squishes down" our three dimensional surface to give a better view of the entire perimeter of a space (a mountain for example)

Now suppose instead of seeking curves of constant height, we wish to find directions along which height changes most rapidly. This can now be done easily because we have projected "flattened down" the surface to the x-y plane in the contour map. Intuitively, we travel perpendicular to contour curves, since even partially traveling along contour curves would involve traveling along a level set. This page's main image shows a number of vectors perpendicular to contours, meaning they represent the most rapid change of height from the point at the tail of the vector. If the image represents mountains, then the vectors are actually pointing in the direction of steepest descent, and are thus the negatives of the gradient vectors, which by definition always point in the direction of steepest ascent.

### Directional Derivatives

====Mathematical Interpretations of Directional Derivatives====

# A More Mathematical Explanation

Note: understanding of this explanation requires: *Some Multivariable Calculus

The gradient is a useful idea for finding the path of steepest descent or ascent. For a scalar [...]

The gradient is a useful idea for finding the path of steepest descent or ascent. For a scalar function f with two input variables, such as a function that gives height in terms of horizontal position, the gradient vector is defined in terms of partial derivatives: $\nabla f(\vec{x}) = (\partial{f}/\partial{x} , \partial{f}/\partial{y})$.

Intuitively, this definition means that if our function has a high rate of change in a certain x-y direction, the gradient vector will have a large component in that direction, as shown in the directional derivative section. Note that the gradient can readily be extended to handle more than two input variables, by simply having the partial derivatives of each subsequent variable in each consecutive component.

Thus in this context the gradient function has an input of position, and an output of vectors. Each vector points in the direction of steepest ascent from the point the vector originates, with the vector's magnitude corresponding to the rate of ascent one would experience if one followed the vector. Traveling along gradient vectors in the opposite direction gives a path of steepest descent, as in this page's main image.

So to change height most rapidly, we travel along gradient vectors, and to remain at the same height, we follow a level set. We can also analyze intermediate cases: given a direction of travel, how will our height change?

### Directional Derivatives

The concept of directional derivative is useful for finding the rate of height change along any path. To do so, we simply take the dot product of the unit vector in the direction of the path with the gradient vector.

Rate of height change along a path $\vec{v}$ is $\nabla f \cdot \frac{\vec{v}}{\mid\vec{v}\mid}$

By nature of the dot project, this rate is maximized when we travel along the gradient, and is minimized to zero when we travel perpendicular to the gradient, along a level set.

For a level set (blue), the magnitude of the directional derivative (black) is shown. It is the component of the gradient (purple) in the direction of the path (red). Note that the directional derivative is in fact a scalar; the length of the black arrow here is equal to the directional derivative.
Directional derivative of a surface, which is the level set of a function from $R^3 \rightarrow R$. Gradient vector is blue, direction of path is purple, and the magnitude of the directional derivative is green. Again, the directional derivative is in fact a scalar, with the length of the green arrow here equal to the directional derivative.

### Examples

Image for Example 1: level set of the field is purple gradient is red, and direction of the path is green
• Example 1: Given the field $f(\vec{x}) = 3x^2 +2yx -yz^3$, the gradient at any point is
$\nabla f(\vec{x}) = (\partial{f}/\partial{x} , \partial{f}/\partial{y}, \partial{f}/\partial{z})$
$= (6x+2y, 2x-z^3, -3yz^2)$

The gradient at the point $(1,2,0)$ is:
$(10, 2, 0)$
The directional derivative from this point in the direction of the vector $(0,1,0)$ is
$(10, 2, 0) \cdot (0, 1, 0) = 0 + 2 + 0 = 2$

Image for Example 2: Level set of the function is purple, gradient is red, and direction of path is green
• Example 2: Given the field $f(\vec{x}) = sin(xy) +xyz + e^{yz}$, the gradient at any point is
$\nabla f(\vec{x}) = (\partial{f}/\partial{x} , \partial{f}/\partial{y}, \partial{f}/\partial{z})$
$= (ycos(xy) +yz, xcos(xy) +xz +ze^{yz}, xy + ye^{yz} )$

The gradient at the point $(0, 1, 5)$ is:
$(1+5,0+0+5e^5,0+e^5) = (6,5e^5,e^5)$
The directional derivative in the direction of the vector $(0, 0, 1)$ is
$(6,5e^5,e^5) \cdot (0,0,1) = e^5$

# Teaching Materials

  [[Description::This image shows gradient vectors at different points on a contour map.  These vectors show the paths of steepest descent at different points on the landscape.|]]