47  Vector differential calculus

Grad, div, curl — the calculus of fields

Hold a weather map. The isotherms — lines of equal temperature — curve across it. At any point, one direction makes the temperature climb fastest; the gradient tells you which direction that is and how steep the climb is. Perpendicular to that direction, the temperature doesn’t change at all.

Now picture a pipe carrying fluid. At some cross-sections the fluid spreads out; at others it converges. Divergence measures the net outflow at each point — positive where fluid is being created (a source), negative where it drains away (a sink). Curl measures something different: whether the fluid rotates. Stick a tiny paddle wheel in the flow; if it spins, the curl is non-zero.

Three operators — gradient, divergence, curl — encode the geometry of how any field varies through space. Every major equation in physics is written in terms of them.

47.1 What this chapter helps you do

Symbols to keep handy

These are the bits of notation you'll see a lot. If a line of symbols feels like a fence, read it out loud once, then keep going.

  • f: grad f

  • ^2 f: del squared f, or the Laplacian of f

  • D_ f: directional derivative of f in the direction u

Definitions to keep handy

These are the words we keep coming back to. If one feels slippery, come back here and steady it before you push on.

  • scalar field: A number at every point in space (temperature, pressure, elevation).

  • vector field: A vector at every point in space (wind velocity, fluid flow).

  • gradient: A vector that points in the direction of steepest increase of a scalar field.

  • divergence: A measure of net outflow: sources are positive, sinks are negative.

  • curl: A measure of local rotation: whether a tiny paddle wheel would spin.

This chapter gives you a vocabulary for how fields change in space. You will learn to:

  • treat a scalar or vector field as “a value at every point”
  • compute and interpret the gradient, divergence, and curl
  • recognise what each operator is measuring (steepest increase, net outflow, local rotation)
  • connect these operators to real map and flow questions (slope/aspect, sources/sinks, circulation)

Watch for this

  • \nabla is an operator. It is not a vector you plug numbers into until you decide what it is acting on.
  • Grad/div/curl are three different questions about the same field. Do not treat them as interchangeable formulas.
  • Interpretation matters: after computing, say what the sign and direction mean physically.

47.2 Vectors: dot and cross products

If vectors feel rusty

This section is a quick tune-up. You do not need to memorise it again. You just need the two operations (dot and cross) to feel familiar enough that the field operators later do not sound like nonsense.

A vector in three dimensions is a triple of numbers, written \mathbf{u} = (u_1, u_2, u_3) or in column form. Its magnitude is |\mathbf{u}| = \sqrt{u_1^2 + u_2^2 + u_3^2}.

Two operations link a pair of vectors to useful scalars and vectors.

47.2.1 The dot product

\mathbf{u} \cdot \mathbf{v} = u_1 v_1 + u_2 v_2 + u_3 v_3

Geometrically: \mathbf{u} \cdot \mathbf{v} = |\mathbf{u}||\mathbf{v}|\cos\theta, where \theta is the angle between them. This means:

  • \mathbf{u} \cdot \mathbf{v} = 0 if and only if \mathbf{u} and \mathbf{v} are perpendicular.
  • \text{proj}_{\mathbf{v}} \mathbf{u} = \dfrac{\mathbf{u} \cdot \mathbf{v}}{|\mathbf{v}|} is the scalar projection of \mathbf{u} onto \mathbf{v} — how much of \mathbf{u} lies in the direction of \mathbf{v}.

Example. \mathbf{u} = (1, 2, 3), \mathbf{v} = (4, 0, -1).

\mathbf{u} \cdot \mathbf{v} = (1)(4) + (2)(0) + (3)(-1) = 4 + 0 - 3 = 1

The angle between them: \cos\theta = \dfrac{1}{\sqrt{14}\,\sqrt{17}} \approx 0.065, so \theta \approx 86° — nearly perpendicular.

47.2.2 The cross product

\mathbf{u} \times \mathbf{v} = \begin{vmatrix} \mathbf{i} & \mathbf{j} & \mathbf{k} \\ u_1 & u_2 & u_3 \\ v_1 & v_2 & v_3 \end{vmatrix} = (u_2 v_3 - u_3 v_2,\; u_3 v_1 - u_1 v_3,\; u_1 v_2 - u_2 v_1)

The result is a vector perpendicular to both \mathbf{u} and \mathbf{v}, with magnitude |\mathbf{u} \times \mathbf{v}| = |\mathbf{u}||\mathbf{v}|\sin\theta — equal to the area of the parallelogram spanned by \mathbf{u} and \mathbf{v}. Direction follows the right-hand rule: curl the fingers of your right hand from \mathbf{u} toward \mathbf{v}; your thumb points in the direction of \mathbf{u} \times \mathbf{v}.

Note that \mathbf{u} \times \mathbf{v} = -\mathbf{v} \times \mathbf{u} — order matters. The cross product is anti-commutative.

Example. \mathbf{u} = (1, 0, 0), \mathbf{v} = (0, 1, 0) (the standard basis vectors \mathbf{i} and \mathbf{j}).

\mathbf{u} \times \mathbf{v} = (0 \cdot 0 - 0 \cdot 1,\; 0 \cdot 0 - 1 \cdot 0,\; 1 \cdot 1 - 0 \cdot 0) = (0, 0, 1) = \mathbf{k}

This is correct: the right-hand rule applied to \mathbf{i} \times \mathbf{j} gives \mathbf{k}, pointing out of the xy-plane.

47.3 Scalar and vector fields

Before we talk about grad, div, and curl, fix one idea: a field is just a function. The only difference is that the input is a point in space.

How to read the field operators

  • Symbol: \nabla

  • Reads as: “nabla” or “del”

  • Means: a vector-derivative operator (you apply it to a field)

  • Use when: forming grad, div, curl, and the Laplacian

  • Common misread: \nabla by itself is not “the gradient”; it becomes grad/div/curl depending on how it is combined and what it acts on

  • Symbol: \nabla f

  • Reads as: “grad f”

  • Means: the direction and rate of steepest increase of the scalar field f

  • Use when: slope/aspect, optimisation, potentials and forces

  • Common misread: \nabla f is a vector field, not a number

  • Symbol: \nabla \cdot \mathbf{F}

  • Reads as: “div F”

  • Means: net outflow per unit volume (sources/sinks) of the vector field

  • Use when: incompressible flow, conservation laws, flux balance

  • Common misread: divergence is a scalar, not a vector

  • Symbol: \nabla \times \mathbf{F}

  • Reads as: “curl F”

  • Means: local rotation tendency of the vector field

  • Use when: vorticity, circulation, electromagnetism

  • Common misread: curl is a vector; a nonzero curl means “paddle-wheel spins”, not “the arrows bend”

  • Symbol: \nabla^2 f

  • Reads as: “del squared f” or “Laplacian of f”

  • Means: divergence of the gradient (a scalar measure of how a field differs from its local average)

  • Use when: diffusion, heat, wave and potential equations

  • Common misread: \nabla^2 is not ordinary squaring

  • Symbol: D_{\mathbf{u}}f

  • Reads as: “directional derivative of f in the direction u”

  • Means: rate of change of f if you move in direction \mathbf{u}

  • Use when: you care about change along a path or a physical direction

  • Common misread: \mathbf{u} should be a unit vector if you want a true rate per unit distance

A scalar field assigns a single number to each point in space: f : \mathbb{R}^3 \to \mathbb{R}. Examples:

  • Temperature T(x,y,z) — one number at each location
  • Pressure p(x,y,z) — one number at each location
  • Voltage V(x,y,z) — one number at each location

A vector field assigns a vector to each point in space: \mathbf{F} : \mathbb{R}^3 \to \mathbb{R}^3. Examples:

  • Wind velocity \mathbf{v}(x,y,z) — a direction and speed at each location
  • Gravitational field \mathbf{g}(x,y,z) — pointing toward the Earth’s centre, weakening with distance
  • Electric field \mathbf{E}(x,y,z) — direction a positive test charge would accelerate

Both are functions. The difference is only in what they return. All of single-variable calculus was about functions f : \mathbb{R} \to \mathbb{R}. Vector differential calculus extends differentiation to these richer domains.

47.4 The gradient

47.4.1 Partial derivatives

Before defining the gradient, we need partial derivatives. Given f(x, y, z), the partial derivative with respect to x is:

\frac{\partial f}{\partial x} = \lim_{h \to 0} \frac{f(x+h, y, z) - f(x, y, z)}{h}

Compute it by differentiating f with respect to x while treating y and z as constants. The partial with respect to y treats x and z as constants, and so on.

Example. f(x, y, z) = x^2 y + yz^3.

\frac{\partial f}{\partial x} = 2xy, \qquad \frac{\partial f}{\partial y} = x^2 + z^3, \qquad \frac{\partial f}{\partial z} = 3yz^2

Each partial derivative measures the rate of change as you move in exactly one coordinate direction while holding the others fixed.

47.4.2 Definition

The gradient of a scalar field f is the vector field formed by collecting all three partial derivatives:

\nabla f = \left(\frac{\partial f}{\partial x},\; \frac{\partial f}{\partial y},\; \frac{\partial f}{\partial z}\right)

The symbol \nabla (nabla) is the del operator — an instruction to differentiate. Applied to a scalar, it produces a vector.

47.4.3 Geometric meaning

The gradient \nabla f at any point:

  1. Points in the direction of steepest increase of f.
  2. Is perpendicular to the level surface f = c passing through that point.
  3. Has magnitude |\nabla f| equal to the rate of change of f in that steepest direction.

Think of contour lines on a topographic map. The gradient at any point is an arrow pointing directly uphill — perpendicular to the contour through that point, and longer where the slope is steeper.

Example. f(x, y, z) = x^2 + y^2 + z^2 (the squared distance from the origin).

\nabla f = (2x,\; 2y,\; 2z) = 2(x, y, z) = 2\mathbf{r}

The gradient points radially outward — away from the origin, in the direction of increasing distance. This makes geometric sense: the level surfaces of f are spheres centred at the origin, and the gradient is perpendicular to them, i.e. radially outward.

47.4.4 Directional derivative

The rate of change of f as you move in an arbitrary direction \mathbf{u} (a unit vector) is called the directional derivative:

D_{\mathbf{u}} f = \nabla f \cdot \mathbf{u}

This is the projection of the gradient onto the direction you’re moving. When \mathbf{u} aligns with \nabla f, the directional derivative is maximised. When \mathbf{u} is perpendicular to \nabla f, the directional derivative is zero — you’re moving along a level surface.

Example. f(x, y, z) = x^2 y + yz^3 at point (1, 2, -1). Find the rate of change in the direction \mathbf{u} = \frac{1}{\sqrt{3}}(1, 1, 1).

First, the gradient at (1, 2, -1):

\nabla f\big|_{(1,2,-1)} = \bigl(2(1)(2),\; (1)^2 + (-1)^3,\; 3(2)(-1)^2\bigr) = (4, 0, 6)

Then:

D_{\mathbf{u}} f = (4, 0, 6) \cdot \frac{1}{\sqrt{3}}(1, 1, 1) = \frac{4 + 0 + 6}{\sqrt{3}} = \frac{10}{\sqrt{3}} \approx 5.77

47.4.5 Total differential

For small displacements (dx, dy, dz) from a point, the change in f is approximated by the total differential:

df = \frac{\partial f}{\partial x}\,dx + \frac{\partial f}{\partial y}\,dy + \frac{\partial f}{\partial z}\,dz = \nabla f \cdot d\mathbf{r}

This is the multi-variable chain rule in compact form. If x, y, z are themselves functions of a parameter t, the chain rule becomes:

\frac{df}{dt} = \frac{\partial f}{\partial x}\frac{dx}{dt} + \frac{\partial f}{\partial y}\frac{dy}{dt} + \frac{\partial f}{\partial z}\frac{dz}{dt} = \nabla f \cdot \frac{d\mathbf{r}}{dt}

47.5 Divergence

47.5.1 Definition

Given a vector field \mathbf{F} = (F_1, F_2, F_3), the divergence is:

\nabla \cdot \mathbf{F} = \frac{\partial F_1}{\partial x} + \frac{\partial F_2}{\partial y} + \frac{\partial F_3}{\partial z}

The del operator \nabla is now being “dotted” with the vector field — hence the dot product notation. The result is a scalar field: one number at each point.

Example. \mathbf{F}(x, y, z) = (x^2, 2xy, z^2).

\nabla \cdot \mathbf{F} = \frac{\partial}{\partial x}(x^2) + \frac{\partial}{\partial y}(2xy) + \frac{\partial}{\partial z}(z^2) = 2x + 2x + 2z = 4x + 2z

At the point (1, 0, 1): \nabla \cdot \mathbf{F} = 4(1) + 2(1) = 6.

47.5.2 Physical meaning

Imagine \mathbf{F} is a fluid velocity field. Enclose a tiny box around a point. The divergence measures the net rate of fluid flowing out of that box per unit volume:

  • \nabla \cdot \mathbf{F} > 0: more fluid leaving than entering — a source. (Think: water spraying from a sprinkler head.)
  • \nabla \cdot \mathbf{F} < 0: more fluid entering than leaving — a sink. (Think: water draining into a drain.)
  • \nabla \cdot \mathbf{F} = 0: perfectly balanced inflow and outflow — the fluid is incompressible at that point.

The continuity equation in fluid mechanics captures this precisely:

\frac{\partial \rho}{\partial t} + \nabla \cdot (\rho \mathbf{v}) = 0

This says: the rate of change of density at a point equals the negative divergence of the mass flux. Mass neither appears nor disappears.

Preview: Divergence theorem

Gauss’s divergence theorem connects the divergence over a volume V to the flux through its bounding surface S:

\iiint_V \nabla \cdot \mathbf{F}\, dV = \oiint_S \mathbf{F} \cdot d\mathbf{A}

The integral of all the local sources inside equals the total outflow through the boundary. This is covered in full in the next chapter on vector integral calculus.

47.6 Curl

47.6.1 Definition

Given a vector field \mathbf{F} = (F_1, F_2, F_3), the curl is:

\nabla \times \mathbf{F} = \begin{vmatrix} \mathbf{i} & \mathbf{j} & \mathbf{k} \\ \dfrac{\partial}{\partial x} & \dfrac{\partial}{\partial y} & \dfrac{\partial}{\partial z} \\[6pt] F_1 & F_2 & F_3 \end{vmatrix}

Expanding the determinant:

\nabla \times \mathbf{F} = \left(\frac{\partial F_3}{\partial y} - \frac{\partial F_2}{\partial z},\; \frac{\partial F_1}{\partial z} - \frac{\partial F_3}{\partial x},\; \frac{\partial F_2}{\partial x} - \frac{\partial F_1}{\partial y}\right)

The del operator is now being “crossed” with the vector field. The result is itself a vector field.

Example. \mathbf{F}(x, y, z) = (-y, x, 0). This is a 2D field that rotates counterclockwise.

\frac{\partial F_3}{\partial y} - \frac{\partial F_2}{\partial z} = 0 - 0 = 0 \frac{\partial F_1}{\partial z} - \frac{\partial F_3}{\partial x} = 0 - 0 = 0 \frac{\partial F_2}{\partial x} - \frac{\partial F_1}{\partial y} = 1 - (-1) = 2

So \nabla \times \mathbf{F} = (0, 0, 2) — a uniform curl pointing in the z-direction. The rotation is uniform everywhere, which makes sense: this is solid-body rotation.

47.6.2 Physical meaning

Imagine dropping a tiny paddle wheel into a fluid flow. If the paddle wheel spins, the curl is non-zero at that point; if it doesn’t spin, the curl is zero. The direction of the curl vector is the axis of rotation (by the right-hand rule); its magnitude measures the rotation speed.

  • Irrotational field: \nabla \times \mathbf{F} = \mathbf{0} everywhere. The field has no local rotation — no paddle wheel anywhere would spin.
  • Rotational field: \nabla \times \mathbf{F} \neq \mathbf{0} somewhere.

An irrotational field for which \nabla \times \mathbf{F} = \mathbf{0} throughout a simply-connected region can be written as the gradient of a scalar potential: \mathbf{F} = \nabla \phi. Gravity and electrostatics are irrotational outside their sources.

Key identity: For any twice-differentiable scalar field f,

\nabla \times (\nabla f) = \mathbf{0}

The curl of a gradient is always zero. Geometrically: gradient fields have no rotation. This identity will appear repeatedly — it is a test for whether a vector field can be expressed as a gradient.

Preview: Stokes’ theorem

Stokes’ theorem connects the curl over a surface S to the line integral around its boundary curve C:

\iint_S (\nabla \times \mathbf{F}) \cdot d\mathbf{A} = \oint_C \mathbf{F} \cdot d\mathbf{r}

The total rotation through a surface equals the circulation around its edge.

47.7 The Laplacian

47.7.1 Definition

Apply the gradient to a scalar field f to get \nabla f. Then take the divergence of that result. The outcome is the Laplacian:

\nabla^2 f = \nabla \cdot (\nabla f) = \frac{\partial^2 f}{\partial x^2} + \frac{\partial^2 f}{\partial y^2} + \frac{\partial^2 f}{\partial z^2}

The Laplacian is a scalar field. It is a single operator that combines second-order partial derivatives in all directions.

Example. f(x, y, z) = x^2 + y^2 + z^2.

\frac{\partial^2 f}{\partial x^2} = 2, \qquad \frac{\partial^2 f}{\partial y^2} = 2, \qquad \frac{\partial^2 f}{\partial z^2} = 2

\nabla^2 f = 2 + 2 + 2 = 6

Example. f(x, y, z) = \frac{1}{r} where r = \sqrt{x^2 + y^2 + z^2} (the electrostatic potential of a point charge). A careful calculation shows \nabla^2\!\left(\frac{1}{r}\right) = 0 for r \neq 0. This is Laplace’s equation, and functions satisfying it are called harmonic.

47.7.2 Physical meaning

The Laplacian \nabla^2 f at a point measures how f at that point differs from the average value of f in a small sphere around it. Specifically:

  • \nabla^2 f > 0: f is below the local average — the field is concave up, like the bottom of a bowl.
  • \nabla^2 f < 0: f is above the local average — a local maximum relative to its surroundings.
  • \nabla^2 f = 0: f exactly equals its local average everywhere — this is Laplace’s equation, and its solutions are smooth without local extrema in the interior.

The Laplacian appears in every major equation of mathematical physics:

Equation Form What it models
Laplace’s equation \nabla^2 f = 0 Steady-state electrostatics, incompressible flow
Poisson’s equation \nabla^2 f = g Electrostatics with charges, gravity with mass
Heat equation \frac{\partial u}{\partial t} = k\,\nabla^2 u Heat diffusion through a material
Wave equation \frac{\partial^2 u}{\partial t^2} = c^2\,\nabla^2 u Sound, light, water waves

47.8 Applications

47.8.1 Gradient descent and optimisation

In machine learning, a loss function L(\mathbf{w}) measures how wrong a model is, where \mathbf{w} is a vector of model parameters. The gradient \nabla_\mathbf{w} L points in the direction of steepest increase of the loss. To reduce the loss, move in the opposite direction:

\mathbf{w}_{\text{new}} = \mathbf{w}_{\text{old}} - \eta\,\nabla_\mathbf{w} L

The scalar \eta is the learning rate — how large a step to take. This is gradient descent. In high-dimensional spaces (modern neural networks have billions of parameters), computing the gradient efficiently is the central computational challenge. The mathematics is exactly what this chapter covers, lifted to millions of dimensions.

47.8.2 Electric field from voltage potential

In electrostatics, the voltage V(x, y, z) is a scalar field. The electric field is its negative gradient:

\mathbf{E} = -\nabla V

The minus sign is physical convention: the electric field points from high to low voltage, not from low to high. Positive charges accelerate down the voltage hill.

If V = x^2 + y^2 + z^2 (a simple quadratic potential), then:

\nabla V = (2x, 2y, 2z), \qquad \mathbf{E} = (-2x, -2y, -2z)

The field points radially inward — toward the origin, toward lower potential. Taking the divergence:

\nabla \cdot \mathbf{E} = -2 - 2 - 2 = -6

Gauss’s law in differential form states \nabla \cdot \mathbf{E} = \rho/\varepsilon_0, where \rho is the charge density. A uniform \nabla \cdot \mathbf{E} = -6 means a uniform negative charge density — a medium with uniform charge throughout.

47.8.3 Continuity equation in fluid mechanics

For a fluid with density \rho(x, y, z, t) and velocity field \mathbf{v}(x, y, z, t), conservation of mass requires:

\frac{\partial \rho}{\partial t} + \nabla \cdot (\rho\,\mathbf{v}) = 0

This says: the rate at which mass density increases at a point equals the negative divergence of mass flux. Mass flows in from regions where \nabla \cdot (\rho\mathbf{v}) < 0 and flows out where it is positive. If the fluid is incompressible ($= $ const), this simplifies to \nabla \cdot \mathbf{v} = 0.

Where this shows up

  • An electrical engineer designs antenna patterns using the curl and divergence of Maxwell’s equations: \nabla \times \mathbf{E} = -\partial\mathbf{B}/\partial t and \nabla \cdot \mathbf{B} = 0.
  • A meteorologist reads wind fields as vector fields and uses divergence to locate areas of rising air (positive divergence near the surface means air is being pulled up).
  • A robotics engineer computing the configuration-space gradient of a potential function is doing gradient descent in the exact sense of this chapter.
  • A GIS analyst computing watershed flow directions is applying the gradient of the elevation field: water flows opposite to \nabla h.

The operators are the same in every case. The domain changes.

47.9 What you can do now

You can now take a field and ask three different, precise questions about how it changes: steepest increase (gradient), net outflow (divergence), and local rotation (curl). You can compute these operators and, just as importantly, interpret their sign and direction in a concrete context (maps, fluids, electromagnetism, optimisation).

47.10 Exercises

These exercises progress from component calculation through applied interpretation. In each, start with the definition before writing any formula.

  1. A temperature field on a heated plate is modelled by f(x, y, z) = x^2 y + yz^3. Find \nabla f and evaluate it at the point (1, 2, -1). Which coordinate direction gives the greatest rate of temperature increase at that point?
  1. A pressure field is given by p(x, y, z) = 3x^2 - 2y^2 + xyz. At the point (2, 1, 3), find the rate of change of pressure in the direction \mathbf{u} = \frac{1}{\sqrt{2}}(1, 0, 1) — the diagonal direction in the xz-plane.
  1. A fluid velocity field is given by \mathbf{F}(x, y, z) = (x^2, 2xy, z^2). Compute \nabla \cdot \mathbf{F}. Identify the regions where the fluid acts as a source (positive divergence) and where it acts as a sink (negative divergence).
  1. Verify that \mathbf{F}(x, y, z) = (-y, x, 0) represents a purely rotational flow — it should have non-zero curl and zero divergence. Compute both.
  1. Let f(x, y, z) = x^2 y^2 z. Verify the identity \nabla \times (\nabla f) = \mathbf{0} — the curl of a gradient is always zero. This confirms that gradient fields are irrotational (conservative).
  1. The electric potential in free space is V(x, y, z) = x^2 + y^2 + z^2. Find the electric field \mathbf{E} = -\nabla V, then compute \nabla \cdot \mathbf{E} and identify what Gauss’s law says about the charge distribution.