AMath 501

Outline

Basic Vector Manipulations

Coordinates & Position Vectors

  1. Cartesian Coordinates:
    • r=xi^+yj^+zk^
  2. Spherical Coordinates:
    • r=re^r
  3. Cylindrical Coordinates:
    • r=re^r+ze^z

Curvilinear Coordinates

e^i=r/uir/ui,i=1,2,3 hi=rui

Derivatives and Arc Length

  1. Derivative of position vector dr:
dr=ru1du1+ru2du2+ru3du3 dr=h1du1e^1+h2du2e^2+h3du3e^3
  1. Arc length differential (ds)2:
(ds)2=drdr=h12(du1)2+h22(du2)2+h32(du3)2
  1. Arc Length Formula:
L=ab|dr(t)dt|dt

Gradient Operator

:=i^x+j^y+k^z(in Cartesian):=1h1e^1u1+1h2e^2u2+1h3e^3u3

Divergence Operator

  1. In Cartesian coordinates:
divF=F=F1x+F2y+F3z
  1. In general:
divF=1h1h2h3[u1(F1h2h3)+u2(F2h1h3)+u3(F3h1h2)]

where:

F=F1e^1+F2e^2+F3e^3
  1. Write down div in spherical/cylindrical coordinates.

Curl Operator

CurlF=1h1h2h3|h1e^1h2e^2h3e^3u1u2u3h1F1h2F2h3F3|

Physical Explanation

Line Integral

W=r(a)r(b)Fdr=r(a)r(b)[F1(h1du1)+F2(h2du2)+F3(h3du3)] W=abFdrdtdt=ab[F1h1du1dt+F2h2du2dt+F3h3du3dt]dt

Conservative Field

W=r(a)r(b)Fdr=dΦ=Φ(r(b))Φ(r(a))

Surface Integral

SFn^dson a surfaceS dS=n^ds=(ru1×ru2)du1du2=ru1×ru2ru1×ru2ru1×ru2du1du2=n^ds n^=ff,which is easier than:n^=rx×ryrx×ry

Surface Representation

ds=1+(hx)2+(hy)2dxdy r=xi^+yj^+h(x,y)k^

and:

rx=i^+hxk^,ry=j^+hyk^n^ds=f(fx)2+(fy)2+(fz)21+(hx)2+(hy)2dxdy n^ds=fdxdy

Surface Area

A=ds

Divergence Theorem

VFn^ds=VdivFdV dV=h1h2h3du1du2du3

Stokes' Formula/Theorem

ScurlFn^ds=CFdr,

This expands to:

×F=(F3yF2z)i^(F3xF1z)j^+(F2xF1y)k^

In 2D:

curlF=F2xF1y

Definition of Holomorphic Functions / Analytic Functions

A holomorphic function (or analytic function) is a complex function f(z)  that is differentiable at every point in an open subset of the complex plane C . Differentiability in the complex sense means that the limit defining the derivative:

f(z)=limh0f(z+h)f(z)h

exists and is the same no matter how h approaches 0 in the complex plane.

Cauchy-Riemann Relations:

For f(z)=u(x,y)+iv(x,y)  (where z=x+iy), the function is holomorphic if:

ux=vy,uy=vx.

Branch Cuts / Points:

Some functions (like lnz or z) are not holomorphic everywhere because they involve multivalued branches. For example:

Example

  1. Holomorphic Function: f(z)=z2+i

Here, u(x,y)=x2y2  and v(x,y)=2xy+1. These satisfy the Cauchy-Riemann equations:

ux=2x,vy=2x

and

uy=2y,vx=2y.
  1. Non-Holomorphic Function: f(z)=|z|2=x2+y2

Here, u(x,y)=x2+y2 and v(x,y)=0. The Cauchy-Riemann equations fail:

ux=2xvy=0.

Cauchy Theorem

If f(z) is holomorphic (analytic) in a simply connected domain D and γ is a closed contour in D, then:

γf(z)dz=0.

Key Idea:
The integral of an analytic function over a closed loop is zero if the function is analytic everywhere inside and on the contour.

Example:

Let f(z)=z2, and γ is the circle |z|=1:

γz2dz=0

since f(z) is holomorphic everywhere.

Cauchy Integral Formula

If f(z) is holomorphic in a simply connected domain D and γ is a simple closed contour in D, then for any point a inside γ:

f(a)=12πiγf(z)zadz.

Key Idea:
The value of a holomorphic function inside a contour can be computed using the values of the function on the contour.

Example:

Let f(z)=z2, and γ is the circle |z|=2. Compute f(0):

f(0)=12πiγz2zdz=12πiγzdz.

Since γzdz=0, f(0)=0.

Residue

Intuition: Circulation Around the Singularity

The residue measures how much the function “circulates” around the singularity. If you imagine walking along the contour C, the residue tells you the strength and direction of this “circulation” (positive for counterclockwise, negative for clockwise).

In f(z)=1z1, the residue is 1, meaning a unit of circulation counterclockwise around z=1.

Key Points About Residues and Singularities

  1. Residue Explains Local Behavior Near a Singularity
    The residue at a singularity z=z0 describes the “circulation” of f(z) near that singularity.
    For example, in f(z)=1(z+2)(z1):
  1. Residues Are Independent of Distance From the Singularity
    Residues depend only on the singularity itself, not on the distance from it. The contour C used to calculate the residue can have any radius, as long as it encloses only that singularity (and no others).

This is because the integral Cf(z)dz over any closed contour enclosing the singularity gives the same result, thanks to the Cauchy Integral Formula.

  1. Residue Measures Local Circulation
    Residue tells us how f(z) “circulates” locally around the singularity. This is like isolating the behavior of f(z) at that point.
  1. Why Distance Doesn’t Affect Residue
    The residue at a singularity depends only on the coefficient of 1zz0 in the Laurent series expansion. Since Laurent series expansions focus on the singularity and ignore the behavior elsewhere, the residue is unaffected by the distance from the singularity.

Residue Theorem

Let f(z) be holomorphic in a domain D, except for isolated singularities. If γ is a simple closed contour in D that encloses these singularities, then:

γf(z)dz=2πiResidues of f(z) inside γ.

Key Idea:
The integral around a closed contour is determined by the sum of residues of the function’s singularities inside the contour.

Single Singular Point at  z = 0

In your specific example, the contour C is the unit circle |z|=1, and the function f(z) has only one singularity inside the contour, at z=0. For this special case:

Cf(z)dz=2πiRes(f(z),0).

The residue of f(z) at z=0 is the coefficient of 1z in the Laurent series expansion of f(z) around z=0. That coefficient is denoted as a1.

So, in this case:

Cf(z)dz=2πiRes(f(z),0)=2πia1.

This is why a1 alone represents the residue for the integral in this case—there is only one singularity inside the contour, so the residue theorem reduces to this single contribution.

Steps to Find Residues:

  1. For a simple pole at z=a, residue:
Res(f,a)=limza(za)f(z).
  1. For higher-order poles or Laurent expansions, use:
Res(f,a)=coefficient of 1za in Laurent series of f(z).

Example:

Let f(z)=1z2+1, and γ is the circle |z|=2. The singularities are at z=i and z=i. Residues:

Res(f,i)=limzi(zi)1z2+1=12i,Res(f,i)=12i.

Thus:

γ1z2+1dz=2πi(12i12i)=0.

Calculation

Res(f,i)=limzi(zi)1z2+1=(zi)1(zi)(z+i)=limzi1z+i=12i

Singularities

A singularity of a complex function is a point z0 where the function is not holomorphic (analytic). There are three main types of singularities, which are classified based on the behavior of f(z) near z0.

Classification of Singularities

Removable Singularity

limz0sinzz=1.

So, z=0 is a removable singularity. Redefine f(0)=1 to make f(z) analytic everywhere.

Pole

Types:

  1. Simple Pole: If n=1.
  2. Higher-Order Pole: If n>1.

Essential Singularity

e1/z=n=01n!zn,

which is infinitely oscillatory as z0.

Laurent Expansions

A Laurent series is a representation of a complex function f(z) as an infinite series that includes both positive and negative powers of (zz0):

f(z)=n=cn(zz0)n.

Here:

cn=12πiγf(z)(zz0)n+1dz,

where γ is a closed contour around z0.

Laurent Series Centered at  z = 0

If the expansion is centered at z0=0, then (zz0)=z, and the Laurent series becomes:

f(z)=n=cnzn.

We write the Laurent series as:

f(z)=+a2z2+a1z+a0+a1z+a2z2+,

where:

So this is just notation. Writing it as anzn or cnzn is equivalent, as long as you recognize that the coefficient of 1zn is cn.

The coefficient a1 specifically refers to the term 1z, which corresponds to the residue. This notation emphasizes its role in the residue theorem:

Residue at z=0=a1.

So, while the general Laurent series looks like:

f(z)=n=cn(zz0)n,

in practice, we rewrite it as:

f(z)=+a2z2+a1z+a0+a1z+,

because this form explicitly separates positive and negative powers of z, and it is easier to identify a1, the residue.

How to Rewrite

To decide whether to rewrite terms, follow these steps:

Step 1: Identify Singularities

Find all the singularities of the function. These divide the complex plane into regions of convergence.

Step 2: Determine the Region of Interest

Ask: What region am I analyzing? For example:

Step 3: Check Convergence Behavior

General Rule for Laurent Series:

  1. Focus on |w|<1:
    Identify the variable w such that |w|<1. This ensures convergence of the geometric series.
  2. If the original function satisfies |w|<1, no rewriting is needed.
    • Example: |z|<1 for 11+z.
  3. If |w|1, rewrite the function to redefine w so |w|<1.
    • Example: |z|>1 for 11+z, rewrite using 1z.

Example 1:

Laurent Series for f(z)=1z(z1).
Expand f(z)=1z(z1) around z0=0:

f(z)=1z1z1.

Using the geometric series expansion 11w=n=0wn (valid for |w|<1), rewrite 1z1:

1z1=11z=n=0zn.

Thus:

f(z)=1z(n=0zn)=n=01zn1.

The Laurent series is:

f(z)=1z1zz2z3.

This series converges for |z|>1.

Complex Method for Solving Real Integrals

General Procedure

  1. Transform the Real Integral into a Complex Integral:
    Replace the real variable x with the complex variable z, and rewrite the real integral:
I=f(x)dx=γf(z)dz,

where γ is a contour in the complex plane.

  1. Close the Contour:
    Add a semicircular arc in the complex plane to make the integral over a closed contour. Ensure that the contribution from the arc goes to 0 as the radius tends to infinity:
γf(z)dz=f(x)dx+arcf(z)dz.
  1. Apply the Residue Theorem:
    Compute the integral over the closed contour γ using the Residue Theorem:
γf(z)dz=2πiRes(f(z),zk),

where zk are the singularities of f(z) inside the contour.

  1. Extract the Real Integral:
    The desired integral I is related to the contour integral minus any contributions from the semicircular arc or other portions.

Example

Evaluate:

I=1x2+1dx. I=1z2+1dz. γ1z2+1dz=1z2+1dz+arc1z2+1dz.

As R1z2+10 on the arc, so its contribution vanishes.

Res(1z2+1,i)=limzi(zi)1z2+1=12i.

Thus:

γ1z2+1dz=2πi12i=π. I=1x2+1dx=π.

Jordan’s Lemma

Jordan’s Lemma is a result in complex analysis used to evaluate integrals of the form:

I=eimzf(z)dz,

where:

The key idea is that when closing the contour in the upper half-plane, the contribution of the integral over the semicircular arc vanishes as the radius R, provided f(z) decays sufficiently fast.

Application

Jordan’s Lemma is especially useful when evaluating real integrals using contour integration, where the integrand includes oscillatory terms eimz (for large m).

Steps to Apply Jordan’s Lemma

  1. Write the real integral in terms of  z :
I=eimxf(x)dx.
  1. Extend the integral to the complex plane, turning it into a contour integral:
γeimzf(z)dz,

where γ includes the real line and a semicircular arc in the upper half-plane.
3. Show that the contribution from the semicircular arc vanishes as R, using Jordan’s Lemma.
4. Apply the Residue Theorem to compute the integral over the closed contour γ.

Example

Evaluate:

I=eimxx2+1dx,m>0. I=eimzz2+1dz. γeimzz2+1dz=eimzz2+1dz+arceimzz2+1dz. eimz=eimRcosθemRsinθ.

The term emRsinθ0 as R, because sinθ>0 in the upper half-plane. Thus:

arceimzz2+1dz0as R. Res(eimzz2+1,i)=limzi(zi)eimzz2+1=em2i.

Using the Residue Theorem:

γeimzz2+1dz=2πiem2i=πem. I=eimxx2+1dx=πem.

Improper Integrals and Principal Value

Improper Integrals

An improper integral is an integral where:

  1. The limits of integration are infinite, e.g.:
f(x)dx.
  1. The integrand has a singularity within the integration range, e.g.:
111xdx.

Such integrals may not converge in the usual sense. However, by using Principal Value (P.V.) techniques and complex analysis tools like the Residue Theorem, we can define and compute them.

Principal Value (P.V.)

The Principal Value of an integral is a method to assign a finite value to certain divergent improper integrals.

P.V.abf(x)dx=limϵ0(acϵf(x)dx+c+ϵbf(x)dx). P.V.f(x)dx=limRRRf(x)dx.

Residue Theorem for Improper Integrals

Improper integrals can often be evaluated using the Residue Theorem, especially for integrals of the form:

f(x)dx.

The idea is to extend the real integral to a closed contour in the complex plane and use the residues of f(z) inside the contour:

f(x)dx=2πiRes(f(z),inside the contour).

Example 1

Evaluate:

P.V.111xdx. P.V.111xdx=limϵ0(1ϵ1xdx+ϵ11xdx). 1ϵ1xdx=ln|ϵ|ln|1|=ln|ϵ|,ϵ11xdx=ln|1|ln|ϵ|=ln|ϵ|. P.V.111xdx=ln|ϵ|ln|ϵ|=0.

Thus:

P.V.111xdx=0.

Example 2

Evaluate:

I=1x2+1dx.

We solved this earlier using the residue theorem:

  1. Extend the integral to the complex plane:
1x2+1dx=γ1z2+1dz,

where γ is a closed contour in the upper half-plane.

  1. Find the singularities of f(z)=1z2+1:
z=i,z=i.
  1. Apply the Residue Theorem:
    The residue at z=i is:
Res(1z2+1,i)=12i.
  1. Compute the integral:
γ1z2+1dz=2πi12i=π.

Thus:

1x2+1dx=π.

Fourier Transform and Inverse Transform

The Fourier transform is a powerful mathematical tool used to analyze and represent a time-domain signal f(t) in the frequency domain F(ω). It is defined as:

F(ω)=eiωtf(t)dt,

where:

Conditions for Existence

For the Fourier transform to exist, the function f(t) must satisfy the absolute integrability condition:

|f(t)|dt<.

This ensures that f(t) has finite energy and can be transformed into the frequency domain.

Inverse Fourier Transform

The original signal f(t) can be recovered from its Fourier transform F(ω) using the inverse Fourier transform:

f(t)=12πeiωtF(ω)dω.

Properties of the Fourier Transform

  1. Linearity:
F{af1(t)+bf2(t)}=aF1(ω)+bF2(ω),

where F represents the Fourier transform operator.

  1. Time Shift:
    If g(t)=f(tt0), then:
F{g(t)}=eiωt0F(ω).
  1. Frequency Shift:
    If g(t)=eiω0tf(t), then:
F{g(t)}=F(ωω0).
  1. Parseval’s Theorem:
    The energy of the signal in the time domain is equal to the energy in the frequency domain:
|f(t)|2dt=12π|F(ω)|2dω.

Example 1: Fourier Transform of a Gaussian

Let f(t)=et2. The Fourier transform is:

F(ω)=eiωtet2dt.

Using a standard result for Gaussian integrals:

F(ω)=πeω2/4.

Example 2: Fourier Transform of a Rectangular Pulse

Let:

f(t)={1,|t|T,0,|t|>T.

The Fourier transform is:

F(ω)=TTeiωtdt.

Solve the integral:

F(ω)=sin(ωT)ω.

This result demonstrates how a rectangular time-domain signal transforms into a sinc function in the frequency domain.

One-Sided Fourier Transform

The one-sided Fourier transform is a variation of the Fourier transform where the integration is limited to t0. It is used when the signal f(t) is causal (i.e., f(t)=0 for t<0).

The one-sided Fourier transform is defined as:

F(ω)=0eiωtf(t)dt.

Laplace Transform

The Laplace transform generalizes the Fourier transform by replacing eiωt with est, where  s  is a complex variable s=σ+iω.

The Laplace transform of f(t) is defined as:

F(s)=0estf(t)dt,where s=σ+iω.

Key Difference:

Convergence

The Laplace transform converges for functions f(t) satisfying:

0|f(t)|eσtdt<,

which allows it to handle a broader class of functions than the Fourier transform.

Connection Between Fourier and Laplace Transforms

If F(s) is the Laplace transform of f(t), then the Fourier transform can be derived by setting s=iω:

F(ω)=F(s)|s=iω=0eiωtf(t)dt.

Example

Compute the Laplace transform of f(t)=eata>0.

F(s)=0esteatdt=0e(s+a)tdt. F(s)=[e(s+a)t(s+a)]0=1s+a,for Re(s)>a.

Example: Fourier Transform from Laplace Transform

Given the Laplace transform:

F(s)=1s+a.

The Fourier transform is obtained by substituting s=iω:

F(ω)=1iω+a.