We study the strongly singular volume integral operator that describes the scattering of time-harmonic electromagnetic waves. For the case of piecewise constant material coefficients and smooth interfaces, we determine the essential spectrum. We show that it is a finite set and that the operator is Fredholm of index zero in if and only if the relative permeability and permittivity are both different from 0 and ?.