Home | About | Journals | Submit | Contact Us | Français |

**|**HHS Author Manuscripts**|**PMC3521605

Formats

Article sections

Authors

Related links

Phys Rev Lett. Author manuscript; available in PMC 2012 December 13.

Published in final edited form as:

Published online 2012 October 17. doi: 10.1103/PhysRevLett.109.168102

PMCID: PMC3521605

NIHMSID: NIHMS419101

The publisher's final edited version of this article is available at Phys Rev Lett

See other articles in PMC that cite the published article.

Superresolution microscopy enables imaging in the optical far field with ~20 nm-scale resolution. However, classical concepts of resolution using point-spread and modulation-transfer functions fail to describe the physical limits of superresolution techniques based on stochastic localization of single emitters. Prior treatments of stochastic localization microscopy have defined how accurately a single emitter’s position can be determined, but these bounds are restricted to sparse emitters, do not describe conventional microscopy, and fail to provide unified concepts of resolution for all optical methods. Here we introduce a measure of resolution, the information transfer function (ITF), that gives physical limits for conventional and stochastic localization techniques. The ITF bounds the accuracy of image determination as a function of spatial frequency and for conventional microscopy is proportional to the square of the modulation-transfer function. We use the ITF to describe how emitter density and photon counts affect imaging performance across the continuum from conventional to superresolution microscopy, without assuming emitters are sparse. This unified physical description of resolution facilitates experimental choices and designs of image reconstruction algorithms.

Exploring the physical bounds on light microscopy has been a mainstay activity in theoretical optics. In classical [1, 2] and in most modern treatments [3] the limits on resolution have been derived using deterministic field theories for optical diffraction. This ignores photon shot noise, the dominant noise source in perhaps most modern microscopy applications. Digital image processing algorithms that take noise into account can achieve subpixel superresolution by combining multiple conventional images of a single sample or scene [4, 5]. However, the poor performance of these techniques in recovering high spatial frequency information led to the recognition that prior information about image structure is generally essential for attaining superresolution [6]. Yet, existing theories do not provide physical limits on image estimation based on the noise and prior information available from specific measurement schemes.

Here we study the physics of superresolution imaging by stochastic localization of single molecules, as in photoactivated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM), which achieve superresolution via the spatial localization of single fluorescent molecules [7–10]. We stress that stochastic localization is a distinct measurement and computational analysis procedure that exploits the prior knowledge the active fluorophores are dilute. Previous theories of superresolution from digital image processing do not describe the specific form of prior information that has allowed stochastic localization techniques to successfully achieve tenfold or better superresolution beyond the conventional diffraction limit. Our theory provides unified performance limits for stochastic localization, conventional microscopy, and the entire class of digital image processing algorithms for subpixel superresolution.

Our work builds on earlier applications of estimation theory that amended classical notions of resolution by including fluctuations in the propagating fields [11, 12]. Instead, we consider photon statistics and model the stochastic activation and measurement of individual molecules. Our resolution measure, termed here the information transfer function (ITF), limits how well one can determine a specimen’s features at each spatial frequency. The ITF thus replaces the modulation-transfer function (MTF) but with an expanded range of explanation, covering conventional and stochastic localization microscopy. Importantly, for conventional microscopy the ITF reduces to the square of the MTF, scaled by the number of observed photons, thereby preserving physicists’ basic intuitions about imaging. Overall, our formalism unifies long-standing work on the spatial filtering properties of optical imaging with recent efforts to describe the limits imposed by photon shot noise.

We consider an image taken from a specimen of *m* fluorophores, all of the same color and located in the sample plane at {**x*** _{j}*}. The experimental data are the counts, {

$$\begin{array}{ccc}P(\{{N}_{l}\}|\{{\mathbf{x}}_{j}\})\hfill & =\hfill & {\displaystyle \mathbf{\prod}_{l=1}^{L}{e}^{-{\lambda}_{l}}\frac{{\lambda}_{l}^{{N}_{l}}}{{N}_{l}!},}\hfill \\ \hfill {\lambda}_{l}& =\hfill & {\displaystyle \mathbf{\sum}_{j=1}^{m}{p}_{j}h({\mathbf{y}}_{l}-{\mathbf{x}}_{j})\mathrm{\Delta}{\mathbf{y}}_{l}}\hfill \end{array}$$

(1)

where *p _{j}* is the intensity of the

$$P(\{{\mathbf{z}}_{k}\}|N,\{{\mathbf{x}}_{j}\})={\displaystyle \mathbf{\prod}_{k=1}^{N}}{\displaystyle \mathbf{\sum}_{j=1}^{m}\frac{{p}_{j}}{{\displaystyle {\mathbf{\sum}}_{i=1}^{m}{p}_{i}}}h({\mathbf{z}}_{k}-{\mathbf{x}}_{j})d{\mathbf{z}}_{k}.}$$

(2)

This satisfies ∫*P*({**z*** _{k}*}|

To study the limits of this technique, we use a key tool from estimation theory, the Cramér-Rao lower bound [13] (CRLB), which bounds the accuracy of any estimator, {* _{i}*}, of a set of parameters, {

Previous applications of the CRLB to emitter localization did not yield limits on how well entire images can be determined, nor formalism to supersede the PSF and MTF. To illustrate, consider a 2D scene composed of two equally bright emitters [14]. We choose a coordinate system in which the emitters lie on the *x* axis at (*x, y*) = (±*d _{x}*, 0).

Real-space analysis of localization accuracy depends on the configuration of emitters. (a) A scene with two emitters has 4 degrees of freedom (inset). The Cramér-Rao lower bound (CRLB) for estimation of each of the 4 coordinates (solid lines; **...**

This analysis extends to scenes of more emitters [Figs. 1(b)–1(d)], but in the general case localization accuracy varies with the scene’s details. The Fisher information for *m* emitters is a 2*m* × 2*m* matrix whose entries depend on the emitters’ 2*m* position coordinates. For *m* > 2 there is no general coordinate system diagonalizing **J**. A resolution measure that varies from sample to sample is inconsistent with traditional concepts of resolution and has limited practical utility.

We introduce a measure, the ITF, that gives resolution bounds for all specimens and generalizes the MTF to account for photon statistics. The ITF provides the CRLB for image estimation as a function of spatial frequency; this conception of resolution applies equally well to conventional or stochastic localization microscopy.

Consider an image scene, represented by a positive intensity function, *I*(**x**), normalized to have unit integral. In biological microscopy, *I* may represent the spatial probability density of fluorescently labeled cellular or protein structures. We seek a bound on the squared error of an unbiased estimator, *Î*(**k**). The ITF, *F*(**k**), bounds the error in estimating the image frequency components: **E**_{I(k)} |*Î*(**k**) − *I*(**k**)|^{2} ≥ 1/*F*(**k**). (In practice it may be impossible to define unbiased estimators for some image components, especially at high spatial frequencies [16]. A generalization of the CRLB relates *F*(**k**) to the minimum variance of a biased estimator [13]. Even when no unbiased estimator exists, the ITF provides an objective figure of merit for image resolution that is based on the measurement statistics.)

Physical intuition suggests the ITF should vanish at large *k* and be proportional to *N*, since each photon carries equal Fisher information. We first calculate the ITF exactly using three key simplifying assumptions. First, we ignore photons that cannot be assigned to an emitter due to overlap; the case of overlapping emitters will be considered below. This assumption simplifies the probability, Eq. (2). If *n _{j}* is the number of detected photons from the

$$P(\{{z}_{ij}\}|I)={\displaystyle \mathbf{\prod}_{j=1}^{m}}{\displaystyle \int d{\mathbf{x}}_{j}\mathbf{\prod}_{i=1}^{{n}_{j}}h({\mathbf{z}}_{ij}-{\mathbf{x}}_{j})I({\mathbf{x}}_{j}).}$$

(3)

Second, assuming the PSF, *h*, is Gaussian, we can compute the integral:

$$\int d{\mathbf{x}}_{j}\mathbf{\prod}_{i=1}^{{n}_{j}}{e}^{-[{({\mathbf{z}}_{ij}-{\mathbf{x}}_{j})}^{2}/2{\sigma}^{2}]}I({\mathbf{x}}_{j})\propto {\tilde{I}}_{{n}_{j}}({\widehat{\mathbf{x}}}_{j})\mathbf{\prod}_{i=1}^{{n}_{j}}}{e}^{-(1/2{\sigma}^{2})({\mathbf{z}}_{ij}^{2}-{\widehat{\mathbf{x}}}_{j}^{2})$$

(4)

where ${\widehat{\mathbf{x}}}_{j}\equiv \frac{1}{{n}_{j}}{\displaystyle {\mathbf{\sum}}_{i=1}^{{n}_{j}}{\mathbf{z}}_{ij}}$ is the centroid of the observed photons’ locations, and *Ĩ _{nj}* (

$${\mathbf{J}}_{I({\mathbf{k}}_{1}),I*({\mathbf{k}}_{2})}=m{e}^{-[{(2\pi \sigma )}^{2}/2n]({\mathbf{k}}_{1}^{2}+{\mathbf{k}}_{2}^{2}){\displaystyle \int d\widehat{\mathbf{x}}}\frac{{e}^{-2\pi i({\mathbf{k}}_{1}-{\mathbf{k}}_{2})\widehat{\mathbf{x}}}}{{\tilde{I}}_{n}(\widehat{\mathbf{x}})}.}$$

(5)

Using the normalization R of the image and the PSF, ∫*d***$\widehat{x}$***Ĩ _{n}*(

$${F}_{0}(\mathbf{k})=\frac{1}{{[{\mathbf{J}}^{-1}]}_{I(\mathbf{k}),I*(\mathbf{k})}}=A{\rho}_{e}{e}^{-{(2\pi \mathbf{k}\sigma )}^{2}/n}$$

(6)

where *A* is the field of view area and ρ* _{e}* is the total density of emitters; see Fig. 2(a). (Note ρ

The information transfer function, *F*(*k*), bounds image estimation accuracy. (a) *F*_{0}(*k*) for conventional imaging (*n* = 1 photon/emitter; blue and red curves) and superresolution (*n* = 100, green and cyan). (b) Mean squared localization error for a truncated **...**

This result is derived more explicitly in [16] and shows that the ITF is an image-independent, universal limit valid for any scene. Equation (6) shows that superresolution hinges on the ability to have *n* 1; in practice *n* ~ 100−10^{4} or more. In conventional microscopy, individual emitters may contribute more than one photon to the image, but since photons cannot be reliably assigned to the correct emitter their statistics are equivalent to the case *n* = 1. Increasing the emitter labeling density, ρ* _{e}*, reduces the error variance at all spatial frequencies but has little effect on the threshold frequency at which the ITF becomes vanishingly small [Fig. 2(a)].

We can also compute the ITF exactly, with no restriction on the PSF, for conventional microscopy (*n* = 1). In this case Eq. (3) factorizes into a product of independent contributions from each photon, and the ITF is [16]: *F*(*k*) = *N*|*h*(*k*)|^{2}. This result connects the ITF directly to the conventional MTF.

Both of these exact results are special cases of our main finding, which is a general bound on the ITF for any PSF. If the MTF is bounded by a Gaussian, |*h*(*k*)| ≤ *e*^{−(2πkσ)2/2}, then we find [16]:

$$F(k)\le C{F}_{0}(k),$$

(7)

where *C* is a constant that depends on the image but not on *k*, *A* or ρ* _{e}*.

We now consider how the ITF applies in the case the emitters’ images overlap, which is common when the density of active emitters, ρ_{a}, approaches σ^{−2}. Several computational procedures have recently been proposed for analyzing data from such crowded scenes to speed up superresolution image acquisition, but the fundamental limits on resolution and speed remain unknown [17–21]. We show that the spatial frequency-dependent ITF is generally applicable and smoothly depends on ρ_{a}.

To derive how the ITF depends on ρ* _{a}*, we must specialize to images consisting of

ITF for images of discrete emitters reveals the optimal density. (a) ITF for a fixed number of photons, *N*, with an Airy disk PSF. The Fisher information about emitter location for an isolated emitter is *J*^{(1)} = σ^{−2} per photon, and *N* = **...**

We also reconsider superresolution microscopy with sparse emitters, ρ* _{a}* σ

Besides providing a unified formalism for these two extremes, the ITF can quantify the trade-off between image resolution and acquisition time as a function of the density of activated emitters. To do this, we computed the ITF for simulated specimens with emitters at a range of densities. The ITF smoothly transitions between the low and high emitter density regimes, Fig. 3(a). In live-cell imaging, the time to acquire an image, *T*, is a constrained resource. For fixed *T*, the number of detected photons scales as*N* *B _{ρa}T*, where

In summary, we used estimation theory to calculate the ITF, a unified bound on image estimation accuracy, for stochastic localization and conventional fluorescence microscopy. For completely general images, the key parameter is the number of observed photons per emitter, *n*. In conventional microscopy (*n* = 1) the ITF reduces to the square of the MTF times the total number of observed photons. This result provides a performance bound for superresolution techniques that combine multiple, shifted images or photographs [4, 5]. Such techniques can overcome undersampling due to finite pixels, but the fundamental resolution limit imposed by optical diffraction is described by the ITF for conventional microscopy [6].

Overall, the ITF formalism reveals fundamental resolution limits on fluorescence microscopy, unifying the conventional concepts of resolution with those developed separately for stochastic localization microscopy. The ITF also fulfills the long-standing goal of characterizing how resolution depends on the unavoidable limitations imposed by photon statistics [3, 11, 12]. Further, the ITF facilitates principled choices of experimental parameters that optimize imaging performance at any chosen length scale. Although improved localization and image estimation algorithms will surely continue to emerge [17–21], our work already provides the fundamental physical limits on the possible improvements. The ITF bounds the performance of any estimation procedure in fluorescence microscopy, regardless of emitter density.

The authors would like to thank Morteza Shahram, Haim Sompolinsky, and Markus Meister for helpful discussions, as well as the Swartz Foundation (E. A. M.) and an NIH Director’s Pioneer Award (M. J. S.) for funding.

1. Abbe E. Archiv für Mikroskopische Anatomie. 1873;9:413.

2. Rayleigh L, Strutt JW. Philos. Mag. 1879;8:261.

3. den Dekker A, van den Bos A. J. Opt.Soc. Am. A. 1997;14:547. [PubMed]

4. Robinson D, Milanfar P. IEEE Trans. Image Process. 2006;15:1413. [PubMed]

5. Farsiu S, Robinson D, Elad M, Milanfar P. Int. J. Imaging Syst. Technol. 2004;14:47.

6. Baker S, Kanade T. IEEE Trans. Pattern Anal. Mach. Intell. 2002;24:1167.

7. Betzig E, Patterson GH, Sougrat R, Lindwasser OW, Olenych S, Bonifacino JS, Davidson MW, Lippincott-Schwartz J, Hess HF. Science. 2006;313:1642. [PubMed]

8. Rust MJ, Bates M, Zhuang X. Nat. Methods. 2006;3:793. [PMC free article] [PubMed]

9. Hess ST, Girirajan TPK, Mason MD. Biophys. J. 2006;91:4258. [PubMed]

10. Moerner WE. Proc. Natl. Acad. Sci. U.S.A. 2007;104:12596. [PubMed]

11. Helstrom C. J. Opt. Soc. Am. 1970;60:659.

12. Barrett HH, Denny JL, Wagner RF, Myers KJ. J. Opt. Soc. Am. A. 1995;12:834. [PubMed]

13. Kay SM. Fundamentals of Statistical Signal Processing. Englewood Cliffs, NJ: Prentice-Hall; 1993.

14. Ram S, Ward ES, Ober RJ. Proc. Natl. Acad. Sci. U.S.A. 2006;103:4457. [PubMed]

15. Watkins L, Yang H. Biophys. J. 2004;86:4015. [PubMed]

16. See Supplemental Material at http://link.aps.org/supplemental/10.1103/PhysRevLett.109.168102 for supplementary methods and figures.

17. Huang F, Schwartz SL, Byars JM, Lidke KA. Biomed. Opt. Express. 2011;2:1377. [PMC free article] [PubMed]

18. Holden SJ, Uphoff S, Kapanidis AN. Nat. Methods. 2011;8:279. [PubMed]

19. Cox S, Rosten E, Monypenny J, Jovanovic-Talisman T, Burnette DT, Lippincott-Schwartz J, Jones GE, Heintzmann R. Nat. Methods. 2011;9:195. [PMC free article] [PubMed]

20. Burnette DT, Sengupta P, Dai Y, Lippincott-Schwartz J, Kachar B. Proc. Natl. Acad. Sci. U.S.A. 2011;108:21081. [PubMed]

21. Mukamel EA, Babcock H, Zhuang X. Biophys. J. 2012;102:2391. [PubMed]

22. Bates M, Huang B, Dempsey GT, Zhuang X. Science. 2007;317:1749. [PMC free article] [PubMed]

PubMed Central Canada is a service of the Canadian Institutes of Health Research (CIHR) working in partnership with the National Research Council's national science library in cooperation with the National Center for Biotechnology Information at the U.S. National Library of Medicine(NCBI/NLM). It includes content provided to the PubMed Central International archive by participating publishers. |