PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
 
Cell Rep. 2016 June 14; 15(11): 2524–2535.
Published online 2016 June 2. doi:  10.1016/j.celrep.2016.05.024
PMCID: PMC4914773

Robustness of MEK-ERK Dynamics and Origins of Cell-to-Cell Variability in MAPK Signaling

Summary

Cellular signaling processes can exhibit pronounced cell-to-cell variability in genetically identical cells. This affects how individual cells respond differentially to the same environmental stimulus. However, the origins of cell-to-cell variability in cellular signaling systems remain poorly understood. Here, we measure the dynamics of phosphorylated MEK and ERK across cell populations and quantify the levels of population heterogeneity over time using high-throughput image cytometry. We use a statistical modeling framework to show that extrinsic noise, particularly that from upstream MEK, is the dominant factor causing cell-to-cell variability in ERK phosphorylation, rather than stochasticity in the phosphorylation/dephosphorylation of ERK. We furthermore show that without extrinsic noise in the core module, variable (including noisy) signals would be faithfully reproduced downstream, but the within-module extrinsic variability distorts these signals and leads to a drastic reduction in the mutual information between incoming signal and ERK activity.

Graphical Abstract

An external file that holds a picture, illustration, etc.
Object name is fx1.jpg

Introduction

The behavior of eukaryotic cells is determined by an intricate interplay between signaling, gene regulation, and epigenetic processes. Within a cell, each single molecular reaction occurs stochastically, and the expression levels of molecules can vary considerably in individual cells (Bowsher and Swain, 2012). These non-genetic differences frequently add up to macroscopically observable phenotypic variation (Spencer et al., 2009, Balázsi et al., 2011, Spiller et al., 2010). Such variability can have organism-wide consequences, especially when small differences in the initial cell populations are amplified among their progeny (Quaranta and Garbett, 2010, Pujadas and Feinberg, 2012). Cancer is the canonical example of a disease caused by a sequence of chance events that may be the result of amplifying physiological background levels of cell-to-cell variability (Roberts and Der, 2007).

Better understanding of the molecular mechanisms behind the initiation, enhancement, attenuation, and control of this cellular heterogeneity should help us to address a host of fundamental questions in cell biology and experimental and regenerative medicine. Noise at the molecular level has been amply demonstrated in the literature, in the contexts of both gene expression (Elowitz et al., 2002, Swain et al., 2002, Hilfinger and Paulsson, 2011) and signal transduction (Colman-Lerner et al., 2005, Jeschke et al., 2013). The molecular causes underlying population heterogeneity are only beginning to be understood, and each new study adds nuance and detail to our emerging understanding. Two notions have come to dominate the literature: intrinsic and extrinsic causes of cell-to-cell variability (Swain et al., 2002, Komorowski et al., 2010, Hilfinger and Paulsson, 2011, Toni and Tidor, 2013, Bowsher and Swain, 2012). The former refers to the chance events governing the molecular collisions in biochemical reactions. Each reaction occurs at a random time leading to stochastic differences between cells over time. The latter subsumes all those aspects of the system that are not explicitly modeled. This includes the impact of stochastic dynamics in any components upstream and/or downstream of the biological system of interest, which may be caused, for example, by the stage of the cell cycle and the multitude of factors deriving from it.

It has now become possible to track populations of eukaryotic cells at single-cell resolution over time and measure the changes in the abundances of proteins (Selimkhanov et al., 2014). For example, rich temporal behavior of p53 (Geva-Zatorsky et al., 2006, Batchelor et al., 2011) and Nf-κb (Nelson et al., 2004, Ashall et al., 2009, Paszek et al., 2010) has been characterized in single-cell time-lapse imaging studies. Given such data, and with a suitable model for system dynamics and extrinsic noise in hand it is possible, in principle, to locate the causes of cell-to-cell variability and quantify their contributions to system dynamics. Here, we develop a statistical framework for just this purpose, and we apply it to measurements obtained by quantitative image cytometry (Ozaki et al., 2010): data are obtained at discrete time points but encompass thousands of cells, which allows one to investigate the causes of cell-to-cell variability (Johnston, 2014). The in silico statistical model selection framework also has the advantage that it can be applied in situations where, e.g., dual reporter assays, which explicitly separate out extrinsic and intrinsic sources of variability (Hilfinger and Paulsson, 2011), cannot be applied.

With this framework in hand we consider the dynamics of the central MEK-ERK core module of the MAPK signaling cascade, see Figure 1 (Santos et al., 2007, Inder et al., 2008). MAPK mediated signaling affects cell-fate decision-making processes (Eser et al., 2011)—including proliferation, differentiation, apoptosis, and cell stasis—and cell motility, and the mechanisms of MAPK cascades and their role in cellular information processing have been investigated extensively (Kiel and Serrano, 2009, Mody et al., 2009, Sturm et al., 2010, Takahashi et al., 2010, Aoki et al., 2011, Piala et al., 2014, Voliotis et al., 2014). Here, we take an engineering perspective and aim to characterize how MEK and ERK transmit signals. The upstream sources of noise in signaling involving MAPK cascades have been amply documented (see, e.g., Schoeberl et al., 2002, Santos et al., 2012, Sasagawa et al., 2005), as have their downstream consequences, e.g., in the context of stem cell-fate decision making (Miyanari and Torres-Padilla, 2012, Schröter et al., 2015). The manner in which MEK and ERK modulate this variability is less well understood in detail. Our aim is to answer three related questions: (1) are the dynamics of the MEK-ERK module noisy; (2) where might this noise originate; and (3) how does noise in the MEK-ERK system affect the ability of this important molecular system to relay information reliably?

Figure 1
The MEK/ERK System and Modeling of the MEK/ERK Module

Below we will first quantify the levels of cell-to-cell variability sources of noise in the system, with a special focus on the dynamics of active, i.e., phosphorylated, MEK and ERK; after this we will identify the sources of such noise and compare their relative contributions to cell-to-cell variability. We will show that our analysis is robust to both qualitative as well as quantitative changes in the upstream stimulation. With this in hand, we can then turn to an investigation of the effects cell-to-cell variability has on the ability of cell populations to respond to fluctuating signals.

Results

Quantifying Temporal Evolution of Cell-to-Cell Variability

We investigate the causes of cellular heterogeneity in vivo during ERK activation by phosphorylated MEK in PC12 cells. This cell-to-cell variability study is based on measurements of the concentration of phosphorylated MEK and ERK at the single-cell level obtained by quantitative image cytometry. Cells are plated in medium containing a fixed amount of neuronal growth factor (NGF) as the stimulus at time t = 0. Every 2 min, cells in one well are stimulated in order to quantify the concentration of the two proteins of interest providing us with a series of cross-sectional snapshots of the joint protein distributions of the total amount of phosphorylated MEK and ERK, see Figure 2A.

Figure 2
Measurement of the Evolution of the Joint Protein Distributions of Phosphorylated MEK and Phosphorylated ERK

The observed distributions of the total amount of phosphorylated MEK and ERK are illustrated in Figures 2B and S1, and Figure 2C shows the evolution of the variance, the coefficient of variation and the Fano factor over time for both proteins. The variance over the cell population of the concentration is of the order of 105 and significantly varies with time. We have examined experimental noise versus cell-to-cell variability of total ERKs in unstimulated PC12 cells (Figure S2) (Uda et al., 2013) and found that the experimental noise is negligible. In addition, cell size, cell volume, and Hoechst level (the dye used to quantify nucleic acid levels) make only negligible contributions to observed levels of cell-to-cell variability (Figure S3). We can thus rule out cell cycle, etc. as explanations for or cause of the temporal variability in the amount of active ERK.

Statistical Investigation of the Cell-to-Cell Variability in the Core MEK-ERK Module

The analysis of the origins of cell-to-cell variability in the core MEK-ERK module (i.e., the MEK-ERK interactions as indicated by the red circle in Figure 1, left panel) requires us to determine the modes of ERK phosphorylation and dephosphorylation. ERK activation involves phosphorylation at both its tyrosine and threonine phosphorylation sites by its cognate kinase MEK (Ferrell and Bhatt, 1997, Ferrell and Ha, 2014). Previous studies (Toni et al., 2012) have shown that in vivo phosphorylation (as well as dephosphorylation) occurs in two steps where the kinase binds to the protein twice in order to phosphorylate the two sites successively (see Figure 1, bottom right). Using a Bayesian model selection approach, we confirm that this distributive mechanism best captures the observed average behavior in our data (see Figure S2). We therefore base our analysis of the origins of cell-to-cell variability on this mechanistic model with 20 model parameters including 12 reaction rates, four parameters describing the impact of the NGF stimulus and upstream signals and four parameters controlling the initial concentrations of the species involved in the MEK-ERK core system (see Figure 1 and Supplemental Experimental Procedures).

In this model of the MEK-ERK core module, we assume that the total abundance of ERK remains constant over the length of the experiment and is described by one of the model parameters. Previously, we had shown experimentally that total abundance of ERK does not change, while the levels of phosphorylation change considerably (Ozaki et al., 2010); therefore, it is indeed appropriate to model the cell-to-cell variability of total ERK as (extrinsic) parameter variability.

The workflow adopted in this analysis is summarized in Figure 3. Given the mechanistic model of ERK phosphorylation described above, we will start by quantifying the relative contribution of intrinsic noise and extrinsic noise in the MEK-ERK core module. As illustrated in Figure 3, intrinsic noise results from the stochastic nature of biochemical reactions, while extrinsic noise arises from inherent differences between the cells. We will then experimentally validate our model of cell-to-cell variability by considering the response of the MEK-ERK system to different stimuli, and we will finish with a detailed analysis of the main source of cellular heterogeneity in the MEK-ERK core and the overall impact on MAPK-mediated cellular information processing.

Figure 3
Elucidating the Origin of Cell-to-Cell Variability

Relative Contribution of Extrinsic and Intrinsic Noise in the MEK-ERK Core Module

While it is straightforward to model extrinsic and intrinsic noise, quantifying their relative contributions to real molecular systems has thus far only been possible for systems where two-reporter assays are available (Elowitz et al., 2002, Swain et al., 2002). Here, we develop a statistical framework that allows us to obtain quantitative insights into the roles of these two sources of noise for signaling systems where direct measurements are typically not possible.

Intrinsic variability between cells arises from the stochastic nature of biochemical reactions. Each reaction occurs at a random time, so, even if the molecular species concentrations are identical in every cell at the beginning of the experiment, their evolution will inevitably vary from one cell to another. This intrinsic variability has traditionally been modeled using stochastic simulation algorithms such as the Gillespie algorithm. Here, we aim to examine whether there exists parameter sets for which the stochasticity of the biochemical reactions induces a similar variability between cells to that observed in the experimental data. In order to infer such parameter sets, we use the linear noise approximation (LNA) (Elf and Ehrenberg, 2003, Ferm et al., 2008), which provides an explicit Gaussian likelihood for stochastic biochemical reactions (see Experimental Procedures).

Extrinsic sources of variability stem from all those elements of the “real system” that are not explicitly modeled; these typically include factors such as inherent differences between the cells in terms of protein concentrations at the start of the experiment, and other biophysical parameters. To capture such effects, we allow model parameters to differ between cells (Shahrezaei et al., 2008, Toni and Tidor, 2013): the parameters for each cell are drawn from a log-normal distribution (with means and variances that will be inferred from the data). The potential sources of extrinsic noise in the MEK-ERK system are differences in the reaction rates between cells in the (de-)phosphorylation process of ERK, different initial concentrations of ERK and MEK, and differences in the upstream signaling cascades feeding into the MEK dynamics. The log-normal distribution has two advantages: it allows only positive values for reaction rates, and it allows parameters to vary over orders of magnitude if indicated by the data.

Using the Bayesian framework developed in the Experimental Procedures, we analyze the roles of intrinsic and extrinsic noise in the single-cell data. The resulting statistical model evidence indicates that the extrinsic noise best explains the data. The evolution of the obtained distributions for MEK and ERK are shown and compared to the data in Figure 4A: only the extrinsic noise model can explain the observed high levels of cell-to-cell variability.

Figure 4
Intrinsic Noise Alone Cannot Explain the Observed Variability between Cells

Variation in initial conditions is also not sufficient to generate the observed cell-to-cell variability; this is easily seen by sampling different values for the initial concentration of the species involved in the MEK-ERK system according to a log-normal distribution with mean and variance (given by the inferred means and variances in the extrinsic noise case) and simulating the model with intrinsic noise for each of these initial conditions. The total variance, which is the sum of (1) the mean over the different initial conditions of the variance due to the intrinsic noise, and (2) the variance over the different initial conditions of the mean over the intrinsic variability, is shown in Figure 4B. This shows that the variance including variation in initial conditions does not differ appreciably from the variance of intrinsic noise alone.

In a biological system, we expect extrinsic and intrinsic sources of noise: the cells are likely to be different in terms of initial molecular concentrations and the biochemical reactions occur at random times. We therefore compare the variances of the observed molecular species under extrinsic noise alone with the total variances under both extrinsic and intrinsic noise. From Figure 4B, it is apparent that the contribution of intrinsic noise to the total variation is negligible.

In order to validate the model further, we consider the response of the MEK-ERK system to different stimuli; while the upstream dynamics will be different (different receptors and different upstream intermediates as well as dependence on stimulus strength and temporal pattern [Fujita et al., 2010, Toyoshima et al., 2012]), the core MEK-ERK model, if parameterized correctly, should capture the dynamics. Here, we therefore use the hyper-parameters inferred previously except for those that correspond to the upstream dynamics, which we inferred directly from the EGF and NGF time courses. We find that extrinsic noise model explains the response of the MEK-ERK system to stimulation by EGF (Figure 5A) and different NGF stimulus intensities (Figures 5B and S4). The model with extrinsic noise shows good qualitative and quantitative agreement between model predictions and the new data obtained for different stimulus. Thus, our extrinsic noise model is capable of predicting the response of the core MEK-ERK module to other stimuli than those used in the model development. EGF and NGF are known to give rise to very different downstream behavior (Santos et al., 2007), but the modular nature of MAPK signaling (Mody et al., 2009) means that the characterization of the MEK-ERK component for one input (a given concentration of NGF) already yields a model that can also explain the response to other stimuli.

Figure 5
Prediction of the Impact of Growth Factor on Cell-to-Cell Variability

Fluctuations in the Upstream Reactions and in the Degradation Rate of the Kinase Explain Most of the Cell-to-Cell Variability

Our Bayesian analysis allows us to assess directly which parameters differ most between cells. For each parameter, we have estimates of the coefficient of variation across cells, and the parameters that contribute most to the observed cell-to-cell variability are those for which the inferred coefficient of variation is consistently and significantly different from zero (see Figure S6). We find five strongly contributing factors: three model parameters (k1, k2, and k10) and the two initial conditions that describe the level of background activity present in the cell at the point of stimulation. The degradation rate of active MEK (k2) affects the steady-state levels of cell-to-cell variability; the role of degradation reactions in determining levels of noise (and thus cell-to-cell variability) has been previously studied (Komorowski et al., 2013). The pulse height, k1, and the background upstream signal, k10, jointly characterize the impact of the NGF stimulus and the upstream reactions on the evolution of active MEK (see Figure 1, top right). The origins of noise upstream of MEK are well documented and therefore expected; here, our focus is on how MEK-ERK core dynamics modulate such variability. In Figure 6A, we illustrate the predominant role that these three model parameters that describe the effect of the upstream signal (k1, k2, and k10) have on the extent of cell-to-cell variability in this system.

Figure 6
Factors Contributing to Cell-to-Cell Variability

To further investigate the role of the noise upstream to MEK compared to the noise in the core MEK-ERK module, we compare the joint distribution of the total amount of phosphorylated MEK and ERK when the system is simulated under the full extrinsic noise model or only varying the “driving” parameters k1 and k10 between cells (see Figure 6B). Simply varying the “driving” parameters can explain the evolution of the variance and correlation between the two proteins; the joint distribution of active MEK and ERK is only slightly better captured when we consider all the factors in the full extrinsic noise model.

Impact of Cell-to-Cell Variability on Cellular Information Processing

We conclude our analysis by investigating the role that noise plays in mediating the response of the MEK-ERK module to external stimuli. We compute the mutual information between the total amount of phosphorylated MEK and ERK at different time points, simulating the system under extrinsic noise or varying only the parameters that seems to be related to most of the cellular variability (k1, k2, and k10)—all other model parameters are fixed to the inferred posterior mean values. We observe in Figure 7A that the presence of extrinsic noise decreases the level of transfer of information between the two species of interest. Thus, in a heterogeneous population of cells the statistical dependence between active MEK and ERK or, in other words, the expected information flowing through the MEK-ERK module is decreased. In light of the modest effect that within-module extrinsic noise appears to have on overall patterns of cell-to-cell variability in Figure 6, this profound change to the information transmission reliability might seem surprising. But it does reflect the complex behavior of the mutual information that can result from the interplay between system dynamics and extrinsic noise, and which has been demonstrated theoretically elsewhere (Mc Mahon et al., 2015). In other words, variability in the upstream signals is faithfully transmitted (active ERK is approximately proportional to active MEK) if we ignore variability in the other factors. But when this is taken into account, this relationship becomes less well defined and at the population level the flow of information through MEK-ERK is radically decreased.

Figure 7
Information Processing of the MEK/ERK Module

To follow on from this, we analyze the level of cell-to-cell variability in the system’s output (i.e., the total amount of phosphorylated ERK) as a function of how variable the inputs (captured by the transient and sustained upstream intensities, k1 and k10, and their respective variances over the cell population σk12 and σk102) are. We simulate system output for given values of σk12 and σk102 and compute the ratio

λ(σk1,σk10,t)=s(σk1,σk10,t)s(σk1,σk10,t),

where s(σk1,σk10,t) is the SD of the output at time t (see Figure 7B). Note that σk1=μk1 and σk10=μk10 are the maximum values of these SD, where μk1 and μk10 are the means over the cell population for, respectively, k1 and k10. The ratio λ(σk1,σk10,t) quantifies the change in the level of cell-to-cell variability in the system’s output as the noise level in the input is decreased.

In the first instance, we assume that only the input signal strengths (k1 and k10) vary between cells. The evolution of λ(σk1,σk10,t) over time when varying the variances σk12 and σk102 is shown in Figure 7C (left column). Before t = 8 min, λ(σk1,σk10,t) increases with σk12, whereas σk102 has no impact on λ(σk1,σk10,t). Conversely, after t = 24 min, λ(σk1,σk10,t) increases with σk102 but σk12 no longer affects output variability. Thus variability in active ERK abundance across the cell population is initially strongly influenced by the variability in pulse height, k1, and subsequently by the variability in the sustained or background signal, k10.

To investigate further the effect of the variability in all model parameters on cellular information processing, we also simulate the system under extrinsic noise (varying all model parameters between cells) and compute once more λ(σk1,σk10,t) for different signal variabilities. It is apparent from Figure 7C (right column) that, under the extrinsic noise model, the level of cell-to-cell variability in the system’s output remains substantially high even when the variability in the system’s input has been decreased considerably (λ [similar, equals] 0.45 when σk1 and σk10 are divided by 20). Again the presence of extrinsic noise weakens the efficiency of signal transduction.

Discussion

In this study, we have used quantitative image cytometry to elucidate the causes of population heterogeneity in the MAPK signaling cascade and presented a comprehensive analysis of cell-to-cell variability in the activation dynamics of the MEK-ERK system to environmental stimuli. With a reliable model for the (de-)phosphorylation mechanisms in hand, we were able to dissect the nature of the cell-to-cell variability inherent in the data. Recent models for ERK phosphorylation proposed in the literature (Ortega et al., 2006, Sturm et al., 2010, Harrington et al., 2013, Ferrell and Ha, 2014, Voliotis et al., 2014) allow for very rich dynamics, and a priori it is therefore impossible to make an appeal to the large number of MEK, ERK, and other molecules present in the eukaryotic cell, in order to rule out a role for intrinsic noise. The statistical framework developed for this study, however, gives a clear verdict in favor of extrinsic noise as the dominant factor for the observed cell-to-cell variability in the MEK-ERK system.

With the primary role of extrinsic noise established, we analyzed the contributions to cell-to-cell variability that arise from the different extrinsic sources of noise. Upstream of MEK many potential sources of noise and cell-to-cell variability have been identified in the literature, and our framework captures their contribution. In this study, the focus has been on the contributions to noise that arise from within the MEK-ERK module—this should be taken as akin to establishing the noise characteristics of, e.g., a transistor in electronics. We do find that there is considerable extrinsic variability in the module dynamics. However, the overall contribution of these within-module extrinsic sources of noise to the total dynamics quantitatively studied here are smaller than the upstream sources’ contributions.

We then investigated how this extrinsic noise interferes with signal transduction. Our analysis shows that the overall joint distribution of phosphorylated MEK and ERK can be understood largely in terms of the upstream noise. The full model that accounts for extrinsic variability both upstream and within-module can be argued to capture more of the nuances seen in the empirical data but otherwise does not differ very much. However, these two scenarios have profoundly different impact on the ability of the MEK-ERK module to transmit upstream information to the activity profile of phosphorylated ERK: without extrinsic noise in the core module, variable (including noisy) signals would be faithfully reproduced downstream. But the extrinsic variability in the module parameters distorts these signals and leads to a drastic reduction in the mutual information between incoming signal and ERK activity.

Our results can be interpreted in two ways: we may simply regard the MEK-ERK module as poorly engineered as its behavior depends on the cellular context, or we may view this as a bet hedging (Stumpf et al., 2002, Kussell and Leibler, 2005) strategy, which poises different cells to respond differentially to stimulation, thereby reducing the risk of an inappropriate population wide response to noisy signals. In development and tissue homeostasis (Rué and Martinez Arias, 2015) (and in regenerative medicine), it may be important to find ways to regulate population-level behavior; e.g., using inter- and intra-cellular feedback mechanisms that control cell-to-cell variability further (Michailovici et al., 2014).

The study presented here is based on experiments carried out in PC12 cell lines (Greene and Tischler, 1976), which, unlike in vitro setups, provide the cell physiological context. The activity of upstream and downstream processes affecting ERK may depend on cell type; this has, for example, been shown for nuclear shuttling, where even subtle differences between different cell lines can affect, e.g., the activity of nuclear ERK (Harrington et al., 2012). Our deliberate focus on the core MEK-ERK dynamics is less prone to such strong cell-type specificity over the timescales considered, whereas the potential of feedback from either ERK or any of its many downstream targets onto the MAPK cascade or proteins further upstream should be carefully considered in different cell types. The additional richness in behavior that such feedback (Ortega et al., 2006, Sturm et al., 2010) or explicit consideration of nuclear shuttling (Harrington et al., 2013) of ERK and MEK can induce warrants further investigation (Ozaki et al., 2010); here, over the time course considered, and in light of the data available such effects are marginal, but this may change as longer or more complex temporal stimulation patterns are considered. At the single-cell level, both feedback and shuttling are therefore clearly worth of further investigation.

It is important to keep in mind that no model will ever be able to contain all the constituent parts of any biological system of any real-world relevance. Therefore, extrinsic noise will always be an issue for modeling molecular and cellular systems. There are practical limitations to the current approach; notably it is not possible to fully describe correlations among the different extrinsic sources of noise (the number of parameters that we would have to estimate is simply too large); for example, interactions between kinases and phosphatases (Swain and Siggia, 2002) in MAPK may shape the response dynamics and such interactions are hard to capture in the extrinsic noise model. We believe, however, that the in silico approach developed here can serve to highlight such factors and may therefore be a guide to deciding which system aspects ought to be modeled explicitly. By pinpointing the sources of extrinsic noise, which are typically not obvious a priori, sound statistical modeling is able to provide deeper mechanistic insights and highlight where a model ought to be extended, or whether this is indeed necessary.

Experimental Procedures

Experimental Data Collecting Process

The concentrations of molecular species were measured using quantitative image cytometry (QIC) (Ozaki et al., 2010, Saito et al., 2013). PC12 cells were seeded at a density of 104 cells per well in 96-well poly-L-lysine-coated glass-bottomed plates (Thermo Fisher Scientific). 24 hr after seeding, the medium was replaced with DMEM containing 25 mM HEPES and 0.1% of BSA. 18 hr after serum starvation, the stimulus is applied by replacing the starvation serum with a medium containing the stimulant (5 or 0.5 or 0.1 ng/ml). Our setup carries out stimulation in an incubator and achieved 1-min interval stimulation at 37°C under 5% CO2 in saturated air humidity. The cells are then fixed with 4% paraformaldehyde for 10 min and immunostained. Cells were subjected to QIC analysis with mouse anti-ppERK1/2 Sigma-Aldrich M8159 antibody and rabbit anti-pMEK1/2 Cell Signaling Technology 9121. Note that anti-pMEK antibody detects both singly (pS217 or pS221 alone) and doubly (pS217/221) phosphorylated MEK. Mouse monoclonal anti-ERK antibody (#4696, Cell Signaling Technology) and rabbit polyclonal anti-ERK antibody(#9102, Cell Signaling Technology) were used in Figure S2.

All images were analyzed with Cell Profiler (Kamentsky et al., 2011). The nuclear region was identified based on Hoechst imaging, and the cellular region was identified based on CellMask-stained images going out from the nuclear region. Total cellular signal intensity in nuclear regions and cellular regions were measured for ppERK and pMEK, respectively. We used these intensities as the concentrations of molecules. We used the cellular region in pixels as the cell size and the intensity of CellMask in the cellular region as a measure of cell volume.

The antibody against pMEK used detects both MEK1 and MEK2, all isoforms that phosphorylates ERK. In this study, we assume that the total phosphorylated MEK corresponds to doubly phosphorylated MEK. It is noted that no current technology is available to quantify the amounts of singly and doubly phosphorylated MEK. The antibody against ppERK detects both ERK1 and ERK2, all isoforms that are expressed in PC12 cells. To the best of our knowledge, there is no functional difference between the isoforms for both MEK and ERK at least in PC12 cells. Therefore, we did not make distinction between isoforms in this study.

Parameter Inference and Model Evidence

We use a Bayesian approach in order to infer the parameters of the system (see Supplemental Experimental Procedures for a detailed list of the model parameters) and rank the candidate mechanistic models. Bayesian parameter inference is centered around the posterior probability distribution, p(θ|x), which strikes a compromise between prior knowledge, p(θ), about parameter vectors, θ, and the capacity of a parameter to explain the observed data, x, measured by the likelihood p(x|θ), via

p(θ|x)=p(θ)p(x|θ)p(θ˜)p(x|θ˜)dθ˜.

Here, we evaluate the posterior using a sequential Monte Carlo (SMC) sampler proposed by Del Moral et al. (2006), which is easily parallelized. The output of the algorithm is a set of weighted parameter vectors {θ(i),ω(i)}1iN. Here the parameter vector associated to the highest weight is called the inferred parameter vector. Technical details about our implementation of the SMC sampler algorithm are given in Supplemental Experimental Procedures.

The SMC sampler algorithm also enables us to evaluate the model evidence (Kirk et al., 2013), which is the probability to observe the data x under the model M (given the alternative models considered),

p(x|M)=p(θ|x,M)p(θ|M)dθ.

The model evidence allows us to rank candidate models in terms of their ability to explain the observed data x*: the best model is the one with the highest model evidence. In addition, the Bayes factor assesses the plausibility of two candidate models M1 and M2:

BF1,2=p(x|M1)p(x|M2).

Whenever BF1,2 is larger than 30, the evidence in favor of model M1 is considered very strong (Jeffreys, 1961). We use our own implementation of the SMC sampler algorithm in Python as well as an interface to simulate the models in a computational efficient manner using a graphics processing unit (GPU) accelerated ordinary differential equation (ODE) solver (Zhou et al., 2011) and a C++ ODE solver for stiff models (Hindmarsh et al., 2005).

Likelihood Functions

At each time point tT={0,2,4,50}, the total amount of doubly phosphorylated MEK and ERK are measured in Nt different cells. We denote by xi,t and yi,t the concentration of the two proteins in the i-th cell, 1iNt, and by {x¯t}tT and {y¯t}tT the observed average trajectories. In addition, we denote by xt(θ) and yt(θ) the solution of the system of ODE given the parameter vector θ at time t.

Assuming an independent Gaussian measurement error for each time point with constant variance v, the likelihood function for the average data measurements is

p({x¯t,y¯t}tT|θ)=tTϕ(x¯t;xt(θ),v)ϕ(y¯t;yt(θ),v),

where ϕ(.;m,v) is the probability density function of a normal distribution of mean m and variance v. The variance v is inferred simultaneously with the other parameters.

In order to derive the likelihood function in the intrinsic noise model efficiently (Golightly and Wilkinson, 2015), we use the linear noise approximation (LNA). The LNA provides a system of ODEs, which describes how the means and the variances of the molecular species vary over time. These equations are produced using the StochSens package (Komorowski et al., 2012). With mtx(θ), mty(θ), vtx(θ), and vty(θ) denoting the solutions of the ODEs describing the means and variances for the parameter θ at time t, the likelihood p({xi,t,yi,t}i,t|θ) is equal to

tTi=1Ntϕ(xi,t;mtx(θ),vtx(θ))ϕ(yi,t;mty(θ),vty(θ)).

Extrinsic noise is modeled by considering that each cell has a different set of parameters. The distribution of each parameter across the cell population is assumed to be log-normal. We assume that these distributions are independent and denote by μθ and σθ2 the vector of the means and variances of these distribution, respectively. Due to computational cost, we do not consider any correlation between the parameters. There is no closed-form expression for the probability p({xi,t,yi,t}i,t|μθ,σθ2), and we use the so-called Unscented Transform (UT) (Silk et al., 2011), which, given the first two moments μθ and σθ2 of the distribution in the parameter space, provides an approximation of the evolution of the means and variances of the two species of interest.

We denote by mtx(μθ,σθ2) and mty(μθ,σθ2) the resulting mean behaviors of the two species at time t, and by vtx(μθ,σθ2) and vty(μθ,σθ2) the associated variances. Assuming that the concentration of the doubly phosphorylated MEK and ERK proteins are log-normally distributed, we obtain that the likelihood p({xi,t,yi,t}i,t|μθ,σθ2) is

tTi=1Ntψ(xi,t;mtx(μθ,σθ2),vtx(μθ,σθ2))ψ(yi,t;mty(μθ,σθ2),vty(μθ,σθ2)).

Here ψ(.;m,v) is the probability density function of a log-normal distribution with mean m and variance v. The Supplemental Experimental Procedures contains additional technical details on the computation and the UT algorithm.

Mutual Information

The mutual information between two species (ppERK and ppMEK) is computed based on measurements of the protein concentrations in single-cells at different time points (Mc Mahon et al., 2015). For each time point, we estimate the mutual information using a kernel density estimate of the joint distribution. We use a Gaussian kernel with a diagonal covariance matrix and marginal variances equal to 1.06σN–1/5 where σ is the marginal variance of the data and N is the number of data points (Silverman, 1986).

Author Contributions

S.F., C.P.B., S.K., and M.P.H.S. designed the study; T.K., K.K., T.T., T.W., and S.K. performed the data collection and initial processing; S.F., C.P.B., P.D.W.K., and S.S.M. performed modeling and statistical analysis; S.F., C.P.B., P.D.W.K., S.K., and M.P.H.S. wrote the paper; all authors approved the final version of the manuscript.

Acknowledgments

P.D.W.K., T.K., S.K., and M.P.H.S. acknowledge financial support from the Human Frontiers Science Programme; S.F. was funded through an MRC Biocomputing fellowship; C.P.B. is a Wellcome Trust Career Development Fellow; S.F., C.P.B., P.D.W.K., S.K., and M.P.H.S. were also funded through a JST/BBSRC partnering award. M.P.H.S. is Royal Society Wolfson Research Merit Award holder.

Notes

Published: June 2, 2016

Footnotes

Supplemental Information includes Supplemental Experimental Procedures and seven figures and can be found with this article online at http://dx.doi.org/10.1016/j.celrep.2016.05.024.

Supplemental Information

Document S1. Supplemental Experimental Procedures and Figures S1–S7:
Document S2. Article plus Supplemental Information:

References

Aoki K., Yamada M., Kunida K., Yasuda S., Matsuda M. Processive phosphorylation of ERK MAP kinase in mammalian cells. Proc. Natl. Acad. Sci. USA. 2011;108:12675–12680. [PubMed]
Ashall L., Horton C.A., Nelson D.E., Paszek P., Harper C.V., Sillitoe K., Ryan S., Spiller D.G., Unitt J.F., Broomhead D.S. Pulsatile stimulation determines timing and specificity of NF-kappaB-dependent transcription. Science. 2009;324:242–246. [PubMed]
Balázsi G., van Oudenaarden A., Collins J.J. Cellular decision making and biological noise: from microbes to mammals. Cell. 2011;144:910–925. [PubMed]
Batchelor E., Loewer A., Mock C., Lahav G. Stimulus-dependent dynamics of p53 in single cells. Mol. Syst. Biol. 2011;7:488. [PubMed]
Bowsher C.G., Swain P.S. Identifying sources of variation and the flow of information in biochemical networks. Proc. Natl. Acad. Sci. USA. 2012;109:E1320–E1328. [PubMed]
Colman-Lerner A., Gordon A., Serra E., Chin T., Resnekov O., Endy D., Pesce C.G., Brent R. Regulated cell-to-cell variation in a cell-fate decision system. Nature. 2005;437:699–706. [PubMed]
Del Moral P., Doucet A., Jasra A. Sequential Monte Carlo samplers. J. R. Stat. Soc. Ser. B. Stat. Methodol. 2006;68:411–436.
Elf J., Ehrenberg M. Fast evaluation of fluctuations in biochemical networks with the linear noise approximation. Genome Res. 2003;13:2475–2484. [PubMed]
Elowitz M.B., Levine A.J., Siggia E.D., Swain P.S. Stochastic gene expression in a single cell. Science. 2002;297:1183–1186. [PubMed]
Eser U., Falleur-Fettig M., Johnson A., Skotheim J.M. Commitment to a cellular transition precedes genome-wide transcriptional change. Mol. Cell. 2011;43:515–527. [PubMed]
Ferm L., Lötstedt P., Hellander A. A hierarchy of approximations of the master equation scaled by a size parameter. J. Sci. Comput. 2008;34:127–151.
Ferrell J.E., Jr., Bhatt R.R. Mechanistic studies of the dual phosphorylation of mitogen-activated protein kinase. J. Biol. Chem. 1997;272:19008–19016. [PubMed]
Ferrell J.E., Jr., Ha S.H. Ultrasensitivity part II: multisite phosphorylation, stoichiometric inhibitors, and positive feedback. Trends Biochem. Sci. 2014;39:556–569. [PubMed]
Fujita K.A., Toyoshima Y., Uda S., Ozaki Y., Kubota H., Kuroda S. Decoupling of receptor and downstream signals in the Akt pathway by its low-pass filter characteristics. Sci. Signal. 2010;3:ra56. [PubMed]
Geva-Zatorsky N., Rosenfeld N., Itzkovitz S., Milo R., Sigal A., Dekel E., Yarnitzky T., Liron Y., Polak P., Lahav G. Oscillations and variability in the p53 system. Mol. Sys. Biol. 2006 Published online June 13, 2006. [PMC free article] [PubMed]
Golightly A., Wilkinson D.J. Bayesian inference for Markov jump processes with informative observations. Stat. Appl. Genet. Mol. Biol. 2015;14:169–188. [PubMed]
Greene L.A., Tischler A.S. Establishment of a noradrenergic clonal line of rat adrenal pheochromocytoma cells which respond to nerve growth factor. Proc. Natl. Acad. Sci. USA. 1976;73:2424–2428. [PubMed]
Harrington H.A., Komorowski M., Beguerisse-Diaz M., Ratto G.M., Stumpf M.P.H. Mathematical modeling reveals the functional implications of the different nuclear shuttling rates of Erk1 and Erk2. Phys. Biol. 2012;9:36001. [PubMed]
Harrington H.A., Feliu E., Wiuf C., Stumpf M.M.P. Cellular compartments cause multistability and allow cells to process more information. Biophys. J. 2013;104:1824–1831. [PubMed]
Hilfinger A., Paulsson J. Separating intrinsic from extrinsic fluctuations in dynamic biological systems. Proc. Natl. Acad. Sci. USA. 2011;108:12167–12172. [PubMed]
Hindmarsh A.C., Brown P.N., Grant K.E., Lee S.L., Serban R., Shumaker D.E., Woodward C.S. SUNDIALS: suite of nonlinear and differential/algebraic equation solvers. ACM T. on Math. Software. 2005;31:363–396.
Inder K., Harding A., Plowman S.J., Philips M.R., Parton R.G., Hancock J.F. Activation of the MAPK module from different spatial locations generates distinct system outputs. Mol. Biol. Cell. 2008;19:4776–4784. [PubMed]
Jeffreys H. Oxford University Press; 1961. Theory of Probability.
Jeschke M., Baumgärtner S., Legewie S. Determinants of cell-to-cell variability in protein kinase signaling. PLoS Comput. Biol. 2013;9:e1003357. [PubMed]
Johnston I.G. Efficient parametric inference for stochastic biological systems with measured variability. Stat. Appl. Genet. Mol. Biol. 2014;13:379–390. [PubMed]
Kamentsky L., Jones T.R., Fraser A., Bray M.A., Logan D.J., Madden K.L., Ljosa V., Rueden C., Eliceiri K.W., Carpenter A.E. Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software. Bioinformatics. 2011;27:1179–1180. [PubMed]
Kiel C., Serrano L. Cell type-specific importance of Ras-c-Raf complex association rate constants for MAPK signaling. Sci. Signal. 2009;2:ra38. [PubMed]
Kirk P., Thorne T., Stumpf M.P. Model selection in systems and synthetic biology. Curr. Opin. Biotechnol. 2013;24:767–774. [PubMed]
Komorowski M., Finkenstädt B., Rand D. Using a single fluorescent reporter gene to infer half-life of extrinsic noise and other parameters of gene expression. Biophys. J. 2010;98:2759–2769. [PubMed]
Komorowski M., Zurauskiene J., Stumpf M.P.H. StochSens--Matlab package for sensitivity analysis of stochastic chemical systems. Bioinformatics. 2012;28:731–733. [PubMed]
Komorowski M., Miękisz J., Stumpf M.P. Decomposing noise in biochemical signaling systems highlights the role of protein degradation. Biophys. J. 2013;104:1783–1793. [PubMed]
Kussell E., Leibler S. Phenotypic diversity, population growth, and information in fluctuating environments. Science. 2005;309:2075–2078. [PubMed]
Mc Mahon S.S., Lenive O., Filippi S., Stumpf M.P.H. Information processing by simple molecular motifs and susceptibility to noise. J. R. Soc. Interface. 2015;12:0597. [PubMed]
Michailovici I., Harrington H.A., Azogui H.H., Yahalom-Ronen Y., Plotnikov A., Ching S., Stumpf M.P., Klein O.D., Seger R., Tzahor E. Nuclear to cytoplasmic shuttling of ERK promotes differentiation of muscle stem/progenitor cells. Development. 2014;141:2611–2620. [PubMed]
Miyanari Y., Torres-Padilla M.-E. Control of ground-state pluripotency by allelic regulation of Nanog. Nature. 2012;483:470–473. [PubMed]
Mody A., Weiner J., Ramanathan S. Modularity of MAP kinases allows deformation of their signalling pathways. Nat. Cell Biol. 2009;11:484–491. [PubMed]
Nelson D.E., Ihekwaba A.E., Elliott M., Johnson J.R., Gibney C.A., Foreman B.E., Nelson G., See V., Horton C.A., Spiller D.G. Oscillations in NF-kappaB signaling control the dynamics of gene expression. Science. 2004;306:704–708. [PubMed]
Ortega F., Garcés J.L., Mas F., Kholodenko B.N., Cascante M. Bistability from double phosphorylation in signal transduction. Kinetic and structural requirements. FEBS J. 2006;273:3915–3926. [PubMed]
Ozaki Y., Uda S., Saito T.H., Chung J., Kubota H., Kuroda S. A quantitative image cytometry technique for time series or population analyses of signaling networks. PLoS ONE. 2010;5:e9955. [PubMed]
Paszek P., Ryan S., Ashall L., Sillitoe K., Harper C.V., Spiller D.G., Rand D.A., White M.R.H. Population robustness arising from cellular heterogeneity. Proc. Natl. Acad. Sci. USA. 2010;107:11644–11649. [PubMed]
Piala A.T., Humphreys J.M., Goldsmith E.J. MAP kinase modules: the excursion model and the steps that count. Biophys. J. 2014;107:2006–2015. [PubMed]
Pujadas E., Feinberg A.P. Regulated noise in the epigenetic landscape of development and disease. Cell. 2012;148:1123–1131. [PubMed]
Quaranta V., Garbett S.P. Not all noise is waste. Nat. Methods. 2010;7:269–272. [PubMed]
Roberts P.J., Der C.J. Targeting the Raf-MEK-ERK mitogen-activated protein kinase cascade for the treatment of cancer. Oncogene. 2007;26:3291–3310. [PubMed]
Rué P., Martinez Arias A. Cell dynamics and gene expression control in tissue homeostasis and development. Mol. Syst. Biol. 2015;11:792. [PubMed]
Saito T.H., Uda S., Tsuchiya T., Ozaki Y., Kuroda S. Temporal decoding of MAP kinase and CREB phosphorylation by selective immediate early gene expression. PLoS ONE. 2013;8:e57037. [PubMed]
Santos S.D.M., Verveer P.J., Bastiaens P.I.H. Growth factor-induced MAPK network topology shapes Erk response determining PC-12 cell fate. Nat. Cell Biol. 2007;9:324–330. [PubMed]
Santos S.D.M., Wollman R., Meyer T., Ferrell J.E.J., Jr. Spatial positive feedback at the onset of mitosis. Cell. 2012;149:1500–1513. [PubMed]
Sasagawa S., Ozaki Y.-i., Fujita K., Kuroda S. Prediction and validation of the distinct dynamics of transient and sustained ERK activation. Nat. Cell Biol. 2005;7:365–373. [PubMed]
Schoeberl B., Eichler-Jonsson C., Gilles E.D., Müller G. Computational modeling of the dynamics of the MAP kinase cascade activated by surface and internalized EGF receptors. Nat. Biotechnol. 2002;20:370–375. [PubMed]
Schröter C., Rué P., Mackenzie J.P., Martinez Arias A. FGF/MAPK signaling sets the switching threshold of a bistable circuit controlling cell fate decisions in embryonic stem cells. Development. 2015;142:4205–4216. [PubMed]
Selimkhanov J., Taylor B., Yao J., Pilko A., Albeck J., Hoffmann A., Tsimring L., Wollman R. Systems biology. Accurate information transmission through dynamic biochemical signaling networks. Science. 2014;346:1370–1373. [PubMed]
Shahrezaei V., Ollivier J.F., Swain P.S. Colored extrinsic fluctuations and stochastic gene expression. Mol. Sys. Biol. 2008;4 [PMC free article] [PubMed]
Silk D., Kirk P.D., Barnes C.P., Toni T., Rose A., Moon S., Dallman M.J., Stumpf M.P.H. Designing attractive models via automated identification of chaotic and oscillatory dynamical regimes. Nat. Commun. 2011;2:489. [PubMed]
Silverman B.W. CRC Press; 1986. Density Estimation for Statistics and Data Analysis.
Spencer S.L., Gaudet S., Albeck J.G., Burke J.M., Sorger P.K. Non-genetic origins of cell-to-cell variability in TRAIL-induced apoptosis. Nature. 2009;459:428–432. [PubMed]
Spiller D.G., Wood C.D., Rand D.A., White M.R.H. Measurement of single-cell dynamics. Nature. 2010;465:736–745. [PubMed]
Stumpf M.P.H., Laidlaw Z., Jansen V.A.A. Herpes viruses hedge their bets. Proc. Natl. Acad. Sci. USA. 2002;99:15234–15237. [PubMed]
Sturm O.E., Orton R., Grindlay J., Birtwistle M., Vyshemirsky V., Gilbert D., Calder M., Pitt A., Kholodenko B., Kolch W. The mammalian MAPK/ERK pathway exhibits properties of a negative feedback amplifier. Sci. Signal. 2010;3:ra90. [PubMed]
Swain P.S., Siggia E.D. The role of proofreading in signal transduction specificity. Biophys. J. 2002;82:2928–2933. [PubMed]
Swain P.S., Elowitz M.B., Siggia E.D. Intrinsic and extrinsic contributions to stochasticity in gene expression. Proc. Natl. Acad. Sci. USA. 2002;99:12795–12800. [PubMed]
Takahashi K., Tanase-Nicola S., ten Wolde P.R. Spatio-temporal correlations can drastically change the response of a MAPK pathway. Proc. Natl. Acad. Sci. USA. 2010;107:2473–2478. [PubMed]
Toni T., Tidor B. Combined model of intrinsic and extrinsic variability for computational network design with application to synthetic biology. PLoS Comput. Biol. 2013;9:e1002960. [PubMed]
Toni T., Ozaki Y., Kirk P., Kuroda S., Stumpf M.P.H. Elucidating the in vivo phosphorylation dynamics of the ERK MAP kinase using quantitative proteomics data and Bayesian model selection. Mol. Biosyst. 2012;8:1921–1929. [PubMed]
Toyoshima Y., Kakuda H., Fujita K.A., Uda S., Kuroda S. Sensitivity control through attenuation of signal transfer efficiency by negative regulation of cellular signalling. Nat. Commun. 2012;3:743. [PubMed]
Uda S., Saito T.H., Kudo T., Kokaji T., Tsuchiya T., Kubota H., Komori Y., Ozaki Y., Kuroda S. Robustness and compensation of information transmission of signaling pathways. Science. 2013;341:558–561. [PubMed]
Voliotis M., Perrett R.M., McWilliams C., McArdle C.A., Bowsher C.G. Information transfer by leaky, heterogeneous, protein kinase signaling systems. Proc. Natl. Acad. Sci. USA. 2014;111:E326–E333. [PubMed]
Zhou Y., Liepe J., Sheng X., Stumpf M.P.H., Barnes C. GPU accelerated biochemical network simulation. Bioinformatics. 2011;27:874–876. [PubMed]