PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of ploscompComputational BiologyView this ArticleSubmit to PLoSGet E-mail AlertsContact UsPublic Library of Science (PLoS)
 
PLoS Comput Biol. Apr 2013; 9(4): e1003006.
Published online Apr 18, 2013. doi:  10.1371/journal.pcbi.1003006
PMCID: PMC3630147
Lifespan Differences in Hematopoietic Stem Cells are Due to Imperfect Repair and Unstable Mean-Reversion
Hans B Sieburg,* Giulio Cattarossi, and Christa E. Muller-Sieburg
Stem Cell and Regenerative Medicine Program, The Sanford-Burnham Medical Research Institute, La Jolla, California, United States of America
Mark S. Alber, Editor
University of Notre Dame, United States of America
* E-mail: hsieburg/at/sanfordburnham.org
The authors have declared that no competing interests exist.
Conceived and designed the experiments: CEMS. Performed the experiments: GC. Analyzed the data: HBS. Wrote the paper: HBS CEMS.
Received September 21, 2012; Accepted February 8, 2013.
The life-long supply of blood cells depends on the long-term function of hematopoietic stem cells (HSCs). HSCs are functionally defined by their multi-potency and self-renewal capacity. Because of their self-renewal capacity, HSCs were thought to have indefinite lifespans. However, there is increasing evidence that genetically identical HSCs differ in lifespan and that the lifespan of a HSC is predetermined and HSC-intrinsic. Lifespan is here defined as the time a HSC gives rise to all mature blood cells. This raises the intriguing question: what controls the lifespan of HSCs within the same animal, exposed to the same environment? We present here a new model based on reliability theory to account for the diversity of lifespans of HSCs. Using clonal repopulation experiments and computational-mathematical modeling, we tested how small-scale, molecular level, failures are dissipated at the HSC population level. We found that the best fit of the experimental data is provided by a model, where the repopulation failure kinetics of each HSC are largely anti-persistent, or mean-reverting, processes. Thus, failure rates repeatedly increase during population-wide division events and are counteracted and decreased by repair processes. In the long-run, a crossover from anti-persistent to persistent behavior occurs. The cross-over is due to a slow increase in the mean failure rate of self-renewal and leads to rapid clonal extinction. This suggests that the repair capacity of HSCs is self-limiting. Furthermore, we show that the lifespan of each HSC depends on the amplitudes and frequencies of fluctuations in the failure rate kinetics. Shorter and longer lived HSCs differ significantly in their pre-programmed ability to dissipate perturbations. A likely interpretation of these findings is that the lifespan of HSCs is determined by preprogrammed differences in repair capacity.
All hematopoietic stem cells (HSCs) are characterized by the capacities to produce all blood cell-types by differentiation and to maintain their own population through self-renewal divisions. Every individual HSC, therefore, can generate a complete blood system, or clone, conveying oxygenation and immune protection for a limited time. The time for which all mature blood cell-types can be found in a clone is called the lifespan. Interestingly, HSCs with different lifespans co-exist in the same host. We address the unresolved question: what controls the lifespan of HSCs of the same genotype exposed to the same environment? Here, we use a new approach to multi-scale modeling based on reliability theory and non-linear dynamics to address this question. Large-scale fluctuations in the experimental failure rate kinetics of HSC clones are identified to predict small-scale, genome level, events of deep penetrance, or magnitudes that approach population size. We broadly find that one condition explains our experimental data: repair mechanisms are a priori imperfect and do not improve, nor deteriorate, during the lifespan. As a result, progressively “worse-than-old” genome replicates are generated in self-renewal. A likely interpretation of our findings is that the lifespan of adult HSCs is determined by epigenetically pre-programmed differences in repair capacity.
Adult tissue stem cells, such as hematopoietic stem cells (HSCs), are distinguished from mature cells by the ability to generate all mature cell-types of a particular tissue (multi-potency). To generate mature cells, HSCs differentiate into cells of lower potency. The resulting loss of stem cells must be compensated for by self-renewal, i.e. cell divisions which preserve the multi-potential differentiation capacity of the ancestral HSC. The reliability with which HSCs can transfer their identity and maintain self-renewal upon proliferation has been of keen interest to the field [1], [2]. Important questions are: Are daughter HSCs “as good as old” after self-renewal? How often can individual HSCs self-renew? Do different HSCs have different self-renewal capacities? What controls the fidelity of self-renewal? These questions remain incompletely understood.
Because of their extensive self-renewal capacity, HSCs were initially thought to be immortal. This view was supported by the observation that populations of HSCs could be serially transplanted for a very long period of time - exceeding the normal lifespan of the donor [3], [4]. However, when HSCs were examined on the clonal level, extensive heterogeneity in lifespan was revealed [5][7]. A detailed analysis of a large panel of HSCs showed that the lifespan of individual HSCs is mathematically predictable [8]. HSCs with lifespans from 10 to nearly 60 months were found side-by-side in the same donor [8], indicating that the lifespan is pre-determined on the level of each HSC. Because lifespans of single transplanted HSCs are predictable from few initial values of their repopulation kinetic, the lifespan is a programmed HSC-specific property [8]. The population dynamics, therefore, predict that the molecular machinery which preserves self-renewal, will ultimately fail.
Several hypotheses have been developed to identify and explain how HSCs limit their lifespan. The generation-age hypothesis [9] states that for every cell division, an HSC loses some quality that is referred to as “stemness”.
According to Hayflick's hypothesis [10], the probability that somatic cells produce viable daughter cells which can themselves divide, decreases as the number of divisions increases. The decrease might be caused by progressive telomere shortening [10]. Hence, an extension of Hayflick's hypothesis predicts that stem cell self-renewal capacity should be self-limiting at the level of individual HSCs.
Yet, HSCs and other stem cells, express telomerase [11][14]. This enzyme repairs telomere damage and, thus, aids in preserving genomic integrity. Thus, telomere shortening alone is unlikely to explain a limited lifespan of HSCs. Indeed, mice that have been homozygously ablated for telomerase activity show only mild effects and need to be severely stressed to reveal deficiencies in the hematopoietic system [15]. Potentially in line with these findings in mice are clinical data. It was suggested that telomerase expression declines in the long-run and may be a cause for late bone marrow transplant failure [16]. Declining telomerase expression may act in conjunction with the high stressor load imposed by the many co-morbidities affecting transplant patients [17].
Another proposal suggested that, in conjunction with oxidative stresses, high levels of reactive oxygen species (ROS) could be a damaging force acting on the long-term repopulating capacity of HSCs [18], [19]. The corresponding restoring force is provided by Forkhead box class O (FoxO) transcription factors. FoxO transcription factors increase the expression of genes whose products blunt the effects of elevated ROS [20][22]. That different sources of self-renewal failures could be causally co-dependent is suggested by findings that oxidative stress could shorten telomeres [23].
Along-side genome stability, the preservation of epigenetic patterning is an important prerequisite to reliably produce functional daughter HSCs upon self-renewal. It has been suggested that both maintenance and de novo methylation are needed to maintain epigenetic stability [24]. The expression levels of DNA methyltransferases [25], [26] responsible for maintenance (DNMT1) and de novo methylation (DNMT3a and DNMT3b) could be important for restoring HSC multi-potency [27], [28]. Quantitative work has suggested that small failures may accumulate over time in the DNMT1 pathways leading to the loss of maintenance methylation and, ultimately, epigenetic stability [29]. Yet, neither of these mechanisms and hypotheses explain how HSCs with different lifespans co-exist in a single host.
It was suggested that HSCs could preserve their functional integrity over long periods of time by alternating between two states, called resting or quiescent, and active, respectively [30][32]. This idea poses that intermittent transitions to quiescence could provide the time needed to minimize the detrimental effects of repeated DNA replication and other stresses on the HSC population as a whole [33]. Elegant mathematical models of this idea have been formulated [34][36]. Surprisingly, quiescence may leave HSCs more vulnerable to mutations following DNA repair [37]. Quiescent and active HSCs may use different DNA repair mechanisms and the restoring pathway used by quiescent HSCs may lead to higher differentiation probabilities following re-activation. Never-the-less, when HSC quiescence was inhibited by the expression of the Wnt inhibitor Dickkopf-1, the HSC pool exhausted prematurely [38]. This suggests that periods of rest in the niche are essential for controlling HSC lifespan - supporting the idea that repair is necessary to maintain HSC lifespan.
Mathematically, the lifespan of populations has been addressed in manufacturing, engineering, actuarial and biological applications of reliability theory [39]. Reliability theory was first developed as a quality control tool to predict the time-to-failure - the manufacturing term for lifespan - of manufactured goods to determine warranty times. When examined as a population, the lifespan of manufactured goods proceeds through well-defined phases (Figure 1). First, a decline in population size is found, which is interpreted as failure due to factory error. Second, there is a period of little change, known as the useful phase of the population of goods. Thereafter, the population size declines again, this time caused by age-related failure of essential machine components (wear-out phase). The second phase can be prolonged, if goods are repaired. If repairs occur repeatedly, the useful life will be extended, yet the population of goods will fail in the end, because of a general deterioration of many essential parts. In biology, failure theory has been applied to develop general laws of aging and longevity [40][42], respector-ligand dissociation [43], or genome instability [44]. Here, we show that the principles of reliability and failure can be exploited to craft a new model of HSC self-renewal suggesting that HSCs differ a priori in the number of (self-)repair cycles they can undergo.
Figure 1
Figure 1
Failure Rate Kinetics of Machine and Clonal Blood Cell Populations.
Repopulation Time-to-Failure
We obtained repopulation data experimentally by transplanting single HSCs into ablated mice as described previously [45][48]. The donor HSCs and the host type mice differed in the allelic forms of the Cluster of Differentiation 45 (CD45) antigen. The CD45 antigen is expressed in most hematopoietic cells. This allowed us to follow the mature progeny derived from the transplanted HSCs by staining white blood cells for the donor-type marker. Mice were analyzed every other month and the percent of white blood cells that stained for the donor-type marker were recorded (% donor-type cells). Together, all the data points form the repopulation kinetic as a time series (compare Algorithm 1, Input specification). Because all cell populations were derived from a single HSC, the repopulation kinetic of the clone represents the total repopulation capacity of the original HSC.
Algorithm 1. Algorithm for calculating the discrete time series of reliabilities failure probabilities failure densities and failure rates for batches of raw kinetics. Numbers to the left of the listing indicate line numbers. These are used to reference particular computations in the main narrative. The general notation An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e001.jpg denotes the elements An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e002.jpg through An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e003.jpg of a list An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e004.jpg. The symbol An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e005.jpg denotes the successive differences operator defined for a list of length An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e006.jpg by An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e007.jpg. The function Sum(An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e008.jpg) sums the elements of a list An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e009.jpg.
input : A batch of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e010.jpg kinetics An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e011.jpg of lengths An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e012.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e013.jpg. By An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e014.jpg with An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e015.jpg we denote the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e016.jpg-th time scale, and by An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e017.jpg the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e018.jpg-th kinetic measured experimentally. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e019.jpg is a minimum lower bound on time series size needed to conduct meaningful analyses.
output: A list of lists An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e020.jpg of time series: Time scale (symbolically: An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e021.jpg), Process Rate (An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e022.jpg), Reliability (An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e023.jpg), Failure Probability (An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e024.jpg), Failure Density (An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e025.jpg), Failure Rate (An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e026.jpg), for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e027.jpg.
1 for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e028.jpg to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e029.jpg do
2 process the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e030.jpg-th repopulation kinetic An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e031.jpg;
3 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e032.jpg An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e033.jpg; // clear all lists;
4 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e034.jpg; // extract time scale;
5 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e035.jpg; // extract process measurements;
6 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e036.jpg; //determine instantaneous rates;
7 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e037.jpg Sum An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e038.jpg;
8 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e039.jpg; // reliability;
9 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e040.jpg; // failure probability;
10 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e041.jpg; // failure density
11 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e042.jpg; // failure rate;
12 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e043.jpg; // reliability profile of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e044.jpg-th kinetic;
We previously showed that any HSC will eventually fail to repopulate all mature cell populations [8] (also compare summary Figure 2). The time period until the multi-potential repopulation capacity fails was called the HSC lifespan. Since the lifespan marks the loss of multi-potency, it is the time-to-failure of a stem cell clone as a system [39]. We showed previously that the time-to-failure of individual HSCs is mathematically predictable with great accuracy from few initial measurements of the repopulation kinetic [8]. Hence, the time-to-failure (lifespan) is a deterministic property of individual HSCs, but can be treated as a (Gumbel-distributed) random variable at the level of the HSC compartment.
Figure 2
Figure 2
The Life of A Hematopoietic Stem Cell.
Statistical analysis of 38 repopulation kinetics ascertains that the time-to-failure estimator is unbiased and almost efficient (compare Text S1). This means that the repopulation kinetic of a clone provides near optimal information about the time-to-failure. Of note, the time-to-failure can be modeled as a power law of the proliferative capacity of the clone (compare Text S1, eq 1). From the traditional interpretation of a power law relationship (for example, see [49]), we can expect that reliability and failure rate analyses of the clonal time-to-failure are unaffected by the time scale on which repopulation data were obtained. Therefore, the systems reliability approach can be applied to repopulation kinetics obtained using different time scales (for example, [50]).
Repopulation Reliability
The time-to-failure An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e045.jpg, or lifespan, of an HSC, is a deterministic quantity that measures the time until at least one mature cell population is no longer repopulated. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e046.jpg, therefore, equals the time to the first, and last, failure of multi-potency in all, not just single, clonal HSCs.
In systems theory, reliability is defined as a conditional probability ([39]; also compare Materials & Methods (M&M), section “Reliability Theory”). Specifically, a system is said to operate reliably, if its strength is likely to exceed its load at a future time, given that the system has operated within specifications up to the present time.
The strength of a clonal system lies in the self-renewal and multi-potential differentiation capacities of its HSC population. Here, the term “capacity” can be given the rigorous quantitative meaning of “obtainable work”. Clonal experiments measure the amount of “realized work”, i.e. how much of the strength has actually been transformed into new HSCs (by self-renewal) and mature cells (by differentiation) over time, given load.
Therefore, we could use the repopulation kinetics to identify the rate at which “work” is performed to quantitate clonal reliability. Specifically, we defined the clonal repopulation reliability as the normalized area under the curve of the repopulation rate kinetic (compare Algorithm 1, Line 8; also see Figure 3, A and B). Of note, the clonal reliability can be estimated even if only few initial repopulation data are known, since an HSC's lifespan is predictable from the first few measurements of its repopulation kinetic [8].
Figure 3
Figure 3
Reliability and Failure Kinetics of a Long-lived Long-term Repopulating HSC.
Using the repopulation data of 38 HSC clones with lifespans ranging from An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e048.jpg to nearly 60 months (compare Figure S1 in Text S1), we first determined the repopulation rate kinetics for the whole clone (parameters shown in Table S1 of Text S1) and also for all major subpopulations of T cells, B cells and myeloid cells (representative example shown in Figure 3, A; calculation: Algorithm 1, Line 6). Next, we used the clone data to calculate the respective reliabilities (Figure 3, B; calculation: Algorithm 1, Line 8). An additional curve can be inferred, if the clonal structure is considered in a so-called “common cause” model of clonal reliability. A common cause model poses that, in a multi-component system, the unknown reliability of a central component can be approximately determined by the relationship of all remaining system components to the system's reliability ([39], pp. 217–222).
Since all mature lineages derive from HSCs, a mature cell population and the HSC population can be viewed as serially connected system components. On the other hand, the populations of mature cells appear connected in parallel, since the failure of one such population does not imply the failure of all. The serial connectivity is a mathematical way of representing multi-potency. Hence, an inferred reliability structure model should generate the reliability kinetic of the clonal HSC population.
Considering the HSC population a “common cause” with reliability denoted An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e049.jpg, we posed that the clonal reliability (denoted An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e050.jpg) is connected to the reliabilities of the T cell, B cell and myeloid cell populations (denoted An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e051.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e052.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e053.jpg, respectively) by:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e054.jpg
(1)
Eq 1 is a balance formula expressing the conservation of system structure over the life of a clone. It states that two parallel structure models of a clone behave similarly for all times An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e055.jpg (indicated by the notation An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e056.jpg). The first model (left-hand side, eq 1) considers the HSC population and the clone as a parallel reliability structure. The second model (right-hand side, eq 1) quantitates the reliability of the major mature cell-types as a parallel structure. We applied eq 1 to calculate the values An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e057.jpg at discrete time points An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e058.jpg given by our data. The inferred kinetics are shown as blue curves in Figure 3.
The common cause argument suggests that the HSC population reliability closely resembles the reliability of the clone, modulo a time lag that is small compared to the lifespan (Figure 3, B). This outcome is consistent with our previous conclusions, obtained by different methods that the information contained in the repopulation time series predicts HSC behavior [8].
Repopulation Failure Probability and Failure Density
By definition, the reliability is a forward looking measure that predicts the chances that a system will continue to operate according to its specifications for some time into the future, provided that it has operated reliably in the past. For HSCs, reliable operation means that their main characteristics, i.e. self-renewal and multi-potential differentiation capacities, are preserved when these cells divide. What are the chances of unreliable operation?
In systems theory, unreliability is defined by the conjugate probability of the reliability (for computation compare Algorithm 1, Line 9). Specifically, the probability that the system fails, or failure probability, equals 1 minus the probability that it can continue to operate as before. Hence, the repopulation failure probability, or repopulation “unreliability”, is a cumulative probability function [39] (high/low values indicate high/low likelihood of failure). Its graphical representation is an S-shaped curve whose shape is a horizontally flipped image of the corresponding reliability kinetic (Figure 3).
The failure probability gives rise to the failure density. The latter is a probability density in the usual sense and defined by the rate with which the failure probability changes over time (small values mean little change, high values mean lots of change). We determined the failure probabilities and densities for all clonal populations (Figure 3, C and D; Algorithm 1, Line 10). Because we could predict the reliability kinetics of the HSC population (previous section; also Figure 3, B), we could predict an approximate shape for the repopulation failure density of the HSC population, as well.
Application of the method of symbolic time series comparison in [51] shows that the relationship between the failure densities of the subpopulations of a clone changes over time (Figure 3 C). Specifically, the repopulation failure densities of the HSC population and some mature cell populations becomes more similar (increasingly converge to the same symbol sequence (data not shown)), as the lifespan is approached. By contrast, the densities lack similarity at the beginning of clonal life. To clarify this observation, we conducted a more detailed analysis of the long-range failure dynamics of HSC clones with different lifespans.
Repopulation Failure Rate Kinetics
In systems theory, the failure rate provides information about how system failure occurs as a function of system load acting against system strength over time [39]. Since the future behavior of HSCs is largely pre-programmed [8], [46], the failure rate kinetic informs about how strength, or capacity, is transformed into new HSCs (by self-renewal) and mature cells (by differentiation) over time.
The failure rate is defined as the ratio of failure density divided by the probability of reliable operation (which equals the negative rate of change over time of the logarithm of the reliability [39]; also compare M&M, “Reliability Theory”). We applied this definition to the reliability kinetics of the clone, each mature subpopulation and the predicted reliability of the HSC pool to obtain the respective failure rate kinetics (Figure 3, D and Algorithm 1, Line 11). The main observation is that, for all HSC clones, the failure rate kinetics of all populations, and the clone as a whole, increase sharply towards the end of clonal life. The overall behavior is valid for HSCs of all lifespans (Figure 4, A, C, E; also compare Theorems 1 and 2, and Lemma 1). The onset of the increase, which we called extinction transition, coincides with the onset of the increase in the predicted failure rate kinetic of the HSC population. However, the HSC failure rate increases more rapidly than those of the mature cell populations (Figure 3, D). This suggests that clonal extinction is due to an event that affects the HSC population as a whole and, likely, synchronously.
Figure 4
Figure 4
Failure Rate Kinetics of Long-term Repopulating HSCs.
Repopulation Failure Rates are Mean-Reverting
To better understand the failure behavior of the clonal HSC population before the extinction transition, we looked at truncated failure rate kinetics. We defined a failure rate kinetic as An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e061.jpg-truncated, if An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e062.jpg elements are removed from the beginning and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e063.jpg from the end of the time series, respectively. Hence, the full time series is An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e064.jpg-truncated, while An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e065.jpg-truncation means removing the last An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e066.jpg elements of the time series. For all repopulation kinetics in our database (compare Figure 4 for representative examples of different lifespans; also see Figure S1 of Text S1), we analyzed the behavior of the (0,2)-truncated failure rates (Figure 4, B, D, F).
We had previously shown that past values in HSC repopulation kinetics predict future values [8]. In other words, memory of past behaviors influences the long-term behavior of repopulation kinetics. We now asked, if memory effects could be shown in the failure rate kinetics. To find out, we calculated the Hurst exponent [49], [52], [53] of each An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e067.jpg-truncated failure rate kinetic (Figure 5; compare section “Computation of Hurst Exponent” in M&M; for values compare Table S1 of Text S1). The Hurst exponent method is a statistical approach for finding long-term memory patterns in a time series. Evidence of memory is defined by the inequality An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e068.jpg, where An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e069.jpg denotes the Hurst exponent. If An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e070.jpg, the behavior of a time-series is characterized by a pattern of reversions to a mean, where decreases/increases are followed by increases/decreases. Such a pattern is called “anti-persistent” behavior, which is considered stronger the closer An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e071.jpg is to 0. When An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e072.jpg, past time series values influence future values either only in the upward, or downward, direction, i.e. increases/decreases follow increases/decreases. This pattern is aptly called “persistent behavior”. Persistence is considered stronger the closer An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e073.jpg is to 1. Values close to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e074.jpg are interpreted as evidence that no relationship exists between past and future values of a time series. Since we had previously shown that past values of HSC repopulation kinetics predict future values [8], we could hypothesize that we might find values of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e075.jpg significantly different from An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e076.jpg in failure rate kinetics.
Figure 5
Figure 5
Hurst Exponents of the Failure Rate Kinetics of Long-term Repopulating HSCs.
To properly conducted Hurst exponent analysis, for example, using a standard approach such as the rescaled range or R/S method, knowledge of the average behavior of all sufficiently large segments of the data is required. Because clonal repopulation kinetics have a deterministic core behavior of ballistic shape [8], we could determine averages based on a deterministic failure rate kinetic for each clone (compare Theorem 1). Plotting the experimental failure rate data together with the deterministic failure rate kinetic showed that the former alternate around the latter (data not shown). Using the additional information available in the framework of HSCs, we could overcome the problem of small time series, similar to approaches in financial market analyses, where standard methods require modifications [54], [55]. Specifically, we used the ballistic trend of repopulation data as a domain-specific mean in the Hurst approach, instead of the uniform mean usually applied. For all clones, the Hurst exponents had median valueAn external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e096.jpg (compare Figure 5; Wilcoxon test, significant difference of the medianAn external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e097.jpg to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e098.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e099.jpg). Therefore, the values of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e100.jpg indicated that the failure rate kinetics of HSCs show anti-persistent memory behavior.
Anti-persistence describes a long-range memory behavior of a time series [52], [53], where increases in value are followed by decreases and decreases by increases, as opposed to increases/decreases following increases/decreases, as would be the case for persistent behavior. Using the traditional interpretation, the anti-persistent behavior in the failure rate kinetic of an HSC indicates that the “noise” of the failure rate data follows a long-term pattern that is informative about the biology of HSCs. This pattern suggested the presence of a mean-reverting process in the context of failure kinetics. Therefore, we next considered the possibility that mean-reverting behavior of the failure rate could, biologically, indicate the effects of repair mechanisms acting to decrease the failure rate following increases. In this model, fluctuations in the failure rates, as obtained from measurements of clonal repopulation kinetics, are viewed as indicators for the successive interaction of failure generation and repair, a marked anti-persistent behavior. What is missing, is a quantitative rationale for repair - acting at the cell level, but derived from cell population data.
Iterative Model of Mean-reverting HSC Failure Rates
Because we found evidence of mean-reversion, we asked how the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e101.jpg-truncated failure rates would fit to realizations of the proto-type mean-reverting process, the Ornstein-Uhlenbeck process [56], [57]. The benefits of linking the HSC failure rates to this process are: (a) A quantitative rationale for repair, in the form of a failure dissipation rate; (b) An iterative model for simulating An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e102.jpg-truncated failure rate kinetics based on clonal repopulation data.
We showed numerically that the weighted sum of the variance-adjusted rate of change plus the standardized rate of each An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e103.jpg-truncated failure rate kinetic could be regressed to the rate of change of noise in the data. Mathematically:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e104.jpg
(2)
Both sides of the similarity eq 2 can be determined from the data. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e105.jpg, on the right-hand side, represents the discrete rate of change of noise isolated from the data (for normally distributed noise, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e106.jpg is called a “Wiener process”). An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e107.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e108.jpg denote the mean and standard deviation of the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e109.jpg-truncated failure rate kinetic, respectively. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e110.jpg denotes a positive weight parameter, called the “dissipation rate”. Because the dissipation rate occurs in the context of failure kinetics, we interpreted An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e111.jpg as a quantitative indicator of repair activity - implying that repair could be modeled mechanistically as a dissipation of failure. Eq 2 is equivalent to:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e112.jpg
(3)
Eq 3 is a discrete form of the Ornstein-Uhlenbeck stochastic differential equation [56], [57]. Its solution, called Ornstein-Uhlenbeck process, is well-known as the prototypical mean-reverting process.
Our numerical analyses showed that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e113.jpg had a non-linear fit of the form An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e114.jpg. The values of the weight An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e115.jpg, calculated from experimental data, were specific for individual HSCs. Furthermore, we found that in distribution, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e116.jpg is similar to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e117.jpg, where the second factor denotes the standardized normal distribution with mean 0 and standard deviation 1.
In Theorem 2, we proved that the deterministic repopulation kinetic [8] gives rise to a deterministic differential equation for the failure rate. This equation is formally similar to eq 3, without the noise term. We considered eq 3, therefore, as the approximate Ornstein-Uhlenbeck representation for the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e118.jpg-truncated experimental failure rate data.
Together, these findings independently support the prediction, established earlier by Hurst analysis that the truncated failure rate kinetic of an HSC is mean-reverting. We could conclude that the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e119.jpg-truncated failure rate kinetics can be simulated by an Ornstein-Uhlenbeck model [58], [59] using the iterative scheme:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e120.jpg
(4)
We now asked, if eq 4 could be a model for the full, not only the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e121.jpg-truncated failure rate kinetics. To answer this question in light of the extinction transition seen in the data (sharp increase of failure rates near the end of clonal life), we needed to explain how the mean-reversion property may break down. This required a closer look at the behavior of the parameters An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e122.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e123.jpg and, in particular, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e124.jpg, the quantitative indicator of population level repair activity through dissipation of failure.
Failure Dissipation and Imperfect HSC Repair
We first asked what the properties of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e125.jpg are. The Ornstein-Uhlenbeck formulation (eq 3) allowed us to assess HSC repair efficiency from our clonal repopulation data. We broadly defined “repair” as the total of repair mechanisms available to HSCs. The dissipation rate An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e126.jpg quantitates the strength of the restoring forces as the rate with which the system variable, in our case the failure rate, reverts toward an average behavior An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e127.jpg. We, therefore, could consider the dissipation of failures as evidence of repair activity.
An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e128.jpg quantifies how rapidly the clonal system reverts back in the direction of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e129.jpg-equilibrium. Analysis of the dissipation rate for our experimental data showed that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e130.jpg depends on the lifespan An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e131.jpg. Specifically, determining each An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e132.jpg by fitting to a noisy process (eq 2) and plotting the results as points An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e133.jpg, suggested that the dissipation rate has a non-linearly increasing tendency when increasing, but fixed, lifespans are considered (compare Figure 6, A; green curve). Explicitly, we found:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e134.jpg
(5)
(compare Figure 6, A; green curve; goodness-of-fit: Akaike Information Criterion An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e135.jpg; parameter p-values An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e136.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e137.jpg, respectively). It is important to understand that eq 5 represents a tendency, not a dependency, among the dissipation rates of repopulation kinetics for independent time-to-failure values An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e138.jpg. However, going back to a remark at the beginning, the time-to-failure is a function of load which, as noted, comprises two components relating to peripheral demand, and demands due to disease or injury, respectively. Biologically, load may affect, in parallel, all accessible HSCs in the HSC compartment of a single host. Therefore, if An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e139.jpg is parametrized by load, eq 5, and the eq 6 below, may be interpreted as a power law, dependent on load exposure. This suggested that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e140.jpg may be dependent on “running” time, as well.
Figure 6
Figure 6
Failures are Dissipated More Slowly in Shorter-lived HSCs than in Longer-lived HSCs.
To find out, we used an analytical approach that took advantage of the deterministic behavior of HSC repopulation kinetics. In Theorem 2, we showed that an analytical definition of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e158.jpg can be found as a function of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e159.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e160.jpg, denoted An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e161.jpg, based on the ballistic model of repopulation kinetics developed by us previously. To see if behavior similar to eq 5 can be found analytically, we averaged An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e162.jpg, defined by An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e163.jpg, where integration extends over bounds that are analogous to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e164.jpg-truncation of failure rates (An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e165.jpg is explicitly given in Theorem 2). We found that the dissipation rates derived analytically or from data have similar properties (compare Figure 6, A). As before (compare eq 5), we fitted the resulting set of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e166.jpg values to a non-linear model:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e167.jpg
(6)
(compare Figure 6, A; blue curve; goodness-of-fit: Akaike Information Criterion An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e168.jpg; parameter p-values An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e169.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e170.jpg, respectively). Both approaches show the same tendency of the dissipation rate to increase as a point-wise function of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e171.jpg. Hierarchical cluster analysis showed that the (lifespan, dissipation rate) data An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e172.jpg separate into three clusters. The dissipation rates of the three cluster centroids An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e173.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e174.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e175.jpg are significantly different (Wilcoxon Test, Bonferroni corrected p-values: An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e176.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e177.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e178.jpg).
Together, our findings suggested that HSCs of different lifespans may differ in their ability to utilize repair mechanisms. We used the formulae developed in the proof of Theorem 1 to compare the dynamics of failure generation and failure dissipation (repair). As stated above, we found that, for the deterministic repopulation kinetics, the dissipation rate is a function of time An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e179.jpg and the lifespan An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e180.jpg, i.e. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e181.jpg, for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e182.jpg. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e183.jpg equals the negative logarithmic derivative of the failure density function. As shown in the proof of Theorem 2, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e184.jpg for all An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e185.jpg, with An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e186.jpg that can be calculated from data. This means that, throughout most of the lifespan period, failures are generated at a higher rate than they are dissipated. Therefore, we could use the inequality An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e187.jpg to quantitatively define “imperfect repair” and to ascertain that repair activity is largely insufficient to compensate for the rates at which failures are generated. The analytical treatment supported the notion that failures should accumulate in the long-run.
The mathematical analysis also predicted that, during the initial expansion period of a clone, quantitated by An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e188.jpg, repair capacity exceeds the rate at which failures are generated. Quantitatively, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e189.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e190.jpg. In particular, our theory predicts that each HSC starts “its” clone with a non-zero “initial damage load” An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e191.jpg [40][42]. The “initial damage load” can be calculated for each repopulation kinetic. Its precise biological meaning and, particularly, its developmental origins, will need to be determined experimentally. The switch from higher repair capacity to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e192.jpg may be attributable to the diluting effects of clone size on the programmed, epigenetically heritable, repair capacity of the founder HSC.
Why Some HSCs Live Longer Than Others
Evidence favoring the hypothesis that shorter lived HSCs may be less efficient in dissipating the effects of failures than longer lived HSCs, can be biologically interpreted by placing the dissipation rate in a time-context. The time-context is given by the half-life of the dissipation rate. The half-life is defined by:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e193.jpg
(7)
The half-life data (compare Figure 6, B) show a tendency, where failure rate increases dissipate more rapidly in long-term repopulating HSCs with higher lifespans An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e194.jpg. This holds independently of the manner in which An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e195.jpg values were obtained, either analytically or from data. Mathematically:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e196.jpg
(8)
(goodness-of-fit: Akaike Information Criterion An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e197.jpg; parameter p-values An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e198.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e199.jpg, respectively). Hierarchical cluster analysis showed that the (lifespan, half-life) data An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e200.jpg separate into three clusters. The half-lives of the three cluster centroids An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e201.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e202.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e203.jpg are significantly different (Wilcoxon Test; Bonferroni corrected p-values: An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e204.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e205.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e206.jpg). Like eq's 5 and 6, the relationship eq 8 must be interpreted with care as An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e207.jpg is a time-to-failure variable and should not be confused with a continuum.
The data show larger failure dissipation rate half-lives for HSCs with shorter lifespans, while smaller half-lives associate with longer life. A possible interpretation is that repairs may occur less frequently in shorter lived HSCs than in longer lived HSCs. According to Theorem 1 shorter lived HSCs may have to counteract higher initial damage loads (as suggested by the higher initial values of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e208.jpg for smaller lifespan values). Together, these findings may explain the larger and longer-lasting “peaks” and “valleys” seen in the failure rate kinetics of shorter lived HSCs (Figure 4).
Break-down of Mean-Reversion and Clonal Extinction
An important observation common to all failure rate kinetics is that, near the end of clonal life, the failure rates strongly increase. When we compared actual failure rate kinetics with kinetics generated by simulation using the experimentally derived parameters in eq 4, we noticed that the terminal behavior of the experimental failure rate departed significantly from the mean-reverting characteristic of the simulated rates (for more detailed discussion see below). This suggested that regime-breaking may characterize the extinction transition. “Regimes” is standard terminology to describe disjoint regions in the phase space of a dynamical system such that transitions between the regions are rare (compare Figure 7 for a representative example). We, thus, analyzed the regimes of the phase space of experimental HSC failure rate kinetics.
Figure 7
Figure 7
Failure Rate Phase Space Regimes of Long-term Repopulating HSCs.
The phase space trajectory of an HSC's failure rate kinetic starts in the initial engraftment regime (Figure 7, region E). Here, it remains for up to 3 months of the HSC's life. Then, the trajectory escapes to the region where failure rates are governed by mean-reversion (Figure 7, region OU). It remains in this regime for most of the clonal life - first contracting, then slowly expanding. At some point, the phase space trajectory transitions to a third regime (Figure 7, region T), where the clone becomes extinct. Therefore, regime-breaking is associated with clonal extinction.
We next established the conditions under which the mean-reverting regime breaks. As discussed above, comparison of the experimental failure rate kinetics with realizations of the iterated Ornstein-Uhlenbeck process (eq 4) showed that the simulated process diverges from the experimental data in the terminal regime (Figure 8, Part A). The simulated failure rates continue as before, but the experimental failure rates rise sharply. This behavior could be changed, and brought closer to the experimental data, when a further constraint was added.
Figure 8
Figure 8
Breakdown of Mean-Reverting Behavior in the Failure Rate Kinetics of Long-term Repopulating HSCs.
Specifically, we asked whether the mean of the experimental failure rates is a constant or changes in time. Analysis of the An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e230.jpg-truncated failure rate kinetics of each clone using moving averages showed that the parameter An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e231.jpg, the mean failure rate, increases in a well-defined pattern that occurs in all kinetics (compare an example in Figure 8, B). Though this pattern of increasing mean is present in the raw failure rate data, the change there is subtle, but cumulative. It is enhanced and, thus, becomes more recognizable if moving averages are used (for short lifespans only small windows are needed; larger windows (up to 5 months) are required for longer lifespans). Using non-linear fitting, we found that the succession of moving averages, labelled An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e232.jpg, increases over time as:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e233.jpg
(9)
The critical limit An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e234.jpg is slightly smaller than the time-to-failure, or lifespan, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e235.jpg of the clone. This result obtained from data analysis has an analytical counterpart. In Theorem 1, we showed that the ballistic model of HSC repopulation kinetics [8] leads to a deterministic formula for the failure rate function of any HSC clone, such that, according to Lemma 1, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e236.jpg in the limit An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e237.jpg. Therefore, the analytically derived result matches the behavior extracted from data in eq 9.
We could, thus, conclude that as more self-renewals occur, repair mechanisms must revert to larger failure rates means in daughter HSCs. Biologically, the increasing mean suggests that damage accumulates over successive generations, likely due to imperfect repair.
Clonal hematopoiesis begins with a single HSC and ends with its loss after months to years [4][8]. During this period of time - the lifespan -, the genetic/epigenetic program of the original HSC is replicated to many daughter HSCs. In HSC self-renewal, discrepancies between replicates should be vanishingly small. Yet, clones extinguish after a limited time, suggesting that self-renewal may not be perfectly reliable in the long-run.
Working from repopulation kinetics, we needed to develop quantitative measures of reliability, failure and repair that capture events of magnitudes that approach population size. Our data show that increases in failure rates associate with increasing population-wide failure loads, and decreases relate to dissipative effects of the collective repair strength. Together, the fluctuation patterns of the failure rate kinetics characterize the summary dynamics of microscopic failure and repair events at the macroscopic level of clonal HSC populations.
Our approach does not depend on particular failure sources and repair mechanisms. An advantage, therefore, is that our current understanding of stem cell Omics is not limiting. Rather, reliability theory could open new avenues for interpreting longitudinal network data. For example, we make the prediction that repair capability stays approximately constant through the lifespan of an individual HSC. Constancy does not mean that individual repair mechanisms are unaffected by failure inducing processes. Instead, the function of a deteriorating repair mechanism could be taken over by an alternative pathway.
We predict that the repopulation failure rate kinetics stay at low levels for a long time, but will never revert to zero failure rate. This supports the conclusion that failures are continuously generated, but are never completely cleared. Indeed, failure rates increase slowly, indicating that failures accumulate. Evidence of failure accumulation is not only seen in our experimental data. It also followed by mathematical proof (M&M section; Theorem 2) for the deterministic failure rate kinetics derived from our previously developed ballistic model [8].
Daughter HSCs of successive generations may, thus, carry an increasing failure load - consistent with previous experimental findings on the aging of HSCs [60]. As shown here, increasing failure load coupled with constant repair capacity is key to explaining the differences in lifespans of HSCs in a single host in the absence of strong extrinsic perturbations (e.g., expression of the Wnt inhibitor Dickkopf 1 [38]). These predictions could be tested experimentally using longitudinal genome studies comparing genetic networks in myeloid-biased (My-bi) and lymphoid-biased (Ly-bi) HSCs [47]. The former are typically longer lived than the latter. Reliability analysis may aid in predicting universal check-points (such as An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e238.jpg in Theorem 2) to meaningfully time longitudinal genome studies of My-bi and Ly-bi HSCs. So far, the genome of My-bi HSCs has only been mined at isolated instances [47], [61]. Timing of genomic analyses is experimentally challenging, since HSCs are rare relative to mature blood cell populations.
We showed that the failure rate is stable, but “noisy”. This “noise”, properly classified using rescaled range, or Hurst, analysis [53] shows how stability is generated. The experimental failure rate kinetics alternate irregularly around the deterministic failure rate component, which we used as the mean value in our rescaled range analysis of the data. We found that the Hurst exponent is An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e239.jpg for the failure rate kinetics of all long-term repopulating HSCs. HSCs with lifespans greater than one mouse life have smaller exponents than for lifespans below one mouse life. Using non-linear time series theory, we could conclude that an anti-persistent, or mean-reverting, regime governs the time period where failure rates are at a minimum. The implication is that the interaction between failure-generating mechanisms, such as HSC self-renewal divisions, and failure-dissipating processes, or repairs, creates a self-organized failure-repair equilibrium. An HSC clone exits the equilibrium state, and becomes extinct shortly there-after, when failure load has accumulated sufficiently to surpass repair capacity.
Our reliability analysis of HSCs has implications on aging in HSCs [2], [45], [62] and in other non-homogenous, hierarchically organized, cell systems. The elegant general theory of aging developed by the Gavrilovs [40][42] - tested extensively for populations of organisms but less for those of cells [43], [44] - poses that aging systems have three properties: redundancy, initial damage load, and redundancy depletion. For HSCs, redundancy emerges over time as a function of self-renewals. The declining quality of genome replicates, due to imperfect repair as predicted here, quantifies the rate of redundancy depletion in HSCs. The mathematical results of this paper predict that the failure dissipation rate determined from our data provides a quantitative measure of “progressive damage load” starting from an HSC-specific “initial damage load”. However, what constitutes “initial damage load” in the biology of HSCs, and what its sources are, must first be investigated experimentally - primarily to address the question of how HSCs are programmed during early development.
Clonal Analysis
Freshly explanted BM cells were transplanted in limiting dilution into lethally irradiated CD45 congenic hosts exactly as described [45][47], [63]. Each host received on average 0.2–0.5 HSCs together with 2×transplanted BM as a source of radio-protecting cells. Mice were bled in regular intervals and the % myeloid and lymphoid cells amongst the donor-type cells were measured by Flow cytometry. All experiments were approved by the IACUC.
Software
We used Mathematica version 8.0.1 (Wolfram Research, Inc) for numerical mathematics and computer simulations. R version 2.12.2 and Instat version 3 (GraphPad, Inc) were used for all statistical analyses. Figures were generated using Mathematica version 8.0.1 and edited using GIMP version 2.8.3. The manuscript was written in LaTeX2e using GNU Emacs version 23.3.50 (Free Software Foundation).
Reliability Theory
The subject of reliability theory is to determine the length of time for which a system is capable of bearing “load” given its material “strength”. Mathematically, system reliability versus unreliability at time An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e240.jpg is quantitated by the respective inequalities between strength An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e241.jpg and load An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e242.jpg:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e243.jpg
(10)
Strength and load are non-negative functions of time, i.e. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e244.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e245.jpg. A system's time-to-failure An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e246.jpg is defined as the earliest point in time for which load exceeds strength, i.e.:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e247.jpg
(11)
For repairable systems, multiple occurrences of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e248.jpg are possible, only to be reset by the repair process to some level of reliable operations, i.e. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e249.jpg. Hence, the operation of a repairable system will generate a sequence of time-to-failure values. By contrast, in an unrepairable system, the first time-to-failure is also the last.
Though load and strength can be deterministic, it is advantageous to consider the general case where the strength-load inequality (compare eq 10) is subject to uncertainty. Hence, system reliability is usually defined by a probability measure An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e250.jpg for events An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e251.jpg (colloquially: “time-to-failure not yet reached”):
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e252.jpg
(12)
The explicit reference to the strength-load inequality An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e253.jpg can be suppressed due to the definition of the time-to-failure (eq 11). The definition of probabilities implies that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e254.jpg.
The failure probability is defined as the conjugate probability:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e255.jpg
(13)
The rate of change of the failure probability over time is used to define the failure density:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e256.jpg
(14)
This definition requires that the reliability An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e257.jpg is a differentiable function of time An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e258.jpg.
The rate of system failure, or failure rate, is determined by the ratio of the failure density to the system's reliability, provided that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e259.jpg:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e260.jpg
(15)
Due to the properties of the reliability and the failure density, it follows that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e261.jpg for all permissible An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e262.jpg. Using eqs 14 and 13 in eq 15 shows that the failure rate can also be represented by the derivative of the negative logarithm of the reliability.
Computation of Reliability and Failure Measures
In practical applications, a system's reliability is determined based on field measurements of a particular system variable associated with well-defined, system-specific, time-to-failure conditions. From these measurements, one attempts to form a discrete empirical distribution as a time series An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e263.jpg, where An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e264.jpg, normalized such that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e265.jpg, and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e266.jpg (compare Algorithm 1).
Statistical distribution fitting with appropriate goodness-of-fit measures may identify a suitable closed-form model An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e267.jpg (such as in eq 12), so that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e268.jpg. In this case, a system's reliability and failure rate evolution can be described using probability, dynamical systems theory, and stochastic processes. We show in the main narrative that the failure rate of the repopulation kinetics of hematopoietic stem cells follow an Ornstein-Uhlenbeck stochastic process.
Time series representing the evolution of discrete failure probabilities and failure densities can be obtained by point-wise application of eqs 13 and 14 (as used in Algorithm 1). In the case of the failure density, the differences operator is used to approximate differentiation. This operator is defined by
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e269.jpg
(16)
We computed discrete failure rates as the ratio of density to reliability, as introduced in eq 15. This approach is computationally more efficient and more transparent than using the numerical derivative of the negative logarithm of the reliability sequences.
Computation of Hurst Exponent
To make predictions about the long-term reliability of water reservoirs, Harold Hurst introduced a new statistic, called the rescaled range. This statistic is determined by forming the ratio of the difference between the water level extremes over a long time period, called the range, to the standard deviation from the mean water inflow over the same time period, but using sub-divisions of the time scale into smaller segments [64].
Because of its generality, the rescaled range, or R/S, statistic can be used in many different contexts - with appropriate reinterpretation of time scales and measured entities. Hurst's original finding, expanded by Mandelbrot and collaborators [49], [52], [53], was that, in the limit, the average rescaled range over time periods of increasing size An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e270.jpg, behaves like a fixed power of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e271.jpg:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e272.jpg
(17)
An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e273.jpg is called the Hurst exponent. An algorithm for determining the rescaled range statistic and the empirical Hurst estimate is given below (Algorithm 2). Explanations for the notation used above are given there. Implementations of the R/S and other methods for estimating the Hurst exponent are available in the statistical programming language R.
Algorithm 2. Algorithm for calculating the rescaled range statistic and estimating the Hurst exponent An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e274.jpg. The notations used are the same as in Algorithm 1. In addition the functions Max() and Min() refer to the maximum or minimum of a data set An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e275.jpg respectively. The notation An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e276.jpg denotes the uniform sample mean of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e277.jpg. The function LinModFit(An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e278.jpg) linearly regresses the predictor data An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e279.jpg on the response data An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e280.jpg with An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e281.jpg being used as in the statistical programming language R to express a potential relationship between data. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e282.jpg is a minimum lower bound on time series size to conduct meaningful analyses.
input: A time series An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e283.jpg of length An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e284.jpg, with An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e285.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e286.jpg.
output: A sequence RS of rescaled range values of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e287.jpg and a number An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e288.jpg representing an estimate of the Hurst exponent.
1 for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e289.jpg to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e290.jpg do
2 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e291.jpg Sum An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e292.jpg; //An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e293.jpg-th mean with respect to PDF An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e294.jpg;
3 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e295.jpg Sum An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e296.jpg; // cumulative deviation from mean;
4 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e297.jpg Max An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e298.jpg An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e299.jpgMinAn external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e300.jpg; // range
5 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e301.jpg Sum An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e302.jpg; // standard deviation;
6 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e303.jpg; // An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e304.jpg-th rescaled range;
7 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e305.jpg; //rescaled range sequence;
8 An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e306.jpg LinModFit (An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e307.jpg;
In applications, the benefit of determining the rescaled range sequence is that we can analyze and interpret data that have no characteristic scale. This is sometimes interpreted as lacking bias introduced by specific measurement scales. The Hurst exponent, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e308.jpg, measures the smoothness of (self-similar) time series based on the asymptotics of the rescaled range sequence. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e309.jpg indicates a persistent, or trend-reinforcing, time series. In this case, increases (decreases) of time series values are followed by increases (decreases). This trending increases as An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e310.jpg. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e311.jpg holds for mean-reverting, or anti-persistent, time series. In this case, deviations from the mean lead to reversal of the time series values towards a long-term mean. The “strength” of the mean reversion increases as An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e312.jpg. Geometrically, anti-persistent time series will appear more jagged as An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e313.jpg. The value An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e314.jpg is considered indicative for lack of correlation in the time series: Any values do not inform about future values. In the case of the hematopoietic system, we showed previously that past values of the clonal repopulation kinetics are predictive for future values [8].
Exact Reliability & Failure Kinetics: Theorem 1
We wished to identify the failure rate kinetics under noise-less conditions. To do this, we could use the deterministic model of clonal repopulation kinetics, denoted An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e315.jpg below, that we had developed previously [8] based on experimentally obtained clonal repopulation data.
Theorem 1
Consider the ballistic kinetic An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e316.jpg, with parameters An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e317.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e318.jpg, and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e319.jpg such that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e320.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e321.jpg. Let An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e322.jpg be such that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e323.jpg. Define the rate An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e324.jpg. The failure rate An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e325.jpg of the reliability An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e326.jpg, where An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e327.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e328.jpg, equals:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e329.jpg
(18)
and satisfies:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e330.jpg
(19)
An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e331.jpg is defined as “initial damage load” and depends only on the system parameters.
Proof. From the definition of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e332.jpg follows An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e333.jpg. Then:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e334.jpg
(20)
from which follows that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e335.jpg. Therefore, using An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e336.jpg, the function An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e337.jpg has the form:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e338.jpg
(21)
It follows from eq 21 that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e339.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e340.jpg. Furthermore, integration shows that we can express An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e341.jpg in a normalized form, since:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e342.jpg
(22)
Since An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e343.jpg (eq 13), we get:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e344.jpg
(23)
It follows that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e345.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e346.jpg. Differentiation with respect to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e347.jpg and using eq 14 shows:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e348.jpg
(24)
One notes that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e349.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e350.jpg. Using eq 15, we find:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e351.jpg
(25)
It follows that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e352.jpg. If we write eq 25 in the form An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e353.jpg, we see that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e354.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e355.jpg in the limit An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e356.jpg. The numerator and denominator are differentiable, so that with the substitution An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e357.jpg:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e358.jpg
(26)
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e359.jpg
(27)
from which follows:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e360.jpg
(28)
It follows from de l'Hopital's rule that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e361.jpg, as An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e362.jpg approaches An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e363.jpg from below.
Asymptotic Behavior near the Lifespan: Lemma 1
In Theorem 1, we showed that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e364.jpg in the time limit approaching the lifespan. The following result details the asymptotic growth properties of the deterministic failure rate kinetic.
Lemma 1
The asymptotic behavior of the repopulation failure rate near the lifespan An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e365.jpg is:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e366.jpg
(29)
where, symbolically, the relationship An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e367.jpg between two functions An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e368.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e369.jpg indicates similarity in the limit.
Proof. Series expansion of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e370.jpg near An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e371.jpg shows:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e372.jpg
(30)
Gross Value Distribution of Failure Rates: Lemma 2
We wanted to know the order of magnitude of the “initial damage load” An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e373.jpg in relation to the lifespan An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e374.jpg. In particular, is there a lower bound on An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e375.jpg?
Lemma 2
For An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e376.jpg we have An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e377.jpg. Furthermore: An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e378.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e379.jpg.
Proof. We have for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e380.jpg:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e381.jpg
(31)
The claim follows from the condition An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e382.jpg. Furthermore, using the asymptotic expansion in the proof of Lemma 1, we get:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e383.jpg
(32)
from which the second claim follows.
Failure Growth and Dissipation: Theorem 2
We wanted to know under which conditions on time An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e384.jpg the deterministic failure rate kinetic An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e385.jpg increases and decreases. To find answers, we determined explicitly the rate of change of the noise-less failure rate kinetic derived in Theorem 1. Throughout, we used the simplified notation An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e386.jpg for the derivative of a differentiable function An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e387.jpg of variable An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e388.jpg.
Theorem 2
The rate of change An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e389.jpg of the failure rate An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e390.jpg has the form:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e391.jpg
(33)
with a time-dependent dissipative “frictional force” term An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e392.jpg. The latter is given explicitly by the logarithmic rate of change of the failure density: An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e393.jpg. Furthermore, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e394.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e395.jpg, implying that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e396.jpg is strictly increasing for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e397.jpg. Furthermore, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e398.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e399.jpg.
Remark
An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e400.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e401.jpg can be interpreted as “imperfect” effects of the dissipative force. This motivated our quantitative definition of “imperfect repair”.
Proof. We write An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e402.jpg in the form of an intensity with An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e403.jpg. Differentiating, we get:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e404.jpg
(34)
Since An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e405.jpg, it follows that:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e406.jpg
(35)
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e407.jpg
(36)
This expression can be rewritten once more to yield:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e408.jpg
(37)
where, explicitly:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e409.jpg
(38)
Since An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e410.jpg and the second factor is always negative, it follows that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e411.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e412.jpg. Furthermore, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e413.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e414.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e415.jpg for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e416.jpg.
We now define An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e417.jpg to obtain the general expression for the slope of the failure rate:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e418.jpg
(39)
with the time-dependent positive “dissipation”, or retarding “frictional force”, term An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e419.jpg. The latter is given explicitly by the logarithmic rate of change of the failure density as shown above.
Since An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e420.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e421.jpg when An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e422.jpg or An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e423.jpg when An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e424.jpg. Using the definitions of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e425.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e426.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e427.jpg is equivalent to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e428.jpg or An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e429.jpg. Direct calculation shows that
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e430.jpg
(40)
Using eqs 21 and 24 from the proof of Theorem 1, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e431.jpg becomes:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e432.jpg
(41)
or, equivalently:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e433.jpg
(42)
which is equivalent to:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e434.jpg
(43)
With the substitution An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e435.jpg, the latter becomes an inequality between two functions denoted An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e436.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e437.jpg, respectively:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e438.jpg
(44)
The function An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e439.jpg on the right-hand side of inequality 44 is positive for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e440.jpg, has the value An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e441.jpg at 0, and decreases strictly monotonically to An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e442.jpg. The function An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e443.jpg on the left-hand side of inequality 44 also satisfies An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e444.jpg with An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e445.jpg, but An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e446.jpg. Some manipulation shows that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e447.jpg is monotone increasing for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e448.jpg and decreasing for An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e449.jpg. Taking the second derivative of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e450.jpg and resubstitution shows that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e451.jpg takes a maximum at:
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e452.jpg
(45)
and the inequality 44 is satisfied starting in a neighborhood of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e453.jpg, i.e. An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e454.jpg. It follows that An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e455.jpg, at least from An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e456.jpg on.
With some algebraic substitutions, eq 33 can be formally rewritten as a deterministic form of the Langevin equation. Specifically:
Corollary
With An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e457.jpg, An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e458.jpg having the same meaning as in Theorem 2, we can write
A mathematical equation, expression, or formula.
 Object name is pcbi.1003006.e459.jpg
(46)
with An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e460.jpg interpreted as a mean-squared variation of An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e461.jpg.
Proof. Replace An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e462.jpg by An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e463.jpg for the exact An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e464.jpg. Write An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e465.jpg. Define the function An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e466.jpg to replace An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e467.jpg by An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e468.jpg.
Statistical Analyses
To analyze the (lifespan, dissipation rate) and (lifespan, half-life) data, denoted An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e469.jpg and An external file that holds a picture, illustration, etc.
Object name is pcbi.1003006.e470.jpg, respectively, in the main narrative, we first standardized the data by subtracting the sample mean and dividing by the sample standard deviation column-wise. We used hierarchical cluster analysis on the standardized data to determine the number of clusters and their centroids. Confirmatory analysis was conducted using a standard partitioning approach.
Text S1
It is first shown that the empirical estimator of the time-to-failure, or lifespan, of the repopulation capacity of clonal long-term repopulating hematopoietic stem cells is statistically unbiased, and almost efficient relative to a Gumbel distribution of maximum extremes. Together, these properties indicate that the Gumbel distribution makes best use of the information obtainable from serial repopulation experiments. Table S1 contains experimentally determined HSC lifespans, growth and decline rates, and the Hurst exponents calculated using Algorithm 2 (compare Materials & Methods). Figure S1 shows the shapes of clonal repopulation time series obtained experimentally by measuring the percent donor-type cells in blood after transplanting a single HSC.
(PDF)
Acknowledgments
We thank the unknown reviewers for valuable suggestions that resulted in improvements in the presentation of this paper.
Funding Statement
This work was supported by the National Institutes of Health grants DDK48015 and AG023197 to CEMS. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
1. Kunisaki Y, Frenette PS (2012) The secrets of the bone marrow niche: Enigmatic niche brings challenge for hsc expansion. Nat Med 18: 864–5. [PubMed]
2. Muller-Sieburg CE, Sieburg HB, Bernitz JM, Cattarossi G (2012) Stem cell heterogeneity: implications for aging and regenerative medicine. Blood 119: 3900–7. [PubMed]
3. Harrison D, Stone M, Astle C (1990) Effects of transplantation on the primitive immunohematopoietic stem cell. J Exp Med 172: 431–7. [PMC free article] [PubMed]
4. Harrison DE, Astle CM, Lerner C (1988) Number and continuous proliferative pattern of transplanted primitive immunohematopoietic stem cells. Proceedings of the National Academy of Sciences of the United States of America 85: 822–6. [PubMed]
5. Jordan C, Lemischka I (1990) Clonal and systemic analysis of long-term hematopoiesis in the mouse. Genes Dev 4: 220–32. [PubMed]
6. Keller G, Snodgrass R (1990) Life span of multipotential hematopoietic stem cells in vivo. J Exp Med 171: 1407–1418. [PMC free article] [PubMed]
7. Morrison S, Weissman I (1994) The long-term repopulating subset of hematopoietic stem cells is deterministic and isolatable by phenotype. Immunity 1: 661–73. [PubMed]
8. Sieburg HB, Rezner BD, Muller-Sieburg CE (2011) Predicting clonal self-renewal and extinction of hematopoietic stem cells. Proceedings of the National Academy of Sciences of the United States of America 108: 4370–5. [PubMed]
9. Rosendaal M, Hodgson G, Bradley T (1976) Haemopoietic stem cells are organised for use on the basis of their generation-age. Nature 264: 68–9. [PubMed]
10. Hayflick L, Moorhead PS (1961) The serial cultivation of human diploid cell strains. Experimental cell research 25: 585–621. [PubMed]
11. Cristofalo VJ, Pignolo RJ (1993) Replicative senescence of human fibroblast-like cells in culture. Physiol Rev 73: 617–38. [PubMed]
12. Hiyama E, Yokoyama T, Tatsumoto N, Hiyama K, Imamura Y, et al. (1995) Telomerase activity in gastric cancer. Cancer Res 55: 3258–62. [PubMed]
13. Hiyama K, Ishioka S, Shirotani Y, Inai K, Hiyama E, et al. (1995) Alterations in telomeric repeat length in lung cancer are associated with loss of heterozygosity in p53 and rb. Oncogene 10: 937–44. [PubMed]
14. Hiyama K, Hirai Y, Kyoizumi S, Akiyama M, Hiyama E, et al. (1995) Activation of telomerase in human lymphocytes and hematopoietic progenitor cells. J Immunol 155: 3711–5. [PubMed]
15. Sekulovic S, Gylfadottir V, Vulto I, Gasparetto M, Even Y, et al. (2011) Prolonged self-renewal activity unmasks telomerase control of telomere homeostasis and function of mouse hematopoietic stem cells. Blood 118: 1766–73. [PubMed]
16. Socie G, Stone JV, Wingard JR, Weisdorf D, Henslee-Downey PJ, et al. (1999) Long-term survival and late deaths after allogeneic bone marrow transplantation. late effects working committee of the international bone marrow transplant registry. The New England journal of medicine 341: 14–21. [PubMed]
17. Calado RT, Young NS (2008) Telomere maintenance and human bone marrow failure. Blood 111: 4446–55. [PubMed]
18. Ito K, Hirao A, Arai F, Matsuoka S, Takubo K, et al. (2004) Regulation of oxidative stress by atm is required for self-renewal of haematopoietic stem cells. Nature 431: 997–1002. [PubMed]
19. Ito K, Hirao A, Arai F, Takubo K, Matsuoka S, et al. (2006) Reactive oxygen species act through p38 mapk to limit the lifespan of hematopoietic stem cells. Nat Med 12: 446–51. [PubMed]
20. Miyamoto K, Araki KY, Naka K, Arai F, Takubo K, et al. (2007) Foxo3a is essential for maintenance of the hematopoietic stem cell pool. Cell Stem Cell 1: 101–12. [PubMed]
21. Tothova Z, Kollipara R, Huntly BJ, Lee BH, Castrillon DH, et al. (2007) Foxos are critical mediators of hematopoietic stem cell resistance to physiologic oxidative stress. Cell 128: 325–39. [PubMed]
22. Yalcin S, Zhang X, Luciano JP, Mungamuri SK, Marinkovic D, et al. (2008) Foxo3 is essential for the regulation of ataxia telangiectasia mutated and oxidative stress-mediated homeostasis of hematopoietic stem cells. J Biol Chem 283: 25692–705. [PubMed]
23. von Zglinicki T (2002) Oxidative stress shortens telomeres. Trends Biochem Sci 27: 339–344. [PubMed]
24. Gereige LM, Mikkola HKA (2009) Dna methylation is a guardian of stem cell self-renewal and multipotency. Nat Genet 41: 1164–6. [PubMed]
25. Bestor TH (2000) The dna methyltransferases of mammals. Hum Mol Genet 9: 2395–402. [PubMed]
26. Trasler JM, Trasler DG, Bestor TH, Li E, Ghibu F (1996) Dna methyltransferase in normal and dnmtn/dnmtn mouse embryos. Dev Dyn 206: 239–47. [PubMed]
27. Broske AM, Vockentanz L, Kharazi S, Huska MR, Mancini E, et al. (2009) Dna methylation protects hematopoietic stem cell multipotency from myeloerythroid restriction. Nature genetics 41: 1207–15. [PubMed]
28. Trowbridge JJ, Snow JW, Kim J, Orkin SH (2009) Dna methyltransferase 1 is essential for and uniquely regulates hematopoietic stem and progenitor cells. Cell stem cell 5: 442–9. [PMC free article] [PubMed]
29. Goyal R, Reinhardt R, Jeltsch A (2006) Accuracy of dna methylation pattern preservation by the dnmt1 methyltransferase. Nucleic acids research 34: 1182–8. [PMC free article] [PubMed]
30. Trumpp A, Essers M, Wilson A (2010) Awakening dormant haematopoietic stem cells. Nat Rev Immunol 10: 201–9. [PubMed]
31. Wilson A, Laurenti E, Oser G, van der Wath R, Blanco-Bose W, et al. (2008) Hematopoietic stem cells reversibly switch from dormancy to self-renewal during homeostasis and repair. Cell 135: 1118–29. [PubMed]
32. Wilson A, Laurenti E, Trumpp A (2009) Balancing dormant and self-renewing hematopoietic stem cells. Curr Opin Genet Dev 19: 461–8. [PubMed]
33. Lajtha LG (1979) Stem cell concepts. Differentiation 14: 23–34. [PubMed]
34. Glauche I, Moore K, Thielecke L, Horn K, Loeffler M, et al. (2009) Stem cell proliferation and quiescence–two sides of the same coin. PLoS Comput Biol 5: e1000447. [PMC free article] [PubMed]
35. Takizawa H, Regoes RR, Boddupalli CS, Bonhoeffer S, Manz MG (2011) Dynamic variation in cycling of hematopoietic stem cells in steady state and inflammation. J Exp Med 208: 273–84. [PMC free article] [PubMed]
36. van der Wath RC, Wilson A, Laurenti E, Trumpp A, Liò P (2009) Estimating dormant and active hematopoietic stem cell kinetics through extensive modeling of bromodeoxyuridine label-retaining cell dynamics. PLoS One 4: e6972. [PMC free article] [PubMed]
37. Mohrin M, Bourke E, Alexander D, Warr MR, Barry-Holson K, et al. (2010) Hematopoietic stem cell quiescence promotes error-prone dna repair and mutagenesis. Cell Stem Cell 7: 174–85. [PMC free article] [PubMed]
38. Fleming H, Janzen V, Lo Celso C, Guo J, Leahy K, et al. (2008) Wnt signaling in the niche enforces hematopoietic stem cell quiescence and is necessary to preserve self-renewal in vivo. Cell Stem Cell 2: 274–83. [PMC free article] [PubMed]
39. Rausand M, Hoyland A (2004) System Reliability Theory: Models, Statistical Methods, and Applications. 2nd edition. Hoboken: John Wiley and Sons, Inc. 664 p.
40. Gavrilov L, Gavrilova N (2001) The reliability theory of aging and longevity. Journal of theoretical biology 213: 527–545. [PubMed]
41. Gavrilov L, Gavrilova N (2003) The quest for a general theory of aging and longevity. Sci Aging Knowledge Environ 2003: RE5. [PubMed]
42. Gavrilov L, Gavrilova N (2006) Reliability theory of aging and longevity. In: Masoro E, Austad S, editors, Handbook of the Biology of Aging. Amsterdam: Academic Press, volume 1, pp. 3–41.
43. Tees D, Woodward J, Hammer D (2001) Reliability theory for receptor–ligand bond dissociation. The Journal of Chemical Physics 114: 7483–7496.
44. Maslov AY, Vijg J (2009) Genome instability, cancer and aging. Biochim Biophys Acta 1790: 963–9. [PubMed]
45. Cho RH, Sieburg HB, Muller-Sieburg CE (2008) A new mechanism for the aging of hematopoietic stem cells: aging changes the clonal composition of the stem cell compartment but not individual stem cells. Blood 111: 5553–61. [PubMed]
46. Muller-Sieburg CE, Cho RH, Thoman M, Adkins B, Sieburg HB (2002) Deterministic regulation of hematopoietic stem cell self-renewal and differentiation. Blood 100: 1302–9. [PubMed]
47. Muller-Sieburg CE, Cho RH, Karlsson L, Huang JF, Sieburg HB (2004) Myeloid-biased hematopoietic stem cells have extensive self-renewal capacity but generate diminished lymphoid progeny with impaired il-7 responsiveness. Blood 103: 4111–4118. [PubMed]
48. Sieburg H, Cho R, Dykstra B, Uchida N, Eaves C, et al. (2006) The hematopoietic stem compartment consists of a limited number of discrete stem cell subsets. Blood 107: 2311–6. [PubMed]
49. Mandelbrot B (1983) The fractal geometry of nature/Revised and enlarged edition/. New York, W.H. Freeman and Co., 1983, 495 p.
50. Abkowitz J, Golinelli D, Harrison D, Guttorp P (2000) In vivo kinetics of murine hemopoietic stem cells. Blood 96: 3399–405. [PubMed]
51. Sieburg H, Muller-Sieburg C (2004) Classification of short kinetics by shape. In Silico Biology 4: 209–217. [PubMed]
52. Mandelbrot B (2001) Stochastic volatility, power laws and long memory. Quantitative Finance 1: 558–559.
53. Mandelbrot B, Wallis J (1968) Noah, joseph, and operational hydrology. Water Resources Research 4: null.
54. Granero M, JE S, Perez J (2008) Some comments on hurst exponent and the long memory processes on capital markets. Physica A 387: 5543–5551.
55. Katsev S, L'Heureux I (2003) Are hurst exponents estimated from short or irregular time series meaningful? Computers & Geosciences 29: 1085–1089.
56. Kloeden P, Platen E, Schurz H (1994) Numerical Solution of Sde Through Computer Experiments. Blindern: Springer. 309 p.
57. Øksendal B (2010) Stochastic Differential Equations: An Introduction with Applications. 6th edition. Blindern: Springer. 384 p.
58. Kleptsyna M, Le Breton A (2002) Statistical Analysis of the Fractional Ornstein–Uhlenbeck Type Process. Statistical Inference for Stochastic Processes 5: 229–248.
59. Larralde H (2004) Statistical properties of a discrete version of the ornstein-uhlenbeck process. Physical Review E 69: 027102. [PubMed]
60. Rossi DJ, Bryder D, Seita J, Nussenzweig A, Hoeijmakers J, et al. (2007) Deficiencies in dna damage repair limit the function of haematopoietic stem cells with age. Nature 447: 725–9. [PubMed]
61. Challen GA, Boles NC, Chambers SM, Goodell MA (2010) Distinct hematopoietic stem cell subtypes are differentially regulated by tgf-beta1. Cell Stem Cell 6: 265–278. [PMC free article] [PubMed]
62. Muller-Sieburg C, Sieburg H (2008) Stem cell aging: survival of the laziest? Cell Cycle 7: 3798–804. [PMC free article] [PubMed]
63. Sieburg HB, Cho RH, Dykstra B, Uchida N, Eaves CJ, et al. (2006) The hematopoietic stem compartment consists of a limited number of discrete stem cell subsets. Blood 107: 2311–6. [PubMed]
64. Hurst H (1951) Long term storage capacity of reservoirs. Transactions of the American Society of Civil Engineers 116: 770–799.
65. Muller-Sieburg CE, Cho RH, Sieburg HB, Kupriyanov S, Riblet R (2000) Genetic control of hematopoietic stem cell frequency in mice is mostly cell autonomous. Blood 95: 2446–8. [PubMed]
66. Muller-Sieburg CE, Sieburg HB (2006) The god of hematopoietic stem cells: a clonal diversity model of the stem cell compartment. Cell Cycle 5: 394–8. [PMC free article] [PubMed]
67. Muller-Sieburg CE, Sieburg HB (2006) Clonal diversity of the stem cell compartment. Curr Opin Hematol 13: 243–8. [PubMed]
Articles from PLoS Computational Biology are provided here courtesy of
Public Library of Science