# Mathematical optimization of the combination of radiation and differentiation therapies for cancer

- Department of Mathematical and Statistical Sciences, Centre for Mathematical Biology, University of Alberta, Edmonton, AB, Canada

Cancer stem cells (CSC) are considered to be a major driver of cancer progression and successful therapies must control CSCs. However, CSC are often less sensitive to treatment and they might survive radiation and/or chemotherapies. In this paper we combine radiation treatment with differentiation therapy. During differentiation therapy, a differentiation promoting agent is supplied (e.g., TGF-beta) such that CSCs differentiate and become more radiosensitive. Then radiation can be used to control them. We consider three types of cancer: head and neck cancer, brain cancers (primary tumors and metastatic brain cancers), and breast cancer; and we use mathematical modeling to show that combination therapy of the above type can have a large beneficial effect for the patient; increasing treatment success and reducing side effects.

## 1. Introduction

Cancer stem cells (CSC) have been identified in many cancer types as the driving force behind cancer growth and progression (Dick, 2003; Singh et al., 2003; Sell, 2004; Todaro et al., 2007; Maitland and Colling, 2008. Dingli and Michor (2006) attested as title of their 2006 paper that “*Successful therapy must eradicate cancer stem cells*.” This is hard to do, since CSC can be found at any location in the tumor (Youssefpour et al., 2012) and they are difficult to identify *in vivo* (Kummermehr, 2001). Furthermore, cancer stem cells are less sensitive to radiation or other cell killing agents (Kim and Tannock, 2005; Pajonk et al., 2010). One method to sensitize cancer stem cells is to use differentiation promoting growth factors that force CSCs to differentiate and become more sensitive to radiation. Possible differentiation promoters, which are discussed in the literature, are members of the TGF-*β* superfamily (Transforming growth factor – *β*; see Lander et al., 2009; Watabe and Miyazono, 2009; Meulmeester and Ten Dijke, 2011). TGF-*β* is known to increase stem cell differentiation, but it also affects other characteristics of growing tumors such as invasion and immune evasion. Here we focus on the differentiation stimulating properties of TGF-*β*. Other examples of differentiation therapy agents include ATRA-therapy (all-trans-retinoic acid) for acute promyelocytic leukemia (Sell, 2004) and a combination of INF-*β* (inferon-beta) and MEZ (mezerein) for treatment of melanoma (Leszczyniecka et al., 2001). Many more agents are currently investigated for their differentiation promoting activities (Leszczyniecka et al., 2001).

The mathematical modeling of cancer progression and treatment has a long history and individual treatments as well as combination therapies have been studied. A comprehensive review is given in Swierniak et al. (2009).

Our modeling and analysis of *differentiation therapy* and the combination with *radiation* *therapy* was motivated through a detailed computational model of Youssefpour et al. (2012). The model of Youssefpour et al. (2012) consist of a coupled system of partial differential equations for CSC, transient amplifying cells (TAC), differentiated cancer cells (DC), growth factors and growth inhibiting factors, and differentiation promoters. In addition, the model is spatially explicit and physical properties related to pressure and force balances are included. This model was developed over a series of publications (see Wise et al., 2008 and references therein).

Youssefpour et al. (2012) combine the detailed cancer model with differentiation therapy and with radiation therapy. They find that an appropriate combination of differentiation therapy and radiation therapy can control the cancer in situations where each individual treatment would fail. Their treatment terms are generic terms for differentiation and radiation treatments and they have not been modeled for a specific cancer type. The goal of this paper is to challenge Youssefpour’s findings for the specific cases of *head and neck cancer*, *brain cancers*, and *breast cancer*. We adapt the model of Youssefpour et al. (2012) to be able to include realistic growth and death rates, realistic differentiation therapies, realistic radiation therapy schedules, and appropriate tissue dependent radio-sensitivities. We sacrifice, however, the spatial structure of the model and we study the well mixed, spatially homogeneous situation. We argue that if the effect of combination therapy can be clearly demonstrated on a simpler model, then this mechanism will be part of a more complicated model as well. We find that for average parameters of brain cancers and for breast cancer we can confirm the finding of Youssefpour et al. (2012) in that, combination therapy can control a tumor, where each individual method would fail. For head and neck cancer, we find that differentiation therapy can drastically reduce the amount of radiation that is needed to control the tumor.

## 2. Materials and Methods

We use mathematical modeling and numerical simulations to predict the outcome of these therapies. Our mathematical model is based on a model for cancer stem cells that was derived in Hillen et al. (2013). It describes the interplay of cancer stem cells *U*(*t*) and non-stem cancer cells *V*(*t*). To describe radiation therapy we use the well-established linear quadratic model (see Fowler, 1989) with realistic standard treatments (five treatments per week, weekends off) and with tissue specific radiosensitivity parameters *α* and *β* (see Fowler, 1989). The parameterization of differentiation therapy is more difficult, since differentiation promoters are hard to quantify. Here we use the model and parameters of Youssefpour et al. (2012).

### 2.1. The Mathematical Model

We begin with the spatially homogeneous, cancer stem cell model developed by Hillen et al. (2013). By spatial homogeneity, we mean that cell density, cell growth, and the distribution of chemicals are homogeneous throughout the tumor region.

where *U*(*t*) is the volume fraction of cancer stem cells (CSCs) with respect to the total domain of interest, which contains both tumor and host cells. Similarly, *V*(*t*) is the volume fraction of non-stem tumor cells (TCs) with respect to the total domain of interest. The total volume fraction of the tumor is represented by *P*(*t*), that is, *P*(*t*) = *U*(*t*) + *V*(*t*). The parameter *δ* is the probability that a CSC will give rise to another CSC, when it divides. Thus, 1 − *δ* is the probability that a CSC will give rise to one CSC and one TC, when it divides. It is assumed that the parent CSC remains (Sell, 2004). The growth rates of the CSCs and TCs are given by *m _{U}* and

*m*, respectively. The apoptosis rate of the TCs is represented by

_{V}*a*; we assume that CSCs do not undergo apoptosis since they have unlimited replicative potential. Cell growth and differentiation are tempered by

_{V}*k*(

*P*(

*t*)), which is essentially a volume constraint. Hillen et al. (2013) assume that

*k*(

*P*) is monotonically decreasing in

*P*and piecewise differentiable, and they set

*k*(

*P*) > 0 for

*P*∈ [0,P*) and

*k*(

*P*) = 0 for all

*P*≥

*P**, for some

*P** > 0. For the purposes of this paper, we adopt the version of

*k*(

*P*) used by Hillen et al. (2013) and assume normalization of

*P** = 1 limiting

*P*to a maximum volume fraction of one, and

*k*(0) = 1. For simulations we use:

To match the notation used by Youssefpour et al. (2012) we set *δ* = 2*p* − 1. It follows that 1 − *δ* = 2(1 − *p*). In this case, *p* is the probability that a CSC gives rise to two CSCs, rather than two TCs, when it divides. That is, *p* is the probability that a CSC renews itself, and 1 − *p* is the probability that a CSC differentiates. While this model of CSC division ignores asymmetric division, it is equivalent to the model in equations (1) and (2), as shown in the Appendix of Hillen et al. (2013). The resulting model is given in equations (4) and (5).

### 2.2. Behavior of the Untreated Tumor Model

As noted in Hillen et al. (2013), if there are no CSCs, the TC population is governed by the equation

and since *k* is assumed to be decreasing, the TC population is fated to die out if *m _{V}k*(0) <

*a*. Further, if we assume that

_{V}*k*is strictly decreasing, then the TC population dies out if

since either *V* = 0 and the TCs are already extinct, or *V* > 0 and so *k*(*V)* < *k*(0) and *m _{V}k*(

*V)*<

*a*for all

_{V}*V*> 0.

The steady states of the model defined in (1, 2) are discussed in detail in Hillen et al. (2013), where it is assumed that the growth rates *m _{U}* and

*m*are both one and that the TC apoptosis rate

_{V}*a*is greater than zero. Here, we give the main results, which also apply to the model as stated in (1, 2) or equivalently in (4, 5). We note that in the untreated tumor, we assume

_{V}*δ*∈ (0, 1), that is

*p*∈ (0.5, 1), such that (2

*p*− 1) > 0. The steady states of the system are

The origin, *X*_{0}, has eigenvalues *λ*_{1} = (2*p* − 1)*m _{U}k*(0) > 0 and

*λ*

_{2}=

*m*(0) −

_{V}k*a*. Thus,

_{V}*X*

_{0}is an unstable steady state. The TC only steady state,

*X*, occurs where

_{V}*V*

_{0}solves

*m*(

_{V}k*V*

_{0}) =

*a*and has eigenvalues

_{V}*λ*

_{1}= (2

*p*− 1)

*m*(

_{U}k*V*

_{0}) > 0 and

*λ*

_{2}=

*m*′(

_{V}k*V*

_{0})

*V*

_{0}. Thus,

*X*is also unstable. The linearization for the pure CSC steady state,

_{V}*X*, has negative trace,

_{U}*m*′(1) −

_{U}k*a*, and positive determinant, −

_{V}*a*(2

_{V}*p*− 1)

*m*′(1), thus both eigenvalues are negative, and

_{U}k*X*is a stable steady state. Hillen et al. (2013) have shown that

_{U}*X*is globally asymptotically stable in the biologically relevant region where

_{U}*U*∈ [0, 1],

*V*≥ 0, and

*U*+

*V*≤ 1.

Hillen et al. (2013) derive the slow manifold of the system defined by (1, 2), where they take *m _{U}* =

*m*= 1. The slow manifold is a subset of the phase space ((

_{V}*U*,

*V)*-plane) which describes the long time dynamics of the system. As shown in Hillen et al. (2013), solutions very quickly converge to the slow manifold, and then they slowly follow this manifold getting closer to the attractor at (1, 0). This same slow manifold applies to the system defined by equations (4) and (5). We simply restore

*m*and

_{U}*m*and set

_{V}*δ*= 2

*p*− 1, as described above, giving the slow manifold (see Figure 1A):

**Figure 1. (A)** Slow manifold from equation (10) in the (*U*, *V*) phase plane. **(B)** rate of symmetric division *p*(*t*) [equation (7)] as a function of the sensitivity *ψ*. The values of *p _{max}* and

*p*are set to 0.505 and 0.2. The differentiation promoter,

_{min}*C*, is fixed at one.

_{F}**(C)**Schematic of the radial diffusion problem for the differentiation promoter

*C*.

_{F}The main result of Hillen et al. (2013) is the existence of the *Tumor Growth Paradox*. They show that a tumor with larger death rate *a _{V}* grows quicker on the slow manifold. As a consequence, tumors with larger death rate outgrow tumors with lower death rate. The reason is that increased TC death can liberate CSC which were surrounded by TC, and it can allow CSC to replicate and produce more CSCs. As a result, the tumor becomes bigger. See Hillen et al. (2013) for the detailed argumentation using geometric singular perturbation analysis of the system.

### 2.3. Modeling of Differentiation Therapy

Following Youssefpour et al. (2012), we model differentiation therapy through a simple relationship between the average level of the differentiation promoter, which we denote *C _{F}*, and the probability of CSC self-renewal,

*p*. Unlike the model of Youssefpour et al. (2012) our model does not include a self-renewal promoter; thus, we use the relationship set forth by Youssefpour et al. (2012) but we omit the self-renewal promoting factor:

where *p _{max}* is the maximum probability of self-renewal, and

*p*is the minimum probability of self-renewal. The value of

_{min}*p*is attained if no differentiation promoter

_{max}*C*is present, while

_{F}*p*is attained for

_{min}*C*→ ∞. Youssefpour et al. (2012) choose

_{F}*p*= 1 and

_{max}*p*= 0.2 in their therapy simulations. Unlike Youssefpour and coworkers, we do not model the production of differentiation promoters by tumor cells. Thus,

_{min}*C*solely represents the level of differentiation promoter prescribed during differentiation therapy. To address this lack of endogenous differentiation promoters, we choose

_{F}*p*= 0.505, which is equivalent to setting

_{max}*δ*= 0.01, as was done by Hillen et al. (2013). Following Youssefpour et al. (2012) we choose

*p*= 0.2. The parameter

_{min}*ψ*models the sensitivity of the CSCs to the differentiation promoter. The dependence of

*p*(

*t*) on the sensitivity

*ψ*is shown in Figure 1B. Other possible effects of differentiation therapy, such as effects on growth rates, are ignored, as they are by Youssefpour et al. (2012).

To model the average level of differentiation promoter within the spatially homogeneous tumor as a function of time, *C _{F}*(

*t*), we assume that the tumor resides in a spherical region of tissue and that the differentiation promoter enters this area through the boundary. The ODE system [equations (4) and (5)] gives the mean tumor behavior in this spherical tissue region. Growth promoter that enters the region from the boundary will diffuse very quickly and attain a steady state distribution over this region. To compute this value of

*C*(

_{F}*t*) we solve the problem of diffusion over a sphere of radius

*R*and average the solution over the volume of the sphere. A schematic is given in Figure 1C. We use a lower case letter to describe the radial symmetric solution

*c*(

_{F}*r*,

*t*) of the following boundary value problem

Here *ω* is the effective diffusivity of the differentiation promoter. We set *ω* = 10^{−7} cm^{2}/s throughout our simulations. Before differentiation therapy begins, *C*_{F0}(*t*) is zero. When differentiation therapy begins, the boundary condition on the sphere is set to *C*_{F0}(*t*) = 1 and the promoter diffuses into the sphere. When differentiation therapy ends, the boundary condition is simply set to zero and the promoter diffuses out of the sphere. We then set

### 2.4. Modeling of Radiation Therapy

To model external beam fractionated radiotherapy, we apply the broadly used linear quadratic (LQ) model. The surviving fraction of cells, *S*(*d*), after a single fraction of *d* grays (Gy) of radiation, is given by

where *α* may be interpreted as lethal damage due to a single track of radiation, and *β* may be interpreted as lethal damage due to the misrepair of DNA damage produced by two separate tracks of radiation (Sachs et al., 2001). As a simple approximation of the radiation resistance of CSCs, we assume that they are better able to repair DNA double strand breaks such that the quadratic interaction term *β* is zero for CSC. We further assume that there is no interaction between DNA damage produced by separate fractions of radiation, owing to the relatively large time between fractions, typically 1 day, when compared to typical DNA repair times on the order of 1 h (O’Rourke et al., 2009).

Rather than incorporate an appropriate form of the LQ model into the system of ODEs [equations (4) and (5)], we simply apply equation (8) to the CSC volume fraction, *U*, and to the TC volume fraction, *V*, at scheduled times during the simulation, using *α* and *β* values appropriate for each cell type. For example, if a fraction is scheduled to be delivered at the beginning of the two-hundredth day of the simulation, the simulation is stopped at this time, the LQ model is applied to *U* and *V*, using their respective parameter values, and the simulation is continued at 200 days plus the fraction duration, using the surviving fractions given by equation (8) as the new initial conditions. We assume fraction durations of 10 min throughout our simulations.

### 2.5. Tumor Control Probability

We use tumor control probability (TCP) to model the probability that the cells remaining after treatment will die out. To reflect the fact that we must eliminate all CSCs for treatment success (Dingli and Michor, 2006), and the fact that TCs are doomed to die out in the absence of CSCs, we calculate TCP based on the number of CSCs remaining after treatment, using the Poisson TCP formula (see Gong et al., 2013 for Poisson TCP and other TCP models).

where *N _{U}* stands for the number of CSCs;

*R*is the radius of the spherical region of interest in cm, as described in the section on differentiation therapy; and

*ρ*is the density of cells in the region of interest, which we assume to be 10

^{9}cells per cm

^{3}, a typical cell density for tumors (for example, see Joiner et al., 2009) The closer TCP is to one, the greater the probability that all CSCs die out and the tumor is controlled.

### 2.6. Numerical Simulations

For all numerical simulations of the tumor model [equations (4) and (5)] we assume the mitosis rates of the CSCs and TCs are equal. That is, *m _{U}* =

*m*. Further, following Youssefpour et al. (2012), we assume the apoptosis and mitosis rates of the TCs are equal:

_{V}*a*=

_{V}*m*. These assumptions imply that the TC populations dies out if

_{V}*k*(0) ≤ 1, which is equation (6) for this case. When combined with our earlier assumptions regarding

*k*(

*P*) and with our chosen form for

*k*(

*P*) [equation (3)], we see that in our model TCs are always doomed to die out in the absence of CSCs. Our assumptions regarding the mitosis rates and TC apoptosis rate also simplify the form of the slow manifold to

for all simulations.

Whenever we apply radiation therapy, we assume no difference in the ability of CSCs and TCs to withstand lethal single track damage. Thus, we use the same *α* value for both cell types. As mentioned previously, we set *β* = 0 for CSCs to simulate perfect repair of two-track non-lethal damage.

All numerical simulations are carried out in Maple™, using the dsolve ODE solver employing the rfk45 numerical method. For every simulation, the initial conditions are (*U*_{0}, *V*_{0}) = (0.1, 0.1), and therapy begins on the two-hundredth day. These settings allow the tumor system to hit the slow manifold, *M*, before treatment begins, in each of our simulations.

To prevent negative volume fractions during numerical simulation, we introduce a simple cutoff function

where *λ* is chosen to allow the TCP to approach one before the cutoff is imposed. The system we use for numerical simulation, incorporating the cutoff function is

where *m* = *m _{U}* =

*m*=

_{V}*a*.

_{V}As a measure of treatment success, we calculate the TCP [equation (9)] using the value of *U* obtained at the end of treatment, which is defined as the latter of: (a) the completion of the final radiation fraction, and (b) the point in time when *p*(*t*) reaches 0.5, after differentiation therapy has ended. This second point (b), accounts for the effect of lingering differentiation promoter, after the promoter is no longer being applied.

## 3. Results

We summarize the chosen parameter values in Table 1 and we give relevant references and explanations in the following subsections.

### 3.1. Head and Neck Cancer Tumor Simulations

To simulate ahead and neck tumor, we choose the following parameter values for the LQ model: an *α/β* ratio of 10 Gy and an *α* value of 0.35 Gy^{−1} (Fowler, 2010). We set the mitosis rates of the TCs and CSCs to ln 2*/*3 day^{−1}, using a cell doubling time of 3 days as per Fowler (2010). We note that this is an estimate of cell doubling time for cells undergoing cytotoxic treatment, which tend to have shorter doubling times than untreated cells (Fowler, 2010). For the radius of the domain of interest, *R*, we choose 1.5 cm. All simulations of radiation therapy use fraction sizes of 2.53 Gy, delivered once per day, on weekdays only. We used one of the optimized head and neck radiation schedules recommended by Fowler as a constraint on radiotherapy, which is 25 fractions of 2.53 Gy each, for a total of 63.25 Gy delivered over 32 days (Fowler, 2010). This schedule is optimized to satisfy a late tissue constraint of 70 Gy $\text{EQ}{\text{D}}_{3/2}$ and an acute mucosal constraint of 51 Gy $\text{EQ}{\text{D}}_{10/2}$ while delivering the maximum possible BED to the tumor, given the chosen fraction size and weekday only schedule (Fowler, 2010). We indicate the position of this schedule in Figure 2 using a black plane at 63.25 Gy, which we take as our constraint on radiation therapy.

**Figure 2. (Head and neck) TCP for various regimens of differentiation therapy (DT), radiation therapy (RT), and combination therapy, as applied to a simulated head and neck cancer tumor**. The RT protocol and tumor parameters are described in Table 1. **(A)** Simulations with CSC sensitivity to DT, *ψ* = 0.5. Thus, the probability of CSC self-renewal, *p* > 0.40. **(B)** Simulations with *ψ* = 2. Thus, *p* > 0.30. **(C)** Simulations with *ψ* = 5. Thus, *p* > 0.25. **(D)** Simulations with *ψ* = 50. Thus, *p* > 0.205.

The only parameter not yet specified is the sensitivity *ψ* toward the differentiation promoter and we have no experimental data available. In Figure 2, we show four simulations of the tumor control probability for four different sensitivities *ψ* = 0.5, 2, 5, 50 which covers a wide range of possible values. The *x*-axis denotes the duration of the differentiation treatment and the *y*-axis denotes the total radiation dose. The black plane indicates the maximum tolerable radiation dose in this particular treatment. The colored plane is the tumor control probability (TCP). We see in all four Figures that the TCP is 0 near the origin and it rises sharply to values close to one as both treatment modalities are increased. In Figure 2B for example, we see that radiation alone reaches a TCP of about 60% for the maximum dose. In combination with differentiation therapy of 50 days, we observe treatment success already at total dose of 40 Gray. This effect is more pronounced for higher sensitivity parameter *ψ*. Notice that the curve for 0 DT days is the same in all four figures.

A good quantitative measurement for efficiency of a treatment is the TCP = 50% value. To illustrate how the treatment regimens change for a fixed TCP, we list a few treatment regimens that result in a 50% TCP in Table 2. We see that for large enough sensitivity *ψ*, the total radiation dose can be drastically reduced if differentiation therapy is applied.

### 3.2. Brain Cancer Simulations

To simulate a brain cancer, we use an average *α/β* ratio of 12 Gy and *α* value of 0.3 Gy^{−1}, as estimated by Yuan et al. (2008) for brain cancers (primary tumors as well as brain metastatic cancers). This gives a *β* value of 0.025 Gy^{−2}. For the radius of the domain of interest, *R*, we use 1.9 cm, which is roughly the radius of a sphere of volume 28.8 cm^{3}, the volume of a brain metastatic cancer arising from non-small-cell lung cancer, reported in the same paper (Yuan et al., 2008). For the CSC and TC growth rates, we use ln 2*/*3.9 day^{−1}, where 3.9 is an estimate of the mean potential doubling time of brain metastatic cancer originating from various primary cancers, as measured by flow cytometry (Struikmans et al., 1997). All simulations involving radiation use a fraction size of 3.8 Gy, delivered once per day on weekdays only. This fraction size is listed by Yuan et al. (2008) as part of a hypofractionated stereotactic radiotherapy regimen involving 15 fractions, and it approaches the radiation tolerance for normal brain tissue. We take the total dose of 57.5 Gy listed by Yuan et al. (2008) as our constraint on radiation therapy, which appears as a black plane in Figure 3.

**Figure 3. (Brain cancer) TCP for various regimens of differentiation therapy (DT), radiation therapy (RT), and combination therapy, as applied to a simulated brain cancer with average parameter values**. The RT protocol and tumor parameters are described in Table 1. **(A)** Simulations with CSC sensitivity to DT, *ψ* = 0.5. Thus, the probability of CSC self-renewal, *p* > 0.40. **(B)** Simulations with *ψ* = 2. Thus, *p* > 0.30. **(C)** Simulations with *ψ* = 5. Thus, *p* > 0.25. **(D)** Simulations with *ψ* = 50. Thus, *p* > 0.205.

The results as documented in Figure 3 are very similar to those for the head and neck cancer. One difference is that without any differentiation therapy, the cancer cannot be controlled by radiation alone. At least not within the given parameter values. In Table 3 we list some TCP 50% values for this case.

### 3.3. Breast Cancer Tumor Simulations

To simulate the treatment of a small breast tumor, perhaps remaining after the resection of a large tumor, we choose *R* = 0.25 cm. The CSC and TC growth rates are set to ln 2*/*8.2 day^{−1}, where 8.2 is the median potential doubling time of human breast tumors measured by Rew et al. (1992) using flow cytometry. Plausible parameter values for the LQ model [equation (8)] are taken from Qi et al. (2011): *α/β* = 2.88 Gy and *α* = 0.08 Gy^{−1}. We use a fraction size of 2.26 Gy, delivered once per day on weekdays only. Our radiation constraint, indicated by a black plane in Figure 4, is 65.54 Gy, which corresponds to 29 fractions, the maximum number of fractions that satisfy the late tissue constraint of 70 Gy $\text{EQ}{\text{D}}_{3/2}$ and the acute mucosal constraint of 51 Gy $\text{EQ}{\text{D}}_{10/2}$ given in Fowler (2010).

**Figure 4. (Breast) TCP for various regimens of differentiation therapy (DT), radiation therapy (RT), and combination therapy, as applied to a simulated breast cancer tumor**. The RT protocol and tumor parameters are described in the corresponding result section. **(A)** Simulations with CSC sensitivity to DT, *ψ* = 5. Thus, the probability of CSC self-renewal, *p* > 0.25. **(B)** Simulations with *ψ* = 50. Thus, *p* > 0.205. We do not include graphs for simulations with *ψ* = 0.5 or *ψ* = 2, as they result in TCP ≈ 0 for all treatment regimens tested.

Since the breast tumor in this example is late responding (low *α/β*-ratio), it is very difficult to control the cancer with radiation alone. The maximum tolerable dose of 65.54 Gy is reached much earlier than the TCP shows any growth. Using radiation in combination with differentiation therapy gives some hope that the cancer can be eradicated. Provided, however, that the CSC cells are sensitive enough to the differentiation promoter. In Table 4 we list a few TCP 50% values.

## 4. Discussion

Current treatment modalities of cancer include surgery, radiation, chemotherapy, immuno-therapies, hormone therapies, and differentiation therapies. All of these methods have distinct advantages and limitations and clinicians often combine various methods to obtain the best results. In fact, in most cases a surgical removal or a radiation treatment is followed by chemotherapy. However, if chemotherapy is based on a single cytotoxic agent then the sensitive part of the tumor is killed but the resistant cell population persists; leading to chemo-resistance (Swierniak et al., 2009). The sensitivity to ionizing radiation can also vary in a tumor, where quiescent cells, or stem cells are less radiosensitive than cells that are actively proliferating (Kim and Tannock, 2005; Pajonk et al., 2010). Differentiation therapy describes the attempt to force stem cells into differentiation to increase their sensitivity to treatment agents (Leszczyniecka et al., 2001; Sell, 2004). This idea is conceptually intriguing and it is our attempt in this paper to quantify the possible benefit for three specific cases: head and neck cancer, brain cancers, and breast cancer.

Our results are based on a mathematical model for the dynamics of cancer stem cells (CSC) and non-stem cancer cells (TC). The model is derived from previous models of Youssefpour et al. (2012) and Hillen et al. (2013) and it includes control through differentiation therapy and radiation treatment. The benefit of a given treatment is computed using the (Poissonian) tumor control probability (TCP).

We found very good references to most of the model parameters such as growth rates, doubling times, tumor volumes, and radiation sensitivities (see Table 1). However, we were not able to find good measurements for the sensitivity parameter *ψ*. Differentiation therapy alone has been used successfully in several cases. For example, about 70% of acute promyelocytic leukemia can be controlled by ATRA-therapy (all-trans-retinoic acid, Sell, 2004). Melanoma can be treated with the differentiation promoter cocktail of inferon-β and mezerein (Leszczyniecka et al., 2001); and Lander et al. (2009) and Youssefpour et al. (2012) suggest the use of the differentiation promoter TGF-*β*. However, to our knowledge, the effect of these promoters has never been quantified. Hence we reside to explore a wide range of possible sensitivities *ψ*.

In each case we found a clear advantage of combination therapy, where differentiation therapy drastically reduces the total radiation dose. We are able to confirm the findings of Youssefpour et al. (2012) for the cases of head and neck cancer, brain cancers, and breast cancer data. For future studies it is important to get estimates for the sensitivity *ψ* and we hope that research groups around the world might be able to identify this in the future.

It should be noted that the above model is over-simplistic to fully model a growing tumor. For the brain-tumor, for example, the spatial extent of the tumor is a dominating problem for treatment. The knowledge of an optimal combination therapy schedule is only useful if the overall treatment volume is known. It is the focus of ongoing research to identify a suitable treatment volume (see Konukoglu et al., 2010; Painter and Hillen, 2013). In addition, the immune response will be an important player in each of the tumors mentioned above. As discussed by Hanahan and Weinberg (2011), the immune system can be both, tumor promoting and tumor inhibiting and the complex interactions are not fully understood. When we face all these additional difficulties, it appears as an advantage to have a simple sub-model, such as (4, 5), which clearly and consistently shows the benefit of combination therapy for a wide range of parameters and a selection of different tumors. This suggests that a combination of differentiation therapy and radiation therapy should be considered as a serious alternative.

## Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

## Acknowledgments

We thank the members of the Journal Club in Mathematical Biology at the University of Alberta for valuable feedback and discussions. The work of Jeff W. N. Bachman was funded by an NSERC Undergraduate Student Research Award (USRA). Thomas Hillen is supported by an NSERC Discovery Grant.

## References

Dingli, D., and Michor, F. (2006). Successful therapy must eradicate cancer stem cells. *Stem Cells* 24, 2603–2610.

Fowler, J. (1989). The linear quadratic formula and progress in fractionated radiotherapy. *Br. J. Radiol.* 62, 679–694.

Gong, J., Dos Santos, M. M., Finlay, C., and Hillen, T. (2013). Are more complicated tumor control probability models better? *Math. Med. Biol*. 30, 1–19.

Hillen, T., Enderling, H., and Hahnfeldt, P. (2013). The tumor growth paradox and immune system-mediated selection for cancer stem cells. *Bull. Math. Biol.* 75, 161–184.

Joiner, M., Van der Kogel, A., and Steel, G. G. (2009). *Basic Clinical Radiobiology*, 4th Edn. London: Hodder Arnold.

Kim, J., and Tannock, I. (2005). Repopulation of cancer cells during therapy: an important cause of treatment failure. *Nat. Rev. Cancer* 5, 516–525.

Konukoglu, E., Clatz, O., Bondiau, P., Delignette, H., and Ayache, N. (2010). Extrapolation glioma invasion margin in brain magnetic resonance images: suggesting new irradiation margins. *Med. Image Anal.* 14, 111–125.

Kummermehr, J. (2001). Tumor stem cells – the evidence and the ambiguity. *Acta Oncol. (Madr.)* 40, 981–988.

Lander, A., Gokoffski, K., Wan, F., Nie, Q., and Calof, A. (2009). Cell lineages and the logic of proliferation control. *PLoS Biol.* 7:e15. doi:10.1371/journal.pbio.1000015

Leszczyniecka, M., Roberts, T., Dent, P., Grant, S., and Fisher, P. B. (2001). Differentiation therapy of human cancer: basic science and clinical applications. *Pharmacol. Ther.* 90, 105–156.

Maitland, N., and Colling, T. (2008). Prostate cancer stem cells: a new target for therapy. *J. Clin. Oncol.* 26, 2862–2870.

Meulmeester, E., and Ten Dijke, P. (2011). The dynamic roles of TGF-beta in cancer. *J. Pathol.* 223, 205–218.

O’Rourke, S. F. C., McAneney, H., and Hillen, T. (2009). Linear quadratic and tumor control probability modelling in external beam radiotherapy. *J. Math. Biol.* 58, 799–817.

Painter, K., and Hillen, T. (2013). Mathematical modelling of glioma growth: the use of diffusion tensor imaging DTI data to predict the anisotropic pathways of cancer invasion. *J. Theor. Biol*. 323, 25–39.

Pajonk, E., Vlashi, E., and McBride, W. (2010). Radiation resistance of cancer stem cells: the 4 R’s of radiobiology revisited. *Stem Cells* 24, 639–648.

Qi, X. S., White, J., and Li, X. A. (2011). Is α/β for breast cancer really low? *Radiother. Oncol.* 100, 282–288.

Rew, D. A., Campbell, I. D., Taylor, I., and Wilson, G. D. (1992). Proliferation indices of invasive breast carcinomas after in vivo 5-bromo-2’-deoxyuridine labelling: a flow cytometric study of 75 tumours. *Br. J. Surg.* 79, 335–339.

Sachs, R. K., Hlatky, L. R., and Hahnfeldt, P. (2001). Simple ODE models of tumor growth and anti-angiogenic or radiation treatment. *Math. Comput. Model.* 33, 1297–1305.

Sell, S. (2004). Stem cell origin of cancer and differentiation therapy. *Crit. Rev. Oncol. Hematol.* 51, 1–28.

Singh, S., Clarke, I. D., Terasaki, M., Bonn, V. E., Hawkins, C., Squire, J., et al. (2003). Identification of a cancer stem cell in human brain tumors. *Cancer Res.* 63, 5821–5828.

Struikmans, H., Rutgers, D. H., Jansen, G. H., Tulleken, C. A. F., van der Tweel, I., and Battermann, J. J. (1997). S-phase fraction, 5-bromo-2’-deoxy-uridine labelling index, duration of S-phase, potential doubling time, and DNA index in benign and malignant brain tumors. *Radiat. Oncol. Investig.* 5, 170–179.

Swierniak, A., Kimmel, M., and Smieja, J. (2009). Mathematical modelling as a tool for planning anticancer therapy. *Eur. J. Pharmacol.* 625, 108–121.

Todaro, M., Alea, M. P., Di Stefano, A. B., Cammareri, P., Vermeulen, L., Iovino, F., et al. (2007). Colon cancer stem cells dictate tumor growth and resist cell death by production of interleukin-4. *Cell Stem Cell* 1, 389–402.

Watabe, T., and Miyazono, J. (2009). Roles of TGF-beta family signaling in stem cell renewal and differentiation. *Cell Res.* 19, 103–115.

Wise, S., Lowengrub, J., Frieboes, H., and Cristini, V. (2008). Three-dimensional multispecies nonlinear tumor growth – I. Model and numerical method. *J. Theor. Biol.* 253, 524–543.

Youssefpour, H., Li, X., Lander, A., and Lowengrub, J. (2012). Multispecies model of cell lineages and feedback control in solid tumors. *J. Theor. Biol.* 304, 39–59.

Keywords: cancer stem cells, tumor stem cells, radiation treatment, differentiation therapy, combination therapy, cancer modeling

Citation: Bachman JWN and Hillen T (2013) Mathematical optimization of the combination of radiation and differentiation therapies for cancer. *Front. Oncol.* **3**:52. doi: 10.3389/fonc.2013.00052

Received: 12 December 2012; Accepted: 28 February 2013;

Published online: 18 March 2013.

Edited by:

Katarzyna A. Rejniak, H. Lee Moffitt Cancer Center and Research Institute, USACopyright: © 2013 Bachman and Hillen. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.

*Correspondence: Thomas Hillen, Department of Mathematical and Statistical Sciences, Centre for Mathematical Biology, University of Alberta, 632 Central Academic Building, Edmonton, AB T6G 2G1, Canada. e-mail: thillen@ualberta.ca