This article has Open Peer Review reports available.
Analysis of regional bone scan index measurements for the survival of patients with prostate cancer
© Kalderstam et al.; licensee BioMed Central Ltd. 2014
Received: 6 March 2014
Accepted: 7 July 2014
Published: 10 July 2014
A bone scan is a common method for monitoring bone metastases in patients with advanced prostate cancer. The Bone Scan Index (BSI) measures the tumor burden on the skeleton, expressed as a percentage of the total skeletal mass. Previous studies have shown that BSI is associated with survival of prostate cancer patients. The objective in this study was to investigate to what extent regional BSI measurements, as obtained by an automated method, can improve the survival analysis for advanced prostate cancer.
The automated method for analyzing bone scan images computed BSI values for twelve skeletal regions, in a study population consisting of 1013 patients diagnosed with prostate cancer. In the survival analysis we used the standard Cox proportional hazards model and a more advanced non-linear method based on artificial neural networks. The concordance index (C-index) was used to measure the performance of the models.
A Cox model with age and total BSI obtained a C-index of 70.4%. The best Cox model with regional measurements from Costae, Pelvis, Scapula and the Spine, together with age, got a similar C-index (70.5%). The overall best single skeletal localisation, as measured by the C-index, was Costae. The non-linear model performed equally well as the Cox model, ruling out any significant non-linear interactions among the regional BSI measurements.
The present study showed that the localisation of bone metastases obtained from the bone scans in prostate cancer patients does not improve the performance of the survival models compared to models using the total BSI. However a ranking procedure indicated that some regions are more important than others.
KeywordsArtificial neural networks Machine learning Bone scan index Survival analysis Prostate cancer
Bone scintigraphy is a very common examination for patients with prostate cancer to verify or exclude suspected metastatic disease. For patients with bone metastases the extent of the tumor burden is associated with survival [1, 2]. The Bone Scan Index (BSI) was developed in order to quantify the amount of metastases in bone scans . BSI measures the tumor burden in bone as a percentage of the total skeletal mass and has been shown to be associated with survival of patients with prostate cancer . Automated BSI methods  have been developed to further increase the objectivity and clinical use of bone scans for patients with prostate cancer. Recent work has shown that the total BSI value and BSI change between bone scans are prognostic indicators and can be used as an imaging biomarker for prostate cancer patients [6–8].
Some authors, however, suggest that the localisation of metastases in specific regions in bone is predictive of survival [9, 10]. Riguad and colleges divided prostate cancer patients in two groups; one including patients having bone metastases in the axial skeleton and the other including patients with appendicular bone metastases.
They showed that median survival time was 53 and 29 months in patients with axial and appendicular bone metastases respectively, and that those with axial disease had better survival time than those with appendicular bone metastases . Furthermore, Hovsepian et al. divided prostate cancer patients into four categories depending on the findings on radiographs. They reported that 87% of the individuals in category VI, i.e. those with >25% tumor involvement of the proximal femur died of prostatic cancer, in contrast to patients in risk category I with no involvement of the lung and pubisischium and with <25% involvement of the proximal femur, of these 48% died a disease specific death .
We would therefore like to investigate whether specific localisation of the bone metastases measured by the automated BSI method can predict survival in prostate cancer patients. We used Cox proportional hazards in the survival modeling to investigate the effect of going from the total BSI measurement to twelve regional ones. To allow for possible non-linear interactions between regional BSI measurements we also employed a more flexible modeling approach based on artificial neural networks .
All patients with the diagnosis of prostate cancer, who during the period January 2002 – December 2008 had undergone a whole-body bone scan at the Sahlgrenska University Hospital, Gothenburg, Sweden, were retrospectively considered for inclusion in the study. If several bone scan studies had been performed for the same patient, only the last one was used. Seventeen patients with images of insufficient quality and 48 patients previously included in the development phase of the automated quantification method  were excluded, leaving 1,013 patients in the study population. The study was approved by the Research Ethics Committee at Gothenburg University.
Survival data, collected from the computerized medical records, were updated until September 24, 2010. The cause of death was not known. The mean follow-up time was 2.3 years with a total of 32% censored cases. The mean age was 77 years (SD 9.1).
The percentage of the skeleton affected by tumor mass on a bone scan was measured by calculating the BSI. We have recently presented an automated method , based on the clinically validated methodology for manually computing BSI as presented by a group at the Memorial Sloan-Kettering Cancer Center in New York [3, 12, 13]. The automated method is trained to mimic an expert reader in distinguishing hotspots due to metastases from those caused by factors such as degenerative disease or fractures. A general description of how the computer method is developed and validated, including hot spot detection, feature extraction and artificial neural networks, is presented by Sadik et al. .
Thereafter, hotspots are detected and classified as a metastatic lesion or not. The area of a metastatic hotspot is calculated and this area is divided by the area of the corresponding anatomical region and multiplied by a constant representing the weight fraction of that skeletal region of the total skeleton. This product gives an estimate of the volumetric fraction of the skeleton occupied by the metastatic hotspot. The BSI is the sum of all such fractions.
The BSI-values for the different skeletal regions
To evaluate the prognostic capability of the BSI data two methods were used: Cox proportional hazards (COX) and Artificial Neural Networks (ANNs). COX  is based on the assumption of proportional hazards and is in its standard form (as used here) restricted to linear relations between covariates. The performance of each method was measured using the C-index .
To evaluate the prognostic capability of each regional BSI value individually, a COX model was created for each region and their corresponding C-index performances were compared. A correlation test indicated that age did not correlate with BSI and was therefore included in each model. Finally, a model with the total BSI was also included in the comparison.
While two regions might possess similar prognostic qualities when taken individually, there is still the question to what degree they overlap with or complement each other. This overlap can be investigated using backward elimination: first a model is created with all regional information, then the model is tested with each region missing. The region which resulted in the smallest drop in C-index is considered the least important and is removed. If two regions overlap (in the prognostic sense) however, the choice of region to remove is in the worst case completely arbitrary. To verify that the removal is not arbitrary, and that the removed region does in fact possess worse prognostic capability, we simultaneously performed a forward addition procedure.
Forward addition means that initially, a model with no regional information is created. It thus includes only age. As regions are selected for removal in the backward elimination procedure above, a new model is created which includes this newly removed region, as well as any previous information. In other words, while backward elimination starts with complete regional information as well as age and ends with only age, forward addition starts with just age and ends with all regional information together with age. If there is significant correlations between regions, then the forward addition models will quickly reach the performance of the backward elimination models.
A question related to correlation is the possibility of non-linear interactions between the regional BSI values. To investigate this possibility we turned to a model based on artificial neural networks (ANN) introduced in . ANN is a machine learning technique that offers strong non-linear capabilities. In order to increase generalization performance we used ensembles of ANNs (15 ANNs per ensemble) with 3 hidden neurons each. Each ANN in the ensemble was trained to maximize the C-index on a subset generated with bagging . The flexibility offered by ANNs are accompanied with the caveat that it can be difficult to understand the interactions between the variables due to the black box nature of the ANN. Understanding the interactions is however not required in order to prove their existence.
Following the same procedure as for the COX models we used backward elimination to investigate the significance that the ANN ensemble attributes to the covariates. A covariate that is part of a non-linear interaction will be attributed greater significance by a non-linear model than by a linear model. It is possible to indicate the existence of non-linear interactions by comparing the significance attributed to each variable by the ANN ensemble to the performance of a model trained only on that variable. A variable that is important in a non-linear fashion would have greater significance than would seem motivated based on the performance of the linear model trained using only that variable.
For both COX and ANN models, we used 20x3 fold cross validation unless stated otherwise and normalized the covariates and survival time to have zero mean and standard deviation equal to one.
The top right quadrant contains the variables which are both important individually and ranked highly by the model. This is where the best linear predictors are expected to be placed. Covariates which correlate to a high degree with these will likely end up in the bottom right quadrant. The most interesting section however is the top left quadrant, here covariates will be placed which display non-linear correlations. They would naturally fair worse individually (towards the left) than together (towards the top). No covariates were placed in that quadrant however so the result was what one expected for a data set of linear covariates.
The present study demonstrates that the localisation of bone metastases obtained from the bone scans in prostate cancer patients does not add any further clinical information beyond that of the total BSI value. Two different computational models were tested to investigate the effect of regional BSI measurements. The standard Cox proportional hazards model and one based on artificial neural networks optimizing directly on the C-index performance measure . The C-index was used in this study to evaluate regional BSI values since it directly measures the models’ ability to sort the patients according to survival time, which can be useful for subsequent risk group definitions. While the COX model models the survival curve with linear interactions between the covariates, the ANN model only outputs a prognostic index that optimizes the C-index, but allows for non-linear interactions between the covariates. Any advantages using regional BSI measurements, in terms of maximizing the C-index, should be discoverable in at least one of these two models.Our results show that both COX and ANN models give similar C-index performance for the multivariate analysis indicating that, in our study population, no significant non-linear effects could be found (see Figure 6). No combination of regional BSI measurements gave significantly better performance than using the total BSI. However, the analysis provides a ranking of the twelve BSI localisations, and we found that some regions were more important than others. Specifically a COX model with only BSI information from Costae, Pelvis, Scapula, L_spine and Th_spine performed equally well as a COX model with the total BSI. It should be noted that there is a correlation between important regions and the amount of non-zero BSI measurements.
Our results differ from what Rigaud and colleges and Hovsepian and colleges have found [9, 10]. Rigaud et al. suggest that prostate cancer patients suffering from appendicular metastases experience a shorter life expectancy than those with axial disease only . They included 86 patients treated initially with androgen deprivation as monotherapy. Furthermore, Hovsepian et al. included 102 previously untreated prostate cancer patients having bone metastases with or without lung metastases. They found that patients with >25% involvement of the proximal femur had significantly shorter survival than those with <25% involvement and with no lung metastases . A difference between our studies is that we included all prostate cancer patients (1013) with bone metastases undergoing a bone scintigraphy at our department without restricting the inclusion criterion to a specific prostate cancer group. Our study population is tenfold larger than both Rigauds and colleges and Hovsepians and colleges and have therefore a higher power to address the question whether localisation of bone metastases can predict survival or not.
Our dataset also has similar differences in 5 year survival rates between groups of patients as Singh et al.  reported. The overall survival rate was 43% (75% for Singh). The survival rate for the 287 patients with no detected metastases was 74% (90% for Singh) while the 670 patients with detected metastases had a significantly (p<0.00001) lower survival rate of 30% (58% for Singh). In addition, the 342 patients with ≤5 metastases had a much improved survival rate of 50% (73% for Singh) compared to 7% (45% for Singh) for the 328 patients with >5 metastases (p<0.00001).
Yamashita et al.  found that the presence of bone metastases outside the pelvis and the lumbar spine is predictive of shorter survival time among the responders to androgen deprivation therapy. This suggests that the localisation of bone metastases may be a prognostic indicator if information of therapy response is also added. We have not considered therapy response in the analysis and can therefore not compare our results with theirs. Data on therapy response would be needed to fully clarify the prognostic capability of regional BSI. On the other hand, our group has recently reported that the total BSI-change between the baseline bone scan and the follow-up can predict prognosis in metastatic castration-resistant prostate cancer patients who were receiving docetaxel . 57% of those with a decrease in total BSI-change were alive after two years compared with only 18% of those with an increase in total BSI-change (p=0.03).
The distribution of bone metastases in our data set may differ from histological data because bone scintigraphy can miss some tumors [20, 21]. The sensitivity can be increased with the use of SPECT/CT , but this technique is not routinely applied for all patients at our institution. Therefore, we could not compare planar BSI value with SPECT/CT BSI value. A meta-analysis also indicates that PET/CT has higher sensitivity than planar bone scan for detecting of metastases and the former will most likely replace bone scans in the future [23–25]. A problem that remains to be solved is the high cost and limited availability of PET/CT.
We have not considered the patients clinical T stage or the Gleason score in the statistical modeling. Neither have we considered the patient’s treatment response or their treatment arsenal, i.e. whether the patients are newly diagnosed or having castration-resistant prostate cancer. However, the aim of this study was to investigate whether one can extract and provide the clinicians with additional important clinical information from the bone scans in order to further help them differentiate between low-risk and high-risk patients. The outcome of this study is that the localisations of bone metastases does not add further clinical information beyond that of the total BSI-value.
Using two different survival analysis models and a relatively large patient population we have found that regional BSI measurements does not increase the prognostic capability compared to models that are using the total BSI. A ranking of the twelve skeletal regions showed that a model with BSI measurements from Costae, Pelvis, Scapula, L_spine and Th_spine obtained the same C-index as a model with only the total BSI (age always included). Furthermore the survival modeling could not find any complex interactions between the regional measurements beyond that of a simple additive model. The overall C-index performance for the different models was around 70%.
The study was supported by funds from the Swedish Foundation for Strategic Research (CREATE Health).
- Soloway MS, Hardeman SW, Hickey D, Raymond J, Todd B, Soloway S, Moinuddin M: Stratification of patients with metastatic prostate cancer based on extent of disease on initial bone scan. Cancer. 1988, 61: 195-202. 10.1002/1097-0142(19880101)61:1<195::AID-CNCR2820610133>3.0.CO;2-Y.View ArticlePubMedGoogle Scholar
- Noguchi M, Kikuchi H, Ishibashi M, Noda S: Percentage of the positive area of bone metastasis is an independent predictor of disease death in advanced prostate cancer. Br J Cancer. 2003, 88: 195-201. 10.1038/sj.bjc.6600715. doi:10.1038/sj.bjc.6600715,View ArticlePubMedPubMed CentralGoogle Scholar
- Erdi YE, Humm JL, Imbriaco M, Yeung H, Larson SM: Quantitative bone metastases analysis based on image segmentation. J Nucl Med. 1997, 38: 1401-1406.PubMedGoogle Scholar
- Sabbatini P, Larson SM, Kremer A, Zhang ZF, Sun M, Yeung H, Imbriaco M, Horak I, Conolly M, Ding C, Ouyang P, Kelly WK, Scher HI: Prognostic significance of extent of disease in bone in patients with androgen-independent prostate cancer. J Clin Oncol. 1999, 17: 948-957.PubMedGoogle Scholar
- Sadik M, Suurküla M, Höglund P, Jarund A, Edenbrandt L: Quality of planar whole-body bone scan interpretations - a nationwide survey. Eur J Nucl Med Mol Imaging. 2008, 35: 1464-1472. 10.1007/s00259-008-0721-5. doi:10.1007/s00259-008-0721-5,View ArticlePubMedGoogle Scholar
- Kaboteh R, Gjertsson P, Lomsky M, Ohlsson M, Sjöstrand K, Edenbrandt L, Leek Hk: Progression of bone metastases in patients with prostate cancer - automated detection of new lesions and calculation of bone scan index. EJNMMI Res. 2013, 3 (1): 64-10.1186/2191-219X-3-64. doi:10.1186/2191-219X-3-64,View ArticlePubMedPubMed CentralGoogle Scholar
- Ulmert D, Kaboteh R, Fox JJ, Savage C, Evans MJ, Lilja H, Abrahamsson P-A, Björk T, Gerdtsson A, Bjartell A, Gjertsson P, Höglund P, Lomsky M, Ohlsson M, Richter J, Sadik M, Morris MJ, Scher HI, Sjöstrand K, Yu A, Suurküla M, Edenbrandt L, Larson SM: A novel automated platform for quantifying the extent of skeletal tumour involvement in prostate cancer patients using the bone scan index. Eur Urol. 2012, 62 (1): 78-84. 10.1016/j.eururo.2012.01.037. doi:10.1016/j.eururo.2012.01.037,View ArticlePubMedPubMed CentralGoogle Scholar
- Mitsui Y, Shiina H, Yamamoto Y, Haramoto M, Arichi N, Yasumoto H, Kitagaki H, Igawa M: Prediction of survival benefit using an automated bone scan index in patients with castration-resistant prostate cancer. BJU Int. 2012, 110: 628-34. 10.1111/j.1464-410X.2012.11355.x. doi:10.1111/j.1464-410X.2012.11355.x,View ArticleGoogle Scholar
- Rigaud J, Tiguert R, Le Normand L, Karam G, Glemain P, Buzelin J-M, Bouchot O: Prognostic value of bone scan in patients with metastatic prostate cancer treated initially with androgen deprivation therapy. J Urol. 2002, 168: 1423-1426. 10.1016/S0022-5347(05)64465-5.View ArticlePubMedGoogle Scholar
- Hovsepian JA, Byar DP: Quantitative radiology for staging and prognosis of patients with advanced prostatic carcinoma. Correlations with other pretreatment characteristics. Urology. 1979, 14: 145-150. 10.1016/0090-4295(79)90147-X. doi:10.1016/0090-4295(79)90147-X,View ArticlePubMedGoogle Scholar
- Kalderstam J, Edén P, Bendahl P-O, Strand C, Ohlsson M, Fernö M: Training artificial neural networks directly on the concordance index for censored data using genetic algorithms. Artif Intell Med. 2013, 58 (2): 125-132. 10.1016/j.artmed.2013.03.001.View ArticlePubMedGoogle Scholar
- D’Amico AV, Desjardin A, Chung A, Chen MH, Schultz D, Whittington R, Malkowicz SB, Wein A, Tomaszewski JE, Renshaw AA, Loughlin K, Richie JP: Assessment of outcome prediction models for patients with localized prostate carcinoma managed with radical prostatectomy or external beam radiation therapy. Cancer. 1998, 82: 1887-1896. 10.1002/(SICI)1097-0142(19980515)82:10<1887::AID-CNCR11>3.0.CO;2-P.View ArticlePubMedGoogle Scholar
- Stattin P, Holmberg E, Johansson J-E, Holmberg L, Adolfsson J, Hugosson J: Outcomes in localized prostate cancer: national prostate cancer register of sweden follow-up study. J Nat Cancer Inst. 2010, 102: 950-958. 10.1093/jnci/djq154. doi:10.1093/jnci/djq154,View ArticlePubMedPubMed CentralGoogle Scholar
- Sadik M, Hamadeh I, Nordblom P, Suurkula M, Höglund P, Ohlsson M, Edenbrandt L: Computer-assisted interpretation of planar whole-body bone scans. J Nuclear Med. 2008, 49 (12): 1958-1965. 10.2967/jnumed.108.055061.View ArticleGoogle Scholar
- Cox DR: Regression models and life-tables. J R Stat Soc Series B (Methodological). 1972, 34 (2): 187-220.Google Scholar
- Harrell FE, Lee KL, Mark DB: Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996, 15: 361-387. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4. doi:10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4,View ArticlePubMedGoogle Scholar
- Breiman L: Bagging predictors. Mach Learn. 1996, 24 (2): 123-140.Google Scholar
- Singh D, Yi WS, Brasacchio RA, Muhs AG, Smudzin T, Williams JP, Messing E, Okunieff P: Is there a favorable subset of patients with prostate cancer who develop oligometastases?. Int J Radiat Oncol Biol Phys. 2004, 58 (1): 3-10. 10.1016/S0360-3016(03)01442-1.View ArticlePubMedGoogle Scholar
- Yamashita K, Denno K, Ueda T, Komatsubara Y, Kotake T, Usami M, Maeda O, Nakano S, Hasegawa Y: Prognostic significance of bone metastases in patients with metastatic prostate cancer. Cancer. 1993, 71: 1297-1302. 10.1002/1097-0142(19930215)71:4<1297::AID-CNCR2820710421>3.0.CO;2-S.View ArticlePubMedGoogle Scholar
- Batson OV: The function of the vertebral veins and their role in the spread of metastases. Ann Surg. 1940, 112 (1): 138-10.1097/00000658-194007000-00016.View ArticlePubMedPubMed CentralGoogle Scholar
- Roudier M, Vesselle H, True L, Higano C, Ott S, King S, Vessella R: Bone histology at autopsy and matched bone scintigraphy findings in patients with hormone refractory prostate cancer: the effect of bisphosphonate therapy on bone scintigraphy results. Clin Exp Metastasis. 2003, 20 (2): 171-180. 10.1023/A:1022627421000.View ArticlePubMedGoogle Scholar
- Helyar V, Mohan HK, Barwick T, Livieratos L, Gnanasegaran G, Clarke SE, Fogelman I: The added value of multislice spect/ct in patients with equivocal bony metastasis from carcinoma of the prostate. Eur J Nucl Med Mol Imaging. 2010, 37 (4): 706-713. 10.1007/s00259-009-1334-3.View ArticlePubMedGoogle Scholar
- Wondergem M, van der Zant FM, van der Ploeg T, Knol RJ: A literature review of 18f-fluoride pet/ct and 18f-choline or 11c-choline pet/ct for detection of bone metastases in patients with prostate cancer. Nuclear Med Commun. 2013, 34 (10): 935-945. 10.1097/MNM.0b013e328364918a.View ArticleGoogle Scholar
- Cook GJR: Pet and pet/ct imaging of skeletal metastases. Cancer Imaging. 2010, 10 (1): 153-10.1102/1470-7330.2010.0022.View ArticlePubMed CentralGoogle Scholar
- Chakraborty D, Bhattacharya A, Mete UK, Mittal BR: Comparison of 18f fluoride pet/ct and 99mtc-mdp bone scan in the detection of skeletal metastases in urinary bladder carcinoma. Clinical Nuclear Med. 2013, 38 (8): 616-621. 10.1097/RLU.0b013e31828da5cc.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2342/14/24/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.