|Year : 2019 | Volume
| Issue : 4 | Page : 235-241
Risk Factors for 3-Year-Mortality and a Tool to Screen Patient in Dialysis Population
MA Bujang1, PX Kuan1, FE Sapri1, WJ Liu2, R Musa3
1 Clinical Research Centre, Sarawak General Hospital, Kuching, Sarawak, Malaysia
2 Department of Medicine, Haemodialysis Unit, Hospital Sultanah Aminah, Johor Bahru, Johor, Malaysia
3 Department of Psychiatry, Kulliyyah of Medicine, International Islamic University, Kuantan, Pahang, Malaysia
|Date of Web Publication||04-Jun-2019|
M A Bujang
Clinical Research Centre, Sarawak General Hospital, Jalan Tun Ahmad Zaidi Adruce, Kuching, Sarawak
Source of Support: None, Conflict of Interest: None
Introduction: Clinical parameters especially co-morbidities among end stage renal disease (ESRD) patients are associated with mortality. This study aims to determine the risk factors that are associated with mortality within three years among prevalent patients with ESRD. Methods: This is a cohort study where prevalent ESRD patients' details were recorded between May 2012 and October 2012. Their records were matched with national death record at the end of year 2015 to identify the deceased patients within three years. Four models were formulated with two models were based on logistic regression models but with different number of predictors and two models were developed based on risk scoring technique. The preferred models were validated by using sensitivity and specificity analysis. Results: A total of 1332 patients were included in the study. Majority succumbed due to cardiovascular disease (48.3%) and sepsis (41.3%). The identified risk factors were mode of dialysis (P < 0.001), diabetes mellitus (P < 0.001), chronic heart disease (P < 0.001) and leg amputation (P = 0.016). The accuracy of four models was almost similar with AUC between 0.680 and 0.711. The predictive models from logistic regression model and risk scoring model were selected as the preferred models based on both accuracy and simplicity. Besides the mode of dialysis, diabetes mellitus and its complications are the important predictors for early mortality among prevalent ESRD patients. Conclusions: The models either based on logistic regression or risk scoring model can be used to screen high risk prevalent ESRD patients.
Keywords: End stage renal disease, mortality, risk factors, screening tool, sensitivity and specificity
|How to cite this article:|
Bujang M A, Kuan P X, Sapri F E, Liu W J, Musa R. Risk Factors for 3-Year-Mortality and a Tool to Screen Patient in Dialysis Population. Indian J Nephrol 2019;29:235-41
|How to cite this URL:|
Bujang M A, Kuan P X, Sapri F E, Liu W J, Musa R. Risk Factors for 3-Year-Mortality and a Tool to Screen Patient in Dialysis Population. Indian J Nephrol [serial online] 2019 [cited 2020 Nov 26];29:235-41. Available from: https://www.indianjnephrol.org/text.asp?2019/29/4/235/259728
| Introduction|| |
End stage renal disease (ESRD) is a state of permanent loss of renal function. The prevalence of ESRD patients is growing rapidly worldwide fuelled by aging populations and a pandemic of chronic non-communicable diseases especially diabetes mellitus and hypertension. It was estimated that by 2030, the global population of ESRD patients on dialysis may exceed two million. The statistics has shown that ESRD as one of the burden of diseases worldwide.
In Malaysia, the incidence and prevalence of patients with ESRD has been on an upward trend for the past 20 years. The annual mortality rate for patients on dialysis in the year 2014 was 12.0% and majority of the deaths were contributed by cardiovascular disease (CVD) with 37.0%, followed by sepsis with 24.0%. By 2040, the prevalence of ESRD patients is projected at more than 100 000 patients with the estimated prevalence rate at 25.6% which is about nine times of prevalence rate in 2000.
The current situation has indicated that ESRD has become a burden of disease in majority of the countries whereby the disease has a significant impact on morbidity,,, quality of life,,, mortality, and economic burden for the country. Patients with ESRD are considered as very high risk group and usually have lower survival especially with presence of other comorbidities such as CVD and hypertension., Numerous studies have been done to determine the risk factors for mortality or survival among ESRD patients,,,,, and majority of these studies only reported up to the level of the risk factors.
Stating the risk factors is useful. However, to formulate a predictive model from the risk factors would ease the clinicians in prognostication.,, Few studies have attempted to produce a predictive model to determine the risk of mortality among ESRD patients., Similarly, based on the Malaysian population, this study aims to determine the risk factors for mortality within three years. Hence, this study aims to develop a simple predictive model based on logistic regression model and risk scoring model to predict risk for mortality within three years among prevalent ESRD patients. The significance of the study was to identify and to propose a simple and quick prognostic model that can be used by clinicians in clinical setting to screen high risk patients requiring more attention.
| Materials and Methods|| |
This is a cohort study where patients' demographic and clinical details were recorded from questionnaire based study. The recruitment was based on consecutive sampling from May 2012 to October 2012. The samples were prevalent dialysis patients who were undergoing peritoneal dialysis or haemodialysis from 22 dialysis centres within 10 states. Written consent was taken from all patients before they participated in the study. Demographic profiles (age, gender, ethnicity, religion, marital status, highest education level, smoking history and alcohol history) and clinical histories and parameters (duration of dialysis, mode of dialysis, body mass index, diabetes mellitus, hypertension, Coronary Heart Disease (CHD), leg amputation, cerebrovascular disease and cancer) were collected during the baseline of study. The definition of these variables are following the same definition with the Case Report Form (CRF) for National Renal Registry report.
Their records such as their name and identification card number were then matched with National Death Record (NDR) which is maintained by Department of Registration Malaysia at the end of year 2015 to determine the status of mortality within three years. The data was divided into model development (70.0% of the data) and model validation (remaining 30.0% of the data) based on consecutive sampling. The idea is that, the model that to be developed in the development phases to be as good or sensitive in predicting for later data. The study was registered under the National Medical Research Registry (NMRR-11-827-10135) and has obtained approval from the Medical Research Ethics Committee (MREC) of Malaysia.
All analyses were carried out using SPSS (IBM corporation. Released 2011. IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp).
Logistic regression model
Univariate analysis was conducted based on Pearson's chi square test to determine the associated factors toward risk of mortality within three years while multivariate analysis was based on logistic regression using forward likelihood ratio method. The cut off probability for variable selection was set at 0.05 for both inclusion and exclusion. Two models were derived from logistic regression model where the first model includes the significant factor from demographic and clinical variables while the second model only incorporates clinical variables as predictors. The coefficients, odds ratio with respective confidence interval and P values were recorded then subsequently the z-score and probability of event were calculated for both models. The probability of event was calculated using the following link function: P[event] = ez/1 + ez. The area under the curve (AUC) was analysed to examine the accuracy of the probability of event from model 1 and model 2 towards status of mortality within three years.
Risk scoring model
The clinical variables that were significant (P < 0.05) based on multivariate analysis were selected as the predictors for risk scoring models. Pearson's chi square test was applied to determine the association between clinical variables toward risk of mortality within three years. The crude odd ratios were calculated for all the significant variables. There are two approaches in assigning the score. Model 3 recommended that the scores were assigned based on the magnitude of effect size (odds ratio) while Model 4 recommended each variables were assigned by one mark. The total score is calculated by a summation of the scores.
| Results|| |
Descriptive, prevalence of the risks factor and incidence of mortality
A total of 1332 patients (51.0% males and 49.0% females) were included in our study. Majority of patients' age were between 40 and 64 years (58.3%). Almost half of them were classified as overweight (28.9%) and obese (12.5%). There were 35.9% of them who were already diagnosed with diabetes mellitus. Majority of them (83.9%) were having hypertension. One sixth of the patients (15.3%) in our study diagnosed with ESRD had underlying CHD [Table 1] and [Table 2]. Prevalence of mortality within 3 years was 41.4%. Patients died were due to CVD (48.3%) and sepsis (41.3%), gastrointestinal (2.8%), cancer (2.1%), hepatobiliary (1.2%), accident (0.2%) and others (4.0%).
|Table 1: Univariate analysis for associated factors within demographic profile variables toward mortality within 3 years based on data from model development|
Click here to view
|Table 2: Univariate analysis for associated factors within clinical variables toward mortality within 3 years based on data from model development|
Click here to view
Based on univariate analysis, marital status (P < 0.001), highest education level (P < 0.001), mode of dialysis (P < 0.001), status of transplant (P = 0.001), status of diabetes mellitus (P < 0.001), status of hypertension (P < 0.001), status of chronic heart disease (P < 0.001) and status of leg amputation (P < 0.001) were associated with the outcome [Table 1] and [Table 2]. The characteristics of patients who are likely at risk of mortality within three years are widow/widower, lower highest education level (no formal education and primary school), mode of dialysis with CAPD, without transplant, having diabetes mellitus, hypertension, chronic heart disease and leg amputation.
Logistic regression model
Result based on multivariate analysis suggested that all the significant variables remained significant except for marital status, status of transplant and hypertension (Model 1). Second model (Model 2) was formulated and to only incorporates clinical variables. All variables remained significant except for hypertension. The AUC (95%CI) for Model 1 and Model 2 were 0.711 (0.676, 0.745) and 0.692 (0.656, 0.727) respectively [Table 3].
|Table 3: Summary of statistics derived from logistic regression model for Model 1 and Model 2 based on data from model development|
Click here to view
Risk scoring model
The risk scoring model was based on logistic regression model in terms of variable selection but using the pre-determined score instead of the coefficients. There were four clinical variables were tested such as mode of dialysis, diabetes mellitus, CHD and leg amputation. The crude odds ratios were within 1.6 to 5.2. Two models were proposed and the distributions of the score were assigned based on the weightage of crude odd ratio (Model 3) and by assigning 1 mark for each variable (Model 4). The AUC (95% CI) for Model 3 and Model 4 were 0.697 (0.662, 0.731) and 0.680 (0.645, 0.716) respectively [Table 4].
|Table 4: The effect size of each significant clinical variables towards mortality within 3 years based on data from model development and the assigned score for Model 3 and Model 4|
Click here to view
Preferred statistical models
If the decision is taken merely based on statistics, the best model was Model 1 with slightly higher accuracy as compared to the rest of the models. However, due to simplicity, this study proposed Model 2 and Model 4 as the preferred models where Model 2 which is based on logistic regression reported slightly higher accuracy. The probability of event and the score were further categorized into two (Low risk to high risk versus very high risk; Low risk versus moderate to very high risk). The sensitivity and specificity of the two models were evaluated based on sensitivity and specificity analysis.
Results of sensitivity and specificity from data in development and validation sets for both models based on selected cut offs were exactly similar. Based on categorization of “Low risk to high risk versus very high risk”, the sensitivity and specificity were 9.95% and 98.93% respectively. The same categorization was tested based on data in validation phase, and the sensitivity and specificity were 8.83% and 99.09% respectively. Meanwhile, based on categorization of “Low risk versus moderate to very high risk”, the sensitivity and specificity were 77.42% and 49.11% respectively. The same categorization was tested based on data in validation phase, the result showed that the sensitivity and specificity were 88.89% and 25.45% respectively [Table 5].
|Table 5: Summary of the performance of Model 2 and Model 4 in predicting high risk of mortality within 3 years among prevalent end stage renal disease patients|
Click here to view
| Discussion|| |
The prevalence of mortality was 41.4% within three years and this was parallel to the data shown in 2014 by the National Renal Registry where annual prevalence in that year was reported to be 12.0%. The main causality was due to CVD where reported involving one third of them, followed by a quarter of them succumbed due to sepsis; similar to what have been reported in the national registry. The pattern of cause of deaths was also consistent in U.S.,
This study has explored four possible models in predicting mortality within three years among prevalent ESRD patients. Logistic regression model has been used widely in clinical research to determine association between factors and outcome. If the effect sizes of the contributing factors are satisfactorily high, then it is worth to pursue the model for prediction. With regards to studies on associated factors towards mortality among ESRD patients, previous works have applied different approaches. Barrett et al. had applied age and other comorbidity as predictors for mortality from first dialysis but the prediction is not quite satisfactory. Meanwhile, Cohen et al. (2010) worked on predicting six-month mortality for patients who are on maintenance haemodialysis. Their work used five predictors and found that the accuracy of the model is satisfactory.
We developed the model based on forward likelihood ratio as the stepwise method with strict cut offs probability for entry and removal selection in the stepwise procedure. Forward stepwise procedure starts with a null model. Then it allows each variable to be selected into the model one at a time based on some pre-specified priority. The process is continuing until some stopping rule is satisfied. This is to ensure only major factors will be selected in the final model since statistically significant or P value less than 0.05 is also can be achieved by very large sample besides the clinical significant.,,
This study has found that the major contributing factors for the risk of mortality within three years are highest education level, mode of dialysis, diabetes mellitus, CHD and leg amputation. Considering the classification of education may differ in other countries, Model 2 was developed to only incorporate the clinical variables. The AUC between Model 1 and Model 2 were almost similar. However, Model 2 was a preferred choice due to its properties of having less predictor and was also possible to be applied in other countries.
Perhaps, one of the disadvantages of using logistic regression model is the complexity in the calculation of the risk or probability of event. This could make the model unlikely to attract clinicians to apply the model in clinical setting. Due to this concern, this study has also explored the possibility in developing the prediction model based on risk scoring model. Based on this model, scores are assigned to each predictor based on some judgement and simple calculation such as summation to be applied to derive the total score.
In this study, two approaches were applied to assign the score for each predictor. Model 3 assigned the score based on the magnitude of effect size such as odds ratio and Model 4 assigned the score for one mark each. Results found that the AUC between Model 3 and Model 4 are almost similar and hence Model 4 is preferred due to simpler computation. Based on our data, the assigned of one-mark score for each predictor is sufficient since the magnitude of effect sizes based on crude odds ratio were quite narrow with between 1.6 and 5.2. In fact, the adjusted odds ratios were narrower. Although some may perceive different weightage score need to be assigned for different predictor, but result showed that the accuracy of Model 3 and Model 4 were almost similar. A famous risk scoring such as TIMI score to predict unstable angina is also applying simple computation of scoring with one-mark score for each predictor.
Due to the similarities in the accuracy, this study has proposed that Model 2 and Model 4 to be applied to screen high risk patients of mortality within three years. Based on the selected cut offs, both models have reported good sensitivity although with moderate specificity. In some studies, specificity values can be reduced to increase the sensitivity of the screening tool.,, However, if based on categorization of “Low risk to high risk versus very high risk”, the specificity was highly excellent. Therefore, which categorization to be applied will depends on the aim of the researchers.
This study has showed that performance of model based on risk scoring is as good as model that was based on logistic regression. The authors would like to emphasize that the approach of risk scoring is recommended to be accepted if each predictor have almost the same magnitude in predicting the outcome. It was showed in the [Table 3] where the coefficients were between 0.552 and 1.086 and hence, this study recommended one mark for each predictor is reasonably acceptable.
There were few models reported in literatures with different approaches in methodology. Majority recruited new dialysis patients and review the cohort between six months to five years.,, Cohen et al. (2010) recruited prevalent dialysis patients only on haemodialysis and only emphasize for six months' survival. The present study in the other hand successfully developed the screening tool to determine the high risk patients based on three-years' mortality among prevalent ESRD. The justification to use the prevalent dialysis patients as the subjects is because to develop a risk model that can be applied for ESRD patients at any point of disease.
Wagner et al. has studied a 3-years cohort among the new dialysis patients. They found that basic patient characteristics (age, race, primary kidney disease, and treatment modality), comorbid conditions (diabetes, history of cardiovascular disease, and smoking), and laboratory variables (hemoglobin, serum albumin, creatinine, and calcium levels) can predict 3-year mortality in incident dialysis patients. Instead predicting yes or no mortality within three years, their study preferred to use risk classification such as low, intermediate, high, and very high mortality risk. The present study has found almost similar independent factors such as age and comorbid conditions but unfortunately the present study did not observe laboratory variables. To date, there is no predictive modelling has been developed to screen high risk ESRD patients in Malaysia. This study perhaps had recruited small sample size in comparison with prevalent ESRD patients currently available in Malaysia. However, previous study had shown that study with sample size preferably more than 500 will likely to produce statistics that represent the parameters in the intended population., Another limitation of this study is some causes of death were unknown due to some death certificates were verified by non-medical officers and also in some cases were due to refusal of post-mortems by family members. However, at least 69.3% of the causes of death were successfully verified by medical officers. If the unknown death can be assumed as a sudden death due to CVD, hence the percentage of cause of death due to CVD will increase from 48.3% to 64.2%.
Besides that, this study did not observe variables that perhaps important in predicting the outcome such as anemia, phosphate level and other indicators. This is because, this was a questionnaire based study and hence some of the important clinical parameters were not available. However, the earlier intention of this study is to develop a predictive model using basic parameters so a quicker screening process can be made without relying on other parameters. Some of the AUCs were slightly less than 70.0% in which the values are perhaps not sufficiently strong for diagnostic purpose. Therefore, the application of the models need to be interpreted with caution.
However, the AUCs with nearly 70.0% is acceptable good for screening purpose. In some studies, the optimal cut off can be adjusted to increase sensitivity of the model but at the same time, have to sacrifice the value of specificity. This practice can be accepted in some studies if the instrument or the model to be used for screening purpose., We recommended future studies to apply the model in different populations in other countries so the evaluation and the robustness of the predictive model can be assessed.
| Conclusion|| |
In conclusion, this study found that the major causes of death within three years among ESRD patients are CHD and sepsis. Besides that, we have developed a simple and quick screening tool to determine patients who are at risk of mortality within three years. This study proposed two types of statistical models that can be used to screen high risk patients with ESRD. Based on our data, the model based on logistic regression and risk scoring model were both equally good. Hence, this study has proposed the logistic regression model to be applied in clinical setting since the model has slightly higher accuracy and was developed based on the standard mathematical computation. However, for a quick and simpler screening purpose, risk scoring model is also can be used instead.
We would like to thank the Director General of Health Malaysia for his permission to publish this article. We would like to thank the National Renal Registry, Malaysia, especially to Sister Lee Day Guat for their contribution and data sharing. We would also like to thank to Ministry of Science, Technology and Innovation, Malaysia for the funding and to Ms Nur Khairul Bariyyah Mohd Hatta for helping to format and submit this manuscript on our behalf.
Research involving human participants and/or animals
This study did not apply any intervention. However, this study was conducted based on the ethical standard in conducting research. The study was registered under the National Medical Research Registry (NMRR-11-827-10135) and has obtained approval from the Medical Research Ethics Committee (MREC) of Malaysia.
Written consent was obtained from all patients before they participated in the study
Declaration of patient consent
The authors certify that they have obtained all appropriate patient consent forms. In the form the patients have given their consent for their images and other clinical information to be reported in the journal. The patients understand that their names and initials will not be published and due efforts will be made to conceal their identity, but anonymity cannot be guaranteed.
Financial support and sponsorship
Funding is provided by the Ministry of Science, Technology and Innovation, Malaysia (Project No. 06-01-08-SF0093).
Conflicts of interest
There are no conflicts of interest.
| References|| |
Szczech LA, Lazar IL. Projecting the United States ESRD population: Issues regarding treatment of patients with ESRD. Kidney Int Suppl 2004;66:S3-7.
The National Renal Registry. 22nd
Report of the Malaysian Dialysis and Transplant Registry 2014. Kuala Lumpur, Malaysian Society of Nephrology; 2015.
Bujang MA, Adnan TH, Hashim NH, Mohan K, Kim Liong A, Ahmad G, et al.
Forecasting the incidence and prevalence of patients with end-stage renal disease in Malaysia up to the year 2040. Int J Nephrol 2017;2017:2735296.
Held PJ, Brunner F, Odaka M, García JR, Port FK, Gaylin DS, et al.
Five-year survival for end-stage renal disease patients in the United States, Europe, and Japan, 1982 to 1987. Am J Kidney Dis 1990;15:451-7.
Bujang MA, Musa R, Liu WJ, Chew TF, Lim CT, Morad Z, et al.
Depression, anxiety and stress among patients with dialysis and the association with quality of life. Asian J Psychiatr 2015;18:49-52.
Liu WJ, Musa R, Chew TF, Lim CT, Morad Z, Bujang A, et al.
Quality of life in dialysis: A Malaysian perspective. Hemodial Int 2014;18:495-506.
Valderrábano F, Jofre R, López-Gómez JM. Quality of life in end-stage renal disease patients. Am J Kidney Dis 2001;38:443-64.
Patel SS, Shah VS, Peterson RA, Kimmel PL. Psychosocial variables, quality of life, and religious beliefs in ESRD patients treated with hemodialysis. Am J Kidney Dis 2002;40:1013-22.
Muntner P, Hamm LL, Kusek JW, Chen J, Whelton PK, He J, et al.
The prevalence of nontraditional risk factors for coronary heart disease in patients with chronic kidney disease. Ann Intern Med 2004;140:9-17.
Whelton PK, Klag MJ. Hypertension as a risk factor for renal disease. Review of clinical and epidemiological evidence. Hypertension 1989;13:I19-27.
Ku E, Gassman J, Appel LJ, Smogorzewski M, Sarnak MJ, Glidden DV, et al.
BP control and long-term risk of ESRD and mortality. J Am Soc Nephrol 2017;28:671-7.
Muntner P, Judd SE, Gao L, Gutiérrez OM, Rizk DV, McClellan W, et al.
Cardiovascular risk factors in CKD associate with both ESRD and mortality. J Am Soc Nephrol 2013;24:1159-65.
Foster MC, Inker LA, Hsu CY, Eckfeldt JH, Levey AS, Pavkov ME, et al.
Filtration markers as predictors of ESRD and mortality in Southwestern American Indians with type 2 diabetes. Am J Kidney Dis 2015;66:75-83.
Babayev R, Whaley-Connell A, Kshirsagar A, Klemmer P, Navaneethan S, Chen SC, et al.
Association of race and body mass index with ESRD and mortality in CKD stages 3-4: Results from the kidney early evaluation program (KEEP). Am J Kidney Dis 2013;61:404-12.
Wilson PW, D'Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB, et al
. Prediction of coronary heart disease using risk factor categories. Circulation 1998;97:1837-47.
Antman EM, Cohen M, Bernink PJ, McCabe CH, Horacek T, Papuchis G, et al.
The TIMI risk score for unstable angina/non-ST elevation MI: A method for prognostication and therapeutic decision making. JAMA 2000;284:835-42.
Senthil MP, Salowi MA, Bujang MA, Kueh A, Siew CM, Sumugam K, et al.
Risk factors and prediction models for retinopathy of prematurity. Malays J Med Sci 2015;22:57-63.
Barrett BJ, Parfrey PS, Morgan J, Barre P, Fine A, Goldstein MB, et al
. Prediction of early death in end stage renal disease patients receiving dialysis. Am J Kidney Dis 1997;29:214-22.
Cohen LM, Ruthazer R, Moss AH, Germain MJ. Predicting six-month mortality for patients who are on maintenance hemodialysis. Clin J Am Soc Nephrol 2010;5:72-9.
Bloembergen WE, Port FK, Mauger EA, Wolfe RA. A comparison of cause of death between patients treated with hemodialysis and peritoneal dialysis. J Am Soc Nephrol 1995;6:184-91.
Sarnak MJ, Jaber BL. Mortality caused by sepsis in patients with end-stage renal disease compared with the general population. Kidney Int 2000;58:1758-64.
Ioannidis JP. Why most published research findings are false. PLoS Med 2005;2:e124.
Bujang MA, Ghani PA, Zolkepali NA, Selvarajah S, Haniff J. A comparison between convenience sampling versus systematic sampling in getting the true parameter in a population: Explore from a clinical database: The Audit Diabetes Control Management (ADCM) registry in 2009. Proceedings of the International Conference Statistics Sciences Business Engineering; 2012.
Bujang MA, Sa'at N, Joys AR, Mohamad Ali M. An audit of the statistics and the comparison with the parameter in the population. AIP Conference Proceedings; 2015. p. 1682.
Bujang MA, Adnan TH. Requirements for minimum sample size for sensitivity and specificity analysis. J Clin Diagn Res 2016;10:YE01-6.
Yunus A, Seet W, Mohamad Adam B, Haniff J. Validation of the Malay version of berlin questionaire to identify Malaysian patients for obstructive sleep apnea. Malays Fam Physician 2013;8:5-11.
Tan SM, Loh SF, Bujang MA, Haniff J, Rahman FN, Ismail F, et al
. Validation of the Malay version of children's depression inventory. Int Med J 2013;20:188-91.
Wagner M, Ansell D, Kent DM, Griffith JL, Naimark D, Wanner C, et al.
Predicting mortality in incident dialysis patients: An analysis of the United Kingdom renal registry. Am J Kidney Dis 2011;57:894-902.
Adnan TH, Bujang MA, Supramaniam P, Hamedon NM, Mat Lazim SS, Haniff J, et al
. Trend analysis of medically certified death in Malaysia, 1995–2010. J Health Inform Dev Ctries 2012;6:396-405.
Yunus A, Seet W, Mohamad Adam B, Haniff J. Validation of the Malay version of berlin questionaire to identify Malaysian patients for obstructive sleep apnea. Malays Fam Physician 2013;8:3-5.
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]