Michel Pompeu Barros Oliveira SáI; Paulo Ernando FerrazII; Artur Freire SoaresIII; Rodrigo Gusmão Albuquerque MirandaIII; Mayara Lopes AraújoIII; Frederico Vasconcelos SilvaIII; Ricardo de Carvalho LimaIV
OBJECTIVE: Deep sternal wound infection following coronary artery bypass grafting is a serious complication associated with significant morbidity and mortality. Despite the substantial impact of deep sternal wound infection, there is a lack of specific risk stratification tools to predict this complication after coronary artery bypass grafting. This study was undertaken to develop a specific prognostic scoring system for the development of deep sternal wound infection that could risk-stratify patients undergoing coronary artery bypass grafting and be applied right after the surgical procedure.
METHODS: Between March 2007 and August 2016, continuous, prospective surveillance data on deep sternal wound infection and a set of 27 variables of 1500 patients were collected. Using binary logistic regression analysis, we identified independent predictors of deep sternal wound infection. Initially we developed a predictive model in a subset of 500 patients. Dataset was expanded to other 1000 consecutive cases and a final model and risk score were derived. Calibration of the scores was performed using the Hosmer-Lemeshow test.
RESULTS: The model had area under Receiver Operating Characteristic (ROC) curve of 0.729 (0.821 for preliminary dataset). Baseline risk score incorporated independent predictors of deep sternal wound infection: obesity (P=0.046; OR 2.58; 95% CI 1.11-6.68), diabetes (P=0.046; OR 2.61; 95% CI 1.12-6.63), smoking (P=0.008; OR 2.10; 95% CI 1.12-4.67), pedicled internal thoracic artery (P=0.012; OR 5.11; 95% CI 1.42-18.40), and on-pump coronary artery bypass grafting (P=0.042; OR 2.20; 95% CI 1.13-5.81). A risk stratification system was, then, developed.
CONCLUSION: This tool effectively predicts deep sternal wound infection risk at our center and may help with risk stratification in relation to public reporting and targeted prevention strategies in patients undergoing coronary artery bypass grafting.
aROC = Area of receiver operating characteristic curve
BMI = Body mass index
BHIS = Brompton & Harefield Infection Score
CABG = Coronary artery bypass grafting
CDC = Centers for Disease Control and Prevention
COPD = Chronic obstructive pulmonary disease
CPB = Cardiopulmonary bypass
DSWI = Deep sternal wound infection
ITA = Internal thoracic artery
OR = Operation room
ROC = Receiver operating characteristic
Deep sternal wound infection (DSWI) following coronary artery bypass grafting (CABG) is a serious and costly complication. Although individual risk factors for DSWI after CABG have been identified in multiple previous studies[2-6], and despite the existence of stratification tools for predicting risk of surgical site infection after CABG [for instance, the Brompton & Harefield Infection Score (BHIS) developed by Raja et al., which included leg or sternal, superficial, deep incisional, or organ/space surgical site infections], there is a lack of specific risk stratification tools to predict DSWI after CABG.
This study was undertaken to develop a specific prognostic scoring system for the development of DSWI that could risk-stratify patients undergoing CABG and should be applied right after the end of the surgical procedure.
The study was conducted in accordance with the principles of the Declaration of Helsinki. The local ethical committee approved the study. The authors adhered to STROBE guidelines for reporting observational studies.
Continuous, prospective surveillance data on DSWI was collected. From March 2007 to August 2016, for every CABG (with or without additional procedure), a set of 27 variables were collected to allow subsequent analysis at our institution. The dependent variable was DSWI after surgical procedure. This variable was categorized into yes or no. DSWI was considered in those who met the criteria according to the Centers for Disease Control and Prevention (CDC):
1. Patient has organisms cultured from sternal/mediastinal tissue or fluid obtained during a surgical operation or needle aspiration;
2. Patient has evidence of mediastinitis seen during a surgical operation or histopathologic examination;
3. Patient has at least one of the following signs or symptoms with no other recognized cause: fever (38oC), chest pain, or sternal instability and at least one of the following:
a. purulent discharge from sternal/mediastinal area;
b. organisms cultured from blood or discharge from sternal/mediastinal area;
c. mediastinal widening on X-ray.
The independent variables were:
Age > 70 years;
Gender (male or female);
Obesity (body mass index – BMI ≥ 30 kg/m2);
Hypertension (reported by patient and/or use of antihypertensive medication);
Diabetes (reported by patient and/or use of oral hypoglycemic medication and/or insulin);
Smoking (reported by patient; active or inactive for less than 10 years);
Chronic obstructive pulmonary disease – COPD (dyspnea or chronic cough and prolonged use of bronchodilators or corticosteroids and/or compatible radiological changes – hypertransparency by hyperinflation and/or rectification of ribs and/or diaphragmatic rectification);
Preoperative renal disease (creatinine ≥ 2.26 mg/dL or pre-operative dialysis);
Previous cardiac surgery;
Ejection fraction < 50%;
Preoperative stay > 24h;
Emergency surgery (during acute myocardial infarction, ischemia not responding to therapy with intravenous nitrates, cardiogenic shock);
Use of internal thoracic arteries (ITA);
Use of bilateral ITA;
Harvesting technique for ITA (Pedicled – direct dissection of surrounding margin of tissue around the ITA with electrocautery – or Skeletonized – artery dissection with scissors and clipping intercostal branches with metal clips without involving any margins tissue around ITA);
Number of bypasses;
Use of cardiopulmonary bypass – CPB (on-pump or offpump);
Time of CPB > 100 minutes;
Additional surgical procedure;
First-year resident in the operation room (OR);
Postoperative low cardiac output;
Reoperation (new sternotomy for bleeding, tamponade, or other reasons during the intra-hospital period);
Respiratory complications (pulmonary infection, acute respiratory distress syndrome, atelectasis, need for intubation for more than 48 hours);
Postoperative renal complications (creatinine ≥ 2.26 mg/dL or postoperative dialysis);
Blood transfusion (blood transfusion in the postoperative period before diagnostic definition of mediastinitis);
Multiple transfusions (more than 3 units of any blood products in postoperative period before diagnostic definition of DSWI);
Infection at another site.
Binary logistic regression analysis was performed to identify any independent predictors of DSWI in our population, with outcome measure of DSWI detected during primary admission or on readmission. Calibration of the scores was performed using the Hosmer-Lemeshow goodness-of-fit test. For the Hosmer-Lemeshow test, a P value that was not statistically significant (e.g, P greater than 0.05) was considered to indicate reasonable model fit. Discrimination power of the scores was analyzed using the receiver operating characteristic (ROC) curve.
Somers’ Dxy rank correlation coefficient was used as a measure of discrimination. Dxy corresponds to 2*(C–0.5) where C is the generalized area of ROC (aROC) curve (concordance probability).
R version 2.15.2 (http://www.R-project.org) and rms package (R package version 4.0-0, http://CRAN.R-project.org/package¼rms) statistical software package was used for statistical analysis.
The total sample size of this study was 1500 cases. We initially developed a predictive model in a subset of 500 consecutive cases drawn from our hospital (March 2007-April 2010). Following testing of the preliminary data, the dataset was expanded to other 1000 consecutive cases (March 2010-August 2016), from the same hospital.
Variables that were associated with increased risk of DSWI with P<0.05 were obesity, diabetes, smoking, preoperative renal disease, COPD, ejection fraction < 50%, use of pedicled ITA, on-pump CABG, additional procedure to CABG, renal complications, respiratory complications, infection at another site, reoperation and multiple transfusions. Table 1 shows the data from the univariate analysis.
Multivariate Analysis by Logistic Regression
We identified the following independent risk factors for developing DSWI: obesity (P=0.046; OR 2.58; 95% CI 1.11-6.68), diabetes (P=0.046; OR 2.61; 95% CI 1.12-6.63), smoking (P=0.008; OR 2.10; 95% CI 1.12-4.67), pedicled ITA (P=0.012; OR 5.11; 95% CI 1.42-18.40), and on-pump CABG (P=0.042; OR 2.20; 95% CI 1.13-5.81).
The score was devised by rounding off the OR values in the multivariate logistic regression, assigning 3 points to obesity, 3 points to diabetes, 2 points to smoking, 5 points to pedicled ITA, and 2 points to on-pump CABG (Figure 1).
The initial predictive model in a subset of 500 cases offered a very good prediction of outcome. The aROC curve was 0.821 (Figure 2). The Hosmer-Lemeshow goodness-of-fit test (chi significance) showed a score of 0.983.
The predictive model was tested and found to predict outcome effectively in the larger dataset (aROC curve was 0.729) (Figure 3). Hosmer-Lemeshow test showed a score of 0.142. Bootstrapping validation confirmed a good discriminative power of the model (preliminary dataset Dxy=0.61, testing dataset Dxy=0.42).
This study was undertaken at a tertiary care hospital that perform large volumes of CABG surgery, and data from 1500 patients were used to analyze risk factors for DSWI after CABG surgery. Obesity, diabetes, smoking, pedicled ITA and on-pump CABG were identified as specific predictors of DSWI after CABG. The present index was developed and validated as a predictive tool to specifically stratify CABG patients into three groups based on the risk of postoperative DSWI.
Many factors have been associated with the development of DSWI after cardiac surgery. However, there is no consensus as to which factors are most important and how each one is an independent predictor of risk for postoperative DSWI.
We observed obesity as an independent risk factor for postoperative DSWI. Milano et al. discussed some factors that could explain why obesity is a risk factor, for example, the dose of prophylactic antibiotics not corrected for BMI of the patient. They also suggest that skin preparation can be difficult and inappropriate due to the deep folds of the skin and fatty tissue itself, which can act as a substrate for infection. Diez et al. related the etiology of DSWI in obese patients with bradytrophic properties of adipose tissue that contribute to poor healing of wounds. Farsky et al. also found a BMI > 40 kg/m2 to be an independent predictor of DSWI after CABG among 1975 Brazilian patients.
Diabetes is always a feared risk factor and viewed with caution by cardiovascular surgeons, because, as a result of its pathophysiology, microvascular changes and high levels of blood glucose may adversely affect the healing process[14,15]. In this study, diabetic patients were 2.6 times more likely (independent association) to develop DSWI compared with non-diabetics. Despite our results, in another Brazilian study, published by Tiveron et al., diabetes was not found to be independently associated with mediastinitis among 2768 patients when it was adjusted for renal disease. On the other hand, Ledur et al. found diabetes to be independently associated with any infection after CABG (including DSWI) among 717 Brazilian patients.Another independent risk factor for DSWI in our study was smoking, being associated with 2.1 times more likely to present with DSWI compared with non-smokers. Abboud et al. also reported that smokers were 3.3 times more likely (independent association) to develop DSWI when compared with non-smokers in a case control study involving 117 patients (39 cases and 78 controls).
Our study found that on-pump CABG was an independent risk factor for developing postoperative DSWI. Bottio et al., in a prospective study with 324 patients who underwent CABG, of whom 216 underwent on-pump CABG and 108 underwent off-pump, observed there was lower incidence of DSWI in the off-pump group, although this difference was not statistically significant. Mack et al. observed a lower incidence of wound infection in patients undergoing off-pump compared to onpump. Sabik et al., in the Cleveland Clinic study involving 812 patients undergoing CABG (half on-pump and half off-pump), have identified a higher incidence of wound infection in the on-pump group (2% vs. 0.2%, P=0.04). Reston et al., in a metaanalysis of 53 studies involving a total of 46621 patients, found lower incidence of wound complications, including DSWI, in patients undergoing off-pump compared with on-pump CABG.
We did not observe any differences in the incidence of DSWI among patients who used or not ITA and nor did we observe an increased risk for those who used bilateral ITA. However, we found that there was a higher incidence of DSWI in patients who used pedicled ITA compared with skeletonized ITA (statistically significant). In other words, the skeletonized ITA was a protective factor for postoperative DSWI, which was an independent association.
Several studies have shown favorable results to the use of skeletonized ITA[23-26]. Saso et al. demonstrated that skeletonization of ITA in patients undergoing CABG was associated with reduced incidence of DSWI (OR 0.41, 95% CI 0.26 to 0.64) and this effect was even more evident when the specific analysis of diabetic patients was performed (OR 0.19, 95% CI from 0.1 to 0.34). Kai et al. observed that the incidence of DSWI was significantly lower in the group that underwent CABG with use of skeletonized ITA compared to the group using pedicled ITA (0.6% vs. 13% P=0.01). Sá et al. performed a meta-analysis with 4817 patients from 22 studies, demonstrating that skeletonized ITA appears to reduce the incidence of postoperative DSWI in comparison to pedicled ITA after CABG. Sá et al. conducted a second meta-analysis to determine whether there was any difference between skeletonized versus pedicled bilateral ITA in terms of DSWI after CABG with 8 studies involving 2633 (1698 skeletonized; 935 pedicled) and concluded that, when both ITAs are used, the skeletonized technique appeared to reduce the incidence of DSWI after CABG in comparison to the pedicled technique.
These results were found probably as a result of better sternal perfusion after ITA skeletonization compared to the pedicled ITA[27,28]. Boodhwani et al. conducted a study with 48 patients, in which each individual was submitted to CABG using bilateral ITA, and all ITAs were dissected skeletonized in left side and pedicled in right side. Patients were then evaluated for sternal perfusion through scintigraphy (radionuclear image). The authors found that sternal perfusion was increased in skeletonized side compared with pedicle side (increase of 17.6%, P=0.03). Kamiya et al. showed that the oxygen saturation and blood flow in the microcirculation of the sternum tissue were better when using the skeletonized ITA compared to pedicled ITA. Despite the beneficial impact of skeletonization on reducing the risk of sternal wound infection it is important to emphasize that skeletonization is technically more demanding and more timeconsuming than pedicled ITA harvesting with a steep learning curve associated with it[29-31]. Furthermore, some surgeons have raised concerns about the quality of the graft, mainly when it comes to the patency and the flow capacity of the skeletonized ITA. According to two meta-analyses[32,33], these concerns may be unfounded. The first one was conducted in order to determine whether there was any difference between skeletonized versus pedicled ITA in terms of patency within the first two years after CABG. In this meta-analysis, five studies involving 1764 evaluated conduits (1145 skeletonized; 619 pedicled) met the eligibility criteria. The overall OR for graft occlusion showed no statistical significant difference between groups. The authors concluded that, in terms of patency, skeletonized ITA appears to be non-inferior in comparison to pedicled ITA after CABG.
The second one aimed to summarize the evidence comparing the free flow capacity of skeletonized versus pedicled ITA during CABG. In total, 8 studies were identified and involved a total of 907 conduits (360 skeletonized and 547 pedicled). The authors concluded that, in terms of flow capacity, the skeletonized ITA appears to be superior in comparison to pedicled ITA during CABG.
One of the novelties of this risk prediction score, compared to other existing scores, is that it was designed to be applied not in the preoperative period, but at the time the surgical procedure ends, so that we have a score based not only on preoperative factors, but also on what actually happened during the surgical procedure.
Our study has several potential limitations. Firstly, other risk factors may be involved, but they are difficult to be measured. The aspect of the bone, which can sometimes show signs of osteoporosis, ischemia, the surgeon’s ability, failure to follow the antisepsis procedures, errors in the sternotomy and in the sternum rewiring, and excessive use of an electric scalpel, are factors that are very often not mentioned, but can be important factors in the pathophysiology of DSWI. Secondly, the total number of DSWI events was relatively small (n=72), limiting the ability to identify associations with a large number of variables. In addition, as the study emanates from one centre, one could argue that it is limited in its ability to identify associations between other unrecognized risk factors and DSWI. Similarly, the accuracy (discrimination) and utility of this tool has been validated internally; however, its generalizability to other CABG practices is unknown. External validation by other institutions of these data is required to overcome these limitations. Despite these limitations, this tool was developed and validated as an accurate tool for predicting DSWI in CABG patients. This tool was able to discriminate between three different risk strata of patients using objective data.
In conclusion, our results support the use of this tool for stratifying CABG patients based on risk of DSWI at our center. Given the wide DSWI risk variability among CABG patients, the practicing surgeon will be able to identify those at highest risk, providing the opportunity for postoperative planning, care and implementation of more aggressive preventive strategies when indicated.
1. Sharma M, Berriel-Cass D, Baran J Jr. Sternal surgical-site infection following coronary artery bypass graft: prevalence, microbiology, and complications during a 42-month period. Infect Control Hosp Epidemiol. 2004;25(6):468-71. [MedLine]
2. Harrington G, Russo P, Spelman D, Borrell S, Watson K, Barr W, et al. Surgical-site infection rates and risk factor analysis in coronary artery bypass graft surgery. Infect Control Hosp Epidemiol. 2004;25(6):472-6. [MedLine]
3. Olsen MA, Sundt TM, Lawton JS, Damiano RJ Jr, Hopkins-Broyles D, Lock-Buckley P, et al. Risk factors for leg harvest surgical site infections after coronary artery bypass graft surgery. J Thorac Cardiovasc Surg. 2003;126(4):992-9. [MedLine]
4. Lu JC, Grayson AD, Jha P, Srinivasan AK, Fabri BM. Risk factors for sternal wound infection and mid-term survival following coronary artery bypass surgery. Eur J Cardiothorac Surg. 2003;23(6):943-9. [MedLine]
5. Fowler VG Jr, O'Brien SM, Muhlbaier LH, Corey GR, Ferguson TB, Peterson ED. Clinical predictors of major infections after cardiac surgery. Circulation. 2005;112 (9 Suppl):I358-65.
6. Vuorisalo S, Haukipuro K, Pokela R, Syrjälä H. Risk features for surgical-site infections in coronary artery bypass surgery. Infect Control Hosp Epidemiol. 1998;19(4):240-7. [MedLine]
7. Raja SG, Rochon M, Jarman JW. Brompton Harefield Infection Score (BHIS): development and validation of a stratification tool for predicting risk of surgical site infection after coronary artery bypass grafting. Int J Surg. 2015;16(Pt A):69-73. [MedLine]
8. Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al; STROBE Initiative. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Int J Surg. 2014;12(12):1500-24. [MedLine]
9. Horan TC, Andrus M, Dudeck MA. CDC/NHSN surveillance definition of health care-associated infection and criteria for specific types of infections in the acute care setting. Am J Infect Control. 2008;36(5):309-32. [MedLine]
10. Friedman ND, Bull AL, Russo PL, Leder K, Reid C, Billah B, et al. An alternative scoring system to predict risk for surgical site infection complicating coronary artery bypass graft surgery. Infect Control Hosp Epidemiol. 2007;28(10):1162-8. [MedLine]
11. Milano CA, Kesler K, Archibald N, Sexton DJ, Jones RH. Mediastinitis after coronary artery bypass graft surgery. Risk factors and long-term survival. Circulation. 1995;92(8):2245-51. [MedLine]
12. Diez C, Koch D, Kuss O, Silber RE, Friedrich I, Boergermann J. Risk factors for mediastinitis after cardiac surgery: a retrospective analysis of 1700 patients. J Cardiothorac Surg. 2007;2:23. [MedLine]
13. Farsky PS, Graner H, Duccini P, Zandonadi EC, Amato VL, Anger J, et al. Risk factors for sternal wound infections and application of the STS score in coronary artery bypass graft surgery. Rev Bras Cir Cardiovasc. 2011;26(4):624-9. [MedLine]
14. Furnary AP, Zerr KJ, Grunkemeier GL, Starr A. Continuous intravenous insulin infusion reduces the incidence of deep sternal wound infection in diabetic patients after cardiac surgical procedures. Ann Thorac Surg. 1999;67(2):352-60.
15. Zerr KJ, Furnary AP, Grunkemeier GL, Bookin S, Kanhere V, Starr A. Glucose control lowers the risk of wound infection in diabetics after open heart operations. Ann Thorac Surg. 1997;63(2):356-61. [MedLine]
16. Tiveron MG, Fiorelli AI, Mota EM, Mejia OA, Brandão CM, Dallan LA, et al. Preoperative risk factors for mediastinitis after cardiac surgery: assessment of 2768 patients. Rev Bras Cir Cardiovasc. 2012;27(2):203-10. [MedLine]
17. Ledur P, Almeida L, Pellanda LC, Schaan BD. Predictors of infection in post-coronary artery bypass graft surgery. Rev Bras Cir Cardiovasc. 2011;26(2):190-6. [MedLine]
18. Abboud CS, Wey SB, Baltar VT. Risk factor for mediastinitis after cardiac surgery. Ann Thorac Surg. 2004;77(2):676-83. [MedLine]
19. Bottio T, Rizzoli G, Caprili L, Nesseris G, Thiene G, Gerosa G. Full-sternotomy off-pump versus on-pump coronary artery bypass procedures: in-hospital outcomes and complication during one year in a single center. Tex Heart Inst J. 2003;30(4):261-7. [MedLine]
20. Mack MJ, Pfister A, Bachand D, Emery R, Magee MJ, Connolly M, et al. Comparison of coronary bypass surgery with and without cardiopulmonary bypass in patients with multivessel disease. J Thorac Cardiovasc Surg. 2004;127(1):167-73. [MedLine]
21. Sabik JF, Blackstone EH, Lytle BW, Houghtaling PL, Gillinov AM, Cosgrove DM. Equivalent midterm outcomes after off-pump and on-pump coronary surgery. J Thorac Cardiovasc Surg. 2004;127(1):142-8. [MedLine]
22. Reston JT, Tregear SJ, Turkelson CM. Meta-analysis of short-term and mid-term outcomes following off-pump coronary artery bypass grafting. Ann Thorac Surg. 2003;76(5):1510-5. [MedLine]
23. Saso S, James D, Vecht JA, Kidher E, Kokotsakis J, Malinovski V, et al. Effect of skeletonization of the internal thoracic artery for coronary revascularization on the incidence of sternal wound infection. Ann Thorac Surg. 2010;89(2):661-70. [MedLine]
24. Kai M, Hanyu M, Soga Y, Nomoto T, Nakano J, Matsuo T, et al. Off-pump coronary artery bypass grafting with skeletonized bilateral internal thoracic arteries in insulin-dependent diabetics. Ann Thorac Surg. 2007;84(1):32-6. [MedLine]
25. Sá MP, Ferraz PE, Escobar RR, Vasconcelos FP, Ferraz AA, Braile DM, et al. Skeletonized versus pedicled internal thoracic artery and risk of sternal wound infection after coronary bypass surgery: meta-analysis and meta-regression of 4817 patients. Interact Cardiovasc Thorac Surg. 2013;16(6):849-57. [MedLine]
26. Sá MP, Cavalcanti PE, Santos HJAC, Soares AF, Albuquerque Miranda RG, Araújo ML, et al. Skeletonized versus pedicled bilateral internal mammary artery grafting: outcomes and concerns analyzed through a meta-analytical approach. Int J Surg. 2015;16(Pt B):146-52.
27. Boodhwani M, Lam BK, Nathan HJ, Mesana TG, Ruel M, Zeng W, et al. Skeletonized internal thoracic artery harvest reduces pain and dysesthesia and improves sternal perfusion after coronary artery bypass surgery: a randomized, double-blind, within-patient comparison. Circulation. 2006;114(8):766-73. [MedLine]
28. Kamiya H, Akhyari P, Martens A, Karck M, Haverich A, Lichtenberg A. Sternal microcirculation after skeletonized versus pedicled harvesting of the internal thoracic artery: a randomized study. J Thorac Cardiovasc Surg. 2008;135(1):32-7. [MedLine]
29. Umakanthan J, Jeyakumar P, Umakanthan B, Jeyakumar N, Senthilkumar N, Saraswathy MR, et al. Barriers to the universal adoption of bilateral internal mammary artery grafting. Int J Surg. 2015;16(Pt B):179-82.
30. Raja SG. Bilateral internal mammary artery grafting in diabetics: outcomes, concerns and controversies. Int J Surg. 2015;16(Pt B):153-7.
31. Sajja LR. Strategies to reduce deep sternal wound infection after bilateral internal mammary artery grafting. Int J Surg. 2015;16(Pt B):171-8. [MedLine]
32. Sá MP, Ferraz PE, Escobar RR, Nunes EO, Lustosa P, Vasconcelos FP, et al. Patency of skeletonized versus pedicled internal thoracic artery in coronary bypass graft surgery: a systematic review, meta-analysis and meta-regression. Int J Surg. 2014;12(7):666-72. [MedLine]
33. Sá MP, Cavalcanti PE, Santos HJ, Soares AF, Miranda RG, Araújo ML. Flow capacity of skeletonized versus pedicled internal thoracic artery in coronary artery bypass graft surgery: systematic review, meta-analysis and meta-regression. Eur J Cardiothorac Surg. 2015;48(1):25-31. [MedLine]
No financial support.
No conflict of interest.
Authors' roles & responsibilities
MPBOS Conception and design; operations and/or experiments performance; analysis and/or interpretation of data; statistical analysis; manuscript writing or critical review of its content; final approval of the manuscript
PEF Conception and design; operations and/or experiments performance; analysis and/or interpretation of data; statistical analysis; manuscript writing or critical review of its content; final approval of the manuscript
AFS Operations and/or experiments performance; manuscript writing or critical review of its content; final approval of the manuscript
RGAM Operations and/or experiments performance; manuscript writing or critical review of its content; final approval of the manuscript
MLA Operations and/or experiments performance; manuscript writing or critical review of its content; final approval of the manuscript
FVS Manuscript writing or critical review of its content; final approval of the manuscript
RCL Manuscript writing or critical review of its content; final approval of the manuscript
Article receive on Tuesday, November 15, 2016