Schultz BJ, Sweeney T, DeBaun MR, Remmel M, Midic U, Khatri P, Gardner MJ. Pilot study of a novel serum mRNA gene panel for diagnosis of acute septic arthritis. World J Orthop 2019; 10(12): 424-433 [PMID: 31908991 DOI: 10.5312/wjo.v10.i12.424]
Corresponding Author of This Article
Blake J Schultz, MD, Surgeon, Department of Orthopedic Surgery, Stanford University, 450 Broadway Street Pavilion C, 4th Floor, Redwood City, CA 94063, United States. email@example.com
Checklist of Responsibilities for the Scientific Editor of This Article
This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Author contributions: Sweeney T, Remmel M, Midic U, Khatri P ran the laboratory tests and performed data analysis and interpretation. Schultz BJ, DeBaun MR and Gardner MJ organized and ran the clinical trial. All authors provided critical feedback and helped shape the research, analysis and manuscript. All authors have read and approve of the final submitted manuscript.
Institutional review board statement: All specimens from the patients were obtained after their informed consent and ethical permission was obtained for participation in the study.
Conflict-of-interest statement: The authors report no relevant conflicts of interest.
Open-Access: This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Corresponding author: Blake J Schultz, MD, Surgeon, Department of Orthopedic Surgery, Stanford University, 450 Broadway Street Pavilion C, 4th Floor, Redwood City, CA 94063, United States. firstname.lastname@example.org
Received: August 14, 2019 Peer-review started: August 14, 2019 First decision: August 30, 2019 Revised: September 19, 2019 Accepted: October 18, 2019 Article in press: October 18, 2019 Published online: December 18, 2019
Septic arthritis is an orthopedic emergency requiring immediate surgical intervention. Current diagnostic standard of care is an invasive joint aspiration. Aspirations provide information about the inflammatory cells in the sample within a few hours, but there is often ambiguity about whether the source is infectious (e.g. bacterial) or non-infectious (e.g. gout). Cultures can take days to result, so decisions about surgery are often made with incomplete data. Novel diagnostics are thus needed. The “Sepsis MetaScore” (SMS) is an 11-mRNA host immune blood signature that can distinguish between infectious and non-infectious acute inflammation. It has been validated in multiple cohorts across heterogeneous clinical settings.
To study whether the SMS holds diagnostic validity in determining the etiology of acute arthritis.
We conducted a blinded, prospective, non-interventional clinical study of the SMS. All patients undergoing work-up for a septic primary joint were enrolled. Patients proceeded through the normal standard-of-care pathway, including joint aspiration and inflammatory labs [white blood cell (WBC), erythrocyte sedimentation rate (ESR), C-reactive protein (CRP)]. Venous blood was also drawn into PAX gene RNA-stabilizing tubes and mRNAs were measured using Nano String nCounter™. SMS was calculated blinded to clinical results.
A total of 20 samples were included, of which 11 were infected based on aspiration or intra-operative cultures. The SMS had an area under the ROC curve (AUROC) of 0.87 for separating infectious from non-infectious conditions. For comparison, the AUROCs for ESR = 0.58, CRP = 0.6, and WBC = 0.59. At 100% sensitivity for infection, the specificity of the SMS was 40%, meaning nearly half of non-septic patients could have been ruled out for further intervention.
In this pilot study, SMS showed a high level of diagnostic accuracy in predicting septic joints compared to other diagnostic biomarkers. This quick blood test could be an important tool for early, accurate identification of acute septic joints and need for emergent surgery, improving clinical care and healthcare spending.
Core tip: Acute septic arthritis is an orthopedic emergency. The current gold standard diagnostic tool is synovial fluid culture, but this can take days to results, so decisions about surgery are made with imperfect information. A novel diagnostic “Sepsis MetaScore” (SMS) based on an mRNA signature has been identified that uses a blood sample to rapidly identify differentiate septic vs aseptic inflammation. Our pilot study showed the SMS had higher diagnostic accuracy than current standard of care inflammatory labs, showing potential for use as a rule-out test for septic arthritis, helping to minimize misdiagnosis and avoid unnecessary surgeries.
Citation: Schultz BJ, Sweeney T, DeBaun MR, Remmel M, Midic U, Khatri P, Gardner MJ. Pilot study of a novel serum mRNA gene panel for diagnosis of acute septic arthritis. World J Orthop 2019; 10(12): 424-433
Acute arthritis is a common complaint in emergency rooms and orthopedic clinics, with over 13000 hospitalizations per year and over $750 million dollars in healthcare spending in the United States alone[1,2]. The etiology can be septic, commonly from a bacterial infection, or aseptic, such as gout, transient synovitis or other inflammatory, non-infectious etiologies. Acute septic arthritis of native joints is an orthopedic emergency requiring urgent surgical irrigation and debridement (I and D) to prevent irreparable damage to the joint, inpatient hospitalization and an extended course of IV antibiotics. Inflammatory arthritis is typically managed medically on an outpatient basis. The presentation of septic versus aseptic acute arthritis is difficult to distinguish clinically. but making a quick and accurate diagnosis is critical given the drastically different treatments. Currently, clinicians rely heavily on imperfect serum and synovial fluid laboratory values to make acute decisions about emergency surgery[4-7], potentially exposing non-infected patients to unnecessary surgery.
The annual incidence of septic arthritis in native joints is 4-10 patients/100000 patient years, and is continuing to rise with increasing antimicrobial resistance, aging, immunosuppression and the increasing number of invasive or orthopaedic procedures[8-11]. The current diagnostic work-up includes serum inflammatory labs [white blood cell (WBC) counts, erythrocyte sedimentation rate (ESR) and C-reactive protein (CRP)], and an invasive synovial fluid aspiration from the joint. These diagnostics are limited by their turn-around time and specificity. The definitive diagnosis of septic arthritis requires a positive culture from the synovial fluid, which can take multiple days to result. Serum labs result quickly and provide information about general systemic inflammation, but are not specific for infection. Synovial fluid evaluation reveals the inflammatory milieu within the joint, specifically WBC count, percentage of polymorphonuclear cells (PMNs), presence of crystals and a gram stain for bacteria, within a few hours, but again, these are not diagnostic, often leaving ambiguity about whether the source is infectious (e.g. bacterial) or non-infectious (e.g. gout)[4,5]. In addition, the presence of inflammatory cells can be artificially low in patients who are immunocompromised[6,12]. Furthermore, the presence of gouty crystals alone does not rule out a concomitant superimposed bacterial infection, making accurate diagnosis in this setting even more difficult. Procalcitonin has recently been investigated as an inflammatory serum biomarker[13,14]. While it has shown promise in distinguishing septic from aseptic arthritis, it also does not accurately distinguish non-infective inflammation like gout from septic arthritis, and therefore is still a limited diagnostic biomarker.
The Sepsis MetaScore (SMS) is a novel diagnostic serum blood test that can efficiently distinguish between infectious and non-infectious acute systemic inflammation. SMS works by interpreting the expression levels of 11 specific mRNAs in peripheral blood (the so-called “host response” to infection). Previous studies have validated its ability to distinguish infection from non-infectious inflammation in a variety of independent clinical settings including medical and surgical patients from ambulatory clinics to the ICU[17-19]. In this study, we hypothesized that the SMS could identify patients presenting acutely with septic arthritis based on positive cultures from those with aseptic arthropathies.
MATERIALS AND METHODS
Level II blinded, prospective, observational study
Following Institutional Review Board approval, we enrolled a convenience sample of adult patients presenting to the emergency department at a quaternary referral center with acute, atraumatic onset of a painful, swollen native joint. Non-native joints were excluded due to the different clinical and laboratory diagnostic cut-offs and treatment options for periprosthetic joint infections. Patients were enrolled in the trial at the time of presentation by an orthopaedic surgery resident.
All enrolled patients proceeded through the normal standard-of-care pathway, including inflammatory labs (WBC, ESR, CRP) and a joint aspiration performed by an orthopedic surgery resident. Aspirations were analyzed by the hospital lab for WBC count, percentage of PMNs, culture, gram stain and crystals. If the patient was taken for surgery, an additional intra-operative tissue sample was sent for culture. At the time of the initial lab draw, 2.5 cc of venous blood was also drawn into a PAX gene RNA-stabilizing tube. Blinded, deidentified samples were sent to Inflammatix, where the 11 mRNAs that comprise the SMS were measured using Nano String nCounter™. The SMS was calculated as previously described (difference of geometric means) blinded to clinical results. The SMS score was calculated at the end of study enrollment, so no treating physician was aware of the results during patient care and it was not a factor in any clinical decisions. An independent observer (BS) retrospectively reviewed the charts and patients were diagnosed with septic arthritis if they had a positive culture resulted from the synovial fluid or tissue sample at time of surgery. All other patients were diagnosed with aseptic arthritis.
The primary endpoint of the study was the ROC curve (AUROC) of the SMS to determine clinically adjudicated septic joint status. Secondary endpoints were (1) The specificity of the SMS at the sensitivity > 95%, and (2) The AUROCs of comparator inflammatory biomarkers (serum WBC, CRP, ESR, and synovial WBCs and %PMNs). Student’s t-tests were used to compare continuous variables. Multivariate least-squares logistic regression included only those patients with no missing variables. Significance was set a P < 0.05. Calculations were conducted in R, version 3.5.1.
Our cohort included 20 patients (14 males and 6 females), with an average age of 54.7 years (Table 1). With respect to anatomic location there were fourteen knees, three ankles, two elbows, and one wrist. Ten samples were septic and ten were aseptic based on final culture results. Types of bacterial infections included Staphylococcus aureus, Streptococcus, Pseudomonas aeruginosa, Klebsiella pneumoniae, and Candida[1,6]. There were two cases of a concomitant gout flare with articular bacterial infection and one case of concomitant pseudogout with articular bacterial infection; these three cases were considered septic. There were four cases of gout that were aseptic, one had a surgical I and D due to acute concern for infection, however no aspirate or intra-operative cultures ever grew. In one septic patient the lab was unable to calculate the synovial cell counts because there was not enough fluid. One patient with concomitant gout and articular bacterial infection could not have the synovial PMNs calculated because of the high level of cellular degeneration. One aseptic patient did not have serum inflammatory labs drawn. All other patients had a full set of serum and synovial labs. All patients had an SMS calculated.
Table 1 Patient demographics and laboratory results.
In the aseptic group (10 patients), average serum WBC = 11.7 cells/mm3, ESR = 58.4 mm/h and CRP = 16.1 mg/dL, and the average synovial WBC = 39881 cells/mm3, PMNs = 84.8% (Table 1). In the septic group (10 patients), the average serum WBC = 13.4 ESR = 80.4 and CRP = 19.6, and the average synovial WBC = 42800, PMNs = 80.6%. No significant statistical difference was found in any inflammatory labs between the septic and aseptic groups. However, there was a significant difference in the Sepsis MetaScore between groups; aseptic = -0.33, septic = 1.1 (P = 0.008).
The SMS had an area under the AUROC of 0.87 (95%CI: 0.71-1) for separating infectious from non-infectious conditions (Figure 1A). Notably, this is very similar to its diagnostic accuracy in multiple other cohorts, lending credence to the stability of the metric[16-18]. For comparison, the AUROCs for serum ESR = 0.58 (95%CI: 0.87-0.29), CRP = 0.6 (95%CI: 0.87-0.34), and WBC = 0.59 (95%CI: 0.85-0.33), and synovial WBC = 0.54 (95%CI: 0.81-0.28) and PMN = 0.51(95%CI: 0.79-0.24) (Figure 1B-F). At 100% sensitivity for infection, the specificity of the SMS was 40%. This suggests that a substantial fraction of non-septic patients could potentially be safely ruled out for further surgical intervention.
Figure 1 ROC curves for separating infectious from non-infectious joint infections.
A: Sepsis Metascore area under the ROC = 0.87; B: Erythrocyte sedimentation rate area under the ROC = 0.58; C: C-reactive protein area under the ROC = 0.6; D: White blood cell area under the ROC = 0.59; E. Synovial cell area under the ROC = 0.54; F: Synovial polymorphonuclear cells % area under the ROC = 0.51. WBC: White blood cell; ESR: Erythrocyte sedimentation rate; CRP: C-reactive protein; SMS: Sepsis MetaScore.
In practice, the decision for surgery is not based on one specific inflammatory marker, but rather on the constellation of the clinical and laboratory presentation. To account for this we performed a multivariate logistic regression on all patients with complete laboratory data to measure whether the SMS remained an independent predictor of infection status when accounting for blood and synovial markers of inflammation (Table 2). Note six observations removed due to missingness. SMS was the only significant predictor of infection status when combined with “standard” inflammatory labs, further indicating that it may continue to hold diagnostic utility compared to several standard-of-care labs at once.
Table 2 Multivariate logistic regression analysis for the prediction of infection.
synovial % PMN
Residual standard error: 0.4478 on 6 degrees of freedom
Patients with septic arthritis can also have systemic infections, which can complicate the diagnosis. One patient who was admitted for a bacterial pleural effusion with positive blood cultures also had an acute onset of knee pain (Figure 2). The patient’s knee was aseptic based on a negative aspirate culture and 15111 WBC, but the SMS was elevated. Note, because of the small sample size, a distinct cut-off has not yet been established for the SMS, but as Figure 2 indicates, SMS in the aseptic group tended to be lower (< 0) and SMS is septic group tended to be higher (> 1). This was ruled as a “false positive” since the joint was aseptic, though the SMS did accurately indicate that the patient had a systemic bacterial infection. Notably, if this patient is excluded from the data, the AUROC improves to 0.90 (95%CI: 0.76–1). Additionally, two patients in the septic group received antibiotics prior to SMS draw. Both had at least 12 h of antibiotics, and not surprisingly, their SMS scores were the two lowest of the septic group (Figure 2).
Figure 2 Scatter plot with Sepsis MetaScore on the Y-axis grouped by aseptic (black dots) and septic joints (red dots).
Note the open circle in the aseptic group is the patient who had a concurrent systemic bacterial infection with a negative joint aspiration. The two open circles in the septic group, were given antibiotics at least 12 h prior to Sepsis MetaScore blood draw.
Septic arthritis can be difficult to distinguish from non-infectious arthropathies at the time of presentation. In this pilot study we determined the early diagnostic validity of a novel blood test, the Sepsis Metascore, for septic arthritis. Notably, the SMS had substantially higher AUROCs than standard-of-care inflammatory markers, though this did not reach significance in our small pilot study.
The current laboratory work-up for acute septic arthritis lacks diagnostic accuracy[4,5]. In our cohort, there was a trend towards lower serum WBC, ESR and CRP in the aseptic group compared to the septic group, however, this was not significantly different. The synovial PMN percentages were actually slightly lower in the septic group than the aseptic group, and both groups had synovial WBC averages lower than 50000 cells/mm3 which is the generally accepted cut-off for septic arthritis[5,6,20]. This finding could be from the abnormalities in a few of the septic patients, including immunosuppression and gouty superinfections where the lab noted high levels of cellular degeneration that compromised an accurate cell count. While a larger sample size may decrease the effect of these abnormalities on the lab averages, these cases highlight the overall limited diagnostic potential of the current laboratory work-up. With a reasonable specificity (40%) at 100% sensitivity for infection seen in this study, the SMS offers diagnostic potential as a rule-out test for acute septic arthritis in native joints. Its high sensitivity is ideal for the clinical urgency associated with acute septic arthritis, where a missed diagnosis could lead to devastating, irreversible articular destruction. In such scenarios, the test would have to be available in a rapid timeframe. The SMS has been licensed to Inflammatix for commercial development as part of a point-of-care test with a 30 min turnaround time, which would make it a valuable additional data point for early diagnosis.
The SMS has the potential to be particularly helpful in patients with inflammatory arthropathies and immunocompromise that further complicate septic arthritis diagnosis. Patients with gout can have elevated inflammatory labs and cellular degeneration in the synovial aspirate that make diagnosing a superimposed bacterial infection difficult. In our sample, there was one patient with a history of gout who presented with acute knee pain and a synovial aspirate of 96000 WBC and 86% PMNs with few monosodium urate crystals. Despite no synovial culture results, the high inflammatory markers were concerning for a concomitant bacterial infection and the patient was taken emergently to the OR for a surgical I and D and admitted to the hospital for IV antibiotics. Neither aspirate nor multiple intra-operative cultures grew any bacteria, implying the joint was aseptic. The SMS was -1.05 here. This case was a prime example of a patient who underwent a surgical procedure in the setting of an ambiguous diagnosis that could have been best treated with only medical management.
SMS could be similarly helpful in patients with other inflammatory arthropathies such as rheumatoid arthritis. These patients have an increased risk of developing septic arthritis, especially if they are on immunomodulators, but often experience delay in clinical diagnosis because their inflammatory labs are often elevated at baseline, making it difficult to diagnose acute infection[21,22]. We had an example of this in our study with a patient with seropositive rheumatoid arthritis who presented with acute elbow pain and a synovial aspirate with 189000 WBC and 94% PMNs. Surgical I and D was performed, but neither the aspirate nor intra-operative cultures were positive. The SMS was low at -0.52. They re-presented eight months later with a similar clinical presentation with 176000 WBC with 85% PMNs on aspiration. The patient was taken for a second I and D, again with negative aspirate and intra-operative cultures. Acid fast bacilli, fungal cultures and 16S PCR were also negative. Ultimately our Infectious Disease colleagues diagnosed the patient with recurrent aseptic inflammatory arthritis.
Finally, the SMS could also be useful in patients with immunosuppression who have “falsely” low inflammatory markers[6,12]. There was one patient in the septic group on chemotherapy for leukemia who had suppressed inflammatory markers (WBC = 0.8, ESR = 58, CRP = 27.5, synovial WBC = 139, PMN = 9%) despite a positive aspirate culture that grew Klebsiella. Despite the low inflammatory labs, the SMS was correctly elevated at 1.28, showing its potential as a valuable tool in these special circumstances to prevent missed septic arthritis in patients with a compromised inflammatory response.
Although our pilot study focused on adult patients, the SMS also has potential utility in pediatric and adolescent septic arthritis. The common clinical presentation of transient synovitis of the hip, which is thought to be triggered by a systemic viral infection[23,24], presents similarly to septic arthritis. Additionally, pediatric patients have a high incidence of “culture negative” septic arthritis which makes diagnosis difficult. Given the technical skill and advanced imaging needed to obtain a diagnostic hip aspiration, there would be tremendous benefit if the SMS proved to be an effective rule-out test in this population. Periprosthetic joint infection diagnosis is another area of potential application[26,27]. Although this case does not always require the same urgency that septic native joints require the SMS could potentially add another data point to suggest infection in equivocal cases prior to surgical intervention.
One limitation of this pilot study is its small sample size. A larger sample size, in a rigorously validated, properly statistically powered cohort of patients is necessary to confirm the diagnostic accuracy of the SMS. Another limitation of the study was the timing of SMS lab draw. While our protocol indicated lab draw at the same time as the initial inflammatory lab sample, this was not always possible, and sometimes occurred hours later. Still, we expect the SMS score to decrease with the administration of antibiotics and/or surgical debridement, so the fact that it was still accurate in predicting infection in these patients supports the validity of the test. More generally, a limitation of the SMS is the inability to distinguish systemic vs isolated articular infections. One patient with a bacterial pleural effusion had an aseptic aspirate of their knee. The SMS was elevated, correctly identifying the systemic bacterial infection, but in our data was ruled as a “false positive” since the joint was aseptic (Figure 2). With this in mind, the use of SMS to diagnose septic arthritis in patients with concomitant acute infections may be limited. Finally, a limitation in our data analysis is the reliance on synovial and intra-operative cultures to definitively diagnosing septic arthritis. While this is the current gold-standard diagnostic, it is not 100% sensitive, and can be influenced by administration of antibiotics prior to aspiration[28-30]. Additionally, clinical diagnosis of septic arthritis is not based on one or two lab values, but rather a clinical gestalt factoring in clinical exam, weight bearing status, prior antibiotic use, past medical history and presentation. While the regression model does allow us to compare a combination of lab values to the SMS, further study into the entire patient picture is warranted. Additionally, comparison to newer infection diagnostics such as pro-calcitonin and PCR analysis is warranted[14,31].
The literature is scarce regarding the incidence of patients who undergo emergent I and D for presumed septic arthritis that is ultimately deemed to be non-infected, but anecdotally at our institution this could be as high as 15%-20% of patients who undergo urgent I and D. This highlights the importance of a fast, reliable and less invasive rule-out diagnostic test to give clinicians confidence to choose not to intervene, sparing substantial costs, unnecessary surgery and patient morbidity.
Novel diagnostic tests are needed to quickly and accurately diagnose acute septic arthritis in native joints. In this pilot study, the SMS showed a high level of diagnostic accuracy in predicting septic joints compared to other diagnostic biomarkers. A large, prospective validation study is warranted to better establish the diagnostic accuracy and predictive values of the SMS. When confirmed in larger cohorts and available as a rapid blood test, the SMS could be an important tool for early, accurate diagnosis of acute septic joints and evaluation of need for urgent surgery. Future research should also expand to in investigate infection in non-unions, periprosthetic joints, infected hardware or grafts, transient synovitis, and others.
Septic arthritis in native joints is an orthopedic emergency, requiting urgent surgical intervention. It can present similarly to non-septic arthritis such as grout, transient synovitis or inflammatory arthritis. Non-septic arthritis can be managed medically, so accurate diagnosis is important. Currently, diagnosis is based on a combination of clinic exam and serum and synovial biomarkers which do not reliability differentiate infection from non-infective inflammation. The gold standard of diagnosis is intra-articular aspiration cultures, which can take days to result, so decisions about urgent surgery are often made with incomplete information. Novel diagnostics are needed to improve the speed and accuracy of diagnosis.
Novel diagnostics are needed to improve the speed and accuracy of diagnosis of septic arthritis to prevent the irreversible damage to cartilage seen in septic arthritis of native joints and to avoid unnecessary surgery in patients with aseptic arthritis. The ability to quickly and accurately identify and monitor infection through serum biomarkers, instead of invasive aspirations, has many potential applications across orthopedics, including peri-prosthetic infection, pediatric transient synovitis, hardware infection and in the work-up of fracture non-union.
The main objective was to compare the ability of the Sepsis MetaScore (SMS) to diagnosis acute septic arthritis in native joints compared to current diagnostic serum and synovial biomarkers. The SMS proved more accurate than serum white blood cell (WBC), erythrocyte sedimentation rate, C-reactive protein and synovial WBC and polymorphonuclear cells %. With the ability to result in 30 min without an invasive intra-articular aspiration, there is potential for future research across orthopedics for diagnosis and monitoring of infection.
We conducted a prospective, observational study of adult patients being worked up for acute septic arthritis of native joints in the emergency department. They proceeded through the standard of care work-up including inflammatory labs and aspiration, with an additional venous lab draw into a PAX gene RNA-stabilizing tube that was used to calculate the SMS. Decisions for surgery were made without consideration of SMS which was calculated at the end of the enrollment period, blinded to clinical results. Patients were retrospectively deemed infected or not based on synovial culture results. The SMS and other inflammatory labs were compared to this diagnosis
There was no significant difference in any of the standard serum or synovial labs between the septic and aseptic groups, except for the SMS which was significantly higher in septic patient compared to aseptic patient (P = 0.008). This pilot study data is encouraging, but still needs to be validated in a larger study.
The SMS shows potential as a quicker and more accurate diagnostic tool for acute septic arthritis than current serum and synovial biomarkers. It shows unique potential in complicated patients with histories of gout, inflammatory arthritis or immunocompromise where the current serum biomarkers are known to be less accurate. With development of the 30 min point of care testing, this is a potentially valuable diagnostic aid for decisions about emergency surgery and has potential applications across orthopedics subspecialties for infection diagnosis and monitoring.
Novel serum biomarkers show potential to increase the accuracy and decrease the time to diagnosis of septic arthritis. Future research in a larger study population is needed to validate these findings, which could then be replicated to investigate other topics in orthopedics such as periprosthetic joint infection, septic arthritis in pediatric patients, fracture non-unions and hardware infection.
Manuscript source: Unsolicited manuscript
Specialty type: Orthopedics
Country of origin: United States
Peer-review report classification
Grade A (Excellent): 0
Grade B (Very good): B
Grade C (Good): C, C
Grade D (Fair): 0
Grade E (Poor): 0
P-Reviewer: Sitkin S, Ueda H, Yang MS S-Editor: Zhang L L-Editor: A E-Editor: Liu MY