A longitudinal analysis of anesthesia data for cataract surgery: selection of working correlation structure

Abstract

Background

Cataract surgery is most commonly done under local anesthesia with anesthesia and sedation controlled. Anesthetic depth and awareness monitoring during surgery frequently lead to irregular-timed observations. Inappropriate choice of working correlation structure in generalized estimating equations (GEE) may lead to inefficient estimation of parameters. The aim of this study was to apply the two new criteria to the anesthesia data for cataract surgery, to select and compare different candidates for working structure.

Methods

In this randomized controlled trial, anesthesia depth and hemodynamic changes were considered to be the primary outcome. The first group received propofol at a dose of 50‑75 μg/kg/min and the second group received 1% isoflurane. We developed a GEE regression model based on several candidates for the working correlation framework and then evaluated it according to CEBIC (Constraint Empirical Bayesian Information Criterion) and CEAIC (Constraint Empirical Akaike Information Criterion) criteria. Data analysis was performed using the R software 3.6.1.

Results

The mean age of the propofol group was 67.46 years (SD = 12.46 years) and 64.53 years for the isoflurane group (SD = 13.77 years). The mean BIS in isoflurane was higher among all time points than the propofol group, but only the difference between the two groups was statistically significant in 3 min after surgery (P = 0.04). On the basis of the CEAIC and CEBIC criteria, an independent working correlation was the best structure for the BIS outcome. In addition, the best structure was the unstructured correlation for HR. The MAP (mean arterial pressure) parameter estimate results revealed that the AR (1) structure was a good choice.

Conclusion

In comparison to CIC and QIC, two CEAIC and CEBIC criteria have chosen a different structure for the working correlation between repeated measurements of anesthetic indices obtained during cataract surgery.

Introduction

A cataract is the lack of clarity of the lens due to the opacification of the lens (Liu et al. 2017). In 2014, the WHO reported 95 million people were visually impaired due to cataracts (WHO 2014). Several large-scale population-based studies have reported that cataract prevalence increases with age, ranging from 3.9% at age 55–64 to 92.6% at age 80 and older (Mitchell et al. 1997; Chua et al. 2015; Varma and Torres 2004). The current visually significant cataract management standard is the surgical removal and replacement of the cataract lens with the intraocular lens. Cataract surgery is one of the most cost-effective treatments in many countries, and the most widely performed technique (Jaycock et al. 2009). Among low-income and middle-income countries, there is gender inequality in cataract surgical exposure, where men are more likely to have cataract surgery than women (Peto odds ratio [OR] 1·71, 95% CI 1·48–1·97) (Lewallen et al. 2009).

Cataract surgery is most frequently performed under local anesthesia with monitored anesthesia care and sedation (Alhashemi 2006; Eichel and Goldberg 2005). During this procedure, different medications were used for sedation, including propofol, benzodiazepines, and opioids (Aydin et al. 2002; Janzen et al. 1999; Wong and Merrick 1996). Propofol is a short-acting sedative with a quick recovery profile and its use is related with a number of additional benefits including the relative ease in retaining a sufficiently depressed level of consciousness and sufficient amnesia (Gotoda et al. 2016). Oxygen desaturation and hypotension, however, are limitations of propofol sedation. Care is needed to avoid sedation-related adverse events in the treatment of older patients because elderly people commonly have 1 or more underlying diseases (Alhashemi 2006; Gotoda et al. 2016). On the other hand, the bispectral index system (BIS, Aspect Medical Systems) has been developed and is currently broadly used to monitor the anesthetic depth and awareness or adequacy of anesthesia throughout the surgery (Wang et al. 2013). The worldwide market leader is the bispectral index system (BIS, Aspect Medical Systems), which notifies anesthesiologists if the anesthesia depth is insufficient (Orser 2008; Chen and Rex 2004). BIS monitoring is a system based on electroencephalography that measures the depth of anesthesia by measuring the electroencephalogram and utilizes a complex algorithm to produce an index score that offers an objective measurement of the level of consciousness in sedated patients (Drake et al. 2006; Imagawa et al. 2008; Johansen and Sebel 2000). Comparison of hemodynamic changes between both the propofol groups and isoflurane was inconsistent in most studies. Furthermore, the depth of anesthesia pattern across surgery has not been contrasted between classes.

Longitudinal observations often occur in the context of anesthesiology through anesthesia depth monitoring or hemodynamics. The well-known generalized estimating equation (GEE) offered by Liang and Zeger was a quite popular approach to the analysis of longitudinal data (Liang and Zeger 1986). GEE estimators are efficient when the structure of the working correlation is correctly defined. Nonetheless, failure to define this structure may lead to a significant loss of efficiency even though the quality can remain so (Wang and Carey 2003). In addition, anesthetic depth and awareness monitoring during surgery frequently produce in irregular timed observations. Wang et.al extended the GEE framework with two new criteria for selecting the best working correlation framework for irregularly timed measurements and small sample size results. The aim of this study was, therefore, to apply the two criteria introduced by Wang et al. to the data presented in (Khakzad et al. 2019), to select and compare different candidates for working correlation structure applying to cataract surgery data.

Methods

The GEE method was applied to data submitted by Khakzad et al. and collected using a randomized design of the clinical trial (Khakzad et al. 2019). We used the program code in version 3.6.1 of the R software program to analyze the data. The codes can be found in the Additional file 1. We built a GEE regression model based on several candidates for the working correlation structure. These candidate models were then compared according to CEBIC (Constraint Empirical Bayesian Information Criterion) and CEAIC (Constraint Empirical Akaike Information Criterion) criteria and selected the best. In particular, since the values of the response variable is continuous in this study, we consider a Gaussian regression model where the mean structure is specified as

$$ {\mu}_{ij}={\beta}_0+{\beta}_1 intervention+{\beta}_2 time+{\beta}_3 intervention\times time $$

where, μ_ij is the response mean for ith participant in time j.β₀, β₁, β₂, and β₃ are regression coefficients.

The RCT was approved by the Ethics Committee of the University Of Medical Sciences Of Babol. The Code of Ethics was MUBABOL.REC.1394.289. The RCT was registered on the irct.ir website and the code is IRCT20100208003305N9. Participants included 60 patients undergoing cataract surgery in class I and class II of the American Society of Anesthesiologists (ASA). Patients were ineligible to take part in this study if they had (a) a history of cardiovascular disease, (b) had diabetes and uncontrolled hypertension, (c) had liver or kidney failure, (d) patients with psychiatric problems, addicted to alcohol and drugs, and (e) patients with a difficult airway. Eligible patients were randomly divided into two intervention groups. One party administered 50‑75 (μg/kg/min) of propofol and the other administered 1% of isoflurane (Soha Helal Company) to sustain anesthesia. Heart rate, systolic and diastolic blood pressure, and BIS were tracked and registered prior to induction. The BIS level (vista device) was recorded at baseline (before surgery), followed by 1, 3, 5, and 8 min after surgery, and then every 5 min, depending on the time of operation. At the end of the surgery, hemodynamics and BIS indices were also registered when anesthetics were stopped and laryngeal mask airways removed. In addition, wake-up time was reported from the time the medication was discontinued until the eyes were opened by a call, and recovery time was calculated from the time the medication was discontinued until the patient earned Aldrete scores higher than 9 (Mishra et al. 2011). Further data on the RCT can be found in the article by (Khakzad et al. 2019).

Results

The mean age for the propofol group was 67.46 years (standard deviation (SD) = 12.46 years) and 64.53 years for the isoflurane group (SD = 13.77 years). The clinical trial included 16 (53.3%) males in the propofol group and 15 (50%) males in the isoflurane group. Of the participants, 5 (16.70%) were educated in the propofol group and 4 (13.30%) in the isofluran group. General characteristics of the sample are shown in Table 1.

Table 1 General characteristics of study participants (percentage or mean ± SD)

Average of BIS, HR, and MAP between the two intervention groups before and during cataract surgery was shown in Table 2. The mean BIS in isoflurane was higher among all time points than the propofol group, but only the difference between the two groups was statistically significant in 3 min after surgery (P = 0.04). On the other hand, the mean HR measurements in the propofol group were higher than isoflurane at all times, except for 23 min after surgery. The HR difference was only significant between the two intervention groups at the time 18 min after the start of the operation (P = 0.02). Although the MAP average was up to 5 min higher in the isoflurane group than in the propofol group, it was reversed 8 min later. At all times, the mean differences were not significant.

Table 2 Average trend of BIS, heart rate, and MAP during cataract surgery between two intervention groups

Tables 3, 4, and 5 provide an estimate of the regression parameters obtained using the GEE approach and standard errors in the four commonly working correlation structures (independence, exchangeable, AR (1), and unstructured). CEAIC, CEBIC, Correlation Information Criterion (CIC), and Quasi-likelihood Information Criterion (QIC) criteria were used to select the appropriate working correlation structure for each of the three outcomes. According to Table 3, for the BIS result, on the basis of the two new criteria, CEAIC and CEBIC, a lower value was obtained for the independent working correlation. Whereas according to the CIC criterion, the structure of AR (1) was best suited to the correlation of repeated measures. Under the independence structure, the standard errors of the estimates were smaller than those of the other correlations. Table 4 provided the calculation of regression coefficients for HR under specific working correlation structures. The results indicated that the unstructured correlation was the best structure based on the CEAIC and CEBIC criteria, while the AR (1) structure was selected by CIC and the independence correlation was selected by QIC. The parameter estimate results for MAP revealed that the AR (1) structure was a good choice based on CEAIC, CEBIC, and CIC, while the QIC criteria selected the exchangeable correlation structure (Table 5).

Table 3 Results of fitting GEE model, EAIC, and EBIC criteria for BIS outcome

Table 4 Results of fitting GEE model, EAIC, and EBIC criteria for HR outcome

Table 5 Results of fitting GEE model, EAIC, and EBIC criteria for MAP outcome

Discussion

In the present study, two new criteria were applied to select the true working correlation structure for irregular timed measurements. Measurements were collected from two groups of patients undergoing cataract surgery; randomized controlled trial participants were assigned to either propofol or isoflurane. Our results showed that the selected correlation structure based on CEBIC and CEAIC criteria was different when using traditional criteria such as CIC and QIC. As a result, the estimated effects of propofol and isoflurane on BIS, HR, and MAP and the relevant standard errors were affected during cataract surgery. In addition, competing candidate models have had different time effects on BIS, HR, and MAP.

Traditional model selection criteria, such as QIC, CIC, EAIC, and EBIC, are not suitable for cases of irregular observation timing (Wang and Fu 2017). The assumption of these criteria is that all subjects will share the same matrix of correlation that is not established in the presence of irregular observations (Chen and Lazar 2012). Due to the nature of the anesthesia and the different operating time, the data presented here were exposed to irregular time intervals during surgery. Khakzad et al. analyzed this dataset using repeated measures analysis of variance (RMANOVA) which considered the same time points and regular observation timing for each participant (Khakzad et al. 2019). RMANOVA works when complete observations are available for each participant. In the case of irregular time intervals, therefore, RMANOVA considers the minimum number of repeated observations and omits the remaining information. Omitting the observations causes an imbalance in baseline measurements between the two study groups and reduces the power of statistical tests.

The results of a simulation study conducted by Wang et al. showed that all criteria work well when the sample size is large (more than 60) (Wang and Fu 2017; Chen et al. 2018). The selection accuracy of all criteria increased as the size of the sample increased. In addition, CEAIC and CEBIC preferred the correct structure more than 74% of the time for all settings. The performance of the CEAIC and the CABIC for unbalanced data was similar to that of balanced data. When the true correlation structure is the independence model, the CEBIC has higher selection accuracy than the CEAIC. The performance of CEAIC and CEBIC was the same when the correlation structure is exchangeable or AR (1). Additionally, CEAIC and CEBIC perform better than CIC and QIC, in particular for small sample sizes and large repeat measurements (e.g., sample size = 30 and repeated measures = 10). In addition, it should be noted that CEAIC and CEBIC are more robust against the number of variables than CIC and QIC.

Eventually, although the GEE theory states that the average parameter estimates are consistent with any working correlation model, an important related issue is whether the selected candidate model is acceptable to describe the data (Xu et al. 2012; Leung et al. 2009).

In conclusion, two CEAIC and CEBIC criteria have chosen a different structure compared to CIC and QIC for the working correlation between the repeated measurements of anesthetic indices obtained during cataract surgery. In the future, it is necessary to analyze anesthetic data with irregular timing measurements and to compare the results with traditional criteria.