Assessment of Reporting Quality in Randomized Controlled Trials of Acupuncture for Primary Insomnia with CONSORT Statement and STRICTA Guidelines

Aim To assess the reporting quality of randomized controlled trials (RCTs) on acupuncture for primary insomnia (PI). Methods Seven Chinese and English databases were searched for publication reporting RCTs on acupuncture for PI from the inception of the databases to August 6, 2021. The internationally recognized Consolidated Standards of Reporting Trials (CONSORT) statement and the International Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) guidelines were used to evaluate the reporting quality. The agreement between two researchers was calculated by Cohen's kappa. Results A total of 102 eligible RCTs were assessed. According to the CONSORT statement (2017), the positive reporting rates of items such as “abstract,” “background,” “participants,” and “numbers analyzed” were above 80%. However, the positive reporting rates of items such as “sample size,” “randomization implementation,” “Outcomes and estimation,” “Ancillary analyses,” and “Registration” were below 20%. According to STRICTA guidelines, the positive reporting rates of items such as “style of acupuncture,” “reasons for acupuncture treatment,” “Number of needles inserted,” “Needle retention time,” “Treatment regimen,” and “precise description of the control intervention” were above 80%. However, the positive reporting rates of items such as “setting and context of treatment” and “practitioner background” were below 20%. Conclusion It is essential to advocate the endorsement of the CONSORT statement and STRICTA guidelines to improve the quality of acupuncture RCT reports.


Introduction
Primary insomnia (PI) is characterized by difficulty in falling asleep or staying asleep, with the exclusion of insomnia caused by various secondary factors including mental, physical, and neurological disorders, alcohol, or drugs [1]. e overall prevalence of insomnia was 5%-10% worldwide [2], while the incidence rate of insomnia in females is higher than that in males [3]. Severe insomnia affects normal life and work and increases the risk of various diseases [4].
At present, the treatments of insomnia mainly include cognitive behavioral therapy (CBT), drug therapy, physical therapy, and complementary and alternative medicine (CAM) [5]. CBT, the first-line therapy of insomnia, costs a lot and lacks effective training providers, making it difficult to popularize [6]. Although the short-term efficacy of drugs in the treatment of insomnia has been confirmed, it has been reported that there are side effects such as hangover, drug resistance, and drug dependence [5]. e efficacy of physical therapy (such as transcranial magnetic stimulation and phototherapy) is not certain yet [4,7]. Acupuncture in CAM has been applied by acupuncture practitioners and accepted by patients and is being increasingly widely used to treat insomnia [8].
e number of RCTs of acupuncture for PI has been increasing gradually in recent years, but their work varies considerably in quality [9]. Accurate and standardized RCT reports not only can reduce the bias of systematic evaluation but also help medical decision-making [10]. With highquality reports, acupuncture practitioners can easily master effective operating procedures [11].
In the past ten years, there has not been any study on the quality evaluation of RCTs of acupuncture for PI. e CONSORT statement (https://www.consort-statement.org/) is an evidence-based report guide designed to improve research transparency and reduce waste [10]. STRICTA (https://stricta.info/), an independent guide for reporting acupuncture research, has become a formal extended version of the CONSORT report of RCTs [11]. ese guidelines ensure transparency and a coherent approach to testing and reporting trials of complex interventions [10]. A range of studies have shown that it can help readers gain information on study design, intervention implementation, data analysis, and so on [12,13]. erefore, in this study, the internationally recognized CONSORT statement of nondrug RCTs (2017) and STRICTA were used to evaluate the reporting quality of RCTs of acupuncture for PI so as to lay a foundation for high-quality RCT design of acupuncture treatment for insomnia in the future.

Document Retrieval Methods.
(1) Database for retrieval: China National Knowledge Infrastructure (CNKI), China Science and Technology Journal Database (VIP), Wanfang Database (WF), PubMed, Embase, Web of Science, and Cochrane Library. (2) Publication time: from database creation to August 6, 2021. (3) Search strategy: the following search terms were used in both Chinese and English: (primary insomnia) AND (acupuncture OR acupuncture therapy) AND (randomized controlled trial OR RCT).

Inclusion
Criteria. All the following criteria were met: (1) confirmed diagnosis of PI; (2) RCT of acupuncture to treat PI; and (3) the intervention measures of the experimental group were acupuncture (including hand acupuncture, electroacupuncture, ear acupuncture, abdominal acupuncture, and eye acupuncture) or acupuncture combined with traditional Chinese medicine (TCM) nondrug therapy other than acupuncture (acupressure, moxibustion, ear point treatment, etc.); the control group was treated with Western medicine or sham acupuncture or acupuncture at nonmeridian and nonacupoints.

Exclusion Criteria.
One of the following criteria was met: (1) not in accordance with the inclusion criteria; (2) no confirmed diagnosis of PI in the RCT (such as diagnosis of perimenopausal insomnia); (3) in addition to acupuncture, the intervention measures in the experimental group also included drug treatment; (4) the control group was treated with routine acupuncture; (5) if the content of conference paper and periodical paper or Chinese paper and English paper were similar, the one with higher quality were chosen; (6) if the papers were about the same RCT, the one published later was chosen; (7) the paper was about research protocol; and (8) full-text paper not available.

Document Screening and Data Extraction.
Paper screening, data extraction, and cross-checking were performed by two researchers independently. In case of any disagreement, the two researchers negotiated first. Firstly, the RCT was imported into NoteExpress 3.4 (Guangzhou University of Chinese Medicine library version, released 2021, Beijing, China). After duplicate checking, the title and abstract of the paper were read. After excluding the clearly irrelevant papers, the full text of the paper was read to determine whether the inclusion should be made. e extracted data included the year of publication, author, intervention measures, CONSORT statement (2017), STRICTA standard entries, and relevant information, which were entered into Excel 2016. Disagreements between the two researchers over data selection and extraction were resolved by discussion, with the involvement of a third researcher (Yu Kui).

Quality Evaluation
Method. 25 items from CONSORT (2017) and 6 items from STRICTA were used to evaluate the quality of reports. Two trained researchers with no interest conflicts extracted the data independently and evaluated the report item by item as "reported," "partially reported," or "not reported." en, their results were cross-checked. In case of disagreement, a third researcher with no interest conflicts should arbitrate. e number of RCTs meeting each item was calculated, and the percentage of items reported was also calculated.
Cohen's l-statistic was calculated to assess the agreement between two researchers. We judged agreement as poor if l ≤ 0.2; fair if 0.2 < l ≤ 0.4; moderate if 0.4 < l ≤ 0.6; substantial if 0.6 < l ≤ 0.8; good if 0.8 < l < 1; and prefect if l � 1 [14]. Cohen's l-statistic and 95% CI of each item were performed by using PASW Statistics for Windows, version 18.0 (SPSS Inc., Released 2009, Chicago, USA).

Document Retrieval
Results. According to the above retrieval strategies, a total of 1269 relevant RCTs were detected. Among them, 377 duplicated ones were screened out, and 454 clearly irrelevant ones were excluded by titles and abstracts. After reading the full text, 102 in accordance with the inclusion criteria were included, and 336 were excluded according to the exclusion criteria. Finally, 91 Chinese papers and 11 English papers were included. e process and results of literature screening are shown in Figure 1.

CONSORT Statement (2017).
e quality of the included RCTs was assessed by the CONSORT statement (2017), as shown in Table 1. e positive reporting rates of items such as "abstract," "background," "participants," and "numbers analyzed" were above 80%. However, the positive reporting rates of items such as "sample size," "randomization implementation," "Outcomes and estimation," "Ancillary analyses," and "Registration" were below 20%.

Trial Methods.
Among the 102 papers included, all (100%) described the experimental design and distribution proportion, and none made any changes in experimental methods after the beginning of the experiment (l �1). All (100%) described the eligibility criteria of the participants (l �1), and only 2 (2%) did not mention the place for data collection (0.04 < l < 1.28). A vast majority (99%) described the details of interventions for each group (l �1). Among them, 12 (11.8%) described whether and how the interventions were standardized (0.59 < l < 0.95), while 5 (4.9%) mentioned whether the measure providers' compliance to the protocol was evaluated or how to enhance their compliance (0.42 < l < 0.98), and none (0%) mentioned whether the participants' compliance to the interventions was evaluated or how to enhance that (l �1). 87 (85.3%) completely and accurately explained the primary and secondary outcome indicators (0.69 < l < 0.99), and the remaining 15 (14.7%) used only one outcome indicator. One article (1%) changed the outcome indicators and explained the reasons after the start of the trial (l �1). 14 (13.7%) reported how to determine the sample size (0.73 < l < 1.01), and 1 (1%) partially reported. 17 articles (16.7%) described the principles of interpretation, analysis, and test suspension if there were corresponding situations (0.57 < l < 0.89).

Randomized
Methods. 69 (67.6%) described the methods of generating random allocation sequences (0.77 < l < 0.97), and 4 (3.9%) mentioned the types of   random methods and limited details (0.22 < l < 1.10). 34 (33.3%) mentioned the mechanism for performing random sequence allocation and described the steps of concealing sequence numbers (0.82 < l < 1.00). 10 (9.8%) reported who generated the random allocation sequence, included the participants, and assigned concealment to the participants (0.86 < l < 1.04), while 1 (1%) partially mentioned the abovementioned information. 23 (22.5%) mentioned the implementation of the blind method, to whom it was implemented and how the implementation was carried out (0.79 < l < 0.99). In 9 (8.8%), intervention measures were found to have similarities in case of relevant situations (0.61 < l < 0.99). 7 (6.9%) described the measures to limit bias in case the blind method could not be implemented (0.58 < l < 1.06). 100 (98%) reported the statistical methods used to compare the primary and secondary outcome indicators of each group (0.43 < l < 0.95), and 2 (2%) described the methods of additional analysis (l �1).

Trial Results.
All the 102 RCTs included described the number of cases randomly assigned to each group, received the assigned treatment, and included in the analysis of outcome indicators (l � 1). Among them, 33 (32.4%) reported the number of cases dropped out and eliminated from each group and explained the reasons (0.84 < l < 0.98); 10 (9.8%) reported the number of cases dropped out and eliminated from each group but without explanation of the reasons; only 4 (3.9%) reported the time from random allocation to the delay of intervention implementation in each group (0.57 < l < 1.13).

Other Information.
Of the 102 papers included, only 12 (11.8%) included the clinical trial registration number and the name of the trial registry (l �1). 36 (35.3%) provided the author's mailbox with possible access to the complete trial protocol (l �1). 47 (46.1%) provided information of the sources of funding and other support (l �1).

STRICTA Guidelines.
STRICTA guidelines were used to assess the quality of included RCT reports, as shown in Table 2. e positive reporting rates of items such as "style of acupuncture," "reasons for acupuncture treatment," "number of needles inserted," "needle retention time," "treatment regimen," and "precise description of the control intervention" were above 80%. However, the positive reporting rates of items such as "setting and context of treatment" and "practitioner background" were below 20%.  instructions to practitioners, and explanations to patients (0.61 < l < 0.97).

Discussion
is study found that RCTs in acupuncture for PI were varied in reporting quality, with only a few in strict compliance with the CONSORT statement (2017) and STRICTA guidelines. (2017). In terms of the CONSORT statement (2017), most RCTs had high reporting rates in the introduction, description of trial design, results, and so on. However, the following shortcomings existed: (1) By title, only 15 out of 102 included papers could be identified as RCT. (2) In terms of intervention measures, few RCTs described whether and how to standardize the intervention measures and evaluate the compliance of experimenters and participants with the trial protocol. (3) In terms of sample size, only 14 papers estimated the sample size. (4) In terms of random methods, only a few papers completely reported the generation of sequence, allocation concealment mechanism, implementation, and blinding, while most papers only mentioned the words "random," "random number table," or "opaque envelope." Acupuncture is special in the way that acupuncture practitioners cannot be blinded, so blinding was hardly mentioned in these RCTs. Given that adequate randomization is an effective measure to ensure the authenticity of the results [15], and research confirms that allocation concealment and blinding are important protective measures to reduce the bias of implementation, measurement, and estimation of effects [16] and to ensure the feasibility and repeatability of the research, researchers should describe the random sequence generation, allocation concealment, implementation, and blinding in detail. (5) In terms of results, nearly half of the RCTs reported the number of cases that were dropped out and eliminated from each group, but a small part of them did not explain the reasons. (6) In terms of the implementation of interventions, nearly half of the RCTs only reported the recruitment period or neither the recruitment nor follow-up period; one-third of the RCTs did not use a table to list the baseline data of each group; only five mentioned the estimated effect size and its precision; more than half of the RCTs did not report whether there were harmful or unintended effects in each group. (7) In terms of discussion, more than half of the RCTs did not consider the potential sources of bias, imprecision, and multiple analyses in RCTs; a small number of RCTs did not mention the generalizability of the trial findings; half of the literature only gave the results and did not weigh the benefits and harms of the results or consider other relevant evidence. (8) In terms of other information, although the International Committee of Medical Journal Editors (ICMJE) requires all clinical trials must be registered to improve transparency and accountability [17], few RCTs had clinical trial registration numbers and names of the trial registry; most RCTs did not provide access to a complete trial protocol; more than half of the RCTs did not mention the sources of funding and other support.

STRICTA Guidelines.
In terms of STRICTA guidelines, the reporting rates of items 1a, 1b, 2a, 2e, 2f, 3a, 3b, and 6b were above 80%, indicating that most RCTs of acupuncture for PI have paid attention to the contents of these items. However, our study has also found the following shortcomings: (1) In terms of acupuncture details, one-third of the RCTs only mentioned the name of acupoints without the description of whether acupuncture was given to one or both sides. A few RCTs did not report the depth of needle insertion. Some RCTs did not report whether it was necessary to look for acupuncture reaction (Qi arrival) after inserting the needle. A small part of the RCTs did not explain the type of needle, while some mentioned the diameter and length of needles without the name of the manufacturer. e lack of acupuncture details not only reduces the credibility of research conclusions and the objectivity of clinical efficacy but also hinders the promotion and international development of acupuncture therapy [18]. (2) In terms of auxiliary interventions, most of the RCTs did not include the information of treatment and control interventions obtained by patients, such as any wording related to the informed consent and information affecting beliefs and expectations of the treatment. (3) More than 80% of the RCTs did not describe acupuncture practitioners, which could affect the generalizability of the trial results. (4) In terms of control intervention, most RCTs did not explain the reason for selecting the intervention for the control group. e selection of interventions for the control group should be combined with the medical ethics and scientificity of the study, and the reasons should be given [19].
Studies have shown that since CONSORT and STRICTA were firstly introduced to China in 1997 and 2003, respectively, the quality of RCTs report of acupuncture intervention published in Chinese journals has improved over time [12]. e number and quality of RCTs of acupuncture treatment for PI have been greatly improved compared with those before 2010 [20]. Compared with the evaluation of similar acupuncture RCT literature [21,22], there are still imperfections in the design, implementation of trials, and research reports, while the report on acupuncture details is relatively complete.

Deficiency.
is study has its own deficiencies. (1) Only a small number of foreign RCTs in accordance with the inclusion criteria was included, indicating a possible problem of insufficient representation of foreign literature. (2) RCTs were only searched in Chinese and English databases, so RCTs in other languages may be missed.

Conclusion
In conclusion, the report quality of RCTs of acupuncture for PI needs to be improved. erefore, it is warranted to advocate the endorsement of the CONSORT statement and STRICTA guidelines for the improvement in the quality of acupuncture RCT reports. For standardized RCT reports and improved quality of acupuncture clinical research, clinical researchers need to learn the basics of clinical trials systematically, and journal editors need to learn and adopt CONSORT statements and STRICTA guidelines. 8 Evidence-Based Complementary and Alternative Medicine Data Availability e dataset can be accessed from the corresponding author upon reasonable request.

Disclosure
Jinsong Yang and Fanjun Yu are the co-first authors.

Conflicts of Interest
e authors claim no conflicts of interest.

Authors' Contributions
Jinsong Yang and Yu Kui designed this study design. Fanjun Yu and Haotian Qu developed the search strategy and conducted the data analysis. Jinsong Yang and Keyi Lin extracted the searches, independently screened potential studies, and extracted the data from the included studies. Litao Pan rectified the data analysis. Jinsong Yang drafted and presented the manuscript. Yihan He and Yu Kui revised the manuscript. Fen Feng, Litao Pan, and Jing Zhao discussed the results and polished the manuscript. All authors had approved the publication of the final manuscript. Jinsong Yang and Fanjun Yu contributed equally to this study. Litao Pan and Yu Kui corresponded to this study.