Keywords
Chronic migraine, stakeholder workshop, randomised controlled trials
ALL Metrics
-
Views
Downloads
How to cite this article
Rees S, Cooklin A, Duncan C et al. Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.13548.2) NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
Export Citation
Sciwheel
EndNote
Ref. Manager
Bibtex
ProCite
Sente
Select a format first
▬
✚
Research Article
Revised Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop
[version 2; peer review: 1 approved, 3 approved with reservations]
Sophie Rees
https://orcid.org/0000-0003-4399-2049
1, Andrew Cooklin2, Callum Duncan3, [...] Manjit Matharu4, Seyran Naghdi https://orcid.org/0000-0001-5504-7189
5, Martin Underwood5,6, Hema Mistry https://orcid.org/0000-0002-5023-1160
5,6Sophie Rees
https://orcid.org/0000-0003-4399-2049
1, Andrew Cooklin2, [...] Callum Duncan3, Manjit Matharu4, Seyran Naghdi https://orcid.org/0000-0001-5504-7189
5, Martin Underwood5,6, Hema Mistry https://orcid.org/0000-0002-5023-1160
5,6 PUBLISHED 15 Apr 2025
Author details Author details
1 Bristol Trials Centre, Bristol University, Bristol, BS8 1NU, UK
2 Patient Representative, England, UK
3 Department of Neurology, Aberdeen Royal Infirmary, Aberdeen, Scotland, AB25 2ZN, UK
4 Queen Square Institute of Neurology and The National Hospital for Neurology and Neurosurgery, University College London, London, England, UK
5 Warwick Clinical Trials Unit, University of Warwick, Coventry, England, CV4 7AL, UK
6 University Hospitals Coventry and Warwickshire NHS Trust, Coventry, England, CV2 2DX, UK
2 Patient Representative, England, UK
3 Department of Neurology, Aberdeen Royal Infirmary, Aberdeen, Scotland, AB25 2ZN, UK
4 Queen Square Institute of Neurology and The National Hospital for Neurology and Neurosurgery, University College London, London, England, UK
5 Warwick Clinical Trials Unit, University of Warwick, Coventry, England, CV4 7AL, UK
6 University Hospitals Coventry and Warwickshire NHS Trust, Coventry, England, CV2 2DX, UK
Sophie Rees
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Original Draft Preparation
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Original Draft Preparation
Andrew Cooklin
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Callum Duncan
Roles: Conceptualization, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Investigation, Methodology, Writing – Review & Editing
Manjit Matharu
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Seyran Naghdi
Roles: Investigation, Writing – Review & Editing
Roles: Investigation, Writing – Review & Editing
Martin Underwood
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Hema Mistry
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
OPEN PEER REVIEW
REVIEWER STATUS
Chronic migraine is a disabling condition that can substantially impact on quality of life. People with chronic migraine have headaches on at least 15 days of every month. Preventative medications aiming to reduce number of days with migraine are available, but high-quality randomised evidence is lacking for many drugs, and it is unclear which medications should be prioritised for research. There is also no existing evidence about patient and clinicians’ priorities for research.
We undertook a consensus workshop with patient and healthcare professional stakeholders, using nominal group technique, to understand these stakeholders’ priorities for future randomised controlled trials. We reached a consensus on a set of research recommendations for the field.
Eight people with chronic migraine and eleven healthcare professionals took part in an online workshop. Comparisons of calcitonin gene-related peptide monoclonal antibodies (CGRP MAbs) and OnabotulinumtoxinA (BTA) were a top priority for our group. Candesartan and Flunarizine were the top drugs the group wanted to compare against placebo.
These research recommendations should guide researchers in the field, and funders when prioritising commissioned research and assessing funding applications. Particular areas to explore further are Candesartan or Flunarizine versus placebo, and comparing and combining CGRP MAbs with other medications.
Chronic migraine is thought to affect 2–4% of the population. It is a disabling condition that can destroy work and family life. Chronic migraine is defined as headaches on 15 or more days per month, with migraine (e.g. aura, nausea) on at least eight of those days. Drugs can be used to reduce the number of days with headache/migraine. We need more research to know which are most effective and best value for money for the NHS. This will support patients and doctors when making decisions which preventive drugs to use.
We wanted to find out what people with chronic migraine and health professionals think are the most important to study, to help researchers and funders prioritise their work.
We held an online workshop with eight people with chronic migraine and eleven health professionals specialising in headaches. The workshop had four core parts. Firstly, participants were briefed on our research findings regarding our review of the literature on preventative drug treatments. Secondly, the participants were divided into small groups to discuss their top drugs to study against placebo or against other drugs. Each small group had a nominated ‘Facilitator’ to chair the discussion and a notetaker to record it. Thirdly, there was a feedback session from each of the small groups to the whole group. Then finally as a whole group, we asked everyone to vote to rank the top comparisons in order of priority.
The group’s priorities for future research were Candesartan and Flunarizine versus placebo and comparing and testing combinations of drugs. Our findings are useful for researchers and funders in the field of headache.
Chronic migraine, stakeholder workshop, randomised controlled trials
Corresponding Author(s)
Hema Mistry (
[email protected])
Grant information: This project is funded by the National Institute for Health and Care Research (NIHR) under its ‘NIHR Health Technology Assessment Programme’ (Grant Reference Number NIHR132803). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.
Copyright: © 2025 Rees S et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. How to cite: Rees S, Cooklin A, Duncan C et al. Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.13548.2) First published: 04 Apr 2024, 4:16 (https://doi.org/10.3310/nihropenres.13548.1) Latest published: 15 Apr 2025, 4:16 (https://doi.org/10.3310/nihropenres.13548.2) In this version we have responded to peer review comments. In particular we have edited the methods section to add detail or clarify details. Professor Martin Underwood’s and Dr Hema Mistry’s affiliation has been corrected to University Hospitals Coventry and Warwickshire NHS Trust.
In this version we have responded to peer review comments. In particular we have edited the methods section to add detail or clarify details. Professor Martin Underwood’s and Dr Hema Mistry’s affiliation has been corrected to University Hospitals Coventry and Warwickshire NHS Trust.
See the authors' detailed response to the review by Raquel Gil-Gouveia
See the authors' detailed response to the review by Debashish Chowdhury
See the authors' detailed response to the review by Hsiangkuo Yuan
Migraine is the world’s second commonest disabling disorder1 and the top cause of years lived with disability in people aged 15–492. Chronic migraine is defined as headaches on 15 or more days per month for more than three months, with features of migraine (e.g. aura, nausea) on at least eight of those days. Chronic migraine is thought to affect 2-4% of the population3,4. Those with chronic migraine have the potential to benefit from effective prophylactic drugs to prevent headache days and migraine attacks, and improve quality of life.
Preventive medications can effectively treat chronic migraine, but it can be a challenge for clinicians and patients choosing a medication due to the various side effects and limited evidence. Our 2023 systematic review found that further definitive evidence is needed on many commonly prescribed medications (e.g. amitriptyline, Candesartan, propranolol)5–7. However, no work exists to guide researchers and funders designing and commissioning research in terms of the priorities of patients and healthcare professionals.
Following completion of systematic reviews of clinical- and cost-effectiveness, and adverse events, we used consensus methodology to translate these findings into useful research recommendations for research priorities, grounded in the perspectives of both people with chronic migraine and headache specialists. Consensus methodology is used in health research to generate research priorities and recommendations8–10.
In this paper we report on the research recommendations agreed to amongst a group of patient and health professional stakeholders. The findings should guide researchers in the field, and funders when prioritising commissioned research and assessing funding applications.
We used Nominal Group Technique (NGT)11, a method used by health researchers to generate ideas and to facilitate making decisions quickly in a large and diverse group. This method facilitates participation and contribution from all group members. We used small group work to facilitate discussion between patients and healthcare professionals, moderated by experienced facilitators. We designed the workshop and materials together with our Patient and Public Involvement (PPI) representative (AC), who suggested adding a breakaway session, wherein people with migraine and clinicians could meet separately to share thoughts and reflect on any challenges in the mixed groups. This supported patients at the workshop to ensure their voices were heard. At the end of the workshop, participants voted anonymously using an online polling website (Vevox)12. All participants’ votes counted equally, and the final priorities were based solely on the anonymous voting. Facilitators were not members of the study team, minimising the possibility of influencing the conversation in any particular direction.
We aimed to recruit 10 healthcare professionals and 15 people with chronic migraine, based on our previous experience of running similar workshops and the practicalities of including a range of voices but also allowing everyone a chance to contribute. We approached people with migraine through the National Migraine Centre’s (NMC) mailing list. Administrators of the NMC sent information about the workshop, a link to the expression of interest form online, and the study team contact details. People who expressed an interest were asked for basic demographic data to be used for purposive sampling to achieve diversity in terms of age, ethnicity, and years living with chronic migraine. We used personal networks to approach healthcare professionals directly, aiming for a mix of specialties and backgrounds, such as neurologists, general practitioners with a special interest, and headache nurses. Healthcare professionals were invited to express an interest by contacting the study team.
All individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.
This project was part of a larger study (Award ID: NIHR132803) which systematically reviewed the randomised controlled trial literature on preventive drug treatments for chronic migraine13. Having completed those reviews, we sent a summary of the findings to all invitees. The workshop itself took place online using Microsoft Teams and began with a presentation summarising the research and findings of the earlier work packages. We then explained the aims and scope of the workshop and research recommendations. Next, our patient representative spoke about the importance of equal voice within the small groups before the group was split into three breakout ‘rooms’ each containing approximately three people with migraine and four healthcare professionals. Each group also had a member of the study team to take notes (scribe) using a template we provided containing a table to clearly document final decisions, and a space for notes to capture the discussion. Figure 1 shows the workshop design.
The small group work required groups to agree on a top five drug-placebo comparisons and top five drug-drug comparisons. They were tasked to consider:
• How much evidence we have on the drug
• Safety (side effects)
• Efficacy (how effective the drugs were found to be in our study)
• Feasibility (cost, availability, ease of administration)
To support discussion and decision-making, we provided a crib sheet reporting the key study findings. Participants were reminded that they held valid knowledge and perspectives to bring to the discussion, and they were allowed to suggest comparisons of drugs not included in our study.
Next, the group was split by participant type (all people with migraine in one group and all healthcare professionals in another). With a facilitator, they reflected on the success of/any issues with equal voice in the small group sessions. Scribes provided their group session notes with the rest of the team before the plenary session. As a plenary, we discussed the outcomes from the group work. Voting then took place, followed by a brief discussion of the results and explanation of the team’s next steps and implications for the field. All attendees were provided with a certificate of attendance (health professionals) or thank you letter and payment (people with migraine) by email following the meeting.
Two PPI members of the team were involved in development of this project as co-applicants. One PPI member (AC) continued to provide input throughout the study, and actively contributed to design of the workshop and the materials. For example, AC suggested a separate discussion for all patients in the workshop. AC also provided a great deal of input on the workshop materials to ensure they were accessible and relevant. AC also spoke at the workshop to welcome patients, explain the importance of each participant feeling that they had an equal voice, explained his role within the team and was a notetaker in the small group sessions.
We received 147 expressions of interest in response to the invitation shared by the NMC. Nineteen people were sampled for maximum variation in terms of age, ethnicity, and years living with chronic migraine. Eight people with chronic migraine attended on the day. Fourteen clinicians expressed an interest, and all were invited to the workshop. Eleven attended on the day. Although we invited more people with migraine than health professionals, on the day the balance of attendees was in favour of health professionals. Demographics of our sample is shown in Table 1.
Each group provided ten top comparisons (five drug vs drug, and five drug vs placebo). We removed duplicate questions to create two lists of top comparisons, which resulted in eleven drug-drug comparisons and eight drug-placebo comparisons for future randomised controlled trials. These are shown in Table 2 and Table 3. Calcitonin gene-related peptide monoclonal antibodies (CGRP MAbs) and OnabotulinumtoxinA (BTA) dominated the top head-to-head drug comparisons identified by the groups, each featuring in six of the eleven comparisons.
| Comparison | Comparator 1 | Comparator 2 |
|---|---|---|
| 1 | All CGRP MAbs rotation | All CGRP MAbs rotation* |
| 2 | BTA + Topiramate | CGRP Mabs |
| 3 | CGRP Mabs | BTA |
| 4 | CGRP MAbs | CGRP MAbs + gepant |
| 5 | CGRP MAbs + BTA | BTA |
| 6 | CGRP MAbs + BTA | CGRP Mabs |
| 7 | CGRP MAb receptor# | MAb ligand |
| 8 | Flunarizine | BTA |
| 9 | Melatonin | Amitriptyline |
| 10 | Propranolol | BTA |
| 11 | Topiramate | Flunarizine |
In the final part of the workshop, participants voted anonymously for their top five choices of the comparisons. The results are shown in Table 4 and Table 5.
We then combined these to make a top 10 and asked participants to rank them in order of priority. The results are shown in Table 6.
| Rank | Comparator 1 | Comparator 2 |
|---|---|---|
| 1 | CGRP MAbs + BTA | CGRP MAbs |
| 2 | CGRP MAbs | BTA |
| 3 | CGRP MAb receptor | MAb ligand |
| 4 | CGRP MAbs + BTA | BTA |
| 5 | CGRP MAbs | CGRP MAbs + gepant |
| Rank | Comparator 1 | Comparator 2 |
|---|---|---|
| 1 | Candesartan | Placebo |
| 2 | Flunarizine | Placebo |
| 3 | Melatonin | Placebo |
| 4 | Beta-blocker | Placebo |
| 5 | Tricyclic antidepressant | Placebo |
This project used consensus methodology to generate research recommendations that are aimed at informing researchers in the field of chronic migraine when designing research projects and funding applications, and to support funders and reviewers assessing funding applications.
Candesartan and Flunarizine were the top drugs the group wanted compared against placebo. The group felt that as there was no evidence for these drugs in our clinical- and cost-effectiveness study, yet these drugs are commonly used to treat chronic migraine, they should be a high priority for research. Candesartan is a cheap and commonly used drug for hypertension, and GPs are familiar with it. In contrast, Flunarizine is not licensed and is more difficult to prescribe. It is currently usually only prescribed through specialist headache services. Researchers should consider this when designing future randomised controlled trial, and it could be argued that Candesartan may be an easier target for changing practice if research found good evidence of its clinical and cost effectiveness in this population.
The list of comparisons initially suggested by the groups included unanticipated drugs such as melatonin and doxycycline. The latter was put forward by one of the small groups, as a group member drew on evidence from a small open label study of four patients14. It was rejected by the wider group and was not included in the final list of priorities. Melatonin was mentioned in more than one of the small groups and was ranked within the top five drug-drug comparisons. This is not a commonly used drug for the management of migraine. One study found it performed better than placebo but not to amitriptyline, but in an episodic migraine population15.
Drugs without good quality evidence (e.g. Candesartan, Flunarizine, tricyclics) were prioritised for drug-placebo comparisons, as there is already good quality evidence for Topiramate, BTA, and MAbs versus placebo. The stakeholder group felt that evidence was needed to understand the differing clinical effectiveness between the different MAbs, MAbs with different targets, and of combining MAbs with BTA versus each alone. We anticipated that the group would prioritise comparing older commonly used drugs with each other, when in fact these drugs were only prioritised for comparison against placebo. Topiramate, BTA and CGRP MAbs do not feature in the top five drug-placebo comparisons, reflecting the existing evidence of the superiority of these medications against placebo.
The group raised the possibility of additive effects of combining medications, which was unanticipated by the study team. Since each of the drugs work through different pathways it is plausible that more substantial effects could be achieved through combinations. Our literature reviews found modest effect sizes, the smallest being 1.49 fewer monthly migraine days for topiramate, and the largest being 2.77 fewer migraine days per month for Fremanezumab5. Effect sizes describe the whole population, including those who did not respond to a medication at all, and so the effect on an individual can be much higher. However, the group felt it is worth exploring if additive effects are possible without negative interaction. For example, if the effects of BTA and a CGRP MAb add up to a mean effect size of 4–5 days reduction in headache or migraine days, that could be transformative for many people with chronic migraine.
This exercise was specifically designed to consider preventive medications rather than interventional procedures. We included Botox as a medication as it fits into same part of the care pathway as other preventive medications. Future research could review the evidence base for interventional procedures such as greater occipital nerve blocks, and generate priorities for research about such treatments.
Our study design meant that participants were able to provide multiple patient and clinician perspectives one research priorities for chronic migraine. However, it is possible another group might have identified different priorities. We also designed it closely with input from our patient partners. Despite inviting more people with migraine than health professionals, on the day more health professionals attended than people with migraine. We anticipated a number of dropouts due to the nature of chronic migraine. Future similar research should consider over-recruiting to an even greater extent to try to avoid this imbalance. Holding the workshop online meant that people with no internet access were excluded. However, it did mean that people did not need to travel and were able to join easily from different geographical regions. We achieved diversity in our small sample of people with migraine, in terms of age, ethnicity, and years with chronic migraine.
Researchers in the field of preventive migraine medication should consider the research recommendations generated through our stakeholder workshop when designing studies. Particular areas to explore are Candesartan or Flunarizine versus placebo, and comparing and combining CGRP MAbs with other medications.
The study was approved by the University of Warwick Biomedical and Social Sciences Research Ethics Committee (BSREC) on 13th February 2023 (Ref: BSREC 49/22-23).
Written informed consent for participation in the study and publication of the participants’ responses was obtained from all participants.
All data generated or analysed during this study are included in this published article. Further breakdown of this data is unavailable to protect participant confidentiality.
Kimberley Stewart provided administrative and technical support for the stakeholder workshop. Vivien Nichols, Professor David Ellard, and Dr Susanne Arnold facilitated the small groups during the stakeholder workshop. Dr Rachel Potter helped develop the study design. The National Migraine Centre supported recruitment to the workshop. We would like to thank all the patient representatives and clinicians who attended the workshop and voted.
Faculty Opinions recommendedReferences
- 1. GBD 2016 Disease and Injury Incidence and Prevalence Collaborators: Global, regional, and national incidence, prevalence, and years lived with disability for 328 diseases and injuries for 195 countries, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. 2017; 390(10100): 1211–1259. PubMed Abstract | Publisher Full Text | Free Full Text
- 2. Steiner TJ, Stovner LJ, Vos T, et al.: Migraine is first cause of disability in under 50s: will health politicians now take notice? J Headache Pain. 2018; 19(1): 17. PubMed Abstract | Publisher Full Text | Free Full Text
- 3. Hagen K, Zwart JA, Vatten L, et al.: Prevalence of migraine and non-migrainous headache—head-HUNT, a large population-based study. Cephalalgia. 2000; 20(10): 900–906. PubMed Abstract | Publisher Full Text
- 4. Stovner L, Hagen K, Jensen R, et al.: The global burden of headache: a documentation of headache prevalence and disability worldwide. Cephalalgia. 2007; 27(3): 193–210. PubMed Abstract | Publisher Full Text
- 5. Naghdi S, Underwood M, Madan J, et al.: Clinical effectiveness of pharmacological interventions for managing chronic migraine in adults: a systematic review and network meta-analysis. J Headache Pain. 2023; 24(1): 164. PubMed Abstract | Publisher Full Text | Free Full Text
- 6. Mistry H, Naghdi S, Underwood M, et al.: Competing treatments for migraine: a headache for decision-makers. J Headache Pain. 2023; 24(1): 162. PubMed Abstract | Publisher Full Text | Free Full Text
- 7. Naghdi S, Underwood M, Brown A, et al.: Adverse and serious adverse events incidence of pharmacological interventions for managing chronic and episodic migraine in adults: a systematic review. BMJ Neurol Open 2024; 6(1): e000616. PubMed Abstract | Publisher Full Text | Free Full Text
- 8. Nair R, Aggarwal R, Khanna D: Methods of formal consensus in classification/diagnostic criteria and guideline development. Semin Arthritis Rheum. 2011; 41(2): 95–105. PubMed Abstract | Publisher Full Text | Free Full Text
- 9. Hughes C, Ellard DR, Campbell A, et al.: Developing evidence-based guidance for assessment of suspected infections in care home residents. BMC Geriatr. 2020; 20(1): 59. PubMed Abstract | Publisher Full Text | Free Full Text
- 10. Potter R, Hee SW, Griffiths F, et al.: Development and validation of a telephone classification interview for common chronic headache disorders. J Headache Pain. 2019; 20(1): 2. PubMed Abstract | Publisher Full Text | Free Full Text
- 11. Van de Ven AH, Delbecq AL: The nominal group as a research instrument for exploratory health studies. Am J Public Health. 1972; 62(3): 337–342. PubMed Abstract | Publisher Full Text | Free Full Text
- 12. Vevox: Vevox: The #1 rated polling and Q&A platform. 2023; [Accessed 2023 30th May]. Reference Source
- 13. Mistry H, Naghdi S, Brown A, et al.: Preventive drug treatments for adults with chronic migraine: systematic review with economic modelling. Health Technol Assess. 2024; 28(63): 1–329. PubMed Abstract | Publisher Full Text | Free Full Text
- 14. Rozen T: Doxycycline for treatment resistant new daily persistent headache. Headache. 2008; 70(Suppl 1:A348).
- 15. Gonçalves AL, Ferreira AM, Ribeiro RT, et al.: Randomised clinical trial comparing melatonin 3mg, amitriptyline 25 mg and placebo for migraine prevention. J Neurol Neurosurg Psychiatry. 2016; 87(10): 1127–1132. PubMed Abstract | Publisher Full Text | Free Full Text
Author details Author details
1 Bristol Trials Centre, Bristol University, Bristol, BS8 1NU, UK
2 Patient Representative, England, UK
3 Department of Neurology, Aberdeen Royal Infirmary, Aberdeen, Scotland, AB25 2ZN, UK
4 Queen Square Institute of Neurology and The National Hospital for Neurology and Neurosurgery, University College London, London, England, UK
5 Warwick Clinical Trials Unit, University of Warwick, Coventry, England, CV4 7AL, UK
6 University Hospitals Coventry and Warwickshire NHS Trust, Coventry, England, CV2 2DX, UK
2 Patient Representative, England, UK
3 Department of Neurology, Aberdeen Royal Infirmary, Aberdeen, Scotland, AB25 2ZN, UK
4 Queen Square Institute of Neurology and The National Hospital for Neurology and Neurosurgery, University College London, London, England, UK
5 Warwick Clinical Trials Unit, University of Warwick, Coventry, England, CV4 7AL, UK
6 University Hospitals Coventry and Warwickshire NHS Trust, Coventry, England, CV2 2DX, UK
Sophie Rees
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Original Draft Preparation
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Original Draft Preparation
Andrew Cooklin
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Callum Duncan
Roles: Conceptualization, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Investigation, Methodology, Writing – Review & Editing
Manjit Matharu
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Seyran Naghdi
Roles: Investigation, Writing – Review & Editing
Roles: Investigation, Writing – Review & Editing
Martin Underwood
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Hema Mistry
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Writing – Review & Editing
Competing interests
Manjit Matharu is Chair of the medical advisory board of the CSF Leak Association. On the advisory board for Abbott, Allergan, Novartis, Eli Lilly, Medtronic, Autonomic Technologies and TEVA. Received payment for the development of educational presentations from Allergan, ElectroCore, Eli Lilly, Novartis, and TEVA. Received grants from Abbott, Medtronic and Ehlers Danlos society. He is co- investigator on NIHR awards. Hema Mistry is a member of the Member of the NIHR HTA General Funding Commissioning Committee. She is co- investigator on NIHR awards. Callum Duncan is chair of SIGN 155. He is co-investigator on NIHR awards. Martin Underwood is chief investigator or co-investigator on multiple previous and current research grants from the UK National Institute for Health Research, and is a co-investigator on grants funded by the Australian NHMRC and Norwegian MRC. He was an NIHR Senior Investigator until March 2021. He is a director and shareholder of Clinvivo Ltd that provides electronic data collection for health services research He receives some salary support from University Hospitals Coventry and Warwickshire He is a co-investigator on two current and one completed NIHR funded studies that have, or have had, additional support from Stryker Ltd. Sophie Rees is co-investigator on NIHR awards.
Grant information
This project is funded by the National Institute for Health and Care Research (NIHR) under its ‘NIHR Health Technology Assessment Programme’ (Grant Reference Number NIHR132803). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.
Article Versions (2)
Copyright
© 2025 Rees S et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
metrics
VIEWS
$counts.viewCount
downloads
Citations
CITE
how to cite this article
Rees S, Cooklin A, Duncan C et al. Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.13548.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.
Current Reviewer Status: ?
Key to Reviewer Statuses VIEW HIDE
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 15 Apr 2025 Revised
Views
0
How to cite this report:
Gazerani P. Reviewer Report For: Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.14898.r35413) The direct URL for this report is:
https://openresearch.nihr.ac.uk/articles/4-16/v2#referee-response-35413
https://openresearch.nihr.ac.uk/articles/4-16/v2#referee-response-35413
NOTE: it is important to ensure the information in square brackets after the title is included in this citation.
Reviewer Report 03 May 2025
Approved with Reservations
VIEWS 0
This article reports on a stakeholder consensus workshop to identify research priorities for randomized controlled trials (RCTs) in chronic migraine preventive medication. Using the Nominal Group Technique (NGT), the authors engaged patients and healthcare professionals to produce a ranked list ... Continue reading I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. Close
This article reports on a stakeholder consensus workshop to identify research priorities for randomized controlled trials (RCTs) in chronic migraine preventive medication. Using the Nominal Group Technique (NGT), the authors engaged patients and healthcare professionals to produce a ranked list of drug comparisons. The study addresses a clear gap in guiding future research priorities based on stakeholder input. The article is clearly written and the study is timely and relevant.
The research question is important and well-justified.
The methodology (NGT) is appropriate for generating consensus ideas.
Patient and Public Involvement (PPI) was meaningfully integrated throughout.
Presentation of the results is clear, with useful tables summarizing priorities.
Critical points for improvement:
Sample size and generalizability:
The workshop included only 19 participants (8 patients, 11 healthcare professionals).
The imbalance between patients and professionals may bias the priorities toward clinician perspectives.
Please expand the limitations section to more explicitly discuss how this small and unbalanced sample may affect the generalizability of the findings.
Selection bias:
Participants were mainly recruited via a specific center and networks, potentially limiting the diversity of views.
It would strengthen the manuscript if the authors acknowledge this more explicitly and discuss its implications.
Voting process transparency: While rankings of priorities are presented, the actual number of votes or percentages for each option are not shown. Including this information (or explaining why it is not available) would improve transparency and allow readers to assess the strength of consensus.
Validation of priorities: Only a single round of consensus was conducted without subsequent validation (e.g., second round voting or wider survey). While this is acceptable for an exploratory exercise, the authors should acknowledge that a larger or more iterative process could yield different results.
Implementation considerations: The conclusions would be strengthened by briefly discussing the feasibility of future trials based on the priorities identified (e.g., regulatory barriers for Flunarizine in the UK).
International applicability: As the sample is UK-based, it would be helpful if the authors comment on whether they believe the identified priorities are transferable to other healthcare settings.
Discussion
- For mAb+BTA vs. mAb or BTA, there is real-world data on this. However, it is uncertain whether such real-world data were factored into the consideration.
- I am curious that candesartan ranked 2nd, even though candesartan is not the most frequently used preventive medication. Could the author provide some explanation?
- Please provide the limitations of this study.
-
Is the work clearly and accurately presented and does it cite the current literature?
Yes
-
Is the study design appropriate and is the work technically sound?
Yes
-
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
-
If applicable, is the statistical analysis and its interpretation appropriate?
Yes
-
Are all the source data underlying the results available to ensure full reproducibility?
Yes
-
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: •Grants: NIH (R44NS115460, Drug-Free Nerve Block Device for the Relief of Pain and Symptoms in Migraines and other Headaches), AHS Early-Stage Investigator Research Award (2024)•Site investigators: Teva, Abbvie, Ipsen, Parema•Consultants: Salvia, Pfizer, Abbvie, Cerenovous•Royalties: Cambridge University Press, Medlink
Reviewer Expertise: migraine, outcome, neuroimaging
CITE
HOW TO CITE THIS REPORT Yuan H. Reviewer Report For: Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.14706.r31875)
The direct URL for this report is:
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31875
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31875
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
- Author Response 07 May 2025Sophie Rees, Bristol Trials Centre, Bristol University, Bristol, BS8 1NU, UK07 May 2025Author ResponseIntroduction:
- For reference #1, please cite the latest YLD paper on migraine.
- For reference #7, please update the citation detail:
- For reference #1, please cite the latest YLD paper on migraine.
- For reference #7, please update the citation detail: BMJ Neurology Open 2024, 6(1):e000616.
- The feasibility of the Nominal Group Technique should be described with associated literature.
Methods- Although a crib sheet was provided, it is uncertain what trial information was involved in the decision-making. Were data from both clinical trials and real-world studies included? Perhaps it would be helpful to provide the crib sheet in the appendix.
- It is uncertain if there’s a predetermined set of comparison questions (vs. open-ended) to choose from.
Results- There were 2 sets of tables, one from the small group and one from the workshop. Besides melatonin and doxycycline, it is unclear the key differences or similarities between these 2 sets, from the context, results, and implications perspective.
- Table 6 is a combination of table 4 and table 5. Is there a specific reason to show all of them? Also, the ranking from table 4 did not match that from table 6.
Discussion- For mAb+BTA vs. mAb or BTA, there is real-world data on this. However, it is uncertain whether such real-world data were factored into the consideration.
- I am curious that candesartan ranked 2nd, even though candesartan is not the most frequently used preventive medication. Could the author provide some explanation?
- Please provide the limitations of this study.
Introduction:Competing Interests: No competing interests were disclosed. Close- For reference #1, please cite the latest YLD paper on migraine.
- For reference #7, please update the citation detail: BMJ Neurology Open 2024, 6(1):e000616.
- The feasibility of the Nominal Group Technique should be described with associated literature.
Methods- Although a crib sheet was provided, it is uncertain what trial information was involved in the decision-making. Were data from both clinical trials and real-world studies included? Perhaps it would be helpful to provide the crib sheet in the appendix.
- It is uncertain if there’s a predetermined set of comparison questions (vs. open-ended) to choose from.
Results- There were 2 sets of tables, one from the small group and one from the workshop. Besides melatonin and doxycycline, it is unclear the key differences or similarities between these 2 sets, from the context, results, and implications perspective.
- Table 6 is a combination of table 4 and table 5. Is there a specific reason to show all of them? Also, the ranking from table 4 did not match that from table 6.
Discussion- For mAb+BTA vs. mAb or BTA, there is real-world data on this. However, it is uncertain whether such real-world data were factored into the consideration.
- I am curious that candesartan ranked 2nd, even though candesartan is not the most frequently used preventive medication. Could the author provide some explanation?
- Please provide the limitations of this study.
COMMENTS ON THIS REPORT
- Author Response 07 May 2025Sophie Rees, Bristol Trials Centre, Bristol University, Bristol, BS8 1NU, UK07 May 2025Author ResponseIntroduction:
- For reference #1, please cite the latest YLD paper on migraine.
- For reference #7, please update the citation detail:
- For reference #1, please cite the latest YLD paper on migraine.
- For reference #7, please update the citation detail: BMJ Neurology Open 2024, 6(1):e000616.
- The feasibility of the Nominal Group Technique should be described with associated literature.
Methods- Although a crib sheet was provided, it is uncertain what trial information was involved in the decision-making. Were data from both clinical trials and real-world studies included? Perhaps it would be helpful to provide the crib sheet in the appendix.
- It is uncertain if there’s a predetermined set of comparison questions (vs. open-ended) to choose from.
Results- There were 2 sets of tables, one from the small group and one from the workshop. Besides melatonin and doxycycline, it is unclear the key differences or similarities between these 2 sets, from the context, results, and implications perspective.
- Table 6 is a combination of table 4 and table 5. Is there a specific reason to show all of them? Also, the ranking from table 4 did not match that from table 6.
Discussion- For mAb+BTA vs. mAb or BTA, there is real-world data on this. However, it is uncertain whether such real-world data were factored into the consideration.
- I am curious that candesartan ranked 2nd, even though candesartan is not the most frequently used preventive medication. Could the author provide some explanation?
- Please provide the limitations of this study.
Introduction:Competing Interests: No competing interests were disclosed. Close- For reference #1, please cite the latest YLD paper on migraine.
- For reference #7, please update the citation detail: BMJ Neurology Open 2024, 6(1):e000616.
- The feasibility of the Nominal Group Technique should be described with associated literature.
Methods- Although a crib sheet was provided, it is uncertain what trial information was involved in the decision-making. Were data from both clinical trials and real-world studies included? Perhaps it would be helpful to provide the crib sheet in the appendix.
- It is uncertain if there’s a predetermined set of comparison questions (vs. open-ended) to choose from.
Results- There were 2 sets of tables, one from the small group and one from the workshop. Besides melatonin and doxycycline, it is unclear the key differences or similarities between these 2 sets, from the context, results, and implications perspective.
- Table 6 is a combination of table 4 and table 5. Is there a specific reason to show all of them? Also, the ranking from table 4 did not match that from table 6.
Discussion- For mAb+BTA vs. mAb or BTA, there is real-world data on this. However, it is uncertain whether such real-world data were factored into the consideration.
- I am curious that candesartan ranked 2nd, even though candesartan is not the most frequently used preventive medication. Could the author provide some explanation?
- Please provide the limitations of this study.
Views
0
How to cite this report:
Gil-Gouveia R. Reviewer Report For: Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.14706.r31709) The direct URL for this report is:
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31709
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31709
NOTE: it is important to ensure the information in square brackets after the title is included in this citation.
Reviewer Report 18 Jun 2024
Approved with Reservations
VIEWS 0
Thank you for the opportunity to review this manuscript. However, I do have several concerns about it.
Major Concerns
1. Concept and Objective
The main objective is to provide recommendations for research priorities ... Continue reading I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. Close
Major Concerns
1. Concept and Objective
The main objective is to provide recommendations for research priorities ... Continue reading
Thank you for the opportunity to review this manuscript. However, I do have several concerns about it.
Major Concerns
1. Concept and Objective
The main objective is to provide recommendations for research priorities grounded in the perspectives of relevant stakeholders, identified as both people with chronic migraine and headache specialists.
However, the most relevant stakeholders for research are primarily researchers, including those in academic institutions, clinical researchers in hospitals, and pharmaceutical companies, as they have the resources and willingness to conduct clinical trials.
Additionally, governments, policy makers (or insurance companies, depending on the context), and regulatory agencies are crucial stakeholders.
Healthcare professionals, including neurologists, headache specialists, general practitioners, pharmacists, nurses and patients and patient advocacy groups (but also employers and families of people living with migraine), also play an important role.
Most of these key stakeholders were not included in the study, which is a significant oversight.
2. Patient Bias and Information
3. Research Priorities
4. Methodological Concerns
5. Workshop Concerns
These aspects introduce several types of bias in the data that are difficult to oversee when reading the discussion.
Major Concerns
1. Concept and Objective
The main objective is to provide recommendations for research priorities grounded in the perspectives of relevant stakeholders, identified as both people with chronic migraine and headache specialists.
However, the most relevant stakeholders for research are primarily researchers, including those in academic institutions, clinical researchers in hospitals, and pharmaceutical companies, as they have the resources and willingness to conduct clinical trials.
Additionally, governments, policy makers (or insurance companies, depending on the context), and regulatory agencies are crucial stakeholders.
Healthcare professionals, including neurologists, headache specialists, general practitioners, pharmacists, nurses and patients and patient advocacy groups (but also employers and families of people living with migraine), also play an important role.
Most of these key stakeholders were not included in the study, which is a significant oversight.
2. Patient Bias and Information
- Patients may struggle to make unbiased decisions about pharmacological agents due to their limited information, which is likely based only on the summary of findings and the presentation given beforehand.
- Healthcare professionals have a different, more informed perspective due to their knowledge and experience with these drugs.
- Patients, on the other hand, might have a biased perspective influenced by their personal experiences with specific medications.
3. Research Priorities
- The manuscript does not address important issues related to drug research for migraines, such as safety concerns, combination therapies, dosing strategies, patient adherence, and personalized medicine strategies, including treatments for refractory migraine patients. I find it hard to believe that these topics did not come up in the group discussions.
4. Methodological Concerns
- Small Sample Size: The aim was to recruit 10 healthcare professionals and 15 people with chronic migraine. This relatively small sample size might limit the generalizability of the findings.
- Recruitment Strategy
- Selection Bias: Relying on the National Migraine Centre’s (NMC) mailing list may introduce selection bias, as it may not represent the broader population of people with chronic migraine.
- Convenience Sampling: Using personal networks to recruit healthcare professionals could lead to convenience sampling, potentially biasing the sample towards those with a particular interest or relationship with the researchers.
- Diversity of Participants
- Lack of Diversity: There’s no mention of efforts to ensure diversity among participants, although the sample seems balanced by age and ethnicity. However, there is no information about gender, severity of migraine, number of treatment failures or exposure to the evaluated drugs, and geographic location for people with migraine. For healthcare professionals, age, gender, and years of experience would also be important to ensure diversity.
- Recruitment Communication
- Communication Details: The description does not specify how potential participants were informed about confidentiality, voluntary participation, and the potential risks and benefits of participating in the study.
5. Workshop Concerns
- Online Format
- Access Issues: Conducting the workshop online via Microsoft Teams may exclude participants who lack access to technology or are not comfortable using digital platforms, potentially biasing the sample.
- Group Composition
- Imbalance: Each breakout room had a mix of three people with migraine and four healthcare professionals. This imbalance might affect the dynamics and ensure equal voice, potentially leading to dominance by healthcare professionals.
- Facilitation
- Training Details: The document mentions that a patient representative spoke about the importance of equal voice but does not detail how facilitators were trained to manage group dynamics effectively or address power imbalances.
- Decision-Making Process
- Consensus Building: The criteria for agreeing on top drug comparisons are clear, but the process for resolving disagreements or ensuring consensus within groups is not specified.
- Data Collection
- Standardization: The role of the scribes in note-taking is mentioned, but it’s unclear how the notes were standardized to ensure consistency and reliability across different groups.
- Splitting by Participant Type
- Reinforcing Hierarchies: Separating people with migraine and healthcare professionals for reflection may reinforce hierarchical distinctions, potentially undermining the principle of equal voice.
- Voting and Discussion
- Voting Methods: The methods for voting are not described. It's unclear whether it was anonymous, whether participants had equal voting power, and how voting influenced the final decisions.
- Ethical Considerations
- Ethical Approval: The methods section does not mention ethical approval or how ethical considerations (e.g., informed consent, data protection, right to withdraw) were addressed.
- Outcome Measures
- Effectiveness Measurement: The methods for measuring the effectiveness of the workshop in achieving its aims are not described.
- Stakeholder Engagement
- Feedback Integration: There’s a lack of detail on how stakeholder feedback was integrated into the planning and execution of the workshop, ensuring that it met the needs of both healthcare professionals and people with migraine.
These aspects introduce several types of bias in the data that are difficult to oversee when reading the discussion.
-
Is the work clearly and accurately presented and does it cite the current literature?
Partly
-
Is the study design appropriate and is the work technically sound?
Partly
-
Are sufficient details of methods and analysis provided to allow replication by others?
Partly
-
If applicable, is the statistical analysis and its interpretation appropriate?
Not applicable
-
Are all the source data underlying the results available to ensure full reproducibility?
No
-
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Migraine, Headache, Health services organization and quality, fMRI, PROMs
CITE
HOW TO CITE THIS REPORT Gil-Gouveia R. Reviewer Report For: Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.14706.r31709)
The direct URL for this report is:
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31709
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31709
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
- Author Response 15 Apr 2025Sophie Rees, Bristol Trials Centre, Bristol University, Bristol, BS8 1NU, UK15 Apr 2025Author ResponseThank you for the opportunity to review this manuscript. However, I do have several concerns about it.
Major Concerns
1. Concept and Objective
The main objective is to provide ... Continue reading Thank you for the opportunity to review this manuscript. However, I do have several concerns about it.
Major Concerns
1. Concept and Objective
The main objective is to provide recommendations for research priorities grounded in the perspectives of relevant stakeholders, identified as both people with chronic migraine and headache specialists.
However, the most relevant stakeholders for research are primarily researchers, including those in academic institutions, clinical researchers in hospitals, and pharmaceutical companies, as they have the resources and willingness to conduct clinical trials. Additionally, governments, policy makers (or insurance companies, depending on the context), and regulatory agencies are crucial stakeholders.
The purpose of this project was to understand the priorities from the perspective of those living with and managing the condition. We believe that research should be led by clinical need first and foremost. It is of course up to researchers to identify which of the priorities they are able to research at a particular time, and to address methodological questions. We did not want the workshop to be derailed by discussion of the practicalities of these comparisons: we wanted the focus to be based on the evidence we produced through our systematic reviews, combined with the experiential and clinical knowledge of people living with, and/or treating people with, chronic migraine.
Healthcare professionals, including neurologists, headache specialists, general practitioners, pharmacists, nurses and patients and patient advocacy groups (but also employers and families of people living with migraine), also play an important role. Most of these key stakeholders were not included in the study, which is a significant oversight.
Eleven of our 19 participants were healthcare professionals, including specialists, neurologists, and general practitioners. We recruited people with chronic migraine through a patient-led organisation: National Migraine Centre.
2. Patient Bias and Information
Patients may struggle to make unbiased decisions about pharmacological agents due to their limited information, which is likely based only on the summary of findings and the presentation given beforehand.
Healthcare professionals have a different, more informed perspective due to their knowledge and experience with these drugs.
Patients, on the other hand, might have a biased perspective influenced by their personal experiences with specific medications.
We disagree that patients cannot make unbiased decisions about research priorities. It is common when setting research priorities to draw on patient perspectives. Both health professionals and people living with migraine have their particular perspectives, informed by their experiences. We gave the same information to all the participants who attended the workshop.
3. Research Priorities
The manuscript does not address important issues related to drug research for migraines, such as safety concerns, combination therapies, dosing strategies, patient adherence, and personalized medicine strategies, including treatments for refractory migraine patients. I find it hard to believe that these topics did not come up in the group discussions.
In the workshop, we aimed to keep participants on track by focusing only on which comparisons (head-to-head or placebo) they thought would be most important to prioritise. It would of course be important for any researchers developing a study about any of the medications to work with patient representatives and health professionals to determine the dosing strategies, combinations, and ways to understand and support treatment adherence.
4. Methodological Concerns
Small Sample Size: The aim was to recruit 10 healthcare professionals and 15 people with chronic migraine. This relatively small sample size might limit the generalizability of the findings.
In this study we were seeking to achieve consensus from a group of interested and informed individuals. This is usual in consensus exercise of this nature. We were not seeking to establish the views of the population as whole. This would have required a different study design.
Recruitment Strategy
Selection Bias: Relying on the National Migraine Centre’s (NMC) mailing list may introduce selection bias, as it may not represent the broader population of people with chronic migraine.
Our experience in previous work is that identifying people with chronic headache disorders from the general population to participate in research studies is extremely challenging. For example, in the CHESS trial we needed to approach over 31,000 people to ensure we could recruit 736 participants. Any such approach would also need NHS research ethical approval. Pragmatically, working with the National Migraine centre allowed us to recruit participants in a timely and efficient manner.
Convenience Sampling: Using personal networks to recruit healthcare professionals could lead to convenience sampling, potentially biasing the sample towards those with a particular interest or relationship with the researchers.
Our experience across multiple studies of this nature is that it can be very challenging to recruit health professionals willing to give up their time for the project. Any form of random sampling is almost certainly doomed to failure. Not least because of the challenge of actually finding data for the sampling frame. The use of personal networks means we were able to recruit participants for the study.
Diversity of Participants
Lack of Diversity: There’s no mention of efforts to ensure diversity among participants, although the sample seems balanced by age and ethnicity. However, there is no information about gender, severity of migraine, number of treatment failures or exposure to the evaluated drugs, and geographic location for people with migraine. For healthcare professionals, age, gender, and years of experience would also be important to ensure diversity.
We asked people expressing an interest to provide basic demographic data and used purposive sampling to generate a sample that was diverse in terms of age, ethnicity, and years living with chronic migraine. This was described in the ‘Participants’ section of the paper, but we have also added this to the methods section. Given the small sample, any attempt to include diversity in all of the above characteristics would result in tokenism. We chose to focus on a small number of characteristics we could realistically achieve diversity in.
Recruitment Communication
Communication Details: The description does not specify how potential participants were informed about confidentiality, voluntary participation, and the potential risks and benefits of participating in the study.
We have added the following to the paper: ‘Individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.’
5. Workshop Concerns
Online Format
Access Issues: Conducting the workshop online via Microsoft Teams may exclude participants who lack access to technology or are not comfortable using digital platforms, potentially biasing the sample.
While we agree this is a potential limitation, if we had held the workshop in person this would have disadvantaged those who would need to travel further or who had physical disabilities, caring responsibilities, or less ability to pay for travel. Our previous experience is that that people living with chronic migraine can find it very difficult to commit to all day in person meeting because of the unpredictable nature of their disease.
Group Composition
Imbalance: Each breakout room had a mix of three people with migraine and four healthcare professionals. This imbalance might affect the dynamics and ensure equal voice, potentially leading to dominance by healthcare professionals.
This was a result of the numbers of people invited that actually attended on the day. The facilitators were skilled in ensuring everyone in the group had a chance to contribute and address any dominant voices. We also included a session where all people with migraine could reflect on any challenges to their equal voice in the small group discussions.
Facilitation
Training Details: The document mentions that a patient representative spoke about the importance of equal voice but does not detail how facilitators were trained to manage group dynamics effectively or address power imbalances.
We chose facilitators who were experienced in facilitating discussions between patients and healthcare professionals, and who had previous experience of facilitating similar consensus workshops.
Decision-Making Process
Consensus Building: The criteria for agreeing on top drug comparisons are clear, but the process for resolving disagreements or ensuring consensus within groups is not specified.
In the small groups, we facilitated discussions about the potential drug comparisons, and disagreements were resolved through discussion. Although we asked the groups to come up with five head-to-head and five placebo comparisons, scribes also noted where the group felt strongly that there were others they would want mentioned. When we returned to plenary, these additional comparisons were presented by the scribes and facilitators, and as a whole group we were able to discuss them. The facilitators were skilled in consensus discussions, and the group members were willing to consider other views and to come to a consensus.
Data Collection
Standardization: The role of the scribes in note-taking is mentioned, but it’s unclear how the notes were standardized to ensure consistency and reliability across different groups.
We used a pro forma for the scribes to take notes. This included a table to clearly document the final decisions, and a space for notes to document the discussion. We have added this to the paper which now reads ‘Each group also had a member of the study team to take notes (scribe) using a template we provided containing a table to clearly document final decisions, and a space for notes to capture the discussion.’
Splitting by Participant Type
Reinforcing Hierarchies: Separating people with migraine and healthcare professionals for reflection may reinforce hierarchical distinctions, potentially undermining the principle of equal voice.
This was suggested by our PPI representative and co-author. It was intended to provide people with migraine with an opportunity and space to reflect on their equal voice in the small groups, and any opinions they felt unable to express.
Voting and Discussion
Voting Methods: The methods for voting are not described. It's unclear whether it was anonymous, whether participants had equal voting power, and how voting influenced the final decisions.
In the paper, it reads ‘participants voted anonymously using an online polling website (Vevox).’ All participants votes counted the same, and the final priorities were based solely on the anonymous voting. We have added this to the paper.
Ethical Considerations
Ethical Approval: The methods section does not mention ethical approval or how ethical considerations (e.g., informed consent, data protection, right to withdraw) were addressed.
While it is true that ethical approval is not in the methods section, it is included in the ‘Ethics and consent’ section at the end.
We have added following text to the methods. ‘All individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.’
Outcome Measures
Effectiveness Measurement: The methods for measuring the effectiveness of the workshop in achieving its aims are not described.
We are unclear what the reviewer is expecting here. The aim of the workshop was to arrive at consensus from a group of health care professional and people with chronic migraine on research priorities. We achieved this aim and would therefore consider the exercise has been effective.
Stakeholder Engagement
Feedback Integration: There’s a lack of detail on how stakeholder feedback was integrated into the planning and execution of the workshop, ensuring that it met the needs of both healthcare professionals and people with migraine.
Within the ‘Patient and Public Involvement’ section under methods, we outline how people with migraine were involved in the development of workshop materials and planning. Healthcare professionals were also part of the study team and gave input from their perspective.
These aspects introduce several types of bias in the data that are difficult to oversee when reading the discussion.
We hope that our responses have addressed the concerns of the reviewer. We have also added the following text to the discussion to make it clearer that these are the views of the group we recruited: ‘Our participants were able to provide multiple patient and clinician perspectives on research priorities for chronic migraine. However, it is possible another group might have identified different priorities.’Thank you for the opportunity to review this manuscript. However, I do have several concerns about it.Competing Interests: No competing interests were disclosed. Close
Major Concerns
1. Concept and Objective
The main objective is to provide recommendations for research priorities grounded in the perspectives of relevant stakeholders, identified as both people with chronic migraine and headache specialists.
However, the most relevant stakeholders for research are primarily researchers, including those in academic institutions, clinical researchers in hospitals, and pharmaceutical companies, as they have the resources and willingness to conduct clinical trials. Additionally, governments, policy makers (or insurance companies, depending on the context), and regulatory agencies are crucial stakeholders.
The purpose of this project was to understand the priorities from the perspective of those living with and managing the condition. We believe that research should be led by clinical need first and foremost. It is of course up to researchers to identify which of the priorities they are able to research at a particular time, and to address methodological questions. We did not want the workshop to be derailed by discussion of the practicalities of these comparisons: we wanted the focus to be based on the evidence we produced through our systematic reviews, combined with the experiential and clinical knowledge of people living with, and/or treating people with, chronic migraine.
Healthcare professionals, including neurologists, headache specialists, general practitioners, pharmacists, nurses and patients and patient advocacy groups (but also employers and families of people living with migraine), also play an important role. Most of these key stakeholders were not included in the study, which is a significant oversight.
Eleven of our 19 participants were healthcare professionals, including specialists, neurologists, and general practitioners. We recruited people with chronic migraine through a patient-led organisation: National Migraine Centre.
2. Patient Bias and Information
Patients may struggle to make unbiased decisions about pharmacological agents due to their limited information, which is likely based only on the summary of findings and the presentation given beforehand.
Healthcare professionals have a different, more informed perspective due to their knowledge and experience with these drugs.
Patients, on the other hand, might have a biased perspective influenced by their personal experiences with specific medications.
We disagree that patients cannot make unbiased decisions about research priorities. It is common when setting research priorities to draw on patient perspectives. Both health professionals and people living with migraine have their particular perspectives, informed by their experiences. We gave the same information to all the participants who attended the workshop.
3. Research Priorities
The manuscript does not address important issues related to drug research for migraines, such as safety concerns, combination therapies, dosing strategies, patient adherence, and personalized medicine strategies, including treatments for refractory migraine patients. I find it hard to believe that these topics did not come up in the group discussions.
In the workshop, we aimed to keep participants on track by focusing only on which comparisons (head-to-head or placebo) they thought would be most important to prioritise. It would of course be important for any researchers developing a study about any of the medications to work with patient representatives and health professionals to determine the dosing strategies, combinations, and ways to understand and support treatment adherence.
4. Methodological Concerns
Small Sample Size: The aim was to recruit 10 healthcare professionals and 15 people with chronic migraine. This relatively small sample size might limit the generalizability of the findings.
In this study we were seeking to achieve consensus from a group of interested and informed individuals. This is usual in consensus exercise of this nature. We were not seeking to establish the views of the population as whole. This would have required a different study design.
Recruitment Strategy
Selection Bias: Relying on the National Migraine Centre’s (NMC) mailing list may introduce selection bias, as it may not represent the broader population of people with chronic migraine.
Our experience in previous work is that identifying people with chronic headache disorders from the general population to participate in research studies is extremely challenging. For example, in the CHESS trial we needed to approach over 31,000 people to ensure we could recruit 736 participants. Any such approach would also need NHS research ethical approval. Pragmatically, working with the National Migraine centre allowed us to recruit participants in a timely and efficient manner.
Convenience Sampling: Using personal networks to recruit healthcare professionals could lead to convenience sampling, potentially biasing the sample towards those with a particular interest or relationship with the researchers.
Our experience across multiple studies of this nature is that it can be very challenging to recruit health professionals willing to give up their time for the project. Any form of random sampling is almost certainly doomed to failure. Not least because of the challenge of actually finding data for the sampling frame. The use of personal networks means we were able to recruit participants for the study.
Diversity of Participants
Lack of Diversity: There’s no mention of efforts to ensure diversity among participants, although the sample seems balanced by age and ethnicity. However, there is no information about gender, severity of migraine, number of treatment failures or exposure to the evaluated drugs, and geographic location for people with migraine. For healthcare professionals, age, gender, and years of experience would also be important to ensure diversity.
We asked people expressing an interest to provide basic demographic data and used purposive sampling to generate a sample that was diverse in terms of age, ethnicity, and years living with chronic migraine. This was described in the ‘Participants’ section of the paper, but we have also added this to the methods section. Given the small sample, any attempt to include diversity in all of the above characteristics would result in tokenism. We chose to focus on a small number of characteristics we could realistically achieve diversity in.
Recruitment Communication
Communication Details: The description does not specify how potential participants were informed about confidentiality, voluntary participation, and the potential risks and benefits of participating in the study.
We have added the following to the paper: ‘Individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.’
5. Workshop Concerns
Online Format
Access Issues: Conducting the workshop online via Microsoft Teams may exclude participants who lack access to technology or are not comfortable using digital platforms, potentially biasing the sample.
While we agree this is a potential limitation, if we had held the workshop in person this would have disadvantaged those who would need to travel further or who had physical disabilities, caring responsibilities, or less ability to pay for travel. Our previous experience is that that people living with chronic migraine can find it very difficult to commit to all day in person meeting because of the unpredictable nature of their disease.
Group Composition
Imbalance: Each breakout room had a mix of three people with migraine and four healthcare professionals. This imbalance might affect the dynamics and ensure equal voice, potentially leading to dominance by healthcare professionals.
This was a result of the numbers of people invited that actually attended on the day. The facilitators were skilled in ensuring everyone in the group had a chance to contribute and address any dominant voices. We also included a session where all people with migraine could reflect on any challenges to their equal voice in the small group discussions.
Facilitation
Training Details: The document mentions that a patient representative spoke about the importance of equal voice but does not detail how facilitators were trained to manage group dynamics effectively or address power imbalances.
We chose facilitators who were experienced in facilitating discussions between patients and healthcare professionals, and who had previous experience of facilitating similar consensus workshops.
Decision-Making Process
Consensus Building: The criteria for agreeing on top drug comparisons are clear, but the process for resolving disagreements or ensuring consensus within groups is not specified.
In the small groups, we facilitated discussions about the potential drug comparisons, and disagreements were resolved through discussion. Although we asked the groups to come up with five head-to-head and five placebo comparisons, scribes also noted where the group felt strongly that there were others they would want mentioned. When we returned to plenary, these additional comparisons were presented by the scribes and facilitators, and as a whole group we were able to discuss them. The facilitators were skilled in consensus discussions, and the group members were willing to consider other views and to come to a consensus.
Data Collection
Standardization: The role of the scribes in note-taking is mentioned, but it’s unclear how the notes were standardized to ensure consistency and reliability across different groups.
We used a pro forma for the scribes to take notes. This included a table to clearly document the final decisions, and a space for notes to document the discussion. We have added this to the paper which now reads ‘Each group also had a member of the study team to take notes (scribe) using a template we provided containing a table to clearly document final decisions, and a space for notes to capture the discussion.’
Splitting by Participant Type
Reinforcing Hierarchies: Separating people with migraine and healthcare professionals for reflection may reinforce hierarchical distinctions, potentially undermining the principle of equal voice.
This was suggested by our PPI representative and co-author. It was intended to provide people with migraine with an opportunity and space to reflect on their equal voice in the small groups, and any opinions they felt unable to express.
Voting and Discussion
Voting Methods: The methods for voting are not described. It's unclear whether it was anonymous, whether participants had equal voting power, and how voting influenced the final decisions.
In the paper, it reads ‘participants voted anonymously using an online polling website (Vevox).’ All participants votes counted the same, and the final priorities were based solely on the anonymous voting. We have added this to the paper.
Ethical Considerations
Ethical Approval: The methods section does not mention ethical approval or how ethical considerations (e.g., informed consent, data protection, right to withdraw) were addressed.
While it is true that ethical approval is not in the methods section, it is included in the ‘Ethics and consent’ section at the end.
We have added following text to the methods. ‘All individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.’
Outcome Measures
Effectiveness Measurement: The methods for measuring the effectiveness of the workshop in achieving its aims are not described.
We are unclear what the reviewer is expecting here. The aim of the workshop was to arrive at consensus from a group of health care professional and people with chronic migraine on research priorities. We achieved this aim and would therefore consider the exercise has been effective.
Stakeholder Engagement
Feedback Integration: There’s a lack of detail on how stakeholder feedback was integrated into the planning and execution of the workshop, ensuring that it met the needs of both healthcare professionals and people with migraine.
Within the ‘Patient and Public Involvement’ section under methods, we outline how people with migraine were involved in the development of workshop materials and planning. Healthcare professionals were also part of the study team and gave input from their perspective.
These aspects introduce several types of bias in the data that are difficult to oversee when reading the discussion.
We hope that our responses have addressed the concerns of the reviewer. We have also added the following text to the discussion to make it clearer that these are the views of the group we recruited: ‘Our participants were able to provide multiple patient and clinician perspectives on research priorities for chronic migraine. However, it is possible another group might have identified different priorities.’
COMMENTS ON THIS REPORT
- Author Response 15 Apr 2025Sophie Rees, Bristol Trials Centre, Bristol University, Bristol, BS8 1NU, UK15 Apr 2025Author ResponseThank you for the opportunity to review this manuscript. However, I do have several concerns about it.
Major Concerns
1. Concept and Objective
The main objective is to provide ... Continue reading Thank you for the opportunity to review this manuscript. However, I do have several concerns about it.
Major Concerns
1. Concept and Objective
The main objective is to provide recommendations for research priorities grounded in the perspectives of relevant stakeholders, identified as both people with chronic migraine and headache specialists.
However, the most relevant stakeholders for research are primarily researchers, including those in academic institutions, clinical researchers in hospitals, and pharmaceutical companies, as they have the resources and willingness to conduct clinical trials. Additionally, governments, policy makers (or insurance companies, depending on the context), and regulatory agencies are crucial stakeholders.
The purpose of this project was to understand the priorities from the perspective of those living with and managing the condition. We believe that research should be led by clinical need first and foremost. It is of course up to researchers to identify which of the priorities they are able to research at a particular time, and to address methodological questions. We did not want the workshop to be derailed by discussion of the practicalities of these comparisons: we wanted the focus to be based on the evidence we produced through our systematic reviews, combined with the experiential and clinical knowledge of people living with, and/or treating people with, chronic migraine.
Healthcare professionals, including neurologists, headache specialists, general practitioners, pharmacists, nurses and patients and patient advocacy groups (but also employers and families of people living with migraine), also play an important role. Most of these key stakeholders were not included in the study, which is a significant oversight.
Eleven of our 19 participants were healthcare professionals, including specialists, neurologists, and general practitioners. We recruited people with chronic migraine through a patient-led organisation: National Migraine Centre.
2. Patient Bias and Information
Patients may struggle to make unbiased decisions about pharmacological agents due to their limited information, which is likely based only on the summary of findings and the presentation given beforehand.
Healthcare professionals have a different, more informed perspective due to their knowledge and experience with these drugs.
Patients, on the other hand, might have a biased perspective influenced by their personal experiences with specific medications.
We disagree that patients cannot make unbiased decisions about research priorities. It is common when setting research priorities to draw on patient perspectives. Both health professionals and people living with migraine have their particular perspectives, informed by their experiences. We gave the same information to all the participants who attended the workshop.
3. Research Priorities
The manuscript does not address important issues related to drug research for migraines, such as safety concerns, combination therapies, dosing strategies, patient adherence, and personalized medicine strategies, including treatments for refractory migraine patients. I find it hard to believe that these topics did not come up in the group discussions.
In the workshop, we aimed to keep participants on track by focusing only on which comparisons (head-to-head or placebo) they thought would be most important to prioritise. It would of course be important for any researchers developing a study about any of the medications to work with patient representatives and health professionals to determine the dosing strategies, combinations, and ways to understand and support treatment adherence.
4. Methodological Concerns
Small Sample Size: The aim was to recruit 10 healthcare professionals and 15 people with chronic migraine. This relatively small sample size might limit the generalizability of the findings.
In this study we were seeking to achieve consensus from a group of interested and informed individuals. This is usual in consensus exercise of this nature. We were not seeking to establish the views of the population as whole. This would have required a different study design.
Recruitment Strategy
Selection Bias: Relying on the National Migraine Centre’s (NMC) mailing list may introduce selection bias, as it may not represent the broader population of people with chronic migraine.
Our experience in previous work is that identifying people with chronic headache disorders from the general population to participate in research studies is extremely challenging. For example, in the CHESS trial we needed to approach over 31,000 people to ensure we could recruit 736 participants. Any such approach would also need NHS research ethical approval. Pragmatically, working with the National Migraine centre allowed us to recruit participants in a timely and efficient manner.
Convenience Sampling: Using personal networks to recruit healthcare professionals could lead to convenience sampling, potentially biasing the sample towards those with a particular interest or relationship with the researchers.
Our experience across multiple studies of this nature is that it can be very challenging to recruit health professionals willing to give up their time for the project. Any form of random sampling is almost certainly doomed to failure. Not least because of the challenge of actually finding data for the sampling frame. The use of personal networks means we were able to recruit participants for the study.
Diversity of Participants
Lack of Diversity: There’s no mention of efforts to ensure diversity among participants, although the sample seems balanced by age and ethnicity. However, there is no information about gender, severity of migraine, number of treatment failures or exposure to the evaluated drugs, and geographic location for people with migraine. For healthcare professionals, age, gender, and years of experience would also be important to ensure diversity.
We asked people expressing an interest to provide basic demographic data and used purposive sampling to generate a sample that was diverse in terms of age, ethnicity, and years living with chronic migraine. This was described in the ‘Participants’ section of the paper, but we have also added this to the methods section. Given the small sample, any attempt to include diversity in all of the above characteristics would result in tokenism. We chose to focus on a small number of characteristics we could realistically achieve diversity in.
Recruitment Communication
Communication Details: The description does not specify how potential participants were informed about confidentiality, voluntary participation, and the potential risks and benefits of participating in the study.
We have added the following to the paper: ‘Individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.’
5. Workshop Concerns
Online Format
Access Issues: Conducting the workshop online via Microsoft Teams may exclude participants who lack access to technology or are not comfortable using digital platforms, potentially biasing the sample.
While we agree this is a potential limitation, if we had held the workshop in person this would have disadvantaged those who would need to travel further or who had physical disabilities, caring responsibilities, or less ability to pay for travel. Our previous experience is that that people living with chronic migraine can find it very difficult to commit to all day in person meeting because of the unpredictable nature of their disease.
Group Composition
Imbalance: Each breakout room had a mix of three people with migraine and four healthcare professionals. This imbalance might affect the dynamics and ensure equal voice, potentially leading to dominance by healthcare professionals.
This was a result of the numbers of people invited that actually attended on the day. The facilitators were skilled in ensuring everyone in the group had a chance to contribute and address any dominant voices. We also included a session where all people with migraine could reflect on any challenges to their equal voice in the small group discussions.
Facilitation
Training Details: The document mentions that a patient representative spoke about the importance of equal voice but does not detail how facilitators were trained to manage group dynamics effectively or address power imbalances.
We chose facilitators who were experienced in facilitating discussions between patients and healthcare professionals, and who had previous experience of facilitating similar consensus workshops.
Decision-Making Process
Consensus Building: The criteria for agreeing on top drug comparisons are clear, but the process for resolving disagreements or ensuring consensus within groups is not specified.
In the small groups, we facilitated discussions about the potential drug comparisons, and disagreements were resolved through discussion. Although we asked the groups to come up with five head-to-head and five placebo comparisons, scribes also noted where the group felt strongly that there were others they would want mentioned. When we returned to plenary, these additional comparisons were presented by the scribes and facilitators, and as a whole group we were able to discuss them. The facilitators were skilled in consensus discussions, and the group members were willing to consider other views and to come to a consensus.
Data Collection
Standardization: The role of the scribes in note-taking is mentioned, but it’s unclear how the notes were standardized to ensure consistency and reliability across different groups.
We used a pro forma for the scribes to take notes. This included a table to clearly document the final decisions, and a space for notes to document the discussion. We have added this to the paper which now reads ‘Each group also had a member of the study team to take notes (scribe) using a template we provided containing a table to clearly document final decisions, and a space for notes to capture the discussion.’
Splitting by Participant Type
Reinforcing Hierarchies: Separating people with migraine and healthcare professionals for reflection may reinforce hierarchical distinctions, potentially undermining the principle of equal voice.
This was suggested by our PPI representative and co-author. It was intended to provide people with migraine with an opportunity and space to reflect on their equal voice in the small groups, and any opinions they felt unable to express.
Voting and Discussion
Voting Methods: The methods for voting are not described. It's unclear whether it was anonymous, whether participants had equal voting power, and how voting influenced the final decisions.
In the paper, it reads ‘participants voted anonymously using an online polling website (Vevox).’ All participants votes counted the same, and the final priorities were based solely on the anonymous voting. We have added this to the paper.
Ethical Considerations
Ethical Approval: The methods section does not mention ethical approval or how ethical considerations (e.g., informed consent, data protection, right to withdraw) were addressed.
While it is true that ethical approval is not in the methods section, it is included in the ‘Ethics and consent’ section at the end.
We have added following text to the methods. ‘All individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.’
Outcome Measures
Effectiveness Measurement: The methods for measuring the effectiveness of the workshop in achieving its aims are not described.
We are unclear what the reviewer is expecting here. The aim of the workshop was to arrive at consensus from a group of health care professional and people with chronic migraine on research priorities. We achieved this aim and would therefore consider the exercise has been effective.
Stakeholder Engagement
Feedback Integration: There’s a lack of detail on how stakeholder feedback was integrated into the planning and execution of the workshop, ensuring that it met the needs of both healthcare professionals and people with migraine.
Within the ‘Patient and Public Involvement’ section under methods, we outline how people with migraine were involved in the development of workshop materials and planning. Healthcare professionals were also part of the study team and gave input from their perspective.
These aspects introduce several types of bias in the data that are difficult to oversee when reading the discussion.
We hope that our responses have addressed the concerns of the reviewer. We have also added the following text to the discussion to make it clearer that these are the views of the group we recruited: ‘Our participants were able to provide multiple patient and clinician perspectives on research priorities for chronic migraine. However, it is possible another group might have identified different priorities.’Thank you for the opportunity to review this manuscript. However, I do have several concerns about it.Competing Interests: No competing interests were disclosed. Close
Major Concerns
1. Concept and Objective
The main objective is to provide recommendations for research priorities grounded in the perspectives of relevant stakeholders, identified as both people with chronic migraine and headache specialists.
However, the most relevant stakeholders for research are primarily researchers, including those in academic institutions, clinical researchers in hospitals, and pharmaceutical companies, as they have the resources and willingness to conduct clinical trials. Additionally, governments, policy makers (or insurance companies, depending on the context), and regulatory agencies are crucial stakeholders.
The purpose of this project was to understand the priorities from the perspective of those living with and managing the condition. We believe that research should be led by clinical need first and foremost. It is of course up to researchers to identify which of the priorities they are able to research at a particular time, and to address methodological questions. We did not want the workshop to be derailed by discussion of the practicalities of these comparisons: we wanted the focus to be based on the evidence we produced through our systematic reviews, combined with the experiential and clinical knowledge of people living with, and/or treating people with, chronic migraine.
Healthcare professionals, including neurologists, headache specialists, general practitioners, pharmacists, nurses and patients and patient advocacy groups (but also employers and families of people living with migraine), also play an important role. Most of these key stakeholders were not included in the study, which is a significant oversight.
Eleven of our 19 participants were healthcare professionals, including specialists, neurologists, and general practitioners. We recruited people with chronic migraine through a patient-led organisation: National Migraine Centre.
2. Patient Bias and Information
Patients may struggle to make unbiased decisions about pharmacological agents due to their limited information, which is likely based only on the summary of findings and the presentation given beforehand.
Healthcare professionals have a different, more informed perspective due to their knowledge and experience with these drugs.
Patients, on the other hand, might have a biased perspective influenced by their personal experiences with specific medications.
We disagree that patients cannot make unbiased decisions about research priorities. It is common when setting research priorities to draw on patient perspectives. Both health professionals and people living with migraine have their particular perspectives, informed by their experiences. We gave the same information to all the participants who attended the workshop.
3. Research Priorities
The manuscript does not address important issues related to drug research for migraines, such as safety concerns, combination therapies, dosing strategies, patient adherence, and personalized medicine strategies, including treatments for refractory migraine patients. I find it hard to believe that these topics did not come up in the group discussions.
In the workshop, we aimed to keep participants on track by focusing only on which comparisons (head-to-head or placebo) they thought would be most important to prioritise. It would of course be important for any researchers developing a study about any of the medications to work with patient representatives and health professionals to determine the dosing strategies, combinations, and ways to understand and support treatment adherence.
4. Methodological Concerns
Small Sample Size: The aim was to recruit 10 healthcare professionals and 15 people with chronic migraine. This relatively small sample size might limit the generalizability of the findings.
In this study we were seeking to achieve consensus from a group of interested and informed individuals. This is usual in consensus exercise of this nature. We were not seeking to establish the views of the population as whole. This would have required a different study design.
Recruitment Strategy
Selection Bias: Relying on the National Migraine Centre’s (NMC) mailing list may introduce selection bias, as it may not represent the broader population of people with chronic migraine.
Our experience in previous work is that identifying people with chronic headache disorders from the general population to participate in research studies is extremely challenging. For example, in the CHESS trial we needed to approach over 31,000 people to ensure we could recruit 736 participants. Any such approach would also need NHS research ethical approval. Pragmatically, working with the National Migraine centre allowed us to recruit participants in a timely and efficient manner.
Convenience Sampling: Using personal networks to recruit healthcare professionals could lead to convenience sampling, potentially biasing the sample towards those with a particular interest or relationship with the researchers.
Our experience across multiple studies of this nature is that it can be very challenging to recruit health professionals willing to give up their time for the project. Any form of random sampling is almost certainly doomed to failure. Not least because of the challenge of actually finding data for the sampling frame. The use of personal networks means we were able to recruit participants for the study.
Diversity of Participants
Lack of Diversity: There’s no mention of efforts to ensure diversity among participants, although the sample seems balanced by age and ethnicity. However, there is no information about gender, severity of migraine, number of treatment failures or exposure to the evaluated drugs, and geographic location for people with migraine. For healthcare professionals, age, gender, and years of experience would also be important to ensure diversity.
We asked people expressing an interest to provide basic demographic data and used purposive sampling to generate a sample that was diverse in terms of age, ethnicity, and years living with chronic migraine. This was described in the ‘Participants’ section of the paper, but we have also added this to the methods section. Given the small sample, any attempt to include diversity in all of the above characteristics would result in tokenism. We chose to focus on a small number of characteristics we could realistically achieve diversity in.
Recruitment Communication
Communication Details: The description does not specify how potential participants were informed about confidentiality, voluntary participation, and the potential risks and benefits of participating in the study.
We have added the following to the paper: ‘Individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.’
5. Workshop Concerns
Online Format
Access Issues: Conducting the workshop online via Microsoft Teams may exclude participants who lack access to technology or are not comfortable using digital platforms, potentially biasing the sample.
While we agree this is a potential limitation, if we had held the workshop in person this would have disadvantaged those who would need to travel further or who had physical disabilities, caring responsibilities, or less ability to pay for travel. Our previous experience is that that people living with chronic migraine can find it very difficult to commit to all day in person meeting because of the unpredictable nature of their disease.
Group Composition
Imbalance: Each breakout room had a mix of three people with migraine and four healthcare professionals. This imbalance might affect the dynamics and ensure equal voice, potentially leading to dominance by healthcare professionals.
This was a result of the numbers of people invited that actually attended on the day. The facilitators were skilled in ensuring everyone in the group had a chance to contribute and address any dominant voices. We also included a session where all people with migraine could reflect on any challenges to their equal voice in the small group discussions.
Facilitation
Training Details: The document mentions that a patient representative spoke about the importance of equal voice but does not detail how facilitators were trained to manage group dynamics effectively or address power imbalances.
We chose facilitators who were experienced in facilitating discussions between patients and healthcare professionals, and who had previous experience of facilitating similar consensus workshops.
Decision-Making Process
Consensus Building: The criteria for agreeing on top drug comparisons are clear, but the process for resolving disagreements or ensuring consensus within groups is not specified.
In the small groups, we facilitated discussions about the potential drug comparisons, and disagreements were resolved through discussion. Although we asked the groups to come up with five head-to-head and five placebo comparisons, scribes also noted where the group felt strongly that there were others they would want mentioned. When we returned to plenary, these additional comparisons were presented by the scribes and facilitators, and as a whole group we were able to discuss them. The facilitators were skilled in consensus discussions, and the group members were willing to consider other views and to come to a consensus.
Data Collection
Standardization: The role of the scribes in note-taking is mentioned, but it’s unclear how the notes were standardized to ensure consistency and reliability across different groups.
We used a pro forma for the scribes to take notes. This included a table to clearly document the final decisions, and a space for notes to document the discussion. We have added this to the paper which now reads ‘Each group also had a member of the study team to take notes (scribe) using a template we provided containing a table to clearly document final decisions, and a space for notes to capture the discussion.’
Splitting by Participant Type
Reinforcing Hierarchies: Separating people with migraine and healthcare professionals for reflection may reinforce hierarchical distinctions, potentially undermining the principle of equal voice.
This was suggested by our PPI representative and co-author. It was intended to provide people with migraine with an opportunity and space to reflect on their equal voice in the small groups, and any opinions they felt unable to express.
Voting and Discussion
Voting Methods: The methods for voting are not described. It's unclear whether it was anonymous, whether participants had equal voting power, and how voting influenced the final decisions.
In the paper, it reads ‘participants voted anonymously using an online polling website (Vevox).’ All participants votes counted the same, and the final priorities were based solely on the anonymous voting. We have added this to the paper.
Ethical Considerations
Ethical Approval: The methods section does not mention ethical approval or how ethical considerations (e.g., informed consent, data protection, right to withdraw) were addressed.
While it is true that ethical approval is not in the methods section, it is included in the ‘Ethics and consent’ section at the end.
We have added following text to the methods. ‘All individuals who expressed an interest were provided by email with an information sheet which included detail on confidentiality, voluntary participation, right/how to withdraw, and the potential risks and benefits of participation. These principles were reinforced at the start of the workshop.’
Outcome Measures
Effectiveness Measurement: The methods for measuring the effectiveness of the workshop in achieving its aims are not described.
We are unclear what the reviewer is expecting here. The aim of the workshop was to arrive at consensus from a group of health care professional and people with chronic migraine on research priorities. We achieved this aim and would therefore consider the exercise has been effective.
Stakeholder Engagement
Feedback Integration: There’s a lack of detail on how stakeholder feedback was integrated into the planning and execution of the workshop, ensuring that it met the needs of both healthcare professionals and people with migraine.
Within the ‘Patient and Public Involvement’ section under methods, we outline how people with migraine were involved in the development of workshop materials and planning. Healthcare professionals were also part of the study team and gave input from their perspective.
These aspects introduce several types of bias in the data that are difficult to oversee when reading the discussion.
We hope that our responses have addressed the concerns of the reviewer. We have also added the following text to the discussion to make it clearer that these are the views of the group we recruited: ‘Our participants were able to provide multiple patient and clinician perspectives on research priorities for chronic migraine. However, it is possible another group might have identified different priorities.’
Views
0
How to cite this report:
Chowdhury D. Reviewer Report For: Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.14706.r31879) The direct URL for this report is:
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31879
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31879
NOTE: it is important to ensure the information in square brackets after the title is included in this citation.
Reviewer Report 10 Jun 2024
Approved with Reservations
VIEWS 0
I have reviewed the original research article by Rees et al on “research priorities for randomised control trials in chronic migraine prevention medication is stakeholder consensus workshop”
This workshop was undertaken with patient and healthcare professional ... Continue reading I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. Close
This workshop was undertaken with patient and healthcare professional ... Continue reading
I have reviewed the original research article by Rees et al on “research priorities for randomised control trials in chronic migraine prevention medication is stakeholder consensus workshop”
This workshop was undertaken with patient and healthcare professional stakeholders using the nominal group technique. The paper is based on the consensus recommendations for research on randomized controlled trials for chronic migraine prevention.
The manuscript is well-written and highlights the pertinent points. I have the following observations and queries:
This workshop was undertaken with patient and healthcare professional stakeholders using the nominal group technique. The paper is based on the consensus recommendations for research on randomized controlled trials for chronic migraine prevention.
The manuscript is well-written and highlights the pertinent points. I have the following observations and queries:
- It appears that for approaching the healthcare professionals, personal networks were used. How was it done? randomly or as a convenience sampling?
- How was the sampling number decided?
- Out of 147 expressions of interest in the participants group ,19 people were sampled based on a number of considerations. How was this sampling done?
- Whether this 19 participants were on any preventive medications and how were they responding to them? This is important to know because this might have influenced their voting choices depending on the clinical response they were getting from a particular preventive.
- I find it a little intriguing that greater occipital nerve blocks have not been included in the list. There is emerging evidence of its efficacy in chronic migraine patients ( few RCTs are available) and also in combination with oral medications such as topiramate. This is a cheap treatment, easily accessible, and easy to administer. Hence I think this needs to be explored further.
- The authors may also add a few lines regarding the ethical dilemma of testing the suggested drugs against a placebo as currently there is reasonable evidence to support the use of Botulinum toxin -A and CGRP mabs in chronic migraine patients. How can these patients be deprived of these drugs and given a placebo for such a disabling disease? Hence, instead of placebo-controlled trials, non-inferiority design trials would probably be best. Although I agree that the robust evidence comes through a placebo-controlled trial, the ethical dilemma remains.
-
Is the work clearly and accurately presented and does it cite the current literature?
Yes
-
Is the study design appropriate and is the work technically sound?
Yes
-
Are sufficient details of methods and analysis provided to allow replication by others?
Partly
-
If applicable, is the statistical analysis and its interpretation appropriate?
Not applicable
-
Are all the source data underlying the results available to ensure full reproducibility?
No source data required
-
Are the conclusions drawn adequately supported by the results?
Yes
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Headache medicine, migraine , trigeminal autonomic cephalalgias
CITE
HOW TO CITE THIS REPORT Chowdhury D. Reviewer Report For: Research priorities for randomised controlled trials in chronic migraine preventive medication: A stakeholder consensus workshop [version 2; peer review: 1 approved, 3 approved with reservations]. NIHR Open Res 2025, 4:16 (https://doi.org/10.3310/nihropenres.14706.r31879)
The direct URL for this report is:
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31879
https://openresearch.nihr.ac.uk/articles/4-16/v1#referee-response-31879
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
- Author Response 15 Apr 2025Sophie Rees, Bristol Trials Centre, Bristol University, Bristol, BS8 1NU, UK15 Apr 2025Author ResponseI have reviewed the original research article by Rees et al on “research priorities for randomised control trials in chronic migraine prevention medication is stakeholder consensus workshop”
This workshop was ... Continue reading I have reviewed the original research article by Rees et al on “research priorities for randomised control trials in chronic migraine prevention medication is stakeholder consensus workshop”
This workshop was undertaken with patient and healthcare professional stakeholders using the nominal group technique. The paper is based on the consensus recommendations for research on randomized controlled trials for chronic migraine prevention. The manuscript is well-written and highlights the pertinent points. I have the following observations and queries:
It appears that for approaching the healthcare professionals, personal networks were used. How was it done? randomly or as a convenience sampling?
We used purposive sampling to ensure a mix of clinical roles and experience. Everyone who responded expressing an interest was invited to the workshop.
How was the sampling number decided?
The target sample size (10 health professionals and 15 people with migraine) was determined using our previous experience of running similar workshops and the practicalities of including a range of voices but also allowing everyone a chance to contribute. We have added this rationale to the paper.
Out of 147 expressions of interest in the participants group ,19 people were sampled based on a number of considerations. How was this sampling done?
Purposive sampling was used based on their responses to the expression of interest. We aimed for maximum variation in terms of age, ethnicity, and years lived with chronic migraine. This is included in the paper under the ‘participants’ section.
Whether this 19 participants were on any preventive medications and how were they responding to them? This is important to know because this might have influenced their voting choices depending on the clinical response they were getting from a particular preventive.
We did not ask participants to state this information about themselves. Our view is that it would have been inappropriate for a consensus exercise of this nature to ask participants for detailed clinical information of this nature.
I find it a little intriguing that greater occipital nerve blocks have not been included in the list. There is emerging evidence of its efficacy in chronic migraine patients ( few RCTs are available) and also in combination with oral medications such as topiramate. This is a cheap treatment, easily accessible, and easy to administer. Hence I think this needs to be explored further.
This exercise was specifically designed to consider preventive medications rather than interventional procedures. We included Botox as a medication as it fits into same part of the care pathway as other preventive medications.
The authors may also add a few lines regarding the ethical dilemma of testing the suggested drugs against a placebo as currently there is reasonable evidence to support the use of Botulinum toxin -A and CGRP mabs in chronic migraine patients. How can these patients be deprived of these drugs and given a placebo for such a disabling disease? Hence, instead of placebo-controlled trials, non-inferiority design trials would probably be best. Although I agree that the robust evidence comes through a placebo-controlled trial, the ethical dilemma remains.
We presented our participants with the known data for effectiveness of medications. They discussed whether head-to-head, or placebo-controlled trials were appropriate. We are reporting on their recommendations. Discussing the ethical issues of placebo-controlled trials and the role, if any, of non-inferiority studies in this area is beyond the scope of this paper. Our view is that this would need a fresh piece of empirical work to assess acceptability. Although of course the objective evidence on acceptability would come from testing recruitment to placebo-controlled trials.I have reviewed the original research article by Rees et al on “research priorities for randomised control trials in chronic migraine prevention medication is stakeholder consensus workshop”Competing Interests: No competing interests were disclosed. Close
This workshop was undertaken with patient and healthcare professional stakeholders using the nominal group technique. The paper is based on the consensus recommendations for research on randomized controlled trials for chronic migraine prevention. The manuscript is well-written and highlights the pertinent points. I have the following observations and queries:
It appears that for approaching the healthcare professionals, personal networks were used. How was it done? randomly or as a convenience sampling?
We used purposive sampling to ensure a mix of clinical roles and experience. Everyone who responded expressing an interest was invited to the workshop.
How was the sampling number decided?
The target sample size (10 health professionals and 15 people with migraine) was determined using our previous experience of running similar workshops and the practicalities of including a range of voices but also allowing everyone a chance to contribute. We have added this rationale to the paper.
Out of 147 expressions of interest in the participants group ,19 people were sampled based on a number of considerations. How was this sampling done?
Purposive sampling was used based on their responses to the expression of interest. We aimed for maximum variation in terms of age, ethnicity, and years lived with chronic migraine. This is included in the paper under the ‘participants’ section.
Whether this 19 participants were on any preventive medications and how were they responding to them? This is important to know because this might have influenced their voting choices depending on the clinical response they were getting from a particular preventive.
We did not ask participants to state this information about themselves. Our view is that it would have been inappropriate for a consensus exercise of this nature to ask participants for detailed clinical information of this nature.
I find it a little intriguing that greater occipital nerve blocks have not been included in the list. There is emerging evidence of its efficacy in chronic migraine patients ( few RCTs are available) and also in combination with oral medications such as topiramate. This is a cheap treatment, easily accessible, and easy to administer. Hence I think this needs to be explored further.
This exercise was specifically designed to consider preventive medications rather than interventional procedures. We included Botox as a medication as it fits into same part of the care pathway as other preventive medications.
The authors may also add a few lines regarding the ethical dilemma of testing the suggested drugs against a placebo as currently there is reasonable evidence to support the use of Botulinum toxin -A and CGRP mabs in chronic migraine patients. How can these patients be deprived of these drugs and given a placebo for such a disabling disease? Hence, instead of placebo-controlled trials, non-inferiority design trials would probably be best. Although I agree that the robust evidence comes through a placebo-controlled trial, the ethical dilemma remains.
We presented our participants with the known data for effectiveness of medications. They discussed whether head-to-head, or placebo-controlled trials were appropriate. We are reporting on their recommendations. Discussing the ethical issues of placebo-controlled trials and the role, if any, of non-inferiority studies in this area is beyond the scope of this paper. Our view is that this would need a fresh piece of empirical work to assess acceptability. Although of course the objective evidence on acceptability would come from testing recruitment to placebo-controlled trials.
COMMENTS ON THIS REPORT
- Author Response 15 Apr 2025Sophie Rees, Bristol Trials Centre, Bristol University, Bristol, BS8 1NU, UK15 Apr 2025Author ResponseI have reviewed the original research article by Rees et al on “research priorities for randomised control trials in chronic migraine prevention medication is stakeholder consensus workshop”
This workshop was ... Continue reading I have reviewed the original research article by Rees et al on “research priorities for randomised control trials in chronic migraine prevention medication is stakeholder consensus workshop”
This workshop was undertaken with patient and healthcare professional stakeholders using the nominal group technique. The paper is based on the consensus recommendations for research on randomized controlled trials for chronic migraine prevention. The manuscript is well-written and highlights the pertinent points. I have the following observations and queries:
It appears that for approaching the healthcare professionals, personal networks were used. How was it done? randomly or as a convenience sampling?
We used purposive sampling to ensure a mix of clinical roles and experience. Everyone who responded expressing an interest was invited to the workshop.
How was the sampling number decided?
The target sample size (10 health professionals and 15 people with migraine) was determined using our previous experience of running similar workshops and the practicalities of including a range of voices but also allowing everyone a chance to contribute. We have added this rationale to the paper.
Out of 147 expressions of interest in the participants group ,19 people were sampled based on a number of considerations. How was this sampling done?
Purposive sampling was used based on their responses to the expression of interest. We aimed for maximum variation in terms of age, ethnicity, and years lived with chronic migraine. This is included in the paper under the ‘participants’ section.
Whether this 19 participants were on any preventive medications and how were they responding to them? This is important to know because this might have influenced their voting choices depending on the clinical response they were getting from a particular preventive.
We did not ask participants to state this information about themselves. Our view is that it would have been inappropriate for a consensus exercise of this nature to ask participants for detailed clinical information of this nature.
I find it a little intriguing that greater occipital nerve blocks have not been included in the list. There is emerging evidence of its efficacy in chronic migraine patients ( few RCTs are available) and also in combination with oral medications such as topiramate. This is a cheap treatment, easily accessible, and easy to administer. Hence I think this needs to be explored further.
This exercise was specifically designed to consider preventive medications rather than interventional procedures. We included Botox as a medication as it fits into same part of the care pathway as other preventive medications.
The authors may also add a few lines regarding the ethical dilemma of testing the suggested drugs against a placebo as currently there is reasonable evidence to support the use of Botulinum toxin -A and CGRP mabs in chronic migraine patients. How can these patients be deprived of these drugs and given a placebo for such a disabling disease? Hence, instead of placebo-controlled trials, non-inferiority design trials would probably be best. Although I agree that the robust evidence comes through a placebo-controlled trial, the ethical dilemma remains.
We presented our participants with the known data for effectiveness of medications. They discussed whether head-to-head, or placebo-controlled trials were appropriate. We are reporting on their recommendations. Discussing the ethical issues of placebo-controlled trials and the role, if any, of non-inferiority studies in this area is beyond the scope of this paper. Our view is that this would need a fresh piece of empirical work to assess acceptability. Although of course the objective evidence on acceptability would come from testing recruitment to placebo-controlled trials.I have reviewed the original research article by Rees et al on “research priorities for randomised control trials in chronic migraine prevention medication is stakeholder consensus workshop”Competing Interests: No competing interests were disclosed. Close
This workshop was undertaken with patient and healthcare professional stakeholders using the nominal group technique. The paper is based on the consensus recommendations for research on randomized controlled trials for chronic migraine prevention. The manuscript is well-written and highlights the pertinent points. I have the following observations and queries:
It appears that for approaching the healthcare professionals, personal networks were used. How was it done? randomly or as a convenience sampling?
We used purposive sampling to ensure a mix of clinical roles and experience. Everyone who responded expressing an interest was invited to the workshop.
How was the sampling number decided?
The target sample size (10 health professionals and 15 people with migraine) was determined using our previous experience of running similar workshops and the practicalities of including a range of voices but also allowing everyone a chance to contribute. We have added this rationale to the paper.
Out of 147 expressions of interest in the participants group ,19 people were sampled based on a number of considerations. How was this sampling done?
Purposive sampling was used based on their responses to the expression of interest. We aimed for maximum variation in terms of age, ethnicity, and years lived with chronic migraine. This is included in the paper under the ‘participants’ section.
Whether this 19 participants were on any preventive medications and how were they responding to them? This is important to know because this might have influenced their voting choices depending on the clinical response they were getting from a particular preventive.
We did not ask participants to state this information about themselves. Our view is that it would have been inappropriate for a consensus exercise of this nature to ask participants for detailed clinical information of this nature.
I find it a little intriguing that greater occipital nerve blocks have not been included in the list. There is emerging evidence of its efficacy in chronic migraine patients ( few RCTs are available) and also in combination with oral medications such as topiramate. This is a cheap treatment, easily accessible, and easy to administer. Hence I think this needs to be explored further.
This exercise was specifically designed to consider preventive medications rather than interventional procedures. We included Botox as a medication as it fits into same part of the care pathway as other preventive medications.
The authors may also add a few lines regarding the ethical dilemma of testing the suggested drugs against a placebo as currently there is reasonable evidence to support the use of Botulinum toxin -A and CGRP mabs in chronic migraine patients. How can these patients be deprived of these drugs and given a placebo for such a disabling disease? Hence, instead of placebo-controlled trials, non-inferiority design trials would probably be best. Although I agree that the robust evidence comes through a placebo-controlled trial, the ethical dilemma remains.
We presented our participants with the known data for effectiveness of medications. They discussed whether head-to-head, or placebo-controlled trials were appropriate. We are reporting on their recommendations. Discussing the ethical issues of placebo-controlled trials and the role, if any, of non-inferiority studies in this area is beyond the scope of this paper. Our view is that this would need a fresh piece of empirical work to assess acceptability. Although of course the objective evidence on acceptability would come from testing recruitment to placebo-controlled trials.
Alongside their report, reviewers assign a status to the article:
- Approved
- Approved with reservations
- Not approved
| Invited Reviewers | ||||
|---|---|---|---|---|
| 1 | 2 | 3 | 4 | |
| Version 2 (revision) 15 Apr 25 | read | read | read | |
| Version 1 04 Apr 24 | read | read | read |
Sign up for content alerts
You are now signed up to receive this alert
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Examples of 'Non-Financial Competing Interests'
- Within the past 4 years, you have held joint grants, published or collaborated with any of the authors of the selected paper.
- You have a close personal relationship (e.g. parent, spouse, sibling, or domestic partner) with any of the authors.
- You are a close professional associate of any of the authors (e.g. scientific mentor, recent student).
- You work at the same institute as any of the authors.
- You hope/expect to benefit (e.g. favour or employment) as a result of your submission.
- You are an Editor for the journal in which the article is published.
Examples of 'Financial Competing Interests'
- You expect to receive, or in the past 4 years have received, any of the following from any commercial organisation that may gain financially from your submission: a salary, fees, funding, reimbursements.
- You expect to receive, or in the past 4 years have received, shared grant support or other funding with any of the authors.
- You hold, or are currently applying for, any patents or significant stocks/shares relating to the subject matter of the paper you are commenting on.
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Register with NIHR Open Research
Already registered? Sign in
close
Error
If you are a previous or current NIHR award holder, sign up for information about developments, publishing and publications from NIHR Open Research.
We'll keep you updated on any major new updates to NIHR Open Research
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.
Email us for further assistance.
The email address should be the one you originally registered with F1000.
Email address not valid, please try again
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
Code not correct, please try again
Server error, please try again.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Please wait...