ENTtoday
  • Home
  • COVID-19
  • Practice Focus
    • Allergy
    • Facial Plastic/Reconstructive
    • Head and Neck
    • Laryngology
    • Otology/Neurotology
    • Pediatric
    • Rhinology
    • Sleep Medicine
  • Departments
    • Issue Archive
    • TRIO Best Practices
      • Allergy
      • Facial Plastic/Reconstructive
      • Head and Neck
      • Laryngology
      • Otology/Neurotology
      • Pediatric
      • Rhinology
      • Sleep Medicine
    • Career Development
    • Case of the Month
    • Everyday Ethics
    • Health Policy
    • Legal Matters
    • Letter From the Editor
    • Medical Education
    • Online Exclusives
    • Practice Management
    • Resident Focus
    • Rx: Wellness
    • Special Reports
    • Tech Talk
    • Viewpoint
    • What’s Your O.R. Playlist?
  • Literature Reviews
    • Allergy
    • Facial Plastic/Reconstructive
    • Head and Neck
    • Laryngology
    • Otology/Neurotology
    • Pediatric
    • Rhinology
    • Sleep Medicine
  • Events
    • Featured Events
    • TRIO Meetings
  • Contact Us
    • About Us
    • Editorial Board
    • Triological Society
    • Advertising Staff
    • Subscribe
  • Advertise
    • Place an Ad
    • Classifieds
    • Rate Card
  • Search

Study Design Flaws Can Create Result Interpretation Problems

by Amy E. Hamaker • February 7, 2020

  • Tweet
  • Email
Print-Friendly Version

What are the most common pitfalls observed in scientific research derived from national cancer registries, predominantly the Surveillance, Epidemiology, and End Results (SEER) Program and the National Cancer Database (NCDB)?

Bottom line: Pitfalls were identified in two major areas: design and data analysis. These inherent design flaws can raise considerable problems with interpretation.

You Might Also Like

  • Study: Surgery, Radiation Therapy Equally Effective in Treating OPSCC
  • Depth of Invasion Addition to Tumor Guidelines Can Result in a Higher Tumor Stage in More Than 20% of Patients
  • Study Raises Questions about Angioedema Management
  • Oncogene Panel Evaluation for ITNs Result in More Aggressive Surgical Management Techniques
Explore This Issue
February 2020

Comment: This is a timely article that combined a literature review with structured interviews with journal editors to identify common pitfalls in database research in head and neck oncology. The authors identified design, analysis, and statistical shortcomings that were common among database studies submitted for peer review. This article is a valuable read for otolaryngologists who find database research challenging to interpret and sheds light on some of the design and statistical nuances that limit actionable conclusions in this type of research. —Andres Bur, MD

BACKGROUND: National cancer registries allow researchers to analyze large cohorts of populations with malignancies to examine patterns of cancer care delivery and outcomes. This can be valuable in our understanding of cancer epidemiology and biology, and its treatment. The vast amount of data, however, also sets the stage for flawed design, analysis, and statistics. 

STUDY DESIGN: Literature review.

SETTING: PubMed, The National Cancer Institute’s SEER website, and the American College of Surgeons’ NCDB website.

SYNOPSIS: An a priori plan documentation through pre-data analyses is often evidence of a well-thought-out study; without it, false or meaningless associations may arise. To avoid stretching associations, defined hypotheses and appropriate statistical modeling should be established before analyzing data. Pitfalls of study design can occur in selecting patient cohorts (e.g., unbalanced demographics, multiple primaries from the same individual, cases diagnosed only at autopsy), survival analysis (e.g., uncontrolled tumor or treatment factors, treatment imbalance), and bias introduction from tumor biology. There are multiple strategies to address these problems, including stringent, detailed inclusion criteria, matched analysis, propensity score–based weights, Bonferroni correction, and regression adjustment. An additional flaw is not being selective in the pathology groupings for survival analysis. For example, some studies that evaluate head and neck squamous cell carcinoma do not control for the effects of human papillomavirus (HPV) oropharynx cancer. Cases missing key variables needed for analysis should be dropped from the study so the cohort is uniform. Inadequate database capture of chemotherapy, radiation, or multiple treatments can skew treatment outcomes and treatment delay implications.

CITATION: Jones EA, Shuman AG, Egleston BL, et al. Common pitfalls of head and neck research using cancer registries. Otolaryngol Head Neck Surg. 2019;161:245–250.   

Filed Under: Head and Neck, Literature Reviews Tagged With: clinical research, clinical studyIssue: February 2020

You Might Also Like:

  • Study: Surgery, Radiation Therapy Equally Effective in Treating OPSCC
  • Depth of Invasion Addition to Tumor Guidelines Can Result in a Higher Tumor Stage in More Than 20% of Patients
  • Study Raises Questions about Angioedema Management
  • Oncogene Panel Evaluation for ITNs Result in More Aggressive Surgical Management Techniques

The Triological SocietyENTtoday is a publication of The Triological Society.

The Laryngoscope
Ensure you have all the latest research at your fingertips; Subscribe to The Laryngoscope today!

Laryngoscope Investigative Otolaryngology
Open access journal in otolaryngology – head and neck surgery is currently accepting submissions.

Classifieds

View the classified ads »

TRIO Best Practices

View the TRIO Best Practices »

Top Articles for Residents

  • Do Training Programs Give Otolaryngology Residents the Necessary Tools to Do Productive Research?
  • Why More MDs, Medical Residents Are Choosing to Pursue Additional Academic Degrees
  • What Physicians Need to Know about Investing Before Hiring a Financial Advisor
  • Tips to Help You Regain Your Sense of Self
  • Should USMLE Step 1 Change from Numeric Score to Pass/Fail?
  • Popular this Week
  • Most Popular
  • Most Recent
    • The Dramatic Rise in Tongue Tie and Lip Tie Treatment
    • Vertigo in the Elderly: What Does It Mean?
    • Experts Delve into Treatment Options for Laryngopharyngeal Reflux
    • Otolaryngologists Have a Major Role to Play in Treating COVID-19 Long-Haulers
    • Some Laryngopharyngeal Reflux Resists PPI Treatment
    • Vertigo in the Elderly: What Does It Mean?
    • New Developments in the Management of Eustachian Tube Dysfunction
    • Some Laryngopharyngeal Reflux Resists PPI Treatment
    • Eustachian Tuboplasty: A Potential New Option for Chronic Tube Dysfunction and Patulous Disease
    • The Dramatic Rise in Tongue Tie and Lip Tie Treatment
    • Podcasts Becoming More Popular Method of Education for Otolaryngologists
    • How to Embrace Optimism in the Midst of the COVID-19 Pandemic
    • Tips on How to Approach Conversations with Patients about the COVID-19 Vaccine
    • Steps You Should Take to Protect Your Voice and Hearing During Telemedicine Sessions
    • Routine Postoperative Adjunct Treatments Unnecessary for Idiopathic Cerebrospinal Fluid Leaks

Polls

Have you spoken with your patients about receiving the COVID-19 vaccine?

View Results

Loading ... Loading ...
  • Polls Archive
  • Home
  • Contact Us
  • Advertise
  • Privacy Policy
  • Terms of Use

Visit: The Triological Society • The Laryngoscope • Laryngoscope Investigative Otolaryngology

Wiley
© 2021 The Triological Society. All Rights Reserved.
ISSN 1559-4939

loading Cancel
Post was not sent - check your email addresses!
Email check failed, please try again
Sorry, your blog cannot share posts by email.
This site uses cookies: Find out more.