Skip to main content


Stony Brook University

Systematic Reviews: Grey Lit

A guide to conducting systematic reviews.

What is Grey Literature?

In 1997, The Luxembourg Convention on Grey Literature defined it as š“that which is produced on all levels of government, academics, business and industry in print and electronic formats, but which is not controlled by commercial publishers”  (Farace 1998)
š
šSynonyms: Fugitive literature, gray literature


šForms of Grey Lit include: Reports, Conference Abstracts, Dissertations & Theses, Registered Clinical Trials, Interviews, Patents, Newsletters, White Papers, Book Chapters
 

Using the Grey Literature

Advantages

  • Minimizes bias
  • Finds valuable data that would otherwise be missed
  • Increases currency and accuracy,
  • Broadens applicability of review

ššDisadvantages

  • Takes time and effort
  • Difficult to find and access; may have associated costs
  • Indexing  and search interfaces may be poor quality
  • Often isn’t peer-reviewed

Bottom line ⇒ You are not doing a real systematic review if you don't include some gray literature searching.

Why is Grey Lit Important?

š“Publication bias is the term for what occurs whenever the research that appears in the published literature is systematically unrepresentative of the population of completed studies.”  (Rothstein, 2005)
š
šSystematic reviews aim to include ALL high quality studies about the research question. This is difficult to accomplish, but a missed study or studies may affect results and conclusions.
 

As the Cochrane Collaboration reports, studies that report statistically significant 'positive' results are:

  • more likely to be published (publication bias)
  • more likely to be published rapidly (time lag bias)
  • more likely to be published in English (language bias)
  • more likely to be published more than once (multiple publication bias)
  • more likely to be cited by others (citation bias)

šBecause of this, negative studies, equivocal results studies, and non-English studies are less likely to get published, less likely to get into the top journals, and less likely to get cited.

šNot everything gets published in peer-reviewed journals, particularly English peer-reviewed journals.

Rothstein H, Sutton AJ, & Borenstein M. (2005). Publication bias in meta-analysis prevention, assessment and adjustments. Chichester, England; Hoboken, NJ: Wiley.

Dissertations/Theses

Dissertations and Theses aren't always easy to locate but they can be valuable resources. Search options include:

Clinical Trials

Conference Abstracts

There are a number of sources for conference/meeting abstracts.

Many, but not all, literature databases also index these and allow you to include or exclude them from your search.

Additionally, most associations and societies provide access to their conference proceedings on their websites and/or in their primary journal, usually as a supplement issue. Ones relevant to your topic can be searched directly.

Other Sources