SlideShare a Scribd company logo
www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9	 1
Articles
Multicentre evaluation of multidisciplinary team meeting
agreement on diagnosis in diffuse parenchymal lung disease:
a case-cohort study
Simon L FWalsh, Athol UWells, Sujal R Desai,Venerino Poletti, Sara Piciucchi, Alessandra Dubini, Hilario Nunes, DominiqueValeyre,
PierreY Brillet, Marianne Kambouchner, António Morais, José M Pereira, Conceição Souto Moura, Jan C Grutters, Daniel A van den Heuvel,
HendrikW van Es, Matthijs F van Oosterhout, Cornelis A Seldenrijk, Elisabeth Bendstrup, Finn Rasmussen, Line B Madsen, Bibek Gooptu,
Sabine Pomplun, HiroyukiTaniguchi, Junya Fukuoka,Takeshi Johkoh, Andrew G Nicholson, Charlie Sayer, Lilian Edmunds, Joseph Jacob,
Maria A Kokosi, Jeffrey L Myers, Kevin R Flaherty, David M Hansell
Summary
Background Diffuse parenchymal lung disease represents a diverse and challenging group of pulmonary disorders.
A consistent diagnostic approach to diffuse parenchymal lung disease is crucial if clinical trial data are to be applied
to individual patients. We aimed to evaluate inter-multidisciplinary team agreement for the diagnosis of diffuse
parenchymal lung disease.
Methods We did a multicentre evaluation of clinical data of patients who presented to the interstitial lung disease
unit of the Royal Brompton and Harefield NHS Foundation Trust (London, UK; host institution) and required
multidisciplinary team meeting (MDTM) characterisation between March 1, 2010, and Aug 31, 2010. Only patients
whose baseline clinical, radiological, and, if biopsy was taken, pathological data were undertaken at the host
institution were included. Seven MDTMs, consisting of at least one clinician, radiologist, and pathologist, from
seven countries (Denmark, France, Italy, Japan, Netherlands, Portugal, and the UK) evaluated cases of diffuse
parenchymal lung disease in a two-stage process between Jan 1, and Oct 15, 2015. First, the clinician, radiologist,
and pathologist (if lung biopsy was completed) independently evaluated each case, selected up to five differential
diagnoses from a choice of diffuse lung diseases, and chose likelihoods (censored at 5% and summing to 100% in
each case) for each of their differential diagnoses, without inter-disciplinary consultation. Second, these specialists
convened at an MDTM and reviewed all data, selected up to five differential diagnoses, and chose diagnosis
likelihoods. We compared inter-observer and inter-MDTM agreements on patient first-choice diagnoses using
Cohen’s kappa coefficient (κ). We then estimated inter-observer and inter-MDTM agreement on the probability of
diagnosis using weighted kappa coefficient (κw). We compared inter-observer and inter-MDTM confidence of
patient first-choice diagnosis. Finally, we evaluated the prognostic significance of a first-choice diagnosis of
idiopathic pulmonary fibrosis (IPF) versus not IPF for MDTMs, clinicians, and radiologists, using univariate Cox
regression analysis.
Findings 70 patients were included in the final study cohort. Clinicians, radiologists, pathologists, and the MDTMs
assigned their patient diagnoses between Jan 1, and Oct 15, 2015. IPF made up 88 (18%) of all 490 MDTM first-
choice diagnoses. Inter-MDTM agreement for first-choice diagnoses overall was moderate (κ=0·50). Inter-MDTM
agreement on diagnostic likelihoods was good for IPF (κw=0·71 [IQR 0·64–0·77]) and connective tissue disease-
related interstitial lung disease (κw=0·73 [0·68–0·78]); moderate for non-specific interstitial pneumonia (NSIP;
κw=0·42 [0·37–0·49]); and fair for hypersensitivity pneumonitis (κw=0·29 [0·24–0·40]). High-confidence diagnoses
(>65% likelihood) of IPF were given in 68 (77%) of 88 cases by MDTMs, 62 (65%) of 96 cases by clinicians, and in
57 (66%) of 86 cases by radiologists. Greater prognostic separation was shown for an MDTM diagnosis of IPF than
compared with individual clinician’s diagnosis of this disease in five of seven MDTMs, and radiologist’s diagnosis of
IPF in four of seven MDTMs.
Interpretation Agreement between MDTMs for diagnosis in diffuse lung disease is acceptable and good for a diagnosis
of IPF, as validated by the non-significant greater prognostic separation of an IPF diagnosis made by MDTMs than
the separation of a diagnosis made by individual clinicians or radiologists. Furthermore, MDTMs made the diagnosis
of IPF with higher confidence and more frequently than did clinicians or radiologists. This difference is of particular
importance, because accurate and consistent diagnoses of IPF are needed if clinical outcomes are to be optimised.
Inter-multidisciplinary team agreement for a diagnosis of hypersensitivity pneumonitis is low, highlighting an urgent
need for standardised diagnostic guidelines for this disease.
Funding National Institute of Health Research, Imperial College London.
Lancet Respir Med 2016
Published Online
May 11, 2016
http://dx.doi.org/10.1016/
S2213-2600(16)30033-9
Department of Radiology
(S L FWalsh MD), King’s College
Hospital NHS Foundation
Trust, London, UK
(S R Desai MD); Interstitial Lung
Disease Unit (Prof A UWells MD,
M A Kokosi MD) and
Department of Radiology
(Prof D M Hansell FRSM), Royal
Brompton and Harefield NHS
FoundationTrust, London, UK
(J Jacob FRCR); Department of
Diseases of theThorax
(ProfV Poletti MD) and
Department of Radiology
(S Piciucchi MD), GB Morgagni
Hospital, Forlì, Italy;
Department of Surgical
Pathology, Morgagni
Pierantoni Hospital, Forlì, Italy
(A Dubini MD); Université Paris,
Sorbonne Paris Cité, EA2363
Réponses cellulaires et
fonctionnelles à l’hypoxie,
Bobigny, France
(Prof H Nunes MD,
Prof DValeyre MD,
Prof PY Brillet MD); Assistance
Publique-Hôpitaux de Paris,
Service de Pneumologie
(Prof H Nunes, Prof DValeyre),
Service de Radiologie
(Prof PY Brillet), and Service
d’Anatomie Pathologique
(M Kambouchner MD), Hôpital
Avicenne, Bobigny, France;
Serviço de Pneumologia
(Prof A Morais MD) and
Pathology Department
(C Souto Moura MD), Centro
Hospitalar São João, Porto,
Portugal (J M Pereira MD);
Faculdade de Medicina,
Universidade do Porto, Porto,
Portugal (Prof A Morais);
ILD Center of Excellence
St Antonius Hospital, Division
Heart and Lungs, University,
16TLRM0035
This version saved: 12:32, 10-May-16
THELANCETRM-D-16-00035R3
S2213-2600(16)30033-9
Embargo: May 11, 2016—23:30 (BST)
Funded by NIHR, Green OA to be made free from November 11, 2016 [23:30] BST
FT
Articles
2	 www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9
Introduction
Diffuse parenchymal lung disease represents a diverse
and challenging group of pulmonary disorders with
varied prognoses and different management options.
A consistent diagnostic approach to these diseases is
essential if clinical trial data are to be reliably applied to
individual patients. With the 2014 licensing of two new
antifibrotic idiopathic pulmonary fibrosis (IPF) drugs
(pirfenidone1
and nintedanib2
), accurate and consistent
diagnosis of IPF is of particular importance to achieve
clinical benefits for patients. In 2002, a joint statement by
the American Thoracic Society (ATS) and the European
Respiratory Society (ERS) on the classification of
idiopathic interstitial pneumonias advocated a multi­
disciplinary diagnostic approach, involving integration of
clinical, radiological, and, in cases for which lung biopsy
material is available, pathological data.3
This approach
has been emphasised by several studies4–7
in the past
12 years and was restated in the 2013 ATS/ERS update8
on
idiopathic interstitial pneumonia classification. Although
this recommendation specifically applies to idiopathic
interstitial pneumonia, a multidisciplinary approach has
been widely used as the diagnostic gold standard for
diffuse parenchymal lung disease in general.4,6
Several
studies4–6,9
have evaluated inter-observer agreement for
diagnosis in the setting of diffuse parenchymal lung
disease. However, most of these studies pre-date the
2013 ATS/ERS update,8
the 2011 joint ATS/ERS/Japanese
Respiratory Society/Latin American Thoracic Association
statement10
on the diagnosis and management of IPF,
and the availability of novel antifibrotic IPF drugs
(pirfenidone1
and nintedanib2
), all of which might affect
diagnostic decisions. Furthermore, many of these studies
focused on individual observers rather than agreement
between multidisciplinary teams.4–6,9,11
In this study, we
aimed to evaluate the level of inter-multidisciplinary team
diagnostic agreement between seven international
centres for diagnosis of diffuse parenchymal lung disease.
Methods
Study design, patients, and multidisciplinary team
selection
For this case-cohort study we selected consecutive
patients who presented to the interstitial lung disease
unit of the Royal Brompton and Harefield NHS
Foundation Trust (London, UK; host institution) and
patients with challenging diagnosis had MDTM
characterisation, between March 1, 2010, and
Aug 31, 2010. Only patients who had all their clinical
investigations (serology, high-resolution CT, and, when
required, surgical lung biopsy) completed at the host
institution were included. Seven multi­disciplinary
teams from seven different countries (Denmark,
France, Italy, Japan, Netherlands, Portugal, and the
UK), each with specialist expertise in the diagnosis and
management of diffuse parenchymal lung disease,
were invited and agreed to participate in the study. The
only prerequisite for participation in the study was that
each multidisciplinary team had to have a regular
multidisciplinary meeting (about once a week) for
Research in context
Evidence before this study
We searched PubMed on Jan 17, 2014, using the search terms
“diffuse parenchymal lung disease”, “idiopathic pulmonary
fibrosis”, “idiopathic interstitial pneumonias”, “interobserver
agreement”, “diagnosis”, and “multidisciplinary team” for
articles written in English and published between Jan 1, 2000,
and Jan 1, 2014.We extended our search to include studies
published up to Dec 1, 2015, during the writing of the
manuscript.We identified seven key publications that were
pertinent to our study. Of these, we identified four studies of
observer agreement in the setting of diffuse parenchymal lung
disease. All of these seven studies, however, pre-dated the
latest AmericanThoracic Society and the European Respiratory
Society (ATS/ERS) update for the classification of idiopathic
interstitial pneumonias, and not all studies had evaluated
diagnostic agreement between multidisciplinary teams, but
rather focused on diagnostic agreement between individual
observers.
Added value of this study
Our study is the first evaluation, to our knowledge, of inter-
multidisciplinary team agreement for diagnosis in the setting
of diffuse parenchymal lung disease since the updated
2013 ATS/ERS classification of idiopathic interstitial
pneumonias and the 2011 ATS/ERS/Japanese Respiratory
Society/Latin AmericanThoracic Association guidelines for the
diagnosis and management of idiopathic pulmonary fibrosis.
Our study shows that diagnostic agreement between MDTMs is
non-significant compared with inter-observer agreement
between clinicians, radiologists, and pathologists in the setting
of diffuse parenchymal lung disease. Specifically in idiopathic
pulmonary fibrosis, MDTMs have a higher level of agreement
on diagnoses, assign diagnoses with higher confidence more
frequently, and provide diagnoses that have non-significant
greater prognostic separation than do clinicians or radiologists
in most cases.
Implications of all the available evidence
The differences in diagnostic certainty between MDTMs and
individual clinicians is of particular importance, because
accurate and consistent diagnoses of idiopathic pulmonary
fibrosis are needed if clinical outcomes are to be optimised. By
contrast, inter-multidisciplinary team agreement for a
diagnosis of hypersensitivity pneumonitis is low, highlighting
an urgent need for standardised diagnostic guidelines for
this disease.
Medical Centre Utrecht,
Netherlands
(Prof J C Grutters MD);
Department of Radiology
(D A van den Heuvel MD,
HW van Es MD) and
Department of Pathology
(M F van Oosterhout MD,
C A Seldenrijk MD), St Antonius
Hospital, Nieuwegein,
Netherlands; Department of
Respiratory Diseases and
Allergy (E Bendstrup PhD) and
Department of Radiology
(F Rasmussen MD) and
Department of Pathology
(L B Madsen PhD), Aarhus
University Hospital, Aarhus,
Denmark; Division of Asthma,
Allergy and Lung Biology,
King’s College London, London,
UK (B Gooptu PhD);
Department of Cellular
Pathology, University College
Hospital London, London, UK
(S Pomplun FRCPath);
Department of Respiratory
Medicine and Allergy,Tosei
General Hospital, Aichi, Japan
(HTaniguchi MD); Department
of Pathology, Nagasaki
University Graduate School of
Biomedical Sciences, Nagasaki,
Japan (Prof J Fukuoka MD);
Department of Radiology,
Kinki Central Hospital of
Mutual Aid Association of
Public SchoolTeachers, Itami,
Japan (T Johkoh MD); National
Heart and Lung Institute,
Imperial College London,
London, UK
(Prof A G Nicholson DM,
L Edmunds FRCPath); Brighton
and Sussex University
HospitalsTrust, Brighton, UK
(C Sayer FRCR); and Department
of Pathology (Prof J L Myers MD)
and Department of Internal
Medicine, Division of
Pulmonary and Critical Care
Medicine (Prof K R Flaherty MD),
University of Michigan, Ann
Arbor, MI, USA
Correspondence to:
Dr Simon L FWalsh, Department
of Radiology, King’s College
Hospital NHS FoundationTrust,
London SE5 9RS, UK
slfwalsh@gmail.com
Articles
www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9	 3
See Online for appendix
diffuse parenchymal lung disease in place with
consistent attendance by at least one clinician,
radiologist, and pathologist. For the retrospective
examination of clinically indicated data, the institutional
ethics review board of Royal Brompton and Harefield
NHS Foundation Trust waived the need for informed
patient consent.
Evaluation of cases
The evaluation of every case took place in two stages
between Jan 1, and Oct 15, 2015. At first, clinicians,
radiologists, and pathologists had to review the cases
independently without interspecialty consultation.
Clinicians had access to all the presenting clinical
information (age, sex, smoking history, history of
established connective tissue disease, symptoms
[including those suggestive of connective tissue disease],
autoantibody profile, exposure history, drugs at
presentation, bronchoalveolar lavage result [if done],
and angiotensin converting enzyme concentration [if
assessed]), pulmonary function tests, and high-resolution
CT (no access to the original high-resolution CT report or
the pathology result). Radiologists and pathologists had
access to only the age, sex, and smoking history for the
patient, and the high-resolution CT (radiologist) or
digitalised surgical lung biopsy slides (pathologist) taken
at presentation. Pathologists had access to all pathology
data that were available in the form of digitalised slides
(in .svs format), which were viewed using Aperio
ImageScope (version 12.3) viewing software. This digital
viewing application has all the imaging functionality
normally available to pathologists in routine clinical
practice and the host institution uses it to evaluate cases
referred from outside institutions for additional opinions.
For each patient, observers (clinicians, radiologists,
and pathologists) had to select up to five differential
diagnoses and provide a diagnostic likelihood (censored
at 5% increments and summing to 100% in each case)
from a drop-down menu of diffuse lung diseases
(appendix). The only stipulation was that diagnoses were
considered in the context of the current 2013 version of
the ATS/ERS classification and terminology for idiopathic
interstitial pneumonias.8
Once the cases had been reviewed independently, the
clinician, radiologist, and pathologist convened as a
multidisciplinary team to review the cases together and
provide up to five diagnoses with diagnostic likelihoods
(also censored at 5% increments and summing to
100% in each case). All clinical information supplied in
the first stage, including pulmonary function tests,
high-resolution CT at presentation and digitalised
surgical lung biopsy slides were available to the
multidisciplinary team.
In this study we aimed to evaluate inter-
multidisciplinary team agreement for the diagnosis of
diffuse parenchymal lung disease. To validate the
diagnosis made by the MDTMs at the seven centres
versus individual specialists, we compared the mortality
of each team’s diagnosis of IPF. We compared diagnoses
by separating the entire cohort into a binary IPF diagnosis
category (IPF [if first-choice diagnosis for a patient is
IPF] and not [if first-choice diagnosis is of another cause])
for each MDTM, clinician, and radiologist, based on
assigned diagnoses. Pathologist diagnoses are not shown
due to small number of cases (appendix). We calculated
the survival period for each patient from the date of
referral to the host institution to the minimum of date of
death, date the patient was last known to be alive, or
June 1, 2015 (end of the study period). We obtained vital
status for every patient on June 1, 2015, by evaluating
their electronic patient record.
Statistical analysis
We used Cohen’s kappa coefficient (κ) to evaluate
inter-observer and inter-MDTM agreement for patient’s
first-diagnosis. We used Cohen’s weighted-kappa
coefficient (κw) to evaluate inter-observer agreement and
inter-MDTM agreement for an estimation of the probability
of each diagnosis. We converted the percentage diagnostic
likelihood given for each diagnosis to a five point scale
(0–4), representing clinically useful probabilities (0 for
condition not included in the differential diagnosis; 1 for
low probability [5–25%]; 2 for intermediate probability
[30–65%]; 3 for high probability [70–95%]; and 4 for
pathognomonic [100%]). For example, if the differential
diagnoses given by an MDTM were IPF
(65% diagnostic likelihood), non-specific interstitial
pneumonia (NSIP; 25% diagnostic likelihood), and
hypersensitivity pneumonitis (10% diagnostic likelihood),
the probability grades would be 2 for IPF, 1 for NSIP, and 1
for hypersensitivity pneumonitis. We calculated weighted-
kappa coefficient values between paired observers (for
statements of inter-observer agreement), and between
paired multidisciplinary teams (for statements of inter-
MDTM agreement), which were expressed as median
(IQR) values for all unique combinations of pairs (21 for
seven observers or seven multidisciplinary teams).
Weighting of the kappa coefficient allowed us to quantify
the extent of disagreement, by assigning greater emphasis
to large differences between scores. Weighted-kappa
coefficients were categorised as poor (0<κw≤0·20), fair
(0·20<κw≤0·40), moderate (0·40<κw≤0·60), good
(0·60<κw≤0·80), and excellent (0·80<κw≤1·00). This
approach has been used in previous investigations9,11
of
inter-observer agreement for diagnosis in diffuse lung
diseases.
Additionally, for each patient the first-choice diagnosis
was considered low confidence (diagnostic likelihood
<70%) or high confidence (diagnostic likelihood ≥70%).
These categories were based on the diagnostic likelihood
categories used to assess the clinical probability of
pulmonary embolism in the PIOPED study.12
We used univariate Cox regression analysis to identify
associations between mortality and MDTM, clinician,
Articles
4	 www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9
and radiologist diagnoses in terms of IPF versus not IPF.
Reported hazard ratios (HRs) are for diagnosis of IPF
versus not IPF. We tested the assumptions of proportional
hazards by visual inspection of the log–log plot of
survival, comparison of the Kaplan-Meier observed
survival curves with the Cox predicted curves for the
same variable, and graphical and formal analysis of
Schoenfeld residuals (analysis not shown). Results are
reported as HRs, 95% CIs, and p values, and are
graphically shown as Kaplan-Meier survival curves. We
completed statistical analyses using Stata (version 12;
StataCorp, College Station, Texas).
Role of the funding source
The funders of the study had no role in study design,
data collection, data analysis, data interpretation, or
writing of the report. The corresponding author had full
access to all of the data in the study and had final
responsibility for the decision to submit for publication.
Results
We identified 113 consecutive new patient referrals, who
required local MDTM characterisation, from the clinical
database of the host institute between March 1, 2010, and
Aug 31, 2010. We excluded 43 (38%) of 113 referrals on the
basis that their initial work-up high-resolution CT scan
(29 patients), lung function (four patients), or surgical
lung biopsy (ten patients) were completed by the referring
institution (appendix). The remaining 70 (62%) of
113 patient referrals were included as the final study
cohort. Basic patient demographics are in table 1. 13 (19%)
of 70 patients had an established diagnosis of a connective
tissue disease (seven patients had systemic sclerosis,
three had rheumatoid arthritis, two had Sjögren’s
syndrome, and one had mixed connective tissue disease)
at the time of presentation to the host institution, and
22 (31%) of 70 cases underwent surgical lung biopsy at the
host institution (table 1). In patients in whom a surgical
lung biopsy was not done (table 1), a confident diagnosis
had been made by the host institution without the need
for a surgical lung biopsy sample. Vital status was known
for all patients at the end of the study period (June 1, 2015).
70 patients resulted in the assignment of 490 first-
choice MDTM diagnoses (70 patients evaluated by
seven MDTMs). First-choice diagnoses are shown in
table 2. The NSIP and organising pneumonia overlap with
interstitial lung disease category was combined with the
NSIP category. The four most prevalent first-choice
diagnoses (connective tissue disease-related interstitial
lung disease, IPF, hypersensitivity pneumonitis, and
NSIP) were the focus of subsequent analyses. The
remaining diagnosis categories whose frequency was less
than 10% of the total number of first-choice diagnoses
(other, sarcoidosis, drug-related interstitial lung
disease, occupational lung disease, pleuroparenchymal
fibroelastosis, and organising pneumonia) were combined
into an others diagnosis category. The final diagnosis
categories were connective tissue disease-related
interstitial lung disease, IPF, idiopathic NSIP,
hypersensitivity pneumonitis, and others.
Inter-observer agreement (between clinicians,
radiologists, and pathologists) and inter-MDTM
agreement for first-choice diagnosis are listed in table 3.
Overall inter-MDTM agreement for first-choice diagnosis
in patients was moderate (table 3). Inter-MDTM
agreement for a first-choice diagnosis of IPF or of
connective tissue disease-related interstitial lung disease
was good, but for a first-choice diagnosis of idiopathic
NSIP or hypersensitivity pneumonitis was fair (table 3).
In the subgroup analysis of patients in whom a surgical
Patients (n=70)
Age (years) 60·9 (15·5)
Sex
Men 24 (34%)
Women 46 (66%)
Smoking
Never 38 (54%)
Previously smoked 24 (34%)
Current 8 (11%)
Established connective tissue disease history 13 (19%)
Biopsy taken
Yes 22 (31%)
No 48 (69%)
DLco (% predicted) 44·8 (14·5%)
FEV1 (% predicted) 73·0 (20·5%)
FVC (% predicted) 79·0 (19·6%)
Where appropriate, data are mean (SD) and n (%). DLco=diffusing capacity of the
lungs for carbon monoxide. FEV1=forced expiratory volume in 1 s. FVC=forced
vital capacity.
Table 1: Patient demographics and characteristics
Number of first-choice
diagnoses (n=490)
Connective tissue disease-related interstitial
lung disease
146 (30%)
Idiopathic pulmonary fibrosis 88 (18%)
Hypersensitivity pneumonitis 46 (9%)
Idiopathic non-specific interstitial pneumonia 42 (9%)
Unclassifiable interstitial lung disease 38 (8%)
Other 37 (8%)
Sarcoidosis 20 (4%)
Drug-related interstitial lung disease 18 (4%)
Smoking-related interstitial lung disease 16 (3%)
Occupational lung disease 14 (3%)
Pleuroparenchymal fibroelastosis 10 (2%)
Organising pneumoniaor non-specific
interstitial pneumoniaoverlappingdisease
8 (2%)
Organising pneumonia 7 (1%)
Table 2: First-choice diagnoses given by seven multidisciplinary teams
for 70 cases of diffuse lung disease
Articles
www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9	 5
lung biopsy was not done (table 1), overall inter-MDTM
agreement for diagnosis was moderate (table 3).
Inter-MDTM agreement for first-choice diagnoses of IPF,
connective tissue disease-related interstitial lung disease,
and hypersensitivity pneumonitis in these patients were
all greater than the first-choice diagnoses of all patients
(table 3).
Inter-MDTM agreement on the diagnostic likelihood of
IPF and connective tissue disease-related interstitial lung
disease was good, but moderate for idiopathic NSIP, and
fair for hypersensitivity pneumonitis diagnoses (table 4).
Subgroup analysis of inter-MDTM agreement on the
estimation of diagnostic likelihood of IPF in patients
without lung biopsy was good (κw=0·78, IQR 0·74–0·83).
Overall inter-observer agreement between clinicians
for first-choice diagnosis was moderate and was fair
between radiologists and between pathologists (table 3).
Agreement between clinicians on the probability of a
diagnosis of IPF or connective tissue disease-related
interstitial lung disease was higher than agreement on
the probability of a diagnosis of idiopathic NSIP or
hypersensitivity pneumonitis (table 4). Agreement
between radiologists or pathologists was highest for the
probability of a diagnosis of IPF compared with
agreement on the probability of a diagnosis of connective
tissue disease-related interstitial lung disease, idiopathic
NSIP, or hypersensitivity pneumonitis (table 4).
At the time of patient selection, 13 (19%) of 70 patients
had an established diagnosis of a connective tissue
disease, meaning any diagnosis of interstitial lung
disease in these cases would most likely be classified as
connective tissue disease-related interstitial lung disease.
To investigate whether in these 13 cases there was high
agreement for this diagnosis resulted in an increase in
agreement on non-connective tissue disease diagnoses
and, particularly, affected agreement on a diagnosis of
IPF, we did a post-hoc subgroup analysis in the 57 (81%)
of 70 cases who did not have an established diagnosis of
connective tissue disease. In this analysis, although
inter-MDTM agreement for a first-choice diagnosis of
connective tissue disease-related interstitial lung disease
decreased (from κ=0·57 to κ=0·42), no significant change
was observed in inter-MDTM agreement for a first-
choice diagnosis of IPF (κ=0·58), idiopathic NSIP
(κ=0·24), or hypersensitivity pneumonitis (κ=0·23;
appendix).
347 (70%) of 490 first-choice multidisciplinary team
diagnoses were made with high confidence (appendix).
Median prevalence of first-choice multidisciplinary team
diagnoses made with high confidence was 67·1%
(IQR 54·3–88·8). Median prevalence of first-choice
diagnoses made with high confidence was 58·9%
(IQR 52·9–71·4) by clinicians, 68·6% (35·7–85·7) by
radiologists, and 72·7% (59·1–81·8) by pathologists
(appendix). In the subgroup analysis of the 48 (69%) of
70 patients who did not undergo a surgical lung biopsy,
237 (71%) of 336 first-choice multidisciplinary team
diagnoses were made with high confidence. In this
subgroup, median prevalence of first-choice diagnoses
made with high confidence were 60·4% (37·5–75·0) by
clinicians, 66·6% (39·6–83·3) by radiologists, and 68·7%
(IQR 52·8–87·5) by the multidisciplinary teams.
For the diagnosis of IPF, supportive non-significant
increases in diagnostic confidence by MDTMs (68 [77%]
of 88) were shown, compared with clinicians (62 [65%] of
96) or radiologists (57 [66%] of 86; p=0·23). In the
22 (31%) of 70 cases that underwent surgical lung biopsy
(therefore a total of 154 diagnoses by seven pathologists),
15 (10%) of 154 cases were assigned a first-choice
diagnosis of IPF, of which 12 (8%) were assigned with
high confidence.
We reviewed the 15 cases who the pathologists gave a
first-choice diagnosis of IPF to ascertain whether in
patients who had had a surgical lung biopsy, the final
MDTM diagnosis was usually IPF. In six of 15 cases,
despite the pathologist giving a first-choice diagnosis of
IPF, the final MDTM first-choice diagnosis was not IPF.
Furthermore, in only two of 15 cases was IPF not already
suggested by either the clinician or radiologist in the
MDTM (appendix).
Clinicians (κ) Radiologists (κ) Pathologists (κ) MDTM (κ)
Total
(n=70)
No
biopsy
(n=48)
Total
(n=70)
No
biopsy
(n=48)
Total
(n=70)
No
biopsy
(n=48)
Total
(n=70)
No
biopsy
(n=48)
Overall total 0·45 0·50 0·33 0·31 0·31 ¨ 0·50 0·57
Idiopathic pulmonary
fibrosis total
0·59 0·71 0·46 0·42 0·46 ¨ 0·60 0·70
Non-specific interstitial
pneumonia total
0·19 0·19 0·25 0·25 0·23 ¨ 0·25 0·25
Connective tissue
disease-related interstitial
lung disease total
0·57 0·62 0·10 0·11 0·22 ¨ 0·64 0·73
Hypersensitivity
pneumonitis total
0·25 0·38 0·27 0·22 0·20 ¨ 0·24 0·31
MDTM=multidisciplinary team meeting.
Table 3: Unweighted kappa values (κ) for clinicians, radiologists, pathologists, and inter-
multidisciplinary team meeting agreement on individual diagnoses of diffuse parenchymal lung disease
Clinicians (κw) Radiologists (κw) Pathologists (κw) MDTM (κw)
Idiopathic pulmonary
fibrosis
0·72 (0·67–0·76) 0·60 (0·46–0·66) 0·58 (0·45–0·66) 0·71 (0·64–0·77)
Connective tissue
disease-related
interstitial lung disease
0·76 (0·70–0·78) 0·17 (0·08–0·31) 0·21 (0·06–0·36) 0·73 (0·68–0·78)
Non-specific interstitial
pneumonia
0·31 (0·27–0·41) 0·32 (0·26–0·41) 0·30 (0·00–0·53) 0·42 (0·37–0·49)
Hypersensitivity
pneumonitis
0·42 (0·30–0·47) 0·35 (0·29–0·43) 0·26 (0·10–0·45) 0·29 (0·24–0·40)
Data are median (IQR). MDTM=multidisciplinary team meeting.
Table 4:Weighted kappa values (κw) for estimation of diagnostic likelihood for individual diagnoses of
diffuse parenchymal lung disease
Articles
6	 www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9
In the univariate Cox regression analysis, the
multidisciplinary distinction between IPF and other
diagnoses (not IPF) had non-significant increases
toward greater prognostic separation (as judged by HR
p values; all seven MDTMs had a significant
separation) than the clinician distinction (in
five of seven teams) or the radiologist distinction (in
four of seven teams; table 5). The figure shows the
Kaplan-Meier survival curves for the categorisation of
first-choice diagnosis as IPF or not IPF in cases (by at
least four of seven MDTMs, four of seven clinicians,
and four of seven radiologists). The same analysis for
pathologists’ diagnosis of IPF was not significant for
five of seven pathologists, probably because of the
small subgroup size (22 patients) and low prevalence
of IPF in this subgroup (in 15 of 154 diagnoses
pathologists’ first-choice diagnoses were IPF;
appendix).
Discussion
We have shown that an acceptable level (based on κ>0·40
is deemed clinically acceptable) of diagnostic agreement
exists between multidisciplinary teams in the setting of
diffuse parenchymal lung disease. Additionally, we
showed that this agreement was validated by the non-
significant increases towards greater prognostic
separation of an IPF diagnosis made by multidisciplinary
teams than by individual clinicians or radiologists.
Furthermore, MDTMs make the diagnosis of IPF with
high confidence more frequently than do clinicians or
radiologists.
Since the publication of the ATS/ERS 2002 consensus
statement on the classification of idiopathic interstitial
pneumonias, multidisciplinary evaluation of diffuse
parenchymal lung disease has been widely used as the
diagnostic gold standard.3,8
This diagnostic approach has
been partly investigated in several settings. Flaherty and
colleagues4
examined the formulation of diagnosis in a
cohort of diffuse parenchymal lung diseases against
inter-observer agreement and diagnostic confidence in
one multidisciplinary team (consisting of three clinicians,
two radiologists, and two pathologists) and showed that
diagnostic agreement between observers improved with
successive integration of clinical, radiological, and
pathological data. In a second study,6
Flaherty and
colleagues expanded on these findings by showing
higher levels of agreement between academic physicians,
radiologists, and pathologists for diagnosis in diffuse
lung disease than with their community counterparts.
Later in 2008, Thomeer and colleagues5
reported in
a cohort of patients included in an IPF trial, a high
accuracy for a clinical diagnosis of this disease made
by six respiratory physicians from different European
centres. A limitation of these studies is that
not all evaluated the agreement between different
multidisciplinary teams for diagnoses,4
one focused
specifically on the diagnosis of IPF5
and all studies pre-
date the latest 2013 ATS/ERS idiopathic interstitial
pneumonia update.4–6,8,9
To our knowledge this study is
the first to evaluate inter-MDTM agreement for diagnosis
in diffuse lung disease since the 2013 ATS/ERS update
on the classification of idiopathic interstitial pneumonias.
With the 2014 licensing of two new drugs1,2
for
treatment of IPF in mild to moderate disease, early and
accurate diagnosis of IPF is crucial. Our study showed
that inter-MDTM agreement for the diagnosis of IPF is
good, with clinicians having only marginally lower levels
of agreement than MDTMs for this diagnosis. On
subgroup analysis in patients without surgical lung
biopsy, inter-MDTM agreement and inter-observer
agreement between clinicians for the diagnosis of IPF
improved and were, again, almost the same. As evidence-
based diagnostic criteria for IPF are now clearly defined
and are relatively easily applied to many patients with
this disease, the near parity of agreement between
MDTMs and between clinicians is not surprising.8,10
For
Clinicians (HR, 95% CI,
p value)
Radiologists (HR, 95% CI,
p value)
MDTM (HR, 95% CI, p value)
Team 1 2·09 (0·90–4·86, p=0·085) 2·80 (1·17–6·73, p=0·021) 2·67 (1·21–6·02, p=0·016)
Team 2 2·95 (1·33–6·59, p=0·008) 4·08 (1·84–9·04, p=0·001) 3·44 (1·54–7·68, p=0·003)
Team 3 3·75 (1·65–8·51, p=0·002) 2·78 (1·11–6·97, p=0·030) 5·30 (2·26–12·41, p<0·001)
Team 4 3·34 (1·38–8·00, p=0·007) 4·49 (1·71–12·29, p=0·003) 3·99 (1·49–10·66, p=0·006)
Team 5 2·03 (0·87–4·69, p=0·100) 2·58 (1·08–6·21, p=0·033) 2·61 (1·12–6·06, p=0·025)
Team 6 4·14 (1·72–9·97, p=0·002) 2·11 (0·91–4·89, p=0·082) 3·36 (1·40–8·07, p=0·007)
Team 7 2·96 (1·43–6·55, p=0·007) 1·28 (0·53–3·06, p=0·583) 2·43 (1·09–5·41, p=0·030)
Results for the multidisciplinary team meetings (MDTMs), clinicians, and radiologists are based on the whole patient
cohort (n=70). HR=hazard ratio.
Table 5: Univariate Cox regression analysis for mortality according to clinician, radiologist, and MDTM
diagnoses of idiopathic pulmonary fibrosis versus not idiopathic pulmonary fibrosis
Non-IPF survival
IPF survival
Cumulativesurvivalproportion(%)
0 500 1000 1500 2000
Follow-up time (days)
100
80
60
40
20
0
MDTMs
Clinicians
Radiologists
Figure: Kaplan-Meier of survival differences between patients assigned a diagnosis of idiopathic pulmonary
fibrosis and those assigned other diagnoses (not idiopathic pulmonary fibrosis)
The cohort of 70 patients was separated into cases for which at least four of seven multidisciplinary team
meetings (MDTMs) assigned a first-choice diagnosis of idiopathic pulmonary fibrosis (IPF; blue curve; hazard
ratio 6·26, 95% CI 2·72–14·33, p<0·0001), at least four of seven clinicians assigned a first-choice diagnosis of IPF
(red curve; 4·43, 1·94–10·01, p<0·0001), and at least four of seven radiologists assigned a first-choice diagnosis of
IPF (green curve; 3·76, 1·61–8·75, p=0·002); or into other diagnoses (not IPF). For number of patients at risk see
appendix.
Articles
www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9	 7
example, in a patient with classic appearances for usual
interstitial pneumonia on high-resolution CT, a rapidly
progressive disease course, and no identifiable triggers,
multidisciplinary discussion is unlikely to alter a
clinician’s initial impression of IPF. Our findings suggest
that formal multidisciplinary input might not be
necessary in every case of suspected IPF if expert clinical
evaluation is available, which could be of particular
relevance to centres with restricted access to appropriate
radiology or pathology expertise.13
A strength of our findings is that the greater agreement
on multidisciplinary diagnosis is mirrored by the
non-significant improvement in prognostic separation
of a multidisciplinary distinction between IPF and other
diagnoses compared with the clinicians’ or radiologists’
distinction. To show this, we selected patients from
2010 data when they first presented to the host institution,
to allow an analysis of 5-year survival. An added
advantage of this approach was that these patients were
referred to the Royal Brompton and Harefield NHS
Foundation Trust in a pre-antifibrotic drug era, therefore
mortality differences between patients with IPF and
those without this disease were not confounded by
antifibrotic therapy. The fact that non-significant
improvements are present but inconclusive might reflect
powering limitations. Additionally, this inconsistency
might indicate that multidisciplinary discussion adds
prognostic value in the subgroup of patients in which
there is significant diagnostic uncertainty.
By contrast with those with IPF, many patients with
non-IPF interstitial lung diseases are not covered by
evidence-based diagnostic guidelines, therefore their
diagnosis is driven by clinical reasoning and analysis of
all available data in a multidisciplinary setting. In these
situations, a level of disagreement between MDTMs is
predictable and borne out by the poor level of inter-MDTM
agreement in the current study for diagnoses of NSIP
and hypersensitivity pneumonitis.8,14–16
The diagnosis of
hypersensitivity pneumonitis is well known to be
challenging because it relies on an array of data, which
are not definitive when considered in isolation.15
Furthermore, at least on high-resolution CT, patterns of
NSIP, usual interstitial pneumonia, or organising
pneumonia might be the only expressions of this
disease.16–19
The low MDTM agreement for the diagnosis
of hypersensitivity pneumonitis in our study highlights
an urgent need for international consensus on what
hypersensitivity pneumonitis actually is.
Our use of the weighted kappa to investigate inter-
MDTM and inter-observer agreement on diagnostic
probabilities is similar to other studies9
of diagnostic
agreement, but warrants particular consideration. We used
the weighted kappa converting the diagnostic likelihoods
to a five-point probability scale, which enabled examination
of the range of diagnostic likelihoods from minimal
likelihood to pathognomonic. Since exclusion of IPF in
diagnosis is as important as making a diagnosis of IPF,
our methodology has allowed us to show that there is good
agreement on the likelihood of IPF and, as previously
stated, reflects consistent application of established
diagnostic guidelines for this disease. By contrast, MDTM
agreement on the likelihood of hypersensitivity
pneumonitis was low, reinforcing the view that MDTMs
were unclear on how this diagnosis is made.
Two separate observations from our study warrant
further discussion. First, 13 patients had an established
diagnosis of a connective tissue disease at presentation.
However, after MDT evaluation, a connective tissue
disease diagnosis was constructed in an additional
eight cases or more by five of the seven MDTMs based on
presenting clinical symptoms and serology. Separation of
patients with idiopathic interstitial pneumonia from
those with connective tissue disease-related interstitial
lung disease can be challenging—some patients present
with subtle clinical features or serological abnormalities,
suggesting an autoimmune process, but do not meet
established criteria for a specific connective tissue
disease.20–22
In 2015, an ERS/ATS task force was formed to
establish consensus on how to classify these patients,
and a set of diagnostic criteria has been suggested.23–26
After removal of patients with an established diagnosis of
connective tissue disease, our subgroup analysis showed
acceptable levels of agreement on connective tissue
disease-related interstitial lung disease (by contrast
with hypersensitivity pneumonitis), underlying the
importance of reaching an international consensus on
disease definitions. Furthermore, the high frequency of
connective tissue disease-related interstitial lung disease
diagnoses made in our study highlights the importance
of formal rheumatology input within the MDTM, which
might include face-to-face rheumatological consultation
with patients suspected of having an undiagnosed
connective tissue disease.
Second, dynamic exchanges of clinical, radiological,
and pathological information between experts in a
multidisciplinary process has previously been suggested
to result in higher-confidence diagnoses.4
However, in
our study the proportion of high-confidence diagnoses
(≥70%) assigned after MDTM evaluation did not increase
compared with the proportion of high-confidence
diagnoses assigned by the individual components of the
MDTM. In most MDTMs, high-confidence diagnoses
were more frequently assigned by radiologists and
pathologists than were MDTM diagnoses or diagnoses
assigned by clinicians. In our study, radiologists and
pathologists did not have access to clinical information,
so their interpretation was based almost entirely on
pattern recognition, which might conceivably result in
more confident, but not necessarily more accurate,
diagnoses. Although one benefit of the multidisciplinary
process is that diagnoses might be challenged and must
be publicly defended, it is possible that extra discussion
creates additional difficulties in some cases that initially
seem straightforward when evaluated by individuals in
Articles
8	 www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9
isolation. However, we must highlight that in the specific
case of IPF, MDTMs made the diagnosis of IPF with
high confidence more frequently than did clinicians or
radiologists.
Our methodology has some limitations. Since patients
were selected from a pre-antifibrotic drug era, IPF was
possibly not as prevalent in our study cohort as it would
be now at most referral centres, which expend more time
in their evaluation of patients for approval for antifibrotic
treatment. However, as discussed, the inclusion of
patients who had not had antifibrotic drugs allowed us
to evaluate the veracity of MDTM diagnosis for IPF
against the outcomes. Second, unlike a real-world
multidisciplinary process, no observers had face-to-face
consultations with patients and therefore did not have
the benefit of obtaining a clinical history or doing
a physical examination first-hand. In difficult to
characterise patients, a clinician’s impression might be
influenced by direct contact with the patient in ways that
are not easily and objectively quantified. Equally
important, but also difficult to assess, is the effect of
individual personalities on MDTM diagnosis. Arguably, a
consensus diagnosis at multidisciplinary evaluation
sometimes might reflect the strongest voice in the room
rather than represent true agreement between
participants. Lastly, the wide range of proportions of
high-confidence diagnoses reported between the
different MDTMs in our study might reflect cultural
influences on the dynamics of multidisciplinary
evaluation. These less tangible influences could be the
focus of further studies.
In conclusion, our study showed that diagnostic
agreement between MDTMs is higher than inter-
observer agreement between clinicians, radiologists, and
pathologists in the setting of diffuse parenchymal lung
disease. In particular, inter-MDTM agreement for a
diagnosis of IPF is good and validated by the non-
significant greater prognostic separation of an IPF
diagnosis made by multidisciplinary teams than by
individual specialists. We showed low levels of inter-
MDTM agreement for NSIP and hypersensitivity
pneumonitis, which for hypersensitivity pneumonitis
might be in relation to the absence of evidence-based
guidelines to diagnose this disease.
Contributors
SLFW, AUW, SRD, and DMH had the study concept and did data
analysis, and manuscript writing. SLFW, AUW, SRD, AGN, CS, LE, JJ,
MAK, and DMH did data collection. AGN and LE did evaluation of
digitalised pathology data. JLM and KRF did manuscript review and
editing. All remaining authors made up the seven multidisciplinary
teams from Denmark (EB, FR, LBM), France (HN, DV, PYB, MK), Italy
(VP, SP, AD), Japan (HT, JF, TJ), Netherlands (JCG, DAvdH, HWvE,
MFvO, CAS), Portugal (AM, JMP, CSM), and the UK (SRD, BG, SP).
Declaration of interests
AUW has received personal fees from Intermune, Roche, Bayer, and
Gilead. HN is an investigator for clinical trials by Intermune, Roche,
Boehringer Ingelheim, Sanofi, and Centocor. DV has received personal
fees from Roche, Intermune and Boehringer Ingelheim. HT has
received personal fees from Abbott Japan Co Ltd, Actelion
Pharmaceuticals Japan Ltd, Ashai Kasei Pharmaceutical Corporation,
Astellas Pharmaceutical Incorporated, AstraZeneca, Bayer, Boehringer
Ingelheim, and Chugai Pharmaceuticals. JF has received personal fees
from Astellas Pharmaceutical Incorporated, Pathology Institute
Corporation, Chugai Pharmaceuticals, and Sakura Finetek Japan. AGN
has received personal fees from Sanofi, Intermune, Boehringer
Ingelheim, and Actelion. KRF has received personal fees from
Boehringer Ingelheim, Genentech, Ikaria, Immuneworks, Veracyte,
Roche, Gilead, Biogen, Afferent, Aeolus, and Pharmakea; and has
received grants from Boehringer Ingelheim, Genentech, Roche, and
Afferent. DMH has received personal fees from Boehringer Ingelheim,
Sanofi, AstraZeneca, Roche, and GlaxoSmithKline. The other authors
declare no competing interests.
Acknowledgments
We thank the National Institute of Health Research Respiratory Disease
Biomedical Unit (Royal Brompton and Harefield NHS Foundation Trust,
London, UK) and Imperial College London (London, UK). DMH is the
recipient of a National Institute of Health Research Senior Investigator
Award.
References
1	 King TE Jr, Bradford WZ, Castro-Bernardini S, et al. A phase 3 trial
of pirfenidone in patients with idiopathic pulmonary fibrosis.
N Engl J Med 2014; 370: 2083–92.
2	 Richeldi L, du Bois RM, Raghu G, et al. Efficacy and safety of
nintedanib in idiopathic pulmonary fibrosis. N Engl J Med 2014;
370: 2071–82.
3	 American Thoracic Society, European Respiratory Society.
American Thoracic Society/European Respiratory Society
international multidisciplinary consensus classification of the
idiopathic interstitial pneumonias. This joint statement of the
American Thoracic Society (ATS), and the European Respiratory
Society (ERS) was adopted by the ATS board of directors, June 2001
and by the ERS Executive Committee, June 2001.
Am J Respir Crit Care Med 2002; 165: 277–304.
4	 Flaherty KR, King TE Jr, Raghu G, et al. Idiopathic interstitial
pneumonia: what is the effect of a multidisciplinary approach to
diagnosis? Am J Respir Crit Care Med 2004; 170: 904–10.
5	 Thomeer M, Demedts M, Behr J, et al. Multidisciplinary
interobserver agreement in the diagnosis of idiopathic pulmonary
fibrosis. Eur Respir J 2008; 31: 585–91.
6	 Flaherty KR, Andrei AC, King TE Jr, et al. Idiopathic interstitial
pneumonia: do community and academic physicians agree on
diagnosis? Am J Respir Crit Care Med 2007; 175: 1054–60.
7	 Tomassetti S, Piciucchi S, Tantalocco P, Dubini A, Poletti V.
The multidisciplinary approach in the diagnosis of idiopathic
pulmonary fibrosis: a patient case-based review. Eur Respir Rev 2015;
24: 69–77.
8	 Travis WD, Costabel U, Hansell DM, et al. An official American
Thoracic Society/European Respiratory Society statement: update of
the international multidisciplinary classification of the idiopathic
interstitial pneumonias. Am J Respir Crit Care Med 2013;
188: 733–48.
9	 Aziz ZA, Wells AU, Hansell DM, et al. HRCT diagnosis of diffuse
parenchymal lung disease: inter-observer variation. Thorax 2004;
59: 506–11.
10	 Raghu G, Collard HR, Egan JJ, et al. An official ATS/ERS/JRS/ALAT
statement: idiopathic pulmonary fibrosis: evidence-based guidelines
for diagnosis and management. Am J Respir Crit Care Med 2011;
183: 788–824.
11	 Walsh SL, Calandriello L, Sverzellati N, Wells AU, Hansell DM,
UIP Observer Consort. Interobserver agreement for the ATS/ERS/
JRS/ALAT criteria for a UIP pattern on CT. Thorax 2016; 71: 45–51 .
12	 PIOPED Investigators. Value of the ventilation/perfusion scan in
acute pulmonary embolism. Results of the prospective investigation
of pulmonary embolism diagnosis (PIOPED). JAMA 1990;
263: 2753–59.
13	 Jo HE, Corte TJ, Moodley Y, et al. Evaluating the interstitial lung
disease multidisciplinary meeting: a survey of expert centres.
BMC Pulm Med 2016; 16: 22.
14	 Travis WD, Hunninghake G, King TE Jr, et al. Idiopathic nonspecific
interstitial pneumonia: report of an American Thoracic Society
project. Am J Respir Crit Care Med 2008; 177: 1338–47.
Articles
www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9	 9
15	 Lacasse Y, Selman M, Costabel U, et al. Clinical diagnosis of
hypersensitivity pneumonitis. Am J Respir Crit Care Med 2003;
168: 952–58.
16	 Silva CI, Muller NL, Lynch DA, et al. Chronic hypersensitivity
pneumonitis: differentiation from idiopathic pulmonary fibrosis
and nonspecific interstitial pneumonia by using thin-section CT.
Radiology 2008; 246: 288–97.
17	 Lacasse Y, Girard M, Cormier Y. Recent advances in hypersensitivity
pneumonitis. Chest 2012; 142: 208–17.
18	 Churg A, Sin DD, Everett D, Brown K, Cool C. Pathologic patterns
and survival in chronic hypersensitivity pneumonitis.
Am J Surg Pathol 2009; 33: 1765–70.
19	 Silva CI, Churg A, Muller NL. Hypersensitivity pneumonitis:
spectrum of high-resolution CT and pathologic findings.
AJR Am J Roentgenol 2007; 188: 334–44.
20	 Fischer A, du Bois R. Interstitial lung disease in connective tissue
disorders. Lancet 2012; 380: 689–98.
21	 Tzelepis GE, Toya SP, Moutsopoulos HM. Occult connective tissue
diseases mimicking idiopathic interstitial pneumonias. Eur Respir J
2008; 31: 11–20.
22	 Mittoo S, Gelber AC, Christopher-Stine L, Horton MR, Lechtzin N,
Danoff SK. Ascertainment of collagen vascular disease in patients
presenting with interstitial lung disease. Respir Med 2009;
103: 1152–58.
23	 Fischer A, West SG, Swigris JJ, Brown KK, du Bois RM.
Connective tissue disease-associated interstitial lung disease:
a call for clarification. Chest 2010; 138: 251–56.
24	 Vij R, Noth I, Strek ME. Autoimmune-featured interstitial lung
disease: a distinct entity. Chest 2011; 140: 1292–99.
25	 Kinder BW, Collard HR, Koth L, et al. Idiopathic nonspecific
interstitial pneumonia: lung manifestation of undifferentiated
connective tissue disease? Am J Respir Crit Care Med 2007;
176: 691–97.
26	 Fischer A, Antoniou KM, Brown KK, et al, ERS/ATS Task Force on
Undifferentiated Forms of CTD-ILD. An official European
Respiratory Society/American Thoracic Society research statement:
interstitial pneumonia with autoimmune features. Eur Respir J
2015; 46: 976–87.

More Related Content

What's hot

Sign80
Sign80Sign80
Sign80
SoM
 
The effect of long-term traditional Chinese medicine treatment on disease-fre...
The effect of long-term traditional Chinese medicine treatment on disease-fre...The effect of long-term traditional Chinese medicine treatment on disease-fre...
The effect of long-term traditional Chinese medicine treatment on disease-fre...
LucyPi1
 
Idiopathic Subglottic and Tracheal Stenosis - A Survey of the Patient Experience
Idiopathic Subglottic and Tracheal Stenosis - A Survey of the Patient ExperienceIdiopathic Subglottic and Tracheal Stenosis - A Survey of the Patient Experience
Idiopathic Subglottic and Tracheal Stenosis - A Survey of the Patient Experience
Catherine Anderson
 
Thrombocytosis at time of hospitalization is a reliable 1
Thrombocytosis at time of hospitalization is a reliable 1Thrombocytosis at time of hospitalization is a reliable 1
Thrombocytosis at time of hospitalization is a reliable 1
Hesham Abdel Halim
 
2016-Crawford-BMC Pulm Med published
2016-Crawford-BMC Pulm Med published2016-Crawford-BMC Pulm Med published
2016-Crawford-BMC Pulm Med published
Ji-Youn Yeo
 
ASPERGILOSIS 2016 GUIA IDSA
ASPERGILOSIS 2016 GUIA IDSA ASPERGILOSIS 2016 GUIA IDSA
ASPERGILOSIS 2016 GUIA IDSA
Mauricio Alejandro Usme Arango
 
1 s2.0-s0002934317307180
1 s2.0-s00029343173071801 s2.0-s0002934317307180
1 s2.0-s0002934317307180
RachmadSammulia2
 
324
324324
James Fingleton PhD thesis amended FINAL version 14th November
James Fingleton PhD thesis amended FINAL version 14th NovemberJames Fingleton PhD thesis amended FINAL version 14th November
James Fingleton PhD thesis amended FINAL version 14th November
James Fingleton
 
INSPIRE study BMC 2006
INSPIRE study BMC 2006INSPIRE study BMC 2006
INSPIRE study BMC 2006
Sunil Ramkali
 
Prevalence and predictors of pulmonary arterial hypertension in a sample of i...
Prevalence and predictors of pulmonary arterial hypertension in a sample of i...Prevalence and predictors of pulmonary arterial hypertension in a sample of i...
Prevalence and predictors of pulmonary arterial hypertension in a sample of i...
Alexander Decker
 
Inter society consensus for the management of peripheral arterial disease (tasc)
Inter society consensus for the management of peripheral arterial disease (tasc)Inter society consensus for the management of peripheral arterial disease (tasc)
Inter society consensus for the management of peripheral arterial disease (tasc)
Jonathan Campos
 
Dr. Lisa Marie Cannon
Dr. Lisa Marie CannonDr. Lisa Marie Cannon
Dr. Lisa Marie Cannon
Dr. Lisa Marie Cannon
 
Risk of heart failure after community acquired pneumonia: prospective control...
Risk of heart failure after community acquired pneumonia: prospective control...Risk of heart failure after community acquired pneumonia: prospective control...
Risk of heart failure after community acquired pneumonia: prospective control...
Bhargav Kiran
 
Prognosis of pulmonary arterial hypertension
Prognosis of pulmonary arterial hypertensionPrognosis of pulmonary arterial hypertension
Prognosis of pulmonary arterial hypertension
gisa_legal
 
FINALReveiwofLiterature
FINALReveiwofLiteratureFINALReveiwofLiterature
FINALReveiwofLiterature
Jacob Burd
 
NEUMONIA ASOCIADA AL VENTILADOR GUIA IDSA 2016
NEUMONIA ASOCIADA AL VENTILADOR GUIA IDSA 2016NEUMONIA ASOCIADA AL VENTILADOR GUIA IDSA 2016
NEUMONIA ASOCIADA AL VENTILADOR GUIA IDSA 2016
Mauricio Alejandro Usme Arango
 
Derivation and validation of an exclusive pre operative risk evaluation syste...
Derivation and validation of an exclusive pre operative risk evaluation syste...Derivation and validation of an exclusive pre operative risk evaluation syste...
Derivation and validation of an exclusive pre operative risk evaluation syste...
Clinical Surgery Research Communications
 
Mesa 1.4.Dr Jose Luis López Campos
Mesa 1.4.Dr Jose Luis López CamposMesa 1.4.Dr Jose Luis López Campos
Mesa 1.4.Dr Jose Luis López Campos
Quim Fuster
 
MERS case control study sheds light on clinical predictors
MERS case control study sheds light on clinical predictorsMERS case control study sheds light on clinical predictors
MERS case control study sheds light on clinical predictors
Yael Waknine
 

What's hot (20)

Sign80
Sign80Sign80
Sign80
 
The effect of long-term traditional Chinese medicine treatment on disease-fre...
The effect of long-term traditional Chinese medicine treatment on disease-fre...The effect of long-term traditional Chinese medicine treatment on disease-fre...
The effect of long-term traditional Chinese medicine treatment on disease-fre...
 
Idiopathic Subglottic and Tracheal Stenosis - A Survey of the Patient Experience
Idiopathic Subglottic and Tracheal Stenosis - A Survey of the Patient ExperienceIdiopathic Subglottic and Tracheal Stenosis - A Survey of the Patient Experience
Idiopathic Subglottic and Tracheal Stenosis - A Survey of the Patient Experience
 
Thrombocytosis at time of hospitalization is a reliable 1
Thrombocytosis at time of hospitalization is a reliable 1Thrombocytosis at time of hospitalization is a reliable 1
Thrombocytosis at time of hospitalization is a reliable 1
 
2016-Crawford-BMC Pulm Med published
2016-Crawford-BMC Pulm Med published2016-Crawford-BMC Pulm Med published
2016-Crawford-BMC Pulm Med published
 
ASPERGILOSIS 2016 GUIA IDSA
ASPERGILOSIS 2016 GUIA IDSA ASPERGILOSIS 2016 GUIA IDSA
ASPERGILOSIS 2016 GUIA IDSA
 
1 s2.0-s0002934317307180
1 s2.0-s00029343173071801 s2.0-s0002934317307180
1 s2.0-s0002934317307180
 
324
324324
324
 
James Fingleton PhD thesis amended FINAL version 14th November
James Fingleton PhD thesis amended FINAL version 14th NovemberJames Fingleton PhD thesis amended FINAL version 14th November
James Fingleton PhD thesis amended FINAL version 14th November
 
INSPIRE study BMC 2006
INSPIRE study BMC 2006INSPIRE study BMC 2006
INSPIRE study BMC 2006
 
Prevalence and predictors of pulmonary arterial hypertension in a sample of i...
Prevalence and predictors of pulmonary arterial hypertension in a sample of i...Prevalence and predictors of pulmonary arterial hypertension in a sample of i...
Prevalence and predictors of pulmonary arterial hypertension in a sample of i...
 
Inter society consensus for the management of peripheral arterial disease (tasc)
Inter society consensus for the management of peripheral arterial disease (tasc)Inter society consensus for the management of peripheral arterial disease (tasc)
Inter society consensus for the management of peripheral arterial disease (tasc)
 
Dr. Lisa Marie Cannon
Dr. Lisa Marie CannonDr. Lisa Marie Cannon
Dr. Lisa Marie Cannon
 
Risk of heart failure after community acquired pneumonia: prospective control...
Risk of heart failure after community acquired pneumonia: prospective control...Risk of heart failure after community acquired pneumonia: prospective control...
Risk of heart failure after community acquired pneumonia: prospective control...
 
Prognosis of pulmonary arterial hypertension
Prognosis of pulmonary arterial hypertensionPrognosis of pulmonary arterial hypertension
Prognosis of pulmonary arterial hypertension
 
FINALReveiwofLiterature
FINALReveiwofLiteratureFINALReveiwofLiterature
FINALReveiwofLiterature
 
NEUMONIA ASOCIADA AL VENTILADOR GUIA IDSA 2016
NEUMONIA ASOCIADA AL VENTILADOR GUIA IDSA 2016NEUMONIA ASOCIADA AL VENTILADOR GUIA IDSA 2016
NEUMONIA ASOCIADA AL VENTILADOR GUIA IDSA 2016
 
Derivation and validation of an exclusive pre operative risk evaluation syste...
Derivation and validation of an exclusive pre operative risk evaluation syste...Derivation and validation of an exclusive pre operative risk evaluation syste...
Derivation and validation of an exclusive pre operative risk evaluation syste...
 
Mesa 1.4.Dr Jose Luis López Campos
Mesa 1.4.Dr Jose Luis López CamposMesa 1.4.Dr Jose Luis López Campos
Mesa 1.4.Dr Jose Luis López Campos
 
MERS case control study sheds light on clinical predictors
MERS case control study sheds light on clinical predictorsMERS case control study sheds light on clinical predictors
MERS case control study sheds light on clinical predictors
 

Viewers also liked

Fotografía
FotografíaFotografía
Fotografía
jose gutierrez
 
Zugo value
Zugo valueZugo value
Zugo value
zugo Tech Corp.
 
Farzand Ali - CV
Farzand Ali - CVFarzand Ali - CV
Farzand Ali - CV
Farzand Ali
 
Introdução Análise de Balanços
Introdução Análise de BalançosIntrodução Análise de Balanços
Introdução Análise de Balanços
Jeferson Souza
 
Fotografía
FotografíaFotografía
Fotografía
jose gutierrez
 
Brochure oa
Brochure oaBrochure oa
Brochure oa
Laurel Ragland
 
Trabajo final espanol
Trabajo final espanolTrabajo final espanol
Trabajo final espanol
Natanael Rosa
 
Expats & Personal Finances - the Swiss Conundrum
Expats & Personal Finances -  the Swiss ConundrumExpats & Personal Finances -  the Swiss Conundrum
Expats & Personal Finances - the Swiss Conundrum
Daniel O'Leary MBA
 
Apostila html
Apostila htmlApostila html
Apostila html
Jeferson Souza
 
Historia oral
Historia oralHistoria oral
Historia oral
Mob Cranb
 
Cyprus: Cement - Market Report. Analysis And Forecast To 2025
Cyprus: Cement - Market Report. Analysis And Forecast To 2025Cyprus: Cement - Market Report. Analysis And Forecast To 2025
Cyprus: Cement - Market Report. Analysis And Forecast To 2025
IndexBox Marketing
 
Republic Of Korea: Tractors - Market Report. Analysis And Forecast To 2025
Republic Of Korea: Tractors - Market Report. Analysis And Forecast To 2025Republic Of Korea: Tractors - Market Report. Analysis And Forecast To 2025
Republic Of Korea: Tractors - Market Report. Analysis And Forecast To 2025
IndexBox Marketing
 

Viewers also liked (12)

Fotografía
FotografíaFotografía
Fotografía
 
Zugo value
Zugo valueZugo value
Zugo value
 
Farzand Ali - CV
Farzand Ali - CVFarzand Ali - CV
Farzand Ali - CV
 
Introdução Análise de Balanços
Introdução Análise de BalançosIntrodução Análise de Balanços
Introdução Análise de Balanços
 
Fotografía
FotografíaFotografía
Fotografía
 
Brochure oa
Brochure oaBrochure oa
Brochure oa
 
Trabajo final espanol
Trabajo final espanolTrabajo final espanol
Trabajo final espanol
 
Expats & Personal Finances - the Swiss Conundrum
Expats & Personal Finances -  the Swiss ConundrumExpats & Personal Finances -  the Swiss Conundrum
Expats & Personal Finances - the Swiss Conundrum
 
Apostila html
Apostila htmlApostila html
Apostila html
 
Historia oral
Historia oralHistoria oral
Historia oral
 
Cyprus: Cement - Market Report. Analysis And Forecast To 2025
Cyprus: Cement - Market Report. Analysis And Forecast To 2025Cyprus: Cement - Market Report. Analysis And Forecast To 2025
Cyprus: Cement - Market Report. Analysis And Forecast To 2025
 
Republic Of Korea: Tractors - Market Report. Analysis And Forecast To 2025
Republic Of Korea: Tractors - Market Report. Analysis And Forecast To 2025Republic Of Korea: Tractors - Market Report. Analysis And Forecast To 2025
Republic Of Korea: Tractors - Market Report. Analysis And Forecast To 2025
 

Similar to 16TLRM0035_MDT_STUDY

Guidelines for the management of hospital-adquired pneumonia ERJ 2017.pdf
Guidelines for the management of hospital-adquired pneumonia ERJ 2017.pdfGuidelines for the management of hospital-adquired pneumonia ERJ 2017.pdf
Guidelines for the management of hospital-adquired pneumonia ERJ 2017.pdf
DenisBacinschi2
 
Asthma In General Practice
Asthma In General PracticeAsthma In General Practice
Asthma In General Practice
Sherri Cost
 
Atypical Presentations of lung cancers.pdf
Atypical Presentations of lung cancers.pdfAtypical Presentations of lung cancers.pdf
Atypical Presentations of lung cancers.pdf
Kimberly Pulley
 
bulla pdf com
bulla pdf combulla pdf com
bulla pdf com
DiegoAlexisHuataVilc
 
Bmj.i5813.full
Bmj.i5813.fullBmj.i5813.full
Bmj.i5813.full
Siddharth Pugalendhi
 
Community Acquired Pneumonia
Community Acquired PneumoniaCommunity Acquired Pneumonia
Community Acquired Pneumonia
Bhargav Kiran
 
Incidence of pneumonia and risk factors among patients with head and neck can...
Incidence of pneumonia and risk factors among patients with head and neck can...Incidence of pneumonia and risk factors among patients with head and neck can...
Incidence of pneumonia and risk factors among patients with head and neck can...
Enrique Moreno Gonzalez
 
From Systems Biology to Personalized Medicine: an epidemiological view
From Systems Biology to Personalized Medicine: an epidemiological viewFrom Systems Biology to Personalized Medicine: an epidemiological view
From Systems Biology to Personalized Medicine: an epidemiological view
brnbarcelona
 
2016 CONSENSUS SEPSIS AND SEPSIS SHOCK.pdf
2016 CONSENSUS SEPSIS AND SEPSIS SHOCK.pdf2016 CONSENSUS SEPSIS AND SEPSIS SHOCK.pdf
2016 CONSENSUS SEPSIS AND SEPSIS SHOCK.pdf
rachelmorales18
 
Severe asthma-cpg-erj
Severe asthma-cpg-erjSevere asthma-cpg-erj
Severe asthma-cpg-erj
Dragoch
 
Asthma Management guidlines.
Asthma Management guidlines.Asthma Management guidlines.
Asthma Management guidlines.
charithwg
 
Proefschrift Annerika Slok
Proefschrift Annerika SlokProefschrift Annerika Slok
Proefschrift Annerika Slok
Annerika Slok
 
Evidence based practice for dvt prophylaxis - power point
Evidence based practice for dvt prophylaxis - power pointEvidence based practice for dvt prophylaxis - power point
Evidence based practice for dvt prophylaxis - power point
Rafie1Davidov
 
Evidence based practice for dvt prophylaxis - power point
Evidence based practice for dvt prophylaxis - power pointEvidence based practice for dvt prophylaxis - power point
Evidence based practice for dvt prophylaxis - power point
Rafie1Davidov
 
Evidence-Based Practice For DVT Prophylaxis Power Point
Evidence-Based Practice For DVT Prophylaxis   Power PointEvidence-Based Practice For DVT Prophylaxis   Power Point
Evidence-Based Practice For DVT Prophylaxis Power Point
Rafie1Davidov
 
Debate on mucolytics
Debate on mucolyticsDebate on mucolytics
Debate on mucolytics
Prem Chand
 
Vogelmeier et al-2017-american_journal_of_respiratory_and_critical_care_medicine
Vogelmeier et al-2017-american_journal_of_respiratory_and_critical_care_medicineVogelmeier et al-2017-american_journal_of_respiratory_and_critical_care_medicine
Vogelmeier et al-2017-american_journal_of_respiratory_and_critical_care_medicine
defrichandra85
 
QPS-NL Respiratory Capabilities Presentation
QPS-NL Respiratory Capabilities PresentationQPS-NL Respiratory Capabilities Presentation
QPS-NL Respiratory Capabilities Presentation
QPS Holdings, LLC
 
ANAESTHESIOLOGY MARCH 2018
ANAESTHESIOLOGY MARCH 2018ANAESTHESIOLOGY MARCH 2018
ANAESTHESIOLOGY MARCH 2018
chadhameenu
 
main.pdf
main.pdfmain.pdf

Similar to 16TLRM0035_MDT_STUDY (20)

Guidelines for the management of hospital-adquired pneumonia ERJ 2017.pdf
Guidelines for the management of hospital-adquired pneumonia ERJ 2017.pdfGuidelines for the management of hospital-adquired pneumonia ERJ 2017.pdf
Guidelines for the management of hospital-adquired pneumonia ERJ 2017.pdf
 
Asthma In General Practice
Asthma In General PracticeAsthma In General Practice
Asthma In General Practice
 
Atypical Presentations of lung cancers.pdf
Atypical Presentations of lung cancers.pdfAtypical Presentations of lung cancers.pdf
Atypical Presentations of lung cancers.pdf
 
bulla pdf com
bulla pdf combulla pdf com
bulla pdf com
 
Bmj.i5813.full
Bmj.i5813.fullBmj.i5813.full
Bmj.i5813.full
 
Community Acquired Pneumonia
Community Acquired PneumoniaCommunity Acquired Pneumonia
Community Acquired Pneumonia
 
Incidence of pneumonia and risk factors among patients with head and neck can...
Incidence of pneumonia and risk factors among patients with head and neck can...Incidence of pneumonia and risk factors among patients with head and neck can...
Incidence of pneumonia and risk factors among patients with head and neck can...
 
From Systems Biology to Personalized Medicine: an epidemiological view
From Systems Biology to Personalized Medicine: an epidemiological viewFrom Systems Biology to Personalized Medicine: an epidemiological view
From Systems Biology to Personalized Medicine: an epidemiological view
 
2016 CONSENSUS SEPSIS AND SEPSIS SHOCK.pdf
2016 CONSENSUS SEPSIS AND SEPSIS SHOCK.pdf2016 CONSENSUS SEPSIS AND SEPSIS SHOCK.pdf
2016 CONSENSUS SEPSIS AND SEPSIS SHOCK.pdf
 
Severe asthma-cpg-erj
Severe asthma-cpg-erjSevere asthma-cpg-erj
Severe asthma-cpg-erj
 
Asthma Management guidlines.
Asthma Management guidlines.Asthma Management guidlines.
Asthma Management guidlines.
 
Proefschrift Annerika Slok
Proefschrift Annerika SlokProefschrift Annerika Slok
Proefschrift Annerika Slok
 
Evidence based practice for dvt prophylaxis - power point
Evidence based practice for dvt prophylaxis - power pointEvidence based practice for dvt prophylaxis - power point
Evidence based practice for dvt prophylaxis - power point
 
Evidence based practice for dvt prophylaxis - power point
Evidence based practice for dvt prophylaxis - power pointEvidence based practice for dvt prophylaxis - power point
Evidence based practice for dvt prophylaxis - power point
 
Evidence-Based Practice For DVT Prophylaxis Power Point
Evidence-Based Practice For DVT Prophylaxis   Power PointEvidence-Based Practice For DVT Prophylaxis   Power Point
Evidence-Based Practice For DVT Prophylaxis Power Point
 
Debate on mucolytics
Debate on mucolyticsDebate on mucolytics
Debate on mucolytics
 
Vogelmeier et al-2017-american_journal_of_respiratory_and_critical_care_medicine
Vogelmeier et al-2017-american_journal_of_respiratory_and_critical_care_medicineVogelmeier et al-2017-american_journal_of_respiratory_and_critical_care_medicine
Vogelmeier et al-2017-american_journal_of_respiratory_and_critical_care_medicine
 
QPS-NL Respiratory Capabilities Presentation
QPS-NL Respiratory Capabilities PresentationQPS-NL Respiratory Capabilities Presentation
QPS-NL Respiratory Capabilities Presentation
 
ANAESTHESIOLOGY MARCH 2018
ANAESTHESIOLOGY MARCH 2018ANAESTHESIOLOGY MARCH 2018
ANAESTHESIOLOGY MARCH 2018
 
main.pdf
main.pdfmain.pdf
main.pdf
 

16TLRM0035_MDT_STUDY

  • 1. www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 1 Articles Multicentre evaluation of multidisciplinary team meeting agreement on diagnosis in diffuse parenchymal lung disease: a case-cohort study Simon L FWalsh, Athol UWells, Sujal R Desai,Venerino Poletti, Sara Piciucchi, Alessandra Dubini, Hilario Nunes, DominiqueValeyre, PierreY Brillet, Marianne Kambouchner, António Morais, José M Pereira, Conceição Souto Moura, Jan C Grutters, Daniel A van den Heuvel, HendrikW van Es, Matthijs F van Oosterhout, Cornelis A Seldenrijk, Elisabeth Bendstrup, Finn Rasmussen, Line B Madsen, Bibek Gooptu, Sabine Pomplun, HiroyukiTaniguchi, Junya Fukuoka,Takeshi Johkoh, Andrew G Nicholson, Charlie Sayer, Lilian Edmunds, Joseph Jacob, Maria A Kokosi, Jeffrey L Myers, Kevin R Flaherty, David M Hansell Summary Background Diffuse parenchymal lung disease represents a diverse and challenging group of pulmonary disorders. A consistent diagnostic approach to diffuse parenchymal lung disease is crucial if clinical trial data are to be applied to individual patients. We aimed to evaluate inter-multidisciplinary team agreement for the diagnosis of diffuse parenchymal lung disease. Methods We did a multicentre evaluation of clinical data of patients who presented to the interstitial lung disease unit of the Royal Brompton and Harefield NHS Foundation Trust (London, UK; host institution) and required multidisciplinary team meeting (MDTM) characterisation between March 1, 2010, and Aug 31, 2010. Only patients whose baseline clinical, radiological, and, if biopsy was taken, pathological data were undertaken at the host institution were included. Seven MDTMs, consisting of at least one clinician, radiologist, and pathologist, from seven countries (Denmark, France, Italy, Japan, Netherlands, Portugal, and the UK) evaluated cases of diffuse parenchymal lung disease in a two-stage process between Jan 1, and Oct 15, 2015. First, the clinician, radiologist, and pathologist (if lung biopsy was completed) independently evaluated each case, selected up to five differential diagnoses from a choice of diffuse lung diseases, and chose likelihoods (censored at 5% and summing to 100% in each case) for each of their differential diagnoses, without inter-disciplinary consultation. Second, these specialists convened at an MDTM and reviewed all data, selected up to five differential diagnoses, and chose diagnosis likelihoods. We compared inter-observer and inter-MDTM agreements on patient first-choice diagnoses using Cohen’s kappa coefficient (κ). We then estimated inter-observer and inter-MDTM agreement on the probability of diagnosis using weighted kappa coefficient (κw). We compared inter-observer and inter-MDTM confidence of patient first-choice diagnosis. Finally, we evaluated the prognostic significance of a first-choice diagnosis of idiopathic pulmonary fibrosis (IPF) versus not IPF for MDTMs, clinicians, and radiologists, using univariate Cox regression analysis. Findings 70 patients were included in the final study cohort. Clinicians, radiologists, pathologists, and the MDTMs assigned their patient diagnoses between Jan 1, and Oct 15, 2015. IPF made up 88 (18%) of all 490 MDTM first- choice diagnoses. Inter-MDTM agreement for first-choice diagnoses overall was moderate (κ=0·50). Inter-MDTM agreement on diagnostic likelihoods was good for IPF (κw=0·71 [IQR 0·64–0·77]) and connective tissue disease- related interstitial lung disease (κw=0·73 [0·68–0·78]); moderate for non-specific interstitial pneumonia (NSIP; κw=0·42 [0·37–0·49]); and fair for hypersensitivity pneumonitis (κw=0·29 [0·24–0·40]). High-confidence diagnoses (>65% likelihood) of IPF were given in 68 (77%) of 88 cases by MDTMs, 62 (65%) of 96 cases by clinicians, and in 57 (66%) of 86 cases by radiologists. Greater prognostic separation was shown for an MDTM diagnosis of IPF than compared with individual clinician’s diagnosis of this disease in five of seven MDTMs, and radiologist’s diagnosis of IPF in four of seven MDTMs. Interpretation Agreement between MDTMs for diagnosis in diffuse lung disease is acceptable and good for a diagnosis of IPF, as validated by the non-significant greater prognostic separation of an IPF diagnosis made by MDTMs than the separation of a diagnosis made by individual clinicians or radiologists. Furthermore, MDTMs made the diagnosis of IPF with higher confidence and more frequently than did clinicians or radiologists. This difference is of particular importance, because accurate and consistent diagnoses of IPF are needed if clinical outcomes are to be optimised. Inter-multidisciplinary team agreement for a diagnosis of hypersensitivity pneumonitis is low, highlighting an urgent need for standardised diagnostic guidelines for this disease. Funding National Institute of Health Research, Imperial College London. Lancet Respir Med 2016 Published Online May 11, 2016 http://dx.doi.org/10.1016/ S2213-2600(16)30033-9 Department of Radiology (S L FWalsh MD), King’s College Hospital NHS Foundation Trust, London, UK (S R Desai MD); Interstitial Lung Disease Unit (Prof A UWells MD, M A Kokosi MD) and Department of Radiology (Prof D M Hansell FRSM), Royal Brompton and Harefield NHS FoundationTrust, London, UK (J Jacob FRCR); Department of Diseases of theThorax (ProfV Poletti MD) and Department of Radiology (S Piciucchi MD), GB Morgagni Hospital, Forlì, Italy; Department of Surgical Pathology, Morgagni Pierantoni Hospital, Forlì, Italy (A Dubini MD); Université Paris, Sorbonne Paris Cité, EA2363 Réponses cellulaires et fonctionnelles à l’hypoxie, Bobigny, France (Prof H Nunes MD, Prof DValeyre MD, Prof PY Brillet MD); Assistance Publique-Hôpitaux de Paris, Service de Pneumologie (Prof H Nunes, Prof DValeyre), Service de Radiologie (Prof PY Brillet), and Service d’Anatomie Pathologique (M Kambouchner MD), Hôpital Avicenne, Bobigny, France; Serviço de Pneumologia (Prof A Morais MD) and Pathology Department (C Souto Moura MD), Centro Hospitalar São João, Porto, Portugal (J M Pereira MD); Faculdade de Medicina, Universidade do Porto, Porto, Portugal (Prof A Morais); ILD Center of Excellence St Antonius Hospital, Division Heart and Lungs, University, 16TLRM0035 This version saved: 12:32, 10-May-16 THELANCETRM-D-16-00035R3 S2213-2600(16)30033-9 Embargo: May 11, 2016—23:30 (BST) Funded by NIHR, Green OA to be made free from November 11, 2016 [23:30] BST FT
  • 2. Articles 2 www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 Introduction Diffuse parenchymal lung disease represents a diverse and challenging group of pulmonary disorders with varied prognoses and different management options. A consistent diagnostic approach to these diseases is essential if clinical trial data are to be reliably applied to individual patients. With the 2014 licensing of two new antifibrotic idiopathic pulmonary fibrosis (IPF) drugs (pirfenidone1 and nintedanib2 ), accurate and consistent diagnosis of IPF is of particular importance to achieve clinical benefits for patients. In 2002, a joint statement by the American Thoracic Society (ATS) and the European Respiratory Society (ERS) on the classification of idiopathic interstitial pneumonias advocated a multi­ disciplinary diagnostic approach, involving integration of clinical, radiological, and, in cases for which lung biopsy material is available, pathological data.3 This approach has been emphasised by several studies4–7 in the past 12 years and was restated in the 2013 ATS/ERS update8 on idiopathic interstitial pneumonia classification. Although this recommendation specifically applies to idiopathic interstitial pneumonia, a multidisciplinary approach has been widely used as the diagnostic gold standard for diffuse parenchymal lung disease in general.4,6 Several studies4–6,9 have evaluated inter-observer agreement for diagnosis in the setting of diffuse parenchymal lung disease. However, most of these studies pre-date the 2013 ATS/ERS update,8 the 2011 joint ATS/ERS/Japanese Respiratory Society/Latin American Thoracic Association statement10 on the diagnosis and management of IPF, and the availability of novel antifibrotic IPF drugs (pirfenidone1 and nintedanib2 ), all of which might affect diagnostic decisions. Furthermore, many of these studies focused on individual observers rather than agreement between multidisciplinary teams.4–6,9,11 In this study, we aimed to evaluate the level of inter-multidisciplinary team diagnostic agreement between seven international centres for diagnosis of diffuse parenchymal lung disease. Methods Study design, patients, and multidisciplinary team selection For this case-cohort study we selected consecutive patients who presented to the interstitial lung disease unit of the Royal Brompton and Harefield NHS Foundation Trust (London, UK; host institution) and patients with challenging diagnosis had MDTM characterisation, between March 1, 2010, and Aug 31, 2010. Only patients who had all their clinical investigations (serology, high-resolution CT, and, when required, surgical lung biopsy) completed at the host institution were included. Seven multi­disciplinary teams from seven different countries (Denmark, France, Italy, Japan, Netherlands, Portugal, and the UK), each with specialist expertise in the diagnosis and management of diffuse parenchymal lung disease, were invited and agreed to participate in the study. The only prerequisite for participation in the study was that each multidisciplinary team had to have a regular multidisciplinary meeting (about once a week) for Research in context Evidence before this study We searched PubMed on Jan 17, 2014, using the search terms “diffuse parenchymal lung disease”, “idiopathic pulmonary fibrosis”, “idiopathic interstitial pneumonias”, “interobserver agreement”, “diagnosis”, and “multidisciplinary team” for articles written in English and published between Jan 1, 2000, and Jan 1, 2014.We extended our search to include studies published up to Dec 1, 2015, during the writing of the manuscript.We identified seven key publications that were pertinent to our study. Of these, we identified four studies of observer agreement in the setting of diffuse parenchymal lung disease. All of these seven studies, however, pre-dated the latest AmericanThoracic Society and the European Respiratory Society (ATS/ERS) update for the classification of idiopathic interstitial pneumonias, and not all studies had evaluated diagnostic agreement between multidisciplinary teams, but rather focused on diagnostic agreement between individual observers. Added value of this study Our study is the first evaluation, to our knowledge, of inter- multidisciplinary team agreement for diagnosis in the setting of diffuse parenchymal lung disease since the updated 2013 ATS/ERS classification of idiopathic interstitial pneumonias and the 2011 ATS/ERS/Japanese Respiratory Society/Latin AmericanThoracic Association guidelines for the diagnosis and management of idiopathic pulmonary fibrosis. Our study shows that diagnostic agreement between MDTMs is non-significant compared with inter-observer agreement between clinicians, radiologists, and pathologists in the setting of diffuse parenchymal lung disease. Specifically in idiopathic pulmonary fibrosis, MDTMs have a higher level of agreement on diagnoses, assign diagnoses with higher confidence more frequently, and provide diagnoses that have non-significant greater prognostic separation than do clinicians or radiologists in most cases. Implications of all the available evidence The differences in diagnostic certainty between MDTMs and individual clinicians is of particular importance, because accurate and consistent diagnoses of idiopathic pulmonary fibrosis are needed if clinical outcomes are to be optimised. By contrast, inter-multidisciplinary team agreement for a diagnosis of hypersensitivity pneumonitis is low, highlighting an urgent need for standardised diagnostic guidelines for this disease. Medical Centre Utrecht, Netherlands (Prof J C Grutters MD); Department of Radiology (D A van den Heuvel MD, HW van Es MD) and Department of Pathology (M F van Oosterhout MD, C A Seldenrijk MD), St Antonius Hospital, Nieuwegein, Netherlands; Department of Respiratory Diseases and Allergy (E Bendstrup PhD) and Department of Radiology (F Rasmussen MD) and Department of Pathology (L B Madsen PhD), Aarhus University Hospital, Aarhus, Denmark; Division of Asthma, Allergy and Lung Biology, King’s College London, London, UK (B Gooptu PhD); Department of Cellular Pathology, University College Hospital London, London, UK (S Pomplun FRCPath); Department of Respiratory Medicine and Allergy,Tosei General Hospital, Aichi, Japan (HTaniguchi MD); Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan (Prof J Fukuoka MD); Department of Radiology, Kinki Central Hospital of Mutual Aid Association of Public SchoolTeachers, Itami, Japan (T Johkoh MD); National Heart and Lung Institute, Imperial College London, London, UK (Prof A G Nicholson DM, L Edmunds FRCPath); Brighton and Sussex University HospitalsTrust, Brighton, UK (C Sayer FRCR); and Department of Pathology (Prof J L Myers MD) and Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine (Prof K R Flaherty MD), University of Michigan, Ann Arbor, MI, USA Correspondence to: Dr Simon L FWalsh, Department of Radiology, King’s College Hospital NHS FoundationTrust, London SE5 9RS, UK slfwalsh@gmail.com
  • 3. Articles www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 3 See Online for appendix diffuse parenchymal lung disease in place with consistent attendance by at least one clinician, radiologist, and pathologist. For the retrospective examination of clinically indicated data, the institutional ethics review board of Royal Brompton and Harefield NHS Foundation Trust waived the need for informed patient consent. Evaluation of cases The evaluation of every case took place in two stages between Jan 1, and Oct 15, 2015. At first, clinicians, radiologists, and pathologists had to review the cases independently without interspecialty consultation. Clinicians had access to all the presenting clinical information (age, sex, smoking history, history of established connective tissue disease, symptoms [including those suggestive of connective tissue disease], autoantibody profile, exposure history, drugs at presentation, bronchoalveolar lavage result [if done], and angiotensin converting enzyme concentration [if assessed]), pulmonary function tests, and high-resolution CT (no access to the original high-resolution CT report or the pathology result). Radiologists and pathologists had access to only the age, sex, and smoking history for the patient, and the high-resolution CT (radiologist) or digitalised surgical lung biopsy slides (pathologist) taken at presentation. Pathologists had access to all pathology data that were available in the form of digitalised slides (in .svs format), which were viewed using Aperio ImageScope (version 12.3) viewing software. This digital viewing application has all the imaging functionality normally available to pathologists in routine clinical practice and the host institution uses it to evaluate cases referred from outside institutions for additional opinions. For each patient, observers (clinicians, radiologists, and pathologists) had to select up to five differential diagnoses and provide a diagnostic likelihood (censored at 5% increments and summing to 100% in each case) from a drop-down menu of diffuse lung diseases (appendix). The only stipulation was that diagnoses were considered in the context of the current 2013 version of the ATS/ERS classification and terminology for idiopathic interstitial pneumonias.8 Once the cases had been reviewed independently, the clinician, radiologist, and pathologist convened as a multidisciplinary team to review the cases together and provide up to five diagnoses with diagnostic likelihoods (also censored at 5% increments and summing to 100% in each case). All clinical information supplied in the first stage, including pulmonary function tests, high-resolution CT at presentation and digitalised surgical lung biopsy slides were available to the multidisciplinary team. In this study we aimed to evaluate inter- multidisciplinary team agreement for the diagnosis of diffuse parenchymal lung disease. To validate the diagnosis made by the MDTMs at the seven centres versus individual specialists, we compared the mortality of each team’s diagnosis of IPF. We compared diagnoses by separating the entire cohort into a binary IPF diagnosis category (IPF [if first-choice diagnosis for a patient is IPF] and not [if first-choice diagnosis is of another cause]) for each MDTM, clinician, and radiologist, based on assigned diagnoses. Pathologist diagnoses are not shown due to small number of cases (appendix). We calculated the survival period for each patient from the date of referral to the host institution to the minimum of date of death, date the patient was last known to be alive, or June 1, 2015 (end of the study period). We obtained vital status for every patient on June 1, 2015, by evaluating their electronic patient record. Statistical analysis We used Cohen’s kappa coefficient (κ) to evaluate inter-observer and inter-MDTM agreement for patient’s first-diagnosis. We used Cohen’s weighted-kappa coefficient (κw) to evaluate inter-observer agreement and inter-MDTM agreement for an estimation of the probability of each diagnosis. We converted the percentage diagnostic likelihood given for each diagnosis to a five point scale (0–4), representing clinically useful probabilities (0 for condition not included in the differential diagnosis; 1 for low probability [5–25%]; 2 for intermediate probability [30–65%]; 3 for high probability [70–95%]; and 4 for pathognomonic [100%]). For example, if the differential diagnoses given by an MDTM were IPF (65% diagnostic likelihood), non-specific interstitial pneumonia (NSIP; 25% diagnostic likelihood), and hypersensitivity pneumonitis (10% diagnostic likelihood), the probability grades would be 2 for IPF, 1 for NSIP, and 1 for hypersensitivity pneumonitis. We calculated weighted- kappa coefficient values between paired observers (for statements of inter-observer agreement), and between paired multidisciplinary teams (for statements of inter- MDTM agreement), which were expressed as median (IQR) values for all unique combinations of pairs (21 for seven observers or seven multidisciplinary teams). Weighting of the kappa coefficient allowed us to quantify the extent of disagreement, by assigning greater emphasis to large differences between scores. Weighted-kappa coefficients were categorised as poor (0<κw≤0·20), fair (0·20<κw≤0·40), moderate (0·40<κw≤0·60), good (0·60<κw≤0·80), and excellent (0·80<κw≤1·00). This approach has been used in previous investigations9,11 of inter-observer agreement for diagnosis in diffuse lung diseases. Additionally, for each patient the first-choice diagnosis was considered low confidence (diagnostic likelihood <70%) or high confidence (diagnostic likelihood ≥70%). These categories were based on the diagnostic likelihood categories used to assess the clinical probability of pulmonary embolism in the PIOPED study.12 We used univariate Cox regression analysis to identify associations between mortality and MDTM, clinician,
  • 4. Articles 4 www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 and radiologist diagnoses in terms of IPF versus not IPF. Reported hazard ratios (HRs) are for diagnosis of IPF versus not IPF. We tested the assumptions of proportional hazards by visual inspection of the log–log plot of survival, comparison of the Kaplan-Meier observed survival curves with the Cox predicted curves for the same variable, and graphical and formal analysis of Schoenfeld residuals (analysis not shown). Results are reported as HRs, 95% CIs, and p values, and are graphically shown as Kaplan-Meier survival curves. We completed statistical analyses using Stata (version 12; StataCorp, College Station, Texas). Role of the funding source The funders of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report. The corresponding author had full access to all of the data in the study and had final responsibility for the decision to submit for publication. Results We identified 113 consecutive new patient referrals, who required local MDTM characterisation, from the clinical database of the host institute between March 1, 2010, and Aug 31, 2010. We excluded 43 (38%) of 113 referrals on the basis that their initial work-up high-resolution CT scan (29 patients), lung function (four patients), or surgical lung biopsy (ten patients) were completed by the referring institution (appendix). The remaining 70 (62%) of 113 patient referrals were included as the final study cohort. Basic patient demographics are in table 1. 13 (19%) of 70 patients had an established diagnosis of a connective tissue disease (seven patients had systemic sclerosis, three had rheumatoid arthritis, two had Sjögren’s syndrome, and one had mixed connective tissue disease) at the time of presentation to the host institution, and 22 (31%) of 70 cases underwent surgical lung biopsy at the host institution (table 1). In patients in whom a surgical lung biopsy was not done (table 1), a confident diagnosis had been made by the host institution without the need for a surgical lung biopsy sample. Vital status was known for all patients at the end of the study period (June 1, 2015). 70 patients resulted in the assignment of 490 first- choice MDTM diagnoses (70 patients evaluated by seven MDTMs). First-choice diagnoses are shown in table 2. The NSIP and organising pneumonia overlap with interstitial lung disease category was combined with the NSIP category. The four most prevalent first-choice diagnoses (connective tissue disease-related interstitial lung disease, IPF, hypersensitivity pneumonitis, and NSIP) were the focus of subsequent analyses. The remaining diagnosis categories whose frequency was less than 10% of the total number of first-choice diagnoses (other, sarcoidosis, drug-related interstitial lung disease, occupational lung disease, pleuroparenchymal fibroelastosis, and organising pneumonia) were combined into an others diagnosis category. The final diagnosis categories were connective tissue disease-related interstitial lung disease, IPF, idiopathic NSIP, hypersensitivity pneumonitis, and others. Inter-observer agreement (between clinicians, radiologists, and pathologists) and inter-MDTM agreement for first-choice diagnosis are listed in table 3. Overall inter-MDTM agreement for first-choice diagnosis in patients was moderate (table 3). Inter-MDTM agreement for a first-choice diagnosis of IPF or of connective tissue disease-related interstitial lung disease was good, but for a first-choice diagnosis of idiopathic NSIP or hypersensitivity pneumonitis was fair (table 3). In the subgroup analysis of patients in whom a surgical Patients (n=70) Age (years) 60·9 (15·5) Sex Men 24 (34%) Women 46 (66%) Smoking Never 38 (54%) Previously smoked 24 (34%) Current 8 (11%) Established connective tissue disease history 13 (19%) Biopsy taken Yes 22 (31%) No 48 (69%) DLco (% predicted) 44·8 (14·5%) FEV1 (% predicted) 73·0 (20·5%) FVC (% predicted) 79·0 (19·6%) Where appropriate, data are mean (SD) and n (%). DLco=diffusing capacity of the lungs for carbon monoxide. FEV1=forced expiratory volume in 1 s. FVC=forced vital capacity. Table 1: Patient demographics and characteristics Number of first-choice diagnoses (n=490) Connective tissue disease-related interstitial lung disease 146 (30%) Idiopathic pulmonary fibrosis 88 (18%) Hypersensitivity pneumonitis 46 (9%) Idiopathic non-specific interstitial pneumonia 42 (9%) Unclassifiable interstitial lung disease 38 (8%) Other 37 (8%) Sarcoidosis 20 (4%) Drug-related interstitial lung disease 18 (4%) Smoking-related interstitial lung disease 16 (3%) Occupational lung disease 14 (3%) Pleuroparenchymal fibroelastosis 10 (2%) Organising pneumoniaor non-specific interstitial pneumoniaoverlappingdisease 8 (2%) Organising pneumonia 7 (1%) Table 2: First-choice diagnoses given by seven multidisciplinary teams for 70 cases of diffuse lung disease
  • 5. Articles www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 5 lung biopsy was not done (table 1), overall inter-MDTM agreement for diagnosis was moderate (table 3). Inter-MDTM agreement for first-choice diagnoses of IPF, connective tissue disease-related interstitial lung disease, and hypersensitivity pneumonitis in these patients were all greater than the first-choice diagnoses of all patients (table 3). Inter-MDTM agreement on the diagnostic likelihood of IPF and connective tissue disease-related interstitial lung disease was good, but moderate for idiopathic NSIP, and fair for hypersensitivity pneumonitis diagnoses (table 4). Subgroup analysis of inter-MDTM agreement on the estimation of diagnostic likelihood of IPF in patients without lung biopsy was good (κw=0·78, IQR 0·74–0·83). Overall inter-observer agreement between clinicians for first-choice diagnosis was moderate and was fair between radiologists and between pathologists (table 3). Agreement between clinicians on the probability of a diagnosis of IPF or connective tissue disease-related interstitial lung disease was higher than agreement on the probability of a diagnosis of idiopathic NSIP or hypersensitivity pneumonitis (table 4). Agreement between radiologists or pathologists was highest for the probability of a diagnosis of IPF compared with agreement on the probability of a diagnosis of connective tissue disease-related interstitial lung disease, idiopathic NSIP, or hypersensitivity pneumonitis (table 4). At the time of patient selection, 13 (19%) of 70 patients had an established diagnosis of a connective tissue disease, meaning any diagnosis of interstitial lung disease in these cases would most likely be classified as connective tissue disease-related interstitial lung disease. To investigate whether in these 13 cases there was high agreement for this diagnosis resulted in an increase in agreement on non-connective tissue disease diagnoses and, particularly, affected agreement on a diagnosis of IPF, we did a post-hoc subgroup analysis in the 57 (81%) of 70 cases who did not have an established diagnosis of connective tissue disease. In this analysis, although inter-MDTM agreement for a first-choice diagnosis of connective tissue disease-related interstitial lung disease decreased (from κ=0·57 to κ=0·42), no significant change was observed in inter-MDTM agreement for a first- choice diagnosis of IPF (κ=0·58), idiopathic NSIP (κ=0·24), or hypersensitivity pneumonitis (κ=0·23; appendix). 347 (70%) of 490 first-choice multidisciplinary team diagnoses were made with high confidence (appendix). Median prevalence of first-choice multidisciplinary team diagnoses made with high confidence was 67·1% (IQR 54·3–88·8). Median prevalence of first-choice diagnoses made with high confidence was 58·9% (IQR 52·9–71·4) by clinicians, 68·6% (35·7–85·7) by radiologists, and 72·7% (59·1–81·8) by pathologists (appendix). In the subgroup analysis of the 48 (69%) of 70 patients who did not undergo a surgical lung biopsy, 237 (71%) of 336 first-choice multidisciplinary team diagnoses were made with high confidence. In this subgroup, median prevalence of first-choice diagnoses made with high confidence were 60·4% (37·5–75·0) by clinicians, 66·6% (39·6–83·3) by radiologists, and 68·7% (IQR 52·8–87·5) by the multidisciplinary teams. For the diagnosis of IPF, supportive non-significant increases in diagnostic confidence by MDTMs (68 [77%] of 88) were shown, compared with clinicians (62 [65%] of 96) or radiologists (57 [66%] of 86; p=0·23). In the 22 (31%) of 70 cases that underwent surgical lung biopsy (therefore a total of 154 diagnoses by seven pathologists), 15 (10%) of 154 cases were assigned a first-choice diagnosis of IPF, of which 12 (8%) were assigned with high confidence. We reviewed the 15 cases who the pathologists gave a first-choice diagnosis of IPF to ascertain whether in patients who had had a surgical lung biopsy, the final MDTM diagnosis was usually IPF. In six of 15 cases, despite the pathologist giving a first-choice diagnosis of IPF, the final MDTM first-choice diagnosis was not IPF. Furthermore, in only two of 15 cases was IPF not already suggested by either the clinician or radiologist in the MDTM (appendix). Clinicians (κ) Radiologists (κ) Pathologists (κ) MDTM (κ) Total (n=70) No biopsy (n=48) Total (n=70) No biopsy (n=48) Total (n=70) No biopsy (n=48) Total (n=70) No biopsy (n=48) Overall total 0·45 0·50 0·33 0·31 0·31 ¨ 0·50 0·57 Idiopathic pulmonary fibrosis total 0·59 0·71 0·46 0·42 0·46 ¨ 0·60 0·70 Non-specific interstitial pneumonia total 0·19 0·19 0·25 0·25 0·23 ¨ 0·25 0·25 Connective tissue disease-related interstitial lung disease total 0·57 0·62 0·10 0·11 0·22 ¨ 0·64 0·73 Hypersensitivity pneumonitis total 0·25 0·38 0·27 0·22 0·20 ¨ 0·24 0·31 MDTM=multidisciplinary team meeting. Table 3: Unweighted kappa values (κ) for clinicians, radiologists, pathologists, and inter- multidisciplinary team meeting agreement on individual diagnoses of diffuse parenchymal lung disease Clinicians (κw) Radiologists (κw) Pathologists (κw) MDTM (κw) Idiopathic pulmonary fibrosis 0·72 (0·67–0·76) 0·60 (0·46–0·66) 0·58 (0·45–0·66) 0·71 (0·64–0·77) Connective tissue disease-related interstitial lung disease 0·76 (0·70–0·78) 0·17 (0·08–0·31) 0·21 (0·06–0·36) 0·73 (0·68–0·78) Non-specific interstitial pneumonia 0·31 (0·27–0·41) 0·32 (0·26–0·41) 0·30 (0·00–0·53) 0·42 (0·37–0·49) Hypersensitivity pneumonitis 0·42 (0·30–0·47) 0·35 (0·29–0·43) 0·26 (0·10–0·45) 0·29 (0·24–0·40) Data are median (IQR). MDTM=multidisciplinary team meeting. Table 4:Weighted kappa values (κw) for estimation of diagnostic likelihood for individual diagnoses of diffuse parenchymal lung disease
  • 6. Articles 6 www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 In the univariate Cox regression analysis, the multidisciplinary distinction between IPF and other diagnoses (not IPF) had non-significant increases toward greater prognostic separation (as judged by HR p values; all seven MDTMs had a significant separation) than the clinician distinction (in five of seven teams) or the radiologist distinction (in four of seven teams; table 5). The figure shows the Kaplan-Meier survival curves for the categorisation of first-choice diagnosis as IPF or not IPF in cases (by at least four of seven MDTMs, four of seven clinicians, and four of seven radiologists). The same analysis for pathologists’ diagnosis of IPF was not significant for five of seven pathologists, probably because of the small subgroup size (22 patients) and low prevalence of IPF in this subgroup (in 15 of 154 diagnoses pathologists’ first-choice diagnoses were IPF; appendix). Discussion We have shown that an acceptable level (based on κ>0·40 is deemed clinically acceptable) of diagnostic agreement exists between multidisciplinary teams in the setting of diffuse parenchymal lung disease. Additionally, we showed that this agreement was validated by the non- significant increases towards greater prognostic separation of an IPF diagnosis made by multidisciplinary teams than by individual clinicians or radiologists. Furthermore, MDTMs make the diagnosis of IPF with high confidence more frequently than do clinicians or radiologists. Since the publication of the ATS/ERS 2002 consensus statement on the classification of idiopathic interstitial pneumonias, multidisciplinary evaluation of diffuse parenchymal lung disease has been widely used as the diagnostic gold standard.3,8 This diagnostic approach has been partly investigated in several settings. Flaherty and colleagues4 examined the formulation of diagnosis in a cohort of diffuse parenchymal lung diseases against inter-observer agreement and diagnostic confidence in one multidisciplinary team (consisting of three clinicians, two radiologists, and two pathologists) and showed that diagnostic agreement between observers improved with successive integration of clinical, radiological, and pathological data. In a second study,6 Flaherty and colleagues expanded on these findings by showing higher levels of agreement between academic physicians, radiologists, and pathologists for diagnosis in diffuse lung disease than with their community counterparts. Later in 2008, Thomeer and colleagues5 reported in a cohort of patients included in an IPF trial, a high accuracy for a clinical diagnosis of this disease made by six respiratory physicians from different European centres. A limitation of these studies is that not all evaluated the agreement between different multidisciplinary teams for diagnoses,4 one focused specifically on the diagnosis of IPF5 and all studies pre- date the latest 2013 ATS/ERS idiopathic interstitial pneumonia update.4–6,8,9 To our knowledge this study is the first to evaluate inter-MDTM agreement for diagnosis in diffuse lung disease since the 2013 ATS/ERS update on the classification of idiopathic interstitial pneumonias. With the 2014 licensing of two new drugs1,2 for treatment of IPF in mild to moderate disease, early and accurate diagnosis of IPF is crucial. Our study showed that inter-MDTM agreement for the diagnosis of IPF is good, with clinicians having only marginally lower levels of agreement than MDTMs for this diagnosis. On subgroup analysis in patients without surgical lung biopsy, inter-MDTM agreement and inter-observer agreement between clinicians for the diagnosis of IPF improved and were, again, almost the same. As evidence- based diagnostic criteria for IPF are now clearly defined and are relatively easily applied to many patients with this disease, the near parity of agreement between MDTMs and between clinicians is not surprising.8,10 For Clinicians (HR, 95% CI, p value) Radiologists (HR, 95% CI, p value) MDTM (HR, 95% CI, p value) Team 1 2·09 (0·90–4·86, p=0·085) 2·80 (1·17–6·73, p=0·021) 2·67 (1·21–6·02, p=0·016) Team 2 2·95 (1·33–6·59, p=0·008) 4·08 (1·84–9·04, p=0·001) 3·44 (1·54–7·68, p=0·003) Team 3 3·75 (1·65–8·51, p=0·002) 2·78 (1·11–6·97, p=0·030) 5·30 (2·26–12·41, p<0·001) Team 4 3·34 (1·38–8·00, p=0·007) 4·49 (1·71–12·29, p=0·003) 3·99 (1·49–10·66, p=0·006) Team 5 2·03 (0·87–4·69, p=0·100) 2·58 (1·08–6·21, p=0·033) 2·61 (1·12–6·06, p=0·025) Team 6 4·14 (1·72–9·97, p=0·002) 2·11 (0·91–4·89, p=0·082) 3·36 (1·40–8·07, p=0·007) Team 7 2·96 (1·43–6·55, p=0·007) 1·28 (0·53–3·06, p=0·583) 2·43 (1·09–5·41, p=0·030) Results for the multidisciplinary team meetings (MDTMs), clinicians, and radiologists are based on the whole patient cohort (n=70). HR=hazard ratio. Table 5: Univariate Cox regression analysis for mortality according to clinician, radiologist, and MDTM diagnoses of idiopathic pulmonary fibrosis versus not idiopathic pulmonary fibrosis Non-IPF survival IPF survival Cumulativesurvivalproportion(%) 0 500 1000 1500 2000 Follow-up time (days) 100 80 60 40 20 0 MDTMs Clinicians Radiologists Figure: Kaplan-Meier of survival differences between patients assigned a diagnosis of idiopathic pulmonary fibrosis and those assigned other diagnoses (not idiopathic pulmonary fibrosis) The cohort of 70 patients was separated into cases for which at least four of seven multidisciplinary team meetings (MDTMs) assigned a first-choice diagnosis of idiopathic pulmonary fibrosis (IPF; blue curve; hazard ratio 6·26, 95% CI 2·72–14·33, p<0·0001), at least four of seven clinicians assigned a first-choice diagnosis of IPF (red curve; 4·43, 1·94–10·01, p<0·0001), and at least four of seven radiologists assigned a first-choice diagnosis of IPF (green curve; 3·76, 1·61–8·75, p=0·002); or into other diagnoses (not IPF). For number of patients at risk see appendix.
  • 7. Articles www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 7 example, in a patient with classic appearances for usual interstitial pneumonia on high-resolution CT, a rapidly progressive disease course, and no identifiable triggers, multidisciplinary discussion is unlikely to alter a clinician’s initial impression of IPF. Our findings suggest that formal multidisciplinary input might not be necessary in every case of suspected IPF if expert clinical evaluation is available, which could be of particular relevance to centres with restricted access to appropriate radiology or pathology expertise.13 A strength of our findings is that the greater agreement on multidisciplinary diagnosis is mirrored by the non-significant improvement in prognostic separation of a multidisciplinary distinction between IPF and other diagnoses compared with the clinicians’ or radiologists’ distinction. To show this, we selected patients from 2010 data when they first presented to the host institution, to allow an analysis of 5-year survival. An added advantage of this approach was that these patients were referred to the Royal Brompton and Harefield NHS Foundation Trust in a pre-antifibrotic drug era, therefore mortality differences between patients with IPF and those without this disease were not confounded by antifibrotic therapy. The fact that non-significant improvements are present but inconclusive might reflect powering limitations. Additionally, this inconsistency might indicate that multidisciplinary discussion adds prognostic value in the subgroup of patients in which there is significant diagnostic uncertainty. By contrast with those with IPF, many patients with non-IPF interstitial lung diseases are not covered by evidence-based diagnostic guidelines, therefore their diagnosis is driven by clinical reasoning and analysis of all available data in a multidisciplinary setting. In these situations, a level of disagreement between MDTMs is predictable and borne out by the poor level of inter-MDTM agreement in the current study for diagnoses of NSIP and hypersensitivity pneumonitis.8,14–16 The diagnosis of hypersensitivity pneumonitis is well known to be challenging because it relies on an array of data, which are not definitive when considered in isolation.15 Furthermore, at least on high-resolution CT, patterns of NSIP, usual interstitial pneumonia, or organising pneumonia might be the only expressions of this disease.16–19 The low MDTM agreement for the diagnosis of hypersensitivity pneumonitis in our study highlights an urgent need for international consensus on what hypersensitivity pneumonitis actually is. Our use of the weighted kappa to investigate inter- MDTM and inter-observer agreement on diagnostic probabilities is similar to other studies9 of diagnostic agreement, but warrants particular consideration. We used the weighted kappa converting the diagnostic likelihoods to a five-point probability scale, which enabled examination of the range of diagnostic likelihoods from minimal likelihood to pathognomonic. Since exclusion of IPF in diagnosis is as important as making a diagnosis of IPF, our methodology has allowed us to show that there is good agreement on the likelihood of IPF and, as previously stated, reflects consistent application of established diagnostic guidelines for this disease. By contrast, MDTM agreement on the likelihood of hypersensitivity pneumonitis was low, reinforcing the view that MDTMs were unclear on how this diagnosis is made. Two separate observations from our study warrant further discussion. First, 13 patients had an established diagnosis of a connective tissue disease at presentation. However, after MDT evaluation, a connective tissue disease diagnosis was constructed in an additional eight cases or more by five of the seven MDTMs based on presenting clinical symptoms and serology. Separation of patients with idiopathic interstitial pneumonia from those with connective tissue disease-related interstitial lung disease can be challenging—some patients present with subtle clinical features or serological abnormalities, suggesting an autoimmune process, but do not meet established criteria for a specific connective tissue disease.20–22 In 2015, an ERS/ATS task force was formed to establish consensus on how to classify these patients, and a set of diagnostic criteria has been suggested.23–26 After removal of patients with an established diagnosis of connective tissue disease, our subgroup analysis showed acceptable levels of agreement on connective tissue disease-related interstitial lung disease (by contrast with hypersensitivity pneumonitis), underlying the importance of reaching an international consensus on disease definitions. Furthermore, the high frequency of connective tissue disease-related interstitial lung disease diagnoses made in our study highlights the importance of formal rheumatology input within the MDTM, which might include face-to-face rheumatological consultation with patients suspected of having an undiagnosed connective tissue disease. Second, dynamic exchanges of clinical, radiological, and pathological information between experts in a multidisciplinary process has previously been suggested to result in higher-confidence diagnoses.4 However, in our study the proportion of high-confidence diagnoses (≥70%) assigned after MDTM evaluation did not increase compared with the proportion of high-confidence diagnoses assigned by the individual components of the MDTM. In most MDTMs, high-confidence diagnoses were more frequently assigned by radiologists and pathologists than were MDTM diagnoses or diagnoses assigned by clinicians. In our study, radiologists and pathologists did not have access to clinical information, so their interpretation was based almost entirely on pattern recognition, which might conceivably result in more confident, but not necessarily more accurate, diagnoses. Although one benefit of the multidisciplinary process is that diagnoses might be challenged and must be publicly defended, it is possible that extra discussion creates additional difficulties in some cases that initially seem straightforward when evaluated by individuals in
  • 8. Articles 8 www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 isolation. However, we must highlight that in the specific case of IPF, MDTMs made the diagnosis of IPF with high confidence more frequently than did clinicians or radiologists. Our methodology has some limitations. Since patients were selected from a pre-antifibrotic drug era, IPF was possibly not as prevalent in our study cohort as it would be now at most referral centres, which expend more time in their evaluation of patients for approval for antifibrotic treatment. However, as discussed, the inclusion of patients who had not had antifibrotic drugs allowed us to evaluate the veracity of MDTM diagnosis for IPF against the outcomes. Second, unlike a real-world multidisciplinary process, no observers had face-to-face consultations with patients and therefore did not have the benefit of obtaining a clinical history or doing a physical examination first-hand. In difficult to characterise patients, a clinician’s impression might be influenced by direct contact with the patient in ways that are not easily and objectively quantified. Equally important, but also difficult to assess, is the effect of individual personalities on MDTM diagnosis. Arguably, a consensus diagnosis at multidisciplinary evaluation sometimes might reflect the strongest voice in the room rather than represent true agreement between participants. Lastly, the wide range of proportions of high-confidence diagnoses reported between the different MDTMs in our study might reflect cultural influences on the dynamics of multidisciplinary evaluation. These less tangible influences could be the focus of further studies. In conclusion, our study showed that diagnostic agreement between MDTMs is higher than inter- observer agreement between clinicians, radiologists, and pathologists in the setting of diffuse parenchymal lung disease. In particular, inter-MDTM agreement for a diagnosis of IPF is good and validated by the non- significant greater prognostic separation of an IPF diagnosis made by multidisciplinary teams than by individual specialists. We showed low levels of inter- MDTM agreement for NSIP and hypersensitivity pneumonitis, which for hypersensitivity pneumonitis might be in relation to the absence of evidence-based guidelines to diagnose this disease. Contributors SLFW, AUW, SRD, and DMH had the study concept and did data analysis, and manuscript writing. SLFW, AUW, SRD, AGN, CS, LE, JJ, MAK, and DMH did data collection. AGN and LE did evaluation of digitalised pathology data. JLM and KRF did manuscript review and editing. All remaining authors made up the seven multidisciplinary teams from Denmark (EB, FR, LBM), France (HN, DV, PYB, MK), Italy (VP, SP, AD), Japan (HT, JF, TJ), Netherlands (JCG, DAvdH, HWvE, MFvO, CAS), Portugal (AM, JMP, CSM), and the UK (SRD, BG, SP). Declaration of interests AUW has received personal fees from Intermune, Roche, Bayer, and Gilead. HN is an investigator for clinical trials by Intermune, Roche, Boehringer Ingelheim, Sanofi, and Centocor. DV has received personal fees from Roche, Intermune and Boehringer Ingelheim. HT has received personal fees from Abbott Japan Co Ltd, Actelion Pharmaceuticals Japan Ltd, Ashai Kasei Pharmaceutical Corporation, Astellas Pharmaceutical Incorporated, AstraZeneca, Bayer, Boehringer Ingelheim, and Chugai Pharmaceuticals. JF has received personal fees from Astellas Pharmaceutical Incorporated, Pathology Institute Corporation, Chugai Pharmaceuticals, and Sakura Finetek Japan. AGN has received personal fees from Sanofi, Intermune, Boehringer Ingelheim, and Actelion. KRF has received personal fees from Boehringer Ingelheim, Genentech, Ikaria, Immuneworks, Veracyte, Roche, Gilead, Biogen, Afferent, Aeolus, and Pharmakea; and has received grants from Boehringer Ingelheim, Genentech, Roche, and Afferent. DMH has received personal fees from Boehringer Ingelheim, Sanofi, AstraZeneca, Roche, and GlaxoSmithKline. The other authors declare no competing interests. Acknowledgments We thank the National Institute of Health Research Respiratory Disease Biomedical Unit (Royal Brompton and Harefield NHS Foundation Trust, London, UK) and Imperial College London (London, UK). DMH is the recipient of a National Institute of Health Research Senior Investigator Award. References 1 King TE Jr, Bradford WZ, Castro-Bernardini S, et al. A phase 3 trial of pirfenidone in patients with idiopathic pulmonary fibrosis. N Engl J Med 2014; 370: 2083–92. 2 Richeldi L, du Bois RM, Raghu G, et al. Efficacy and safety of nintedanib in idiopathic pulmonary fibrosis. N Engl J Med 2014; 370: 2071–82. 3 American Thoracic Society, European Respiratory Society. American Thoracic Society/European Respiratory Society international multidisciplinary consensus classification of the idiopathic interstitial pneumonias. This joint statement of the American Thoracic Society (ATS), and the European Respiratory Society (ERS) was adopted by the ATS board of directors, June 2001 and by the ERS Executive Committee, June 2001. Am J Respir Crit Care Med 2002; 165: 277–304. 4 Flaherty KR, King TE Jr, Raghu G, et al. Idiopathic interstitial pneumonia: what is the effect of a multidisciplinary approach to diagnosis? Am J Respir Crit Care Med 2004; 170: 904–10. 5 Thomeer M, Demedts M, Behr J, et al. Multidisciplinary interobserver agreement in the diagnosis of idiopathic pulmonary fibrosis. Eur Respir J 2008; 31: 585–91. 6 Flaherty KR, Andrei AC, King TE Jr, et al. Idiopathic interstitial pneumonia: do community and academic physicians agree on diagnosis? Am J Respir Crit Care Med 2007; 175: 1054–60. 7 Tomassetti S, Piciucchi S, Tantalocco P, Dubini A, Poletti V. The multidisciplinary approach in the diagnosis of idiopathic pulmonary fibrosis: a patient case-based review. Eur Respir Rev 2015; 24: 69–77. 8 Travis WD, Costabel U, Hansell DM, et al. An official American Thoracic Society/European Respiratory Society statement: update of the international multidisciplinary classification of the idiopathic interstitial pneumonias. Am J Respir Crit Care Med 2013; 188: 733–48. 9 Aziz ZA, Wells AU, Hansell DM, et al. HRCT diagnosis of diffuse parenchymal lung disease: inter-observer variation. Thorax 2004; 59: 506–11. 10 Raghu G, Collard HR, Egan JJ, et al. An official ATS/ERS/JRS/ALAT statement: idiopathic pulmonary fibrosis: evidence-based guidelines for diagnosis and management. Am J Respir Crit Care Med 2011; 183: 788–824. 11 Walsh SL, Calandriello L, Sverzellati N, Wells AU, Hansell DM, UIP Observer Consort. Interobserver agreement for the ATS/ERS/ JRS/ALAT criteria for a UIP pattern on CT. Thorax 2016; 71: 45–51 . 12 PIOPED Investigators. Value of the ventilation/perfusion scan in acute pulmonary embolism. Results of the prospective investigation of pulmonary embolism diagnosis (PIOPED). JAMA 1990; 263: 2753–59. 13 Jo HE, Corte TJ, Moodley Y, et al. Evaluating the interstitial lung disease multidisciplinary meeting: a survey of expert centres. BMC Pulm Med 2016; 16: 22. 14 Travis WD, Hunninghake G, King TE Jr, et al. Idiopathic nonspecific interstitial pneumonia: report of an American Thoracic Society project. Am J Respir Crit Care Med 2008; 177: 1338–47.
  • 9. Articles www.thelancet.com/respiratory Published online May 11, 2016 http://dx.doi.org/10.1016/S2213-2600(16)30033-9 9 15 Lacasse Y, Selman M, Costabel U, et al. Clinical diagnosis of hypersensitivity pneumonitis. Am J Respir Crit Care Med 2003; 168: 952–58. 16 Silva CI, Muller NL, Lynch DA, et al. Chronic hypersensitivity pneumonitis: differentiation from idiopathic pulmonary fibrosis and nonspecific interstitial pneumonia by using thin-section CT. Radiology 2008; 246: 288–97. 17 Lacasse Y, Girard M, Cormier Y. Recent advances in hypersensitivity pneumonitis. Chest 2012; 142: 208–17. 18 Churg A, Sin DD, Everett D, Brown K, Cool C. Pathologic patterns and survival in chronic hypersensitivity pneumonitis. Am J Surg Pathol 2009; 33: 1765–70. 19 Silva CI, Churg A, Muller NL. Hypersensitivity pneumonitis: spectrum of high-resolution CT and pathologic findings. AJR Am J Roentgenol 2007; 188: 334–44. 20 Fischer A, du Bois R. Interstitial lung disease in connective tissue disorders. Lancet 2012; 380: 689–98. 21 Tzelepis GE, Toya SP, Moutsopoulos HM. Occult connective tissue diseases mimicking idiopathic interstitial pneumonias. Eur Respir J 2008; 31: 11–20. 22 Mittoo S, Gelber AC, Christopher-Stine L, Horton MR, Lechtzin N, Danoff SK. Ascertainment of collagen vascular disease in patients presenting with interstitial lung disease. Respir Med 2009; 103: 1152–58. 23 Fischer A, West SG, Swigris JJ, Brown KK, du Bois RM. Connective tissue disease-associated interstitial lung disease: a call for clarification. Chest 2010; 138: 251–56. 24 Vij R, Noth I, Strek ME. Autoimmune-featured interstitial lung disease: a distinct entity. Chest 2011; 140: 1292–99. 25 Kinder BW, Collard HR, Koth L, et al. Idiopathic nonspecific interstitial pneumonia: lung manifestation of undifferentiated connective tissue disease? Am J Respir Crit Care Med 2007; 176: 691–97. 26 Fischer A, Antoniou KM, Brown KK, et al, ERS/ATS Task Force on Undifferentiated Forms of CTD-ILD. An official European Respiratory Society/American Thoracic Society research statement: interstitial pneumonia with autoimmune features. Eur Respir J 2015; 46: 976–87.