PowerPoint Presentation

592 views

Published on

Published in: Health & Medicine
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
592
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

PowerPoint Presentation

  1. 1. LIDC Education Exhibit - RSNA 20031/99End/Return to HomeEnd/Return to Home The Lung Image Database Consortium (LIDC):The Lung Image Database Consortium (LIDC): Fundamental Issues for the Creation of aFundamental Issues for the Creation of a Resource for the Image ProcessingResource for the Image Processing Research CommunityResearch Community
  2. 2. LIDC Education Exhibit - RSNA 20032/99End/Return to HomeEnd/Return to Home Exhibit Learning Objectives:Exhibit Learning Objectives:  Learn about the LIDC’s goals andLearn about the LIDC’s goals and methods for creating:methods for creating: a publicly available database,a publicly available database, for the development, training, and evaluation offor the development, training, and evaluation of Computer-Aided Diagnosis (CAD) methods,Computer-Aided Diagnosis (CAD) methods, for lung cancer detection and diagnosis usingfor lung cancer detection and diagnosis using helical CT.helical CT.
  3. 3. LIDC Education Exhibit - RSNA 20033/99End/Return to HomeEnd/Return to Home Learning Objectives:Learning Objectives:  Learn about challenges in interpreting CTLearn about challenges in interpreting CT image data sets for the detection andimage data sets for the detection and diagnosis of lung cancerdiagnosis of lung cancer
  4. 4. LIDC Education Exhibit - RSNA 20034/99End/Return to HomeEnd/Return to Home Learning Objectives:Learning Objectives:  Learn about the intricacies of establishingLearn about the intricacies of establishing spatial “truth” for lesion location andspatial “truth” for lesion location and boundary.boundary.
  5. 5. LIDC Education Exhibit - RSNA 20035/99End/Return to HomeEnd/Return to Home The Challenge: Lung CancerThe Challenge: Lung Cancer  Cancer of the lung and bronchus is theCancer of the lung and bronchus is the leading fatal malignancy in the United States.leading fatal malignancy in the United States. Five-year survival is low, but treatment ofFive-year survival is low, but treatment of early-stage disease improves chances ofearly-stage disease improves chances of survival considerably.survival considerably.
  6. 6. LIDC Education Exhibit - RSNA 20036/99End/Return to HomeEnd/Return to Home The Challenge: Lung CancerThe Challenge: Lung Cancer  Given:Given:  Promising results from recent studies involving the usePromising results from recent studies involving the use of helical computed tomography (CT) for the earlyof helical computed tomography (CT) for the early detection of lung cancerdetection of lung cancer  As well as rapid developments in Multi-detector CTAs well as rapid developments in Multi-detector CT (MDCT) technology which provide for the possibility of(MDCT) technology which provide for the possibility of the detection of smaller lung nodules and offers athe detection of smaller lung nodules and offers a potentially effective tool for earlier detection.potentially effective tool for earlier detection.  There has been an increased interest in computer-aidedThere has been an increased interest in computer-aided diagnosis (CAD) techniques applied to CT imaging for lungdiagnosis (CAD) techniques applied to CT imaging for lung cancer to assist radiologists’ with their decision-making.cancer to assist radiologists’ with their decision-making.
  7. 7. LIDC Education Exhibit - RSNA 20037/99End/Return to HomeEnd/Return to Home The NCI Response: Forming the LIDCThe NCI Response: Forming the LIDC To stimulate research in the area of CAD,To stimulate research in the area of CAD, the National Cancer Institute (NCI) formedthe National Cancer Institute (NCI) formed a consortium of institutions to develop thea consortium of institutions to develop the standards and consensus necessary forstandards and consensus necessary for constructing an image database resourceconstructing an image database resource of thoracic helical CT images.of thoracic helical CT images.
  8. 8. LIDC Education Exhibit - RSNA 20038/99End/Return to HomeEnd/Return to Home MotivatioMotivatio nn • The development of CAD methods byThe development of CAD methods by the imaging research community would bethe imaging research community would be facilitated and enhanced through access tofacilitated and enhanced through access to a repository of CT image dataa repository of CT image data
  9. 9. LIDC Education Exhibit - RSNA 20039/99End/Return to HomeEnd/Return to Home MotivatioMotivatio nn • The development of CAD methods byThe development of CAD methods by the imaging research community would bethe imaging research community would be facilitated and enhanced through access tofacilitated and enhanced through access to a repository of CT image dataa repository of CT image data (1) It would provide data to researchers(1) It would provide data to researchers without access to clinical imageswithout access to clinical images
  10. 10. LIDC Education Exhibit - RSNA 200310/99End/Return to HomeEnd/Return to Home MotivatioMotivatio nn • The development of CAD methods byThe development of CAD methods by the imaging research community would bethe imaging research community would be facilitated and enhanced through access tofacilitated and enhanced through access to a repository of CT image dataa repository of CT image data (1) It would provide data to researchers(1) It would provide data to researchers without access to clinical imageswithout access to clinical images (2) It would also allow for meaningful(2) It would also allow for meaningful comparisons of different CAD methodscomparisons of different CAD methods
  11. 11. LIDC Education Exhibit - RSNA 200311/99End/Return to HomeEnd/Return to Home The LIDCThe LIDC This consortium - called the Lung ImageThis consortium - called the Lung Image Database Consortium (LIDC) - seeks toDatabase Consortium (LIDC) - seeks to establish standard formats and processesestablish standard formats and processes by which to manage lung images and theby which to manage lung images and the related technical and clinical data that willrelated technical and clinical data that will be used by researchers to develop, trainbe used by researchers to develop, train and evaluate CAD algorithms for lungand evaluate CAD algorithms for lung cancer detection and diagnosis.cancer detection and diagnosis.
  12. 12. LIDC Education Exhibit - RSNA 200312/99End/Return to HomeEnd/Return to Home Member InstitutionsMember Institutions • Five institutions were selected to form theFive institutions were selected to form the Lung Image Database Consortium (LIDC)Lung Image Database Consortium (LIDC)
  13. 13. LIDC Education Exhibit - RSNA 200313/99End/Return to HomeEnd/Return to Home Member InstitutionsMember Institutions Cornell University UCLA University of Chicago University of Iowa University of Michigan
  14. 14. LIDC Education Exhibit - RSNA 200314/99End/Return to HomeEnd/Return to Home SteeringSteering CommitteeCommitteeCornell University David Yankelevitz Anthony P. Reeves UCLA Michael F. McNitt-Gray Denise R. Aberle University of Chicago Samuel G. Armato III Heber MacMahon University of Iowa Geoffrey McLennan Eric A. Hoffman University of Michigan Charles R. Meyer Ella Kazerooni NCI Laurence P. Clarke Barbara Y. Croft
  15. 15. LIDC Education Exhibit - RSNA 200315/99End/Return to HomeEnd/Return to Home ContributingContributing ParticipantsParticipantsClaudia Henschke, Cornell David Gur, U. of Pittsburgh Robert Wagner, FDA Nicholas Petrick, FDA Lori Dodd, NCI Ed Staab, NCI Daniel Sullivan, NCI Houston Baker, NCI Carey Floyd, Duke Aliya Husain, U. of Chicago Matthew Brown, UCLA Christopher Piker, U. of Iowa Peyton Bland, U. of Michigan Andinet Asmamaw, Cornell Richie Pais, UCLA Antoni Chan, Cornell Gary Laderach, U. of Michigan Junfeng Guo, U. of Iowa Charles Metz, U. of Chicago Roger Engelmann, U. of Chicago Adam Starkey, U. of Chicago Jim Sayre, UCLA Mike Fishbein, UCLA Andy Flint, U. of Michigan Barry DeYoung, U. of Iowa Brian Mullan, U. of Iowa Madeline Vazquez, Cornell
  16. 16. LIDC Education Exhibit - RSNA 200316/99End/Return to HomeEnd/Return to Home MissioMissio nn The mission of the LIDC is the sharing ofThe mission of the LIDC is the sharing of lung images, especially low-dose helical CTlung images, especially low-dose helical CT scans of adults screened for lung cancer,scans of adults screened for lung cancer, and related technical and clinical data for theand related technical and clinical data for the development and testing of computer-aideddevelopment and testing of computer-aided detection and diagnosis technologydetection and diagnosis technology
  17. 17. LIDC Education Exhibit - RSNA 200317/99End/Return to HomeEnd/Return to Home PrincipalPrincipal GoalsGoalsTo establish standard formats and processes forTo establish standard formats and processes for managing thoracic CT scans and related technicalmanaging thoracic CT scans and related technical and clinical data for use in the development andand clinical data for use in the development and testing of computer-aided diagnostic algorithms.testing of computer-aided diagnostic algorithms.
  18. 18. LIDC Education Exhibit - RSNA 200318/99End/Return to HomeEnd/Return to Home PrincipalPrincipal GoalsGoalsTo establish standard formats and processes forTo establish standard formats and processes for managing thoracic CT scans and related technicalmanaging thoracic CT scans and related technical and clinical data for use in the development andand clinical data for use in the development and testing of computer-aided diagnostic algorithms.testing of computer-aided diagnostic algorithms. To develop an image database as a web-To develop an image database as a web- accessible international research resource for theaccessible international research resource for the development, training, and evaluation of computer-development, training, and evaluation of computer- aided diagnostic (CAD) methods for lung canceraided diagnostic (CAD) methods for lung cancer detection and diagnosis using helical CT.detection and diagnosis using helical CT.
  19. 19. LIDC Education Exhibit - RSNA 200319/99End/Return to HomeEnd/Return to Home TheThe DatabaseDatabase •The database will contain:The database will contain: 1)1) a collection of CT scan imagesa collection of CT scan images 2)2) a searchable relational databasea searchable relational database
  20. 20. LIDC Education Exhibit - RSNA 200320/99End/Return to HomeEnd/Return to Home Fundamental Issues for the LIDCFundamental Issues for the LIDC
  21. 21. LIDC Education Exhibit - RSNA 200321/99End/Return to HomeEnd/Return to Home LIDC Challenge #1 -LIDC Challenge #1 - Define a NoduleDefine a Nodule  Though at first this seems trivial, the LIDCThough at first this seems trivial, the LIDC had significant discussion about what tohad significant discussion about what to include and what not to include as ainclude and what not to include as a nodulenodule  A Nodule is part of a spectrum of focal abnormalities.  This spectrum includes scars, cancers, benign lesions, calcified lesions, etc.
  22. 22. LIDC Education Exhibit - RSNA 200322/99End/Return to HomeEnd/Return to Home What is a Nodule?What is a Nodule? “nodule: any pulmonary or pleural lesion represented in a radiograph by a sharply defined, discrete, nearly circular opacity 2-30 mm in diameter” from the Fleischner Society's Glossary of Terms for Thoracic Radiology (AJR 1984)
  23. 23. LIDC Education Exhibit - RSNA 200323/99End/Return to HomeEnd/Return to Home
  24. 24. LIDC Education Exhibit - RSNA 200324/99End/Return to HomeEnd/Return to Home “nodule: round opacity, at least moderately well marginated and no greater than 3 cm in maximum diameter” from the Fleishner Society's Glossary of Terms for CT of the Lungs (Radiology 1996) What is a Nodule?What is a Nodule?
  25. 25. LIDC Education Exhibit - RSNA 200325/99End/Return to HomeEnd/Return to Home Nodule
  26. 26. LIDC Education Exhibit - RSNA 200326/99End/Return to HomeEnd/Return to Home Is this a Nodule?
  27. 27. LIDC Education Exhibit - RSNA 200327/99End/Return to HomeEnd/Return to Home
  28. 28. LIDC Education Exhibit - RSNA 200328/99End/Return to HomeEnd/Return to Home
  29. 29. LIDC Education Exhibit - RSNA 200329/99End/Return to HomeEnd/Return to Home
  30. 30. LIDC Education Exhibit - RSNA 200330/99End/Return to HomeEnd/Return to Home
  31. 31. LIDC Education Exhibit - RSNA 200331/99End/Return to HomeEnd/Return to Home
  32. 32. LIDC Education Exhibit - RSNA 200332/99End/Return to HomeEnd/Return to Home
  33. 33. LIDC Education Exhibit - RSNA 200333/99End/Return to HomeEnd/Return to Home
  34. 34. LIDC Education Exhibit - RSNA 200334/99End/Return to HomeEnd/Return to Home
  35. 35. LIDC Education Exhibit - RSNA 200335/99End/Return to HomeEnd/Return to Home
  36. 36. LIDC Education Exhibit - RSNA 200336/99End/Return to HomeEnd/Return to Home
  37. 37. LIDC Education Exhibit - RSNA 200337/99End/Return to HomeEnd/Return to Home
  38. 38. LIDC Education Exhibit - RSNA 200338/99End/Return to HomeEnd/Return to Home NOTE: This is the slice which was shown earlier
  39. 39. LIDC Education Exhibit - RSNA 200339/99End/Return to HomeEnd/Return to Home
  40. 40. LIDC Education Exhibit - RSNA 200340/99End/Return to HomeEnd/Return to Home
  41. 41. LIDC Education Exhibit - RSNA 200341/99End/Return to HomeEnd/Return to Home
  42. 42. LIDC Education Exhibit - RSNA 200342/99End/Return to HomeEnd/Return to Home
  43. 43. LIDC Education Exhibit - RSNA 200343/99End/Return to HomeEnd/Return to Home
  44. 44. LIDC Education Exhibit - RSNA 200344/99End/Return to HomeEnd/Return to Home
  45. 45. LIDC Education Exhibit - RSNA 200345/99End/Return to HomeEnd/Return to Home
  46. 46. LIDC Education Exhibit - RSNA 200346/99End/Return to HomeEnd/Return to Home
  47. 47. LIDC Education Exhibit - RSNA 200347/99End/Return to HomeEnd/Return to Home
  48. 48. LIDC Education Exhibit - RSNA 200348/99End/Return to HomeEnd/Return to Home What is a Nodule?What is a Nodule? Focal AbnormalitiesFocal Abnormalities ( ) NodulesNodules • a spectrum of abnormalities Scar Spiculated Nodule Calcified Nodule
  49. 49. LIDC Education Exhibit - RSNA 200349/99End/Return to HomeEnd/Return to Home LIDC Challenge #1 -LIDC Challenge #1 - Define a NoduleDefine a Nodule  LIDC Response is to develop a NoduleLIDC Response is to develop a Nodule Visual Library using:Visual Library using:  Cases that ARE in Nodule portion of spectrumCases that ARE in Nodule portion of spectrum  Cases that are OUTSIDE Nodule portion ofCases that are OUTSIDE Nodule portion of spectrumspectrum  Classification by Thoracic RadiologistsClassification by Thoracic Radiologists  In Development NowIn Development Now  Expected Completion Feb 2004.Expected Completion Feb 2004.
  50. 50. LIDC Education Exhibit - RSNA 200350/99End/Return to HomeEnd/Return to Home Truth AssessmentTruth Assessment  Investigators will require “truth” informationInvestigators will require “truth” information •
  51. 51. LIDC Education Exhibit - RSNA 200351/99End/Return to HomeEnd/Return to Home Truth AssessmentTruth Assessment  Investigators will require “truth” informationInvestigators will require “truth” information  location of noduleslocation of nodules •
  52. 52. LIDC Education Exhibit - RSNA 200352/99End/Return to HomeEnd/Return to Home Truth AssessmentTruth Assessment  Investigators will require “truth” informationInvestigators will require “truth” information  location of noduleslocation of nodules  spatial extent of nodulesspatial extent of nodules •
  53. 53. LIDC Education Exhibit - RSNA 200353/99End/Return to HomeEnd/Return to Home Truth AssessmentTruth Assessment  Investigators will require “truth” informationInvestigators will require “truth” information  location of noduleslocation of nodules  spatial extent of nodulesspatial extent of nodules  Spatial “Truth” will be estimated bySpatial “Truth” will be estimated by “Radiologic Truth”“Radiologic Truth” •
  54. 54. LIDC Education Exhibit - RSNA 200354/99End/Return to HomeEnd/Return to Home LIDC Challenge #2LIDC Challenge #2 Define the Boundary of a NoduleDefine the Boundary of a Nodule  Though it seems that the boundary of a noduleThough it seems that the boundary of a nodule should be easy to define, we (and others) haveshould be easy to define, we (and others) have found that there is considerable inter-readerfound that there is considerable inter-reader variability in defining the boundary of a nodule.variability in defining the boundary of a nodule.  This is difficult enough with a solid nodule, butThis is difficult enough with a solid nodule, but even more difficult with spiculated nodules,even more difficult with spiculated nodules, ground glass nodules or non-solid nodules.ground glass nodules or non-solid nodules.
  55. 55. LIDC Education Exhibit - RSNA 200355/99End/Return to HomeEnd/Return to Home SPICULATED NODULE Instructions to Thoracic Radiologists were “Draw the Boundary of the Nodule”
  56. 56. LIDC Education Exhibit - RSNA 200356/99End/Return to HomeEnd/Return to Home SPICULATED NODULE Expert Number 1 Contour
  57. 57. LIDC Education Exhibit - RSNA 200357/99End/Return to HomeEnd/Return to Home SPICULATED NODULE Expert Number 2 Contour
  58. 58. LIDC Education Exhibit - RSNA 200358/99End/Return to HomeEnd/Return to Home SPICULATED NODULE Comparison of Contours
  59. 59. LIDC Education Exhibit - RSNA 200359/99End/Return to HomeEnd/Return to Home  Five radiologists using 3 drawing methods:Five radiologists using 3 drawing methods:  One manual 3-panel (3D) drawing methodOne manual 3-panel (3D) drawing method  Two different semiautomatic 3D methodsTwo different semiautomatic 3D methods Reader and Method Variability inReader and Method Variability in Drawing BoundariesDrawing Boundaries
  60. 60. LIDC Education Exhibit - RSNA 200360/99End/Return to HomeEnd/Return to Home Case 5, Slice 19Case 5, Slice 19
  61. 61. LIDC Education Exhibit - RSNA 200361/99End/Return to HomeEnd/Return to Home Radiologist 1 - Method 1Radiologist 1 - Method 1
  62. 62. LIDC Education Exhibit - RSNA 200362/99End/Return to HomeEnd/Return to Home Radiologist 1 - Method 2Radiologist 1 - Method 2
  63. 63. LIDC Education Exhibit - RSNA 200363/99End/Return to HomeEnd/Return to Home Radiologist 1 - Method 3Radiologist 1 - Method 3
  64. 64. LIDC Education Exhibit - RSNA 200364/99End/Return to HomeEnd/Return to Home Radiologist 2 - Method 1Radiologist 2 - Method 1
  65. 65. LIDC Education Exhibit - RSNA 200365/99End/Return to HomeEnd/Return to Home Radiologist 2 - Method 3Radiologist 2 - Method 3
  66. 66. LIDC Education Exhibit - RSNA 200366/99End/Return to HomeEnd/Return to Home Radiologist 3 - Method 1Radiologist 3 - Method 1
  67. 67. LIDC Education Exhibit - RSNA 200367/99End/Return to HomeEnd/Return to Home Radiologist 3 - Method 2Radiologist 3 - Method 2
  68. 68. LIDC Education Exhibit - RSNA 200368/99End/Return to HomeEnd/Return to Home Radiologist 3 - Method 3Radiologist 3 - Method 3
  69. 69. LIDC Education Exhibit - RSNA 200369/99End/Return to HomeEnd/Return to Home Radiologist 4 - Method 1Radiologist 4 - Method 1
  70. 70. LIDC Education Exhibit - RSNA 200370/99End/Return to HomeEnd/Return to Home Radiologist 4 - Method 2Radiologist 4 - Method 2
  71. 71. LIDC Education Exhibit - RSNA 200371/99End/Return to HomeEnd/Return to Home Radiologist 4 - Method 3Radiologist 4 - Method 3
  72. 72. LIDC Education Exhibit - RSNA 200372/99End/Return to HomeEnd/Return to Home Radiologist 5 - Method 1Radiologist 5 - Method 1
  73. 73. LIDC Education Exhibit - RSNA 200373/99End/Return to HomeEnd/Return to Home Radiologist 5 - Method 3Radiologist 5 - Method 3
  74. 74. LIDC Education Exhibit - RSNA 200374/99End/Return to HomeEnd/Return to Home  For each voxel, sum the number ofFor each voxel, sum the number of occurrences (across reader and methodoccurrences (across reader and method combinations) that it was included as part ofcombinations) that it was included as part of the nodulethe nodule  Create a probabilistic map of nodule voxelsCreate a probabilistic map of nodule voxels  Higher probability voxels are shown asHigher probability voxels are shown as brighter; lower probability are darkerbrighter; lower probability are darker  Can use apply a threshold and show onlyCan use apply a threshold and show only voxels > some prob. Value if desired.voxels > some prob. Value if desired. Create a Probabilistic Description ofCreate a Probabilistic Description of Nodule BoundaryNodule Boundary
  75. 75. LIDC Education Exhibit - RSNA 200375/99End/Return to HomeEnd/Return to Home Probabilistic Description of BoundaryProbabilistic Description of Boundary
  76. 76. LIDC Education Exhibit - RSNA 200376/99End/Return to HomeEnd/Return to Home Apply Threshold if DesiredApply Threshold if Desired
  77. 77. LIDC Education Exhibit - RSNA 200377/99End/Return to HomeEnd/Return to Home LIDC Challenge #2LIDC Challenge #2 Define the Boundary of a NoduleDefine the Boundary of a Nodule  Do we need to reconcile these Boundaries?Do we need to reconcile these Boundaries?  LIDC’s answer is no.LIDC’s answer is no.  LIDC Approach will be to:LIDC Approach will be to:  Come to a consistent definition of the desired boundaryCome to a consistent definition of the desired boundary (include just solid portion? non-solid portion?)(include just solid portion? non-solid portion?)  Assess reader variability of contoursAssess reader variability of contours  Construct a probabilistic description of boundaries toConstruct a probabilistic description of boundaries to capture reader variabilitycapture reader variability
  78. 78. LIDC Education Exhibit - RSNA 200378/99End/Return to HomeEnd/Return to Home LIDC Challenge #3-LIDC Challenge #3- Data Collection ProcessData Collection Process  Recent research has demonstrated thatRecent research has demonstrated that Single reads are not sufficient – At least twoSingle reads are not sufficient – At least two and perhaps four readers may be required.and perhaps four readers may be required.  Not practical to do joint readings across fiveNot practical to do joint readings across five institutionsinstitutions  LIDC Will NOT do a forced consensus read.LIDC Will NOT do a forced consensus read.
  79. 79. LIDC Education Exhibit - RSNA 200379/99End/Return to HomeEnd/Return to Home LIDC Challenge #3-LIDC Challenge #3- Data Collection ProcessData Collection Process  Will do a Two-Staged Process:Will do a Two-Staged Process:  Perform independent (Blinded) readings of cases byPerform independent (Blinded) readings of cases by multiple radiologistsmultiple radiologists  Compile readings and redistribute composite readingsCompile readings and redistribute composite readings  Perform a Second, Unblinded read by same set ofPerform a Second, Unblinded read by same set of radiologistsradiologists  Each reader can see readings of every other reader.Each reader can see readings of every other reader.  No forced consensusNo forced consensus  Capture probabilistic detection (e.g. a nodule canCapture probabilistic detection (e.g. a nodule can be identified by 3 of 4 readers) and probabilisticbe identified by 3 of 4 readers) and probabilistic contours.contours.
  80. 80. 8080 LIDC Process Model 2.4LIDC Process Model 2.4 October 2003October 2003 OverviewOverview PrerequisitesPrerequisites major data collection steps, andmajor data collection steps, and data collected at each step.data collected at each step.
  81. 81. LIDC Education Exhibit - RSNA 200381/99End/Return to HomeEnd/Return to Home Prerequisites Actions Data Collected IRB approvals Participants Scanned as part of Study/Clinical Program Non-Image Data Demographic Data Labeling Image Quality score Scan Classification Patient Classification Image Data/Dicom Data LIDC Activities CT Scan Criteria Apply Inclusion Criteria -Meets Scan Parameter Criteria [NOTE: All NLST & ELCAP eligible] Apply Inclusion Criteria: -IF Meets Scan Parameter Criteria [NOTE: All NLST & ELCAP eligible] - AND IF Meets Patient Inclusion Criteria Patient/Nodule Criteria Apply Inclusion Criteria: -IF Meets Scan Parameter Criteria [NOTE: All NLST & ELCAP eligible] - AND IF Meets Patient Inclusion Criteria -THEN Include in Db, Label Nodule Characteristics and Score Image Quality Labeling Vocabulary Image Quality Criteria
  82. 82. LIDC Education Exhibit - RSNA 200382/99End/Return to HomeEnd/Return to Home Prerequisites Radiologist Review Process (described next) Identified lesions for each condition: Each reader, blinded and unblinded read • Location • Outline • Label •Definition of Nodules to be included in Db •Agreement on Marking /Contouring process LIDC Activities #2 Case 1#3 Case 1 #4 Case 1 #1 Case 1 Actions Data Collected Reader 1 Reader 2 Reader 3 Reader 4
  83. 83. LIDC Education Exhibit - RSNA 200383/99End/Return to HomeEnd/Return to Home Blinded Reads – Each Reader Reads Independently (Blinded to Results of Other Readers)
  84. 84. LIDC Education Exhibit - RSNA 200384/99End/Return to HomeEnd/Return to Home Reader 1 Blinded Read for Reader 1 – Marks Only One Nodule
  85. 85. LIDC Education Exhibit - RSNA 200385/99End/Return to HomeEnd/Return to Home Reader 2 Blinded Read for Reader 2 – Marks Two Nodules (Note: One nodule is same as Reader 1)
  86. 86. LIDC Education Exhibit - RSNA 200386/99End/Return to HomeEnd/Return to Home Reader 3 Blinded Read for Reader 3 – Marks Two Nodules (Note: Again, One nodule is same as for Reader 1)
  87. 87. LIDC Education Exhibit - RSNA 200387/99End/Return to HomeEnd/Return to Home Reader 4 Blinded Read for Reader 4 – Did Not Mark Any Nodules
  88. 88. LIDC Education Exhibit - RSNA 200388/99End/Return to HomeEnd/Return to Home UnBlinded Reads – Readings in Which Readers Are Shown Results of Other Readers Each Reader Marks Nodules After Being Shown Results From Other Readers’ Blinded Reads (Each Reader Decides to Include or Ignore).
  89. 89. LIDC Education Exhibit - RSNA 200389/99End/Return to HomeEnd/Return to Home Reader 1 Unblinded Read for Reader 1 – Now Marks Two Nodules (Originally only marked one)
  90. 90. LIDC Education Exhibit - RSNA 200390/99End/Return to HomeEnd/Return to Home Reader 2 Unblinded Read for Reader 2 – Still Marks Two Nodules (No Change)
  91. 91. LIDC Education Exhibit - RSNA 200391/99End/Return to HomeEnd/Return to Home Reader 3 Unblinded Read for Reader 3 – Now Marks Three Nodules (Originally only marked two)
  92. 92. LIDC Education Exhibit - RSNA 200392/99End/Return to HomeEnd/Return to Home Reader 4 Unblinded Read for Reader 4 – Now Marks Three Nodules (Originally did not mark any)
  93. 93. LIDC Education Exhibit - RSNA 200393/99End/Return to HomeEnd/Return to Home 4 Markings 2 Markings 2 Markings Composite on Unblinded Reads for All Four Readers
  94. 94. LIDC Education Exhibit - RSNA 200394/99End/Return to HomeEnd/Return to Home Database ImplementationDatabase Implementation TASKS COMPLETED (see reports on website):TASKS COMPLETED (see reports on website):  Specification of Inclusion Criteria:Specification of Inclusion Criteria:  CT scanning technical parametersCT scanning technical parameters  Patient inclusion criteriaPatient inclusion criteria  Process Model for Data collectionProcess Model for Data collection  Determination of Spatial "truth" Using Blinded andDetermination of Spatial "truth" Using Blinded and Unblinded readsUnblinded reads  Development of Boundary Drawing/ContouringDevelopment of Boundary Drawing/Contouring ToolsTools
  95. 95. LIDC Education Exhibit - RSNA 200395/99End/Return to HomeEnd/Return to Home Database ImplementationDatabase Implementation TASKS ONGOING (expected completion date)TASKS ONGOING (expected completion date)  Definition of Nodule - Nodule Visual LibraryDefinition of Nodule - Nodule Visual Library (Feb 04)(Feb 04)  Evaluation of Boundary Variability (Feb 04):Evaluation of Boundary Variability (Feb 04):  Inter-Reader VariabilityInter-Reader Variability  Boundary Drawing Tool VariabilityBoundary Drawing Tool Variability
  96. 96. LIDC Education Exhibit - RSNA 200396/99End/Return to HomeEnd/Return to Home Implementation TimelineImplementation Timeline TaskTask Date ExpectedDate Expected  Specify Complete Data ModelSpecify Complete Data Model Jan 04Jan 04  Specify LIDC internal workflowSpecify LIDC internal workflow Jan 04Jan 04 Data passing, Performing reviewsData passing, Performing reviews  Initial implementation, testing workflow Jan/Feb 04Initial implementation, testing workflow Jan/Feb 04  Database Implementation- StartDatabase Implementation- Start Jan 04Jan 04  Database Implementation- Completion Mar/Apr 04Database Implementation- Completion Mar/Apr 04  Implement Public Interface to Database Apr/May 04Implement Public Interface to Database Apr/May 04  PUBLIC ACCESS TO CASES – EXPECTED MAY/JUNPUBLIC ACCESS TO CASES – EXPECTED MAY/JUN 0404
  97. 97. LIDC Education Exhibit - RSNA 200397/99End/Return to HomeEnd/Return to Home Publications/PresentationsPublications/Presentations  LIDC Overview manuscriptLIDC Overview manuscript  In Preparation, submission in 1In Preparation, submission in 1stst Quarter 04Quarter 04  Assessment Methodologies manuscriptAssessment Methodologies manuscript  In Preparation, submission in 1In Preparation, submission in 1stst Quarter 04Quarter 04  Special SessionSpecial Session SPIE Medical ImagingSPIE Medical Imaging  Sunday evening Feb 15, 2004Sunday evening Feb 15, 2004
  98. 98. LIDC Education Exhibit - RSNA 200398/99End/Return to HomeEnd/Return to Home To learn more about the LIDC:To learn more about the LIDC: Return for CME Category 1 Credit:Return for CME Category 1 Credit:  Monday – ThursdayMonday – Thursday  12:15 pm to 1:15 pm12:15 pm to 1:15 pm At these times, LIDC members will beAt these times, LIDC members will be here to describe the efforts of thehere to describe the efforts of the consortium, this exhibit and any otherconsortium, this exhibit and any other questions you might havequestions you might have
  99. 99. LIDC Education Exhibit - RSNA 200399/99End/Return to HomeEnd/Return to Home Return to Exhibit Home PageReturn to Exhibit Home Page Click HereClick Here

×