1
Ewa Deelman            Gideon Juve            Mats Rynge  Information Sciences Institute, USC    John Good, Anastasia Lait...
•  Funded 2002-2005 by NASA Earth Sciences   Technology Office Compute Technologies   Program•  Current release, version 3...
•  Over 11,000 downloads to date•  Individual astronomers and (teams of) IT researchers•  Spitzer Wide Area Infrared Extra...
•    Expérience pour la Recherche dObjets Sombres-2•    Cosmic Background Imager•    Arecibo Legacy Fast ALFA Survey•    A...
•  Use rigorous software engineering practices to ensure well-   organized and well-documented code, and control and manag...
•  Develop when possible in an open software, open data mode,   where source code, a set of input data, and tests are free...
8
9
3.6 µm8.0 µm24 µm         10
•  Scale•  Preserve calibration and    positional information•  Port to all common Unix/    Linux platforms•  Support all ...
•  ANSI-compliant C       •  All software and •  Component Based Toolkit libraries bundled    Design                    to...
Type “make”              13
•  Unzip•  Untar•  cd into main Montage directory, type   “make”•  Add $INSTALL/Montage_vX.Y/bin to   your path to run fro...
•  Detection of diffuse radio emission in the   galaxy clusters A800, A910, A1550, and   CL1446+26 Govoni et al.•  Compari...
16
Developed by Dr Tom Robitaille, MPIA                                  17
APLpy (the Astronomical Plotting Library inPython) is a Python module for producingpublication-quality plots of astronomic...
•  1500 square degree area mapped at 21-cm as part of the     Arecibo Legacy Fast ALFA Survey (ALFALFA)•  Spitzer Galactic...
IRAC Instrument Data Only                     find                           mJPEG                           mImgtbl      ...
Used Montage components to generate 235,000 galaxies measuredby the Sloan Digital Sky Survey. Used Amazon EC2 cloud.      ...
Create movies of the sky to seehow it changes with timeUse Montage to re-projectimages from multiplewavelengths on toonto ...
•  Task scheduling in distributed environments (performance-   focused)•  Designing job schedulers for the grid•  Designin...
Montage 1 degree workflow run with cleanup on OSG-PSU   24
Small 1,200 Montage WorkflowCluster small workflow tasks for performance
Montage is maintained without funding                                    26
•  G. B. Berriman, J. Good, E. Deelman and A. Alexov.   “Ten years of software sustainability at the Infrared   Processing...
Upcoming SlideShare
Loading in...5
×

Adoption of Software By A User Community: The Montage Image Mosaic Engine Example

688

Published on

Presented at the 1st Workshop on Maintainable Software Practices in e-Science, Chicago, 9 October 2012. Co-located with e-Science 2012.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
688
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Adoption of Software By A User Community: The Montage Image Mosaic Engine Example

  1. 1. 1
  2. 2. Ewa Deelman Gideon Juve Mats Rynge Information Sciences Institute, USC John Good, Anastasia LaityNASA Exoplanet Science Institute, Caltech Joe Jacob, Dan Katz JPL 2
  3. 3. •  Funded 2002-2005 by NASA Earth Sciences Technology Office Compute Technologies Program•  Current release, version 3.3, available for download at http://montage.ipac.caltech.edu o Licensed through Caltech by a clickwrap license•  Maintained at the Infrared Processing and Analysis Center, Caltech. 3
  4. 4. •  Over 11,000 downloads to date•  Individual astronomers and (teams of) IT researchers•  Spitzer Wide Area Infrared Extragalactic Survey•  Surveying the Agents of a Galaxy’s Evolution•  Galactic Legacy Infrared Mid-plane Survey Extraordinary•  Isaac Newton Telescope Photometric Survey of the Northern Galactic Plane•  Sloan Digital Sky Survey•  Large Synoptic Survey Telescope•  Bolocam Galactic Plane Survey 4
  5. 5. •  Expérience pour la Recherche dObjets Sombres-2•  Cosmic Background Imager•  Arecibo Legacy Fast ALFA Survey•  Atacama Large Millimeter Array•  Las Cumbres Observatory Global Telescope E/PO•  Galaxy Zoo/Zooniverse 5
  6. 6. •  Use rigorous software engineering practices to ensure well- organized and well-documented code, and control and manage interfaces.•  Listen to your user community, and if possible have a formal user-advisory group. Build a community that encourages users to contribute to sustainability; take advantage of Web 2.0 in this endeavor. 6
  7. 7. •  Develop when possible in an open software, open data mode, where source code, a set of input data, and tests are freely available.•  Build software that meets specific scientific goals; don’t be a solution that looks for a problem. ✔•  Make sure the software is easy to build. ✔•  Design for sustainability, extensibility, re-use and portability from the outset. Use modular designs. Avoid “flavor of the month” new technologies. ✔ 7
  8. 8. 8
  9. 9. 9
  10. 10. 3.6 µm8.0 µm24 µm 10
  11. 11. •  Scale•  Preserve calibration and positional information•  Port to all common Unix/ Linux platforms•  Support all common coordinate systems and projections•  Be easy to build... Careful what you ask! 11
  12. 12. •  ANSI-compliant C •  All software and •  Component Based Toolkit libraries bundled Design together •  Parallelizes •  No third-party dependenciesInput Reprojection Background Rectification Co-addition OutputMontage Workflow
  13. 13. Type “make” 13
  14. 14. •  Unzip•  Untar•  cd into main Montage directory, type “make”•  Add $INSTALL/Montage_vX.Y/bin to your path to run from any directory•  Perform build test: produce test mosaic and compare with prebuilt mosaic 14
  15. 15. •  Detection of diffuse radio emission in the galaxy clusters A800, A910, A1550, and CL1446+26 Govoni et al.•  Comparing near-infrared extinction and submillimeter data in the molecular cloud TMC-1 Malinen et al.•  Integral Field Spectroscopy studies of 14 early-type galaxies in the Coma cluster Scott et al.•  The Dust Properties of Bubble HII Regions as seen by Herschel Anderson et al. 15
  16. 16. 16
  17. 17. Developed by Dr Tom Robitaille, MPIA 17
  18. 18. APLpy (the Astronomical Plotting Library inPython) is a Python module for producingpublication-quality plots of astronomicalimaging data. - 600 downloads since April 2012 Developed by Dr Tom Robitaille, MPIA 18
  19. 19. •  1500 square degree area mapped at 21-cm as part of the Arecibo Legacy Fast ALFA Survey (ALFALFA)•  Spitzer Galactic Legacy Infrared Midplane Survey Extraordinaire 19
  20. 20. IRAC Instrument Data Only find mJPEG mImgtbl mMakeHdr Find all the FITS images Create grayscale JPEG Create image metadata Create a header within a galaxy dataset previews of all FITS images of all raw files encompassing all data files Loop over each SINGS mJPEG mProjExec galaxy dataset Create 3-color JPEG Previews Reproject all files to the same scale, Using different bandpasses orientation and sky projection Create thumbnails of all JPEG files for HTML display pages convertCreate HTML summary page per galaxy edit htmlwith all FITS images and JPEG preview linksCreate image metadata for general searchengine, inventory search and imagecutouts application. mImgtbl ngc4450 IRAC 3-Color ngc4450 Optical 3-Color Preview
  21. 21. Used Montage components to generate 235,000 galaxies measuredby the Sloan Digital Sky Survey. Used Amazon EC2 cloud. 21
  22. 22. Create movies of the sky to seehow it changes with timeUse Montage to re-projectimages from multiplewavelengths on toonto a common set of imageparameters. 22
  23. 23. •  Task scheduling in distributed environments (performance- focused)•  Designing job schedulers for the grid•  Designing fault tolerance techniques for job schedulers•  Exploring issues of data provenance in scientific workflows•  Exploring the cost and performance of scientific applications running on Clouds•  Developing high-performance workflow restructuring techniques•  Developing application performance frameworks•  Developing workflow orchestration techniques 23
  24. 24. Montage 1 degree workflow run with cleanup on OSG-PSU 24
  25. 25. Small 1,200 Montage WorkflowCluster small workflow tasks for performance
  26. 26. Montage is maintained without funding 26
  27. 27. •  G. B. Berriman, J. Good, E. Deelman and A. Alexov. “Ten years of software sustainability at the Infrared Processing and Analysis Center.” Phil. Trans. Roy. Soc. A, vol. 369, pp. 3384-3397. 2011.•  D. S. Katz, G. B. Berriman and R. G. Mann. “Collaborative astronomical image mosaics.” In “Reshaping research and development using Web 2.0- based technologies.” M. Baker, ed., in press.•  Astronomy Computing Today http://astrocompute.wordpress.com.•  The Montage web page http://montage.ipac.caltech.edu 27
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×