Helioviewer Talk at the SDO-AIA science Meeting, 20-22 April 2009

731
-1

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
731
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Helioviewer Talk at the SDO-AIA science Meeting, 20-22 April 2009

  1. 1. ADNET Systems, Inc. Helioviewer Discovery for Everyone Everywhere Jack Ireland & Helioviewer Team ADNET Systems, Inc.Thursday, May 28, 2009
  2. 2. ADNET Systems, Inc. Helioviewer Discovery for Everyone Everywhere Desmond Amadigwe Jack Ireland Patrick Schmiedel George Dimitoglou Ben Karel Benjamin Wamsler Bernhard Fleck Daniel Müller Alen Agheksanterian Keith Hughitt Juan Pablo Garcia OrtizThursday, May 28, 2009
  3. 3. The Helioviewer Project • Challenges - Huge amounts of data: - SOHO: ~0.2 Gbyte/day - SDO: ~1400 Gbyte/day - Large range of time & length- scales - Many different data products - Distributed archives - Multiple interest groups There are many distributed sources of information for one physical system - the heliosphere.J. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  4. 4. The Helioviewer Project • Goals - Enable efficient data browsing and visualization for users everywhere - Transparent access to multiple distributed archives e.g. HEK, VSO, GOES flare catalogs, ground based data - Extensible, open design that requires a minimal effort to join Create a discovery infrastructure that allows users to explore the heliosphere as a physical systemJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  5. 5. Components • Image service - Database of images from multiple observatories - JPEG2000 compression scheme - many advantages - API to use service - open to allJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  6. 6. Components • Image service - Database of images from multiple observatories - JPEG2000 compression scheme - many advantages - API to use service - open to all • Feature/Event service - A web service that interacts with multiple archives, e.g. HEK,VSO, GOES flare catalogs. - API to use service - open to allJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  7. 7. Components • Image service - Database of images from multiple observatories - JPEG2000 compression scheme - many advantages - API to use service - open to all • Feature/Event service - A web service that interacts with multiple archives, e.g. HEK,VSO, GOES flare catalogs. - API to use service - open to all • Browse tools - www.helioviewer.org - web interface - JHelioviewer - Java applicationJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  8. 8. Image storage with JPEG2000 JPEG2000 = new wavelet-based compression standard Advantages: • Multiple resolutions [Images at different resolutions are automatically created during wavelet compression process] • Random image access [Selected parts + quality layers can be accessed] • Flexible file format [for metadata] • Well-suited for archives [lossless mode, “Compress once, decompress many ways”]J. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  9. 9. Image storage with JPEG2000 JPEG2000 = new wavelet-based compression standard Advantages: • Multiple resolutions multiple heliospheric [Images at different resolutions are automatically created during wavelet compression process] ✓ length-scales • Random image access [Selected parts + quality layers can be accessed] • Flexible file format [for metadata] • Well-suited for archives [lossless mode, “Compress once, decompress many ways”]J. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  10. 10. Image storage with JPEG2000 JPEG2000 = new wavelet-based compression standard Advantages: • Multiple resolutions multiple heliospheric [Images at different resolutions are automatically created during wavelet compression process] ✓ length-scales selectable sub- • Random image access ✓ regions [Selected parts + quality layers can be accessed] • Flexible file format [for metadata] • Well-suited for archives [lossless mode, “Compress once, decompress many ways”]J. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  11. 11. Image storage with JPEG2000 JPEG2000 = new wavelet-based compression standard Advantages: • Multiple resolutions multiple heliospheric [Images at different resolutions are automatically created during wavelet compression process] ✓ length-scales selectable sub- • Random image access ✓ regions [Selected parts + quality layers can be accessed] • Flexible file format [for metadata] ✓ FITS header • Well-suited for archives [lossless mode, “Compress once, decompress many ways”]J. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  12. 12. Image storage with JPEG2000 JPEG2000 = new wavelet-based compression standard Advantages: • Multiple resolutions multiple heliospheric [Images at different resolutions are automatically created during wavelet compression process] ✓ length-scales selectable sub- • Random image access ✓ regions [Selected parts + quality layers can be accessed] • Flexible file format [for metadata] ✓ FITS header • Well-suited for archives lower data transfer [lossless mode, “Compress once, decompress many ways”] ✓ requirements for distributed archivesJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  13. 13. Remote Access to Image Data 40962 px image level 5 • JPIP = JPEG2000 5 level DWT level 4 Interactive Protocol level 3 • JPIP provides a client level 2 −server architecture for transmitting JPEG2000 level 1 imagery over networks • Can query arbitrary parts, quality levels of images and movies we need transfer only those wavelet movie • IDL, Solarsoft, Kakadu coefficients required for the requested cube JPEG2000 libraries field of view and timeJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  14. 14. SDO-AIA image data • JPEG2000 compression by a factor 16 yields reasonable browse EIT images. • 16x compression @ 1 minute cadence yields ~ 0.3 Tb/year/wavelength. • Keep most recent data (1-3 mo.) at full cadence? • Permanent library of browsable images for entire mission. • Very easy to concatenate JPEG2000 files to make movies and serve them remotely.J. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  15. 15. Feature/event service • Works with heterogenous feature/event services and archives, e.g., HEK, VSO, stand- alone catalogs (e.g., GOES) • Transparent to the user • API is open to other developers • Many types of meta-data are handledJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  16. 16. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  17. 17. www.helioviewer.org Ajax, PHP, ImageMagick, Kakadu/JPEG2000, Javascript librariesJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  18. 18. www.helioviewer.org Date/Time navigatorJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  19. 19. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  20. 20. www.helioviewer.org Data overlay selector & managerJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  21. 21. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  22. 22. www.helioviewer.org Feature/Event selectorJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  23. 23. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  24. 24. www.helioviewer.org zoom bar and centeringJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  25. 25. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  26. 26. www.helioviewer.org step forward in timeJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  27. 27. www.helioviewer.org add LASCO C2J. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  28. 28. www.helioviewer.org add SEEDS CME catalogJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  29. 29. www.helioviewer.org zoom out / widen field of viewJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  30. 30. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  31. 31. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  32. 32. www.helioviewer.org add LASCO C3, vary layer opacity, zoom outJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  33. 33. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  34. 34. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  35. 35. www.helioviewer.org toggle full screenJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  36. 36. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  37. 37. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  38. 38. www.helioviewer.org click on an icon to get details on an eventJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  39. 39. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  40. 40. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  41. 41. www.helioviewer.org view FITS keywords for selected imageJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  42. 42. www.helioviewer.org press ‘D’ for quick detailsJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  43. 43. www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  44. 44. JhelioviewerJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  45. 45. Jhelioviewer Java, JPIP server, KakaduJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  46. 46. JhelioviewerJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  47. 47. Jhelioviewer movie controlsJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  48. 48. Jhelioviewer image processing and overviewJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  49. 49. Future developmentsJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  50. 50. Future developments • our own serverJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  51. 51. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg)J. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  52. 52. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg) • SDO JPEG2000 pipelineJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  53. 53. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg) • SDO JPEG2000 pipeline • VSO mediated data accessJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  54. 54. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg) • SDO JPEG2000 pipeline • VSO mediated data access • movie generation via www.helioviewer.orgJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  55. 55. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg) • SDO JPEG2000 pipeline • VSO mediated data access • movie generation via www.helioviewer.org • better feature/event browsing and navigationJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  56. 56. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg) • SDO JPEG2000 pipeline • VSO mediated data access • movie generation via www.helioviewer.org • better feature/event browsing and navigation • complex query tool - HEK,VSOJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  57. 57. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg) • SDO JPEG2000 pipeline • VSO mediated data access • movie generation via www.helioviewer.org • better feature/event browsing and navigation • complex query tool - HEK,VSO • web browser plug-in for JPEG2000 streamingJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  58. 58. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg) • SDO JPEG2000 pipeline • VSO mediated data access • movie generation via www.helioviewer.org • better feature/event browsing and navigation • complex query tool - HEK,VSO • web browser plug-in for JPEG2000 streaming • establish multiple Helioviewer service providersJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  59. 59. Future developments • our own server • pipeline real-time SOHO image data (SPD mtg) • SDO JPEG2000 pipeline • VSO mediated data access • movie generation via www.helioviewer.org • better feature/event browsing and navigation • complex query tool - HEK,VSO • web browser plug-in for JPEG2000 streaming • establish multiple Helioviewer service providers • social networkingJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009
  60. 60. Thank you! www.helioviewer.org http://achilles.nascom.nasa.gov/~dmuellerJ. Ireland ADNET Systems, Inc.Thursday, May 28, 2009

×