0
Multidimensional Data in the    Virtual Observatory                          Jose Enrique Ruiz del Mazo                Tut...
SUMMARYContext• The AMIGA project• The Virtual Observatory• Multidimensional Data in Astronomy• AMIGA VO ContributionsGene...
AMIGAAnalysis of the interstellar Medium of Isolated GAlaxiesPI : Dr. Lourdes Verdes-MontenegroIAA-CSIC, IRAMhttp://amiga....
VIRTUAL OBSERVATORYThe Virtual Observatory is an infrastructure of interoperable data and services.IVOA provides technical...
VIRTUAL OBSERVATORYThe Virtual Observatory is an infrastructure of interoperable data and services.IVOA provides technical...
VIRTUAL OBSERVATORYThe Virtual Observatory is an infrastructure of interoperable data and services.IVOA provides technical...
VIRTUAL OBSERVATORYThe Virtual Observatory is an infrastructure of interoperable data and services.IVOA provides technical...
MULTIDIMENSIONAL DATAObservational Techniques• Radiointerferometry• Integral Field Spectroscopy• Multi Object Spectroscopy...
AMIGA VO CONTRIBUTIONSAMIGA Catalog• ConeSearch Service• Web InterfaceRADAMSRadio Astronomy Data Model for Single-dish tel...
GENERIC DATASETSTyped Datasets         SIMPLE ACCESS PROTOCOLS•   Tabular Data•   1D Spectra•   2D Images•   3D Cubes•   T...
GENERIC DATASETSTyped Datasets                                        SIMPLE ACCESS PROTOCOLS•   Tabular Data•   1D Spectr...
GENERIC DATASETSTyped Datasets                                        SIMPLE ACCESS PROTOCOLS•   Tabular Data•   1D Spectr...
DATA DISCOVERYAssociated Data Collections•   Simple Access Protocols perform discovery of associated data•   Present IVOA ...
DATA DISCOVERYAssociated Data Collections•   Simple Access Protocols perform discovery of associated data•   Present IVOA ...
DATA DISCOVERYAssociated Data Collections•   Simple Access Protocols perform discovery of associated data•   Present IVOA ...
DATA ACCESSVirtual Data generation may requireasynchronous services deployed ondistributed GRID architecturesWhole dataset...
GDS DISCOVERY INPUTSREQUEST=queryData             SPECRES                              SPATRESPOS                         ...
GDS DISCOVERY OUTPUTQueryAssociationAccessDataSet: Declaration of Spatial, Time and Polarization Axis              CONSIST...
GDS IMPLEMENTATION
GDS IMPLEMENTATION
GDS IMPLEMENTATION
accessData
getCapabilities
CONCLUSIONS•   Study of the state of the art of both MultiD data in Astronomy and Protocols in the VO•   Determine the bes...
FUTURE WORK•   Virtual Data generation and accesData standards needed•   Achieve final IVOA recommendation for MultiD disc...
Upcoming SlideShare
Loading in...5
×

Multidimensional Data in the VO

286

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
286
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Multidimensional Data in the VO"

  1. 1. Multidimensional Data in the Virtual Observatory Jose Enrique Ruiz del Mazo Tutora: Dr. Lourdes Verdes-Montenegro IAA - CSIC Máster FISYMAT Trabajo de Investigación Tutelada Universidad de Granada Diciembre 2010
  2. 2. SUMMARYContext• The AMIGA project• The Virtual Observatory• Multidimensional Data in Astronomy• AMIGA VO ContributionsGeneric Datasets• Data Discovery• Data AccessGeneric Dataset Discovery Service• Input Parameters• Query Response• ImplementationConclusions and Future Work
  3. 3. AMIGAAnalysis of the interstellar Medium of Isolated GAlaxiesPI : Dr. Lourdes Verdes-MontenegroIAA-CSIC, IRAMhttp://amiga.iaa.esObs. Marseille, Obs. Paris, CfA, ASIAA, MPIfA, IAC,Univ. Alabama, Mc Donald Observatory, Arcetri, UNAM,Kapteyn Astronomical Institute Need of a statistically significant sample of isolated galaxies, in order to provide a baseline to compare with the behaviour of galaxies in denser environments Multiλ analysis ~1000 galaxias + Need of intensive and complex analysis of 3D data 2D spatial + 1 Velocity
  4. 4. VIRTUAL OBSERVATORYThe Virtual Observatory is an infrastructure of interoperable data and services.IVOA provides technical standards for :• Providers to share data and services• Developers of applications to discover the services, find and access the dataThe final goal is that astronomers use this data infrastructure in a seamless way
  5. 5. VIRTUAL OBSERVATORYThe Virtual Observatory is an infrastructure of interoperable data and services.IVOA provides technical standards for :• Providers to share data and services• Developers of applications to discover the services, find and access the dataThe final goal is that astronomers use this data infrastructure in a seamless way
  6. 6. VIRTUAL OBSERVATORYThe Virtual Observatory is an infrastructure of interoperable data and services.IVOA provides technical standards for :• Providers to share data and services• Developers of applications to discover the services, find and access the dataThe final goal is that astronomers use this data infrastructure in a seamless way
  7. 7. VIRTUAL OBSERVATORYThe Virtual Observatory is an infrastructure of interoperable data and services.IVOA provides technical standards for :• Providers to share data and services• Developers of applications to discover the services, find and access the dataThe final goal is that astronomers use this data infrastructure in a seamless way
  8. 8. MULTIDIMENSIONAL DATAObservational Techniques• Radiointerferometry• Integral Field Spectroscopy• Multi Object Spectroscopy• Fabry-Perot Instruments• OTF Imaging Credit Stephen Todd and Douglas Pierce-Price Credit M. Westmoquette
  9. 9. AMIGA VO CONTRIBUTIONSAMIGA Catalog• ConeSearch Service• Web InterfaceRADAMSRadio Astronomy Data Model for Single-dish telescopesJuan de Dios Santader-VelaRobledo DSS-63 VO Archive• ConeSearch Service• SSA Service• Web InterfaceTAPASTelescope Archive for Public Access SystemIRAM-30m VO Archive• ConeSearch Service• Web Interface
  10. 10. GENERIC DATASETSTyped Datasets SIMPLE ACCESS PROTOCOLS• Tabular Data• 1D Spectra• 2D Images• 3D Cubes• Time Series
  11. 11. GENERIC DATASETSTyped Datasets SIMPLE ACCESS PROTOCOLS• Tabular Data• 1D Spectra• 2D Images• 3D Cubes• Time SeriesGeneric / MultiTyped DatasetsComplex data associations of different individual typesSurvey Field• Spectral data cube• 2D projections/extractions of the cube• Source catalog computed from the 2-D continuum• Some extracted spectra of objects in the field
  12. 12. GENERIC DATASETSTyped Datasets SIMPLE ACCESS PROTOCOLS• Tabular Data• 1D Spectra• 2D Images• 3D Cubes• Time SeriesGeneric / MultiTyped DatasetsComplex data associations of different individual typesSurvey Field• Spectral data cube• 2D projections/extractions of the cube• Source catalog computed from the 2-D continuum• Some extracted spectra of objects in the field
  13. 13. DATA DISCOVERYAssociated Data Collections• Simple Access Protocols perform discovery of associated data• Present IVOA models provide full description• REF-ID mechanism in VOTable allow association of data• RESOURCE mechanism in VOTable allow metadata extension
  14. 14. DATA DISCOVERYAssociated Data Collections• Simple Access Protocols perform discovery of associated data• Present IVOA models provide full description• REF-ID mechanism in VOTable allow association of data• RESOURCE mechanism in VOTable allow metadata extensionIssues• Original data products can be very large, worsening transfer rates and latency• Clients applications do not support all native observatory-dependent formats• Users are often not interested in the whole product but in a smaller portion
  15. 15. DATA DISCOVERYAssociated Data Collections• Simple Access Protocols perform discovery of associated data• Present IVOA models provide full description• REF-ID mechanism in VOTable allow association of data• RESOURCE mechanism in VOTable allow metadata extensionIssues• Original data products can be very large, worsening transfer rates and latency• Clients applications do not support all native observatory-dependent formats• Users are often not interested in the whole product but in a smaller portionVirtual Data from Uniformly Sampled Datasets• Data generated on-the-fly at access time based on user demands• Discovery implies negotiation with the service for access methods• WCS metadata needed for most virtual data generation
  16. 16. DATA ACCESSVirtual Data generation may requireasynchronous services deployed ondistributed GRID architecturesWhole datasetFiltering/FlaggingSpectrum extraction2D slices extractionDimensional reductionCutout 3D sub-cubeGeneral 2D projectionGeneral 3D projectionGeneral 2D slices through a 3D cubeComplex transformations
  17. 17. GDS DISCOVERY INPUTSREQUEST=queryData SPECRES SPATRESPOS TIMERES RESOLUTIONSIZE FLUXLIMITBAND SNR PRECISIONTIME VARAMPL SENSITIVITYPOL FLUXCALIB COVERAGEFORMAT WAVECALIB ASTCALIBREDSHIFTREGION PUBIDINTERSECT CREATORID PUBLISHER COLLECTIONTARGETNAME MTIMETARGETCLASS TARGETTYPE TOP MAXREC SERVICE COMPRESS RUNID
  18. 18. GDS DISCOVERY OUTPUTQueryAssociationAccessDataSet: Declaration of Spatial, Time and Polarization Axis CONSISTENCYDataIDProvenance: BeamMajorAxis, BeamMinorAxis, BeamPositionAngle INSTRUMENTALCurationTarget: VelocityDerived: DerivedVelocity, VelocityStatError, VelocityConfidence PHYSICS VarAmplStatError, VarAmplConfidenceCoordSys: RedshiftFrameUcdChar.SpatialAxisChar.SpectralAxisChar.TimeAxis CONSISTENCYChar.FluxAxis: FluxAverage, FluxMin, FluxSaturation, FluxSupportExtentChar.PolarizationAxis PHYSICS
  19. 19. GDS IMPLEMENTATION
  20. 20. GDS IMPLEMENTATION
  21. 21. GDS IMPLEMENTATION
  22. 22. accessData
  23. 23. getCapabilities
  24. 24. CONCLUSIONS• Study of the state of the art of both MultiD data in Astronomy and Protocols in the VO• Determine the best strategy for discovery and access of complex MultiD datasets• Propose Discovery Method for a GDS conceived in the less possible intrusive way• Reuse of existing VO Data Models and VO Protocols with minor modifications• Implementation of the proposed Discovery Method for a GDS
  25. 25. FUTURE WORK• Virtual Data generation and accesData standards needed• Achieve final IVOA recommendation for MultiD discovery and access VO protocols• Upcoming facilities will provide 3D datacubes and services to access and use them• getCapabilities method is key for interoperability among services• Conception and development of VO Scientific Workflows for 3D Data Analysis• EU funded project Wf4Ever Advanced Workflow Preservation Technologies for Enhanced Sience
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×