The HDF Group

HDF
Past, Present, Future
Mike Folk
The HDF Group
The 14th HDF and HDF-EOS Workshop
September 28-30, 2010

...
The HDF Group

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

2

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

3

www.hdfgroup.org
NCSA 1986

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

4

www.hdfgroup.org
GFTF Oct 28, 1987

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

5

www.hdfgroup.org
GFTF Oct 28, 1987

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

6

www.hdfgroup.org
GFTF Nov 9, 1987

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

7

www.hdfgroup.org
GFTF Nov 9, 1987

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

8

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

9

www.hdfgroup.org
Library
• Version 1 – 1988
• Primitive objects
• “raster,” “palette”, “aspect ratio”

• “sets” or groupings to form higher...
Library
• Version 3 – 1990
• Subsetting
• Vertex sets (Vsets)
• Groups (Vgroups), and tables (Vdatas)

• Version 4 – 1996
...
Command line tools

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

12

www.hdfgroup.org
NCSA software
Big simulations with HDF

Desktop visualization
with “NCSA Image”

Desktop visualization with PolyView
Septe...
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

14

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

15

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

16

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

17

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

18

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

19

www.hdfgroup.org
NetCDF Harmonization

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

20

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

21

www.hdfgroup.org
Other adopters of HDF

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

22

www.hdfgroup.org
Other adopters of HDF

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

23

www.hdfgroup.org
Other adopters of HDF
Non-destructive
testing

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

24

www.hdfgroup.org
Earth Observing System

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

25

www.hdfgroup.org
Earth Science (Earth Observing System)
Aqua (6/01)

Terra
CERES MISR
MODIS

September 28-30,

Aqua

CERES
MODIS
AMSR

Aura...
Message:
HDF needs to support
mission critical applications
with high quality and
performance standards

September 28-30, ...
A need for change?

Shortcomings of HDF (1996)
•
•
•
•
•

Limits on object & file size (<2GB)
Limited number of objects (<...
NCSA Access, Spring 1996

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

29

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

30

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

31

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

32

www.hdfgroup.org
ASCI = Accelerated Strategic Computing Initiative
We Have A Nuclear Test Ban Treaty

How do we maintain a nuclear stockpil...
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

34

www.hdfgroup.org
Big simulations
A simulation can have billions of elements
Each element can have dozens of associated values

September 28...
ASCI Data models and Formats Group

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

36

www.hdfgroup.org
Describing data is challenging

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

37

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

38

www.hdfgroup.org
HDF audience (1997)
•
•
•
•

Applications facing big data challenges
Academia, government, industry
Hundreds of different ...
Something is missing

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

40

www.hdfgroup.org
What is on these tapes?

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

41

www.hdfgroup.org
Message:
Communities are
committing critically
important data to HDF for
the long term,
and expect it to last.

September ...
The HDF Group

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

43

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

44

www.hdfgroup.org
R&D 100

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

45

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

46

www.hdfgroup.org
CHANGING USER PROFILE

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

47

www.hdfgroup.org
Flight testing

September 28-30,
2010

HDF/HDF-EOS Workshop XIV

48

www.hdfgroup.org
Vehicle testing

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

49

www.hdfgroup.org
Bioinformatics

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

50

www.hdfgroup.org
Images

25-80Å resolution electron tomography
8k x 8k x 1k images soon (256 GB)
September 28-30, 2010

HDF/HDF-EOS Worksho...
Making movies

Spiderman 3
September 28-30, 2010

The Polar Express
HDF/HDF-EOS Workshop XIV

52

www.hdfgroup.org
New expectations
•
•
•
•

“Deliverables”
“What about my data in 2080?”
How soon can you do this for me?
Business opportuni...
Doing business in academia preservation?
Data

We deliver papers,
not software.

Talk to the librarian.

I can do that
for...
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

55

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

56

www.hdfgroup.org
Missions and Goals
• The five missions
•
•
•
•
•

Public
Software
Service
Human
Financial/Structural

September 28-30, 201...
HDF Group Mission
To ensure long-term
accessibility of HDF data
through sustainable
development and support of
HDF technol...
• Business options and
questions
• For-Profit or not?
• How to make money?

• Intellectual property

Spinning off

Septemb...
Help from an unexpected place

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

60

www.hdfgroup.org
The HDF Group

Running our Business:
Challenges and Surprises

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

61

www.hd...
Challenges
• Managing contracts
• Finance
• Keeping overhead under control
• Defining “profit”
• Accounting and budgeting ...
Today vs. 2006
2006

2010

Staff

17

34

Funded
projects
Budget

6

13

$1.6M

$3.4M

September 28-30, 2010

HDF/HDF-EOS ...
The HDF Group

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

64

www.hdfgroup.org
The near future

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

65

www.hdfgroup.org
Cross the chasm to new
users and applications

Time

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

66

www.hdfgroup.org
The near future
•
•
•
•

From technology driven to market driven
Raising the open source quality bar
Expanding our ability...
The future

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

68

www.hdfgroup.org
TECHNOLOGY
STRATEGIES

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

69

www.hdfgroup.org
Lots of data

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

70

www.hdfgroup.org
Big data

Cores

Petaflops

224,162

1.759

Image courtesy of the National Center for Computational Sciences, Oak Ridge Na...
Kinds of data

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

72

www.hdfgroup.org
GFTF Nov 9, 1987

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

73

www.hdfgroup.org
A focus on
Preservation

Darwin’s first evolutionary tree - 183
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

74

www.h...
Preservationbased
evolution

Darwin’s first evolutionary tree - 183
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

75

w...
Promoting
standardization
and
interoperability

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

76

www.hdfgroup.org
Institutional
strategies

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

77

www.hdfgroup.org
A missiondriven
business

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

78

www.hdfgroup.org
One keeper of
the format
and software

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

79

www.hdfgroup.org
Open
source

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

80

www.hdfgroup.org
Long-term institutional
support

The National Archives, Washington, D.C.

September 28-30, 2010

HDF/HDF-EOS Workshop XIV
...
Human, financial, legal
foundations for
sustainability

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

82

www.hdfgroup....
Business
model

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

83

www.hdfgroup.org
A virtual
organization

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

84

www.hdfgroup.org
Thank You

September 28-30, 2010

HDF/HDF-EOS Workshop XIV

85

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

86

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

87

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

88

www.hdfgroup.org
September 28-30, 2010

HDF/HDF-EOS Workshop XIV

89

www.hdfgroup.org
Upcoming SlideShare
Loading in …5
×

The HDF Group - Past, Present and Future

378 views

Published on

The founder of The HDF Group discusses the past, present, and future of the HDF technology and community.

Published in: Technology, Art & Photos
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
378
On SlideShare
0
From Embeds
0
Number of Embeds
14
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • WilhelmsonNormanPolyview: Kriz paper: http://www.sv.vt.edu/NCSA_WkShp/kriz/WkShp_kriz.html
  • Terascale computingDMFTri-lab collaborationFiber Bundles
  • Al Fleig in 1990 took me to a hallway at NASA where there were racks upon racks of shelves containing old magnetic tapes. Al said to me, “Mike, do you see all of those tapes. Some of them are decades old. They contain priceless data that can help us understand our planet as a system. And Mike, guess what, we don’t have any way to get to the data on most of those tapes because we can’t find the information we need to decipher them. Is there some way with HDF that we can put information at the start of the file – a name, a phone number, anything – that would give us a fighting chance to figure out that information?”That conversation with Al stuck in my mind from that day forward. When it came time to redesign HDF by creating HDF5, one of the things we did was introduce the use of a user block, so that someone could put their name, or anything else they wanted to, at the beginning of a file, so that the creator or someone else can provide information that will give posterity a fighting chance to figure out what’s in the file.
  • DNA sequencing (Geospiza)
  • Electron tomography
  • Sony Imageworks’ Field3D uses HDF5 as its format.HDF5 was used in the making of Lord of The Rings
  • The Fiddler is a metaphor for survival, through tradition and joyfulness, in a life of uncertainty and imbalance.
  • To broaden the base of supporters, thus reaching a threshold support for HDF5 that will guarantee sustainabilityAnd/or to reach a point where the technology is perceived as a public good that must be sustained.Broaden the base - increase the need for long-term supportDiverse application domainsDiverse institutional types (govt, commercial, academic)VendorsMore large, stable institutional use and supportWhole product supportToolstechnology interoperability (iRODS, opendap, XML, RDBMS, MATLAB, ...)Add enough legs to the stool...To broaden the base of supporters, thus reaching a threshold support for HDF5 that will guarantee sustainabilityAnd/or to reach a point where the technology is perceived as a public good that must be sustained.
  • A simple, durable but evolvable model and implementationSelf-descriptionSpecification documentationPreservation-based evolutionProviding different ways to view the same informationIntegration with preservation frameworks
  • Avogadro’s number – the number of carbon atoms in 12 grams – is 602,200,000,000,000,000,000,000In 15 years the number of bits in the digital universe will surpass Avogadro’s number.* * The digital universe.
  • The world&apos;s fastest supercomputer today, a Cray XT5 system at Oak Ridge National Laboratory that&apos;s known as Jaguar, has a peak performance of 2.3 petaflops. A petaflop is a quadrillion, or 1,000 trillion, sustained floating-point operations per second.The total capacity of the latest Top500 list of the most powerful supercomputers, released at SC09, was 27.6 petaflops, up from 22.6 petaflops in the previous list, released in June.One exaflop is 1,000 times faster than a petaflop -- performing 1 quintillion, or 1 million trillion calculations per second. &quot;We think exascale is a 100 million-core kind of enterprise,&quot; said Dave Turek, vice president of deep computing at IBM.In mid-2008, IBM&apos;s Roadrunner supercomputer -- a hybrid system that runs both AMD&apos;s Opteron processors and Cell chips designed by IBM, Toshiba Corp. and Sony Corp. -- was the first to achieve petaflop speeds. Now the U.S. Department of Energy has started making plans to build an exascale system that&apos;s 1,000 times more powerful than Jaguar.These future systems must use less memory per core and more memory bandwidth. Systems running 100 million cores will face continuous core failures, and the tools for dealing with them will have to be rethought &quot;in a dramatic kind of way,&quot; said Turek.
  • &quot;Evolve with compatibility&quot;Develop guidelines to keep evolution under controlDevelop process to ensure cross-generational compatibility
  • &quot;Evolve with compatibility&quot;Develop guidelines to keep evolution under controlDevelop process to ensure cross-generational compatibility
  • Emphasis on standards. Organization and with user communities emphasize the importance of developing and adhering to standards.Make HDF5 itself a national and international standard, and important building block to preservation.Foster standard uses of HDF5 so that more and more diverse groups can share and integrate dataPromote standard usage within domainsExamplesHDF-EOSCGNSHDF Time history (Aerospace)NeXuSBioHDFcomponentsUnified data modelAPI and implementation (preferably multi-language)ToolsLots of data
  • Long-term institutional supportOne keeper of the format and softwareA mission-driven businessOpen sourceFree as in speech, not as inCross the chasm to new users and applicationsPromoting standardization
  • Community-based, created for and supported by vast user base who constantly test HDF, demonstrate its countless uses, help improve and promote it. Open source lowers barriers to basic accessKnowledge : format and source code available Economic: format, basic library, tools all freeIP: applications built on HDF not encumbered by IP requirements
  • Become a sustainable institutionCreate independent, self-sustaining institutional supportDefine the mission and visionEstablish organization that is mission drivenEstablish a mindset that values long-term preservation mission
  • Find a business model that builds assets and is sustainableFind the right IP strategy that balances openness with stewardshipDevelop sustainability assets: knowledge, people, finances
  • Emphasis on standards. Organization and with user communities emphasize the importance of developing and adhering to standards.Make HDF5 itself a national and international standard, and important building block to preservation.Foster standard uses of HDF5 so that more and more diverse groups can share and integrate dataPromote standard usage within domainsExamplesHDF-EOSCGNSHDF Time history (Aerospace)NeXuSBioHDFcomponentsUnified data modelAPI and implementation (preferably multi-language)ToolsLots of data
  • The HDF Group - Past, Present and Future

    1. 1. The HDF Group HDF Past, Present, Future Mike Folk The HDF Group The 14th HDF and HDF-EOS Workshop September 28-30, 2010 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 1 www.hdfgroup.org
    2. 2. The HDF Group September 28-30, 2010 HDF/HDF-EOS Workshop XIV 2 www.hdfgroup.org
    3. 3. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 3 www.hdfgroup.org
    4. 4. NCSA 1986 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 4 www.hdfgroup.org
    5. 5. GFTF Oct 28, 1987 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 5 www.hdfgroup.org
    6. 6. GFTF Oct 28, 1987 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 6 www.hdfgroup.org
    7. 7. GFTF Nov 9, 1987 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 7 www.hdfgroup.org
    8. 8. GFTF Nov 9, 1987 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 8 www.hdfgroup.org
    9. 9. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 9 www.hdfgroup.org
    10. 10. Library • Version 1 – 1988 • Primitive objects • “raster,” “palette”, “aspect ratio” • “sets” or groupings to form higher level objects • “raster image set” • Version 2 – 1989 • Scientific data sets • 24-bit raster September 28-30, 2010 HDF/HDF-EOS Workshop XIV 10 www.hdfgroup.org
    11. 11. Library • Version 3 – 1990 • Subsetting • Vertex sets (Vsets) • Groups (Vgroups), and tables (Vdatas) • Version 4 – 1996 • Full multiple file, multiple object access September 28-30, 2010 HDF/HDF-EOS Workshop XIV 11 www.hdfgroup.org
    12. 12. Command line tools September 28-30, 2010 HDF/HDF-EOS Workshop XIV 12 www.hdfgroup.org
    13. 13. NCSA software Big simulations with HDF Desktop visualization with “NCSA Image” Desktop visualization with PolyView September 28-30, 2010 HDF/HDF-EOS Workshop XIV 13 www.hdfgroup.org
    14. 14. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 14 www.hdfgroup.org
    15. 15. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 15 www.hdfgroup.org
    16. 16. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 16 www.hdfgroup.org
    17. 17. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 17 www.hdfgroup.org
    18. 18. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 18 www.hdfgroup.org
    19. 19. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 19 www.hdfgroup.org
    20. 20. NetCDF Harmonization September 28-30, 2010 HDF/HDF-EOS Workshop XIV 20 www.hdfgroup.org
    21. 21. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 21 www.hdfgroup.org
    22. 22. Other adopters of HDF September 28-30, 2010 HDF/HDF-EOS Workshop XIV 22 www.hdfgroup.org
    23. 23. Other adopters of HDF September 28-30, 2010 HDF/HDF-EOS Workshop XIV 23 www.hdfgroup.org
    24. 24. Other adopters of HDF Non-destructive testing September 28-30, 2010 HDF/HDF-EOS Workshop XIV 24 www.hdfgroup.org
    25. 25. Earth Observing System September 28-30, 2010 HDF/HDF-EOS Workshop XIV 25 www.hdfgroup.org
    26. 26. Earth Science (Earth Observing System) Aqua (6/01) Terra CERES MISR MODIS September 28-30, Aqua CERES MODIS AMSR Aura TES HRDLS MLS OMI MOPITT www.hdfgroup.org
    27. 27. Message: HDF needs to support mission critical applications with high quality and performance standards September 28-30, 2010 HDF/HDF-EOS Workshop XIV 27 www.hdfgroup.org
    28. 28. A need for change? Shortcomings of HDF (1996) • • • • • Limits on object & file size (<2GB) Limited number of objects (<20K) Rigid data models I/O performance Code complexity September 28-30, 2010 HDF/HDF-EOS Workshop XIV 28 www.hdfgroup.org
    29. 29. NCSA Access, Spring 1996 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 29 www.hdfgroup.org
    30. 30. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 30 www.hdfgroup.org
    31. 31. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 31 www.hdfgroup.org
    32. 32. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 32 www.hdfgroup.org
    33. 33. ASCI = Accelerated Strategic Computing Initiative We Have A Nuclear Test Ban Treaty How do we maintain a nuclear stockpile in the absence of testing? September 28-30, 2010 HDF/HDF-EOS Workshop XIV 33 www.hdfgroup.org
    34. 34. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 34 www.hdfgroup.org
    35. 35. Big simulations A simulation can have billions of elements Each element can have dozens of associated values September 28-30, 2010 HDF/HDF-EOS Workshop XIV 35 www.hdfgroup.org
    36. 36. ASCI Data models and Formats Group September 28-30, 2010 HDF/HDF-EOS Workshop XIV 36 www.hdfgroup.org
    37. 37. Describing data is challenging September 28-30, 2010 HDF/HDF-EOS Workshop XIV 37 www.hdfgroup.org
    38. 38. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 38 www.hdfgroup.org
    39. 39. HDF audience (1997) • • • • Applications facing big data challenges Academia, government, industry Hundreds of different applications Users world-wide September 28-30, 2010 HDF/HDF-EOS Workshop XIV 39 www.hdfgroup.org
    40. 40. Something is missing September 28-30, 2010 HDF/HDF-EOS Workshop XIV 40 www.hdfgroup.org
    41. 41. What is on these tapes? September 28-30, 2010 HDF/HDF-EOS Workshop XIV 41 www.hdfgroup.org
    42. 42. Message: Communities are committing critically important data to HDF for the long term, and expect it to last. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 42 www.hdfgroup.org
    43. 43. The HDF Group September 28-30, 2010 HDF/HDF-EOS Workshop XIV 43 www.hdfgroup.org
    44. 44. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 44 www.hdfgroup.org
    45. 45. R&D 100 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 45 www.hdfgroup.org
    46. 46. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 46 www.hdfgroup.org
    47. 47. CHANGING USER PROFILE September 28-30, 2010 HDF/HDF-EOS Workshop XIV 47 www.hdfgroup.org
    48. 48. Flight testing September 28-30, 2010 HDF/HDF-EOS Workshop XIV 48 www.hdfgroup.org
    49. 49. Vehicle testing September 28-30, 2010 HDF/HDF-EOS Workshop XIV 49 www.hdfgroup.org
    50. 50. Bioinformatics September 28-30, 2010 HDF/HDF-EOS Workshop XIV 50 www.hdfgroup.org
    51. 51. Images 25-80Å resolution electron tomography 8k x 8k x 1k images soon (256 GB) September 28-30, 2010 HDF/HDF-EOS Workshop XIV 51 www.hdfgroup.org
    52. 52. Making movies Spiderman 3 September 28-30, 2010 The Polar Express HDF/HDF-EOS Workshop XIV 52 www.hdfgroup.org
    53. 53. New expectations • • • • “Deliverables” “What about my data in 2080?” How soon can you do this for me? Business opportunities and the academy September 28-30, 2010 HDF/HDF-EOS Workshop XIV 53 www.hdfgroup.org
    54. 54. Doing business in academia preservation? Data We deliver papers, not software. Talk to the librarian. I can do that for you maybe by next year. No profits allowed here! September 28-30, 2010 HDF/HDF-EOS Workshop XIV 54 www.hdfgroup.org
    55. 55. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 55 www.hdfgroup.org
    56. 56. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 56 www.hdfgroup.org
    57. 57. Missions and Goals • The five missions • • • • • Public Software Service Human Financial/Structural September 28-30, 2010 HDF/HDF-EOS Workshop XIV 57 www.hdfgroup.org
    58. 58. HDF Group Mission To ensure long-term accessibility of HDF data through sustainable development and support of HDF technologies. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 58 www.hdfgroup.org
    59. 59. • Business options and questions • For-Profit or not? • How to make money? • Intellectual property Spinning off September 28-30, 2010 HDF/HDF-EOS Workshop XIV 59 www.hdfgroup.org
    60. 60. Help from an unexpected place September 28-30, 2010 HDF/HDF-EOS Workshop XIV 60 www.hdfgroup.org
    61. 61. The HDF Group Running our Business: Challenges and Surprises September 28-30, 2010 HDF/HDF-EOS Workshop XIV 61 www.hdfgroup.org
    62. 62. Challenges • Managing contracts • Finance • Keeping overhead under control • Defining “profit” • Accounting and budgeting expertise • Business model September 28-30, 2010 HDF/HDF-EOS Workshop XIV 62 www.hdfgroup.org
    63. 63. Today vs. 2006 2006 2010 Staff 17 34 Funded projects Budget 6 13 $1.6M $3.4M September 28-30, 2010 HDF/HDF-EOS Workshop XIV 63 www.hdfgroup.org
    64. 64. The HDF Group September 28-30, 2010 HDF/HDF-EOS Workshop XIV 64 www.hdfgroup.org
    65. 65. The near future September 28-30, 2010 HDF/HDF-EOS Workshop XIV 65 www.hdfgroup.org
    66. 66. Cross the chasm to new users and applications Time September 28-30, 2010 HDF/HDF-EOS Workshop XIV 66 www.hdfgroup.org
    67. 67. The near future • • • • From technology driven to market driven Raising the open source quality bar Expanding our ability to help customers Expanding the kinds of things we're good at September 28-30, 2010 HDF/HDF-EOS Workshop XIV 67 www.hdfgroup.org
    68. 68. The future September 28-30, 2010 HDF/HDF-EOS Workshop XIV 68 www.hdfgroup.org
    69. 69. TECHNOLOGY STRATEGIES September 28-30, 2010 HDF/HDF-EOS Workshop XIV 69 www.hdfgroup.org
    70. 70. Lots of data September 28-30, 2010 HDF/HDF-EOS Workshop XIV 70 www.hdfgroup.org
    71. 71. Big data Cores Petaflops 224,162 1.759 Image courtesy of the National Center for Computational Sciences, Oak Ridge National Laboratory”. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 71 www.hdfgroup.org
    72. 72. Kinds of data September 28-30, 2010 HDF/HDF-EOS Workshop XIV 72 www.hdfgroup.org
    73. 73. GFTF Nov 9, 1987 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 73 www.hdfgroup.org
    74. 74. A focus on Preservation Darwin’s first evolutionary tree - 183 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 74 www.hdfgroup.org
    75. 75. Preservationbased evolution Darwin’s first evolutionary tree - 183 September 28-30, 2010 HDF/HDF-EOS Workshop XIV 75 www.hdfgroup.org
    76. 76. Promoting standardization and interoperability September 28-30, 2010 HDF/HDF-EOS Workshop XIV 76 www.hdfgroup.org
    77. 77. Institutional strategies September 28-30, 2010 HDF/HDF-EOS Workshop XIV 77 www.hdfgroup.org
    78. 78. A missiondriven business September 28-30, 2010 HDF/HDF-EOS Workshop XIV 78 www.hdfgroup.org
    79. 79. One keeper of the format and software September 28-30, 2010 HDF/HDF-EOS Workshop XIV 79 www.hdfgroup.org
    80. 80. Open source September 28-30, 2010 HDF/HDF-EOS Workshop XIV 80 www.hdfgroup.org
    81. 81. Long-term institutional support The National Archives, Washington, D.C. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 81 www.hdfgroup.org
    82. 82. Human, financial, legal foundations for sustainability September 28-30, 2010 HDF/HDF-EOS Workshop XIV 82 www.hdfgroup.org
    83. 83. Business model September 28-30, 2010 HDF/HDF-EOS Workshop XIV 83 www.hdfgroup.org
    84. 84. A virtual organization September 28-30, 2010 HDF/HDF-EOS Workshop XIV 84 www.hdfgroup.org
    85. 85. Thank You September 28-30, 2010 HDF/HDF-EOS Workshop XIV 85 www.hdfgroup.org
    86. 86. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 86 www.hdfgroup.org
    87. 87. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 87 www.hdfgroup.org
    88. 88. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 88 www.hdfgroup.org
    89. 89. September 28-30, 2010 HDF/HDF-EOS Workshop XIV 89 www.hdfgroup.org

    ×