F# Data
Making structured data first-class citizens
Tomas Petricek, University of Cambridge
Project homepage: http://fshar...
F# Software Foundation
http://www.fsharp.org
software stacks
trainings teaching F# user groups snippets
mac and linux cros...
F# Data type providers
First-class data
CSV, REST, WorldBank…
R Type provider
Statistics & visualization
5000 tested packa...
Deedle data frame
Data exploration
Indexing and aggregation
F# Charting library
Simple & composable
Interactive style
www....
What are type providers?
Integrating WorldBank and R
http://youtu.be/7r2-B-5H_io
The confusion of languages
What are type providers?
What are type providers?
Type provider research questions
Data vs.
Schema
Laziness
Mapping
to types
Schema
inference
Schema
inference
Schema inference
Loading Titanic data from CSV
http://youtu.be/yjBdZduc0ko
Inferring primitive types
null intbool
string
decimal
float
Structure inference
Working with XML and JSON data
http://youtu.be/_DjX0ybaXZY
http://youtu.be/SkZBzlREOMo
Inferring structured types
person { name : string } person { name : string, age : int }
person { name : string, age : int ...
Does it scale?
Query movies using Apiary provider
http://youtu.be/-Am2uRUv39c
Conclusions
Inference from small-scale samples works!
Schema is (very) often missing
But data is (very) often regular
Chec...
Upcoming SlideShare
Loading in …5
×

F# Data: Making structured data first class citizens

1,035
-1

Published on

Slides from a talk at DCP 2014 workshop, about F# Data type providers. For live code samples, see the YouTube links in the slides!

Published in: Technology, Education
1 Comment
5 Likes
Statistics
Notes
  • the only way to fly
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
1,035
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
10
Comments
1
Likes
5
Embeds 0
No embeds

No notes for slide

F# Data: Making structured data first class citizens

  1. 1. F# Data Making structured data first-class citizens Tomas Petricek, University of Cambridge Project homepage: http://fsharp.github.io/FSharp.Data Get in touch: @tomaspetricek | tomas@tomasp.net
  2. 2. F# Software Foundation http://www.fsharp.org software stacks trainings teaching F# user groups snippets mac and linux cross-platform tutorials F# community open-source MonoDevelop contributions research support consultancy mailing list
  3. 3. F# Data type providers First-class data CSV, REST, WorldBank… R Type provider Statistics & visualization 5000 tested packages www.fslab.org
  4. 4. Deedle data frame Data exploration Indexing and aggregation F# Charting library Simple & composable Interactive style www.fslab.org
  5. 5. What are type providers? Integrating WorldBank and R http://youtu.be/7r2-B-5H_io
  6. 6. The confusion of languages
  7. 7. What are type providers?
  8. 8. What are type providers?
  9. 9. Type provider research questions Data vs. Schema Laziness Mapping to types Schema inference Schema inference
  10. 10. Schema inference Loading Titanic data from CSV http://youtu.be/yjBdZduc0ko
  11. 11. Inferring primitive types null intbool string decimal float
  12. 12. Structure inference Working with XML and JSON data http://youtu.be/_DjX0ybaXZY http://youtu.be/SkZBzlREOMo
  13. 13. Inferring structured types person { name : string } person { name : string, age : int } person { name : string, age : int option } [ { num : int } ] [ { str : string } ] [ { num : int option, str : string option } ] int { value : int } int + { value : int }
  14. 14. Does it scale? Query movies using Apiary provider http://youtu.be/-Am2uRUv39c
  15. 15. Conclusions Inference from small-scale samples works! Schema is (very) often missing But data is (very) often regular Check out F# Data and contribute! Project homepage: http://fsharp.github.io/FSharp.Data Get in touch: @tomaspetricek | tomas@tomasp.net
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×