The document discusses challenges in data management across different environments, particularly in Ruby on Rails. It introduces a tool called Polo that helps generate realistic test data for development environments by utilizing ActiveRecord associations. The tool is open to contributions and supports multiple database systems, aiming to streamline the process of working with real-world data in development.

1. POLO
WORKINGWITHREALWORLDDATAIN
DEVELOPMENT
@nettofarah
1 / 39

2. nettofarah
github.com/nettofarah
@nettofarah
http://bit.ly/polo-rb
2 / 39

3. RealWorldProductionDatain
Development
3 / 39

4. BecauseManagingDataishard
Especially across Different environments
4 / 39

5. Datain Rails.env.dev
is...
Ugly, Incomplete, Weird and Biased
5 / 39

6. SomeConsequencesofInconsistent
Data
6 / 39

7. !"!",##misalignment,form
validation,specialcharacters$$
7 / 39

8. TheWorstConsequence
8 / 39

9. Rails.env.dev
will look %
9 / 39

10. Buthowdopeoplesolvethese
problems?
10 / 39

11. Wecantestitin PRODUCTION
11 / 39

12. Rails.env.staging ?
12 / 39

13. Custom db/migrations
fordata
13 / 39

14. rake db:seed
14 / 39

15. CSVsandSpreadsheets
15 / 39

16. 16 / 39

17. SampleDatabaseSnapshots
17 / 39

18. Your good ol'
ActiveRecord::Associations
to
.sql
18 / 39

19. POLOletsyouturnthis...
19 / 39

20. class Chef < ActiveRecord::Base
has_many :recipes
has_many :ingredients, through: :recipes
end
class Recipe < ActiveRecord::Base
has_many :recipes_ingredients
has_many :ingredients, through: :recipes_ingredients
end
class Ingredient < ActiveRecord::Base
end
class RecipesIngredient < ActiveRecord::Base
belongs_to :recipe
belongs_to :ingredient
end
20 / 39

21. Intothis...
21 / 39

22. inserts = Polo.explore(Chef, 1)
# Chef -> ActiveRecord::Base object
# 1 -> Database ID. (Chef with ID 1)
INSERT INTO `chefs` (`id`, `name`)
VALUES (1, 'Netto')
22 / 39

23. Itworkswithassociationstoo
23 / 39

24. inserts = Polo.explore(Chef, 1, :recipes)
# :recipes ->
# ActiveRecord::Associations::HasManyAssociation
#
# a Chef has many Recipes
INSERT INTO `chefs` (`id`, `name`)
VALUES (1, 'Netto')
INSERT INTO `recipes`
(`id`, `title`, `num_steps`, `chef_id`)
VALUES
(1, 'Turkey Sandwich', NULL, 1)
INSERT INTO `recipes`
(`id`, `title`, `num_steps`, `chef_id`)
VALUES
(2, 'Cheese Burger', NULL, 1)
24 / 39

25. Italsoworkswithnested
associations
25 / 39

26. inserts = Polo.explore(Chef, 1, { :recipes => :ingredients })
# { :recipes => :ingredients } ->
# load every recipe and ingredientes
...
INSERT INTO `recipes` (`id`, `title`, `num_steps`, `chef_id`)
VALUES (1, 'Turkey Sandwich', NULL, 1)
INSERT INTO `recipes` (`id`, `title`, `num_steps`, `chef_id`)
VALUES (2, 'Cheese Burger', NULL, 1)
INSERT INTO `recipes_ingredients`
(`id`, `recipe_id`, `ingredient_id`)
VALUES (1, 1, 1)
INSERT INTO `recipes_ingredients`
(`id`, `recipe_id`, `ingredient_id`)
VALUES (2, 1, 2)
...
INSERT INTO `ingredients` (`id`, `name`, `quantity`)
VALUES (1, 'Turkey', 'a lot')
INSERT INTO `ingredients` (`id`, `name`, `quantity`)
VALUES (2, 'Cheese', '1 slice')
...
26 / 39

27. &&
Showmethemagic!
27 / 39

28. Collectalltheobjects
lib/polo/collector.rb#L16
28 / 39

29. asn = ActiveSupport::Notifications
# Extracted so this can fit in a slide
asn.subscribed(collector, 'sql.active_record') do
# Set up ActiveRecord::Preloader
base_finder = @base_class.
includes(@dependency_tree)
.where(id: @id)
# Store SELECTS in some global storage
collect_sql(@base_class, base_finder.to_sql)
end
29 / 39

30. ''
TransformthemtoSQL
lib/polo/sql_translator.rb#51
30 / 39

31. attributes = record.attributes
keys = attributes.keys.map do |key|
"`#{key}`"
end
values = attributes.map do |key, value|
column = record.column_for_attribute(key)
attribute = cast_attribute(record, column, value)
connection.quote(attribute)
end
joined_keys = keys.join(', ')
joined_values = values.join(', ')
table_name = record.class.table_name
"INSERT INTO `#{table_name}`" +
" (#{joined_keys}) VALUES (#{joined_values})"
31 / 39

32. PROFIT!((
32 / 39

33. Ineedyourhelp!))
33 / 39

34. onGithub
http://github.com/IFTTT/polo
34 / 39

35. PullRequests**
35 / 39

36. PostgreSQL,SQLiteandOracle
support
(advanced features only, basic usage still
works)
36 / 39

37. ActiveRecord<3.2support
37 / 39

38. Checkoutsomeotherreallycool
OpenSourceprojects
http://ifttt.github.io
38 / 39

39. Questions?
39 / 39