Download as PDF, PPTX
![https://github.com/jeresig/i18n-node-2
var greeting = i18n.__('Hello %s, how are you
today?', 'Marcus');
i18n.__n('%s cat', '%s cats', 3);
Node i18n 2 (npm install i18n-2)
setLocaleFromSubdomain([request])](https://image.slidesharecdn.com/empirejs-140514213825-phpapp01/75/EmpireJS-Hacking-Art-with-Node-js-and-Image-Analysis-26-2048.jpg)
![module.exports = function() {!
return {!
scrape: [!
{!
start: "http://ukiyo-e.org/search",!
visit: "//a[@class='img']",!
next: "//a[contains(@rel,'next')]"!
},!
{!
extract: {!
"title": "//p[contains(@class, 'title')]//span",!
"dateCreated": "//p[contains(@class, 'date')]//span",!
"artists[]": "//p[contains(@class, 'artist')]//a",!
"images[]": "//div[contains(@class,'imageholder')]//a/@href"!
}!
}!
]!
};!
};!](https://image.slidesharecdn.com/empirejs-140514213825-phpapp01/75/EmpireJS-Hacking-Art-with-Node-js-and-Image-Analysis-34-2048.jpg)
!["surname" : "Hashimoto",
"surname_kana" : "はしもと",
"name" : "Hashimoto Okiie",
"ascii" : "Hashimoto Okiie",
"plain" : "Hashimoto Okiie",
"kana" : "はしもとおきいえ",
"_id" : ObjectId("530c0825d9a80976b2000437")
}
],
"names" : [
{
"original" : "Hashimoto Okiie (橋本興家)",
"locale" : "ja",
"kanji" : "橋本興家",
"given" : "Okiie",
"given_kana" : "おきいえ",
"surname" : "Hashimoto",
"surname_kana" : "はしもと",
"given_kanji" : "興家",
"surname_kanji" : "橋本",
"name" : "Hashimoto Okiie",
"ascii" : "Hashimoto Okiie",
"plain" : "Hashimoto Okiie",
"kana" : "はしもとおきいえ",
"_id" : ObjectId("530c0825d9a80976b2000439")
}
],
"extract" : [
"53dfc997cbf9fa7501d78e4820b24a9c"
],
"created" : ISODate("2014-02-25T03:04:05Z"),
"__v" : 0
}](https://image.slidesharecdn.com/empirejs-140514213825-phpapp01/75/EmpireJS-Hacking-Art-with-Node-js-and-Image-Analysis-35-2048.jpg)
Uploaded byjeresig
EmpireJS: Hacking Art with Node js and Image Analysis
The document discusses using computer vision and Node.js to analyze Japanese artworks like woodblock prints. It describes collecting data on prints through web scraping, processing the data with tools like PhantomJS, and using image analysis to aid studies of prints by correcting metadata and matching images. The goal is to build a website that facilitates research on ukiyo-e prints through techniques like similarity search and automated data cleaning.
EmpireJS: Hacking Art with Node js and Image Analysis
- 1. Analyzing Japanese Art with Node.js andComputer Vision John Resig
- 17. Lot 55: 20Japanese Woodblock Prints Each depicting a female/Geisha figure with calligraphy throughout each print. Prints measure 13.75" H x 9.375" W. Toning to each print, some losses around edges. Estimated Price: $400 - $600
- 18. Step 1: Acquireand read tons of expensive books.
- 19. Step 2: Learnto read Japanese. * Japanese from the 17th to 19th century. * You’re not going to learn this from Rosetta Stone.
- 20. Step 3: Learnto read Japanese calligraphy.
- 21. Solution: A fast-loading,responsive, i18ned, web site: Ukiyo-e.org
- 26. https://github.com/jeresig/i18n-node-2 var greeting =i18n.__('Hello %s, how are you today?', 'Marcus'); i18n.__n('%s cat', '%s cats', 3); Node i18n 2 (npm install i18n-2) setLocaleFromSubdomain([request])
- 27. https://github.com/jeresig/i18n-node-2 {! "Hello": "Hello",! "Hello %s,how are you today?": "Hello %s, how are you today?",! "weekend": "weekend",! "Hello %s, how are you today? How was your %s.": "Hello %s, how are you today? How was your %s.",! "Hi": "Hi",! "Howdy": "Howdy",! "%s cat": {! "one": "%s cat",! "other": "%s cats"! },! "There is one monkey in the %%s": {! "one": "There is one monkey in the %%s",! "other": "There are %d monkeys in the %%s"! },! "tree": "tree"! }! Node i18n 2 (npm install i18n-2)
- 28. Digital Ocean Amazon S3 AmazonCloudfront Digital Ocean Images Data (HTML, XML, JSON) Images JS, CSS Images JS, CSS nginx (w/ cache) node.js express node.js express naught mongodb Elastic Search Scraper
- 30.
- 31. Collecting Tons ofWoodblock Print Data
- 32. Search Page Page Page HTML Image HTML Image HTML Image Search PagePage Page HTML Image HTML Image HTML Image Queue-based Crawling using PhantomJS Processing Queue
- 33. Some Website WebKit PhantomJS CasperJS SpookyJS Save Data XMLFiles Mongo Log libxml (+ xpath) MongoDB Extract Data Process Data Artists Images Correct Artist and Date Add to Site!
- 34. module.exports = function(){! return {! scrape: [! {! start: "http://ukiyo-e.org/search",! visit: "//a[@class='img']",! next: "//a[contains(@rel,'next')]"! },! {! extract: {! "title": "//p[contains(@class, 'title')]//span",! "dateCreated": "//p[contains(@class, 'date')]//span",! "artists[]": "//p[contains(@class, 'artist')]//a",! "images[]": "//div[contains(@class,'imageholder')]//a/@href"! }! }! ]! };! };!
- 35. "surname" : "Hashimoto", "surname_kana": "はしもと", "name" : "Hashimoto Okiie", "ascii" : "Hashimoto Okiie", "plain" : "Hashimoto Okiie", "kana" : "はしもとおきいえ", "_id" : ObjectId("530c0825d9a80976b2000437") } ], "names" : [ { "original" : "Hashimoto Okiie (橋本興家)", "locale" : "ja", "kanji" : "橋本興家", "given" : "Okiie", "given_kana" : "おきいえ", "surname" : "Hashimoto", "surname_kana" : "はしもと", "given_kanji" : "興家", "surname_kanji" : "橋本", "name" : "Hashimoto Okiie", "ascii" : "Hashimoto Okiie", "plain" : "Hashimoto Okiie", "kana" : "はしもとおきいえ", "_id" : ObjectId("530c0825d9a80976b2000439") } ], "extract" : [ "53dfc997cbf9fa7501d78e4820b24a9c" ], "created" : ISODate("2014-02-25T03:04:05Z"), "__v" : 0 }
- 36.
- 37.
- 38.
- 47.
- 54. Idyll: Offline ImageCropping • https://github.com/jeresig/idyll • Crop images offline and on a mobile device. • Saves the selections back to a server. • Data is synced and saved using HTML 5 appcache. • https://github.com/jeresig/node- appcache-glob
- 55. by David Chester atShutterstock https://github.com/dchester/perl-image-crop-calibration-target
- 56.
- 57. Aiding Woodblock Print Studieswith Image Analysis
- 68.
- 69. Japanese Names • UtagawaHiroshige • Ando Hiroshige • Andō Hiroshige • Hiroshige • 歌川広重 • 広重
- 70.
- 71.
- 72.
- 73. Sharaku Toshusai 東洲斎写楽 Is thisthe family name? Where are the stress marks? How do you “split” this name? Which name parts correlate?
- 74. Tools (all areNode modules!) • https://github.com/lovell/ hepburn • https://github.com/jeresig/ node-enamdict • https://github.com/jeresig/ node-ndlna • https://github.com/jeresig/ node-romaji-name ndlnahepburn enamdict romaji-name
- 75. Hepburn • https://github.com/lovell/ hepburn • Takesin the English form of a Japanese word. • Returns it written in Hiragana or Katakana (phonetic Japanese alphabets). ndlnahepburn enamdict romaji-name うたがわひろしげUtagawa Hiroshige
- 76. Enamdict • https://github.com/jeresig/ node-enamdict • Downloadsand queries the ENAMDICT database • (A mapping of Japanese proper names to Hiragana and English.) • Used to correct typos and figure out surname/given name. ndlnahepburn enamdict romaji-name
- 77. NDLNA • https://github.com/jeresig/ node-ndlna • Queriesthe NDLNA database • Finds the correct Kanji for an English name. • Or the correct English for a Kanji name. ndlnahepburn enamdict romaji-name
- 78.
- 79. { "original" : "SharakuToshusai (東洲斎写楽 )", "locale" : "ja", "kanji" : "東洲斎写楽", "given" : "Sharaku", "given_kana" : "しゃらく", "surname" : "Tōshūsai", "surname_kana" : "とおしゅうさい", "surname_kanji" : "東洲斎", "given_kanji" : "写楽", "name" : "Tōshūsai Sharaku", "ascii" : "Tooshuusai Sharaku", "plain" : "Toshusai Sharaku", "kana" : "とおしゅうさいしゃらく" }
- 80. Dates • https://github.com/jeresig/node-yearrange var yr= require("yearrange");! " yr.parse("1877")! // {"start": 1877, "end": 1877}! " yr.parse("1847-48")! // {"start": 1847, "end": 1848}! " yr.parse("ca. 1810-20s")! // {"start": 1810, "end": 1829, "circa": true}! " yr.parse("18th–19th century")! // {"start": 1700, "end": 1899}! " yr.parse("Meiji era")! // {"start": 1868, "end": 1912}
- 81.
- 84. Miyagawa Shuntei Printed in1897 Sold for: $550 Prints sell for $100-$400 individually True Estimate: $2100 - $8400 * * You just have to find someone willing to buy them!
- 86. • http://ejohn.org/research/ • http://ukiyo-e.org/ •https://github.com/jeresig