Big Data Semantic Folding - Dr. Gerald Loeffler, Head of Development at Cortical.io

1. © cortical.io inc. 2016 big data semantic fingerprinting head of development dr gerald loeffler g_loeffler@cortical.io

2. ©cortical.ioinc.2016 contents • technology • semantic folding • semantic fingerprinting • semantic similarity • Retina Spark • applications • semantic search • semantic text classification • streaming semantic text classification

3. ©cortical.ioinc.2016 semantic folding

4. ©cortical.ioinc.2016 semantic fingerprinting

5. ©cortical.ioinc.2016 semantic similarity

6. ©cortical.ioinc.2016 Retina Spark

7. ©cortical.ioinc.2016 semantic search

8. ©cortical.ioinc.2016 semantic search // Retina to be used is passed as an implicit parameter val fingerprintedDocs = docs.map { case (id, text) => (id, text, getFingerprint(text)) } val docDB = PartitionedDocumentDb(sc, fingerprintedDocs) val results = docDB.search("arbitrary query text", 10)

9. ©cortical.ioinc.2016 semantic text classiﬁcation // Retina to be used is passed as an implicit parameter val classifier = SemanticTextClassifier(labelledTrainingTexts) val prediction = classifier.classify("unlabelled and previously unseen text") (*) Author: malevolentjelly, Created:1288727262 Corpus: https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ For instance, the label predicted for this Reddit comment(*) was Economics (but it appeared in the Technology subreddit): This is why we codify our laws, so that your opinion of okay doesn't deﬁne legal. Not saying mine does, but when we get together and codify things, at least we let everybody know this is our low bar for okay. Google's motto is not "don't break the law". I believe that a companies contribution to our (US) government in the form of taxes is a poor criteria for judging of evil-ness. Unless they're notably dodging taxes, that is. Enough so to be distinct. And that doesn't take into account how the Irish, Dutch, and Bermudians feel about large corporations setting up head quarters in their countries. Clearly these people decided that if they lowered their taxes, more companies would come to them, leading to more jobs and revenue. While we (US) decided that we should raise the taxes to increase revenue. It isn't like Bermuda just forgot about raising their corporate revenue tax. And that's why countries like Ireland and Bermuda have so little to offer their citizens. Is that why Ireland is the UK's economic powerhouse?