SlideShare a Scribd company logo
Analytic Innovation:
Transforming Instagram Data
Into Predictive Analytics
Suresh.sood@uts.edu.au or linkedin.com/in/sureshsood
Xinhua.zhu@uts.edu.au or linkedin.com/pub/xinhua-zhu/27/448/621
Useful References Informing our Thinking
(Silva et al (2013) A comparison of Foursquare and Instagram to the study of city
dynamics and urban social behavior, Proceedings of the 2nd ACM SIGKDD
International Workshop on Urban Computing
Instagram and Foursquare datasets might be compatible in finding popular regions of
city
Chaoming Song, et al. (2010), Limits of Predictability in Human Mobility, Science
There is a potential 93% average predictability in user mobility, an exceptionally high
value rooted in the inherent regularity of human behavior. Yet it is not the 93%
predictability that we find the most surprising. Rather, it is the lack of variability in
predictability across the population.
Scellato et al. (2011), NextPlace: A Spatio-temporal Prediction Framework for
Pervasive Systems. Proceedings of the 9th International Conference on Pervasive
Computing (Pervasive'11)
Daily and weekly routines => Few significant places every day => Regularity in human
activities => Regularity leads to predictability
Useful References Informing our Thinking
Domenico, A. Lima, Musolesi.M. (2012) Interdependence and Predictability of Human
Mobility and Social Interactions. Proceedings of the Nokia Mobile Data Challenge
Workshop.
we have shown that it is possible to exploit the correlation between movement data and
social interactions in order to improve the accuracy of forecasting of the future geographic
position of a user. In particular, mobility correlation, measured by means of mutual
information, and the presence of social ties can be used to improve movement forecasting
by exploiting mobility data of friends. Moreover, this correlation can be used as indicator of
potential existence of physical or distant social interactions and vice versa.
Sadilek, A and Krumm, J. (2012) Far Out: Predicting Long-Term Human Mobility
Where are you going to be 285 days from now at 2pm …we show that it is possible to
predict location of a wide variety of hundreds of subjects even years into the future and
with high accuracy.
Topic Areas
1.
2.
3.
4.
5.
6.
7.

Analytic innovation and exploratory analysis
Motivations for Instagram project
Pattern mining trajectories
Instagram analytics tools
NoSQL- MongoDB
Datafication 3 back end (walk thru)
Q&A
Analytic Innovation
“Let’s define analytic innovation as any type of
analytical approach that is new and unique. It is
something a given organization has not done
before, and perhaps something nobody
anywhere has done before…An analytic
innovation should be focused on analyzing a
new data source, solving a new problem…”
Franks, B. (2012) Taming the Big Data Tidal Wave, p. 255, John Wiley & Son
Discovery (Exploratory) Analytics
 Exploratory
–
–
–
–
–

Unstructured
Machine learning
Data mining
Complex analysis
Data diversity

 Richness

X Business Intelligence
– Dashboard
– Real time decisioning
– Alerts
– Fresh data
– Response time
 Speed of Query
Smartphone, Google Glass or Apple Watchwill
Know What you Want before you do
“…from 2014 your phone *glasses or watch+ will
anticipate your needs, do the research, tell you
what what you want to know – sometimes
before the question even occurs to you…”
Chapman, Jake (2013), The Wired World in 2014
Push Notification Providers
1. Appboy
2. Urban Airship
3. StackMob
4. Parse
5. https://notifica.re
6. http://www.xtify.com
7. http://push.io
8. http://streamin.io
9. https://pushbots.com
10.http://appsfire.com
11.mBlox
12.http://quickblox.com/
13.https://www.mobdb.net
14.http://www.elementwave.com
15.Kahuna - http://www.usekahuna.com/
http://www.quora.com/What-are-some-alternatives-to-Urban-Airship-for-mobile-push
Mobile Relationship Management Workflow (Urban Airship)
What/When?/Where?
Apple Passbook Styles
Urban Airship
Motivations for Instagram Project
•

Trajectory data (not i.i.d. – independent and identically distributed)

•

A new authentication approach based on trajectory

•

Predictive capability phones, glasses and watches

•

Internet of Things (Sensors, RFID and Drones)

•

Indoor GPS

•

Car parking “anywhere”

•

Location based services e.g. advertising

•

Tourist recommender system

•

Food analytics and traceability (farm fork)

•

Mobile apps with trajectory data e.g. Foursquare, Instagram, Nike+ EveryTrial

•

Insurance “pay as you drive”– telematics black box based insurance policy
Black Box Insurance
• Telematics technology (black box) helps assess the driving
behavior and deliver true driver centric premiums by
capturing:
–
–
–
–
–
–
–

Number of journeys
Distances travelled
Types of roads
Speed
Time of travel
Acceleration and braking
Any accidents

• Benefits low mileage, smooth and safe drivers
• Privacy vs. Saving monies on insurance (Canada)
– http://bit.ly/Black_box
Pattern Mining Trajectories
Trajectory Patterns:

Group
of
Trajectories

1. Hot regions (basic unit)
2. Trajectory pattern is
relationships amongst regions
Opportunities :

Location based networks
Destination prediction
Car-pooling
Personal route planning
Group buying
Loyalty
Credit card data

Adapted from: Chang, Wei, Yeh and Peng, “Discovering Personalised Routes from Trajectories”
ACM, LBSN’11, Chicago,illinois,USA, 1 November 2011
Instagram Analytics Tools (off the shelf)
•

Statigram
–
–
–
–

•

Simply Measured
–
–
–
–
–
–
–

•

Lifetime likes
Total comments
New followers/last 7 days
Most liked photos

Total engagement Instagram, Facebook and Twitter
Engaging photo/filter/location
Top photos by date
Active commenters
Best time for engagement
Best day for engagement
Top filters

Nitrogram
–
–
–
–

Countries of followers
Most engaging
Most commented
Likes and comments on a photo
First Australian Instagram Study Conducted by UTS:AAI
Why is Instagram Popular ?
• Mobile photo sharing app + social network
• Mobile first Workflow:
– take picture or select => crop/filter => geo-tag/hashtag/description/share

•
•
•
•

Instagram is “Twitter but with photo updates”
Status updates are transformed photos
Default is pictures and accounts are public
Pictures include:
– Geolocation, hashtags, comments and likes

• Mobile app friendly vs. desktop
MongoDB - An Innovation in Databases?
“MongoDB gets the job done”
“document-oriented NoSQL database”
“MongoDB is natural choice when dealing with JSON”
“Same data model in code = same model in database”
“Data structure store to model applications”

“In MongoDB Instagram post can be stored in single collection and stored exactly as represented in the program as one
object. In a relational database an Instagram post would occupy multiple tables.”
“MongoDB understands geo-spatial co-ordinates and supports geo-spatial indexing”

“Initial MongoDB prototype RedHat OpenShift (Public/Private or Community “Platform as a Service”)

Recommendation engine integrating Mahout libraries and MongoDB (see Roadmap)
As discussed @ Journey to MongoDB:Trajectory Pattern Mining in Australian Instagram
By Suresh Sood and Xinhua Zhu

**Sydney MongoDB Meetup 30 April 2013
Timeline based Trajectory Analysis
Google Map based Trajectory Analysis
Social Relationship Analysis
Location based Retrieval
Popular HashTag Analysis
Popular Image Analysis
Peak Usage Time Analysis
Active User Analysis
Roadmap

Data
collection

Individual(Group) Analysis
Find Preference and Behavior
pattern(including Trajectory pattern)

Manually

Recommendation
Recommend right product (or
service) to right person ( or
group) at right time and place

Automatically
Thank you!

Q/A

More Related Content

Similar to Analytic innovation transforming instagram data into predicitive analytics with references

Towards the Design of Intelligible Object-based Applications for the Web of T...
Towards the Design of Intelligible Object-based Applications for the Web of T...Towards the Design of Intelligible Object-based Applications for the Web of T...
Towards the Design of Intelligible Object-based Applications for the Web of T...
Pierrick Thébault
 
Data mining java titles adrit solutions
Data mining java titles adrit solutionsData mining java titles adrit solutions
Data mining java titles adrit solutions
Adrit Techno Solutions
 
JLopezResume2
JLopezResume2JLopezResume2
JLopezResume2
Jose Lopez
 
Tangible Contextual Tag Clouds towards Controlled and Relevant Social Inter...
Tangible Contextual Tag Clouds towards Controlled and Relevant Social Inter...Tangible Contextual Tag Clouds towards Controlled and Relevant Social Inter...
Tangible Contextual Tag Clouds towards Controlled and Relevant Social Inter...
Adrien Joly
 
IRJET- Next Location Prediction
IRJET-  	  Next Location PredictionIRJET-  	  Next Location Prediction
IRJET- Next Location Prediction
IRJET Journal
 
Foresight Analytics
Foresight AnalyticsForesight Analytics
Foresight Analytics
suresh sood
 
The User is the Query - The Rise of Predictive Proactive Search
The User is the Query - The Rise of Predictive Proactive SearchThe User is the Query - The Rise of Predictive Proactive Search
The User is the Query - The Rise of Predictive Proactive Search
Dawn Anderson MSc DigM
 
Ijsrdv7 i10842
Ijsrdv7 i10842Ijsrdv7 i10842
Ijsrdv7 i10842
aissmsblogs
 
Multimode network based efficient and scalable learning of collective behavior
Multimode network based efficient and scalable learning of collective behaviorMultimode network based efficient and scalable learning of collective behavior
Multimode network based efficient and scalable learning of collective behavior
IAEME Publication
 
Improving Your Library's Mobile Services
Improving Your Library's Mobile ServicesImproving Your Library's Mobile Services
Improving Your Library's Mobile Services
ALATechSource
 
Travel Recommendation Approach using Collaboration Filter in Social Networking
Travel Recommendation Approach using Collaboration Filter in Social NetworkingTravel Recommendation Approach using Collaboration Filter in Social Networking
Travel Recommendation Approach using Collaboration Filter in Social Networking
IRJET Journal
 
Published Paper
Published PaperPublished Paper
Published Paper
Faeza Noor
 
9 Visualization In E Social Science
9 Visualization In E Social Science9 Visualization In E Social Science
9 Visualization In E Social Science
guestde3e66f
 
9 Visualization In E Social Science
9 Visualization In E Social Science9 Visualization In E Social Science
9 Visualization In E Social Science
Webometrics Class
 
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облакуНиколаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Skolkovo Robotics Center
 
The_Future_of_Augmented_Reality
The_Future_of_Augmented_RealityThe_Future_of_Augmented_Reality
The_Future_of_Augmented_Reality
Abbas Tolgay Yılmaz
 
MOBILE APPLICATION FOR DONATION OF ITEMS
MOBILE APPLICATION FOR DONATION OF ITEMSMOBILE APPLICATION FOR DONATION OF ITEMS
MOBILE APPLICATION FOR DONATION OF ITEMS
vivatechijri
 
Using Social Networking Data to Understand Urban Human Mobility
Using Social Networking Data to Understand Urban Human Mobility Using Social Networking Data to Understand Urban Human Mobility
Using Social Networking Data to Understand Urban Human Mobility
Yuyun Wabula
 
Machines are people too
Machines are people tooMachines are people too
Machines are people too
Paul Groth
 
DBLP-SSE: A DBLP Search Support Engine
DBLP-SSE: A DBLP Search Support EngineDBLP-SSE: A DBLP Search Support Engine
DBLP-SSE: A DBLP Search Support Engine
Yi Zeng
 

Similar to Analytic innovation transforming instagram data into predicitive analytics with references (20)

Towards the Design of Intelligible Object-based Applications for the Web of T...
Towards the Design of Intelligible Object-based Applications for the Web of T...Towards the Design of Intelligible Object-based Applications for the Web of T...
Towards the Design of Intelligible Object-based Applications for the Web of T...
 
Data mining java titles adrit solutions
Data mining java titles adrit solutionsData mining java titles adrit solutions
Data mining java titles adrit solutions
 
JLopezResume2
JLopezResume2JLopezResume2
JLopezResume2
 
Tangible Contextual Tag Clouds towards Controlled and Relevant Social Inter...
Tangible Contextual Tag Clouds towards Controlled and Relevant Social Inter...Tangible Contextual Tag Clouds towards Controlled and Relevant Social Inter...
Tangible Contextual Tag Clouds towards Controlled and Relevant Social Inter...
 
IRJET- Next Location Prediction
IRJET-  	  Next Location PredictionIRJET-  	  Next Location Prediction
IRJET- Next Location Prediction
 
Foresight Analytics
Foresight AnalyticsForesight Analytics
Foresight Analytics
 
The User is the Query - The Rise of Predictive Proactive Search
The User is the Query - The Rise of Predictive Proactive SearchThe User is the Query - The Rise of Predictive Proactive Search
The User is the Query - The Rise of Predictive Proactive Search
 
Ijsrdv7 i10842
Ijsrdv7 i10842Ijsrdv7 i10842
Ijsrdv7 i10842
 
Multimode network based efficient and scalable learning of collective behavior
Multimode network based efficient and scalable learning of collective behaviorMultimode network based efficient and scalable learning of collective behavior
Multimode network based efficient and scalable learning of collective behavior
 
Improving Your Library's Mobile Services
Improving Your Library's Mobile ServicesImproving Your Library's Mobile Services
Improving Your Library's Mobile Services
 
Travel Recommendation Approach using Collaboration Filter in Social Networking
Travel Recommendation Approach using Collaboration Filter in Social NetworkingTravel Recommendation Approach using Collaboration Filter in Social Networking
Travel Recommendation Approach using Collaboration Filter in Social Networking
 
Published Paper
Published PaperPublished Paper
Published Paper
 
9 Visualization In E Social Science
9 Visualization In E Social Science9 Visualization In E Social Science
9 Visualization In E Social Science
 
9 Visualization In E Social Science
9 Visualization In E Social Science9 Visualization In E Social Science
9 Visualization In E Social Science
 
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облакуНиколаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
Николаос Мавридис. От Интерактивных роботов к Человеку-машинному облаку
 
The_Future_of_Augmented_Reality
The_Future_of_Augmented_RealityThe_Future_of_Augmented_Reality
The_Future_of_Augmented_Reality
 
MOBILE APPLICATION FOR DONATION OF ITEMS
MOBILE APPLICATION FOR DONATION OF ITEMSMOBILE APPLICATION FOR DONATION OF ITEMS
MOBILE APPLICATION FOR DONATION OF ITEMS
 
Using Social Networking Data to Understand Urban Human Mobility
Using Social Networking Data to Understand Urban Human Mobility Using Social Networking Data to Understand Urban Human Mobility
Using Social Networking Data to Understand Urban Human Mobility
 
Machines are people too
Machines are people tooMachines are people too
Machines are people too
 
DBLP-SSE: A DBLP Search Support Engine
DBLP-SSE: A DBLP Search Support EngineDBLP-SSE: A DBLP Search Support Engine
DBLP-SSE: A DBLP Search Support Engine
 

More from suresh sood

Getting to the Edge of the Future - Tools & Trends of Foresight to Nowcasting
Getting to the Edge of the Future - Tools & Trends of Foresight to NowcastingGetting to the Edge of the Future - Tools & Trends of Foresight to Nowcasting
Getting to the Edge of the Future - Tools & Trends of Foresight to Nowcasting
suresh sood
 
Bigdata AI
Bigdata AI Bigdata AI
Bigdata AI
suresh sood
 
Bigdata ai
Bigdata aiBigdata ai
Bigdata ai
suresh sood
 
Data Science Innovations
Data Science InnovationsData Science Innovations
Data Science Innovations
suresh sood
 
Foresight conversation
Foresight conversationForesight conversation
Foresight conversation
suresh sood
 
Data science Innovations January 2018
Data science Innovations January 2018Data science Innovations January 2018
Data science Innovations January 2018
suresh sood
 
future2020
future2020future2020
future2020
suresh sood
 
Data science innovations
Data science innovations Data science innovations
Data science innovations
suresh sood
 
Data Science Innovations : Democratisation of Data and Data Science
Data Science Innovations : Democratisation of Data and Data Science  Data Science Innovations : Democratisation of Data and Data Science
Data Science Innovations : Democratisation of Data and Data Science
suresh sood
 
Swarm jobs
Swarm jobsSwarm jobs
Swarm jobs
suresh sood
 
Netnography online course part 1 of 3 17 november 2016
Netnography online course part 1 of 3 17 november 2016Netnography online course part 1 of 3 17 november 2016
Netnography online course part 1 of 3 17 november 2016
suresh sood
 
Beyond dashboards
Beyond dashboardsBeyond dashboards
Beyond dashboards
suresh sood
 
Systemof insight
Systemof insightSystemof insight
Systemof insight
suresh sood
 
TPA
TPATPA
Datapreneurs
DatapreneursDatapreneurs
Datapreneurs
suresh sood
 
Future of jobs, big data & innovation
Future of jobs, big data & innovation Future of jobs, big data & innovation
Future of jobs, big data & innovation
suresh sood
 
Jobs Complexity
Jobs ComplexityJobs Complexity
Jobs Complexity
suresh sood
 
Spark Social Media
Spark Social Media Spark Social Media
Spark Social Media
suresh sood
 
Bigdatacooltools
BigdatacooltoolsBigdatacooltools
Bigdatacooltools
suresh sood
 
Spark
SparkSpark

More from suresh sood (20)

Getting to the Edge of the Future - Tools & Trends of Foresight to Nowcasting
Getting to the Edge of the Future - Tools & Trends of Foresight to NowcastingGetting to the Edge of the Future - Tools & Trends of Foresight to Nowcasting
Getting to the Edge of the Future - Tools & Trends of Foresight to Nowcasting
 
Bigdata AI
Bigdata AI Bigdata AI
Bigdata AI
 
Bigdata ai
Bigdata aiBigdata ai
Bigdata ai
 
Data Science Innovations
Data Science InnovationsData Science Innovations
Data Science Innovations
 
Foresight conversation
Foresight conversationForesight conversation
Foresight conversation
 
Data science Innovations January 2018
Data science Innovations January 2018Data science Innovations January 2018
Data science Innovations January 2018
 
future2020
future2020future2020
future2020
 
Data science innovations
Data science innovations Data science innovations
Data science innovations
 
Data Science Innovations : Democratisation of Data and Data Science
Data Science Innovations : Democratisation of Data and Data Science  Data Science Innovations : Democratisation of Data and Data Science
Data Science Innovations : Democratisation of Data and Data Science
 
Swarm jobs
Swarm jobsSwarm jobs
Swarm jobs
 
Netnography online course part 1 of 3 17 november 2016
Netnography online course part 1 of 3 17 november 2016Netnography online course part 1 of 3 17 november 2016
Netnography online course part 1 of 3 17 november 2016
 
Beyond dashboards
Beyond dashboardsBeyond dashboards
Beyond dashboards
 
Systemof insight
Systemof insightSystemof insight
Systemof insight
 
TPA
TPATPA
TPA
 
Datapreneurs
DatapreneursDatapreneurs
Datapreneurs
 
Future of jobs, big data & innovation
Future of jobs, big data & innovation Future of jobs, big data & innovation
Future of jobs, big data & innovation
 
Jobs Complexity
Jobs ComplexityJobs Complexity
Jobs Complexity
 
Spark Social Media
Spark Social Media Spark Social Media
Spark Social Media
 
Bigdatacooltools
BigdatacooltoolsBigdatacooltools
Bigdatacooltools
 
Spark
SparkSpark
Spark
 

Recently uploaded

CAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on BlockchainCAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on Blockchain
Claudio Di Ciccio
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
Mariano Tinti
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
SitimaJohn
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
FODUU
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdfAI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
Techgropse Pvt.Ltd.
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Zilliz
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 

Recently uploaded (20)

CAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on BlockchainCAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on Blockchain
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
Mariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceXMariano G Tinti - Decoding SpaceX
Mariano G Tinti - Decoding SpaceX
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdfAI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 

Analytic innovation transforming instagram data into predicitive analytics with references

  • 1. Analytic Innovation: Transforming Instagram Data Into Predictive Analytics Suresh.sood@uts.edu.au or linkedin.com/in/sureshsood Xinhua.zhu@uts.edu.au or linkedin.com/pub/xinhua-zhu/27/448/621
  • 2. Useful References Informing our Thinking (Silva et al (2013) A comparison of Foursquare and Instagram to the study of city dynamics and urban social behavior, Proceedings of the 2nd ACM SIGKDD International Workshop on Urban Computing Instagram and Foursquare datasets might be compatible in finding popular regions of city Chaoming Song, et al. (2010), Limits of Predictability in Human Mobility, Science There is a potential 93% average predictability in user mobility, an exceptionally high value rooted in the inherent regularity of human behavior. Yet it is not the 93% predictability that we find the most surprising. Rather, it is the lack of variability in predictability across the population. Scellato et al. (2011), NextPlace: A Spatio-temporal Prediction Framework for Pervasive Systems. Proceedings of the 9th International Conference on Pervasive Computing (Pervasive'11) Daily and weekly routines => Few significant places every day => Regularity in human activities => Regularity leads to predictability
  • 3. Useful References Informing our Thinking Domenico, A. Lima, Musolesi.M. (2012) Interdependence and Predictability of Human Mobility and Social Interactions. Proceedings of the Nokia Mobile Data Challenge Workshop. we have shown that it is possible to exploit the correlation between movement data and social interactions in order to improve the accuracy of forecasting of the future geographic position of a user. In particular, mobility correlation, measured by means of mutual information, and the presence of social ties can be used to improve movement forecasting by exploiting mobility data of friends. Moreover, this correlation can be used as indicator of potential existence of physical or distant social interactions and vice versa. Sadilek, A and Krumm, J. (2012) Far Out: Predicting Long-Term Human Mobility Where are you going to be 285 days from now at 2pm …we show that it is possible to predict location of a wide variety of hundreds of subjects even years into the future and with high accuracy.
  • 4. Topic Areas 1. 2. 3. 4. 5. 6. 7. Analytic innovation and exploratory analysis Motivations for Instagram project Pattern mining trajectories Instagram analytics tools NoSQL- MongoDB Datafication 3 back end (walk thru) Q&A
  • 5. Analytic Innovation “Let’s define analytic innovation as any type of analytical approach that is new and unique. It is something a given organization has not done before, and perhaps something nobody anywhere has done before…An analytic innovation should be focused on analyzing a new data source, solving a new problem…” Franks, B. (2012) Taming the Big Data Tidal Wave, p. 255, John Wiley & Son
  • 6. Discovery (Exploratory) Analytics  Exploratory – – – – – Unstructured Machine learning Data mining Complex analysis Data diversity  Richness X Business Intelligence – Dashboard – Real time decisioning – Alerts – Fresh data – Response time  Speed of Query
  • 7. Smartphone, Google Glass or Apple Watchwill Know What you Want before you do “…from 2014 your phone *glasses or watch+ will anticipate your needs, do the research, tell you what what you want to know – sometimes before the question even occurs to you…” Chapman, Jake (2013), The Wired World in 2014
  • 8. Push Notification Providers 1. Appboy 2. Urban Airship 3. StackMob 4. Parse 5. https://notifica.re 6. http://www.xtify.com 7. http://push.io 8. http://streamin.io 9. https://pushbots.com 10.http://appsfire.com 11.mBlox 12.http://quickblox.com/ 13.https://www.mobdb.net 14.http://www.elementwave.com 15.Kahuna - http://www.usekahuna.com/ http://www.quora.com/What-are-some-alternatives-to-Urban-Airship-for-mobile-push
  • 9. Mobile Relationship Management Workflow (Urban Airship) What/When?/Where?
  • 11. Motivations for Instagram Project • Trajectory data (not i.i.d. – independent and identically distributed) • A new authentication approach based on trajectory • Predictive capability phones, glasses and watches • Internet of Things (Sensors, RFID and Drones) • Indoor GPS • Car parking “anywhere” • Location based services e.g. advertising • Tourist recommender system • Food analytics and traceability (farm fork) • Mobile apps with trajectory data e.g. Foursquare, Instagram, Nike+ EveryTrial • Insurance “pay as you drive”– telematics black box based insurance policy
  • 12. Black Box Insurance • Telematics technology (black box) helps assess the driving behavior and deliver true driver centric premiums by capturing: – – – – – – – Number of journeys Distances travelled Types of roads Speed Time of travel Acceleration and braking Any accidents • Benefits low mileage, smooth and safe drivers • Privacy vs. Saving monies on insurance (Canada) – http://bit.ly/Black_box
  • 13. Pattern Mining Trajectories Trajectory Patterns: Group of Trajectories 1. Hot regions (basic unit) 2. Trajectory pattern is relationships amongst regions Opportunities : Location based networks Destination prediction Car-pooling Personal route planning Group buying Loyalty Credit card data Adapted from: Chang, Wei, Yeh and Peng, “Discovering Personalised Routes from Trajectories” ACM, LBSN’11, Chicago,illinois,USA, 1 November 2011
  • 14. Instagram Analytics Tools (off the shelf) • Statigram – – – – • Simply Measured – – – – – – – • Lifetime likes Total comments New followers/last 7 days Most liked photos Total engagement Instagram, Facebook and Twitter Engaging photo/filter/location Top photos by date Active commenters Best time for engagement Best day for engagement Top filters Nitrogram – – – – Countries of followers Most engaging Most commented Likes and comments on a photo
  • 15. First Australian Instagram Study Conducted by UTS:AAI
  • 16. Why is Instagram Popular ? • Mobile photo sharing app + social network • Mobile first Workflow: – take picture or select => crop/filter => geo-tag/hashtag/description/share • • • • Instagram is “Twitter but with photo updates” Status updates are transformed photos Default is pictures and accounts are public Pictures include: – Geolocation, hashtags, comments and likes • Mobile app friendly vs. desktop
  • 17. MongoDB - An Innovation in Databases? “MongoDB gets the job done” “document-oriented NoSQL database” “MongoDB is natural choice when dealing with JSON” “Same data model in code = same model in database” “Data structure store to model applications” “In MongoDB Instagram post can be stored in single collection and stored exactly as represented in the program as one object. In a relational database an Instagram post would occupy multiple tables.” “MongoDB understands geo-spatial co-ordinates and supports geo-spatial indexing” “Initial MongoDB prototype RedHat OpenShift (Public/Private or Community “Platform as a Service”) Recommendation engine integrating Mahout libraries and MongoDB (see Roadmap) As discussed @ Journey to MongoDB:Trajectory Pattern Mining in Australian Instagram By Suresh Sood and Xinhua Zhu **Sydney MongoDB Meetup 30 April 2013
  • 19. Google Map based Trajectory Analysis
  • 24. Peak Usage Time Analysis
  • 26. Roadmap Data collection Individual(Group) Analysis Find Preference and Behavior pattern(including Trajectory pattern) Manually Recommendation Recommend right product (or service) to right person ( or group) at right time and place Automatically