Who were the most influential bands of Rock history? Which bands could not exist of there was no Velvet Underground? How much Shoegazing subgenre is related to the Drone music?
Rock music history was perhaps full of drugs and alcohol but we are sobering up to represent it in terms of (social) networks and find mathematical relationship between artists, trends and subgenres. Full of DataViz and interesting relationships, we will pick up a few common clustering and network analysis algorithms to analyse the publicly available Wiki data. Expect lots of air guitar power chords and virtuoso solos.
From Power Chord to the Power of Models - OredevAli Kheyrollahi
Who were the most influential bands of Rock history? Which bands could not exist if there was no Velvet Underground? How much Shoegazing subgenre is related to the Drone music?
Rock music history was perhaps full of drugs and alcohol but we are sobering up to represent it in terms of (social) networks and find mathematical relationship between artists, trends and subgenres. Full of DataViz and interesting relationships, we will pick up a few common clustering and network analysis algorithms to analyse the publicly available Wiki data. Expect lots of air guitar power chords and virtuoso solos.
Autonomous agents with deep reinforcement learning - Oredev 2018Ali Kheyrollahi
Even if AlphaGo’s victory over the go’s world champion was viewed dubiously as hype by a one-trick pony, AlphaZero’s ability to learn chess in 4 hours and beat the strongest computer using not-of-this-owrld techniques has silenced the strongest of critiques. DeepMind has proved a track record with a trajectory to conquer more complex aspects of human mind.
But really, how do they do it? While many aspects of their technology remains unpublished, they for the most part use common Machine Learning techniques that can be used to build intelligent agents. In this talk, we not only cover tools and techniques but also build an agent to play and compete with humans. See if you can beat the machine!
Buildstuff - what do you need to know about RPC comebackAli Kheyrollahi
While REST has enjoyed a decade of popularity and proliferation, we see a recent resurgence of RPC - mainly advocated and evangelised by large software companies such as Google and Uber.
Our industry has a tendency of going full circle on pretty much anything and everything so this is not exactly a surprise. But before adopting RPC - or any other hype for that matter - it is important to understand why it is making a comeback and what problem it is trying to address. And this is the exact topic we will address in this talk: we will review the RPC and REST, look at key arguments for using and it and in the end we discussion gRPC, one of the main proponents of RPC comeback.
More Related Content
Similar to From power chords to the power of models
From Power Chord to the Power of Models - OredevAli Kheyrollahi
Who were the most influential bands of Rock history? Which bands could not exist if there was no Velvet Underground? How much Shoegazing subgenre is related to the Drone music?
Rock music history was perhaps full of drugs and alcohol but we are sobering up to represent it in terms of (social) networks and find mathematical relationship between artists, trends and subgenres. Full of DataViz and interesting relationships, we will pick up a few common clustering and network analysis algorithms to analyse the publicly available Wiki data. Expect lots of air guitar power chords and virtuoso solos.
Autonomous agents with deep reinforcement learning - Oredev 2018Ali Kheyrollahi
Even if AlphaGo’s victory over the go’s world champion was viewed dubiously as hype by a one-trick pony, AlphaZero’s ability to learn chess in 4 hours and beat the strongest computer using not-of-this-owrld techniques has silenced the strongest of critiques. DeepMind has proved a track record with a trajectory to conquer more complex aspects of human mind.
But really, how do they do it? While many aspects of their technology remains unpublished, they for the most part use common Machine Learning techniques that can be used to build intelligent agents. In this talk, we not only cover tools and techniques but also build an agent to play and compete with humans. See if you can beat the machine!
Buildstuff - what do you need to know about RPC comebackAli Kheyrollahi
While REST has enjoyed a decade of popularity and proliferation, we see a recent resurgence of RPC - mainly advocated and evangelised by large software companies such as Google and Uber.
Our industry has a tendency of going full circle on pretty much anything and everything so this is not exactly a surprise. But before adopting RPC - or any other hype for that matter - it is important to understand why it is making a comeback and what problem it is trying to address. And this is the exact topic we will address in this talk: we will review the RPC and REST, look at key arguments for using and it and in the end we discussion gRPC, one of the main proponents of RPC comeback.
Deep Learning has taken the world of Computer Science by storm yet for many of us it remains an elusive sci-fi-like buzzword. After years of feature engineering in Computer Vision and Natural Language Processing, we have finally come to the point where, we can feed raw data to a Neural Network, similar to how our brains work, and expect results that can surprise us in their high accuracy.
This talk is about de-mystifying Deep Learning for developers many of whom could benefit from understanding and using Deep Learning in their day-to-day job. It covers the background and brief theoretical grounds in the first third but shows actual working code and examples in the rest. We will overview convolutional Neural Networks and then cover network design techniques such as pooling, dropout and local connections.
The examples of this talk are in Keras and aimed to build real-world models in the field of Natural Language Processing.
Microservice Architecture at ASOS - DevSum 2017Ali Kheyrollahi
For the past 3 years, ASOS has been on a journey of moving its monolithic architecture to Microservices - and what has been driving this change is not just the buzzword: as with any monolith, the spiraling cost of change stifles the business and innovation. And in this market, advancing your competitive edge by constant improvement is a big factor in the overall success of your business.
Probably not many know that ASOS website drives more traffic (and way more bandwidth) than the showcase Stackoverflow. Some of the services are built to serve up to 10K RPS (request/second). And the services are spread around the globe currently on more than 4 Azure DCs. And on the top, we have pretty thick data pipelines moving many GBs of data to enable traditional BI - as well as the trendy Machine Learning algorithms powering recommendations and personalisation.
This talk will be a brief intro to the overall view of what +20 2-pizza teams are doing and in specific, goes into some of the details of ML-enabled recommendations platform. Underneath the success of the transition, has been a Logging/Monitoring/Alerting system (Elasticsearch+ConverorBelt+Kibana) to empower platform teams to ensure health of the system and keeping Mean-Time-to-Recovery low.
As with any such talk, there will be a section on lessons learned...
5 must have patterns for your microservice - techoramaAli Kheyrollahi
"Netflix is actually a log generating application that just happens to stream movies"
Building a service/Microservice is itself easy. Scaling it on the cloud is not that hard either but operating, maintaining and iterating a production large scale service is not just about linearisation. As Cockcroft points out, telemetry and monitoring is the most important aspect of building Microservices
We discuss 5 patterns that any serious Microservice should have:
- Canary (an endpoint reporting health of underlying dependencies)
- IO monitor (measuring all calls from Microservice to external dependencies)
- A circuit breaker
- An ActivityId-Propagator
- An exception and short timeout retry policy
Real time monitoring-alerting: storing 2Tb of logs a day in ElasticsearchAli Kheyrollahi
Building any average complex system in the cloud requires telemetry to be the number one concern: you would probably even start with planning and building it first (or perhaps you wish you had!). As quoted by Werner Vogels “Netflix is a log generating application, that happens to stream video quote” - Logging/Monitoring/Alerting has been central to the success of Netflix.
In ASOS, we currently generate more than 1TB of logs daily that gets stored and analysed in our Elasticsearch cluster for monitoring and alerting purposes. ELK stack (Elasticsearch, Logstash and Kibana) has been a very popular tool for logging and monitoring but tuning ELasticsearch for handling such a load is an art form in itself.
In this talk, we start with an overview of ELK stack (we in ASOS use CoveyorBelt instead of logstash so ECK for us) and then move to sharing what we have learned from trying to scale our Elasticsearch for this load: from tuning various configuration parameters to planning your shards and mapping strategy, this talk has quite a bit to equip you to build or tune an ELK stack in your own company.
5 must-have patterns for your microservice - buildstuffAli Kheyrollahi
"Netflix is actually a log generating application that just happens to stream movies"
Building a service/Microservice is itself easy. Scaling it on the cloud is not that hard either but operating, maintaining and iterating a production large scale service is not just about linearisation. As Cockcroft points out, telemetry and monitoring is the most important aspect of building Microservices
We discuss 5 patterns that any serious Microservice should have:
- Canary (an endpoint reporting health of underlying dependencies)
- IO monitor (measuring all calls from Microservice to external dependencies)
- A circuit breaker
- An ActivityId-Propagator
- An exception and short timeout retry policy
Apart from the Microservice buzzword, there is a saddening lack of understanding of what a successful Microservice architecture requires in terms of monitoring and telemetry. MTR in case of a Microservice can be much more than a monolith if these 5 patterns are not in place.
From Hard Science to Baseless Opinions - OredevAli Kheyrollahi
From the mathematicians and scientists of the 20th centuries to today's ninja craftsmen/craftswomen, Software community has lost something along the way. Instead of carefully observing scientific methods and maintaining objectivity, we have tangled ourselves in web of hype and celebrity culture - as if adopting today's YOLO motto. We have completely forgot how to reason scientifically about matters of technical dispute, instead, whoever is more opinionated or shouts louder wins - as if software is an abstract art where you can only form an opinion.
This talk is a critique of the status quo. With a survey of the history of modern culture, we will try to find the origin of our mindset which is very much rooted in the postmodern thought. Then we review the steps we have taken wrong and at the end, we exemplify the techniques of formal/scientific reasoning. A sobering talk yet not without sprinkles of fun and sense of humour...
If you have always felt something is wrong... here is the red pill for you...
"Netflix is actually a log generating application that just happens to stream movies"
Building a service/Microservice is itself easy. Scaling it on the cloud is not that hard either but operating, maintaining and iterating a production large scale service is not just about linearisation. As Cockcroft points out, telemetry and monitoring is the most important aspect of building Microservices
We discuss 5 patterns that any serious Microservice should have:
- Canary (an endpoint reporting health of underlying dependencies)
- IO monitor (measuring all calls from Microservice to external dependencies)
- A circuit breaker
- An ActivityId-Propagator
- An exception and short timeout retry policy
From the mathematicians and scientists of the 20th centuries to today's ninja craftsmen/craftswomen, Software community has lost something along the way. Instead of carefully observing scientific methods and maintaining objectivity, we have tangled ourselves in web of hype and celebrity culture - as if adopting today's YOLO motto. We have completely forgot how to reason scientifically about matters of technical dispute, instead, whoever is more opinionated or shouts louder wins - as if software is an abstract art where you can only form an opinion.
Journey of ASOS to migrate legacy ball of mud / monolith to Microservice Architecture. Also review of our Logging Monitoring Alerting (LMA) framework .
5 Anti-Patterns in Api Design - NDC London 2016Ali Kheyrollahi
This talks elaborates on the Client-Server tenet of REST which focuses on separation of concerns between the client and the server. In the first third of the talk, I will talk about what the ideal client and servers are and examples of how their responsibilities. I will touch on how the word Server has lost its meaning of "serving" and the client has been overshadowed by the focus to the API. I will also compare the API to a restaurant and how its menu is the API's REST resources.
In the rest of the talk, I look at some important anti-patterns commonly seen in the industry (each with at least one example):
1) Chauvinist Server: designing the API from server's perspective failing to hide its complexity behind its API (API designed from the server's perspective)
2) Demanding client: client enforcing its special need onto the signature of the API (certain client's limitation becomes server's default behaviour)
3) Transparent Server: server exposing its internal implementation to its clients (server's underlying or private domain bleeds into the public API)
4) Presumptuous Client: The client assuming the role of a server and engage in taking responsibilities that cannot guarantee
5) Assuming Server: Server that assumes the responsibility of tailoring the response based on what it assumes client is (e.g. browser sniffing)
This talks elaborates on the Client-Server tenet of REST which focuses on separation of concerns between the client and the server. In the first third of the talk, I will talk about what the ideal client and servers are and examples of how their responsibilities. I will touch on how the word Server has lost its meaning of "serving" and the client has been overshadowed by the focus to the API. I will also compare the API to a restaurant and how its menu is the API's REST resources.
In the rest of the talk, I look at some important anti-patterns commonly seen in the industry (each with at least one example):
1) Chauvinist Server: designing the API from server's perspective failing to hide its complexity behind its API (API designed from the server's perspective)
2) Demanding client: client enforcing its special need onto the signature of the API (certain client's limitation becomes server's default behaviour)
3) Transparent Server: server exposing its internal implementation to its clients (server's underlying or private domain bleeds into the public API)
4) Presumptuous Client: The client assuming the role of a server and engage in taking responsibilities that cannot guarantee
5) Assuming Server: Server that assumes the responsibility of tailoring the response based on what it assumes client is (e.g. browser sniffing)
This talks elaborates on the Client-Server tenet of REST which focuses on separation of concerns between the client and the server. In the first third of the talk, I will talk about what the ideal client and servers are and examples of how their responsibilities. I will touch on how the word Server has lost its meaning of “serving” and the client has been overshadowed by the focus to the API. I will also compare the API to a restaurant and how its menu is the API’s REST resources.In the rest of the talk, I look at some important anti-patterns commonly seen in the industry (each with at least one example)
1. Chauvinist Server: designing the API from server’s perspective failing to hide its complexity behind its API (API designed from the server’s perspective).
2. Demanding client: client enforcing its special need onto the signature of the API (certain client’s limitation becomes server’s default behaviour).
3. Transparent Server: server exposing its internal implementation to its clients (server’s underlying or private domain bleeds into the public API).
4. Presumptuous Client: The client assuming the role of a server and engage in taking responsibilities that cannot guarantee.
5. Assuming Server: Server that assumes the responsibility of tailoring the response based on what it assumes client is (e.g. browser sniffing).
Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics.
To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/
Software Engineering, Software Consulting, Tech Lead, Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Transaction, Spring MVC, OpenShift Cloud Platform, Kafka, REST, SOAP, LLD & HLD.
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppGoogle
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-fusion-buddy-review
AI Fusion Buddy Review: Key Features
✅Create Stunning AI App Suite Fully Powered By Google's Latest AI technology, Gemini
✅Use Gemini to Build high-converting Converting Sales Video Scripts, ad copies, Trending Articles, blogs, etc.100% unique!
✅Create Ultra-HD graphics with a single keyword or phrase that commands 10x eyeballs!
✅Fully automated AI articles bulk generation!
✅Auto-post or schedule stunning AI content across all your accounts at once—WordPress, Facebook, LinkedIn, Blogger, and more.
✅With one keyword or URL, generate complete websites, landing pages, and more…
✅Automatically create & sell AI content, graphics, websites, landing pages, & all that gets you paid non-stop 24*7.
✅Pre-built High-Converting 100+ website Templates and 2000+ graphic templates logos, banners, and thumbnail images in Trending Niches.
✅Say goodbye to wasting time logging into multiple Chat GPT & AI Apps once & for all!
✅Save over $5000 per year and kick out dependency on third parties completely!
✅Brand New App: Not available anywhere else!
✅ Beginner-friendly!
✅ZERO upfront cost or any extra expenses
✅Risk-Free: 30-Day Money-Back Guarantee!
✅Commercial License included!
See My Other Reviews Article:
(1) AI Genie Review: https://sumonreview.com/ai-genie-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
#AIFusionBuddyReview,
#AIFusionBuddyFeatures,
#AIFusionBuddyPricing,
#AIFusionBuddyProsandCons,
#AIFusionBuddyTutorial,
#AIFusionBuddyUserExperience
#AIFusionBuddyforBeginners,
#AIFusionBuddyBenefits,
#AIFusionBuddyComparison,
#AIFusionBuddyInstallation,
#AIFusionBuddyRefundPolicy,
#AIFusionBuddyDemo,
#AIFusionBuddyMaintenanceFees,
#AIFusionBuddyNewbieFriendly,
#WhatIsAIFusionBuddy?,
#HowDoesAIFusionBuddyWorks
Transform Your Communication with Cloud-Based IVR SolutionsTheSMSPoint
Discover the power of Cloud-Based IVR Solutions to streamline communication processes. Embrace scalability and cost-efficiency while enhancing customer experiences with features like automated call routing and voice recognition. Accessible from anywhere, these solutions integrate seamlessly with existing systems, providing real-time analytics for continuous improvement. Revolutionize your communication strategy today with Cloud-Based IVR Solutions. Learn more at: https://thesmspoint.com/channel/cloud-telephony
Zoom is a comprehensive platform designed to connect individuals and teams efficiently. With its user-friendly interface and powerful features, Zoom has become a go-to solution for virtual communication and collaboration. It offers a range of tools, including virtual meetings, team chat, VoIP phone systems, online whiteboards, and AI companions, to streamline workflows and enhance productivity.
May Marketo Masterclass, London MUG May 22 2024.pdfAdele Miller
Can't make Adobe Summit in Vegas? No sweat because the EMEA Marketo Engage Champions are coming to London to share their Summit sessions, insights and more!
This is a MUG with a twist you don't want to miss.
Launch Your Streaming Platforms in MinutesRoshan Dwivedi
The claim of launching a streaming platform in minutes might be a bit of an exaggeration, but there are services that can significantly streamline the process. Here's a breakdown:
Pros of Speedy Streaming Platform Launch Services:
No coding required: These services often use drag-and-drop interfaces or pre-built templates, eliminating the need for programming knowledge.
Faster setup: Compared to building from scratch, these platforms can get you up and running much quicker.
All-in-one solutions: Many services offer features like content management systems (CMS), video players, and monetization tools, reducing the need for multiple integrations.
Things to Consider:
Limited customization: These platforms may offer less flexibility in design and functionality compared to custom-built solutions.
Scalability: As your audience grows, you might need to upgrade to a more robust platform or encounter limitations with the "quick launch" option.
Features: Carefully evaluate which features are included and if they meet your specific needs (e.g., live streaming, subscription options).
Examples of Services for Launching Streaming Platforms:
Muvi [muvi com]
Uscreen [usencreen tv]
Alternatives to Consider:
Existing Streaming platforms: Platforms like YouTube or Twitch might be suitable for basic streaming needs, though monetization options might be limited.
Custom Development: While more time-consuming, custom development offers the most control and flexibility for your platform.
Overall, launching a streaming platform in minutes might not be entirely realistic, but these services can significantly speed up the process compared to building from scratch. Carefully consider your needs and budget when choosing the best option for you.
Graspan: A Big Data System for Big Code AnalysisAftab Hussain
We built a disk-based parallel graph system, Graspan, that uses a novel edge-pair centric computation model to compute dynamic transitive closures on very large program graphs.
We implement context-sensitive pointer/alias and dataflow analyses on Graspan. An evaluation of these analyses on large codebases such as Linux shows that their Graspan implementations scale to millions of lines of code and are much simpler than their original implementations.
These analyses were used to augment the existing checkers; these augmented checkers found 132 new NULL pointer bugs and 1308 unnecessary NULL tests in Linux 4.4.0-rc5, PostgreSQL 8.3.9, and Apache httpd 2.2.18.
- Accepted in ASPLOS ‘17, Xi’an, China.
- Featured in the tutorial, Systemized Program Analyses: A Big Data Perspective on Static Analysis Scalability, ASPLOS ‘17.
- Invited for presentation at SoCal PLS ‘16.
- Invited for poster presentation at PLDI SRC ‘16.
Mobile App Development Company In Noida | Drona InfotechDrona Infotech
Looking for a reliable mobile app development company in Noida? Look no further than Drona Infotech. We specialize in creating customized apps for your business needs.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
OpenMetadata Community Meeting - 5th June 2024OpenMetadata
The OpenMetadata Community Meeting was held on June 5th, 2024. In this meeting, we discussed about the data quality capabilities that are integrated with the Incident Manager, providing a complete solution to handle your data observability needs. Watch the end-to-end demo of the data quality features.
* How to run your own data quality framework
* What is the performance impact of running data quality frameworks
* How to run the test cases in your own ETL pipelines
* How the Incident Manager is integrated
* Get notified with alerts when test cases fail
Watch the meeting recording here - https://www.youtube.com/watch?v=UbNOje0kf6E
Utilocate offers a comprehensive solution for locate ticket management by automating and streamlining the entire process. By integrating with Geospatial Information Systems (GIS), it provides accurate mapping and visualization of utility locations, enhancing decision-making and reducing the risk of errors. The system's advanced data analytics tools help identify trends, predict potential issues, and optimize resource allocation, making the locate ticket management process smarter and more efficient. Additionally, automated ticket management ensures consistency and reduces human error, while real-time notifications keep all relevant personnel informed and ready to respond promptly.
The system's ability to streamline workflows and automate ticket routing significantly reduces the time taken to process each ticket, making the process faster and more efficient. Mobile access allows field technicians to update ticket information on the go, ensuring that the latest information is always available and accelerating the locate process. Overall, Utilocate not only enhances the efficiency and accuracy of locate ticket management but also improves safety by minimizing the risk of utility damage through precise and timely locates.
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Mind IT Systems
Healthcare providers often struggle with the complexities of chronic conditions and remote patient monitoring, as each patient requires personalized care and ongoing monitoring. Off-the-shelf solutions may not meet these diverse needs, leading to inefficiencies and gaps in care. It’s here, custom healthcare software offers a tailored solution, ensuring improved care and effectiveness.
AI Genie Review: World’s First Open AI WordPress Website CreatorGoogle
AI Genie Review: World’s First Open AI WordPress Website Creator
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-genie-review
AI Genie Review: Key Features
✅Creates Limitless Real-Time Unique Content, auto-publishing Posts, Pages & Images directly from Chat GPT & Open AI on WordPress in any Niche
✅First & Only Google Bard Approved Software That Publishes 100% Original, SEO Friendly Content using Open AI
✅Publish Automated Posts and Pages using AI Genie directly on Your website
✅50 DFY Websites Included Without Adding Any Images, Content Or Doing Anything Yourself
✅Integrated Chat GPT Bot gives Instant Answers on Your Website to Visitors
✅Just Enter the title, and your Content for Pages and Posts will be ready on your website
✅Automatically insert visually appealing images into posts based on keywords and titles.
✅Choose the temperature of the content and control its randomness.
✅Control the length of the content to be generated.
✅Never Worry About Paying Huge Money Monthly To Top Content Creation Platforms
✅100% Easy-to-Use, Newbie-Friendly Technology
✅30-Days Money-Back Guarantee
See My Other Reviews Article:
(1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
#AIGenieApp #AIGenieBonus #AIGenieBonuses #AIGenieDemo #AIGenieDownload #AIGenieLegit #AIGenieLiveDemo #AIGenieOTO #AIGeniePreview #AIGenieReview #AIGenieReviewandBonus #AIGenieScamorLegit #AIGenieSoftware #AIGenieUpgrades #AIGenieUpsells #HowDoesAlGenie #HowtoBuyAIGenie #HowtoMakeMoneywithAIGenie #MakeMoneyOnline #MakeMoneywithAIGenie
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Łukasz Chruściel
No one wants their application to drag like a car stuck in the slow lane! Yet it’s all too common to encounter bumpy, pothole-filled solutions that slow the speed of any application. Symfony apps are not an exception.
In this talk, I will take you for a spin around the performance racetrack. We’ll explore common pitfalls - those hidden potholes on your application that can cause unexpected slowdowns. Learn how to spot these performance bumps early, and more importantly, how to navigate around them to keep your application running at top speed.
We will focus in particular on tuning your engine at the application level, making the right adjustments to ensure that your system responds like a well-oiled, high-performance race car.
Atelier - Innover avec l’IA Générative et les graphes de connaissancesNeo4j
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Allez au-delà du battage médiatique autour de l’IA et découvrez des techniques pratiques pour utiliser l’IA de manière responsable à travers les données de votre organisation. Explorez comment utiliser les graphes de connaissances pour augmenter la précision, la transparence et la capacité d’explication dans les systèmes d’IA générative. Vous partirez avec une expérience pratique combinant les relations entre les données et les LLM pour apporter du contexte spécifique à votre domaine et améliorer votre raisonnement.
Amenez votre ordinateur portable et nous vous guiderons sur la mise en place de votre propre pile d’IA générative, en vous fournissant des exemples pratiques et codés pour démarrer en quelques minutes.
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeAftab Hussain
Understanding variable roles in code has been found to be helpful by students
in learning programming -- could variable roles help deep neural models in
performing coding tasks? We do an exploratory study.
- These are slides of the talk given at InteNSE'23: The 1st International Workshop on Interpretability and Robustness in Neural Software Engineering, co-located with the 45th International Conference on Software Engineering, ICSE 2023, Melbourne Australia
6. Data Source - Wiki
4,990,2794,990,279 English Articles
37,583,879 Articles
7. Data Source - What about …
2012
http://money.cnn.com/2012/03/13/technology/encyclopedia-britannica-books/
8. Data Source - Wiki vs Britannica
Feng Zhu (assistant prof at Harvard):
There has been lots of research on the accuracy of
Wikipedia, and the results are mixed—some studies
show it is just as good as the experts, others show
[that] Wikipedia is not accurate at all.
… the editors [of Britannica] are still not
found to be more objective than the crowd
in articles that are sufficiently revised.
9. Data Source - Wikipedia in scholar papers
0
45000
90000
135000
180000
2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
Source: Google Scholar
10. Data Source - Dark side of Wiki
The Doggs: A mid-1960s British rock band, noted for
barking while playing music
Lord Byron kept a crocodile and a honey badger as a pet
Ted and the Treble Tones, a rock band from Fresno with a
1959 hit single that appeared nowhere on the Billboard
charts
The Shaggs all female (sister) band Hacked-at drumbeats,
whacked-around chords, songs that seem to have little or
no meter to them… Zappa’s favourite…
11.
12. Data Source - Content vs. Data
… or … Alt-country
Alternative country
… or … Alt.country
… or … Alt. Country
[mind the gap]
13. Data Source - Content vs. Data
comma
slash
new line
period?
no, greek middle dot U+00B7
14. Data Source - Content vs. Data
Hyphen
U+002D
figure dash
U+2012
minus sign
U+2015
em dash
U+2014
en dash
U+2013
15. Data Source - DBpedia
• http://wiki.dbpedia.org/
• bziped N-Triples or N-Quads RDF entries
• Different datasets:
• Titles
• Categories
• Infobox data
• Short Abstracts
• In the end was not used
16. Data Acquisition - Wiki
List of Rock
Genres
Rock Genres Rock Artists
Store
Store
HTML
Capture
Links
Store
HTML
Python scripts
Postgres
18. Data Exploration
“I personally … literally just look at the screen,
just like the matrix”
Claudia Perlich, multi-award winner Data
Scientist
19. Data Exploration
“… the dirty little secret that I have won all of them
because I have found something wrong with the
data… I would like to play around with dataset and
get initimately familiar with dataset and its
properties.“
Claudia Perlich
23. 50 Years of Rock 1965
1. rock (23)
2. folk rock (15)
3. rock and roll (13)
4. folk (12)
5. rhythm and blues (12)
6. blues rock (10)
7. country (9)
The Who
My Generation
“Rock” as genre was king with The
likes of The Who and Beatles
Rock and Roll, popular then, soon to
disappear from the list
24. 50 Years of Rock 1966
1. folk rock (25)
2. garage rock (21)
3. psychedelic rock (20)
4. rock (19)
5. folk (14)
6. protopunk (11)
7. pop (11)
Bob Dylan
Blonde on Blonde
Folk Rock was popular all of the
sixties with a resurgence in the early
70s
This is obviously named
retrospectively but along with
Garage rock to influence punk
25. 50 Years of Rock 1967
1. psychedelic rock (56) ↑
2. folk rock (30)
3. pop (19)
4. folk (19)
5. rock (18)
6. garage rock (12)
7. psychedelic pop (12) The Beatles
Sgt. Pepper's Lonely Hearts
Club Band
67, a big year with Monterey Pop
Festival, was all about psychedelia
Even for psychedelic pop
26. 50 Years of Rock 1968
1. psychedelic rock (70) ←
2. rock (29)
3. folk rock (26)
4. blues rock (25)
5. folk (18)
6. acid rock (18)
7. progressive rock (15)
Jimi Hendrix
Electric Ladyland
No comment, listen to Jimi!
Note Acid Rock and emergence of
progressive rock
27. 50 Years of Rock 1969
1. psychedelic rock (60) ←
2. rock (40)
3. folk rock (33)
4. hard rock (27)
5. folk (26)
6. progressive rock (25)
7. country (22)
Led Zeppelin
Led ZeppelinNot much changed… progrock
moving up
28. 50 Years of Rock 1970
1. rock (57)
2. folk rock (47) ↑
3. psychedelic rock (44) !!
4. hard rock (40) ↑
5. progressive rock (31) ↑
6. country rock (25)
7. folk (24) The Velvet Underground
Loaded
Artists leaving psychedelia for a
harder sound
29. 50 Years of Rock 1971
1. rock (47)
2. hard rock (34) ↑
3. folk rock (33) !
4. progressive rock (33) ↑
5. psychedelic rock (26) !
6. folk (24)
7. country rock (18) CAN
Tago Mago
Progressive rock and hard rock
moving up
30. 50 Years of Rock 1972
1. rock (54)
2. folk rock (34)
3. progressive rock (29)
4. hard rock (29)
5. country rock (27)
6. folk (25)
7. country (20)
Jethro Tull
Thick as a Brick
31. 50 Years of Rock 1973
1. rock (60)
2. hard rock (44) ↑
3. progressive rock (40)
4. folk rock (29)
5. country (24)
6. glam rock (22)
7. country rock (22)
Flashy dresses and make-up, bring it
on!
Pink Floyd
Dark Side of the Moon
32. 50 Years of Rock 1974
1. rock (58)
2. hard rock (52)
3. progressive rock (40)
4. glam rock (29) ↑
5. folk rock (28)
6. blues rock (20)
7. country rock (20)
Supertramp
Crime of the Century
33. 50 Years of Rock 1975
1. rock (53)
2. hard rock (52)
3. progressive rock (37)
4. folk rock (23)
5. country (20)
6. blues rock (20)
7. country rock (18)
Patti Smith
Horses
34. 50 Years of Rock 1976
1. rock (71)
2. hard rock (56)
3. progressive rock (28)
4. heavy metal (19)
5. pop (19)
6. folk (18)
7. country (18)
Did you notice?! Heavy Metal is now
a thing…
AC/DC
High Voltage
35. 50 Years of Rock 1977
1. rock (77)
2. hard rock (43)
3. progressive rock (29)
4. punk rock (21)
5. pop (19)
6. folk rock (15)
7. country rock (14)
Oh yeah, punk rock in full swing and
pretty much mainstream.
Sex Pistols
Never Mind the Bollocks
36. 50 Years of Rock 1978
1. rock (77)
2. hard rock (40)
3. progressive rock (24)
4. new wave (23)
5. pop (21)
6. country (20)
7. punk rock (19)
New wave with a more layered
sound replacing punk rock
Talking Heads
More Songs About Buildings and
Food
37. 50 Years of Rock 1979
1. rock (68)
2. new wave (49) ↑
3. post-punk (42)
4. hard rock (38) !
5. country (22)
6. punk rock (20)
7. progressive rock (15) !
Only after two years of punk, we
have post-punk… phew
Gary Numan
Replicas
38. 50 Years of Rock 1980
1. rock (66)
2. new wave (57)
3. post-punk (49)
4. hard rock (38)
5. country (24)
6. heavy metal (22)
7. punk rock (21)
Joy Division
Closer
39. 50 Years of Rock 1981
1. new wave (75) ↑
2. rock (71)
3. post-punk (68)
4. hard rock (41)
5. synthpop (25)
6. heavy metal (21)
7. country (19)
Another movement is already in
motion with softer keyboard-based
sound
Klaus Nomi
Klaus Nomi
40. 50 Years of Rock 1982
1. new wave (79)
2. post-punk (61)
3. rock (61)
4. hard rock (37)
5. heavy metal (28) ↑
6. synthpop (28)
7. hardcore punk (21)
Iron Maiden
Number of the Beast
Other than new wave and post-punk,
two completely different sounds
growing, heavy metal on one hand
and synth pop on the other…
41. 50 Years of Rock 1983
1. rock (74)
2. new wave (71)
3. post-punk (45) !
4. synthpop (39) ↑
5. heavy metal (36)
6. hard rock (35)
7. pop rock (24) The Police
Synchronicity
42. 50 Years of Rock 1984
1. new wave (73)
2. rock (61)
3. post-punk (44)
4. heavy metal (37)
5. synthpop (37)
6. hard rock (26)
7. alternative rock (24)
In case you haven’t noticed, New
Wave has been on the top spot for a
few years
Echo and the Bunnymen
Ocean Rain
43. 50 Years of Rock 1985
1. new wave (66)
2. rock (56)
3. post-punk (45)
4. heavy metal (33)
5. pop rock (33)
6. alternative rock (28) ↑
7. synthpop (28) !
Alternative Rock appearing… soon
to label much of the rock music we
have now…
The Fall
This Nation’s Saving Grace
44. 50 Years of Rock 1986
1. rock (68)
2. new wave (48) !
3. alternative rock (45) ↑
4. heavy metal (42)
5. post-punk (40)
6. hard rock (31)
7. synthpop (28)
Synthpop is over… only to come
back after 25 years.
The Smiths
The Queen Is Dead
45. 50 Years of Rock 1987
1. rock (62)
2. alternative rock (50) ↑
3. hard rock (36)
4. thrash metal (35)
5. heavy metal (31)
6. new wave (29) !
7. pop rock (24)
Wow… where did this come from?!
Testament
The Legacy
46. 50 Years of Rock 1988
1. alternative rock (59) ↑
2. rock (58)
3. heavy metal (42)
4. hard rock (40)
5. thrash metal (33)
6. synthpop (24)
7. new wave (23) !
New wave is out of favour after
almost 10 years…
Sonic Youth
Daydream Nation
47. 50 Years of Rock 1989
1. rock (80)
2. alternative rock (67)
3. hard rock (41)
4. thrash metal (39)
5. heavy metal (34)
6. new wave (26)
7. pop (22)
The Cure
Disintegration
50. Data Models Model
Mathematical representation of a concept
based on parameters that impact that
concept
• Rating of a native app
• Stackoverflow score
• Credit score
• Fraud check
52. Data Models Graph 101
Social Network Analysis
and Graph Theory
• Nodes/vertices and edges/lines
• Directedness:
• Directed
• Undirected
• Degree, InDegree/OutDegree
• Weight
A B
54. Graph Codez
import networkx as nx
g = nx.Graph()
g.add_edge(‘a’, ‘b’)
g.add_edge(‘b’, ‘c’)
…
print len(g[‘b’]) # degree
c = nx.betweenness_centrality(g, normalized=True)
# c -> dictionary of node names and their score
DiGraph()
57. Data Models Cited Influence
Most influential Rock Artists Based on out-degree
The Beatles => 188
Black Sabbath => 127
Led Zeppelin => 118
Jimi Hendrix => 114
Bob Dylan => 94
Pink Floyd => 86
Iron Maiden => 77
Metallica => 77
The Rolling Stones => 66
The Beach Boys => 65
Neil Young => 63
Nirvana => 62
Slayer => 60
Queen => 59
58. Data Models Cited Influence
Most influential Rock Artists Based on Betweenness Centrality
Jimi Hendrix => 53476.2014921
The Beatles => 47511.7957531
Bob Dylan => 38107.0298185
Led Zeppelin => 32701.7223273
Nirvana => 29733.9066836
Metallica => 29356.6009213
Queen => 28989.2844223
Robert Smith => 28880.670718
Elvis Presley => 28463.2891497
Slade => 27656.487307
Iron Maiden => 22449.6697023
Ramones => 22437.6112965
Rush => 21125.9481602
Neil Young => 19913.887522
59. Data Models Cited Influence
Most influential Artists Based on Betweenness Centrality
Metallica => 566.06
Iron Maiden => 419.21
Corey Taylor => 146.0
Led Zeppelin => 122.73
Slipknot => 116.58
King Diamond => 94.7
Machine Head => 85.12
Rush => 70.41
Black Sabbath => 68.0
Van Halen => 54.56
Deep Purple => 53.5
Megadeth => 42.63
Guns N' Roses => 24.25
Heavy Metal
Nirvana => 490.08
Muse => 114.5
Weezer => 97.33
Pixies => 94.17
Sonic Youth => 78.5
Rivers Cuomo => 69.5
Siouxsie and the Banshees => 51.67
The Smiths => 51.5
Jeff Buckley => 46.17
The Offspring => 43.0
Placebo => 42.0
My Chemical Romance => 34.0
The Smashing Pumpkins => 32.33
Alternative Rock
Rush => 54.0
Marillion => 34.0
Pink Floyd => 33.0
Yes => 20.0
Porcupine Tree => 19.5
Dream Theater => 19.0
Chris Squire => 16.5
Primus => 15.0
Tool => 12.0
Mahavishnu Orchestra => 8.0
Geddy Lee => 7.0
Neil Peart => 5.0
Keith Emerson => 5.0
Progressive Rock
61. Shaping a Model
•Start with Literature survey
•Draw parallels with similar domains
•If you still cannot find one, define a
new model
•Try to refine your model with a
quantitative measure if available
62. Shaping Visionaries Model
Visionary: Influencing vs. being influenced
V: visionary factor
deg+: out-degree
deg-: in-degree
e: the exponential function
63. Shaping Visionaries Model
Joni Mitchell => 44.0
Roxy Music => 31.0
Leonard Cohen => 31.0
Josh White => 31.0
Robert Johnson => 24.0
Etta James => 23.0
Discharge => 22.0
Sam Cooke => 21.0
Duke Ellington => 20.0
Marc Bolan => 19.0
Hank Marvin => 17.0
Jonathan Richman => 16.0
Scott Walker => 16.0
Testament => 16.0
The Police => 16.0
Skip James => 15.0
Albert King => 15.0
The Cure => 14.7151776469
Nico => 14.0
64. Data Models Visionaries Model
Most influential Artists in genres
Radiohead => 15.0
Depeche Mode => 12.0
Morrissey => 11.0
Robert Smith => 11.0
The Replacements => 10.0
The Cure => 8.83
XTC => 8.0
Stone Temple Pilots => 6.0
Duran Duran => 6.0
Nick Cave => 6.0
Wipers => 5.0
Johnny Marr => 4.0
Jane's Addiction => 4.0
Alternative Rock
The Stooges => 6.0
The Jam => 6.0
Sex Pistols => 4.05
Jawbreaker => 4.0
The Runaways => 4.0
The Dickies => 4.0
Circle Jerks => 3.0
Big Black => 3.0
Patti Smith => 3.0
Elvis Costello => 3.0
The Only Ones => 3.0
Kevin Seconds => 3.0
Descendents => 2.94
Punk Rock
Captain Beefheart => 7.0
The Magic Band => 6.0
Genesis => 5.0
Scott Walker => 5.0
Scott Engel => 3.0
Talk Talk => 3.0
Sparks => 2.0
Richard Wright => 2.0
Roxy Music => 1.84
Pink Floyd => 1.49
Mark Hollis => 1.0
Nico => 1.0
Lou Reed => 1.0
Art Rock
Dave Lombardo => 11.0
Napalm Death => 8.0
Morbid Angel => 3.68
Possessed => 3.31
Carcass => 2.21
Immolation => 2.0
Vulcano => 2.0
Hellhammer => 2.0
Autopsy => 1.47
Repulsion => 1.1
Entombed => 1.1
Impetigo => 1.0
Nihilist => 1.0
Death Metal
65. Shaping Impact Model
Imact: Influencing many in a short span
Imp: impact factor
deg+: out-degree
L: longevity (initial continuous years active)
66. Shaping Impact Model
Imact: Influencing many in a short span
Cream => 3.33
Sex Pistols => 2.19
Joy Division => 2.0
Jimi Hendrix => 1.83
The Beatles => 1.59
The Smiths => 1.19
Big Star => 1.19
Parliament => 1.11
Nirvana => 1.0
Ritchie Valens => 0.78
Led Zeppelin => 0.73
Traffic => 0.67
67. Shaping Impact Model
Imact: Influencing many in a short span in a specific genre
Nirvana => 0.5
The Smiths => 0.5
Pixies => 0.28
Happy Mondays => 0.11
Jeff Buckley => 0.1
Jane's Addiction => 0.08
Soundgarden => 0.08
Violent Femmes => 0.06
The Replacements => 0.06
A Perfect Circle => 0.06
Sublime => 0.05
The Hush Sound => 0.04
The Get Up Kids => 0.03
Alternative Rock
Sex Pistols => 0.69
Fuel => 0.22
Descendents => 0.16
The Runaways => 0.16
The Clash => 0.16
Hot Water Music => 0.13
The Stooges => 0.09
Buzzcocks => 0.08
Misfits => 0.06
Ramones => 0.05
The Jam => 0.05
Dead Kennedys => 0.05
The Replacements => 0.05
Punk Rock
Cream => 1.67
Jimi Hendrix => 0.56
Thin Lizzy => 0.39
Led Zeppelin => 0.33
Deep Purple => 0.27
Ram Jam => 0.25
The Stooges => 0.11
Jim Morrison => 0.09
The Runaways => 0.08
Alice Cooper => 0.08
The Doors => 0.06
The Who => 0.04
Judas Priest => 0.02
Hard Rock
Joy Division => 0.56
Bauhaus => 0.028
The Police => 0.02
Siouxsie and Banshees => 0.02
Robert Smith => 0.006
Ultravox => 0.005
New Order => 0.005
My Bloody Valentine => 0.004
Sonic Youth => 0.004
Talking Heads => 0.003
Nick Cave => 0.002
The Cure => 0.001
David Byrne => 0.001
Post-punk
75. Clustering in Networks
Eigenvector: a vector (v) that by getting multiplied in matrix A
does not result in changing its direction (similar to being
multiplied by scalar λ)
u1 u2 u3 u4 u5
-0.7 0.3 -0.2 -0.1 0.7
-0.7 0.3 -0.2 -0.1 0.7
76. Spectral Clustering Codez
from sklearn.cluster import spectral_clustering
import numpy as np
A = [[0.0 for x in n] for x in n]
… # build adjacency matrix
res = spectral_clustering(np.matrix(A),
n_clusters)
# res -> list of cluster indices e.g. [1,1,0,5,…]
77. Spectral Clustering Results
Folk Rock
Country Rock
Blues
Folk
Country
Americana
Roots Rock
Blues Rock
Southern Rock
Power Metal
Progressive Metal
Symphonic Metal
Black Metal
Melodic Death Metal
Groove Metal
Nu Metal
Thrash Metal
Death Metal
Metalcore
Industrial Metal
Gothic Metal
Christian Metal
Doom Metal
Speed Metal
Alternative Rock
Indie Rock
New Wave
Synthpop
Electronica
Rock
R&B
Pop
Pop Rock
Funk
Soul
Heavy Metal
Hard Rock
Alternative Metal
79. 50 Years of Rock 1990
1. alternative rock (69)
2. rock (59)
3. hard rock (48)
4. thrash metal (45)
5. heavy metal (36)
6. punk rock (25)
7. country (23)
This will stay at this spot pretty much
most of the remaining 25 years…
The Black Crowes
Shake Your Money Maker
80. 50 Years of Rock 1991
1. alternative rock (82)
2. rock (68)
3. heavy metal (44)
4. hard rock (33)
5. thrash metal (30)
6. country (23)
7. pop (19)
Nirvana
Nevermind
81. 50 Years of Rock 1992
1. alternative rock (83)
2. rock (56)
3. heavy metal (37)
4. hard rock (35)
5. thrash metal (29)
6. death metal (27)
7. indie rock (25)
A new genre is born….
Rage Against The Machine
Rage Against The Machine
82. 50 Years of Rock 1993
1. alternative rock (125)
2. rock (72)
3. indie rock (39)
4. pop (28)
5. hard rock (28)
6. punk rock (28)
7. grunge (26)
It is all about the West Coast now,
especially Seattle…
Tool
Undertow
83. 50 Years of Rock 1994
1. alternative rock (123)
2. rock (81)
3. indie rock (52)
4. punk rock (46) ↑
5. heavy metal (45)
6. hard rock (34)
7. country (24)
It is popular again and will be for the
next 10 years…
Soundgarden
Superknown
84. 50 Years of Rock 1995
1. alternative rock (139)
2. rock (68)
3. punk rock (49)
4. heavy metal (46)
5. indie rock (44)
6. hard rock (37)
7. grunge (28)
The Smashing Pumpkins
Mellon Collie and the Infinite
SadnessAs it is clear here, grunge was really
undercurrent of what was going at
the time although first half of the 90s
known to be the grunge half-decade
85. 50 Years of Rock 1996
1. alternative rock (132)
2. rock (98)
3. indie rock (60) ↑
4. punk rock (44)
5. heavy metal (42)
6. hard rock (28)
7. country (27)
Another generic label not fully
describing a genere…
Nick Cave and the Bad Seeds
Murder Ballads
86. 50 Years of Rock 1997
1. alternative rock (119)
2. rock (78)
3. indie rock (60)
4. punk rock (45)
5. heavy metal (33)
6. alternative metal (23)
7. pop punk (22)
Radiohead
OK Computer
87. 50 Years of Rock 1998
1. alternative rock (120)
2. rock (73)
3. indie rock (69)
4. punk rock (41)
5. heavy metal (37)
6. hard rock (29)
7. black metal (28)
Harder sound is more popular and
we have a new genre in the list
Neutral Milk Hotel
In the Aeroplane Over the Sea
88. 50 Years of Rock 1999
1. alternative rock (146)
2. indie rock (73)
3. rock (72)
4. heavy metal (40)
5. hard rock (40)
6. alternative metal (34)
7. punk rock (33)
The Beta Band
The Beta Band
We really did not see Britpop making
an appearance… although the
impact and influence would exist
89. 50 Years of Rock 2000
1. alternative rock (103)
2. indie rock (88)
3. rock (86)
4. punk rock (45)
5. heavy metal (41)
6. pop punk (37)
7. alternative metal (37)
Grandaddy
The Sophtware Slump
90. 50 Years of Rock 2001
1. alternative rock (117)
2. rock (94)
3. indie rock (83)
4. alternative metal (49)
5. nu metal (45)
6. hard rock (44)
7. punk rock (36)
Another metal subgenre appearing
and will not be the last.
System of a Down
Toxicity
91. 50 Years of Rock 2002
1. alternative rock (126)
2. indie rock (107)
3. rock (73)
4. heavy metal (54)
5. alternative metal (50)
6. hard rock (48)
7. punk rock (45)
Interpol
Turn on the Bright Lights
92. 50 Years of Rock 2003
1. alternative rock (169)
2. indie rock (117)
3. rock (91)
4. alternative metal (63)
5. punk rock (53)
6. hard rock (51)
7. power metal (46)
The White Stripes
Elephant
93. 50 Years of Rock 2004
1. alternative rock (155)
2. indie rock (130)
3. rock (96)
4. hard rock (64)
5. alternative metal (54)
6. punk rock (51)
7. pop punk (49)
Not much changing in the list…
Arcade Fire
Funeral
94. 50 Years of Rock 2005
1. alternative rock (168)
2. indie rock (164)
3. rock (107)
4. hard rock (69)
5. heavy metal (57)
6. pop punk (55)
7. alternative metal (53)
Sufjan Stevens
Illinoise
95. 50 Years of Rock 2006
1. alternative rock (188)
2. indie rock (179)
3. rock (105)
4. hard rock (70)
5. pop punk (58)
6. progressive metal (55)
7. power metal (46)
And yet another metal subgenre
hitting mainstream…
MUSE
Black Holes and Revelations
96. 50 Years of Rock 2007
1. alternative rock (208)
2. indie rock (201)
3. rock (109)
4. hard rock (67)
5. alternative metal (64)
6. heavy metal (62)
7. pop punk (59)
Radiohead
In Rainbows
97. 50 Years of Rock 2008
1. alternative rock (203)
2. indie rock (197)
3. rock (101)
4. hard rock (60)
5. pop (56)
6. metalcore (51)
7. heavy metal (50)
And we have another metal variant
that is here to stay…
Underoath
Lost in the Sound of Separation
98. 50 Years of Rock 2009
1. alternative rock (200)
2. indie rock (194)
3. rock (72)
4. hard rock (68)
5. indie pop (59)
6. pop rock (59)
7. metalcore (56)
Softer sounds come back…
Animal Collective
Merriweather Post Pavilion
99. 50 Years of Rock 2010
1. alternative rock (176)
2. indie rock (163)
3. rock (86)
4. hard rock (77)
5. indie pop (64)
6. heavy metal (62)
7. metalcore (61)
… and will be around… Arcade Fire
The Suburbs
100. 50 Years of Rock 2011
1. alternative rock (169)
2. indie rock (162)
3. metalcore (63)
4. indie pop (60)
5. alternative metal (58)
6. heavy metal (57)
7. rock (57)
Tinariwen
Tassili
101. 50 Years of Rock 2012
1. alternative rock (145)
2. indie rock (127)
3. rock (71)
4. hard rock (69)
5. alternative metal (50)
6. metalcore (49)
7. indie pop (45)
Goat
World Music
102. 50 Years of Rock 2013
1. alternative rock (126)
2. indie rock (124)
3. rock (73)
4. hard rock (57)
5. synthpop (56)
6. metalcore (51)
7. indie pop (51)
And synthpop makes a come back
after 30 years or so…
Queens of the Stone Age
...Like Clockwork
103. 50 Years of Rock 2014
1. alternative rock (108)
2. indie rock (106)
3. rock (50)
4. hard rock (48)
5. pop (41)
6. metalcore (41)
7. pop rock (40)
Mac DeMarco
Salad Days
105. What is an Intelligent Model?
•Intelligent model is actually not a technically accurate term (but
we use it to denote shift in technique)
•Models learn from data instead of arbitrary definition
•Can sometimes even distinguish and filter noise
•Can represent a far more complex data relationships
•Examples include HMM, SVM and recently Deep Learning
•We review word2wec which uses Neural Network
technique but not as deep as “Deep Learning”
106. word2vec Model
A very powerful model representing words (tokens) as vectors
based on their proximity to other words (tokens).
Once represented as vectors, all algebraic operations can be applied
to the vector representations.
107. word2vec Model
Skip-gram: a proximity-based probability model trained
using Neural Networks (Deep Learning)
Pink Floyd were an English rock band formed in London
X XX
108. word2vec Model
Break the
text to
sentences
Tokenise
each
sentence to
word/
phrases
Feed the
data to
engine
Store
the
Model
Training
Load the
model
Construct
the query
Run against
the model
(Filter noise)
Querying
110. word2vec Codz (Querying)
sims = word_sim.most_similar(positive=pos, negative=neg, topn=topn)
# pos is an array of positive e.g. [“Nick Mason”, “The Rolling Stones”]
# neg is an array of negative e.g. [“Pink Floyd”]
# result is an array of tuples of results for
# “Nick Mason” + “The Rolling Stones” - “Pink Floyd”
# the first entry of which is “Charlie Watts”
114. References
•All pictures from wikipedia.org used under Creative Commons
•Source of all data is from wikipedia.org collected online using a single call and then stored and processed
•Efficient Estimation of Word Representations in Vector Space. Mikolov et. al. http://arxiv.org/abs/1301.3781
•Gensim's word2vec
•networkx lib
•word2vec blog post (500K docs): Five crazy abstractions my Deep Learning word2vec model just did
•word2vec on Rock music blog: Daft Punk+Tool=Muse: word2vec model trained on a small Rock music corpus
•code for word2vec on wiki data
•Highcharts: highcharts
•word2vec paper: PDF
•Automatic real-time road marking recognition using a feature-driven approach PDF
•Video of the road marking recognition: here and here and here
•Future of Programming - Rise of the Scientific Programmer (and fall of the craftsman)