Walnut AI analyzed 100,000 job postings using NLP and word embedding techniques to learn skills in demand. Key insights include: product managers and software engineers are frequently mentioned roles; skills like product management, software engineering, and data-driven decision making appear often; and experience levels between 3-5 years are commonly required. Walnut AI's analysis of job posting text can reveal in-demand roles and skills to help professionals stay relevant and progress in their careers. Continuing to analyze more data sources and metadata can provide additional insights on shifting job demands.

1. Walnut ai
What we learnt from processing 100k job postings with NLP and WordEmbedding Methods
beta

2. Evolution
Peak Hanging-in Barely
skill relevance of professionals

3. Opportunity
Most people don't
know how they
can do better

4. Does this problem exist
ask for advice
friends
mentors
managers
groups

5. How do we solve this problem
what are people
talking about
What are
companies
asking for
What are
companies hiring
for
Data
CommunitiesJob Postings Resumes

6. Product Manager
[Masked Company Name], Inc. - Redwood City, CA 94063
[Masked Company Name] connects people globally around shared video content. Think online
living room - watch together, completely in sync, and group video chat at the same time. We’re
looking for a Product Manager to help us grow the product, our user base and ultimately,
[Masked Company Name].
You will work directly with a team of engineers and designers to improve existing products and
develop new ones. You need to be able to think holistically about user challenges across
multiple platforms, develop that into an actionable roadmap and execute.
Our lean team is growing quickly, and you’ll have the opportunity to make a huge impact at
Rabbit.
Who we’re looking for:
3+ years product management experience in consumer products or applications
Proven analytical skills and the ability to make data-driven decisions
A test-measure-iterate approach
A creative problem solver with a “get it done” attitude
Excellent communication and project management skills
Bonus points: experience managing web and Android applications, design or marketing
experience, an appreciation for puns, growth team experience
Job Type: Full-time
Required experience:
product management: 3 years
Lets look at some data

7. Product Manager
[Masked Company Name], Inc. - Redwood City, CA 94063
[Masked Company Name] connects people globally around shared video content. Think online
living room - watch together, completely in sync, and group video chat at the same time. We’re
looking for a Product Manager to help us grow the product, our user base and ultimately,
[Masked Company Name].
You will work directly with a team of engineers and designers to improve existing products
and develop new ones. You need to be able to think holistically about user challenges
across multiple platforms, develop that into an actionable roadmap and execute.
Our lean team is growing quickly, and you’ll have the opportunity to make a huge impact at
Rabbit.
Who we’re looking for:
3+ years product management experience in consumer products or applications
Proven analytical skills and the ability to make data-driven decisions
A test-measure-iterate approach
A creative problem solver with a “get it done” attitude
Excellent communication and project management skills
Bonus points: experience managing web and Android applications, design or marketing
experience, an appreciation for puns, growth team experience
Job Type: Full-time
Required experience:
product management: 3 years
How do we read data

8. How to compute text
the quick brown fox jumped over the lazy dog
([the, brown], quick), ([quick, fox], brown), ([brown, jumped], fox), ...
Cat 010000110110000101110100
01101011011010010111010001110100011001010
1101110
Kitten
Text Decimal
CBOW SkipGram
https://www.tensorflow.org/tutorials/word2vec/

9. Data Sources
Cleanse, Remove Stop Words
Generate Bigrams/Trigrams ..
UnSupervised Learning
Plot Phrases
c
v
U
n
S
u
p
er
vi
s
e
d
L
e
ar
ni
n
g
c
v
U
n
S
u
p
er
vi
s
e
d
L
e
ar
ni
n
g
c
v
U
n
S
u
p
er
vi
s
e
d
L
e
ar
ni
n
g
c
v
U
n
S
u
p
er
vi
s
e
d
L
e
ar
ni
n
g
develop new products
data-driven decision
'to','of','by','for','will','w
0.5474381446838379
Lets crunch this
Scrapy, Python, Beautifulsoup
Nltk, Python
Gensim, Nltk, Python
Gensim Word2Vec
TensorFlow
Matplotlib, Sklearn

10. What the !!!

11. yeah that makes sense

12. Core
Product mgmt
Skills
Experience Years
Noise
Lets get a pen and paper

13. Refine Keywords
Keyword freq/region
Merge
Publish
c
v
U
n
S
u
p
er
vi
s
e
d
L
e
ar
ni
n
g
c
v
U
n
S
u
p
er
vi
s
e
d
L
e
ar
ni
n
g
c
v
U
n
S
u
p
er
vi
s
e
d
L
e
ar
ni
n
g
Meta data +
Placing this in context

14. Early Results
Product Managers
Backend Engineers Software Engineers
Software Engineering Mgrs

15. Make this data work
https://m.me/Walnutbot

16. Summary
• What did we learn
• Know what you intend to learn
• Know your data sources [Open, Free, Paid]
• Unigrams are useless unless they are proper nouns
• Reuse learnt n-grams, continuously add to stop words phrases
• Ask real people if data makes sense
• Whats next
• More data sources+ Meta data
• Multiple Models exist for the same role, discover them
• Delta between models, insights lie in delta
• Combine insights with Meta data

17. Evolution
skill relevance of professionals
Stay Relevant
Progress
Transform

18. Thank You
Chandan Maruthi
https://www.linkedin.com/in/chandanmaruthi
WalnutAI