Emory NLP Weekly - Date: 9/9/2020 - Presenter: Xiangjue Dong (MS student) https://www.linkedin.com/events/6711755863830466561/

1. Resume Classification with
Term Attention Embeddings
Emory NLP Weekly
9/9/2020
Xiangjue Dong

2. Outline
• Previous Work
• Introduction
• Approaches
• Results
• Error Analysis
• Current Work
• Introduction
• Approaches
• Reference

3. Previous Work

4. Introduction – Dataset
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

5. Introduction – Dataset
• Applications: 24,933 (A).
• Remove duplicated resumes within the same level: 9,286 (B).
• Remove duplicated resumes across all levels;
Retrain only the resumes to the highest level: 6,492 (C).
• Discarded unstructured ones: 5,362 (Br), 3,425 (Cr).
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

6. Introduction – Tasks
• Competence-Level Classification - Multiclass Classification Task
• Given a resume, decide which level of CRC positions that the corresponding
applicant is suitable for.
• Labels: CRC1, CRC2, CRC3, CRC4, NQ
• Resume-to-Job_Description Matching - Binary Classification Task
• Given a resume and a CRC job description, decide whether the applicant is
suitable for that job
• Labels: accept, reject
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

7. Approaches – Competence-Level Classification
• Whole-Context: Section Trimming (Baseline)
• Context-Aware: Section Pruning
• Context-Aware: Chunk Segmenting
• Context-Aware: Section Encoding
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

8. Whole-Context: Section Trimming
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

9. Context-Aware: Section Pruning
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

10. Context-Aware: Section Pruning
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models
• Remove all stop words;
• Remove all words with frequencies top 5%;
• Remove all words with frequencies top 30%.

11. Context-Aware: Section Pruning
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

12. Context-Aware: Chunk Segmenting
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

13. Context-Aware: Chunk Segmenting
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

14. Context-Aware: Section Encoding
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

15. Resume-to-Job_Description Matching
• Whole-Context: Sec./Desc. Trimming (Baseline)
• Context-Aware: Chunk Segmenting + Section Encoding + Desc.
Embedding
• Context-Aware: Multi-Head Attention
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

16. Whole-Context: Sec./Desc. Trimming
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

17. Context-Aware: Chunk Segmenting + Section
Encoding + Desc. Embedding
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

18. Context-Aware: Multi-Head Attention
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

19. Context-Aware: Multi-Head Attention
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

20. Results - Competence-Level Classification
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

21. Results - Resume-to-Job_Description Matching
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

22. Error Analysis
• It’s unable to identify clinical research experience.
• It can’t identify dates of experience.
• It can’t distinguish adjacent CRC positions.
Changmao et al. 2020. Competence-Level Prediction and Resume-Job_Description Matching Using Context-Aware Transformer Models

23. Current Work

24. Introduction – New Dataset
• CRC (2020)
• CRN (2020)

25. Introduction – New Dataset Statistics
CRN-1 CRN-2 CNR-3 Total
CRN (2020) 69 242 19 330
CRC-1 CRC-2 CRC-3 CRC-4 CRC-QM Total
CRC (2020) 11485 7180 1396 479 83 20623

26. Introduction - Guideline

27. Glossary of Terms
• Clinical Settings
• Hospital
• Clinic
• Doctor/Physician Office

28. Glossary of Terms
• Clinical Settings
• Clinical Roles
• Patient Service(s) Coordinator,
• Patient Care Coordinator,
• Clinical Coordinator,
• Unit Secretary
• Clinical Service Representative,
• Medical Scribe, Medical Secretary,
• Pharmacy Technician,
• Phlebotomist,
• Tumor Registrar
• Pre/Post Award Administrator
• Internship in a scientific or health related area (1000 documented hours).

29. Glossary of Terms
• Clinical Settings
• Clinical Roles
• Clinical Research Experience
• clinical research coordinator;
• clinical research associate;
• clinical research assistant;
• research interviewer;
• research assistant;
• clinical research manager;
• clinical research supervisor.

30. Glossary of Terms
• Clinical Settings
• Clinical Roles
• Clinical Research Experience
• Bachelor’s Degrees in scientific or health related fields+
• Biology; Psychology; Epidemiology; Chemistry; Biomedical Science;
Neuroscience; Behavioral Science; Social Work; Microbiology; Nutrition/Food;
Public Health; Health Promotion and Global Health; Complementary and
Alternative Health; Community Wellness .

31. Glossary of Terms
• Clinical Settings
• Clinical Roles
• Clinical Research Experience
• Bachelor’s Degrees in scientific or health related fields+
• Bachelor’s Degrees in non-scientific or non-health related fields
• Business Management;
• Healthcare Management;
• Healthcare Administration;
• Informatics;
• Gender and Global Health

32. Glossary of Terms
• Clinical Settings
• Clinical Roles
• Clinical Research Experience
• Bachelor’s Degrees in scientific or health related fields+
• Bachelor’s Degrees in non-scientific or non-health related fields
• Laboratory Research- Including animal and industry research-
nonclinical
• laboratory specialist; laboratory assistant; laboratory scientist; some PhD
fields are identifiable as laboratory research – chemistry, biotechnology, etc.

33. Glossary of Terms
• Clinical Settings
• Clinical Roles
• Clinical Research Experience
• Bachelor’s Degrees in scientific or health related fields+
• Bachelor’s Degrees in non-scientific or non-health related fields
• Laboratory Research- Including animal and industry research-
nonclinical
• Technical Diploma
• LPN,
• Medical Assistant

34. Model
…
𝑒!"
MHA 𝑒∑
!$!"$%
LD
𝑜&
𝑡'
𝑡(

35. Timeline – By end of September
• Parse the resume using tools to prepare the data
• Generate the statistics table of this year’s data
• Divide data into 20 batches for annotation
• Build models

36. Reference
• Changmao et al. 2020. Competence-Level Prediction and Resume-
Job_Description Matching Using Context-Aware Transformer Models