Machine Language Job Aid

1
AutoML Step-by-Step Guide for Class Authors
Overview
This Guide accompanies the learning video, “AutoML Step-by-Step for Class Authors,” in which we create a class for laptop batteries.
You can use the following like to access the video: (INSERT FINAL VIDEO LINK HERTE).
This AutoML Step-by-Step Guide shows you how to author an AutoML class. At a high level there are four steps:
• Class Definition: view and edit class definition and program-specific information
• Input Domain: configure the classifier that will be taken as input domain by the ML model
• ML Model: where train the ML classifier to recognize patterns and improve its predictions
• Deploy and Launch: complete the required steps to launch the class to production
Each requires multiple actions in the UI and processing on the backend. In this guide we walk through each of them. Let’s find all the
laptop batteries using AutoML. We will use CP Central. Start by navigating to cp-central.catalog.amazon.dev.

2
Stage 1: Class Definition
Step Actions Screenshot
1.
a) Select Classes from main
menu, left side. This brings
up a summary of all
classes, status, last
modified by, and modified
date.
b) Click the button, Create
new class, upper right
2. a) Select ASIN as entity to
classify
b) Click Next

3
3. a) Select AutoML as ASIN
classification technique
b) Click next

4
4. a) Under Class details,
select Program as Sandbox
b) Enter Class name,
Demo_Laptop_Batteries_
(your initials)_ML
c) Use pulldown to select
marketplace, amazon.com
d) Enter class Description,
Demo class to identify all
Laptop Batteries sold on
amazon.com
e) Select Next

5
5. a) In Sandbox program
details, edit mandatory
items.
b) Select 5 for ASIN Review
Priority
c) Use dropdown to select
Agency as null
d) Use dropdown to select
Product category as All
e) Select Notification Date,
today’s date
f) Scroll down, skip optional
fields, and enter Target TP
rate, 95
g) Click Save changes
↓

6
6. a) Skip True positive ASINs
for now
b) Click Next
7. a) Also skip True negative
ASINs
b) Click Next

7
8. a) In the Summary that
appears, review entries
b) Click Create class at
bottom

8
9. a) Your class is created
b) You have completed first
of four stages in authoring
an AutoML class
c) Let’s begin Stage Two of
four.
d) In CP Central overview
that appears, click Edit for
input domain.

9
Stage 2: Input Domain
1. a) In Keyword Classifier
details select radio button,
Only GLs listed below
b) Use GLs dropdown,
select wireless, wireless
accessory, electronics,
mobile electronics
c) Scroll down and enter
for Inclusion category
under Keywords:
{AND
AttributesContain[item_nam
e|product_description|bulle
t_point:laptop]
attributescontain[item_nam
e|product_description|bulle
t_point:battery]
}
d) Click Save
↓

10
2. a) Next to green check,
Classifier saved successful
appears
b) Click Search at right
3. a) Displays both true
positive ASINs (laptop
batteries) and false positive
ASINs (not laptop batteries)
b) Time for text validation

11
4. In breadcrumb at top of
Keyword classifier details
screen, click class name to
navigate to class overview
screen.
5. On class overview screen,
click Test under Input
domain to begin test
classification
6. a) Select Full catalog
b) Click Test class

12
7. Test button becomes
inactive as test process
begins
8. a) You receive email when
test classification in
progress
b) After a while another
email notifies you when
completed

13
9. a) When test is complete,
Validate button becomes
active
b) Use pulldown and click
Validate test accuracy
c) Click Confirm on next
screen to begin validation

14
10. a) New screen opens for
validation to evaluate
keyword predicate
accuracy.
b) Typical validation
consists of 1,000 ASINs
c) Label all ASINs Yes, No,
or Not Enough Information
(NEI)
d) Once you label all ASINs,
should see 15-85% Yes
labels ensuring good
balance of True Positives
e) Less than 1 million ASINs
shows “Mark Batch
Complete,” click button to
close tab
f) More than 1 million
ASINs shows “volume has
exceeded limit,” close tab,
discard batch, and follow
instructions in next step.
d)
c)
e)
f)

15
11. a) AutoML lets you know
when you have successfully
started Validation
b) Click close
12. a) ONLY required when
cannot Mark Batch
Complete
b) Use Validate pulldown
and click Cancel validation
c) You have completed
second of four stages of
AutoML validation

16
Stage 3: ML Model
1. a) Let’s begin the third of
four authoring steps in
AutoML
b) Initialize button is
enabled
c) Click to initialize model
training session

17
2. a) Set PPV as 90
b) Set NPV as 90
c) Set Coverage as 70
d) Check, I have completed
a full catalog test
classification
e) Click initialize

18
3. a) Status indicates, ML
model initialization in
progress
b) This process takes a
while
c) In breadcrumb, click
class name to take you to
class overview
4. a) Train button is now
enabled in overview
b) Click Train to begin
model training

19
5. a) Training screen displays
ASINs that match keyword
predicate
b) ASINs appear 10 at a
time
c) Confirm True Positives
by clicking green check and
False Positives by clicking
red X.
d) In unsure, do not select
any option
e) Unselect by clicking
again
f) After labeling 10 ASINs,
click submit.
g) AutoML learns and
suggests 10 more
h) Bar graph at upper right
indicates percent of
convergence process
complete

20
6. a) 100% convergence
requires average of 1,000
to 5,000 clicks
b) At 100%, click Publish to
publish the AutoML model
7. a) Status indicates publish
is pending
b) This process also takes a
while
c) Click on class name in
breadcrumb to navigate to
Class overview

21
8. Once Test button enabled
under ML model à Test
class, click to launch new
test
9. Select Full catalog and click
Test class.

22
10. Back on Class overview,
Test button disabled as
new test batch generated
11. a) Email indicates test
classification in progress
b) After a while, another
email notifies when
completed

23
12. a) When test is complete,
Validate button is active
b) Use pulldown to click
Validate test accuracy

24
13. a) Test validation opens in
new tab
b) Label all ASINs Yes, No,
or Not Enough Information
c) Summary of label counts
show at top
c) b)
14. a) Label all ASINs
b) Click Mark Batch
Complete button (upper
right)
c) Close tab

25
15. a) On Class overview tab,
AutoML lets you know you
have successfully started
validation
b) Click close
c) You have completed the
third of four stages in
authoring an AutoML class

26
Stage 4: Deploy and Launch
1. a) Let’s begin the fourth
stage in authoring an
AutoML class
b) Now that test validation
is complete, you are ready
to deploy class
c) Deploy button is active
d) Click on Deploy
2. a) Set reason as New class
b) Click Deploy (lower
right)

27
3. a) The system lets you
know Deploy is successful
b) Click Close
4. Once Launch button is
enabled, click on it
5. a) Check Existing ASINs,
Select Full catalog, and
Check New ASINs/ASINs
b) Click Launch

28
6. Class is launched and
classification job submitted
7. a) An email indicates
classification in progress
b) After a while, another
email notifies when it is
completed

29
8. a) Status updates to
Deployed (Classifying
new/updated ASINs)
b) Class is now running on
production
c) You have authored an
AutoML class successfully

Machine Language Job Aid

Recommended

Recommended

More Related Content

Similar to Machine Language Job Aid

Similar to Machine Language Job Aid (20)

More from Jim Piechocki

More from Jim Piechocki (20)

Recently uploaded

Recently uploaded (20)

Machine Language Job Aid