In Supervised ML handling Unseen Data and As generic post processing and avoiding generalization error or mis classification and have more representative samples and retrining
Sequential and reinforcement learning for demand side management by Margaux B...
Machine Learning , Decision Tress and Novelty Detection
1. Machine Learning Algorithms
(MLAs) and Novelty Detection
Rangaprasad Sampath (ranga.sampath@gmail.com)
Madhusoodhana Chari S (madhucharis@gmail.com)
2. Teaching a Child and a MLA (Machine
Learning Algorithm)
Orange
Apple
3. Responses to Unseen/Novel Objects
Insights
Humans may not classify Unseen/Novel objects into known classes.
MLAs classify Unseen/Novel objects into the most probable class.
Orange Orange (30%), Apple (70%)
Apple
I don’t know Orange (72%), Apple (28%)
No response
4. Decision Tree Classifier
Decision Tree Classifier labels as a Car or Not based on the
measurements of length (x2) and width (x1) of a vehicle.
4
x1
Width
(m)
x2
Length
(m)
Label
4 9 !Car
4 10 !Car
4 12 Car
3 11 Car
7 10 !Car
8 16 Car
12 18 Car
10 18 Car
Training Data
5. Novelty Classification
Test Data that is very different from what has
been seen during training i.e. Novelty, is
classified into one of the known classes.
5
x1 x2 Label
4 9 !Car
4 10 !Car
4 12 Car
3 11 Car
Test Data (Red dots)
6. Recognition of an Unknown class
Proposal: Label test data points that
represent Novelty as Unknown.
6
x1 x2 Label
4 9 Unknown
4 10 Unknown
4 12 Unknown
3 11 Unknown
Test Data (Red dots) Unknown
Unknown
Unknown
Unknown
7. Benefits
• Avoidance – of Novel data misclassification.
• Utility – in domains where it is difficult to obtain fully representative
datasets for training.
• Retraining – could be triggered if the number of data points classified
as Unknown exceeded the number of data points classified into
known classes.
• Alerts – could be raised if the percentage of data that got classified as
an Unknown class exceeded a set threshold (say 10 %).
Editor's Notes
This is a sample Three Pictures with Captions slide ideal for including three pictures with brief, bulleted text.
To Replace the Pictures on this Sample Slide (this applies to all slides in this template that contain replaceable pictures)
Select the sample picture and press Delete. Click the icon inside the shape to open the Insert Picture dialog box. Navigate to the location where the picture is stored, select desired picture and click on the Insert button to fit the image proportionally within the shape.
Note: Do not right-click the image to change the picture inside the picture placeholder. This will change the frame size of the picture placeholder. Instead, follow the steps outlined above.
Tip: use the Crop tool to reposition a picture within a placeholder. From the Picture Tools Format tab on the ribbon, click the Crop button. Click and drag the picture within the placeholder to reposition. To scale the picture within the placeholder (while Crop is active), grab a round corner handle and drag to resize. Hold Shift key to constrain picture aspect ratio when resizing.
This is a sample Three Pictures with Captions slide ideal for including three pictures with brief, bulleted text.
To Replace the Pictures on this Sample Slide (this applies to all slides in this template that contain replaceable pictures)
Select the sample picture and press Delete. Click the icon inside the shape to open the Insert Picture dialog box. Navigate to the location where the picture is stored, select desired picture and click on the Insert button to fit the image proportionally within the shape.
Note: Do not right-click the image to change the picture inside the picture placeholder. This will change the frame size of the picture placeholder. Instead, follow the steps outlined above.
Tip: use the Crop tool to reposition a picture within a placeholder. From the Picture Tools Format tab on the ribbon, click the Crop button. Click and drag the picture within the placeholder to reposition. To scale the picture within the placeholder (while Crop is active), grab a round corner handle and drag to resize. Hold Shift key to constrain picture aspect ratio when resizing.
This is a sample Three Pictures with Captions slide ideal for including three pictures with brief, bulleted text.
To Replace the Pictures on this Sample Slide (this applies to all slides in this template that contain replaceable pictures)
Select the sample picture and press Delete. Click the icon inside the shape to open the Insert Picture dialog box. Navigate to the location where the picture is stored, select desired picture and click on the Insert button to fit the image proportionally within the shape.
Note: Do not right-click the image to change the picture inside the picture placeholder. This will change the frame size of the picture placeholder. Instead, follow the steps outlined above.
Tip: use the Crop tool to reposition a picture within a placeholder. From the Picture Tools Format tab on the ribbon, click the Crop button. Click and drag the picture within the placeholder to reposition. To scale the picture within the placeholder (while Crop is active), grab a round corner handle and drag to resize. Hold Shift key to constrain picture aspect ratio when resizing.