Published on


Published in: Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide


  1. 1. Introduction to<br />XLMiner™: <br />PARTITION DATA<br />XLMiner and Microsoft Office are registered trademarks of the respective owners.<br />
  2. 2. Introduction to Partition Data<br />Generally the data sets used in mining are enormous. Hence in order to mine data easily ,one method is to divide/partition data. Partitioning data means dividing the data set into multiple partitions that are mutually exclusive i.e. they do not overlap or the partitions have no data records are common.<br />Partitioning data generally results in 3 sets of data:<br />Training Data set :- This partition is used to create/build the mining model.<br />Validation Data set :- : It is used to check whether the model developed using the training set is accurate or not. The validation set consists of data whose result (the value of the variable to be determined) is already known so that results obtained after applying the model and the actual results can be matched.<br />Test data set :- It is used to determine how the model would perform when it encounters real world data. <br />http://dataminingtools.net<br />
  3. 3. Types of Partitions<br />XLMiner allows us to create 2 kinds of partitions:<br />Standard Partition: Creates 3 partitions based on the partition ratios provided. Data records are randomly elected and every record has an equal chance of lying in any of the partition.<br /><ul><li>Automatic: When this is selected, the wizard by default sets the partitioning ratio as 60(training):40(validation) and no test set is created. These values cannot be altered.
  4. 4. Specify percentages :Unlike automatic, if selected ,the user can specify the ratio of the partitions created in terms of percentages.
  5. 5. Equal partitions: Selecting this option sets a partitioning ratio of 33.3(training): 33.3(validation): 33.3(test) .</li></ul>Partition with oversampling: This method of partitioning is used when the percentage of successes in the output variable is very low in the dataset but we want to train the data with a particular percentage of successes.<br />http://dataminingtools.net<br />
  6. 6. Data Set used for Partition<br />http://dataminingtools.net<br />
  7. 7. Standard Partition (Automatic)-Step 1<br />http://dataminingtools.net<br />
  8. 8. Standard Partition (Automatic)-Output<br /> Testing Set Validation Set<br />http://dataminingtools.net<br />
  9. 9. Standard Partition (Specify)-Step 1<br />Selecting “Specify percentages” allows us to set the partitioning ratios as per our need. Here we have set a ratio of 50(testing):30(validation):20(test)<br />http://dataminingtools.net<br />
  10. 10. Standard Partition (Equal)-Step 1<br />Selecting “Equal” sets the partitioning ratio at 33.3% for each partition creating 3 equal sized partitions.<br />http://dataminingtools.net<br />
  11. 11. Oversampled Partition – Data Set<br />In order to oversample a data set, it must contain at least 1 data item that accepts only 2 distinct values, not more and only then can it be used as the success class(the data item which is oversampled)<br />http://dataminingtools.net<br />
  12. 12. Oversampled Partition – Step 1<br />http://dataminingtools.net<br />
  13. 13. Oversampled Partition – Output<br />The records in the training data set<br />http://dataminingtools.net<br />
  14. 14. Oversampled Partition – Output<br />Rows in Validation set = 27, Rows in testing set = 30% of 27 = 12.<br />http://dataminingtools.net<br />
  15. 15. Thank you<br />For more visit:<br />http://dataminingtools.net<br />http://dataminingtools.net<br />
  16. 16. Visit more self help tutorials<br />Pick a tutorial of your choice and browse through it at your own pace.<br />The tutorials section is free, self-guiding and will not involve any additional support.<br />Visit us at www.dataminingtools.net<br />