Measuring Forecast Accuracy Prepared by : Jennifer Preston
Agenda 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
Agenda – Basic Concept 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
Basic Concept Forecast Error : Where : A i  – the actual value in time period  i   F i  – the forecast value in time period  i
Dimensions of Forecast Accuracy FORECAST ACCURACY Quantity  Accuracy Time  Accuracy
Agenda – Quantity Accuracy 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
Quantity Accuracy  Common Measurements Mean Error Where : FE : Forecast Error Ai  : The actual value in time period i Fi  : The forecast value in time period i Mean Square Error Where : MSE : Mean Square Error Ai  : The actual value in time period i Fi  : The forecast value in time period i
Quantity Accuracy  Common Measurements Mean Absolute Deviation Where : MAD : Mean Absolute Deviation Ai  : The actual value in time period i Fi  : The forecast value in time period i Mean Absolute Percentage Error Where : MAPE : Mean Square Error Ai  : The actual value in time period i Fi  : The forecast value in time period i
Quantity Accuracy Calculation  (Under and Over Forecast) Quantity Accuracy  =   Where N   : Set of forecast quantity related to an actual quantity n= 1, 2, 3 ....... N.  Fn_i : Forecast quantity number  n  related to an actual quantity in period  i Ai   : Corresponding actual quantity in period  i c   : Weight factor related to over- and under-forecast, c > 1
Quantity Accuracy Calculation (Weight of Under and Over Forecast) If costs related to underforecast = costs related to overforecast,  then C=2 If costs related to underforecast < costs related to overforecast, then 1<C<2 Order=A 100% 0% Forecast Accuracy Forecasted Quantity 2A Overforecast Underforecast A 100% 0% Forecast Accuracy Forecasted Quantity CA Overforecast Underforecast
Agenda – Time Accuracy 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
Time Accuracy  (Different Time Shifting) Prepone Postpone
Time Accuracy Calculation (Post and Pre-poned Forecast) Time Accuracy  =  Where  T : difference between the forecast time and the actual time TD : time span for assigning greater-than-zero accuracy for a time shift
Agenda – All in One 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
Combining Quantity and Time Accuracy : Total Forecast Accuracy
Thank You

Measuring Forecast Accuracy

  • 1.
    Measuring Forecast AccuracyPrepared by : Jennifer Preston
  • 2.
    Agenda 1. BasicConcept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
  • 3.
    Agenda – BasicConcept 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
  • 4.
    Basic Concept ForecastError : Where : A i – the actual value in time period i F i – the forecast value in time period i
  • 5.
    Dimensions of ForecastAccuracy FORECAST ACCURACY Quantity Accuracy Time Accuracy
  • 6.
    Agenda – QuantityAccuracy 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
  • 7.
    Quantity Accuracy Common Measurements Mean Error Where : FE : Forecast Error Ai : The actual value in time period i Fi : The forecast value in time period i Mean Square Error Where : MSE : Mean Square Error Ai : The actual value in time period i Fi : The forecast value in time period i
  • 8.
    Quantity Accuracy Common Measurements Mean Absolute Deviation Where : MAD : Mean Absolute Deviation Ai : The actual value in time period i Fi : The forecast value in time period i Mean Absolute Percentage Error Where : MAPE : Mean Square Error Ai : The actual value in time period i Fi : The forecast value in time period i
  • 9.
    Quantity Accuracy Calculation (Under and Over Forecast) Quantity Accuracy = Where N : Set of forecast quantity related to an actual quantity n= 1, 2, 3 ....... N. Fn_i : Forecast quantity number n related to an actual quantity in period i Ai : Corresponding actual quantity in period i c : Weight factor related to over- and under-forecast, c > 1
  • 10.
    Quantity Accuracy Calculation(Weight of Under and Over Forecast) If costs related to underforecast = costs related to overforecast, then C=2 If costs related to underforecast < costs related to overforecast, then 1<C<2 Order=A 100% 0% Forecast Accuracy Forecasted Quantity 2A Overforecast Underforecast A 100% 0% Forecast Accuracy Forecasted Quantity CA Overforecast Underforecast
  • 11.
    Agenda – TimeAccuracy 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
  • 12.
    Time Accuracy (Different Time Shifting) Prepone Postpone
  • 13.
    Time Accuracy Calculation(Post and Pre-poned Forecast) Time Accuracy = Where  T : difference between the forecast time and the actual time TD : time span for assigning greater-than-zero accuracy for a time shift
  • 14.
    Agenda – Allin One 1. Basic Concept 2. Quantity Accuracy 3. Time Accuracy 4. All in One
  • 15.
    Combining Quantity andTime Accuracy : Total Forecast Accuracy
  • 16.