{"id":9679,"date":"2022-06-24T08:47:52","date_gmt":"2022-06-24T12:47:52","guid":{"rendered":"https:\/\/demand-planning.com\/?p=9679"},"modified":"2022-06-24T10:02:07","modified_gmt":"2022-06-24T14:02:07","slug":"my-favorite-forecasting-model","status":"publish","type":"post","link":"https:\/\/demand-planning.com\/2022\/06\/24\/my-favorite-forecasting-model\/","title":{"rendered":"My Favorite Forecasting Model"},"content":{"rendered":"<span class=\"cb-itemprop\" itemprop=\"reviewBody\"><hr \/>\n<p><strong>One of the questions I get asked most frequently is \u201cWhat is your favorite forecasting model?\u201d My answer is \u201cit depends\u201d because not all problems need a hammer. Sometimes you need a wrench or a screwdriver which is why I advocate having a forecasting toolbox that we can draw on to tackle whatever forecasting project arises.<\/strong><\/p>\n<p>When it comes to forecasting methods, we have everything from pure qualitative methods to pure quantitative methods, and everything in between. On the far left of the image below you\u2019ll see judgmental, opinion-based methods with knowledge as the inputs. On the far right, we have unsupervised machine learning \u2013 AI, Artificial Neural Networks etc. where the machine decides on the groupings and optimizes the parameters as they learn the test data. In between these two extremes we have na\u00efve models, causal\/relationship models, and time series models.<\/p>\n<p>All of the models should be in our toolbox as forecasters.<\/p>\n<p>But with dozens of methods available to you, how you decide which ones to use? There are cases when sophisticated machine learning will help you and there are cases when pure judgement will help but somewhere in between the extremes is where you\u2019ll find the models you\u2019ll need on a\u00a0 day-to-day basis.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-9690 aligncenter\" src=\"https:\/\/demand-planning.com\/wp-content\/uploads\/2022\/06\/Screenshot_18.png\" alt=\"\" width=\"900\" height=\"446\" srcset=\"https:\/\/demand-planning.com\/wp-content\/uploads\/2022\/06\/Screenshot_18.png 726w, https:\/\/demand-planning.com\/wp-content\/uploads\/2022\/06\/Screenshot_18-300x149.png 300w\" sizes=\"(max-width: 900px) 100vw, 900px\" \/><\/p>\n<h2><strong>Picking The Right Model For A Particular Forecast<\/strong><\/h2>\n<p>The main thing is to have a toolbox full of different methods that you can draw on depending on the data available and the resources you have. We must balance 3 key elements when choosing a model:<\/p>\n<p><strong><em>Time available<\/em><\/strong>: How much time do you have to generate a forecast? Some models take longer than others.<\/p>\n<p><strong><em>Interpretability of outputs<\/em>:<\/strong> Do you need to explain how the model works to stakeholders? Outputs of some models are difficult to explain to non-forecasters.<\/p>\n<p><strong><em>Data:<\/em><\/strong> Some models require more data than others and we don&#8217;t always have sufficient data.<\/p>\n<p>For example, putting together a sophisticated machine learning model and training it could take months to build, plus extra time for it to provide a useable output. When a forecast is needed <em>now<\/em>, this kind of model won\u2019t help. Similarly you have little or no data as with new products, you may have to use judgmental methods.<\/p>\n<p>Balancing interpretability and accuracy is also key. There are models whose accuracy can be finetuned to a great degree but as we become more accurate, interpretability (explaining the rationale behind the number) often becomes more difficult. Artificial Neural Networks, for example, can be very accurate, but if you need to explain to partners in the S&amp;OP process or to company execs how the model works and why they should trust it, well you might have some difficulty.<\/p>\n<p>Time series models like regression or exponential smoothing are much easier for stakeholders to understand. So what kind of accuracy do you need? Do you need 99% accuracy for a particular forecast, or is some margin of error acceptable? Remember that there are diminishing returns to finetuning a model for accuracy &#8211; more effort doesn&#8217;t necessarily provide more business value.<\/p>\n<p>This is why the best model depends on the context you\u2019re working in.<\/p>\n<p>&nbsp;<\/p>\n<p><iframe loading=\"lazy\" title=\"What Are My Favorite Forecasting Methods?\" width=\"1200\" height=\"675\" src=\"https:\/\/www.youtube.com\/embed\/I4sc0mbyt8A?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<h3><strong>Judgmental Methods<\/strong><\/h3>\n<p>These are not sophisticated but they have their place. When I have no historic data, i.e. for a new product or customer, I have nothing to forecast with. Remember, human judgement based on qualitative factors <em>is a forecast <\/em>and it\u2019s better than no forecast at all.<\/p>\n<p>Judgments are also important in overriding statistical forecasts when an external variable emerges that is isn\u2019t accounted for. A model doesn\u2019t know if you\u2019ve just opened a new store or if supply constraints just unexpectedly emerged. Of course, human judgement has bias \u2013 be sure to identify it if you\u2019re using judgmental models. In the Judgmental category we have:<\/p>\n<p><strong><em>Salesforce Method<\/em><\/strong>: This involves asking what salespeople think about future demand based on their knowledge of the market and customers.<\/p>\n<p><strong><em>Jury Method<\/em><\/strong>: This simply involves surveying stakeholder\u2019s opinions and letting the consensus decide what future demand is likely to be.<\/p>\n<p><strong><em>Dephi Method<\/em><\/strong>: A more systematic version of the Jury Method where stakeholders blindly submit their estimates\/forecasts. You then take a mean of the responses, which is a more robust\/accurate method than you might think.<\/p>\n<h3><strong>Time Series Models<\/strong><\/h3>\n<p>58% of planning organizations use time series methods. It\u2019s popular because we all have the data we need for this method &#8211; we can use sales data or shipment data. Also our colleagues in Finance, Inventory Management and Production can all use these forecasts. Here we identify patterns (whether level, trend, seasonality) and extrapolate going forward.<\/p>\n<p>The key assumption here is that what happened in the past is likely to continue into the future. This means this method works best in stable environments with prolonged demand trends. It doesn\u2019t perform so well with volatile products\/customers, new products and doesn\u2019t explain noise.<\/p>\n<h3><strong>Averaging Models<\/strong><\/h3>\n<p>Instead of using one single data point like a na\u00efve forecast, here we\u2019re using more data points and smooth them, the theory being that this provides a more accurate value. In this category we have simple moving averages and exponential moving averages. The difference between the two is that SMA simply calculates an average of price data while EMA applies more weight to more recent data points.<\/p>\n<h3><strong>Decomposition Models<\/strong><\/h3>\n<p>These models take out the elements of level, trend, seasonality, and noise components, and add them back in for a forward-looking projection. It\u2019s a good statistical method to understand seasonality and trend of a product.<\/p>\n<h3><strong>Exponential Smoothing \u00a0<\/strong><\/h3>\n<p>These are the most used methods and include single and double exponential smoothing, with the Holt model and Winters model being widely used. There is also Holt-Winters which is a combination of the two which is a level, trend, and seasonal model so we\u2019re getting 3 attributes of the time series, enabling an exponential curve weighting the past exponentially.<\/p>\n<p>If a na\u00efve model is taking a single point and averaging them to make multiple points, we\u2019re now taking multiple points and weighting them differently, considering level, trend and seasonality. I find this to be a very versatile model that is appropriate for a lot of data sets. It\u2019s easy to put together, can be used with relatively little data, and is easy to interpret and explain.<\/p>\n<h2><b>Going Beyond Time Series Models\u00a0<\/b><\/h2>\n<p>All data is not time related or sequential. And all information is not necessarily contained within a dataset. Casual or relationship methods assume that there is an external variable (causal factors) that explains demand in a dataset. Examples of causal factors include economic data like housing starts, GDP, weather etc. Relationship models include penetration and velocity models where you add variables to a model.<\/p>\n<p>These carry on nicely from exponential smoothing models that identify level, trend, seasonality and noise. The noise can be explained with causal models and can identify whether there is an external variable (or several). This is useful when there is a lot of noise in your data. Generally speaking, these models are useful alongside series models to explain the consumer behavior changes that are causing the changing demand patterns\/noise.<\/p>\n<h3><strong>Machine Learning Models<\/strong><\/h3>\n<p>Machine learning models take information from a previous iteration or training data set and use them to build a forecast. They can handle multiple types of data which makes them very useful. There are interpretability issues with these models, however, and there is a learning curve when it comes to using them. But it\u2019s not too difficult to get started with the basics &#8211; Na\u00efve Bayes is a good place to start.<\/p>\n<h3><strong>Clustering Models<\/strong><\/h3>\n<p>Clustering, a form of segmentation, allows us to put data into smaller more manageable sub-groups of like data. These subgroups can then be modeled more accurately. At a simple level, classification can be the Pareto rule, or they can be more complex like hierarchical clustering using a dendrogram (a form of distribution which considers distribution of points) and K-means where we group data based on their distance from a central point. They\u2019re all ways of breaking up large data sets into more manageable groups.<\/p>\n<h2><strong>Picking the Best Model <\/strong><\/h2>\n<p>Understand why you\u2019re forecasting. Think about how much time you have, the data you have, your error tolerance and the need the need for interpretability then balance these elements. Start simple (na\u00efve might get you there) and work from there. You might need a hammer, screwdriver, or wrench \u2013 be open to using all the tools in your toolbox.<\/p>\n<hr \/>\n<p><a href=\"https:\/\/ibf.org\/books\/predictive-analytics-for-business-forecasting-and-planning-111\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft wp-image-8866 size-medium\" src=\"https:\/\/demand-planning.com\/wp-content\/uploads\/2021\/01\/Predictive-Analytics-In-Business-Forecasting-2-235x300.jpg\" sizes=\"(max-width: 235px) 100vw, 235px\" srcset=\"https:\/\/demand-planning.com\/wp-content\/uploads\/2021\/01\/Predictive-Analytics-In-Business-Forecasting-2-235x300.jpg 235w, https:\/\/demand-planning.com\/wp-content\/uploads\/2021\/01\/Predictive-Analytics-In-Business-Forecasting-2-803x1024.jpg 803w, https:\/\/demand-planning.com\/wp-content\/uploads\/2021\/01\/Predictive-Analytics-In-Business-Forecasting-2-768x980.jpg 768w, https:\/\/demand-planning.com\/wp-content\/uploads\/2021\/01\/Predictive-Analytics-In-Business-Forecasting-2-1204x1536.jpg 1204w, https:\/\/demand-planning.com\/wp-content\/uploads\/2021\/01\/Predictive-Analytics-In-Business-Forecasting-2-1605x2048.jpg 1605w, https:\/\/demand-planning.com\/wp-content\/uploads\/2021\/01\/Predictive-Analytics-In-Business-Forecasting-2-scaled.jpg 2006w\" alt=\"\" width=\"235\" height=\"300\" \/><\/a>To add the above-mentioned models to your bag of tricks, get your hands on Eric Wilson\u2019s new book\u00a0<em><a href=\"https:\/\/ibf.org\/books\/predictive-analytics-for-business-forecasting-and-planning-111\">Predictive Analytics For Business Forecasting<\/a>.\u00a0<\/em>It is a must-have for the demand planner, forecaster or data scientist looking to employ advanced analytics for improved forecast accuracy and business insight.\u00a0<a href=\"https:\/\/ibf.org\/books\/predictive-analytics-for-business-forecasting-and-planning-111\">Get your copy<\/a>.<\/p>\n<p>&nbsp;<\/p>\n<\/span>","protected":false},"excerpt":{"rendered":"<p>One of the questions I get asked most frequently is \u201cWhat is your favorite forecasting model?\u201d My answer is \u201cit depends\u201d because not all problems need a hammer. Sometimes you need a wrench or a screwdriver which is why I advocate having a forecasting toolbox that we can draw on to tackle whatever forecasting project [&hellip;]<\/p>\n","protected":false},"author":3470,"featured_media":9689,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[387],"tags":[43],"class_list":{"0":"post-9679","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-models-and-methods","8":"tag-forecasting-models"},"_links":{"self":[{"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/posts\/9679"}],"collection":[{"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/users\/3470"}],"replies":[{"embeddable":true,"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/comments?post=9679"}],"version-history":[{"count":0,"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/posts\/9679\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/media\/9689"}],"wp:attachment":[{"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/media?parent=9679"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/categories?post=9679"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/demand-planning.com\/wp-json\/wp\/v2\/tags?post=9679"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}