Time is one of the most important factors on which our businesses and real life depend. But, technology has helped us manage the time with continuous innovations taking place in all aspects of our lives. Don’t worry, we are not talking about anything which doesn’t exist. Let’s be realistic here.
Here, we are talking about the techniques of predicting & forecasting of different industries data for making future strategies. The method we generally use, which deals with time-based data that is nothing but “Time Series Data” & the models we build up for that is “Time Series Modeling”. As the name indicates, it’s basically working on time (years, days, hours, and minutes) based data, to explore hidden insights of the data and trying to understand the unpredictable nature of the market which we have been attempting to quantify.
The time series data used to provide visual information to the unpredictable nature of the market, we have been attempting to quantify and trying to get a grip on that.
An Ordered sequence of observations of a variable or captured object at an equally distributed time interval. The time series is anything which is observed sequentially over the time at the regular interval like hourly, daily, weekly, monthly, quarterly etc. Time series data are important when you are predicting something which is changing over time using the past data. In time series analysis, the goal was to estimate the future value using the behaviours in the past data.
There are many statistical techniques available for time series forecast, however, we have found few effective ones which are listed below:
Techniques of Forecasting:
- Simple Moving Average (SMA)
- Exponential Smoothing (SES)
- Autoregressive Integrated Moving Average (ARIMA)
- Neural Network (NN)
METHOD-I: SIMPLE MOVING AVERAGE (SMA)
A simple moving average (SMA) is the simplest type of technique of forecasting. Basically, a simple moving average is calculated by adding up the last ‘n’ period’s values and then dividing that number by ‘n’. So the moving average value is considered as the forecast for the next period.
Why Do We Use SMA?
Moving averages can be used to quickly identify whether selling is moving in an uptrend or a downtrend depending on the pattern captured by the moving average.
I.e. A moving average is used to smooth out irregularities (peaks and valleys) to easily recognize trends.
SMA Working Example:
Let us suppose, we have a time series data, to have a better understanding on SMA, Where, we have the graphical view of our data, in that we have twelve observations of Price with the equal interval of time. After plotting our data, it seems that it has an upward trend with a lot of peaks and valleys.
Conclusion: The larger the interval, the more the peaks and valleys are smoothed out. The smaller the interval, the closer the moving averages are to the actual data points. The SMA is basically dealing with historical data having more and more peak and valleys. Probably it would be stock data, retail data etc.
METHOD-II: EXPONENTIAL SMOOTHING
This is the second well-known method to produce a smoothed Time Series. Exponential Smoothing assigns exponentially decreasing weights as the observation get older.
Why Do We Use Exponential Smoothing?
Exponential smoothing is usually a way of “smoothing” out the data by removing much of the “noise” (random effect) from the data by giving a better forecast.
Types of Exponential Smoothing Methods
Simple Exponential Smoothing: – If you have a time series that can be described using an additive model with the constant level and no seasonality, you can use simple exponential smoothing to make the short-term forecast.
Holt’s Exponential Smoothing: – If you have a time series that can be described using an additive model with increasing or decreasing trend and no seasonality, you can use Holt’s exponential smoothing to make the short-term forecasts.
Winters’ Three-Parameter Linear and Seasonal Exponential Smoothing: – If you have a time series that can be described using an additive model with increasing or decreasing trend and seasonality, you can use Holt-Winters exponential smoothing to make short-term forecasts.
Here, we have an alpha value that is smoothing constant and this method is called simple exponential smoothing method which considers other two factors as constant (i.e. Seasonality & Trend). Double’s (Holt’s) Exp. Smoothing & Winter’s Exp. Smoothing Methods dealing two factors i.e. Trend and Seasonality (i.e. Beta & Gamma).
Conclusion: Larger the alpha, closer to the actual data points and vice versa. This method is suitable for forecasting data with no trend or seasonal pattern (alpha = Smoothing Constant).
METHOD-III: AUTOREGRESSIVE INTEGRATED MOVING AVERAGE (ARIMA)
Autoregressive Integrated Moving Average (ARIMA): – A statistical technique that uses time series data to predict future. The parameters used in the ARIMA is (P, d, q) which refers to the autoregressive, integrated and moving average parts of the data set, respectively. ARIMA modelling will take care of trends, seasonality, cycles, errors and non-stationary aspects of a data set when making forecasts.
Understanding ARIMA Model in General Term
How to Understand ARIMA model?
To understand this, we can refer real time scenario that is sugar cane juicer, from juicer it is difficult to extract all the juice in one go, so the shopkeeper repeats the process for several times till there is no more juice left in the residual. That’s how ARIMA works, the idea with ARIMA models is that the final residual should look like white noise otherwise there is juice or information available in the data to extract.
How Do We Use ARIMA Model?
ARIMA checks stationarity availability in the data, the data should also show a constant variance in its fluctuations over time. To get the proper information about the parameter used in ARIMA is based on “identification process” which was purposed by Box-Jenkins.
When Do We Use ARIMA Model?
As we all know ARIMA is mainly used to project future values using historical time series data. Its main application is in short forecasting with minimum 38-40 historical data points with the minimum number of outliers. If you do not have at least 38 data points, then it advisable to look for some other methods.
Working Example of ARIMA
Here, we are trying to understand ARIMA using quarterly European retail trade data from 1996 to 2011. The data are clearly non-stationary, with some seasonality, so we will first take a seasonal difference. The seasonally differenced data are shown in Fig. These also appear to be non-stationary, and so we take an additional first difference and maybe next if require. Shown in Fig.
As we considered seasonal ARIMA model which first checks their basic requirements and is ready for forecasting. Forecasts from the model for the next three years are shown in Figure. Notice how the forecasts follow the recent trend in the data (this occurs because of the double differencing).
Conclusion: – It works best when your data exhibits a stable or consistent pattern over time with a minimum amount of outliers.
METHOD-IV: NEURAL NETWORK
ANN:– Artificial neural network (ANN) is basically machine learning approach that models human brain and consists of a number of artificial neurons. Their ability to learn by example makes them very flexible and powerful.
Neural networks has its own strength to derive meaning from complicated or imprecise data, and most of the time can be used to detect the pattern and trend in the data, which cannot be detectable easily from human eye or any computer techniques. We also have some of the advantages of NN like Adaptive learning, self-organization, real-time operation, fault tolerance.
Now a day, in every field NN is equally important, for example, some of the fields I have listed below: –
i. Sales Forecasting
ii. Industrial Process Control
iii. Customer Research
iv. Data Validation
v. Risk Management
vi. Target Marketing
We can use NN in any type of industry and get benefited, as it is very flexible and also doesn’t require any algorithms. They are regularly used to model parts of living organisms and to investigate the internal mechanisms of the brain.
It’s modification of exponential smoothing for sporadic demand product time series suggested by Croston in 1972. The core value of this method is not only the estimation of average demand volume but also the estimation of time interval length between two non-zero demands, the term called for intermittent demand.
The Croston method works in two steps, First, separate exponential smoothing estimates are made of the average size of a demand. Second, the intermittent demands are calculated. This is then used in a form of the constant model to predict the future demand.
How Croston’s Work?
Croston’s has a complex formula, however, what it output is actually very simple. The screenshot below explains what Croston’s does in a very simple way for the sake of understanding.
As you can see, Croston’s removes the periods that have no demand only averaging the periods that have demand. Next Croston’s calculates the frequency of the demand. The math behind this is complex, but the output is extremely similar to performing an exponential smoothing.
Why Do We Use CROSTON’s?
In the given fig. we have two Croston’s forecast based on demand histories, with more non-zero data points. Here Croston’s will come into the picture and show its benefits.
At the very beginning, Croston’s starts detecting cyclic and periodicity into the data points of demand patterns. In this case, it is suggested that a demand could occur possibly after 3.5 (4 after roundup) zero period.
The second most important thing which Croston’s does is, it adjusts the next occurrence from the last non-zero period if the recent periods are zero periods.
So the objects of the forecast are predicting the consumption at the right moment with right quantity. Croston’s does try to predict the “right moment”, which is more sophisticated than the moving average.
The Croston method is a forecasting strategy for products with intermittent demand. In the univariate forecast profile, choose forecast strategy.
Croston’s can be easily emulated with exponential smoothing and any timing benefit is usually adjusted by order lot sizing, and or safety stock in supply planning. Therefore, demand history must not only be lumpy but must also be very low in order for Croston’s to be of value. Therefore, Croston’s can be seen as a speciality forecasting method that provides value in certain limited circumstance.
For more insights on Statistical methods and R programming (Data Science) feel free to get in touch with us through firstname.lastname@example.org, you can also share this content with your network.