Forecasting
Zoho Analytics enables you to effectively predict your future data trends, using its forecasting feature. Forecasting in Zoho Analytics is based on powerful forecasting algorithms which analyzes your past data deeply and comes up with the best forecast for the future. You can setup a forecast in a chart using a very simple setup process, without worrying about the underlying complexity.
This document will help you learn about how forecasting works in Zoho Analytics, and how to easily set up the same in your charts.
Forecasting
- What is Forecasting?
- What are the chart types that support Forecasting?
- How do I setup Forecasting in my chart?
- Can I setup forecasting over What-if analysis?
- Can I set up forecasting over multiple Y-Axis?
- Can I set up forecast for the columns in Color shelf?
- Forecast option is not available in my Chart settings, why?
- How does Forecasting work in Zoho Analytics?
- The forecasted points shown in the chart are different to the shared users. Why?
- The underlying data and drill down options are not available for forecasted data points. Why?
- Can I view the forecast model information applied to the data?
Troubleshooting Tips
- I could not find "Forecast" option in chart settings. Why?
- Already configured forecasting settings are not available now. Why?
- I have configured forecasting for my chart. But it says, "Forecasting is disabled as the data is completely ignored". Why?
- I have configured forecasting for my chart. But it says, "Forecasting is disabled as there is not enough data to identify pattern". Why?
- I have configured forecasting for my chart. But it says, "Forecasting is disabled as there are more than 40% empty values". Why?
- I have configured forecasting for my chart. But it says, "Column cannot be forecast as more than 5 data points is required". Why?
1. What is Forecasting?
Forecasting is a process of predicting the future based on the past data trend. Zoho Analytics forecasting is based on powerful forecasting algorithms which analyzes your past data deeply and comes up with the best forecast for the future.
2. What are the chart types that support Forecasting?
Zoho Analytics supports forecasting for the following chart types.
- Line Chart
- Bar Chart
- Stacked Bar Chart
- Scatter Chart
- Area Chart
- Stacked Area Chart
- Combo Charts (without Bubble Chart).
3. How do I setup Forecasting in my chart?
To set up forecasting in charts, follow the steps below:
- Open the required chart for which you need to set up forecasting in Edit Design mode.
- Click the Analysis button, and choose the Forecast option.
You can also navigate to Settings > Analysis tab > expand the Forecast section and click the + Add Forecast link.
- In the dialog that appears, click the + Add Forecast button and choose the column for which you intend to forecast values.
- Select the dependent factors (columns) for prediction from the Influencing Factors drop-down. It helps to enhance the accuracy of forecasting by accounting for closely related factors that affect the metric being forecasted. For instance, including influencing factors like the availability of technicians or the average resolution time of individual technicians in this example can help achieve more precise forecasts. You can add a maximum of five influencing factors to forecast data.
- The best forecast Model is auto-selected based on the characteristics of the data. The Vector Auto Regression model is applied by default when you choose the influencing factors for forecasting.
However, you can also choose the model and specify the parameters for analysis. Refer to the forecasting models document to learn more.
- Specify the number of data series you need to forecast in the Forecast Length field.
- In the Ignore Last field, provide the number of data series to be ignored while forecasting the data. It helps exclude cases where the data might be incomplete for the last or current period and cross-verify if the chosen model predicts the correct value.
- Choose the confidence interval in which the data point is likely to occur from the Confidence Percentage drop-down. Please note that this option applies only to the line chart.
- Click the More Options icon to customize the Legend & Styling options.
- Provide a title for the forecasted series in the Legend Name field.
- Choose the required color and the line format for forecasting the data using the Forecast Style option. If you have chosen a confidence percentage, you can select the required style using the Confidence Style option.
- Click the + Add Forecast option to apply forecast for more than one metric column (multiple y-axes).
- Select the following options as required:
- Show Forecast Legend: Displays a legend to differentiate between forecasted and actual values.
- Show Forecast Info: Displays detailed information about the models used for forecasting and performance metrics. Enabled by default, users can access the forecast information in both View and Edit Design modes.
- Show Ignored Values: Shows the values that were excluded from the forecasting process.
- Treat as What-if Forecasting: This option forecasts future outcomes by selectively changing inputs through variables and user filters.
- Display Negative Forecasts as 0: This option replaces all the negative forecasted values with 0.
- Click Apply.
The following line chart is forecasted with a 90% confidence score.
4. Can I set up forecasting over What-if analysis??
Yes, Zoho Analytics' What-if Analysis enables you to measure the difference in outcome when one or more variables change. Applying Forecast over a What-if metric column helps you see how the forecasted values will change.
Setting up a forecast over a What-if Analysis is similar to any other chart. What-If will be applied over the entire chart, including forecasted data.
You can choose to apply the What-if factor over the forecasted data alone by selecting the Treat as What-if Forecasting checkbox.
The following screen illustrates the What-If Analysis for forecast data alone.
Click here to learn about What-If Analysis.
5. Can I set up forecasting over multiple Y-Axis?
Yes, you can set up forecasting over multiple Y-Axis in a chart.
6. Can I set up forecasts for the columns in Color shelf?
Yes, you can generate forecasts for the columns used in a chart's Color shelf.
7. Forecast option is not available in my Chart settings, why?
Forecasting will be enabled when it matches certain conditions, which are detailed below:
The chart should be in one of the following supported formats: Line chart, Bar Chart, Stacked Bar Chart, Scatter Chart, Area Chart, Stacked Area Chart, Web Chart and Combo Charts (without Bubble Charts).
The X-axis of the chart should either be a time series or a number series.
There should be more than five data points in the X-axis to ensure accurate forecasting.
Atleast 60% of the past data points should not be null, to enable forecasting.
The chart should contain only a single dimension column in the X-axis, i.e. there should not be any values in the Text, Color, Size or Tooltip fields.
Aggregate function should be applied over at least one value in the Y-axis to enable forecasting. Values with advanced summarizing options such as running total applied over it cannot be used to forecast future data points.
Numeric columns cannot be used as filters in the chart, as forecasting based on filtered data may provide inaccurate results.
8. How Forecasting works in Zoho Analytics?
Zoho Analytics offers a powerful forecasting engine that predicts future data points based on past data. The forecasting engine offers a range of customization such as number of units to be forecasted, number of data points to be ignored in the past data and the formatting to be applied over the forecasted data points.
The following points describe how the forecasting engine works in Zoho Analytics:
The seasonality, trend and randomness of the data is computed, which is then fine-tuned using iterative processing.
The forecasting engine then runs linear, logarithmic and exponential regressions to categorize the data series as linear, logarithmic or exponential.
The accuracy of these predictions is verified using hindcasting. This is a type of back testing that uses the prediction results to estimate past data points, and verifies it with the actual data from the past.
Once the verification is complete, the forecasting engine displays the forecasted data points.
Click here to learn more.
9. The forecasted points shown in chart are different to the shared users. Why?
The chart could have been shared with different filter criteria to the shared users. Number of past data points available in the shared data could very for different shared users, hence the forecasted points are different for shared users.
10. The underlying data and drill down options are not available for forecasted data points. Why?
The forecasted points will not have underlying data generated for each of the forecasted data points. Hence, View Underlying Data and Drill Down options will not be available for forecasted data points.
11. Can I view the forecast model information applied to the data?
Yes, Zoho Analytics lets you view the forecast model information applied over the charts. It provides details about the model used and statistical data to assess the accuracy of the forecasting model. This option becomes available once forecasting is applied. The information is specific to each metric being forecasted.
Zoho Analytics lets you access the forecast model information in both the View and Edit Design modes. To do this, follow the below steps.
In View mode, click any one of the forecasted data points.
In Edit Design mode, click the Settings icon > Analysis tab > expand the Forecast section and click the Edit link. In the dialog that appears, click the Forecast Info icon that appears on mouse over the required forecast.
The forecast model dialog appears with the following information:
General Information
This section displays the following information:
- Training Period: Displays the historical data range used for forecasting data points.
- Forecast Period: Displays the time frame for which the data is forecasted.
Model Information
This section displays the type of forecast model applied over the chart.
- Forecast Model: Displays the Forecast model used for prediction. Zoho Analytics supports five prediction models: ARIMA, STL, ETS, Regression, and Vector Auto Regression.
- Sub Model: Displays the name of the sub-model applied over the chart.
- Frequency: Gives the frequency of the time series.
- Data Components: Displays whether trend and seasonality are present in the given data.
Elements of the forecast models
This section displays the sub-methods and parameters or coefficient values of the forecast model used for analysis.
ARIMA Model
The ARIMA model forecasts time series values by analyzing past data, incorporating both seasonal and non-seasonal trends. The non-seasonal component accounts for overall trends and short-term fluctuations that lack a consistent pattern, while the seasonal component identifies recurring patterns at regular intervals.
The ARIMA model is characterized by three main parameters:
- AR (AutoRegressive): This part uses past values of the time series to predict future values. It is denoted as p, the number of past values used to predict future ones. For example, if p = 2, the model uses the two most recent values to make a prediction.
- Integrated (d): This parameter helps make the time series stationary, meaning its characteristics do not change over time. It is represented as d, the number of times we need to adjust the data to remove trends or seasonal patterns so it behaves consistently.
- MA (Moving Average): This part looks at the relationship between a data point and the errors from previous predictions. Unlike AR, which relies on past values, MA uses past forecast errors to help make predictions. It is denoted as q, the number of past errors we consider in the Moving Average (MA) part to make forecasts.
In ARIMA value (p, d, q) (p, d, q)m, the first ordered triplet (p, d, q) represents the non-seasonal component, and the second ordered triplet represents (p, d, q)m represents the seasonal component.
Exponential Smoothing
Exponential smoothing is a forecasting method that predicts future values by taking an average of past observations, with more weight given to recent data.
STL
In the STL model, the data is divided into three components: Trend, Seasonality, and Residuals. The model info dialog provides details about the decomposition method and decomposed values used for smoothing the parameters.
Regression
Regression is a statistical method that helps to understand and model the relationship between a dependent variable and one or more independent variables. The forecast info dialog shows the Regression model and the statistical methods used to assess its performance. The types of regression models include linear, logarithmic, exponential, power, and polynomial.
The following are the statistical methods used to assess the performance of the regression model.
- R-Squared: This measures how well the model fits the data by indicating the proportion of variation in the dependent variable that can be explained by the independent variables. It shows what percentage of changes in the outcome are explained by the factors in the model.
- Adjusted R-Squared: This adjusts the R-Squared to prevent over fitting. The model with the highest Adjusted R-Squared is preferred, as it indicates a better fit without unnecessary complexity.
- F-statistic: This assesses the overall significance of the model, checking whether the independent variables collectively have a statistically significant effect on the dependent variable.
- P-value: This evaluates the significance of individual independent variables in the model, helping to determine if the relationship between the independent and dependent variables is statistically meaningful.
Vector AutoRegression
A Vector AutoRegression (VAR) model is used when multiple time series affect each other. Each series' forecast relies on its past values and the past values of the other series. This model is applicable only when influencing factors are selected for forecast.
The forecast info dialog shows how many past observations are used. In a VAR(p) model, p indicates the number of periods the model looks at past values to make predictions.
Performance Indicator
- Root-Mean-Square Error: The RMSE calculates the mean difference between actual and forecasted values.
- Mean Absolute Percentage Deviation: The MAPE calculates the average absolute percentage difference between actual and forecasted values.
- Weighted Mean Absolute Percentage Difference: The WMAPD calculates the average of the absolute percentage deviations between the actual and forecasted values, with each deviation weighted according to a specified criterion.
- Linear Error in Probability Space: The LEPS calculates the mean absolute difference between the forecast cumulative distribution value and the observation. The quality of the forecast model is given based on LEPS.
- Quality: The Quality of the forecasting model is decided based on the LEPS value.
- If LEPS is greater than 80%, the forecast model accuracy is considered Good.
- If LEPS is between 30% and 80%, the model's accuracy is deemed Acceptable.
- If LEPS is less than 30%, the accuracy is classified as Poor.
- Bayesian Information Criterion: The BIC is another method used for model selection in statistics.
Troubleshooting Tips
1. I could not find "Forecast" option in chart settings. Why?
This could happen when the forecast constraints are not met. Please refer to the constraints specified.
2. Already configured forecasting settings are not available now. Why?
This could happen when the design of the chart has been modified, which does not match the forecast constraints.
3. I have configured forecasting for my chart. But it says, "Forecasting is disabled as the data is completely ignored". Why?
This could happen if you had set to ignore all the past data points from "Ignore Last" setting.
4. I have configured forecasting for my chart. But it says, "Forecasting is disabled as there is not enough data to identify pattern". Why?
This could happen when there is no sufficient data produced to forecasting engine to come up with forecasted data points.
5. I have configured forecasting for my chart. But it says, "Forecasting is disabled as there are more than 40% empty values". Why?
When the past data points provided to the forecasting engine has more null values, the forecasted points might be inaccurate. To avoid this, the forecasting engine will discard the process when the null values are more than 40% in the given data.
6. I have configured forecasting for my chart. But it says, "Column cannot be forecast as more than 5 data points is required". Why?
To produce an accurate forecast, the data points to be considered for forecasting should be more than 5 points. Try changing the time series in X-axis to a more granular function which may result in more data points. For example, If the existing time series is Year, then change to Month & Year.