Cluster analysis

Clustering is a method used in data analysis to group similar data points together based on certain factors or similarities. Each cluster contains data points that are more similar to each other than to those in other clusters. Zoho Analytics uses the K-means, K-modes, and K-prototype algorithms to group data points.

Business use cases

Customer Segmentation: Customers can be grouped based on different factors like demographics, regions, and preferences. Grouping helps businesses tailor and strategize marketing efforts that improve sales and retention.

Inventory Management: Efficient inventory management facilitates a streamlined supply chain. Clustering can identify seasonal trends related to product purchases and items that are highly in demand and help manage stocks better.

Points to note

  • A minimum of 5 data points are required for clustering.
  • Cluster analysis is supported for scatter plots, bar charts, and bubble charts.
  • Cluster analysis is not supported for Forecast, Trend line, and Anomaly analysis.

Applying cluster analysis

To conduct a cluster analysis, follow the steps below.

  • Click the Analysis icon on the tool bar and select Cluster Analysis from the drop-down menu.

  • In the Cluster Analysis dialog that opens, click Add Clusters.
  • The algorithm model is auto selected based on the columns used in the report.
  • Factors are the columns based on which the data points are grouped. The columns are listed based on the model selected; all the Numerical Columns available in the data will be listed for K-mean, Categorical columns for K-modes, and both numerical and categorical for K-prototype.
  • The Number of Clusters are determined automatically based on the number of data points. A minimum of two clusters and a maximum of 30 clusters can be specified for clustering. The number of clusters should be one less than the number of data points.

  • Choose the Normalization method that should be used to transform the data before clustering. Normalization is the technique used to transform the data to have a common scale.
    • Min-Max Scale: In this method, all the data points are rescaled between the ranges of 0 and 1.
    • Z-Score: Z-Score represents the number of standard deviations a data point is from the mean of the dataset. This transformation is designed to center the data around a mean of 0 and standardize it so that the standard deviation is 1 for the entire dataset. In this method, all the data points are rescaled between the ranges of -1 and 1.
  • For the K-prototype model, specify the Weightage to be given from numerical and categorical factors. The weightage values range from 0.2 to 2. By default, Zoho Analytics gives equal weightage (1.00) to both numerical and categorical factors. Weightage value closer to 0.2 indicates numerical columns will have more weightage and value closer to 2 indicates categorical columns will have more weightage.
  • Click Apply.

Viewing cluster information

This section provides the summary and statistical information that help evaluate the quality of the clusters and how well the data points are grouped. Clusters info option will be enabled once the clustering is applied.

Summary

This section provides the following details:

  • This section provides the following details, such as the algorithm used for clustering, Number of Data points, and Number of clusters in to which the data points are clustered.
  • The Stop Criteria field gives the reason based on which the clustering process was terminated.
  • The Distance formula that was used for clustering:
    • Euclidean distance is the method used for K-means algorithm.
    • Binary Dissimilarity is the method used for K-modes algorithm.
  • The Factors (Columns) and the Normalization method used for clustering.

Performance/Quality Indicators

  • CH Index - The Calinski-Harabasz index (CHI) is a metric used to evaluate the quality of a cluster. The CHI calculates the ratio of between-cluster variance to within-cluster variance. A higher CHI value denotes that the clusters are well grouped.
  • DB Index - The Davies-Bouldin index (DBI) is another metric to assess the quality of clustering. The DBI is calculated by considering the ratio of the average similarity between each cluster and its most similar cluster, to the average dissimilarity between the clusters.

Centroid and Cluster Information

This section provides the details about the number of data points in each cluster and the centroid of the data points for each factor.

Analysis of Variance (ANOVA)

ANOVA is a statistical method that is used to calculate the difference between the means of multiple groups. ANOVA test is a statistical significance test that is used to check whether the null hypothesis can be rejected or not, during hypothesis testing.

  • Within the Sum of Squares - It calculates how much the individual data points within each group differ from the mean of that group.
  • Between the Sum of Squares - It calculates how much the mean values of different groups differ from the overall mean value.

F-Statistic Value

The F-Statistic calculates the ratio of the Mean Square Between (MSB) the clusters to the Mean Square Within (MSW) the clusters. If the F-Statistic is greater than the critical value, we can conclude that the data points are well clustered.

FactorsF-StatisticBetween the Sum of SquaresDegrees of Freedom (between clusters)Within the Sum of SquaresDegrees of Freedom (within clusters)
Columns used for clusteringMSB/MSW

MSB - Mean Square between clusters

MSW- Mean Square within clusters.
Variability between the groups of mean valuek-1

k - number of clusters
Variability within the group of mean valuesN-k

N - Total number of observations

k - number of clusters