Cluster analysis is the grouping of an arrangement of objects in such a way that objects in a related group (known as cluster) are further related to every other group in comparison to those in different groups. This is a fundamental task of examining information retrieval, and a characteristic procedure for measurable knowledge analysis, used in most of the fields, with device knowledge, image analysis, facts improvement, bioinformatics, knowledge demands, and computer representation. Various hierarchical clustering techniques and their variants have been very much explored in the field of machine learning. However, these techniques are deterministic, needn't bother with a determined number of clusters and are stable. But, they are not scalable for high dimensional data set due to their non-linear correlations. In this research, we are combining the agglomerative hierarchical clustering with KNN classification which gives better accuracy as compared to hierarchical clustering. KNN is the classification technique and is the only method to find the medoids of the clusters formed.