Big data or bigdata can fall into various dimensions. k-means algorithms can provide results that are previously observed. It can also provide certain patterns on available data that has occurred over disparate units. However, to attain actual analysis of large volume of data and attain valuable information, a preset of data units charted on a graph and looking at its movement over, for instance TIME, cannot provide desired results or “validation”. Some times, ‘external” and “internal” evaluations could be looked at as a dialectical approach to “problem solving”. However, it may not fit within the realms of huge volume of data sets; big data ; bigdata. Further more, the clustering quality may depreciate. Above all that, the distance between centroids could cause issues in analysis. This has distance problem has already been foreseen and new set of algorithms has started emerging. BIRCH approach could result in new algorithms being put to test.
Approach II [In the process of writing]
Sunny Menon
Sunny Menon is a software executive with large enterprise architecture background with over 20+ years of experience in the design, architecture, development of high volume enterprise applications.
He has experience enabling cloud environment for enterprise applications. Designed and developed a bigdata products. He has helped #startups evolve from conceptual stages through definition of the actual product by aligning them with industry requirements, developing proof-of-concept and demonstrating the product thereby, helping in seeking funding from VCs.
He has extensive experience in the integration of large enterprise applications, middle-ware and modernization of enterprise applications centered around SOA/SaaS/PaaS/Cloud environments.
At night, he enjoys 'staring' at the night skies and thinks, twinkle twinkle little star, how I STILL WONDER what you are.... He is a cruel poet who walks bare foot at times, to feel the beauty of the earth.
Advisory Board Member and Investor : RiverLog Software
Technical advisory to SOADevelopers.com
Executive Board Member - Stencil Research
Strategist : TechBeat Conference.com
CISO - Paragon Security