Infrastructure and Big Data analytics
Posted on behalf of Debashish Mohanty, MFG
The internet has spawned an explosion in data growth in the form of data sets, called Big Data, which are so large they are difficult to store , manage and analyze using traditional DB and Storage architecture. Not only is this new data heavily unstructured, it is voluminous, streaming rapidly and is difficult to harness.
- Cloud Infrastructure
- Virtualization
- Networking
- Storage :In memory Data Base, Tired Storage Software ,DE duplication, Data Protection
Big Data IT infrastructure typically includes HDFS(Hadoop Distributed File System) and MapReduce computing models. apart from these, the storage infrastructure itself has to be revamped to keep up with computing requirements.
The magnitude of the changes required in the IT Infrastructure is huge and definitely requires validation to ensure proper functioning in a controlled manner in production environments. Infrastructure testing for Big Data can help ensure that the underlying Hadoop Distributed File System and MapReduce models integrate seamlessly with other infrastructrue elements. This is critical to ensure uptime of all systems and
Click here to read my earlier post.
