Infosys | Microsoft

Cloud and HPC together helps to resolve significant number of challenges around Big Data processing. However one needs to consider several aspects while weaving a Big Data solution around them. As part of "Data Insight and Social BI" executive update for CXOs, here is a whitepaper published with Cutter and can be downloaded by Cutter users only.
However for the readers of this forum, I have explicitly requested access and Cutter has been kind enough to provide a URL for our reader's access.

Posted by Sudhanshu Hate at 5:17 AM | Permalink | Comments (0) | TrackBacks (0)

The data (structured and un-structured) influencing enterprise decisions is increasing exponentially every year. This data includes not only internal generated data within the enterprise but also external influencers such as social media, government regulations, external public data sets, etc.

The storage and compute capacity within the enterprise is usually limited and cannot scale or grow at the same rate as the data because of various reasons such as lead times to procure infrastructure, increased hardware and software costs to process data, etc. Many a times, this imbalance causes opportunity loss for enterprise for not being able to process the data in the necessary window.

Cloud Computing helps to resolve this in a very subtle manner as it provides a turnkey solution for on-demand network, compute and storage which essentially are the critical building blocks of any big data processing solution.

Continue reading "Considerations for Big Data processing using Cloud Computing" »

Posted by Sudhanshu Hate at 9:15 AM | Permalink | Comments (2) | TrackBacks (0)

Continuing from my earlier blog here, Microsoft discontinued developments on LINQ to HPC and was working towards weaving open source Apache Hadoop in its Big Data Strategy.
Earlier this month (Dec 2011), Microsoft has made the announcement for community release (CTP) of its "Hadoop on Windows Azure" offering. It is codenamed "Isotope" and will be available in two flavors,
• Hadoop runtime on Windows Azure (cloud) - CTP for this is available and general release in March 2012.
• Hadoop runtime on Windows Server (on-premise) - CTP for this is expected in first quarter of 2012 and general release in June 2012.Check these announcements here,

Continue reading "Isotope "Hadoop on Windows and Windows Azure" first look!!!" »

Posted by Sudhanshu Hate at 6:15 AM | Permalink | Comments (0) | TrackBacks (0)

Since last month, we started aggressively doing various pilots using LINQ to HPC in Big Data space. Recently Microsoft released SP3 for Windows Server 2008 R2. We had difficulties trying to get to the installable for the same from Microsoft connect site, as it was not available where it was intended to be.

Continue reading ""LINQ to HPC" dropped from MS Big Data stack?" »

Posted by Sudhanshu Hate at 12:45 PM | Permalink | Comments (1) | TrackBacks (0)

Microsoft is working aggressively towards bridging some of the gaps in its stack for Big Data processing and has a few announcements towards this in recent past.
Here is a view covering various MS technologies for structured and un-structured data analysis. 

Continue reading "Microsoft Big Data stack" »

Posted by Sudhanshu Hate at 11:32 AM | Permalink | Comments (0) | TrackBacks (0)

According to Gartner, "By 2015, companies that have adopted big data and extreme information management will begin to outperform unprepared competitors by 20% in every available financial metric". Check this

Analyzing Big Data is becoming important to identify trends and lot of companies have started doing it to get the edge over competitors, scenarios that fit for such analysis are,

• Political campaign wanting to be get a real time feedback of various actions based on   Tweets and Facebook comments
• Phone companies wanting to trend their billing data
• Credit card companies trying to stop fraud before sales happens
• Web log analysis to identify trends

Continue reading "Introduction - Big Data" »

Posted by Sudhanshu Hate at 12:25 PM | Permalink | Comments (0) | TrackBacks (0)