Originally posted on Gigaom:
Walmart is making a change in the way it does online commerce and there’s a big data story behind that shift. Stephen O’Sullivan, senior director at of Global e-commerce, at WalmartLabs (s wmt) is prepping the retail giant to move from 10 different web sites to one and from a trial-sized 10-node Hadoop cluster to a 250-node Hadoop cluster. Along the way his team will build several tools to migrate data from the current Oracle, (s orcl) Neteeza, Oracle (s orcl) and Greenplum (s emc) gear that he hopes to open source.
In the video below he explains the rationale behind the site consolidation and the subsequent data consolidation that will happen once the sites begin feeding shopper and transaction data into the Hadoop cluster. He still plans to use some of his existing data warehousing gear, but to a much lesser extent.
However, he’s hit a few snags when…
View original 83 more words