Title page for E-project-041309-114640

Project Type MQP

Submission date 2009-04-13

Authors
Patrick Ryan Crane, CS
Alyssa Hargraves, CS

URN E-project-041309-114640

Center Silicon Valley

Sponsor eBay

Title eBay Distributed Log Processing

Advisor
Finkel, David, CS

Availability unrestricted

Abstract
The MQP presented in this document was completed at eBay in San Jose, CA between January and March 2009. eBay Research Labs was using Hadoop to process their log data, and hoped for an easy way to increase their processing speed. To accomplish this, we developed and tested a program to allow users to quickly connect and configure their Windows computers as nodes on eBay's existing Hadoop cluster. Additionally, we created an installer to handle the many prerequisites associated with Hadoop on Windows.

Files
DistributedMQP.pdf

Browse by Author | Browse by Department | Search all available E-projects

Questions? Email project-questions@wpi.edu
Maintained by webmaster@wpi.edu

Project Type	MQP
Submission date	2009-04-13
Authors	Patrick Ryan Crane, CS Alyssa Hargraves, CS
URN	E-project-041309-114640
Center	Silicon Valley
Sponsor	eBay
Title	eBay Distributed Log Processing
Advisor	Finkel, David, CS
Availability	unrestricted
Abstract The MQP presented in this document was completed at eBay in San Jose, CA between January and March 2009. eBay Research Labs was using Hadoop to process their log data, and hoped for an easy way to increase their processing speed. To accomplish this, we developed and tested a program to allow users to quickly connect and configure their Windows computers as nodes on eBay's existing Hadoop cluster. Additionally, we created an installer to handle the many prerequisites associated with Hadoop on Windows.
Files	DistributedMQP.pdf