Leverage Hadoop as your pilot project to gain organizational buy-in and build institutional learning.
A relational database management system works great under many scenarios, but it has its limitations:
Volume issues typically arise when there is a need to index large databases.
In a multi-source environment, data collisions occur and resolving them can be expensive and time consuming.
Velocity problems arise when large amounts of read/write transactions occur that are expensive to compute.
Begin your big data implementation with a baseline Hadoop pilot. This pilot will help build your knowledge of big data, how the Hadoop framework satisfies your use cases, and how it operates in your system. Each component in this baseline stack is well understood in the industry and documentation is readily available.
Impact and Result
Provide a step-by-step starting point to begin the rollout of big data development based on your business and technical requirements.
Highlight the challenges, impacts, potential, and mitigations in big data development.
Identify the key metrics, benchmarks, and instrumentation points to measure the success of your big data rollout.