Big data tools – what to learn
Big data is not just big in terms of data; it is also big in terms of the number of related tools and technologies to learn. Many of the tools are either open source or based on open source. Also, it is highly encouraged for developers and analysts to participate in open forums and contribute to them. However, you should be realistic and stop chasing every single release or new tool coming up almost daily in the market.
In this section, I will cover an end-to-end data life cycle for typical big data projects in financial organizations and use tools that are popular and a bit established. I am not endorsing any tool, and have named a few of them only to give you some background.
Getting your data into HDFS
Before you ...