Mastering Hadoop 3 (e-book)

Mastering Hadoop 3 (e-book) - Opis

Apache Hadoop is one of the most popular big data solutions for distributed storage and for processing large chunks of data. With Hadoop 3, Apache promises to provide a high-performance, more fault-tolerant, and highly efficient big data processing platform, with a focus on improved scalability and increased efficiency.With this guide, you’ll understand advanced concepts of the Hadoop ecosystem tool. You’ll learn how Hadoop works internally, study advanced concepts of different ecosystem tools, discover solutions to real-world use cases, and understand how to secure your cluster. It will then walk you through HDFS, YARN, MapReduce, and Hadoop 3 concepts. You’ll be able to address common challenges like using Kafka efficiently, designing low latency, reliable message delivery Kafka systems, and handling high data volumes. As you advance, you’ll discover how to address major challenges when building an enterprise-grade messaging system, and how to use different stream processing systems along with Kafka to fulfil your enterprise goals.By the end of this book, you’ll have a complete understanding of how components in the Hadoop ecosystem are effectively integrated to implement a fast and reliable data pipeline, and you’ll be equipped to tackle a range of real-world problems in data pipelines. Spis treści: 1. Journey to Hadoop 32. Deep Dive into Hadoop Distributed File System3. YARN Resource Management in Hadoop4. Internals of Map Reduce5. SQL on Hadoop6. Real Time Processing Engines7. Widely used Hadoop Ecosystem Component8. Designing Applications in Hadoop9. Real Time/Micro (...) więcej Batch Processing in Hadoop10. Machine Learning in Hadoop11. Hadoop in Cloud12. Hadoop Cluster Profiling13. Who can do What in Hadoop14. Network and Data Security15. Monitoring Hadoop mniej