Learning PySpark

-

Title : Learning PySpark
Edition : 
Year : 2017
Authors : Tomasz Drabas, Denny Lee
Publisher : Packt
Preface
It is estimated that in 2013 the whole world produced around 4.4 zettabytes of data; that is, 4.4 billion terabytes! By 2020, we (as the human race) are expected to produce ten times that. With data getting larger literally by the second, and given the growing appetite for making sense out of it, in 2004 Google employees Jeffrey Dean and Sanjay Ghemawat published the seminal paper MapReduce: Simplified Data Processing on Large Clusters. Since then, technologies leveraging the concept started growing very quickly with Apache Hadoop initially being the most popular. It ultimately created a Hadoop ecosystem that included abstraction layers such as Pig, Hive, and Mahout – all leveraging this simple concept of map and reduce.
However, even though capable of chewing through petabytes of data daily, MapReduce is a fairly restricted programming framework. Also, most of the tasks require reading and writing to disk. Seeing these drawbacks, in 2009 Matei Zaharia started working on Spark as part of his PhD. Spark was first released in 2012. Even though Spark is based on the same MapReduce concept, its advanced ways of dealing with data and organizing tasks make it 100x faster than Hadoop 
(for in-memory computations). 
In this book, we will guide you through the latest incarnation of Apache Spark using Python. We will show you how to read structured and unstructured data, how to use some fundamental data types available in PySpark, build machine learning models, operate on graphs, read streaming data, and deploy your models in the cloud. Each chapter will tackle different problem, and by the end of the book we hope you will be knowledgeable enough to solve other problems we did not have

space to cover here. 


Password zip : gratissebook.blogspot.co.id

Comments

Post a Comment

Popular posts from this blog

Software Architecture with Python

-
Image
Title : Software Architecture with Python Edition :  Year : 2017 Authors : Anand Balachendran Pillai Publisher : Packt Preface Software architecture, or creating a blueprint design for a particular software  application, is not a walk in the park. The two biggest challenges in software  architecture are keeping the architecture in sync, first with the requirements as they are  uncovered or evolve, and next with the implementation as it gets built and evolves. Filled with examples and use cases, this guide takes a direct approach to helping you  with everything it takes to become a successful software architect. This book will  help you understand the ins and outs of Python so that you can architect and design  highly scalable, robust, clean, and performant applications in Python. DOWNLOAD (MEGA)  |  DOWNLOAD (SOLIDFILE)  |  DOWNLOAD (UPTOBOX) Password zip : gratissebook.blogspot.co.id
Read more

Learning Docker 2nd Edition

-
Image
Title : Learning Docker Edition : 2nd edition Year : 2017 Authors :  Jeeva S. Chelladhurai,  Vinod Singh,  Pethuru Raj Publisher : Packt Preface There are several technical and business advantages associated with Docker. The  longstanding goals of application development, deployment, and delivery automation are  accomplished through Docker-enabled containerization, which is being touted as a crucial  automation method for the tremendous success of the cloud paradigm. Existing workloads  are containerized and cloud-enabled to be stocked in public as well as private repositories.  Both business and IT workloads can be easily pampered, packaged, and presented as  remotely discoverable, usable, portable, and composable containers. Further on, containers  are shipped and run everywhere without any hassle, hitches, and hurdles. The  containerization concept has made IT infrastructures and processes agile and adaptive. This  means that not only is software engineering sped
Read more

Raspberry Pi for Secret Agents

-
Image
Title : Raspberry Pi for Secret Agents Edition : 3rd edition Year : 2016 Authors :  Matthew Poole Publisher :  Packt Preface The Raspberry Pi was developed with the intention of promoting basic computer science in  schools, but the Pi also represents a welcome return to simple, fun, and open computing.  Using gadgets for purposes other than the intended ones, especially for mischief and  pranks, has always been an important part of adopting a new technology and making it  your own. With a  £25 Raspberry Pi computer and a few common USB gadgets, anyone can afford to  become a secret agent. This third edition by Matthew Poole takes the previous edition's projects and brings them  up to date to now support the new Raspberry Pi Zero, Raspberry Pi Version 3, and the  Raspbian Jessie operating system.  There is also a new chapter that looks at ways to connect sensors and gadgets to our Pi to  protect ourselves against other would-be secret agents. DOWNLOAD (MEGA)  
Read more