17 OCT 2024 - Welcome Back to TorrentFunk! Get your pirate hat back out. Streaming is dying and torrents are the new trend. Account Registration works again and so do Torrent Uploads. We invite you all to start uploading torrents again!
TORRENT DETAILS
[FreeCoursesOnline.Me] [Hadoop In Real World] Spark Developer In Real World [FCO]
TORRENT SUMMARY
Status:
All the torrents in this section have been verified by our verification system
For More Udemy Free Courses >>> https://ftuforum.com/ For more Lynda and other Courses >>> https://www.freecoursesonline.me/ Our Forum for discussion >>> https://discuss.ftuforum.com/
Created by : Hadoop In Real World Last updated : 2019 Language : English Torrent Contains : 88 Files, 18 Folders Course Source : https://courses.hadoopinrealworld.com/p/spark-developer-in-real-world
About
The goal of Spark Developer In Real World course is to take someone with zero experience in Spark and turn them into a confident Spark developer who can tackle complex production real world problems in today’s challenging Spark environments.
How do we achieve that?
This course is designed to address 2 key issues that we even see in Spark developers who work in Spark day to day and also someone who is new to Spark.
1. Lack of behind the scenes or deeper understanding in concepts
Why understanding what’s going on behind the scenes is important? Because that’s when you uncover a lot of things, that is when you get to you know the pitfalls in the tools and that is when we will understand how to perform optimizations and how to troubleshoot issues when things go bad. When we go deep, we will learn the tips and tricks that are available for us to take advantage of the full offering of the tool.
2. Most don’t have a 360 degree view of what Spark has to offer
Most aspiring and experienced developers in Spark don’t realize the full potential of Spark, they are focussed on a certain area of Spark and most don’t have a good 360 degree view of what Spark can offer. Spark is not just a tool for in-memory computation. Spark offers a lot more and has dedicated modules for topics like machine learning and streaming and a project named tungsten dedicated to optimize spark for years to come. Spark is aiming to be the go-to platform for data processing, learning and analytics. There is so much development and effort going in to Spark and it is one of the fastest evolving tool in the big data ecosystem.
In this course, we go deep in the concepts. We don’t just say Spark is faster because it does in-memory computing, we go deep in explaining what are the other reasons that enable Spark to be faster. We cover how projects in Spark like Spark SQL (Catalyst Optimizer) or Project Tungten enables Spark to achieve efficiency. We show you how to read logical and physical plans produced by Spark. We talk about resource management, memory structures etc.
This course doesn’t stop with the basic concepts like RDD and DataFrames, we go beyond that. We go in to areas of Machine Learning and Spark Streaming giving you a 360 degree view of what Spark has to offer there by enabling you to become a confident developer in Spark.
When you have both in-depth understanding and a 360 degree view of Spark you will be capable of handling complex production problems and managing real world Spark applications and clusters with confidence.
Pre-requisites[b/]
[b]Java
This course assumes that you have some basic understanding of Hadoop.. If you don’t know Hadoop, don’t worry.. We have a free course titled Hadoop Starter Kit and it will help you understand all the basics.. You can enroll in Hadoop Starter Kit course for for Free @ http://courses.hadoopinrealworld.com
Scala
Almost all of the code and programs discussed in the course are written in Scala.. Because Scala is the default program for Spark.. You will encounter couple of Java programs as well. If you have a programming background. You should be able to follow through the programs even if you don’t know a bit of Scala with no issues. If you know Python, then it is almost like you know Scala already.
If you are new to Scala or functional programming don’t try to master the programming language before you start with the course. Start with the course and when a syntax look unfamiliar look up for that specific thing and move on with the course. If you want to get some Scala basics look in to functions especially anonymous & higher order functions.
Interesting Projects Covered In The Course
• End to End Project: Build a mini Stackoverflow website (Spark, Elasticsearch, Kibana, REST and Angular)
• Page Ranking pages from Wikipedia DataFrames
• Analyzing Trending YouTube videos (CSV & JSON)
• Predicting Country’s Happiness Rank from Happiness Score [Machine Learning]
• Streaming data from Meetup.com with Kafka & Spark Streaming.
Your Instructor
We are a group of Senior Hadoop Consultants who are passionate about Hadoop and Big Data technologies. We have experience across several key domains from finance and retail to social media and gaming. We have worked with Hadoop clusters ranging from 50 all the way to 1000s of nodes.
VISITOR COMMENTS (0 )
FILE LIST
Filename
Size
0. Websites you may like/How you can help Team-FTU.txt
237 B
1 lets get started/Thank you and Welcome - Hadoop In Real World.mp4
71 MB
1 lets get started/Tools And Setup - Hadoop In Real World.m4v
49.1 MB
2 intro to spark/1 Hadoop vs. Spark - Who Wins - Hadoop In Real World.ts
50.3 MB
2 intro to spark/2 How Spark Is Faster Than Hadoop - Hadoop In Real World.ts
26 MB
2 intro to spark/3 Challenges Spark Tries To Address - Hadoop In Real World.ts
33.3 MB
3 rdd-core of spark/1 The Need For RDD - Hadoop In Real World.ts
40 MB
3 rdd-core of spark/2 What Is RDD - Hadoop In Real World.ts
49.6 MB
3 rdd-core of spark/3 What An RDD Is Not - Hadoop In Real World.ts
25.6 MB
4 execution in spark/1 First Program In Spark - Hadoop In Real World.ts
57 MB
4 execution in spark/2 What are Dependencies and Why They are Important - Hadoop In Real World.ts
36.6 MB
4 execution in spark/3 Program to Execution (Part 1) - Hadoop In Real World.ts
46.1 MB
4 execution in spark/4 Program to Execution (Part 2) - Hadoop In Real World.ts
71.2 MB
4 execution in spark/5 Caching Data In Spark - Hadoop In Real World.ts
51.7 MB
4 execution in spark/6 Fault Tolerance - Hadoop In Real World.ts
24.4 MB
5 shuffle in spark/1 Need for Shuffle - Hadoop In Real World.ts
21 MB
5 shuffle in spark/2 Hash Shuffle Manager - Part 1 - Hadoop In Real World.ts
25.1 MB
5 shuffle in spark/3 Hash Shuffle Manager - Part 2 - Hadoop In Real World.ts
29.6 MB
5 shuffle in spark/4 Sort Shuffle Manager - Hadoop In Real World.ts
16.2 MB
6 spark transformations/1 reduceByKey vs groupByKey - Hadoop In Real World.ts
20.5 MB
6 spark transformations/2 Cogroup, Join and Avoiding Shuffle - Part 1 - Hadoop In Real World.ts
33.4 MB
6 spark transformations/3 Cogroup, Join and Avoiding Shuffle - Part 2 - Hadoop In Real World.ts
20.6 MB
6 spark transformations/4 Resizing Partitions - Hadoop In Real World.ts
19.4 MB
7 page ranking with rdds/1 PageRanking Algorithm - Hadoop In Real World.ts
13.9 MB
7 page ranking with rdds/2 PageRank Walk-through - Hadoop In Real World.ts
11.8 MB
7 page ranking with rdds/3 Implementing PageRank with RDDs - Hadoop In Real World.ts
13.2 MB
8 beyond rdds/1 What_s the Problem with RDDs - Hadoop In Real World.ts
23.4 MB
8 beyond rdds/2 DataFrame vs DataSet vs SQL - Hadoop In Real World.ts
32.5 MB
8 beyond rdds/3 Simple Selects - Hadoop In Real World.ts
24 MB
8 beyond rdds/4 Filtering DataFrames - Hadoop In Real World.ts
6.8 MB
8 beyond rdds/5 Aggregating DataFrames - Hadoop In Real World.ts
13.3 MB
8 beyond rdds/6 Joining DataFrames - Hadoop In Real World.ts
22.4 MB
8 beyond rdds/7 PageRanking with DataFrames - Hadoop In Real World.ts
45.4 MB
9 spark with other datasources _ file formats/1 Spark _ Hive - Hadoop In Real World.ts
17.8 MB
9 spark with other datasources _ file formats/2 Spark _ Hive with XML, Parquet _ ORC - Hadoop In Real World.ts
40.9 MB
9 spark with other datasources _ file formats/3 Spark _ RDBMS - Hadoop In Real World.ts
22.9 MB
9 spark with other datasources _ file formats/4 Spark _ HBase (Part - 1) - Hadoop In Real World.ts
36.5 MB
9 spark with other datasources _ file formats/5 Spark _ HBase (Part - 2) - Hadoop In Real World.ts
26.1 MB
9-1 spark- under the hood/1 Inside the Catalyst Optimizer - Hadoop In Real World.ts
22.6 MB
9-1 spark- under the hood/2 Catalyst Optimizer - Plan Walkthrough - Hadoop In Real World.ts
22.3 MB
9-1 spark- under the hood/3 Project Tungsten - Better Memory Management - Hadoop In Real World.ts
24.4 MB
9-1 spark- under the hood/4 Project Tungsten - CPU Cache Aware Optimizations - Hadoop In Real World.ts
20.8 MB
9-2 resource management/1 Spark Architecture - Hadoop In Real World.ts
13.5 MB
9-2 resource management/2 Memory Layout In Executor - Hadoop In Real World.ts
16.2 MB
9-2 resource management/3 Resource Management - Standalone - Hadoop In Real World.ts
32.5 MB
9-2 resource management/4 Resource Management - YARN - Hadoop In Real World.ts
33.9 MB
9-2 resource management/5 Dynamic Resource Allocation - Hadoop In Real World.ts
16.2 MB
9-3 cluster installation/1 Spark Installation - Hadoop In Real World.ts
13.2 MB
9-3 cluster installation/2 Hadoop Cluster Setup (Part 1) - Hadoop In Real World.ts
77.9 MB
9-3 cluster installation/3 Hadoop Cluster Setup (Part 2) - Hadoop In Real World.ts
84.3 MB
9-3 cluster installation/4 Hadoop Cluster Setup (Part 3) - Hadoop In Real World.ts
40.6 MB
9-4 end to end project (spark, elasticsearch,..)/1 End to End Project Introduction - Hadoop In Real World.ts
14.6 MB
9-4 end to end project (spark, elasticsearch,..)/2 Elasticsearch (A quick introduction).ts
15.4 MB
9-4 end to end project (spark, elasticsearch,..)/3 Hands-on with Elasticsearch - Hadoop In Real World.ts
23.7 MB
9-4 end to end project (spark, elasticsearch,..)/4 Stackoverflow Dataset - Hadoop In Real World.ts
21.9 MB
9-4 end to end project (spark, elasticsearch,..)/5 Spark ETL - Hadoop In Real World.ts
36.5 MB
9-4 end to end project (spark, elasticsearch,..)/6 Visualizations with Kibana - Hadoop In Real World.ts
22.3 MB
9-4 end to end project (spark, elasticsearch,..)/7 REST Service with Spring framework.ts
48.9 MB
9-4 end to end project (spark, elasticsearch,..)/8 Building an Angular application - Hadoop In Real World.ts
32.2 MB
9-5 intro to kafka/1 Kafka - The Why and the What - Hadoop In Real World.ts
23.2 MB
9-5 intro to kafka/2 Key Concepts - Hadoop In Real World.ts
28.9 MB
9-5 intro to kafka/3 Experiments with Kafka - Hadoop In Real World.ts
65.1 MB
9-6 machine learning/1 Introduction to Machine Learning - Hadoop In Real World.ts
22.5 MB
9-6 machine learning/2 Machine Learning Blueprint - Hadoop In Real World.ts
11.1 MB
9-6 machine learning/3 Feature Engineering - Hadoop In Real World.ts
19.5 MB
9-6 machine learning/4 Linear Regression - Hadoop In Real World.ts
14.4 MB
9-6 machine learning/5 World Happiness Project - Hadoop In Real World.ts
38.2 MB
9-6 machine learning/6 Decision Trees - Hadoop In Real World.ts
18.3 MB
9-6 machine learning/7 Random Forest - Hadoop In Real World.ts
5.4 MB
9-6 machine learning/8 Predicting 2016 US Elections - Hadoop In Real World.ts
33.6 MB
9-6 machine learning/9 Predicting Yelp Ratings (+ve or -ve) - Hadoop In Real World.ts
38.6 MB
9-7 streaming with spark/1 Why Streaming and How Spark Does Streaming - Hadoop In Real World.ts
20.5 MB
9-7 streaming with spark/2 Core Concepts in Streaming - Hadoop In Real World.ts
15.5 MB
9-7 streaming with spark/3 Output Modes With Non Aggregate Queries - Hadoop In Real World.ts
36.5 MB
9-7 streaming with spark/4 Output Modes With Aggregate Queries - Hadoop In Real World.ts
19.5 MB
9-7 streaming with spark/5 Event Time, Window and Late Events - Hadoop In Real World.ts
25.6 MB
9-7 streaming with spark/6 Handling Late Events In Streaming - Hadoop In Real World.ts
26 MB
9-7 streaming with spark/7 Late Events and Append Mode - Hadoop In Real World.ts
19.2 MB
9-7 streaming with spark/8 Streaming Meetup with Spark (Part 1) - Hadoop In Real World.ts
25.7 MB
9-7 streaming with spark/9 Streaming Meetup with Spark (Part 2) - Hadoop In Real World.ts
25.3 MB
9-8 a short chapter on sclae/1 Introduction to Scala - Hadoop In Real World.ts
45.5 MB
9-8 a short chapter on sclae/2 First Program In Scala (Not Helloworld) - Hadoop In Real World.m4v
66.5 MB
9-8 a short chapter on sclae/3 Scala Functions - Hadoop In Real World.m4v