17 OCT 2024 - Welcome Back to TorrentFunk! Get your pirate hat back out. Streaming is dying and torrents are the new trend. Account Registration works again and so do Torrent Uploads. We invite you all to start uploading torrents again!
TORRENT DETAILS
A Big Data Hadoop And Spark Project For Absolute Beginners
TORRENT SUMMARY
Status:
All the torrents in this section have been verified by our verification system
Get started with Big Data quickly leveraging free cloud cluster and solving a real world use case! Learn Hadoop, Hive , Spark (both Python and Scala) from scratch!
Learn to code Spark Scala & PySpark like a real world developer. Understand real world coding best practices, logging, error handling , configuration management using both Scala and Python.
Project
A bank is launching a new credit card and wants to identify prospects it can target in its marketing campaign.
It has received prospect data from various internal and 3rd party sources. The data has various issues such as missing or unknown values in certain fields. The data needs to be cleansed before any kind of analysis can be done.
Since the data is in huge volume with billions of records, the bank has asked you to use Big Data Hadoop and Spark technology to cleanse, transform and analyze this data.
What you will learn :
Big Data, Hadoop concepts
How to create a free Hadoop and Spark cluster using Google Dataproc
Hadoop hands-on – HDFS, Hive
Python basics
PySpark RDD – hands-on
PySpark SQL, DataFrame – hands-on
Project work using PySpark and Hive
Scala basics
Spark Scala DataFrame
Project work using Spark Scala
Spark Scala Real world coding framework and development using Winutil, Maven and IntelliJ.
Python Spark Hadoop Hive coding framework and development using PyCharm
Building a data pipeline using Hive , PostgreSQL, Spark
Logging , error handling and unit testing of PySpark and Spark Scala applications
Spark Scala Structured Streaming
Applying spark transformation on data stored in AWS S3 using Glue and viewing data using Athena
Prerequisites :
Some basic programming skills
Some knowledge of SQL queries
Who this course is for:
Beginners who want to learn Big Data or experienced people who want to transition to a Big Data role
Big data beginners who want to learn how to code in the real world
Requirements
Students should have some programming background and some knowledge of SQL queries.
Last Updated 12/2020
VISITOR COMMENTS (0 )
FILE LIST
Filename
Size
.pad/0
6 B
.pad/1
190.4 KB
.pad/2
4.2 KB
.pad/3
71.3 KB
.pad/4
109.9 KB
.pad/5
248.5 KB
.pad/6
58 KB
.pad/7
235.6 KB
.pad/8
833.5 KB
TutsNode.com.txt
63 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/10.1 Postgres-course-catalog.sql
1.2 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/11.1 Postgres-course-catalog_psql.zip
619 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/12.1 FutureXSparkScalaProject_Postgres.zip
12.3 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/14. Organizing code with Objects and Methods.mp4
91.2 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/14.1 FutureXSparkScalaProject_organize.zip
108.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/15.1 log4j.zip
343 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/5.1 ScalaHelloWorld.zip
8 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/6.1 ScalaBasics.zip
12.2 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/7.1 SparkHelloWorld.zip
9.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/8.1 githuhb-link.txt
42 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/8.2 winutils.zip
36.1 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/10. Spark Scala real world coding framework and best practices/9.1 FutureXSparkScalaProject.zip
11.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/1. Reading from Hive and Writing to Postgres.mp4
104.1 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/1.1 FutureXSparkScalaProject_readHivewritePG.zip
353.5 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/2. Reading Configuration from JSON using Typesafe.mp4
85.1 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/2.1 FutureXSparkScalaProject_typesafe_config_parser.zip
358.9 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/3.1 FutureXSparkScalaProject_writeToHive.zip
396.9 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/11. A Data Pipeline with Spark Scala Hadoop PostgreSQL/5. Intellij Maven troubleshooting tips.html
590 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/1.1 FutureXScalaUnitTesting.zip
15.6 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/5.1 SparkTransformerSpec.zip
703 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/6.1 SparkTransformerSpec.zip
770 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/7.1 common.zip
1.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/8.1 failtests.txt
100 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/12. Spark Scala Unit Testing using ScalaTest/9.1 SparkTransformerSpec.zip
811 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/1.1 pom.zip
989 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/2.1 cloudera-gcp.txt
3.4 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/3.1 spark2-cloudera.txt
1.5 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/4.1 spark-submit.txt
222 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/13. Running Spark and Hive on a Cloudera QuickStart VM on GCP/4.2 FutureXSparkScalaProject-spark-submit.zip
26.5 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/2.1 files.zip
509 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/2.2 FuturexMiscSparkScala.zip
18.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/4.1 files (1).zip
509 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/4.2 FuturexMiscSparkScala (1).zip
18.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/5.1 StructuredStreamingWindowAggregation.zip
823 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/5.2 sale.zip
530 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/6.1 FuturexMiscSparkScala_Filter.zip
33.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/7.1 StructuredStreamingDemoTimestamp.zip
721 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/8.1 StructuredStreamingWindowAggregation.zip
823 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/14. Spark Scala - Structured Streaming/9.1 FuturexMiscSparkScala.zip
7.8 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/1. PySpark Hadoop Hive development environment using PyCharm and Winutils.mp4
97.5 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/1.1 hello_world_python_spark_hadoop.zip
746 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/2.1 DataPipeline_v1.zip
951 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/4.1 DataPipeline_v2.zip
1.2 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/5.1 DataPipeline_v3.zip
1.5 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/15. Creating a PySpark real world coding framework/6.1 DataPipeline_v4.zip
1.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/2.1 DataPipeline_logging_1.zip
2.6 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/16. PySpark Logging and Error Handling/3.1 DataPipeline_Logger2.zip
2.8 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/1.1 DataPipeline_v5.zip
1.5 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/3.1 Postgres-course-catalog.zip
579 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/4.1 DataPipeline_psycopg2.zip
2.4 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/5.1 DataPipeline_postgres_jdbc.zip
911.8 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/6.1 pg_course.zip
315 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/17. Creating a Data Pipeline with Hadoop PySpark and PostgreSQL/6.2 persist_transformed_df.zip
867 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/18. PySpark - Reading Configuration from properties file/2.1 DataPipeline_read_config.zip
918 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/1.1 test.zip
455 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/19. Unit testing PySpark application and spark-submit/3.1 test_transformer.zip
826 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/1. Creating a free Hadoop and Spark cluster using Google Dataproc.mp4
79.2 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2. Storing data in HDFS and querying with Hive.mp4
82.1 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2.1 retailstore.csv
306 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/3. Hadoop - Hands-On/2.2 hive-hdfs-commands.txt
1.5 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/2.1 Spark_Installation_on_Colab.zip
11.9 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/2.2 spark_installation_on_colab.py
1.3 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/3.1 python_basics.py
4.4 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/3.2 python_basics.py
4.4 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4. PySpark RDD.mp4
78.5 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4.1 pyspark_rdd.zip
15.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/4.2 retailstore.csv
279 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/5.1 pyspark_dataframe.py
4.5 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/5.2 PySpark_DataFrame.zip
17.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/4. Spark concepts and hands-on/6.1 spark-hadoop-commands.txt
1.8 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1. Project - Bank prospects marketing data transformation using Hadoop and Spark.mp4
87.8 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1.1 pyspark_bank_marketing_project.py
2.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/1.2 pyspark_bank_marketing_project.zip
14.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/5. Project - Bank prospects marketing data cleansing using Spark/2. Rapid Revision - Big Data, Hadoop and Spark concepts.mp4
108.7 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/1.1 scala-basics.txt
1.9 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/2.1 spark-scala-dataframe.txt
2.5 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/6. Running the project in Scala/3.1 spark-scala-bank-marketing-project.txt
1.3 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/2.1 Creating a Data Lake using S3, Glue, Athena.zip
1.4 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/6.1 Triggering AWS Glue job with a serverless Lambda function.zip
526 B
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/7. Bank prospects data transformation using AWS S3, Glue and Athena/7.1 glue_pyspark_bank_marketing_project.zip
1.2 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/1. Fast queries with Hive Partitioning.mp4
116.7 MB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/1.1 hive-partition.txt
2.3 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/8. Advanced Hive/2.1 hive-bucketing.txt
1.2 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/1.1 advanced_spark_datasets.zip
736.2 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/2.1 pyspark_udf_and_join.py
3.7 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/2.2 PySpark_udf_and_join.zip
16 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/3.1 PySpark_udf_and_join.zip
16 KB
[TutsNode.com] - A Big Data Hadoop and Spark project for absolute beginners/9. Advanced Spark/3.2 pyspark_udf_and_join.py
