EdX

Big Data Computing with Spark (edX)

Offered by The Hong Kong University of Science and Technology - HKUST, HKUSTx,
Big Data Computing with Spark (edX)

Learn the theory and gain hands-on experience of big data systems, using Spark as the exemplary platform. Big data systems such as Hadoop and Spark emerge as enabling technologies in managing massive amounts of data across hundreds or even thousands of computing nodes. Meanwhile, cloud computing platforms have made these technologies easily accessible to individuals as well as large enterprises.

Class Deals by MOOC List - Click here and see EdX's Active Discounts, Deals, and Promo Codes.

This course exposes students to both the theory and hands-on experience of big data systems, using Spark as the exemplary platform.

What you'll learn

  • Spark programming using both RDD and DataFrame APIs
  • Useful packages including ML, GraphX/GraphFrames, and SparkStreaming
  • Spark internals and performance optimizations
  • Algorithm design for big data systems

Syllabus

Week 1: Overview, MapReduce, and Hadoop
Week 2-3: Spark Basics and RDD
Week 4: SparkSQL and MLib
Week 5: Spark internals
Week 6: Algorithm design for big data
Week 7: GraphX/GraphFrames
Week 8: Spark Streaming

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Analytics in Python (edX) EdX
Columbia University,ColumbiaX

Analytics in Python (edX)

CS: Programming Business

Learn the fundamental of programming in Python and develop the ability to analyze data and make data-driven decisions. Data is the lifeblood of an organization. Competency in programming is an essential skill for successfully extracting information and knowledge from data. The goal of this course is to introduce learners to the basics of programming in Python and to give a working knowledge of how to use programs to deal with data.

This course is archived
5-12 Weeks
Python Big Data Analytics
Details
Herramientas de la Inteligencia de Negocios (edX) EdX
Galileo University,GalileoX

Herramientas de la Inteligencia de Negocios (edX)

Statistics & Data Analysis

Aprende el proceso de extraer y transformar data para generar insumos y tomar decisiones. Usa software, herramientas y sistemas de apoyo. Con este curso aprenderas a tomar decisiones empresariales exitosas. Para ello, aprenderas el proceso completo desde extraer data, hasta su integracion, visualizacion, depuracion, analisis y uso. Podr as transformar data cruda en insumos para la toma de decisiones. Dominaras el uso de software, herramientas y sistemas de apoyo.

Self Paced
Self-Paced
Big Data Business Intelligence Power BI
Details
Programming for Data Science (edX) EdX
University of Adelaide,AdelaideX

Programming for Data Science (edX)

CS: Programming Data Science

Learn how to apply fundamental programming concepts, computational thinking and data analysis techniques to solve real-world data science problems. There is a rising demand for people with the skills to work with Big Data sets and this course can start you on your journey through our Big Data MicroMasters program towards a recognised credential in this highly competitive area. Using practical activities you will learn how digital technologies work and will develop your coding skills through engaging and collaborative assignments.

Self Paced
Self-Paced
Programming Big Data Data Analysis
Details
Big Data Analytics Using Spark (edX) EdX
University of California, San Diego,UC San DiegoX

Big Data Analytics Using Spark (edX)

Statistics & Data Analysis Data Science

Learn how to analyze large datasets using Jupyter notebooks, MapReduce and Spark as a platform. In data science, data is called “big” if it cannot fit into the memory of a single standard laptop or workstation. The analysis of big datasets requires using a cluster of tens, hundreds or thousands of computers. Effectively using such clusters requires the use of distributed files systems, such as the Hadoop Distributed File System (HDFS) and corresponding computational models, such as Hadoop, MapReduce and Spark.

Dec 5th 2023
5-12 Weeks
Machine Learning Big Data Hadoop
Details
Enabling Technologies for Data Science and Analytics: The Internet of Things (edX) EdX
Columbia University,ColumbiaX

Enabling Technologies for Data Science and Analytics: The Internet of Things (edX)

Statistics & Data Analysis

Discover the relationship between Big Data and the Internet of Things (IoT). The Internet of Things is rapidly growing. It is predicted that more than 25 billion devices will be connected by 2020. In this data science course, you will learn about the major components of the Internet of Things and how data is acquired from sensors. You will also examine ways of analyzing event data, sentiment analysis, facial recognition software and how data generated from devices can be used to make decisions.

Self Paced
Self-Paced
Analysis Big Data Data Analysis
Details
Biostatistics for Big Data Applications (edX) EdX
University of Texas Medical Branch

Biostatistics for Big Data Applications (edX)

Statistics & Data Analysis

Learn data analysis basics for working with biomedical big data with practical hands-on examples using R. This course provides a broad foundation of statistical terms and concepts as well as an introduction to the R statistical software package. The topics covered are fundamental components of biostatistical methods used in both omics and population health research.

No sessions Available
5-12 Weeks
Big Data Biostatistics Biomedical
Details
Introducción a los Sistemas de Información Gerencial (MIS): Una guía de supervivencia (edX) EdX
Universidad Carlos III de Madrid - UC3M,UC3Mx

Introducción a los Sistemas de Información Gerencial (MIS): Una guía de supervivencia (edX)

Computer Science

Obtén las habilidades y el conocimiento necesarios para tener éxito en un mundo corporativo dominado por los sistemas de información gerencial (SIG o MIS). Los omnipresentes Sistemas de Información Gerencial (SIG) o Management Information Systems (MIS) juegan un papel crítico en el actual panorama profesional. Desde los sistemas de gestión de las relaciones con los clientes, que gestionan las interacciones diarias con los clientes actuales y potenciales, hasta los sistemas gerenciales y financieros que emiten y pagan facturas, el día a día de la vida laboral está cada vez más controlado por estos sistemas de gestión, que dictan qué hacer y cómo hacerlo.

Self Paced
Self-Paced
Cloud Big Data Information Systems
Details
Knowledge Management and Big Data in Business (edX) EdX
The Hong Kong Polytechnic University,HKPolyUx

Knowledge Management and Big Data in Business (edX)

Management & Leadership Social Sciences

Learn why and how knowledge management and Big Data are vital to the new business era. The business landscape is changing so rapidly that traditional management, business and computing courses do not meet the needs for the next generation of workers in the business world. Most traditional methods are of a repetitive, rule-based nature and will be gradually replaced by Artificial Intelligence.

Self Paced
Self-Paced
Business Management Big Data
Details
Big Data Fundamentals (edX) EdX
University of Adelaide,AdelaideX

Big Data Fundamentals (edX)

Statistics & Data Analysis Data Science

Learn how big data is driving organisational change and essential analytical tools and techniques, including data mining and PageRank algorithms. Organizations now have access to massive amounts of data and it’s influencing the way they operate. They are realizing in order to be successful they must leverage their data to make effective business decisions.

Self Paced
Self-Paced
Big Data Data Mining MapReduce
Details