EdX

Big Data Computing with Spark (edX)

Offered by The Hong Kong University of Science and Technology - HKUST, HKUSTx,
Big Data Computing with Spark (edX)

Learn the theory and gain hands-on experience of big data systems, using Spark as the exemplary platform. Big data systems such as Hadoop and Spark emerge as enabling technologies in managing massive amounts of data across hundreds or even thousands of computing nodes. Meanwhile, cloud computing platforms have made these technologies easily accessible to individuals as well as large enterprises.

Class Deals by MOOC List - Click here and see EdX's Active Discounts, Deals, and Promo Codes.

This course exposes students to both the theory and hands-on experience of big data systems, using Spark as the exemplary platform.

What you'll learn

  • Spark programming using both RDD and DataFrame APIs
  • Useful packages including ML, GraphX/GraphFrames, and SparkStreaming
  • Spark internals and performance optimizations
  • Algorithm design for big data systems

Syllabus

Week 1: Overview, MapReduce, and Hadoop
Week 2-3: Spark Basics and RDD
Week 4: SparkSQL and MLib
Week 5: Spark internals
Week 6: Algorithm design for big data
Week 7: GraphX/GraphFrames
Week 8: Spark Streaming

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Wiretaps to Big Data: Privacy and Surveillance in the Age of Interconnection (edX) EdX
Cornell University

Wiretaps to Big Data: Privacy and Surveillance in the Age of Interconnection (edX)

Social Sciences

Explore the privacy issues of an interconnected world. How does cellular technology enable massive surveillance? Do users have rights against surveillance? How does surveillance affect how we use cellular and other technologies? How does it affect our democratic institutions? Do you know that the metadata collected by a cellular network speaks volumes about its users? In this course you will explore all of these questions while investigating related issues in WiFi and Internet surveillance.

No sessions available
5-12 Weeks
Cryptography Technology Big Data
Details
Introducción a la Ciencia de Datos y el Big Data (edX) EdX
Tecnológico de Monterrey,TecdeMonterreyX

Introducción a la Ciencia de Datos y el Big Data (edX)

Statistics & Data Analysis

Obtén un panorama general de lo que es Data Science o Ciencia de Datos y cómo aplicarla en las organizaciones. Aprende a tomar decisiones basadas en los datos. El futuro pertenece a la ciencia de datos y a quienes la entiendan. Al igual que el petróleo y el gas impulsaron las economías de los siglos XX y XXI, los datos impulsan cada vez mas la innovación y la economía global a medida que avanzamos hacia una nueva era denominada la revolución digital.

Self Paced
Self-Paced
Big Data Data Science Data-Driven
Details
Big Data Solutions for Social and Economic Disparities (edX) EdX
HarvardX,Harvard University

Big Data Solutions for Social and Economic Disparities (edX)

Statistics & Data Analysis

Join Harvard University Professor Raj Chetty in this online course to understand how big data can be used to measure mobility and solve social problems. What factors increase or decrease your likelihood of economic mobility? Does the neighborhood you grew up in play a part? How different is your life from the family’s life just a few streets over?

Self Paced
Self-Paced
Big Data Mobility Social Problems
Details
Big Data Technology Capstone Project (edX) EdX
The Hong Kong University of Science and Technology - HKUST,HKUSTx

Big Data Technology Capstone Project (edX)

Statistics & Data Analysis Computer Science

The Big Data Technology Capstone Project will allow you to apply the techniques and theory you have gained from the four courses in this MicroMasters program to a medium-scale project. In this capstone course, you will get an opportunity to apply the knowledge and skills that you have gained throughout this MicroMasters program.

Self Paced
Self-Paced
Big Data Data Mining Data Analysis
Details
Big Data Strategies to Transform Your Business (edX) EdX
Delft University of Technology,DelftX

Big Data Strategies to Transform Your Business (edX)

Statistics & Data Analysis Business

Make your organization’s business strategy and model, as well as your own career path, future-proof by using big data’s disruptive power. While big data infiltrates all walks of life, most firms have not changed sufficiently to meet the challenges that come with it. In this course, you will learn how to develop a big data strategy, transform your business model and your organization. This course will enable professionals to take their organization and their own career to the next level, regardless of their background and position.

Self Paced
Self-Paced
Management Big Data Business Strategy
Details
Herramientas de la Inteligencia de Negocios (edX) EdX
Galileo University,GalileoX

Herramientas de la Inteligencia de Negocios (edX)

Statistics & Data Analysis

Aprende el proceso de extraer y transformar data para generar insumos y tomar decisiones. Usa software, herramientas y sistemas de apoyo. Con este curso aprenderas a tomar decisiones empresariales exitosas. Para ello, aprenderas el proceso completo desde extraer data, hasta su integracion, visualizacion, depuracion, analisis y uso. Podr as transformar data cruda en insumos para la toma de decisiones. Dominaras el uso de software, herramientas y sistemas de apoyo.

Self Paced
Self-Paced
Big Data Business Intelligence Power BI
Details
Introduction to Management Information Systems (MIS): A Survival Guide (edX) EdX
Universidad Carlos III de Madrid - UC3M,UC3Mx

Introduction to Management Information Systems (MIS): A Survival Guide (edX)

Management & Leadership

Gain the skills and knowledge needed to succeed in an MIS-dominated corporate world. This MIS course will cover supporting tech infrastructures (Cloud, Databases, Big Data), the MIS development/ procurement process, and the main integrated systems, ERPs, such as SAP®, Oracle® or Microsoft Dynamics Navision®, as well as their relationship with Business Process Redesign.

Self Paced
Self-Paced
Cloud Databases Big Data
Details
Introduction to Apache Spark (edX) EdX
University of California, Berkeley

Introduction to Apache Spark (edX)

CS: Software Engineering Statistics & Data Analysis

Learn the fundamentals and architecture of Apache Spark, the leading cluster-computing framework among professionals. Spark is rapidly becoming the compute engine of choice for big data. Spark programs are more concise and often run 10-100 times faster than Hadoop MapReduce jobs. As companies realize this, Spark developers are becoming increasingly valued.

Not Available
Course Not Available
Programming Big Data Apache Spark
Details
Foundations of Data Analytics (edX) EdX
The Hong Kong University of Science and Technology - HKUST,HKUSTx

Foundations of Data Analytics (edX)

Statistics & Data Analysis Computer Science

Learn the fundamental techniques for data analytics and to be prepared for learning and applying more advanced big data technologies. Foundations of Data Analytics: This course will provide fundamental techniques for data analytics, including data collection, data extraction, data integration, data cleansing, and basic machine learning techniques.

Self Paced
Self-Paced
Machine Learning Big Data Data Privacy
Details
Visualización de Datos y Storytelling (edX) EdX
Tecnológico de Monterrey,TecdeMonterreyX

Visualización de Datos y Storytelling (edX)

Engineering Statistics & Data Analysis

Aprende en este curso en línea que es la visualización de datos, sus usos; los elementos que la conforman y la forma de poder utilizarla para el apoyo en la toma de las mejores decisiones para las empresas basadas en el análisis de datos. Digamos que necesitas comprender big data; miles o incluso millones de filas de datos, y tienes poco tiempo para hacerlo. los datos pueden provenir de tu equipo, en cuyo caso tal vez ya estés familiarizado con lo que estás midiendo y de los resultados que se esperan. O puede provenir de otro equipo, o tal vez de varios equipos a la vez, y estar completamente familiarizado.

Self Paced
Self-Paced
Big Data Storytelling Data Science
Details