Big Data Integration and Processing (Coursera)

Big Data Integration and Processing (Coursera)

At the end of the course, you will be able to: Retrieve data from example database and big data management systems; Describe the connections between data management operations and the big data processing patterns needed to utilize them in large-scale analytical applications; Identify when a big data problem needs data integration; Execute simple big data integration and processing on Hadoop and Spark platforms.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

This course is for those new to data science. Completion of Intro to Big Data is recommended. No prior programming experience is needed, although the ability to install applications and utilize a virtual machine is necessary to complete the hands-on assignments. Refer to the specialization technical requirements for complete hardware and software specifications.
Hardware Requirements:
(A) Quad Core Processor (VT-x or AMD-V support recommended), 64-bit; (B) 8 GB RAM; (C) 20 GB disk free. How to find your hardware information: (Windows): Open System by clicking the Start button, right-clicking Computer, and then clicking Properties; (Mac): Open Overview by clicking on the Apple menu and clicking “About This Mac.” Most computers with 8 GB RAM purchased in the last 3 years will meet the minimum requirements.You will need a high speed internet connection because you will be downloading files up to 4 Gb in size.
Software Requirements:
This course relies on several open-source software tools, including Apache Hadoop. All required software can be downloaded and installed free of charge (except for data charges from your internet provider). Software requirements include: Windows 7+, Mac OS X 10.10+, Ubuntu 14.04+ or CentOS 6+ VirtualBox 5+.
Course 3 of 6 in the Big Data Specialization.

Syllabus

WEEK 1
Welcome to Big Data Integration and Processing
Welcome to the third course in the Big Data Specialization. This week you will be introduced to basic concepts in big data integration and processing. You will be guided through installing the Cloudera VM, downloading the data sets to be used for this course, and learning how to run the Jupyter server.
Retrieving Big Data (Part 1)
This module covers the various aspects of data retrieval and relational querying. You will also be introduced to the Postgres database.

WEEK 2
Retrieving Big Data (Part 2)
This module covers the various aspects of data retrieval for NoSQL data, as well as data aggregation and working with data frames. You will be introduced to MongoDB and Aerospike, and you will learn how to use Pandas to retrieve data from them.

WEEK 3
Big Data Integration
In this module you will be introduced to data integration tools including Splunk and Datameer, and you will gain some practical insight into how information integration processes are carried out.

WEEK 4
Processing Big Data
This module introduces Learners to big data pipelines and workflows as well as processing and analysis of big data using Apache Spark.

WEEK 5
Big Data Analytics using Spark
In this module, you will go deeper into big data processing by learning the inner workings of the Spark Core. You will be introduced to two key tools in the Spark toolkit: Spark MLlib and GraphX.

WEEK 6
Learn By Doing: Putting MongoDB and Spark to Work
In this module you will get some practical hands-on experience applying what you learned about Spark and MongoDB to analyze Twitter data.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Understanding China, 1700-2000: A Data Analytic Approach, Part 2 (Coursera) Coursera
The Hong Kong University of Science and Technology - HKUST

Understanding China, 1700-2000: A Data Analytic Approach, Part 2 (Coursera)

The purpose of this course is to summarize new directions in Chinese history and social science produced by the creation and analysis of big historical datasets based on newly opened Chinese archival holdings, and to organize this knowledge in a framework that encourages learning about China in comparative perspective. Our course demonstrates how a new scholarship of discovery is redefining what is singular about modern China and modern Chinese history.

Nov 23rd 2026
4 Weeks
Necessary Condition Analysis (NCA) (Coursera) Coursera
Erasmus University Rotterdam

Necessary Condition Analysis (NCA) (Coursera)

Welcome to Necessary Condition Analysis (NCA). NCA analyzes data using necessity logic. A necessary condition implies that if the condition is not in place, there will be guaranteed failure of the outcome. The opposite however is not true; if the condition is in place, success of the outcome is not guaranteed.

Nov 23rd 2026
5-12 Weeks
Combining and Analyzing Complex Data (Coursera) Coursera
University of Maryland, College Park

Combining and Analyzing Complex Data (Coursera)

In this course you will learn how to use survey weights to estimate descriptive statistics, like means and totals, and more complicated quantities like model parameters for linear and logistic regressions. Software capabilities will be covered with R® receiving particular emphasis. The course will also cover the basics of record linkage and statistical matching—both of which are becoming more important as ways of combining data from different sources. Combining of datasets raises ethical issues which the course reviews. Informed consent may have to be obtained from persons to allow their data to be linked. You will learn about differences in the legal requirements in different countries.

Nov 16th 2026
4 Weeks
Gender Foundations in Health Data: A Data for Health Course (Coursera) Coursera
Johns Hopkins University

Gender Foundations in Health Data: A Data for Health Course (Coursera)

Welcome to Gender Foundations in Health Data: A Data for Health course. This course was developed from an online seminar series of the same name, that was hosted by Johns Hopkins University Bloomberg School of Health in 2021-22. The course instructors are Drs. Michelle Kaufman and Tahilin Sanchez Karver. This course will raise learners' awareness of the necessity of utilizing a gender lens in global public health data, policy, and practice, feature how-tos and key examples of integration of gender in data collection, analysis, and use from Data for Health partners.

Nov 23rd 2026
1 Week
Bioinformatic Methods I (Coursera) Coursera
University of Toronto

Bioinformatic Methods I (Coursera)

Large-scale biology projects such as the sequencing of the human genome and gene expression surveys using RNA-seq, microarrays and other technologies have created a wealth of data for biologists. However, the challenge facing scientists is analyzing and even accessing these data to extract useful information pertaining to the system being studied. This course focuses on employing existing bioinformatic resources – mainly web-based programs and databases – to access the wealth of data to answer questions relevant to the average biologist, and is highly hands-on.

Nov 16th 2026
5-12 Weeks
Population Health: Predictive Analytics (Coursera) Coursera
Leiden University

Population Health: Predictive Analytics (Coursera)

Predictive analytics has a longstanding tradition in medicine. Developing better prediction models is a critical step in the pursuit of improved health care: we need these tools to guide our decision-making on preventive measures, and individualized treatments. In order to effectively use and develop these models, we must understand them better. In this course, you will learn how to make accurate prediction tools, and how to assess their validity. First, we will discuss the role of predictive analytics for prevention, diagnosis, and effectiveness. Then, we look at key concepts such as study design, sample size and overfitting.

Nov 23rd 2026
4 Weeks
Data Science Ethics (Coursera) Coursera
University of Michigan

Data Science Ethics (Coursera)

What are the ethical considerations regarding the privacy and control of consumer information and big data, especially in the aftermath of recent large-scale data breaches? This course provides a framework to analyze these concerns as you examine the ethical and privacy implications of collecting and managing big data. Explore the broader impact of the data science field on modern society and the principles of fairness, accountability and transparency as you gain a deeper understanding of the importance of a shared set of ethical values.

Nov 16th 2026
4 Weeks
Principles of fMRI 2 (Coursera) Coursera
Johns Hopkins University,University of Colorado Boulder

Principles of fMRI 2 (Coursera)

Functional Magnetic Resonance Imaging (fMRI) is the most widely used technique for investigating the living, functioning human brain as people perform tasks and experience mental states. It is a convergence point for multidisciplinary work from many disciplines. Psychologists, statisticians, physicists, computer scientists, neuroscientists, medical researchers, behavioral scientists, engineers, public health researchers, biologists, and others are coming together to advance our understanding of the human mind and brain. This course covers the analysis of Functional Magnetic Resonance Imaging (fMRI) data.

Nov 16th 2026
4 Weeks
HI-FIVE: Health Informatics For Innovation, Value & Enrichment (Administrative/IT Perspective) (Coursera) Coursera
Columbia University

HI-FIVE: Health Informatics For Innovation, Value & Enrichment (Administrative/IT Perspective) (Coursera)

HI-FIVE (Health Informatics For Innovation, Value & Enrichment) Training is an approximately 10-hour online course designed by Columbia University in 2016, with sponsorship from the Office of the National Coordinator for Health Information Technology (ONC). The training is role-based and uses case scenarios. No additional hardware or software are required for this course. Our nation’s healthcare system is changing at a rapid pace.

Nov 23rd 2026
4 Weeks
Process Mining: Data science in Action (Coursera) Coursera
Eindhoven University of Technology

Process Mining: Data science in Action (Coursera)

Process mining is the missing link between model-based process analysis and data-oriented analysis techniques. Through concrete data sets and easy to use software the course provides data science knowledge that can be applied directly to analyze and improve processes in a variety of domains. Data science is the profession of the future, because organizations that are unable to use (big) data in a smart way will not survive. It is not sufficient to focus on data storage and data analysis. The data scientist also needs to relate data to process analysis.

Nov 16th 2026
5-12 Weeks
Construção de Relacionamentos em Vendas Orientada a Dados (Coursera) Coursera
FIA Business School

Construção de Relacionamentos em Vendas Orientada a Dados (Coursera)

Nossas boas-vindas ao Curso Construção de Relacionamento em Vendas Orientada a Dados. Neste curso, você aprenderá métodos sobre data analytics para o ambiente dos profissionais de vendas. Ao final deste curso, você será capaz de avaliar relacionamentos entre o desempenho de vendas e os gastos relacionados; agrupar por semelhança itens, produtos ou serviços e, por fim, realizar recomendações de produtos para clientes sob características preestabelecidas.

Nov 23rd 2026
4 Weeks
Advanced Linear Models for Data Science 2: Statistical Linear Models (Coursera) Coursera
Johns Hopkins University

Advanced Linear Models for Data Science 2: Statistical Linear Models (Coursera)

Welcome to the Advanced Linear Models for Data Science Class 2: Statistical Linear Models. This class is an introduction to least squares from a linear algebraic and mathematical perspective. Before beginning the class make sure that you have the following: a basic understanding of linear algebra and multivariate calculus; a basic understanding of statistics and regression models; at least a little familiarity with proof based mathematics; basic knowledge of the R programming language.

Nov 23rd 2026
4 Weeks