Udacity

Real-Time Analytics with Apache Storm (Udacity)

Offered by Udacity, Twitter,
Real-Time Analytics with Apache Storm (Udacity)

The world is trending in real time! Learn from Twitter to scalably process tweets, or any big data stream, in real-time to drive d3 visualizations using Apache Storm, the "Hadoop of Real Time." Storm is free, open source, and fun to use! Learn from Karthik Ramasamy, about the distributed, fault-tolerant, and flexible technology used to power Twitter’s real-time data flow pipeline. Twitter open sourced Storm in 2011, and it graduated to a top-level Apache project in September, 2014.

Class Deals by MOOC List - Click here and see Udacity's Active Discounts, Deals, and Promo Codes.

Starting from basic distributed concepts presented during our first Udacity-Twitter Storm Hackathon, link Storm concepts to Storm syntax to scalably drive Word Cloud visualizations with Vagrant, Ubuntu, Maven, Flask, Redis, and d3. Link to the public Twitter gardenhose stream to process live tweets, parse embedded URLs, and calculate Top worldwide hashtags. Extend beyond Storm basics by exploring multi-language capabilities in Python, integrate open source components, and implement real-time streaming joins.
In your final project, follow real-time trending topics by implementing the data pipeline to visualize only tweets that contain Top worldwide hashtags. Extend your project by exploring the Twitter API, or any data source, alongside Hackathon participants as they design their own ideas, receive feedback from Karthik, and open source a final project calculating real-time tweet sentiment and geolocation to drive a U.S. Map.
Learn by doing! The world is going real time. Batch processing, popularized by Hadoop, has latency exceeding required real-time demands of modern mobile, connected, always-on users. Stream processing with seconds-required response time is necessary to meet this demand. Twitter is a world leader in real-time processing at scale. Learn the future from the company defining it.

What You Will Learn

Lesson 1
Basic Storm Topologies

  • Link to a real-time d3 Word Cloud Visualization using Redis Flask and d3

Lesson 2
Storm Basics

  • Program Bolts link Spouts and connect to the live Twitter API to process real-time tweets
  • Explore open source components by connecting a Rolling Count Bolt to your topology to visualize Rolling Top Tweeted Words

Lesson 3
Beyond Storm Basics

  • Explore multi-language capabilities to download and parse real-time Tweeted URLs in Python using Beautiful Soup
  • Integrate complex open source bolts to calculate Top-N words to visualize real-time Top-N Hashtags
  • Use stream grouping concepts to easily create streaming join to connect and dynamically process multiple streams

Lesson 4
Final Project

  • Work on your final project and we cover additional questions and topics brought up by Hackathon participants
  • Explore Vagrant
  • VirtualBox
  • Redis
  • Flask
  • and d3 further if you are interested!

Lesson 5
Final Project: Construct a Storm Topology

  • Design a Storm Topology and new bolt that uses streaming joins to dynamically calculate Top-N Hashtags and display real-time tweets that contain trending Top Hashtags
  • Post your visualization to the forum and tweet them to your Twitter followers

Lesson 6
Project Extensions

  • Use additional features of the real-time Twitter sample stream or use any data source to drive your real-time d3 visualization

Prerequisites and Requirements
Programming language required: JavaTo be successful, you'll need intermediate knowledge of Java. Specifically, this is defined by experience and comfort with Java syntax, compile & run-time error diagnostics and debugging, ability to use javadocs as needed, and intermediate data structures including Arrays, HashMaps, and LinkedLists. If you need to build these skills, a good starting point is Udacity’s Introduction to Java with additional comfortability needed identifying and debugging compile & run-time errors. No prior experience is assumed in Ubuntu, git, Maven, Redis, Flask (Python) or d3 (Javascript). Python is useful, but optional. A basic course such as CS101 or OO in Python would be helpful.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Data Science Math Skills (Coursera) Coursera
Duke University

Data Science Math Skills (Coursera)

Sci: Mathematics Data Science

Data science courses contain math—no avoiding that! This course is designed to teach learners the basic math you will need in order to be successful in almost any data science math course and was created for learners who have basic math skills but may not have taken algebra or pre-calculus. Data Science Math Skills introduces the core math that data science is built upon, with no extra complexity, introducing unfamiliar ideas and math symbols one-at-a-time.

Nov 30th 2026
4 Weeks
Math Algebra Probability
Details
Data Analysis and Visualization (Udacity) Udacity
Georgia Institute of Technology,Udacity

Data Analysis and Visualization (Udacity)

Statistics & Data Analysis Data Science

Data and visual analytics is an emerging field concerned with analyzing, modeling, and visualizing complex high dimensional data. This course will introduce students to the field by covering state­-of-­the-art modeling, analysis and visualization techniques. It will emphasize practical challenges involving complex real world data and include several case studies and hands-on work with the R programming language.

Self Paced
Self-Paced
Data Structures Regression Data Analysis
Details
Practical Time Series Analysis (Coursera) Coursera
The State University of New York

Practical Time Series Analysis (Coursera)

Statistics & Data Analysis Data Science

Many of us are "accidental" data analysts. We trained in the sciences, business, or engineering and then found ourselves confronted with data for which we have no formal analytic training. This course is designed for people with some technical competencies who would like more than a "cookbook" approach, but who still need to concentrate on the routine sorts of presentation and analysis that deepen the understanding of our professional topics.

Nov 30th 2026
5-12 Weeks
Statistics Probability Equations
Details
Introduction to Statistics (Coursera) Coursera
Stanford University

Introduction to Statistics (Coursera)

Statistics & Data Analysis Data Science

Stanford's "Introduction to Statistics" teaches you statistical thinking concepts that are essential for learning from data and communicating insights. By the end of the course, you will be able to perform exploratory data analysis, understand key principles of sampling, and select appropriate tests of significance for multiple contexts. You will gain the foundational skills that prepare you to pursue more advanced topics in statistical thinking and machine learning.

Nov 30th 2026
5-12 Weeks
Statistics Analysis Probability
Details
Business Applications of Hypothesis Testing and Confidence Interval Estimation (Coursera) Coursera
Rice University

Business Applications of Hypothesis Testing and Confidence Interval Estimation (Coursera)

Statistics & Data Analysis Data Science

Confidence intervals and Hypothesis tests are very important tools in the Business Statistics toolbox. A mastery over these topics will help enhance your business decision making and allow you to understand and measure the extent of ‘risk’ or ‘uncertainty’ in various business processes. This course advances your knowledge about Business Statistics by introducing you to Confidence Intervals and Hypothesis Testing. These are done by easy to understand applications.

Nov 30th 2026
4 Weeks
Hypothesis Data Analysis Microsoft Excel
Details
Making Data Science Work for Clinical Reporting (Coursera) Coursera
Genentech

Making Data Science Work for Clinical Reporting (Coursera)

Statistics & Data Analysis Data Science

This course is aimed to demonstrate how principles and methods from data science can be applied in clinical reporting. By the end of the course, learners will understand what requirements there are in reporting clinical trials, and how they impact on how data science is used. The learner will see how they can work efficiently and effectively while still ensuring that they meet the needed standards.

Nov 30th 2026
4 Weeks
Github Clinical Trials Data Science
Details
Introduction to Accounting Data Analytics and Visualization (Coursera) Coursera
University of Illinois at Urbana-Champaign

Introduction to Accounting Data Analytics and Visualization (Coursera)

Statistics & Data Analysis Data Science

Accounting has always been about analytical thinking. From the earliest days of the profession, Luca Pacioli emphasized the importance of math and order for analyzing business transactions. The skillset that accountants have needed to perform math and to keep order has evolved from pencil and paper, to typewriters and calculators, then to spreadsheets and accounting software. A new skillset that is becoming more important for nearly every aspect of business is that of big data analytics: analyzing large amounts of data to find actionable insights. This course is designed to help accounting students develop an analytical mindset and prepare them to use data analytic programming languages like Python and R.

Nov 30th 2026
5-12 Weeks
Excel Accounting Data Analysis
Details
Artificial Intelligence for Breast Cancer Detection (Coursera) Coursera
Johns Hopkins University

Artificial Intelligence for Breast Cancer Detection (Coursera)

Data Science

Through interactive lectures and module exercises, this course illustrates the potential of artificial intelligence in breast imaging. Topics include an introduction of breast cancer and breast imaging, introduction to artificial intelligence in image analysis and computer image processing of cancer detection. The course intends to provide students basic understanding of artificial intelligence approaches to breast cancer detection.

Nov 30th 2026
4 Weeks
Artificial Intelligence Data Science Breast Cancer
Details
Model Building and Validation (Udacity) Udacity
Udacity

Model Building and Validation (Udacity)

Statistics & Data Analysis Data Science

Advanced Techniques for Analyzing Data. This course will teach you how to start from scratch in answering questions about the real world using data. Machine learning happens to be a small part of this process. The model building process involves setting up ways of collecting data, understanding and paying attention to what is important in the data to answer the questions you are asking, finding a statistical, mathematical or a simulation model to gain understanding and make predictions.

Self Paced
Self-Paced
Machine Learning Modeling Data Analysis
Details
Population Health: Responsible Data Analysis (Coursera) Coursera
Leiden University

Population Health: Responsible Data Analysis (Coursera)

Statistics & Data Analysis Data Science

In most areas of health, data is being used to make important decisions. As a health population manager, you will have the opportunity to use data to answer interesting questions. In this course, we will discuss data analysis from a responsible perspective, which will help you to extract useful information from data and enlarge your knowledge about specific aspects of interest of the population.

Nov 30th 2026
4 Weeks
Data Analysis R Programming Regression Analysis
Details