Skip to main content
  • Book
  • © 2021

Heron Streaming

Fundamentals, Applications, Operations, and Insights

Authors:

  • Delivers to developers of streaming applications basic and systematic knowledge about Apache Heron
  • Provides basic understanding of stream processing applications in general
  • Aims at professionals with a basic command of Java and Linux

Buy it now

Buying options

eBook USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (13 chapters)

  1. Front Matter

    Pages i-xxi
  2. Heron Fundamentals

    1. Front Matter

      Pages 1-1
    2. Stream Processing

      • Huijun Wu, Maosong Fu
      Pages 3-14
    3. Heron Basics

      • Huijun Wu, Maosong Fu
      Pages 15-31
    4. Study Heron Code

      • Huijun Wu, Maosong Fu
      Pages 33-45
  3. Write Heron Topologies

    1. Front Matter

      Pages 47-47
    2. Migrate Storm Topology to Heron

      • Huijun Wu, Maosong Fu
      Pages 49-60
    3. Write Topology Code

      • Huijun Wu, Maosong Fu
      Pages 61-79
    4. Heron Topology Features

      • Huijun Wu, Maosong Fu
      Pages 81-91
    5. Heron Streamlet API

      • Huijun Wu, Maosong Fu
      Pages 93-115
  4. Operate Heron Clusters

    1. Front Matter

      Pages 117-117
    2. Manage a Topology

      • Huijun Wu, Maosong Fu
      Pages 119-131
    3. Manage Multiple Topologies

      • Huijun Wu, Maosong Fu
      Pages 133-143
  5. Heron Insights

    1. Front Matter

      Pages 145-145
    2. Explore Heron

      • Huijun Wu, Maosong Fu
      Pages 147-169
    3. Extending the Heron Metrics Sink

      • Huijun Wu, Maosong Fu
      Pages 171-181
    4. Extending Heron Scheduler

      • Huijun Wu, Maosong Fu
      Pages 183-195
    5. Heron Is Evolving

      • Huijun Wu, Maosong Fu
      Pages 197-205
  6. Back Matter

    Pages 207-208

About this book

This book provides both a basic understanding of stream processing in general, and practical guidance for development and research with Apache Heron in particular. It delivers to developers of streaming applications basic and systematic knowledge about Heron, which is today only scattered across project documents, technique blogs and code snippets on the Web.

The book is organized in four parts: Part I describes basic knowledge about stream processing, Apache Storm, and Apache Heron (Incubating), and also introduces the Heron source repository. Part II then goes into details and describes two data models to write Heron topologies and often used topology features, including stateful processing. This part is especially targeted at software developers who write topologies using Heron APIs. Next, part III describes Heron tools, including the command-line interface and the user interface, needed to manage a single topology or multiple topologies in a data center. This part is particularlyaimed at operators who deploy and manage running jobs. Eventually, part IV describes the Heron source code and how to customize or extend Heron. This part is especially suggested for software engineers who would like to contribute code to the Heron repository and who are curious about Heron insights.

Overall, this book aims at professionals who want to process streaming data based on Apache Heron. A basic knowledge of Java and Bash commands for Linux is assumed.


Authors and Affiliations

  • Twitter (United States), San Francisco, USA

    Huijun Wu, Maosong Fu

About the authors

Huijun Wu is an engineer at Twitter, Inc. He has been working on the Heron project since the summer of 2016 when Twitter open-sourced the Heron code and is a founding member of Apache Heron (Incubating). Prior to this, he had worked for Microsoft, ARRIS, and Alcatel Lucent. He received a Ph.D. from the School of Computing Informatics and Decision Systems Engineering at Arizona State University.

Maosong Fu is the engineering manager for the Real-Time Compute Team at Twitter. Previously he was the technical lead for Heron at Twitter and had worked on various components of Heron, including Heron Instance, Metrics Manager, Heron Scheduler, etc. He is the author of several publications related to distributed systems, and has a master’s degree from Carnegie Mellon University and a bachelor’s from Huazhong University of Science and Technology.



Bibliographic Information

  • Book Title: Heron Streaming

  • Book Subtitle: Fundamentals, Applications, Operations, and Insights

  • Authors: Huijun Wu, Maosong Fu

  • DOI: https://doi.org/10.1007/978-3-030-60094-5

  • Publisher: Springer Cham

  • eBook Packages: Mathematics and Statistics, Mathematics and Statistics (R0)

  • Copyright Information: The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2021

  • Softcover ISBN: 978-3-030-60093-8Published: 20 March 2021

  • eBook ISBN: 978-3-030-60094-5Published: 19 March 2021

  • Edition Number: 1

  • Number of Pages: XXI, 208

  • Number of Illustrations: 42 b/w illustrations, 1 illustrations in colour

  • Topics: Data Mining and Knowledge Discovery, Information Storage and Retrieval, Big Data, Open Source

Buy it now

Buying options

eBook USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access