I Heart Logs
Event Data, Stream Processing, and Data Integration
Publisher: O'Reilly Media
Final Release Date: September 2014
Pages: 60

Why a book about logs? That’s easy: the humble log is an abstraction that lies at the heart of many systems, from NoSQL databases to cryptocurrencies. Even though most engineers don’t think much about them, this short book shows you why logs are worthy of your attention.

Based on his popular blog posts, LinkedIn principal engineer Jay Kreps shows you how logs work in distributed systems, and then delivers practical applications of these concepts in a variety of common uses—data integration, enterprise architecture, real-time stream processing, data system design, and abstract computing models.

Go ahead and take the plunge with logs; you’re going love them.

  • Learn how logs are used for programmatic access in databases and distributed systems
  • Discover solutions to the huge data integration problem when more data of more varieties meet more systems
  • Understand why logs are at the heart of real-time stream processing
  • Learn the role of a log in the internals of online data systems
  • Explore how Jay Kreps applies these ideas to his own work on data infrastructure systems at LinkedIn
Product Details
About the Author
Colophon
Recommended for You
Customer Reviews

REVIEW SNAPSHOT®

by PowerReviews
oreillyI Heart Logs
 
3.9

(based on 10 reviews)

Ratings Distribution

  • 5 Stars

     

    (4)

  • 4 Stars

     

    (4)

  • 3 Stars

     

    (0)

  • 2 Stars

     

    (1)

  • 1 Stars

     

    (1)

80%

of respondents would recommend this to a friend.

Pros

  • Well-written (8)
  • Easy to understand (7)
  • Concise (6)
  • Accurate (4)

Cons

No Cons

Best Uses

  • Intermediate (6)
    • Reviewer Profile:
    • Developer (7), Educator (4)

Reviewed by 10 customers

Displaying reviews 1-10

Back to top

(1 of 1 customers found this review helpful)

 
5.0

A great guide to build scalable, real time data systems

By manios

from Thessaloniki, Greece

About Me Developer

Verified Reviewer

Pros

  • Accurate
  • Concise
  • Well-written

Cons

    Best Uses

    • Intermediate

    Comments about oreilly I Heart Logs:

    I received a free copy via O'Reilly sponsoring program Java Thessaloniki Java Meetup.

    As the title explicitly informs us, this is a book about Logs! Jey Kreps makes a fast, but to the point approach about what is a Log and how can help us in our everyday lives.

    * In the first chapter, the author distills the concept of "Log" as a special data structure. We meet it in our everyday lives, as a series of informative or error messages in rotating files, as records in database tables or as the basic structural mechanism of a database system. Jay Kreps goes a step further by analysing the term Log and clarifying the reasons why it is useful for us.
    * In the second chapter, the author describes the importance of a log as a solution to the data integration problem. Every organisation stores large amounts of data in disparate systems which have to be transformed (ETL) and integrated in order to be useful and profitable. As time evolves diverse data grow dramatically and reside in specialised databases, Data Warehouse or Business Intelligence systems. That is where a Log comes to the rescue as the medium to store original, transformed or final data which will be consumed by heterogenous consumers.
    * In chapter three the author analyses how a log can fit into real time stream processing systems like Storm, Samza, by providing alternative architectures in handling data flows. As an optimisation in log retention he explains how Apache Kafka log compaction feature can reduce the amount of used disk space and network traffic.
    * Finally in chapter four he discusses building data systems in which a distributed Log plays a central role in initial/intermediary/final data retention and distribution among different "stakeholders".

    This book is full of ideas and use cases which have been applied by the author and the engineering team in LinkedIn. It also gives you a concise idea of how Apache Kafka was born and what problems it does solve.

    I would definitely recommend it to someone who wants to learn how to build scalable, realtime, distributed and fast data systems!

     
    4.0

    Interesting, but not comprehensive enough

    By syndbg

    from Sofia, Bulgaria

    About Me Developer, Educator

    Pros

    • Accurate
    • Well-written

    Cons

    • Not comprehensive enough

    Best Uses

    • Intermediate

    Comments about oreilly I Heart Logs:

    I was postponing this book for a while, but today I decided to finally read it seriously.

    I was very interested to read and understand the architecture behind Linkedin and I wasn't that disappointed. Author Jay Kreps sheds some light on their event-driven architecture.

    I haven't had the chance to develop such systems and I probably fail to understand some of the points the author made, but I think Jay Kreps should've made this in a longer 200 pages book that describes the systems architecture slower and more detailed. 1 page of text and/or sometimes 1-2 diagrams aren't enough to understand the complex systems.

    I sincerely hope this book will have a newer version that is longer and much more detailed.

    (0 of 2 customers found this review helpful)

     
    1.0

    long article, sold as a book

    By uglyhotdog

    from London, UK

    Verified Buyer

    Comments about oreilly I Heart Logs:

    There isn't anything incorrect in the article, but I'm not better off having read it.

    (1 of 1 customers found this review helpful)

     
    5.0

    The power and simplicity of the log

    By Byron

    from Philadelphia, PA

    About Me Developer, Maker

    Verified Buyer

    Pros

    • Concise
    • Easy to understand
    • Well-written

    Cons

      Best Uses

      • Intermediate

      Comments about oreilly I Heart Logs:

      This is a great introduction to power and simplicity of "the log". It will change the way you think about databases and various materialized on the data itself. If it doesn't, read the book again.

      To clarify the expectation, this is not a "how-to" book and does provide code examples or specifics on how to implement a particular log system. Although the author developed Apache Kafka, he stays relatively agnostic to its use or implementation details in the book.

      (0 of 1 customers found this review helpful)

       
      2.0

      Too short

      By The Dude

      from Tel Aviv

      Verified Buyer

      Pros

      • Concise
      • Easy to understand

      Cons

      • Not comprehensive enough
      • Too basic

      Best Uses

        Comments about oreilly I Heart Logs:

        too short

        (1 of 1 customers found this review helpful)

         
        5.0

        Excellent read!

        By mhausenblas

        from Galway, Ireland, Europe

        About Me Data Engineer

        Verified Reviewer

        Pros

        • Easy to understand
        • Well-written

        Cons

          Best Uses

          • Intermediate

          Comments about oreilly I Heart Logs:

          When Jay first talked about the Kappa architecture in http://radar.oreilly.com/2014/07/questioning-the-lambda-architecture.html I was pleased to see it but didn't quite get where he's heading with it. This book provides background, motivations and directions for the Kappa architecture and is much more than a book about logs. A must-read for every Data Engineer!

          (0 of 1 customers found this review helpful)

           
          5.0

          Very good

          By Kvantos

          from Odessa, Ukraine

          About Me Developer, Sys Admin

          Verified Buyer

          Pros

          • Easy to understand
          • Well-written

          Cons

            Best Uses

              Comments about oreilly I Heart Logs:

              This book change my mind. To say true, what shown in book is not new, but explanations help me to build new point of view.

              The stile it written is very good, so this book is easy to absorb.

              (2 of 2 customers found this review helpful)

               
              4.0

              A must read if u dabble with logs,

              By venkatesh-prasad ranganath

              from Manhattan, KS

              About Me Designer, Developer, Educator

              Verified Buyer

              Pros

              • Accurate
              • Concise
              • Easy to understand
              • Helpful examples
              • Well-written

              Cons

                Best Uses

                  Comments about oreilly I Heart Logs:

                  An interesting and informative view about log data and systemic concerns dealing with log data. Jay talks about various aspects of log data such as duality with tables, distribution, coordination of distributed sources, and data integration. He does so by appealing to his experience at LinkedIn and the new developments in the big data technology community, e.g., Storm, Lambda architecture, Samza. He also discusses stream processing and how it related to logs. Interestingly, he has a different take on the general perception of stream processing.

                  Having personally dabbled with log analysis, this was a fast (only 59 pages!!), interesting, confirmatory, and complementary read. I really enjoyed Chapter 2 (data integration) and 3 (stream processing).

                  Be warned, the book does not discuss architectures or technologies or algorithms. It is more of a holistic view about log data and processing with numerous pointers to architectures, technologies, and algorithms.

                   
                  4.0

                  If you are interested in logs, read it!

                  By Venkatesh

                  from Manhattan, KS

                  About Me Developer, Educator

                  Verified Reviewer

                  Pros

                  • Accurate
                  • Concise
                  • Easy to understand
                  • Helpful examples
                  • Well-written

                  Cons

                    Best Uses

                    • Intermediate
                    • Novice

                    Comments about oreilly I Heart Logs:

                    An interesting and informative view about log data and systemic concerns dealing with log data. Jay talks about various aspects of log data such as duality with tables, distribution, coordination of distributed sources, and data integration. He does so by appealing to his experience at LinkedIn and the new developments in the big data technology community, e.g., Storm, Lambda architecture, Samza. He also discusses stream processing and how it related to logs. Interestingly, he has a different take on the general perception of stream processing.

                    Having personally dabbled with log analysis, this was a fast (only 59 pages!!), interesting, confirmatory, and complementary read. I really enjoyed Chapter 2 (data integration) and 3 (stream processing).

                    Be warned, the book does not discuss architectures or technologies or algorithms. It is more of a holistic view about log data and processing with numerous pointers to architectures, technologies, and algorithms.

                    (4 of 4 customers found this review helpful)

                     
                    4.0

                    Good Book to learn about Logs

                    By surachart

                    from Bangkok, Thailand

                    About Me DBA, Developer, Educator, Sys Admin

                    Verified Reviewer

                    Pros

                    • Concise
                    • Easy to understand
                    • Well-written

                    Cons

                      Best Uses

                      • Intermediate
                      • Novice
                      • Student

                      Comments about oreilly I Heart Logs:

                      It need to use reference to find out more. It gave information/concept clearly from real experience.
                      It has not much for the number of pages. However, it's compact and useful for system deployment for Logs System.

                      Displaying reviews 1-10

                      Back to top

                       
                      Buy 2 Get 1 Free Free Shipping Guarantee
                      Buying Options
                      Immediate Access - Go Digital what's this?
                      Ebook:  $25.99
                      Formats:  DAISY, ePub, Mobi, PDF
                      Print & Ebook:  $32.99
                      Print:  $29.99