Books & Videos

Table of Contents

  1. Chapter 1 Seeing Your Life in Data

    1. Personal Environmental Impact Report (PEIR)

    2. your.flowingdata (YFD)

    3. Personal Data Collection

    4. Data Storage

    5. Data Processing

    6. Data Visualization

    7. The Point

    8. How to Participate

  2. Chapter 2 The Beautiful People: Keeping Users in Mind When Designing Data Collection Methods

    1. Introduction: User Empathy Is the New Black

    2. The Project: Surveying Customers About a New Luxury Product

    3. Specific Challenges to Data Collection

    4. Designing Our Solution

    5. Results and Reflection

  3. Chapter 3 Embedded Image Data Processing on Mars

    1. Abstract

    2. Introduction

    3. Some Background

    4. To Pack or Not to Pack

    5. The Three Tasks

    6. Slotting the Images

    7. Passing the Image: Communication Among the Three Tasks

    8. Getting the Picture: Image Download and Processing

    9. Image Compression

    10. Downlink, or, It's All Downhill from Here

    11. Conclusion

  4. Chapter 4 Cloud Storage Design in a PNUTShell

    1. Introduction

    2. Updating Data

    3. Complex Queries

    4. Comparison with Other Systems

    5. Conclusion

    6. Acknowledgments

    7. References

  5. Chapter 5 Information Platforms and the Rise of the Data Scientist

    1. Libraries and Brains

    2. Facebook Becomes Self-Aware

    3. A Business Intelligence System

    4. The Death and Rebirth of a Data Warehouse

    5. Beyond the Data Warehouse

    6. The Cheetah and the Elephant

    7. The Unreasonable Effectiveness of Data

    8. New Tools and Applied Research

    9. MAD Skills and Cosmos

    10. Information Platforms As Dataspaces

    11. The Data Scientist

    12. Conclusion

  6. Chapter 6 The Geographic Beauty of a Photographic Archive

    1. Beauty in Data: Geograph

    2. Visualization, Beauty, and Treemaps

    3. A Geographic Perspective on Geograph Term Use

    4. Beauty in Discovery

    5. Reflection and Conclusion

    6. Acknowledgments

    7. References

  7. Chapter 7 Data Finds Data

    1. Introduction

    2. The Benefits of Just-in-Time Discovery

    3. Corruption at the Roulette Wheel

    4. Enterprise Discoverability

    5. Federated Search Ain't All That

    6. Directories: Priceless

    7. Relevance: What Matters and to Whom?

    8. Components and Special Considerations

    9. Privacy Considerations

    10. Conclusion

  8. Chapter 8 Portable Data in Real Time

    1. Introduction

    2. The State of the Art

    3. Social Data Normalization

    4. Conclusion: Mediation via Gnip

  9. Chapter 9 Surfacing the Deep Web

    1. What Is the Deep Web?

    2. Alternatives to Offering Deep-Web Access

    3. Conclusion and Future Work

    4. References

  10. Chapter 10 Building Radiohead's House of Cards

    1. How It All Started

    2. The Data Capture Equipment

    3. The Advantages of Two Data Capture Systems

    4. The Data

    5. Capturing the Data, aka "The Shoot"

    6. Processing the Data

    7. Post-Processing the Data

    8. Launching the Video

    9. Conclusion

  11. Chapter 11 Visualizing Urban Data

    1. Introduction

    2. Background

    3. Cracking the Nut

    4. Making It Public

    5. Revisiting

    6. Conclusion

  12. Chapter 12 The Design of Sense.us

    1. Visualization and Social Data Analysis

    2. Data

    3. Visualization

    4. Collaboration

    5. Voyagers and Voyeurs

    6. Conclusion

    7. References

  13. Chapter 13 What Data Doesn't Do

    1. When Doesn't Data Drive?

    2. Conclusion

    3. References

  14. Chapter 14 Natural Language Corpus Data

    1. Word Segmentation

    2. Secret Codes

    3. Spelling Correction

    4. Other Tasks

    5. Discussion and Conclusion

    6. Acknowledgments

  15. Chapter 15 Life in Data: The Story of DNA

    1. DNA As a Data Store

    2. DNA As a Data Source

    3. Fighting the Data Deluge

    4. The Future of DNA

    5. Acknowledgments

  16. Chapter 16 Beautifying Data in the Real World

    1. The Problem with Real Data

    2. Providing the Raw Data Back to the Notebook

    3. Validating Crowdsourced Data

    4. Representing the Data Online

    5. Closing the Loop: Visualizations to Suggest New Experiments

    6. Building a Data Web from Open Data and Free Services

    7. Acknowledgments

    8. References

  17. Chapter 17 Superficial Data Analysis: Exploring Millions of Social Stereotypes

    1. Introduction

    2. Preprocessing the Data

    3. Exploring the Data

    4. Age, Attractiveness, and Gender

    5. Looking at Tags

    6. Which Words Are Gendered?

    7. Clustering

    8. Conclusion

    9. Acknowledgments

    10. References

  18. Chapter 18 Bay Area Blues: The Effect of the Housing Crisis

    1. Introduction

    2. How Did We Get the Data?

    3. Geocoding

    4. Data Checking

    5. Analysis

    6. The Influence of Inflation

    7. The Rich Get Richer and the Poor Get Poorer

    8. Geographic Differences

    9. Census Information

    10. Exploring San Francisco

    11. Conclusion

    12. References

  19. Chapter 19 Beautiful Political Data

    1. Example 1: Redistricting and Partisan Bias

    2. Example 2: Time Series of Estimates

    3. Example 3: Age and Voting

    4. Example 4: Public Opinion and Senate Voting on Supreme Court Nominees

    5. Example 5: Localized Partisanship in Pennsylvania

    6. Conclusion

    7. References

  20. Chapter 20 Connecting Data

    1. What Public Data Is There, Really?

    2. The Possibilities of Connected Data

    3. Within Companies

    4. Impediments to Connecting Data

    5. Possible Solutions

    6. Conclusion

  1. Appendix Contributors

  2. COLOPHON