A comprehensive, self-contained guide to Beautiful Soup (the beautifulsoup4 / bs4 package) — Python's friendliest library for parsing HTML and XML…

Welcome to Beautiful Soup: Parsing HTML and XML with Python.

A comprehensive, self-contained guide to Beautiful Soup (the beautifulsoup4 / bs4 package) — Python's friendliest library for parsing HTML and XML and pulling data out of it. Where Scrapy is a whole framework for crawling thousands of pages, Beautiful Soup is a focused library for the other 90% of the time: you have some HTML — a page you fetched, a file, an API response — and you need to navigate it, search it, and extract the data, even when the markup is messy or broken. This book teaches it end to end — the parse tree, parsers, the four object types, navigating and searching, CSS selectors, extracting and modifying, real-world patterns, robustness, and where it fits the ecosystem — blending intuition, the concepts behind the library, and runnable code.

This title is part of the ShriIra library and is free to read in full, right here — our small contribution to making world-class knowledge easy to reach.

A note on reading it: open the Contents menu at the top of the reader to jump between chapters, use the Aa menu to set a comfortable text size, theme (light, sepia, or night), and single- or two-page layout. Your place is saved automatically, so you can always pick up where you left off.

We hope it serves you well.

— Shriira Press

Contents

1. Chapter 1 — What Is Beautiful Soup?
2. Chapter 2 — HTML, the Parse Tree, and Parsers
3. Chapter 3 — Making Soup: Your First Parse
4. Chapter 4 — The Four Objects: Tag, NavigableString, BeautifulSoup, Comment
5. Chapter 5 — Navigating the Tree
6. Chapter 6 — Searching the Tree: find and find_all
7. Chapter 7 — CSS Selectors with select()
8. Chapter 8 — Extracting Text and Attributes
9. Chapter 9 — Modifying the Tree
10. Chapter 10 — Real-World Parsing Patterns
11. Chapter 11 — Robustness and Common Pitfalls
12. Chapter 12 — Beautiful Soup vs. the Ecosystem
13. Chapter 13 — In Practice and the Profession
14. Appendix A — Glossary and Quick Reference
15. Appendix B — Further Reading and Resources