Skip to main content

What is XPath? A Simple Introduction to the XML Path Language

Imagine you're navigating a file system on your computer. You use a path like C:\Users\Documents\report.pdf to pinpoint a specific file. XPath (XML Path Language) works on the same principle, but instead of navigating a file system, it navigates the structure of an XML or HTML document.

XPath is a powerful query language used to select nodes (such as elements, attributes, and text) from an XML document. It is an essential technology for anyone working with structured documents, and it is a core component of XSLT (for transforming XML) and a vital tool for web scraping.

Why Do We Need XPath?​

An XML or HTML document is more than just text; it's a structured collection of data. XPath provides a standard, concise syntax to:

  • Find specific information within a document.
  • Traverse through elements and their attributes.
  • Perform calculations and string manipulations on the data.
  • Select parts of a document for processing, transformation (with XSLT), or extraction.

The Core Concepts of XPath​

To understand XPath, you need to grasp three fundamental ideas.

The Document as a Tree of Nodes​

XPath does not see an XML document as a block of text. It sees a hierarchical tree of nodes.

Consider this simple XML document:

<bookstore>
  <book category="web">
    <title>Learning XML</title>
  </book>
</bookstore>

XPath views this as a tree:

  • A root node at the very top.
  • A <bookstore> element node.
  • A <book> element node, which is a child of <bookstore>.
  • A category attribute node, which belongs to <book>.
  • A <title> element node, which is a child of <book>.
  • A text node containing "Everyday Italian", which is a child of <title>.

Path Expressions for Navigation​

XPath uses a "path-like" syntax to navigate this tree and select nodes.

  • /: Selects from the root node.
  • //: Selects nodes from anywhere in the document.
  • nodename: Selects all child nodes with that name.

Example: to select all the <title> elements inside any <book> element, you would write:

//book/title

This expression is simple, readable, and precisely selects the desired nodes from the document.

Functions and Expressions for Powerful Queries​

XPath is more than just a navigation tool. It includes over 200 built-in functions and a rich set of operators that allow you to create powerful expressions. You can filter nodes based on their content, position, and much more.

Example: to select all books whose price is greater than 30, you would write:

//book[price > 30.00]

The expression inside the square brackets [...] is a predicate that filters the node-set, keeping only the nodes that satisfy the condition.

Key Features of XPath​

  • Navigates the Document Tree: XPath understands the structure of an XML document (elements, attributes, text, etc.) and the relationships between them (parent, child, sibling).
  • Uses Path Expressions: It provides a powerful and intuitive syntax for selecting nodes or sets of nodes.
  • Integral to XSLT and Web Scraping: XPath is a core component of the XSLT standard for transforming XML and is the primary method for selecting elements in most web scraping libraries.
  • Includes a Rich Function Library: It has a large library of standard functions for manipulating strings, numbers, and booleans, and for querying nodes.
  • It's a W3C Standard: XPath is a stable and widely supported recommendation from the World Wide Web Consortium (W3C).

Table of Contents