refactor(html)!: html module rewrite - #51

Merged

James-LG merged 167 commits into

May 3, 2026

Commits on Jul 10, 2024

refactor(html)!: Rewrite html module
James-LG
committed
5f61a37

Commits on Jul 15, 2024

feat(html): First few insertion modes
James-LG
committed
c1aec34

Commits on Jul 18, 2024

feat(html): Parser first pass
James-LG
committed
eba64cd

Commits on Jul 19, 2024

fix(html): Distinguish start and end tags
James-LG
committed
cf049dd

Commits on Jul 20, 2024

fix(html): Fix first pass
James-LG
committed
8987c13
feat(html): First test passing!
James-LG
committed
9a8a32a
test(html): Create html_basic_tests
James-LG
committed
929c738

Commits on Jul 21, 2024

fix(html): Second test passing
James-LG
committed
d18f64c

Commits on Jul 28, 2024

feat(html): Support character references
James-LG
committed
ce79b5a

Commits on Aug 2, 2024

feat(html): Handle attributes
James-LG
committed
be58f1e

Commits on Aug 4, 2024

Commits on Aug 5, 2024

fix: Tracked down intermittent error caused by Hash collision in IndexSet
James-LG
committed
6b55d3e

Commits on Aug 7, 2024

fix(html): Fix bug in before_html_insertion_mode
James-LG
committed
ad9e333

Commits on Aug 11, 2024

feat(html): Implement scripts and comments
James-LG
committed
7e138fe

Commits on Sep 1, 2024

feat(html): Implement RCData tokenizer states
James-LG
committed
99cb51c

Commits on Sep 2, 2024

feat(html): Lots of in body insertion mode cases
James-LG
committed
2752ee6

Commits on Sep 8, 2024

feat(html): GitHub sample parses
James-LG
committed
b483c61

Commits on Sep 9, 2024

feat(html): Doctype implementations and devcontainer updates
James-LG
committed
3f2a68e

Commits on Nov 10, 2024

fix: Fix misnesting issue in script tags
James-LG
committed
08ad632

Commits on Dec 7, 2024

fix: using_the_rules_for does not temporarily change the insertion mode
James-LG
committed
56cd170

Commits on Feb 26, 2026

chore: Add CLAUDE.md
James-LG
committed
ea3be15
fix(html): Fix some bugs and create Raw display mode
James-LG
committed
0c415be
fix: Complete asserts for html_large_tests
James-LG
committed
b21fc7a
fix: All tests passing
James-LG
committed
6adaea1
chore: Features backlog
James-LG
committed
7c6f87b
feat: Complete remaining todods
James-LG
committed
157f29a
feat: Foster parenting algorithm
James-LG
committed
c66405f
feat: InHeadNoscript Insertion Mode
James-LG
committed
c2e1a1c
feat: Complete Table Insertion Mode Suite
James-LG
committed
5b84bfd
feat: InSelect & InSelectInTable Insertion Modes
James-LG
committed
e68dab6
feat: Frameset Insertion Modes
James-LG
committed
ce0ac46
feat: BeforeHtml Insertion Mode
James-LG
committed
50b68c1
feat: BeforeHead Insertion Mode
James-LG
committed
32aa752
feat: InHead insertion mode
James-LG
committed
ace60e6
feat: AfterHead insertion mode
James-LG
committed
7932da1
fix: Remove shadow root conditional
James-LG
committed
6d73cdd
feat: InBody NULL character handling (parse error, ignore)

James-LG
and
claude
committed
eb7b4a5
feat: InBody DOCTYPE handling (parse error, ignore)

James-LG
and
claude
committed
76016a5
feat: InBody frameset start tag handling

James-LG
and
claude
committed
94e0f60
feat: InBody pre/listing start tags and skip-next-LF mechanism

James-LG
and
claude
committed
88484af
feat: InBody dd/dt start tag handling

James-LG
and
claude
committed
d0e547b
feat: InBody plaintext start tag handling

James-LG
and
claude
committed
fabb26b
feat: InBody dd/dt end tag handling

James-LG
and
claude
committed
136a14c
feat: InBody sarcasm end tag handling

James-LG
and
claude
committed
7a8d248
feat: InBody nobr start tag handling

James-LG
and
claude
committed
886c118
feat: InBody applet/marquee/object start and end tags

James-LG
and
claude
committed
d534b09
feat: InBody param/source/track, hr, image, xmp, iframe, noembed/noscript

James-LG
and
claude
committed
2851cae
feat: InBody rb/rtc, rp/rt, math, and table-related start tags

James-LG
and
claude
committed
271d064
feat: XPath or and and logical operator evaluation

James-LG
and
claude
committed
33ec2d5
feat: XPath value comparisons and node comparisons

James-LG
and
claude
committed
449afc1
feat: XPath arithmetic expression evaluation (+, -, *, div, idiv, mod, unary)

James-LG
and
claude
committed
6ac2e7a
feat: XPath string concatenation operator (||)

James-LG
and
claude
committed
e8eb622
feat: XPath for-expression evaluation and variable references

James-LG
and
claude
committed
b2cf27f
feat: XPath let-expression evaluation

James-LG
and
claude
committed
6bb4750
feat: XPath quantified expression evaluation (some/every ... satisfies)

James-LG
and
claude
committed
a77f9dd
feat: XPath if-expression evaluation (if/then/else)

James-LG
and
claude
committed
fe84e2e

Commits on Feb 27, 2026

feat: XPath arrow operator evaluation (=>)

James-LG
and
claude
committed
7029cc1
feat: XPath simple map operator evaluation (!)

James-LG
and
claude
committed
061e4ee
feat: XPath range operator evaluation (to)

James-LG
and
claude
committed
27d0cd6
feat: XPath union, intersect, and except operator evaluation

James-LG
and
claude
committed
ad687c7
feat: XPath instance-of operator evaluation

James-LG
and
claude
committed
592f07a
feat: XPath cast-as and castable-as operator evaluation

James-LG
and
claude
committed
71b466c
feat: XPath postfix expression predicate evaluation

James-LG
and
claude
committed
ff99596
feat: XPath forward and reverse axis evaluation

James-LG
and
claude
committed
40c7376
feat: fn:data/fn:string for PI and comment nodes, comment() kind test

James-LG
and
claude
committed
2128a5e
feat: function item expressions (named refs, inline functions)

James-LG
and
claude
committed
e60267d
feat: XPath map constructor evaluation and map-as-function calling

James-LG
and
claude
committed
6be36d5
feat: XPath array constructor evaluation (square and curly)

James-LG
and
claude
committed
e2211c5
feat: XPath unary and postfix lookup operators (?key)

James-LG
and
claude
committed
35b1ef1
feat: URI-qualified function names and unified dispatch

James-LG
and
claude
committed
ff6f224
feat: XPath name test and wildcard evaluation for node tests

James-LG
and
claude
committed
dce68d7
feat: XPath kind test evaluation, attribute matching, and display formatting

James-LG
and
claude
committed
353e4d3
feat: XPath sequence type matching with occurrence indicators

James-LG
and
claude
committed
621df99
feat: XPath partial function application via argument placeholders

James-LG
and
claude
committed
b41879a
chore: Context and clear features backlog
James-LG
committed
8e07b6d
chore: New features backlog
James-LG
committed
2881696
feat(html): implement text insertion mode EOF handling per WHATWG 13.2.6.4.8

James-LG
and
claude
committed
391e150
feat(html): implement comment/doctype handling in after-body insertion modes

James-LG
and
claude
committed
a0bdda5
feat(xpath): support VarRef and ParenthesizedExpr arrow function specifiers

James-LG
and
claude
committed
4ff6e76
feat(xpath): support URI-qualified type names in cast/castable expressions

James-LG
and
claude
committed
5bf0525
docs: mark cast as URI-qualified type names as done in backlog

James-LG
and
claude
committed
666c396
refactor(xpath): remove stale sorting TODO in apply()

James-LG
and
claude
committed
c2195bc
docs: mark item sorting as done in backlog

James-LG
and
claude
committed
4ddb376
fix(xpath): remove stale TODO for parent:: on attributes, add test

James-LG
and
claude
committed
1fe2fda
feat(xpath): implement 30+ built-in functions across all categories

James-LG
and
claude
committed
253e2de
docs: update backlog with 30+ newly implemented functions

James-LG
and
claude
committed
90236a5
feat(xpath): implement regex string, sequence, and aggregate built-in functions

James-LG
and
claude
committed
793902a
docs: update backlog with 13 newly implemented functions

James-LG
and
claude
committed
a77af36
feat(xpath): implement numeric, string, and sequence built-in functions

James-LG
and
claude
committed
7ae7c27
docs: update backlog with 14 newly implemented functions

James-LG
and
claude
committed
f8b7937
feat(xpath): implement node, accessor, and higher-order built-in functions

James-LG
and
claude
committed
6b28fbd
docs: update backlog with 18 newly implemented functions

James-LG
and
claude
committed
d94dab6
feat(xpath): implement map, array, and math namespace functions

James-LG
and
claude
committed
01eb565
docs: update backlog with 42 newly implemented map/array/math functions

James-LG
and
claude
committed
a6e654b
feat(xpath): implement format-number, normalize-unicode, innermost, outermost, base-uri, document-uri

James-LG
and
claude
committed
c48558d
docs: update backlog with 6 newly implemented fn: functions

James-LG
and
claude
committed
b6486a1
fix(xpath): improve error handling, add fn:error/fn:trace, rename is_root_level

James-LG
and
claude
committed
5dd9d44
docs: update backlog to reflect iteration 12 completions

James-LG
and
claude
committed
027c977
feat(xpath): implement PINode data model, document-node(element-test), and PI kind test matching

James-LG
and
claude
committed
9cfddc7
feat(html): implement HTML fragment parsing algorithm (WHATWG 13.4)

James-LG
and
claude
committed
75ec62d
feat(html): implement foreign content attribute adjustments (WHATWG 13.2.6.1–3)

James-LG
and
claude
committed
ec7e724
fix(html): add missing early return in CDATA section state transition

James-LG
and
claude
committed
14286bf
feat(html): implement SVG element name case correction (WHATWG 13.2.6.5)

James-LG
and
claude
committed
dcfdd4d
feat(html): implement foreign content parsing mode (WHATWG 13.2.6.5)

James-LG
and
claude
committed
e744078
feat(html): implement foreign attribute namespace assignment (WHATWG 13.2.6.3)

James-LG
and
claude
committed
2674478
fix(html): implement adoption agency algorithm Step 4.6 scope check (WHATWG)

James-LG
and
claude
committed
7b400f9
feat(html): implement duplicate attribute deduplication (WHATWG 13.2.5.34)

James-LG
and
claude
committed
a7220f1
feat(xpath): implement typed function/map/array test runtime validation

James-LG
and
claude
committed
f442b29

Commits on Feb 28, 2026

feat(xpath): Static function calls
James-LG
committed
3303742
feat(html): implement quirks mode determination and fix tokenizer bugs
James-LG
committed
2354463
fix(xpath): implement CommentNode string value and parent navigation
James-LG
committed
b11d92b
fix(xpath): instance of and treat as bugs
James-LG
committed
55b902d
fix(xpath): func_data func_string error propagation
James-LG
committed
63cfa6d
fix(xpath): DoctypeNode correctness
James-LG
committed
a05c6ce
fix(xpath): HtmlNode fixes
James-LG
committed
1729cc9
fix(xpath): Name tests
James-LG
committed
4bea1b9
feat(xpath): fn:function_lookup
James-LG
committed
ed3a8b1
chore: Add lxml tests
James-LG
committed
5377c1d
chore: More lxml tests
James-LG
committed
b968b16
fix(xpath): ElementNode::text
James-LG
committed
06b1e7f
fix(xpath): general_comp
James-LG
committed
b0f454c
fix(xpath): AxisStep::eval
James-LG
committed
d57193e
fix(xpath): NameTest:eval
James-LG
committed
8efc63e
fix: lxml tests
James-LG
committed
34d1049

Commits on Mar 2, 2026

fix: string(@class)
James-LG
committed
a5aa9f6
fix: Final cleanup
James-LG
committed
4fbd7c4
fix: GitHub action
James-LG
committed
445d0d4
perf: Optimizations
James-LG
committed
c454b96
refactor: ValueComp
James-LG
committed
a6ead57
perf: More optimizations
James-LG
committed
2b57f88
perf: Even more optimizations
James-LG
committed
7305973
perf: Optimus Prime
James-LG
committed
a2493a2
perf: Batch character insertion
James-LG
committed
253a239
perf: Tag character improvements
James-LG
committed
75849c5
perf: Incremental Hash lookup
James-LG
committed
0dada4a
perf: HashSet duplicate attribute set
James-LG
committed
3f79564
perf: Lots of html parsing improvements
James-LG
committed
ab10e3a
perf: XPath evaluation 10-25x faster for // queries

James-LG
and
claude
committed
9fd723b

Commits on Mar 3, 2026

perf: Optimize predicate evaluation with constant position fast path

James-LG
and
claude
committed
4ea423c
chore: Docs
James-LG
committed
2b895c6

Commits on Mar 4, 2026

fix: Regression tests and fixes
James-LG
committed
e1e45ac

Commits on Mar 6, 2026

fix: Regression tests
James-LG
committed
9ae472a
fix: Feedback
James-LG
committed
8b426d6
fix: Feedback
James-LG
committed
5d8449e
fix: Feedback
James-LG
committed
62c010b
fix: Feedback
James-LG
committed
15c6c85
fix: Address 14 accepted code review findings

James-LG
and
claude
committed
7cb856c

Commits on Mar 8, 2026

fix: Address 14 accepted code review findings with regression tests

James-LG
and
claude
committed
bd5dd74
fix: Address 3 accepted code review findings with regression tests

James-LG
and
claude
committed
2c42a2c
fix: Address 14 accepted code review findings with regression tests

James-LG
and
claude
committed
55c4001
fix: Address 3 accepted code review findings with regression tests

James-LG
and
claude
committed
a2bc99d

Commits on Mar 10, 2026

fix: Address 9 accepted code review findings with regression tests

James-LG
and
claude
committed
e863ce9

Commits on Mar 15, 2026

fix: Address 5 accepted code review findings with regression tests

James-LG
and
claude
committed
a9dbcf5
fix: Address 12 accepted code review findings with regression tests

James-LG
and
claude
committed
e28b013

Commits on Mar 16, 2026

fix: Address 13 accepted code review findings with regression tests

James-LG
and
claude
committed
044484b
fix: Address 24 accepted code review findings with regression tests

James-LG
and
claude
committed
5527290
fix: Address 20 accepted code review findings with regression tests

James-LG
and
claude
committed
bbf561d

Commits on Mar 17, 2026

fix: Address 15 accepted code review findings with regression tests

James-LG
and
claude
committed
c939da8
fix: Address 17 accepted code review findings with regression tests

James-LG
and
claude
committed
2cab40e

Commits on Apr 3, 2026

fix: Address 9 accepted code review findings

James-LG
and
claude
committed
ffdbeae
fix: Address 11 accepted code review findings with regression tests

James-LG
and
claude
committed
c7e5b07

Commits on Apr 8, 2026

fix: Resolve remaining TODO comments across codebase

James-LG
and
claude
committed
6c959be

Commits on May 3, 2026

docs: Update README to reflect current XPath feature coverage

James-LG
and
claude
committed
95d0be8