tag, if the del looks like (DEL_START,
'Text
', DEL_END)iR; s ']
>>> doc = ['
', 'Text', '
', '', 'More Text', '
']
>>> pre, post = doc[:3], doc[3:]
>>> pre, post
(['', 'Text', '
'], ['', 'More Text', '
'])
>>> locate_unbalanced_start(unbalanced_start, pre, post)
>>> pre, post
(['', 'Text', '
', ''], ['More Text', '
'])
As you can see, we moved the point so that the dangling that
we found will be effectively replaced by the div in the original
document. If this doesn't work out, we just throw away
unbalanced_start without doing anything.
i s <>Rl i Rm t inst dels Unexpected delete tag: %rN( Ro R R_ Rn R1 Rq R: ( R\ Rj Rk t findingt finding_namet nextRx ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRg f s*
c C s x | p Pn | d } | i d i d } | p Pn | d } | t j p | i d o Pn | i d i d } | d j p
| d j o Pn | | j o$ | i | i d | i q Pq d S( st like locate_unbalanced_start, except handling end tags and
possibly moving the point earlier in the document. ii s <>/s c B s8 e Z d Z e Z d d e d Z d Z d Z RS( s8 Represents a diffable token, generally a word that is displayed to
the user. Opening tags are attached to this token when they are
adjacent (pre_tags) and closing tags that follow the word
(post_tags). Some exceptions occur when there are empty tags
adjacent to a word, so there may be close tags in pre_tags, or
open tags in post_tags.
We also keep track of whether the word was originally followed by
whitespace, even though we do not want to treat the word as
equivalent to a similar word that does not have a trailing
space.c C se t i | | } | d j o
| | _ n
g | _ | d j o
| | _ n
g | _ | | _ | S( N( R t __new__Rr R8 R7 R< ( t clsR R8 R7 R< t obj( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
c C s d t i | | i | i f S( Ns token(%s, %r, %r)( R t __repr__R8 R7 ( t self( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s
t | S( N( R ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRA s N( R` Ra Rd R RX Rr R R RA ( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR> s
t tag_tokenc B s2 e Z d Z d d e d Z d Z d Z RS( s Represents a token that is actually a tag. Currently this is just
the ![]()
tag, which takes up visible space just like a word but
is only represented in a document by a tag. c C sM t i | d t | f d | d | d | } | | _ | | _ | | _ | S( Ns %s: %sR8 R7 R< ( R> R R= Rz t datat html_repr( R Rz R R R8 R7 R< R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s, d | i | i | i | i | i | i f S( NsR tag_token(%s, %s, html_repr=%s, post_tags=%r, pre_tags=%r, trailing_whitespace=%s)( Rz R R R8 R7 R< ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s | i S( N( R ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRA s N( R` Ra Rd Rr R R R RA ( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
t
href_tokenc B s e Z d Z e Z d Z RS( sh Represents the href in an anchor tag. Unlike other words, we only
show the href when it changes. c C s d | S( Ns Link: %s( ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRA s ( R` Ra Rd RP RX RA ( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C sN t i | o
| } n t | d t } t | d t d | } t | S( sk
Parse the given HTML and returns token objects (words with attached tags).
This parses only the content of a page; anything in the head is
ignored, and the and elements are themselves
optional. The content is then parsed by lxml, which ensures the
validity of the resulting parsed document (though lxml may make
incorrect guesses when the markup is particular bad).
and tags are also eliminated from the document, as
that gets confusing.
If include_hrefs is true, then the href attribute of tags is
included as a special kind of diffable token.t cleanupt skip_tagR ( R t iselementt
parse_htmlRP t
flatten_elt fixup_chunks( RA R t body_elRi ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
c C s' | o t | } n t | d t S( s
Parses an HTML fragment, returning an lxml element. Note that the HTML will be
wrapped in a
tag that was not in the original document.
If cleanup is true, make sure there's no or , and get
rid of any and tags.
t
create_parent( t cleanup_htmlR RP ( RA R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s s s
s c C sj t i | } | o | | i } n t i | } | o | | i } n t i d | } | S( s This 'cleans' the HTML, meaning that any page structure is removed
(only the contents of are used, if there is any and tags are removed. R ( t _body_ret searchRt t _end_body_reRs t _ins_del_ret sub( RA t match( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR ) s s
[ \t\n\r]$c C s* g } d
} g } x| D]} t | t o | d d j ov | d } | d } | i d o | d } t } n t } t d | d | d | d | } g } | i | q | d d
j o9 | d } t | d | d t } g } | i | q q n t | oY | i d o | d } t } n t } t
| d | d | } g } | i | q t | o | i | q t | oM | o | i | q| p t
d | | | | f | i i | q d p t
q W| p t
d d | g S| d i i | | S( sM
This function takes a list of chunks and produces a list of tokens.
i t imgi i R; iR R8 R< t hrefs4 Weird state, cur_word=%r, result=%r, chunks=%r of %rR N( Rr t
isinstancet tupleRZ RP R R R: R t is_wordR> t is_start_tagt
is_end_tagR1 R7 RN ( Ri t tag_accumt cur_wordR Rv R3 Rz R< R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR 9 s\
t paramR t areat brt basefontt inputt baset metat linkt colt addresst
blockquotet centert dirt divt dlt fieldsett formt h1t h2t h3t h4t h5t h6t hrt isindext menut noframest noscriptt olt pRC t tablet ult ddt dtt framesett lit tbodyt tdt tfoott tht theadt trc c sg | p> | i d j o d | i d t | f VqE t | Vn | i t j o) | i o t | o | i o d St | i } x | D] } t i | Vq Wx0 | D]( } x t
| d | D] } | Vq Wq W| i d j o0 | i i d o | o d | i d f Vn | p= t | Vt | i } x | D] } t i | VqGWn d S( s Takes an lxml element el, and generates all the text chunks for
that tag. Each start tag is a chunk, each word is a chunk, and each
end tag is a chunk.
If skip_tag is true, then the outermost container tag is
not returned (just its contents).R R3 NR R R (
Rz t attribt start_tagRp R R0 t tailt split_wordsR R R t gett end_tag( t elR R t start_wordst wordt childt itemt end_words( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s. 4
* c C sv | p | i o g Sg } | i i D] } | | d q2 ~ } t i | p | d d | d R s %s="%s"( Rz R R t itemsR R RP ( R R Rx t value( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s> | i o t i | i o
d } n d } d | i | f S( sg The text representation of an end tag for a tag. Includes
trailing whitespace when appropriate. R; R s %s( R t start_whitespace_reR Rz ( R t extra( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
c C s | i d S( NRl ( Rn ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s
| i d S( Ns or tags inside of any
block-level elements, e.g. transform , etc.
( Rz t block_level_tagst block_level_container_tagsRP R R ( R R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
c C sj xq | D] } t | o Pq q Wd d k } t i | } | i | _ d | _ | i t | | g | (d Sx t | D] } t | o` t | | | i oE t i | } | i | _ d | _ | i
| i | d | q q t i | } | i | | | i
| q W| i o8 t i | } | i | _ d | _ | i
d | n d S( st helper for _fixup_ins_del_tags; actually takes the etc tags
and moves them inside any block-level tags. iNi i ( R t sysR t ElementR Rr RN t listR R RK R} RL R: ( R Rz R R t children_tagt tail_tagt child_tagt text_tag( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s8
%
c C s7 | i } | i p d } | i oZ t | p | | i 7} q | d i o | d i | i 7_ q | i | d _ n | i | } | o | d j o
d } n | | d } | d j o* | i o | i | 7_ q| | _ q | i o | i | 7_ q | | _ n | i | | | d +d S( s
Removes an element, but merges its contents into its place, e.g.,
given s
(
& ' ( 2 (
<
! "
word
toword
R t skip_outer( R R t _fixup_ins_del_tagst serialize_html_fragmentRP ( RA R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRF s c C s~ t | t p t d | t i | d d d t } | o5 | | i d d } | | i d } | i S| Sd S( s Serialize a single lxml element as HTML. The serialized form includes the elements tail. If skip_outer is true, then don't serialize the outermost tag s3 You should pass in an element, not a string like %rt methodRA t encodingt >i Rl N( R R R1 R t tostringR t findt rfindR ( R R RA ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C sg x` d d g D]R } xI | i d | D]4 } t | p q' n t | d | | i q' Wq Wd S( s? fixup_ins_del_tags that works on an lxml document in-place R R s descendant-or-self::%sRz N( t xpatht _contains_block_level_tagt _move_el_inside_blockt drop_tag( R Rz R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C sL | i t j p | i t j o t Sx | D] } t | o t Sq, Wt S( sP True if the element contains any block-level elements, like,
Hi there!
, if you remove the element you getHi there!
R ii i N( t getparentR R R0 R} Rr t getchildren( R t parentR R} t previous( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyt _merge_element_contents4 s* R" c B s e Z d Z d Z d Z RS( st Acts like SequenceMatcher, but tries not to find very small equal blocks amidst large spans of changes i c C s t t | i t | i } t | i | d } t i i | } g } | D]. } | d | j p | d o | | qT qT ~ S( Ni i ( t minR0 R t thresholdt difflibt SequenceMatchert get_matching_blocks( R t sizeR t actualR R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR ^ s !( R` Ra Rd R R ( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR" V s t __main__( t _diffcommand( ( ( R s imgR R R s inputs baseR s linkR ( R R s centers dirR R R R R R R R R R R R R R R R R s preR R ( R R R R R R R R R R (K R t lxmlR t lxml.htmlR R t ret __all__t unicodeR t NameErrort strt __builtins__R t KeyErrorR R R R R$ R R9 R R RE R RO RQ R_ Rb t ExceptionRc RR RS RY Rf Rg Rh R> R R RP R R t compilet It SR R R R R R Rp R R R R R R R R R R RF R R R R R R R" R` R t main( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyt