TJc @ s d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z y d d k
l Z Wn# e j
o d d k l Z n Xd d k
Z
d d k l Z d d k l Z d d k l Z l Z l Z d d k l Z d e f d YZ d e f d
YZ d e f d YZ d
e f d YZ d e f d YZ d e f d YZ d e f d YZ d e f d YZ d S( iN( t StringIO( t Command( t log( t registryt merge_resourcest _JavascriptFileIter( t
OrderedSett archive_tw_resourcesc B sw e Z d Z d Z d d d d d! d" d# g Z d g Z e Z d Z d Z
d Z d Z d Z
d Z RS($ s
Setuptools command to copy and optionally compress all static resources
from a series of distributions and their dependencies into a directory
where they can be served by a fast web server.
To enable compression of CSS and JS files you will need to have installed a
Java Runtime Environment and YUICompressor
(http://www.julienlecomte.net/yuicompressor)
In order for resources from widget eggs to be properly collected these
need to have a 'toscawidgets.widgets' 'widgets' entry-point which points
to a module which, when imported, instantiates all needed JS and CSS Links.
The result is laid out in the output directory in such a way that when
a a web server such as Apache or Nginx is configured to map URLS that
begin with /toscawidgets to that directory static files will be served
from there bypassing python completely.
To integrate this command into your build process you can add these lines
to ``setup.cfg``::
[archive_tw_resources]
output = /home/someuser/public_html/toscawidgets/
compresslevel = 2
distributions = MyProject
yuicompressor = /home/someuser/bin/yuicompressor.jar
onepass = true
[aliases]
deploy = archive_tw_resources --force install
This way you can run::
$ python setup.py deploy
To install a new version of your app and copy/compress resources.
s] Copies ToscaWidgets static resources into a directory where a fast web-server can serve them.s output=t os9 Output directory. If it doesn't exist it will be created.t forcet fs+ If output dir exists, it will be ovewrittent onepasss If given, yuicompressor will only be called once for each kind of file with a all files together and then separated back into smaller filess compresslevel=t csg Compression level: 0) for no compression (default). 1) for js-minification. 2) for js & css compressions yuicompressor=s Name of the yuicompressor jar.s distributions=t ds List of widget dists. to include resources from (dependencies will be handled recursively). Note that these distributions need to define a 'toscawidgets.widgets' 'widgets' entrypoint pointing to a a module where resources are located.t requireoncet rs; Surround the gathered Javascript with a require_once-guard.s .svnc C sC d | _ t | _ t | _ d | _ g | _ d | _ t | _ d S( Nt i s yuicompressor.jar( t outputt FalseR R t
compresslevelt
distributionst
yuicompressorR ( t self( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt initialize_optionsc s c C sU | i d | i d | i d t | i | _ t i i | i | _ d S( NR R R ( t
ensure_stringt ensure_string_listt intR t ost patht abspathR ( R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt finalize_optionsm s
c C s | i p t i d IJd S| i p t i d IJd St i i | i o( | i o t i d | i d IJd S| i d j o0 t i i | i o t i d | i IJd St
i | _ } | i
t i | f d | | i d j o6 | i o t | | | _ q>t | | | _ n t | | | _ | i
| i t d | i i t i i | i o' | i
t i | i f d | i n | i
t i | i f d
t i i | i t i i d } | i
t i | | f d | d S(
Ns# Need to specify an output directorys) Need to specify at least one distributions Destination dir %s exists. s Use -f to ovewritei s Could not find YUICompressor at s Creating temp dir %ss Extracting resourcess Deleting old output dir %ss Creating output dirt /s Moving build to %s( R t syst stderrR R R t existsR R R t tempfilet mktempt tempdirt executet makedirsR t OnePassCompressingWritert writert CompressingWritert
FileWritert _copy_resourcest tuplet finalizet shutilt rmtreet joinR t prefixt stript move( R R% t
final_dest( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt runt s<
!'
$c C s yp g } t i | i D] } | | i q ~ } t | i | t i | d d } | i d | i Wn& t j
o } | i d | n Xd S( Ns toscawidgets.widgetst widgetss Loaded %ss %s has no widgets entrypoint(
t
pkg_resourcest get_distributiont requirest project_namet mapt
_load_widgetst load_entry_pointt announcet __name__t ImportError( R t distributiont _[1]R R: t modt e( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR= s , c C s t | i | i xu t D]m \ } } t d | i d } | d } d i | d } | i | i | | f d | | i
i f q Wd S( NR i i s Copying %s recursively into %s( R< R= R R t filtert Nonet splitR1 R& t _copy_resource_treeR) t base( R t webdirt dirnamet partst modnamet fname( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR, s
c C s? yxt i | | D]} | | i j o q n d i | | f } d i | | f } t i | | o$ | i | i | | f d | q t i | | } t i | \ } } d } | i o# | d j o t i
| | } n t i | | } d i | | f }
| i | i i | |
f d |
| d j o t i i | i |
}
t |
} t i } t | d }
|
i t i | |
i | i |
i t i | |
i t i | |
n | i q WWnL t j
o@ } | i t i j o$ | i d t! | | | f q;n Xd S( NR s Recursing into s application/javascripts Processing t ws Could not copy %s(" R8 t resource_listdirt
IGNORED_NAMESR1 t resource_isdirR& RI t resource_filenamet mimetypest
guess_typeRG R R t _marker_namet resource_streamR) t
write_fileR R R% t openR# R$ t writet START_TEMPLATEt readt END_TEMPLATEt closet renamet OSErrort errnot ENOENTt warnt repr( R RN RO t namet rel_namet full_namet ctt _t require_oncet streamt filenamet inft outnamet outfRE ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyRI sB
( s output=R s9 Output directory. If it doesn't exist it will be created.( s forceR
s+ If output dir exists, it will be ovewrittenN( s onepassNs If given, yuicompressor will only be called once for each kind of file with a all files together and then separated back into smaller files( s compresslevel=R sg Compression level: 0) for no compression (default). 1) for js-minification. 2) for js & css compression( s yuicompressor=Ns Name of the yuicompressor jar.( s distributions=R
s List of widget dists. to include resources from (dependencies will be handled recursively). Note that these distributions need to define a 'toscawidgets.widgets' 'widgets' entrypoint pointing to a a module where resources are located.( s requireonceR s; Surround the gathered Javascript with a require_once-guard.( R@ t
__module__t __doc__t descriptionRG t user_optionsRR t objectt
NO_VARIANTR R R6 R= R, RI ( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR s* &
% t ResourceAggregatorc B s\ e Z d Z d Z e e d Z d Z d Z d Z d Z d Z
d Z RS( st
The aggregation of files is delegated to instances of this class.
That allows for pre/postprocessing.
c C sU | i } | d j o t i t | S| d j o t i t | St d d S( Nt jst csss- Unknown resource kind, must be 'js' or 'css'.( t kindRu t __new__t JSResourceAggregatort CSSResourceAggregatort Exception( t clst commandRm Rz ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR{ s
c C sQ | | _ | | _ g | _ | o t | i d | _ n | | _ | | _ d S( NRP ( R t out_namet added_filesRZ Rp t immediate_writet add_separator_comments( R R Rm R R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt __init__ s c C s | i | | } t i i | p | i i d | | f d S| i i | | f | i oy t | d } t
i } | i i i
| | | i o | i i d | | f n | i i t | i n d S( Ns WARNING: missing resource: %s.%st Us
// -- %s %s --
( t resolve_filenameR R R" R R? R t appendR RZ R# R$ R) RY R Rp R[ R] ( R RN Rm t inf_nameRl t tempname( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt add_file s
c C s
t | i S( N( t boolR ( R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt __nonzero__ s c C s | i o | i i n d S( N( R Rp R_ ( R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt flush s
c C s) x" | i D] } | i d | q
Wd S( Ns %s|%s
( R R[ ( R Rp t entry( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt
write_mapfile
s
c C s t i | | } | S( N( R8 RT ( R RN Rm R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR s c C s d S( N( ( R t out_filename( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt post_hook s ( R@ Rq Rr R{ t TrueR R R R R R R ( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyRw s
R| c B s e Z RS( ( R@ Rq ( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR| s R} c B s2 e Z d Z d Z d Z d Z d Z RS( sv
This class allows to splice in the abl.cssprocessor.CSSRewriter
so that image-references are re-written.
c C s t } t | _ | i o t } t | _ n t t | i | | | | i o? d d k l } d d k l
} | | } | | | _ n d S( Ni( t URI( t CSSRewriter( R R t use_css_rewritert rewritet superR} R t abl.vpathR t abl.cssprocessor.rewriterR t rewriter( R R Rm R R R R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR # s
c C sc t t | i | | | i o< d d k l } | | i | | } | i i | n d S( Ni( R ( R R} R R R R R R t add_css( R RN Rm R t css_file( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR 3 s
c C s2 t t | i | i o | i i n d S( N( R R} R R R R ( R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR ; s
c C sZ | i oL d d k l } | | i } | i i } | i d i | d n d S( Ni( R t imagesR ( R R R RL R R t copy( R R R t out_dirR ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR A s
( R@ Rq Rr R R R R ( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR} s
t aggregate_tw_resourcesc B st e Z d Z d Z d! d# d$ d% d& d' d( d) d* g Z d g Z e Z d Z d Z
d Z d Z d Z
RS(+ s
Setuptools commmand to aggregate Javascript- or CSS-files to one large
file, possibly compressed through the use of YUICompressor.
To enable compression of CSS and JS files you will need to have installed a
Java Runtime Environment and YUICompressor
(http://www.julienlecomte.net/yuicompressor)
In order for resources from widget eggs to be properly collected these
need to have a 'toscawidgets.widgets' 'widgets' entry-point which points
to a module which, when imported, instantiates all needed JS and CSS Links.
The aggregated resources are served via the :class:`tw.mods.base.HostFramework` and
thus must be placed inside a python package to be served as normal resources.
An example commandline invocation would look like this::
python2.5 setup.py aggregate_tw_resources -o myproject/public/javascript/aggregated/ -d MyProject --package=myproject
s< Aggregates ToscaWidgets static resources into a single file.s output=R s9 Output directory. If it doesn't exist it will be created.R s If given, yuicompressor will only be called once for each kind of file with a all files together and then separated back into smaller filess compresslevel=R sg Compression level: 0) for no compression (default). 1) for js-minification. 2) for js & css compressions yuicompressor=s Name of the yuicompressor jar.s distributions=R
s List of widget dists. to include resources from (dependencies will be handled recursively). Note that these distributions need to define a 'toscawidgets.widgets' 'widgets' entrypoint pointing to a a module where resources are located.s kind=t ks The kind, either js or csss variant=t ps The registry variant to fetch the data from. If this option is used,only the selected kind of resources is gathered. The resulting fileset is processed and concatenated to a large file.s package=t ms If gathering a variant, this option can be used to filter the output for a given package. The name of the package can also contain path-elements.So you can group together e.g. 'foo.bar/public/javascript/subdir'.R R s Use the CSS-rewriter to rewrite relative url/image-references before producing the output. To make this actually work, make user you have the AbletonCSSProcessor installed.s .svnc C sa d | _ t | _ t | _ d | _ t | _ d | _ g | _ t i | _
d | _ d | _
d S( NR i Rx s yuicompressor.jar( R R R R R R Rz R R t DEFAULT_VARIANTt variantRG t packageR ( R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR s c C sU | i d | i d | i d t | i | _ t i i | i | _ d S( NR R R ( R R R R R R R R ( R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR s
c C s | i p t i d IJd S| i p t i d IJd St i i | i p( | i d | i t i | i n | i d j o0 t i i | i
o t i d | i
IJd St i } | i
t i | f d | | i d j o6 | i o t | | | _ q7t | | | _ n t | | | _ d } xU | i D]J } t i | d d } | d j o" d
} | | | i } qJqJW| i
| i | f d | i d S( Ns# Need to specify an output directorys) Need to specify at least one distributions Creating output dir %si s Could not find YUICompressor at s Creating temp dir %sc S s t S( N( R ( t resource( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt resource_filter s s toscawidgets.widgetst resource_aggregation_filterc s f d } | S( Nc s | o
| S( N( ( R ( t at b( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR s ( ( R R R ( ( R R s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt combine_predicates s s# Collection resources for variant %s( R R R! R R R R" R? t mkdirR R R# R$ R& R' R R( R) R* R+ R8 t get_entry_infoRG t loadt _collect_variant_resourcesR ( R R% R t distribution_namet epR ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR6 s8
'
c C s yp g } t i | i D] } | | i q ~ } t | i | t i | d d } | i d | i Wn& t j
o } | i d | n Xd S( Ns toscawidgets.widgetsR7 s Loaded %ss %s has no widgets entrypoint(
R8 R9 R: R; R< R= R> R? R@ RA ( R RB RC R R: RD RE ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR= s , c s t i } t | i | i t i | | i d d j o) d j o i d d \ n f d } t i
} t | | } d } t t
i d | } g } xT | D]L } xC | i d D]1 }
| |
o |
| j o | i |
q q Wq Wd d k l } l } x| D]} t | | | f o q6n | i }
|
d j o q6n t |
t o h |
t
i 6}
n | i |
j o |
| i } n |
t
i } t i i | \ } } | i d | i j o q6n | | | p q6n | i } | i d | | f | i | | q6W| oC| i t! | } t" i# } x4 t$ o, | i% d
} | p Pn | i& | qxW| i' d d !} d | | i | i f } t i i( | i) | } t i* | | | i d | t+ i, d
| | i | i f } t i i( | i) | } t! | d } | i- | | i. | i/ | | i d | t+ i, n d S( NR i c sI d j o t S| i i o d j o t S| i St S( N( RG R RN t
startswithR ( t widgetRm ( t filebaseR ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt
in_package s
c S s7 | i } t | t o | t i } n | i | f S( N( Rm t
isinstancet dictR R RN ( R Rm ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt widget_name s t keyt headi( t AggregatedJSLinkt AggregatedCSSLinks Processing %s %si s %s-%s.%ss! Created concatenatenated file: %ss %s-%s.%s.mapRP s Created mapping file: %s(0 R t getcwdR< R= R t chdirR RG RH R# R$ Rw t sortedR t _widgetst retrieve_resourcesR t tw.apiR R R Rm t
basestringR R R t splitextt lowerRz RN R? R R RZ t md5t newR R] t updatet hexdigestR1 R R` R t INFOR R_ R ( R R t cwdR t variant_filenamet resource_aggregatorR R7 t dependency_ordered_widgetsR R R R t variant_mappingRm Rj t extRN Rn t hasht blockt hext dest_nameRp ( ( R R s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR s|
( s output=R s9 Output directory. If it doesn't exist it will be created.N( s onepassNs If given, yuicompressor will only be called once for each kind of file with a all files together and then separated back into smaller files( s compresslevel=R sg Compression level: 0) for no compression (default). 1) for js-minification. 2) for js & css compression( s yuicompressor=Ns Name of the yuicompressor jar.( s distributions=R
s List of widget dists. to include resources from (dependencies will be handled recursively). Note that these distributions need to define a 'toscawidgets.widgets' 'widgets' entrypoint pointing to a a module where resources are located.( s kind=R s The kind, either js or css( s variant=R s The registry variant to fetch the data from. If this option is used,only the selected kind of resources is gathered. The resulting fileset is processed and concatenated to a large file.( s package=R s If gathering a variant, this option can be used to filter the output for a given package. The name of the package can also contain path-elements.So you can group together e.g. 'foo.bar/public/javascript/subdir'.( s rewriteR s Use the CSS-rewriter to rewrite relative url/image-references before producing the output. To make this actually work, make user you have the AbletonCSSProcessor installed.( R@ Rq Rr Rs RG Rt RR Ru Rv R R R6 R= R ( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR J s2 .
R+ c B sI e Z d Z d Z d Z x# d i D] Z d e d Uq. WRS( c C s | | _ | | _ d S( N( RJ t cmd( R R RJ ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR ; s c C s d S( N( ( R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR. ? s c C s t i i | i | } t i i t i i | p t i t i i | n t | d } | i d | t i
| | | i d S( Nt wbs
Writing %s( R R R1 RJ R" RL R' RZ R? R/ t copyfileobjR_ ( R Rl R t finalt dest( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyRY B s s warn announce error executesK def %(name)s(self, *args, **kw):
return self.cmd.%(name)s(*args, **kw)
N( R@ Rq R R. RY RH Rf t locals( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR+ : s
R* c B s, e Z d Z d Z d Z d Z RS( c O s& t t | i | | d | _ d S( Ni ( i i ( R R* R t counters( R t argst kw( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR U s c C sN y4 t t i | i d } d | } | i | Wn t j
o n Xd S( Nid s2 Total JS&CSS compressed size is %.2f%% of original( t reducet operatort truedivR R? t ZeroDivisionError( R t avgt msg( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR. Y s
c
C s | i d d } | d j o | Sd d | i i d | g } | i i d j o | i d n | i d
t i | d t i d t i d
t i } | i d | t } t
i | | | i } | p | S| i
| \ } } | i d j oX | i d | | i f | i d t i i | t i i | | i d nv t | t | f }
t t i |
} t t t | i |
| _ d | | d f } | i | t | } | S( Nt .iRy Rx t javas -jars --typei s --nomunges --charset=utf8t stdoutt stdinR! s Compressing %si s Failed to compress %s: %ds File will be copied untoucheds Compressed %s (New size: %.2f%%)id ( s csss js( RH R R R R t
subprocesst Popent PIPER? R R/ R t getvaluet communicatet
returncodeRd R R! R[ t seekt lenR R R R< t sumt zipR (
R Rl R t typR R t buffert dataR R! t countt ratioR ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt compressb s<
c C s+ | i | | } t t | i | | S( N( R R R* RY ( R Rl R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyRY s ( R@ Rq R R. R RY ( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR* S s !R( c B s, e Z d Z d Z d Z d Z RS( c O sQ t t | i | | h t d 6| _ d | _ d } t i | | _ d S( NRx s' /*! MARKER #### %(path)s #### MARKER */s1 ^\/\* MARKER #### (?P.*?) #### MARKER \*\/$( R R( R R t _cachest _markert ret compilet _re( R R R t regexp( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR s
c C s d } t } | i d x | D]w } | i i | } | oK | o1 | i d t i | | | | i d n | i d } q# | i | q# Wd S( Ni R (
RG R R R t matchR+ RY t truncatet groupR[ ( R Rl t cur_fileR t lineR ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt _demultiplex s
c C st | i d xM | i i D]< \ } } | i d | i | d | } | i | q Wt t | i d S( Ns Compressing all defered filesi s __defered__.( R? R t iteritemsR R R R R( R. ( R R t cachet
compressed( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR. s
c C s | i d d } | i i | } | p( | i d | t i | | | t S| | i t IJ| i d | t i
| | d S( NR is Will not consider %s for onepasss' Defering %s for compression in one pass( RH R t getR? R* RY Rk R R R/ R ( R Rl R R R ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyRY s ( R@ Rq R R R. RY ( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyR( s
(! Rb R R R/ R R R# R R RU t cStringIOR RA R8 t
setuptoolsR t distutilsR t tw.core.resourcesR R R t tw.core.utilR R Ru Rw R| R} R R+ R* R( ( ( ( s3 /usr/lib/python2.6/site-packages/tw/core/command.pyt s4 D-4