diff --git a/scribblings/cache.scrbl b/scribblings/cache.scrbl index 04dc042..61044be 100644 --- a/scribblings/cache.scrbl +++ b/scribblings/cache.scrbl @@ -9,7 +9,17 @@ @defmodule[pollen/cache] -The slowest part of a @racket[render] is parsing and decoding Pollen source files. Often, previewing a single source file necessarily means decoding others (for instance templates, or other source files that are linked into the main source file). But usually, only one source file is changing at a time. Therefore, Pollen stores copies of the exports of source files — namely, whatever is stored in @code[(format "'~a" world:main-pollen-export)] and @code[(format "'~a" world:meta-pollen-export)] — in the cache so they can be reused. +The slowest part of a @racket[render] is parsing and decoding the source file. Often, previewing a single source file necessarily means decoding others (for instance templates, or other source files that are linked into the main source file). But usually, only one source file is changing at a time. Therefore, Pollen stores copies of the exports of source files — namely, whatever is stored in @code[(format "'~a" world:main-pollen-export)] and @code[(format "'~a" world:meta-pollen-export)] — in the cache so they can be reused. + +@defproc[ +(cached-require +[source-path pathish?] +[key (or/c 'doc 'metas 'mod-time)]) +(or/c txexpr? hash? integer?)] +Similar to @racket[(dynamic-require _source-path _key)], except that it tries to get the requested value out of @racket[current-cache]. If it's not there, or out of date, @racket[dynamic-require] is used to update the value. + +If you want the speed benefit of the cache, you should @bold{always} use @racket[cached-require] to get data from Pollen source files. That doesn't mean you can't still use functions like @racket[require], @racket[local-require], and @racket[dynamic-require]. They'll just be slower. + @defproc[ (current-cache) @@ -28,18 +38,10 @@ Initializes @racket[current-cache]. void?] Clears @racket[current-cache]. When only the nuclear option will do. -@defproc[ -(cached-require -[source-path pathish?] -[key (or/c 'doc 'metas 'mod-time)]) -void?] -Similar to @racket[(dynamic-require _source-path _key)], except that it tries to get the requested value out of @racket[current-cache]. If it's not there, or out of date, @racket[dynamic-require] is used to update the value. - -If you want the speed benefit of the cache, you need to use @racket[cached-require] to get data from Pollen source files. That doesn't mean you can't still use functions like @racket[require], @racket[local-require], and @racket[dynamic-require]. They'll just be slower. @defproc[ (cache-ref [source-path pathish?]) hash?] -Returns the cached value associated with the key @racket[_source-path], which will itself be a hash table. See @racket[current-cache] for more. +Returns the cached value associated with the key @racket[_source-path], which will itself be a hash table. See @racket[current-cache]. diff --git a/scribblings/command.scrbl b/scribblings/command.scrbl deleted file mode 100644 index 06bd56d..0000000 --- a/scribblings/command.scrbl +++ /dev/null @@ -1,12 +0,0 @@ -#lang scribble/manual - -@(require scribble/eval (for-label racket (except-in pollen #%module-begin) pollen/world pollen/command)) - -@(define my-eval (make-base-eval)) -@(my-eval `(require pollen)) - -@section{Command} - -@defmodule[pollen/command] - -This module defines functions that are made accessible through @racket[raco], specifically by invoking @racket[raco pollen _command]. \ No newline at end of file diff --git a/scribblings/decode.scrbl b/scribblings/decode.scrbl new file mode 100644 index 0000000..641ae6e --- /dev/null +++ b/scribblings/decode.scrbl @@ -0,0 +1,161 @@ +#lang scribble/manual + +@(require scribble/eval pollen/decode pollen/world (for-label racket (except-in pollen #%module-begin) pollen/world pollen/cache pollen/decode txexpr xml pollen/predicates pollen/decode/typography pollen/decode/block)) + +@(define my-eval (make-base-eval)) +@(my-eval `(require pollen pollen/decode pollen/decode/typography pollen/decode/block)) + +@section{Decode} + +@defmodule[pollen/decode] + +@defproc[ +(decode +[tagged-xexpr txexpr?] +[#:txexpr-tag-proc txexpr-tag-proc (txexpr-tag? . -> . txexpr-tag?) (λ(tag) tag)] +[#:txexpr-attrs-proc txexpr-attrs-proc (txexpr-attrs? . -> . txexpr-attrs?) (λ(attrs) attrs)] +[#:txexpr-elements-proc txexpr-elements-proc (txexpr-elements? . -> . txexpr-elements?) (λ(elements) elements)] +[#:block-txexpr-proc block-txexpr-proc (block-txexpr? . -> . block-txexpr?) (λ(tx) tx)] +[#:inline-txexpr-proc inline-txexpr-proc (txexpr? . -> . txexpr?) (λ(tx) tx)] +[#:string-proc string-proc (string? . -> . string?) (λ(str) str)] +[#:symbol-proc symbol-proc (symbol? . -> . symbol?) (λ(sym) sym)] +[#:valid-char-proc valid-char-proc (valid-char? . -> . valid-char?) (λ(vc) vc)] +[#:cdata-proc cdata-proc (cdata? . -> . cdata?) (λ(cdata) cdata)] +[#:exclude-tags tags-to-exclude (listof symbol?) null] +) +txexpr?] +Recursively process a @racket[_tagged-xexpr], usually the one exported from a Pollen source file as @racket['doc]. This function doesn't do much on its own. Rather, it provides the hooks upon which harder-working functions can be hung. + +@margin-note{This is different from the Scribble approach, where the decoding logic is fixed for every document. In Pollen, you only get the decoding you ask for, and you can customize it to any degree.} + +By default, the @racket[_tagged-xexpr] from a source file is tagged with @racket[root]. Recall from @secref{Pollen mechanics} that any tag can have a function attached to it. So the typical way to use @racket[decode] is to attach your decoding functions to it, and then define @racket[root] to invoke your @racket[decode] function. Then it will be automatically applied to every @racket['doc] during compile. + +While @racket[decode] presents an imposing list of arguments, you're unlikely to use all of them at once. These represent possibilities, not requirements. Let's see what happens when @racket[decode] is invoked without any of its optional arguments: + +@examples[#:eval my-eval +(define tx '(root "I wonder" (em "why") "this works.")) +(decode tx) +] + +Right — nothing. That's because the default value for the decoding arguments is the identity function, @racket[(λ(x)x)]. So everything gets passed through intact, until other action is specified. + +The @racket[_txexpr-tag-proc] argument is a procedure that handles X-expression tags. + +@examples[#:eval my-eval +(define tx '(p "I'm from a strange" (strong "namespace"))) +(decode tx #:txexpr-tag-proc (λ(t) (string->symbol (format "ns:~a" t)))) +] + +The @racket[_txexpr-attrs-proc] argument is a procedure that handles lists of X-expression attributes. (The @racket[txexpr] module, included at no extra charge with Pollen, includes useful helper functions for dealing with attribute lists.) + +@examples[#:eval my-eval +(define tx '(p [[id "first"]] "If I only had a brain.")) +(decode tx #:txexpr-attrs-proc (λ(attrs) (cons '[class "PhD"] attrs ))) +] + +Note that @racket[_txexpr-attrs-proc] will change the attributes of every tagged X-expression, even those that don't have attributes. This is useful, because sometimes you want to add attributes where none existed before. But be careful, because the behavior may make your processing function overinclusive. + +@examples[#:eval my-eval +(define tx '(div (p [[id "first"]] "If I only had a brain.") +(p "Me too."))) +(decode tx #:txexpr-attrs-proc (λ(attrs) (cons '[class "PhD"] attrs ))) +(decode tx #:txexpr-attrs-proc +(λ(attrs) (if (null? attrs) attrs (cons '[class "PhD"] attrs )))) +] + + +The @racket[_txexpr-elements-proc] argument is a procedure that operates on the list of elements that represents the content of each tagged X-expression. Note that each element of an X-expression is subject to two passes through the decoder: once now, as a member of the list of elements, and also later, through its type-specific decoder (i.e., @racket[_string-proc], @racket[_symbol-proc], and so on). + +@examples[#:eval my-eval +(define tx '(div "Double" "\n" "your" "\n" "pleasure")) +(decode tx #:txexpr-elements-proc (λ(es) (map (λ(e)(format "~a~a" e e)) es))) +(decode tx #:txexpr-elements-proc (λ(es) (map (λ(e)(format "~a~a" e e)) es)) +#:string-proc (λ(s) (string-upcase s))) +] + +So why do you need @racket[_txexpr-elements-proc]? Because some types of element decoding depend on context, thus it's necessary to handle the elements as a group. For instance, paragraph detection. The behavior is not merely a @racket[map] across each element: + +@examples[#:eval my-eval +(define (paras tx) (decode tx #:txexpr-elements-proc detect-paragraphs)) +(paras '(body "The first paragraph." "\n\n")) +(paras '(body "The first paragraph." "\n\n" "And another.")) +(paras '(body "The first paragraph." "\n\n" "And another." "\n\n")) +] + + +The @racket[_block-txexpr-proc] argument is a procedure that operates on tagged X-expressions that are deemed block-level (as opposed to inline) elements. That is, they meet the @racket[block-txexpr?] test. (See also @racket[register-block-tag].) + + + + + +Finally, the @racket[_tags-to-exclude] argument is a list of tags that will be exempted from decoding. Though you could get the same result by testing the input within the individual decoding functions, that's tedious and potentially slower. + +@examples[#:eval my-eval +(define tx '(p "I really think" (em "italics") "should be lowercase.")) +(decode tx #:string-proc (λ(s) (string-upcase s))) +(decode tx #:string-proc (λ(s) (string-upcase s)) #:exclude-tags '(em)) +] + +The @racket[_tags-to-exclude] argument is useful if you're decoding source that's destined to become HTML. According to the HTML spec, material within a @racket[