test dir

CONTRIBUTING.md

@@ -6,11 +6,11 @@ I welcome pull requests. But accepting a PR obligates me to maintain that code f
 
 * PRs for simple documentation fixes (e.g., spelling and grammar corrections) are always welcome. For more substantial changes, I don’t necessarily prefer PRs to issues or feature requests. A good description of the problem with a working example is better than a half-baked PR. I can often fix it in less time than it would take to review the PR. (= Principle of Efficiency)
 
-* If you want feedback on a potential PR, I recommend posting to the [Pollen forum](https://forums.matthewbutterick.com/c/typesetting/) rather than here. Because more people will see it. (= Principle of Exposure)
+* If you want feedback on a potential PR, I recommend posting to the [Pollen discussion area](https://github.com/mbutterick/pollen-users) rather than here. Because more people will see it. (= Principle of Exposure)
 
 * Small PRs are easier to accept than large ones. Large PRs should have a benefit worthy of their complexity. PRs that want to amend Pollen’s public interface receive the highest scrutiny. (= Principle of Proportionality)
 
-* I consider every PR, but I can’t promise detailed code reviews or comments. Helpful Racketeers can be found on the [Pollen forum](https://forums.matthewbutterick.com/c/pollen/), the [Racket mailing list](https://lists.racket-lang.org/), and the Racket [Slack channel](https://racket.slack.com/). (= Principle of Specialization)
+* I consider every PR, but I can’t promise detailed code reviews or comments. Helpful Racketeers can be found on the [Pollen discussion area](https://github.com/mbutterick/pollen-users), the [Racket mailing list](https://lists.racket-lang.org/), and the Racket [Slack channel](https://racket.slack.com/). (= Principle of Specialization)
 
 * PRs should be necessary, in the sense that the proposed change can only be accomplished by patching this repo. (Corollary:  features that can live in a separate [package](https://pkgs.racket-lang.org/) probably should.) (= Principle of Necessity)
 

README.md

@@ -1,4 +1,4 @@
-## Pollen: the book is a program [![Contributor Covenant](https://img.shields.io/badge/Contributor%20Covenant-2.0-4baaaa.svg)](CODE_OF_CONDUCT.md) 
+## Pollen: the book is a program [![Build Status](https://github.com/mbutterick/pollen/workflows/CI/badge.svg)](https://github.com/mbutterick/pollen/actions) [![Contributor Covenant](https://img.shields.io/badge/Contributor%20Covenant-2.0-4baaaa.svg)](CODE_OF_CONDUCT.md) 
 
 A book-publishing system written in [Racket](http://racket-lang.org). This is the software I use to publish & maintain my web-based books [Beautiful Racket](http://beautifulracket.com), [Practical Typography](http://practicaltypography.com), and [Typography for Lawyers](http://typographyforlawyers.com).
 
@@ -23,7 +23,7 @@ And update like so:
 
     raco pkg update --update-deps pollen
     
-Official forum: https://forums.matthewbutterick.com/c/typesetting/
+Official discussion area: https://github.com/mbutterick/pollen-users
 
 ## License
 

gangtest/40.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+40 file

gangtest/41.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+41 file

gangtest/42.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+42 file

gangtest/43.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+43 file

gangtest/44.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+44 file

gangtest/45.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+45 file

gangtest/46.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+46 file

gangtest/47.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+47 file

gangtest/48.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+48 file

gangtest/49.txt.pm

@@ -0,0 +1,2 @@
+#lang pollen
+49 file

gangtest/gang.rkt

@@ -0,0 +1,34 @@
+#lang br
+(require racket/path
+         pollen/private/file-utils
+         racket/file)
+
+(define sources (for/list ([p (in-directory ".")]
+                           #:when (path-has-extension? p #"pm"))
+                          p))
+
+#R sources
+
+(define temp-template (build-path "/Users/MB/Desktop/sources/template.txt"))
+(define output-paths (map simplify-path (map path->complete-path (map ->output-path sources))))
+#R output-paths
+
+(define render-results
+(eval (with-syntax ([MODNAME (gensym)]
+                    [TEMPLATE-PATH-STRING (path->string temp-template)])
+        #`(begin
+            (println 'MODNAME)
+            (module MODNAME pollen/private/gang-helper
+              #:sources #,@(map path->string sources)
+              #:template TEMPLATE-PATH-STRING
+              #:result-id result)
+            (let ()
+              (local-require 'MODNAME)
+              result)))))
+
+(for ([render-result (in-list render-results)]
+      [output-path (in-list output-paths)])
+     (display-to-file render-result
+                       output-path
+                       #:exists 'replace
+                       #:mode (if (string? render-result) 'text 'binary)))

gangtest/makem.rkt

@@ -0,0 +1,8 @@
+#lang br
+(require racket/file)
+
+(for ([i 50])
+     (display-to-file (format "#lang pollen\n~a file" i)
+                      (string->path (format "~a.txt.pm" i))
+                      #:exists 'replace
+                      #:mode 'text))

gangtest/pollen.rkt

@@ -0,0 +1,6 @@
+#lang br
+
+(module setup racket/base
+  (provide (all-defined-out))
+  #;(define render-cache-active #false)
+  #;(define compile-cache-active #false))

gangtest/template.txt

@@ -0,0 +1 @@
+here is doc: ◊(cdr doc)

pollen/private/gang-helper.rkt

@@ -0,0 +1,55 @@
+#lang racket/base
+(require (for-syntax racket/base
+                     syntax/strip-context
+                     "project.rkt"
+                     "../setup.rkt")
+         racket/stxparam
+         racket/splicing
+         "external/include-template.rkt"
+         "../cache.rkt"
+         "../pagetree.rkt"
+         "../core.rkt"
+         "../setup.rkt"
+         "../template.rkt"
+         "../top.rkt")
+
+(provide (rename-out [mb #%module-begin])
+         (except-out (all-from-out racket/base) #%module-begin))
+
+(define-syntax-parameter doc (λ (stx) (error 'doc-not-parameterized)))
+(define-syntax-parameter metas (λ (stx) (error 'metas-not-parameterized)))
+(define-syntax-parameter result (λ (stx) (error 'result-not-parameterized)))
+
+(define-syntax (mb stx)
+  (syntax-case stx ()
+    ;; markup / markdown branch
+    [(_ #:sources SOURCE-PATH-STRING ...
+        #:template TEMPLATE-PATH-STRING
+        #:result-id RESULT-ID)
+     (let ([source-path (syntax->datum (car (syntax->list #'(SOURCE-PATH-STRING ...))))])
+       (with-syntax ([DIRECTORY-REQUIRE-FILES
+                      (replace-context #'here (require-directory-require-files source-path))]
+                     [DOC-ID pollen-main-export]
+                     [METAS-ID pollen-meta-export]
+                     [COMMAND-CHAR (setup:command-char source-path)]
+                     [(SUBRESULT ...) (generate-temporaries #'(SOURCE-PATH-STRING ...))])
+         #'(#%module-begin 
+            DIRECTORY-REQUIRE-FILES
+            (splicing-syntax-parameterize
+                ([doc (make-rename-transformer #'DOC-ID)]
+                 [metas (make-rename-transformer #'METAS-ID)]
+                 [result (make-rename-transformer #'RESULT-ID)])
+              (define SUBRESULT
+                (parameterize ([current-pagetree (make-project-pagetree (current-project-root))]
+                               [current-metas (cached-metas SOURCE-PATH-STRING)])
+                  (define doc (cached-doc SOURCE-PATH-STRING))
+                  (define metas (current-metas))
+                  (define here (path->pagenode
+                                (or (select-from-metas pollen-here-path-key metas) 'unknown)))
+                  (if (bytes? doc) ; if main export is binary, just pass it through
+                      doc
+                      ;; allows `require` in a template
+                      (splicing-let-syntax ([require (make-rename-transformer #'local-require)])
+                        (include-template #:command-char COMMAND-CHAR (file TEMPLATE-PATH-STRING)))))) ...
+              (define result (list SUBRESULT ...))
+              (provide result)))))]))

pollen/private/reader-base.rkt

@@ -124,7 +124,6 @@
           [(eq? mode default-mode-markdown) pollen-markdown-source-ext]
           [(eq? mode default-mode-markup) pollen-markup-source-ext]
           [(eq? mode default-mode-pagetree) pollen-pagetree-source-ext]))]
-      [(module-language) 'pollen]
       [else default])))
 
 (define-syntax-rule (reader-module-begin mode . _)

pollen/private/ts.rktd

@@ -1 +1 @@
-1710316839
+1656292611

pollen/render.rkt

@@ -455,12 +455,11 @@
   (with-handlers ([exn:fail:contract? (λ (e) #f)]) ; in case source-path doesn't work with cached-require
     (parameterize ([current-directory (current-project-root)])
       (define source-metas (cached-metas source-path))
-      (define template-name (match (select-from-metas pollen-template-meta-key source-metas) ; #f or atom or list
-                              [(? list? names)
-                               (for/first ([name (in-list names)]
-                                           #:when (equal? (get-ext name) (->string output-path-ext)))
-                                 name)]
-                              [other other]))
+      (define template-name-or-names ; #f or atom or list
+        (select-from-metas pollen-template-meta-key source-metas)) 
+      (define template-name (if (list? template-name-or-names)
+                                (findf (λ (tn) (eq? (get-ext tn) output-path-ext)) template-name-or-names)
+                                template-name-or-names))
       (and template-name (simplify-path (cleanse-path (build-path (dirname source-path) template-name)))))))
 
 (define (get-default-template source-path output-path-ext)

pollen/scribblings/big-picture.scrbl

@@ -15,7 +15,7 @@ This is the core design principle of Pollen. Consistent with this principle, Pol
 
 @item{@bold{A Pollen project consists of source files + static files.} A @italic{source file} is a file that can be compiled to produce certain output. A @italic{static file} is usable as it stands (e.g., an SVG file or webfont). Generally, the textual content of your book will live in source files, and other elements will be static files.}
 
-@item{@bold{Source control is a good idea.} Because Pollen projects are software projects, they can be easily managed with systems for source control and collaboration. If you're a writer at heart, don't fear these systems — the learning curve is repaid by revision & edit tracking that's much easier than it is with Word or PDF files.}
+@item{@bold{Source control is a good idea.} Because Pollen projects are software projects, they can be easily managed with systems for source control and collaboration, like @link["http://github.com"]{GitHub}. If you're a writer at heart, don't fear these systems — the learning curve is repaid by revision & edit tracking that's much easier than it is with Word or PDF files.}
 
 ]
 

pollen/scribblings/installation.scrbl

@@ -106,13 +106,15 @@ I hope you enjoy using it.
 
 @subsection{Bugs and feature requests}
 
-Can be submitted as @link["https://git.matthewbutterick.com/mbutterick/pollen/issues"]{issues} at the main Pollen source repository.
+Can be submitted as @link["https://github.com/mbutterick/pollen/issues"]{GitHub issues} at the main Pollen source repository.
 
 @subsection{Questions & discussion}
 
-For general tips and how-to questions, use the @link["https://forums.matthewbutterick.com/c/typesetting/"]{Pollen discussion forum}. I'll also use that list to post major changes and new features. You need an account to post (free and easy to set up with an email address).
+For general tips and how-to questions, use the @link["https://github.com/mbutterick/pollen-users/issues"]{pollen-users discussion group} (on GitHub). I'll also use that list to post major changes and new features. 
 
-(BTW, the former ``pollenpub'' Google Group and the ``pollen-users'' GitHub repo are now deprecated.)
+You need a GitHub account to post. If you don't have one, don't panic — they're free and easy to set up with an email address. @link["https://github.com/mbutterick/pollen-users"]{Instructions here}.
+
+(BTW, the former ``pollenpub'' Google Group is now deprecated.)
 
 
 

pollen/scribblings/license.scrbl

@@ -10,4 +10,4 @@
 
 This module is licensed under the MIT License.
 
-Source repository at @link["https://git.matthewbutterick.com/mbutterick/pollen/"]{https://git.matthewbutterick.com/mbutterick/pollen/}. Suggestions & corrections welcome.
+Source repository at @link["http://github.com/mbutterick/pollen"]{http://github.com/mbutterick/pollen}. Suggestions & corrections welcome.

pollen/scribblings/version-history.scrbl

@@ -12,7 +12,7 @@ Inconsistent with this system, Pollen's version also appends a build number, whi
 
 @section{Source code}
 
-Pollen's source code is @link["https://git.matthewbutterick.com/mbutterick/pollen/"]{available from this Git repo}. The @tt{MASTER} branch of the repo will always contain the most recent stable version. 
+Pollen's source code is @link["http://github.com/mbutterick/pollen"]{available from this Git repo}. The @tt{MASTER} branch of the repo will always contain the most recent stable version. 
 
 Racket's @link["http://pkg.racket-lang.org"]{package catalog} relies on this branch, so if you get your updates with @tt{raco pkg update pollen}, you'll get the most recent updates from this branch.