Is parallel mode known to crash a lot? #114

Closed
opened 3 years ago by benknoble · 1 comments
benknoble commented 3 years ago (Migrated from github.com)

On small projects, I get a handful of early crashes, and then everything runs smoothly.

On a large project, I get 10s of early crashes, then sporadically one or two every 5.

(By "crash" I mean an individual job fails and is retried serially at the end, without issue.)

Some crashes I saw were caused by car on an eof, file-system issues with copying files or getting sizes, etc. (Some of these were diagnosed by adding to the with-handlers in parallel-render.)

On small projects, I get a handful of early crashes, and then everything runs smoothly. On a large project, I get 10s of early crashes, then sporadically one or two every 5. (By "crash" I mean an individual job fails and is retried serially at the end, without issue.) Some crashes I saw were caused by `car` on an eof, file-system issues with copying files or getting sizes, etc. (Some of these were diagnosed by adding to the `with-handlers` in `parallel-render`.)
mbutterick commented 3 years ago (Migrated from github.com)

Yes, it is more finicky, for reasons I’ve never been able to pin down. Roughly, it has something to do with race errors that arise when parallel places compete for access to the same set of files in the filesystem. Try using fewer parallel jobs.

Yes, it is more finicky, for reasons I’ve never been able to pin down. Roughly, it has something to do with race errors that arise when parallel places compete for access to the same set of files in the filesystem. Try using fewer parallel jobs.
This repo is archived. You cannot comment on issues.
No Milestone
No project
No Assignees
1 Participants
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: mbutterick/pollen-users#114
Loading…
There is no content yet.