Martin A. Brown
a88451c124
report number of files involved
2016-02-20 20:10:35 -08:00
Martin A. Brown
19f01a0a4c
begin refactoring of directory document handling
2016-02-19 00:55:53 -08:00
Martin A. Brown
b1840b03bf
record the 'broken' field in sdoc/odoc
...
and add function to list_broken (analogically appropriate)
2016-02-19 00:54:39 -08:00
Martin A. Brown
f200c0efc2
add function stem_and_ext to the utils
2016-02-19 00:54:16 -08:00
Martin A. Brown
d7fac8d65f
move logic from SourceCollection to scansourcedirs
...
moving the source dir scanning logic into a function (in preparation for
further refactoring of single-file or entire-directory source document
detection)
adapting tests (by changing the name from SourceCollection to scansourcedirs).
no other tests required
added new test to ensure that an empty SourceCollection() returned as expected
2016-02-18 23:31:18 -08:00
Martin A. Brown
3ddb77b55e
adding some docstrings
2016-02-18 23:07:53 -08:00
Martin A. Brown
6762743f66
docstrings for functions
2016-02-18 23:07:44 -08:00
Martin A. Brown
f04b2dfbd0
pep8 fix
2016-02-18 23:07:14 -08:00
Martin A. Brown
1578e282cc
ensure that statfiles includes directories
...
statfiles was not including directories; it does now
2016-02-18 21:55:56 -08:00
Martin A. Brown
88f518ede7
add docstrings and text to utils functions
2016-02-18 17:23:26 -08:00
Martin A. Brown
7d3843c535
adding a bunch of docstring docs
2016-02-18 13:58:53 -08:00
Martin A. Brown
28f7a8468c
minor documentation fixes
2016-02-18 13:58:30 -08:00
Martin A. Brown
809ddc545b
adding # -*- coding: utf8 -*-
2016-02-18 13:25:02 -08:00
Martin A. Brown
bf768d0277
adding basic docstrings
2016-02-18 13:22:48 -08:00
Martin A. Brown
605b57a1ea
sorted(), so dirs and docs are processed stably
...
use sorted() on the sourcedirs and the contents of each directory so that the
directories are always handled in order and the documents are also handled in
order
adjust logging also to refer to "Source collection dir" rather than just "dir"
2016-02-18 09:17:25 -08:00
Martin A. Brown
20ae6bd25c
add stem to logging entries
...
for consistency, make sure that stem is included on logging lines
2016-02-18 09:16:45 -08:00
Martin A. Brown
a34738301f
removing extraneous logging entry
2016-02-18 09:16:37 -08:00
Martin A. Brown
d643883e50
change name_index to name_indexhtml; adapt tests
...
also minor logging adjustments for clarity and consistency
2016-02-18 09:15:47 -08:00
Martin A. Brown
62198e5973
in execute, before Popen, ensure cmd[0] has +x
...
rename is_executable() to isexecutable()
adjust testing code to match change to execute()
2016-02-18 09:13:46 -08:00
Martin A. Brown
2550047d23
pep8/pyflakes corrections
2016-02-17 19:38:27 -08:00
Martin A. Brown
ef355ad8fb
add inventory category for broken outputs
2016-02-17 19:30:25 -08:00
Martin A. Brown
d3b6ad8e56
add iscomplete property to OutputDirectory
2016-02-17 19:19:48 -08:00
Martin A. Brown
ffc0ad6547
improve readability, parallelism of methods by inverting logic
2016-02-17 19:05:23 -08:00
Martin A. Brown
1039dea0e6
let the prebuild_hook call clean
2016-02-17 19:04:51 -08:00
Martin A. Brown
eed25efbba
simplify cleaning; add (unused) name_epub
2016-02-17 19:04:21 -08:00
Martin A. Brown
f5a65cf843
put stem in logging like many other logging lines
2016-02-17 19:03:37 -08:00
Martin A. Brown
fd3b931423
include hooks for prebuild and postbuild states
2016-02-17 18:31:51 -08:00
Martin A. Brown
bc810dd36c
deal with the ENOENT problem in statfiles()
2016-02-17 18:16:20 -08:00
Martin A. Brown
a0de081099
minor logging tweaking
2016-02-17 17:56:42 -08:00
Martin A. Brown
54a8477a33
renaming to inventory.py (and affected tests)
2016-02-17 16:39:42 -08:00
Martin A. Brown
c425c2a8e8
completed first round of testing of driver code
2016-02-17 13:50:55 -08:00
Martin A. Brown
2bcb55e2a0
flipping the stem/dirname arguments
2016-02-17 13:50:06 -08:00
Martin A. Brown
2b0b241019
adjusting format names
2016-02-17 13:49:33 -08:00
Martin A. Brown
a8284f3afa
repair mtime comparison logic
...
repair mtime comparison logic for source and output directories after
generalizing the statfiles() function in utils.py
add a __repr__ to the Inventory object
2016-02-17 12:04:37 -08:00
Martin A. Brown
46edc205e0
factor out the call to os.stat(); broken links
2016-02-17 11:31:08 -08:00
Martin A. Brown
9301a54ab2
switch to using statfiles
2016-02-17 11:19:48 -08:00
Martin A. Brown
515595cac9
improve statfiles, deprecate ill-conceived fileset
...
statfiles now returns a dict() of statinfo and can handle relative paths
2016-02-17 11:18:47 -08:00
Martin A. Brown
f72583fca6
improve and generalize statfiles and getfileset
...
statfiles is the heavy lifter; call os.stat() while walking the directory
simplify getfileset; use the keys returned in the statinfo dict()
2016-02-17 10:17:19 -08:00
Martin A. Brown
01be89c949
pep8 fixes
2016-02-17 09:12:07 -08:00
Martin A. Brown
c99dbefa92
shorter __repr__ can fit on one line
2016-02-17 08:35:53 -08:00
Martin A. Brown
c1ccc544a3
adjust logic into an inventory object
2016-02-17 08:35:36 -08:00
Martin A. Brown
bc1c154108
inital commit of driver file for handling the porcelain logic
2016-02-17 00:22:31 -08:00
Martin A. Brown
dab2f1f8b1
adding support for documents to know their status
2016-02-17 00:17:49 -08:00
Martin A. Brown
8a1afb6e24
allow creation of empty OutputCollection; fixes
...
Allow creation of an empty OutputCollection so that the object can be handed
around in driver.py for higher-level document wrangling.
Also, repair one inobvious statement, thank you pep8/pyflakes
2016-02-16 23:43:07 -08:00
Martin A. Brown
23a5e40d52
shortening knowndoctypes to kdt
2016-02-16 23:42:57 -08:00
Martin A. Brown
6e3362b9aa
a bunch of filesystem stat()ing functions
2016-02-16 23:42:22 -08:00
Martin A. Brown
f17d164b52
allow creation of empty SourceCollection; fixes
...
Allow creation of an empty SourceCollection, which can be handed around in the
driver to allow for higher-level document wrangling
fix bad, always-failing directory check (thank you, testing)
clarify handling of documents living in a directory and the generation of the
fileset
2016-02-16 23:40:09 -08:00
Martin A. Brown
f39237d307
removing commented block that lives in superclass, BaseDoctype
2016-02-16 23:39:56 -08:00
Martin A. Brown
9845e90a39
adding testing for execute and new function getfileset
2016-02-16 19:52:07 -08:00
Martin A. Brown
fbb6e56929
fixes found during testing
...
should standardize on IOError for errno.ENOENT across the package
adhere to standard choice of logging message
make sure to skip a non-directory in OutputCollection ("continue")
2016-02-16 14:13:17 -08:00
Martin A. Brown
ac44f5d577
refactor detection loop and identify duplicates
...
the nesting was deeper than necessary, so adjusting the detection of files
(and directories) and adding a bit more logging upon duplicate detection
2016-02-16 10:44:24 -08:00
Martin A. Brown
f6f6d4b543
only guess the doctype once
2016-02-16 00:23:58 -08:00
Martin A. Brown
547cb303f6
pep8 and pyflakes fixes (and variable renaming)
2016-02-16 00:03:58 -08:00
Martin A. Brown
5e05b0f30d
starting to wear the belt and suspenders
2016-02-15 23:58:50 -08:00
Martin A. Brown
82a0fce575
initial test script for outputs.py
2016-02-15 23:52:52 -08:00
Martin A. Brown
7b08ececf4
renaming OutputDirs more appropriately to OutputCollection
2016-02-15 23:52:08 -08:00
Martin A. Brown
8163efa0a5
converting OutputTree to behave like a dict
2016-02-15 21:55:58 -08:00
Martin A. Brown
55ef688015
adjust SourceDirs to behave like a dictionary
2016-02-15 21:51:56 -08:00
Martin A. Brown
01bee4a269
adjust error-raising invocations (and tests)
2016-02-15 21:32:35 -08:00
Martin A. Brown
ae189e0d83
adjusting some logging and exceptions for verbosity/clarity
2016-02-15 21:15:29 -08:00
Martin A. Brown
68e3b2f0cb
improving cleaning, esp. index.html
2016-02-15 21:04:41 -08:00
Martin A. Brown
cc6caec3a4
improving readability and simplicity
2016-02-15 20:59:49 -08:00
Martin A. Brown
f9aa61fa32
revise BaseDoctype to add generic generation method
2016-02-15 20:59:25 -08:00
Martin A. Brown
7daefd03bd
renaming Sources to SourceDirs
2016-02-15 20:58:44 -08:00
Martin A. Brown
61f2538927
first working example of Linuxdoc processor
2016-02-15 14:04:09 -08:00
Martin A. Brown
73305ca97f
adding function execute() to shell out
2016-02-15 14:03:56 -08:00
Martin A. Brown
3f08105232
pep8/pyflakes fixes
2016-02-15 14:03:35 -08:00
Martin A. Brown
b6076fec82
create OutputDirectory and OutputTree
...
an OutputTree must exist already, contains all of the OutputDocuments
an OutputDocument determines the stem from the dirname and depends on
the OutputNamingConvention for choosing names for the primary files of each
generated output type
2016-02-15 14:01:55 -08:00
Martin A. Brown
f1c40c1e8c
create BaseDoctype with features needed by all
...
each document processor will need to know about its
sources, outputs and the platform details
the generate() method is a temporary model for operation
2016-02-15 13:58:32 -08:00
Martin A. Brown
169d6872f6
pull some of the key names in by default when "import tldp"
2016-02-15 13:57:48 -08:00
Martin A. Brown
82a8a21d18
check for plain file type, too
2016-02-12 23:59:13 -08:00
Martin A. Brown
fe507461e8
found another typo while testing
2016-02-12 23:49:04 -08:00
Martin A. Brown
236ae3cbd4
skip files with no extension (and complain)
2016-02-12 23:14:51 -08:00
Martin A. Brown
f76aa736e7
when calling type(), the word type is already present
2016-02-12 23:00:54 -08:00
Martin A. Brown
ad73629413
returning the wrong answer... get the FIRST answer (yay for testing)
2016-02-12 23:00:30 -08:00
Martin A. Brown
85e6441fa5
initial impl of class to hold platform-specific details
2016-02-12 13:25:58 -08:00
Martin A. Brown
a7a0fe38b3
adding two unused doctypes
2016-02-12 13:25:19 -08:00
Martin A. Brown
85b8df5e86
method .index removed from Python3 string module; not needed anyway
2016-02-12 13:24:55 -08:00
Martin A. Brown
7affd10e0c
correct the reference to the renamed guess function
2016-02-12 13:24:21 -08:00
Martin A. Brown
9a75657c1e
be more like Python3
2016-02-12 13:24:09 -08:00
Martin A. Brown
7c70a7c4b8
formatname must be a string
2016-02-12 13:00:11 -08:00
Martin A. Brown
92fdf8bec1
case-insensitive sorting is preferred
2016-02-12 12:53:30 -08:00
Martin A. Brown
5263a3a219
fleshing out the linuxdoc processing commands
2016-02-12 12:49:50 -08:00
Martin A. Brown
4652345b7a
adding basic required methods
2016-02-12 12:43:45 -08:00
Martin A. Brown
ecf2bee8a6
removing unused sys; shortening logger lines
2016-02-12 12:42:58 -08:00
Martin A. Brown
4d0c6f1f1f
renaming guess.py to typeguesser.py
2016-02-12 12:42:34 -08:00
Martin A. Brown
685418cb1e
removing unused processors.py file
2016-02-12 12:42:03 -08:00
Martin A. Brown
7b97f221bf
f argument is file object; also renaming fin to f
...
fin was the argument and was a filelike object, but
it was pointless, now it is just a file object and called f;
also shrinking the length of two logging lines
2016-02-12 12:25:34 -08:00
Martin A. Brown
f45f10913c
renaming fin to f
2016-02-12 12:25:16 -08:00
Martin A. Brown
eb4de2f877
prettier __repr__ for OutputDir
2016-02-12 10:32:09 -08:00
Martin A. Brown
a74bcb645e
makefh and which functions in utils.py
2016-02-12 10:31:50 -08:00
Martin A. Brown
fc9da80f6f
nicer visually to process a sorted set of files
2016-02-11 15:31:38 -08:00
Martin A. Brown
becb768929
handling multiple source dirs and renaming SourceDir to, simply Sources
2016-02-11 15:16:12 -08:00
Martin A. Brown
ce72500bbd
fleshing out commands and support for linuxdoc
2016-02-11 11:29:23 -08:00
Martin A. Brown
bbe1985a81
changing to __future__ (consistency across project)
2016-02-11 11:29:00 -08:00
Martin A. Brown
627e2ff636
changing to __future__ (consistency across project)
2016-02-11 11:28:38 -08:00
Martin A. Brown
303c133faf
yes, the usual .gitignore
2016-02-11 11:27:36 -08:00
Martin A. Brown
6de9aee212
changing names to sourcedir and outputdir
2016-02-11 09:28:31 -08:00
Martin A. Brown
8670927ac6
adding commands for Linuxdoc format
2016-02-11 09:15:50 -08:00
Martin A. Brown
035ff36afb
adding OutputDir to outputs.py
2016-02-11 09:15:22 -08:00
Martin A. Brown
5adbb9af4c
removing the output elements from sources.py
2016-02-11 09:14:58 -08:00
Martin A. Brown
41bf2ef9c1
decreasing verbosity level on debugging logging
2016-02-11 08:17:04 -08:00
Martin A. Brown
b047b22470
better __repr__ and doctype @property
...
Include a better __repr__ for the SourceDocument object and
make the doctype attribute a @property
2016-02-11 08:12:16 -08:00
Martin A. Brown
35f779aa3e
adjusting level of verbosity for some logging
2016-02-11 08:11:36 -08:00
Martin A. Brown
701657e54b
initial commit
2016-02-10 19:22:23 -08:00