Commit Graph

483 Commits

Author SHA1 Message Date
Martin A. Brown bc1c154108 inital commit of driver file for handling the porcelain logic 2016-02-17 00:22:31 -08:00
Martin A. Brown dab2f1f8b1 adding support for documents to know their status 2016-02-17 00:17:49 -08:00
Martin A. Brown 8a1afb6e24 allow creation of empty OutputCollection; fixes
Allow creation of an empty OutputCollection so that the object can be handed
around in driver.py for higher-level document wrangling.
Also, repair one inobvious statement, thank you pep8/pyflakes
2016-02-16 23:43:07 -08:00
Martin A. Brown 23a5e40d52 shortening knowndoctypes to kdt 2016-02-16 23:42:57 -08:00
Martin A. Brown 6e3362b9aa a bunch of filesystem stat()ing functions 2016-02-16 23:42:22 -08:00
Martin A. Brown f17d164b52 allow creation of empty SourceCollection; fixes
Allow creation of an empty SourceCollection, which can be handed around in the
driver to allow for higher-level document wrangling
fix bad, always-failing directory check (thank you, testing)
clarify handling of documents living in a directory and the generation of the
fileset
2016-02-16 23:40:09 -08:00
Martin A. Brown f39237d307 removing commented block that lives in superclass, BaseDoctype 2016-02-16 23:39:56 -08:00
Martin A. Brown d91f253bd4 pep8 and pyflakes fixes 2016-02-16 19:55:40 -08:00
Martin A. Brown 9845e90a39 adding testing for execute and new function getfileset 2016-02-16 19:52:07 -08:00
Martin A. Brown b23a2ef1c5 adapt to changes in tldptesttools 2016-02-16 14:15:46 -08:00
Martin A. Brown ce060fc5d0 improving coverage of cases in OutputDirectory and OutputCollection 2016-02-16 14:15:15 -08:00
Martin A. Brown fbb6e56929 fixes found during testing
should standardize on IOError for errno.ENOENT across the package
adhere to standard choice of logging message
make sure to skip a non-directory in OutputCollection ("continue")
2016-02-16 14:13:17 -08:00
Martin A. Brown b9defe3e8b more genericization of testing code 2016-02-16 14:12:42 -08:00
Martin A. Brown 8ae6cf7d69 renaming examples.sources to example.sources 2016-02-16 11:11:37 -08:00
Martin A. Brown 9df21df31a renaming examples.examples to examples.sources 2016-02-16 11:10:32 -08:00
Martin A. Brown d392965862 factoring out common testing utilities
renamed TestSourceCollection to TestToolsFilesystem for use in
testing both sources.py and outputs.py
2016-02-16 10:57:44 -08:00
Martin A. Brown ac44f5d577 refactor detection loop and identify duplicates
the nesting was deeper than necessary, so adjusting the detection of files
(and directories) and adding a bit more logging upon duplicate detection
2016-02-16 10:44:24 -08:00
Martin A. Brown 78ee9eb459 revising the mechanism for subdir creation 2016-02-16 10:44:05 -08:00
Martin A. Brown f6f6d4b543 only guess the doctype once 2016-02-16 00:23:58 -08:00
Martin A. Brown 547cb303f6 pep8 and pyflakes fixes (and variable renaming) 2016-02-16 00:03:58 -08:00
Martin A. Brown 5e05b0f30d starting to wear the belt and suspenders 2016-02-15 23:58:50 -08:00
Martin A. Brown 82a0fce575 initial test script for outputs.py 2016-02-15 23:52:52 -08:00
Martin A. Brown 7b08ececf4 renaming OutputDirs more appropriately to OutputCollection 2016-02-15 23:52:08 -08:00
Martin A. Brown 8163efa0a5 converting OutputTree to behave like a dict 2016-02-15 21:55:58 -08:00
Martin A. Brown 55ef688015 adjust SourceDirs to behave like a dictionary 2016-02-15 21:51:56 -08:00
Martin A. Brown 01bee4a269 adjust error-raising invocations (and tests) 2016-02-15 21:32:35 -08:00
Martin A. Brown ae189e0d83 adjusting some logging and exceptions for verbosity/clarity 2016-02-15 21:15:29 -08:00
Martin A. Brown 9b59d99422 no need to track the .pyc files 2016-02-15 21:06:07 -08:00
Martin A. Brown 68e3b2f0cb improving cleaning, esp. index.html 2016-02-15 21:04:41 -08:00
Martin A. Brown cc6caec3a4 improving readability and simplicity 2016-02-15 20:59:49 -08:00
Martin A. Brown f9aa61fa32 revise BaseDoctype to add generic generation method 2016-02-15 20:59:25 -08:00
Martin A. Brown 7daefd03bd renaming Sources to SourceDirs 2016-02-15 20:58:44 -08:00
Martin A. Brown 3ad14231aa renaming Sources to SourceDirs 2016-02-15 20:58:30 -08:00
Martin A. Brown 61f2538927 first working example of Linuxdoc processor 2016-02-15 14:04:09 -08:00
Martin A. Brown 73305ca97f adding function execute() to shell out 2016-02-15 14:03:56 -08:00
Martin A. Brown 3f08105232 pep8/pyflakes fixes 2016-02-15 14:03:35 -08:00
Martin A. Brown b6076fec82 create OutputDirectory and OutputTree
an OutputTree must exist already, contains all of the OutputDocuments
an OutputDocument determines the stem from the dirname and depends on
the OutputNamingConvention for choosing names for the primary files of each
generated output type
2016-02-15 14:01:55 -08:00
Martin A. Brown f1c40c1e8c create BaseDoctype with features needed by all
each document processor will need to know about its
sources, outputs and the platform details
the generate() method is a temporary model for operation
2016-02-15 13:58:32 -08:00
Martin A. Brown 169d6872f6 pull some of the key names in by default when "import tldp" 2016-02-15 13:57:48 -08:00
Martin A. Brown a1d457a3ae initial test support for document enumeration
check to see that empty directories are handled correctly
check to see that single, multiple files in one dir are handled
check to see that single files in multiple directories are handled
2016-02-13 12:32:05 -08:00
Martin A. Brown 91708bdc3c make testdatadir an absolute path 2016-02-13 12:31:58 -08:00
Martin A. Brown 8c57a9a994 put all simple examples in a namespace (easier to wrangle) 2016-02-13 11:26:00 -08:00
Martin A. Brown d16d10f405 in case we do not have SimpleNamespace 2016-02-13 11:24:54 -08:00
Martin A. Brown eaf2823fd6 read examples data from testdata dir; adapt tests
adapt tests to accommodate storing the test data in a separate directory
inspect example objects for signature checking (and extension checking)
adhere to pep8 and pyflakes conventions
2016-02-13 10:54:38 -08:00
Martin A. Brown 0ee20461f3 directory for all sorts of testdata 2016-02-13 10:39:43 -08:00
Martin A. Brown d9c7ac1944 move testdata to sample directory 2016-02-13 10:39:26 -08:00
Martin A. Brown 336faa4df5 test __init__ for missing/wrong type SourceDocument 2016-02-12 23:59:44 -08:00
Martin A. Brown 82a8a21d18 check for plain file type, too 2016-02-12 23:59:13 -08:00
Martin A. Brown fe507461e8 found another typo while testing 2016-02-12 23:49:04 -08:00
Martin A. Brown 39ca112e40 initial test suite framework and first tests 2016-02-12 23:48:48 -08:00