-
-
28 Nov 2018 15:05:31 UTC
- Browse (raw)
- Changes
- How to Contribute
- Issues (4)
- Testers (166 / 81 / 0)
- Kwalitee
Bus factor: 1- % Coverage
- License: gpl_3
24 month- Download (128.46KB)
- MetaCPAN Explorer
- Permissions
- Subscribe to distribution
- This version
- Latest version
Changes for version 0.09
- Correct shebang lines in scripts
Documentation
how to install and setup TaskPipeAn overview of the TaskPipe frameworkscript to execute the TaskPipe ToolModules
A task management framework for building web scrapers and crawlershandles file installs for TaskPipeParameter value interpolator for TaskPipehandling matching of parameter values in the planMatch handler for the $id parameter variablematch handler for the $name parameter variablematch handler for the $this parameter variablemodule determining the parts of a plan parameter variablegeneric class for TaskPipe Iteratorsmanages TaskPipe jobssettings for the TaskPipe::JobManager moduleLogging manager for TaskPipesettings for the TaskPipe::LoggerManager moduleopen proxy management for TaskPipethe base class for IPListsSettings for TaskPipe::OpenProxyManager::IPListPremProxy IP Listsettings for TaskPipe::OpenProxyManager::IPList_PremProxyProxyNova IP ListSettings for TaskPipe::OpenProxyManager::IPList_ProxyNovaXroxy IP Listsettings for TaskPipe::OpenProxyManager::IPList_Xroxysettings for TaskPipe::OpenProxyManagerPath settings for TaskPipeTaskPipe global path settingsproject path settings for TaskPipemanage plan files for TaskPipesettings for TaskPipe::Planread POD for TaskPipeSettings for TaskPipe::PodReadermanage ports for TaskPipeiterate mode type constraintoutput mode type constraintplan mode type constraintscope mode type constraintshell mode type constraintarray ref represented as a string type constraintuser agent type type constraintinformation about the run (of the current plan)base class for sample projectssample project to scrape quotes for S&P500 companiesthe default sample that is used when deploying files/db tablesmanage schema connections for TaskPipesettings for TaskPipe::SchemaManagerglobal schema settings for TaskPipeproject schema settings for TaskPipeGlobal Schema Template for TaskPipeschema template for the global daemon tableglobal schema template for job sourceglobal schema template for open proxy sourceGlobal Schema Template file for port sourceglobal schema template for spawned sourceglobal schema template for thread sourceProject Schema Template for TaskPipeschema template for the project error tableschema template for the project pinterp tableschema template for the project result tableschema template for project thread tableschema template for project xbranch_error tableschema template for project xbranch tableschema template for project xresult tableschema template for the SP500 sample projectschema template for the SP500 project company tablethe class which all TaskPipe tasks should inherit frommap task names to modulesSettings for TaskPipe::Tasktest settings for TaskPipe::Tasksettings for the TaskPipe::TaskUtils modulerecord a record to the databaserecord a result set as a series of name/value pairsrecord a result set as a series of name/value pairsBase TaskPipe class for scraping a webpagesettings for TaskPipe::Task_Scrapeuse a database table as the data sourceuse a file as a data sourcethe base class for file templatestemplate for the global config filetemplate for the project configthe template package for the 'system' config filethe base class for plan templatestemplate for the SP500 sample project plantemplate for the default planbase class for task templatestemplate for the Scrape_Companies task in the SP500 sample projecttemplate for the Scrape_Quote task in the SP500 sample projecttemplate for the Scrape_Stub taskmanages threads for TaskPipeSettings for TaskPipe::ThreadManagerthe base class for the TaskPipe command line toolbase class for TaskPipe Tool commandscommand to clear tablescommand to deploy TaskPipe project filescommand to deploy taskpipe tablescommand to generate taskpipe schema filescommand to run a TaskPipe planthe TaskPipe setup commandshow currently running TaskPipe jobscommand to stop a running taskpipe jobcommand to test an individual TaskPipe taskbase calss for open proxy related commandscommand to fetch open proxiescommand to test open proxieshandles command line options for TaskPipe Toolmanage TOR processes for TaskPipesettings for TaskPipe::TorManagerbase class for managing requests in TaskPipesettings for TaskPipe::UserAgentMangerstandard useragent handleruseragent handler for phantomjsbase class for proxying useragentsuseragent manager for making requests through an open proxy networkuseragent manager for making requests through TORProvides
in lib/TaskPipe/Iterator_Array.pmin lib/TaskPipe/Sample_Test.pmin lib/TaskPipe/SchemaTemplate_Project_Test.pmin lib/TaskPipe/SchemaTemplate_Project_Test/Result/City.pmin lib/TaskPipe/SchemaTemplate_Project_Test/Result/Company.pmin lib/TaskPipe/SchemaTemplate_Project_Test/Result/Employee.pmin lib/TaskPipe/SchemaTemplate_Project_Test/Result/Operation.pmin lib/TaskPipe/TaskUtils.pmin lib/TaskPipe/Task_SeparateArray.pmin lib/TaskPipe/Task_WhoIs/Settings.pmin lib/TaskPipe/Template_Config_Project_SP500.pmin lib/TaskPipe/WhoisManager/Settings.pm
Tom Gracey
As a valued partner and proud supporter of MetaCPAN, StickerYou
is happy to offer a 10% discount on all Custom Stickers,
Business Labels, Roll Labels, Vinyl Lettering or Custom Decals.
StickerYou.com is your one-stop shop to make
your business stick. Use code METACPAN10 at
checkout to apply your discount.