The MinPageDate
parameter filters the pages that are ingested by date. The connector only ingests pages that are older than the specified date. Newer pages are not ingested, though links from these pages might still be followed, depending on the value of SpiderDateFilteredPages.
Specify the date in any of the formats specified by DateFormats.
To use this parameter you must set either DateInUrl or PageDateSelector so that the Web Connector can extract a date for each page.
If you set the parameter MinPageAge, this parameter is ignored.
Type: | String |
Default: | |
Required: | No |
Configuration Section: | TaskName or FetchTasks or Default |
Example: | MinPageDate=2015-June-01
|
See Also: |
|