Keep track of the last seen date and start crawling again from there for the next crawl, instead of crawling everything at each invocation. Can be configured through configuration options.
Keep track of the last seen date and start crawling again from there for the next crawl, instead of crawling everything at each invocation. Can be configured through configuration options.