SpiderMiddleware

Namespace: Spider.Plugin

Assembly: Spider.Plugin

Spider middleware, serves robots.txt on request and denies access to route for spider connections.