EPrints Technical Mailing List Archive
Message: #00853
< Previous (by date) | Next (by date) > | < Previous (in thread) | Next (in thread) > | Messages - Most Recent First | Threads - Most Recent First
[EP-tech] Re: Robots.txt / OAI
- To: eprints-tech@ecs.soton.ac.uk
- Subject: [EP-tech] Re: Robots.txt / OAI
- From: Tim Brody <tdb2@ecs.soton.ac.uk>
- Date: Wed, 11 Jul 2012 09:42:42 +0100
On 10/07/12 17:33, John Salter wrote:
In practise, I don't think OAI bots will look at robots.txt. But I agree /oai2 ought to be Allow(ed).Just a quick question/comment: Does the robots.txt file (e.g. http://demoprints.eprints.org/robots.txt ) mean that compliant bots don't access the OAI-PMH interface http://demoprints.eprints.org/cgi/oai2 ? Is this an issue?
/Tim.
- References:
- [EP-tech] Robots.txt / OAI
- From: John Salter <J.Salter@leeds.ac.uk>
- [EP-tech] Robots.txt / OAI
- Prev by Date: [EP-tech] pronom integration to EPrints 3.3.10
- Next by Date: [EP-tech] Create item's new version
- Previous by thread: [EP-tech] Robots.txt / OAI
- Next by thread: [EP-tech] pronom integration to EPrints 3.3.10
- Index(es):