EPrints Technical Mailing List Archive

See the EPrints wiki for instructions on how to join this mailing list and related information.

Message: #05943

< Previous (by date) | Next (by date) > | < Previous (in thread) | Next (in thread) > | Messages - Most Recent First | Threads - Most Recent First

Re: [EP-tech] Manage data sets with EPrints

Hi all,

 

Just to add to what Lizz said about upload limits, although we don’t use eprints for data at Nottingham, with dspace we did eventually get successful uploads of 100GB via the web front end (we didn’t try for more than that).  The things that initially hindered us achieving this were ensuring that the values for various internal system timeouts, and as well as shibboleth authentication timeouts were long enough to accommodate the time taken for upload.

 

Although eprints is of course an entirely different system, it might be that sys admins encounter similar gotchas when trying to accommodate big uploads so worth checking for that sort of thing if problems are discovered.

 

The other thing is to ensure use of Chrome as most of the other browsers seem to have arbitrary limits on file upload.  I think eprints may use something slightly more sophisticated though for file uploads than your standard old fashioned post technique so may work in a less browser dependant manner.

 

Jonathan

Digital Library Team

University of Nottingham

 

From: eprints-tech-bounces@ecs.soton.ac.uk [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of Lizz Jennings
Sent: 19 September 2016 12:45
To: eprints-tech@ecs.soton.ac.uk
Subject: Re: [EP-tech] Manage data sets with EPrints

 

Hello Josée,

 

We are using EPrints as a data repository, and have successfully added files of around 20GB size to it, but using scripts on the command line to save researchers uploading through the web form which would be tiresome and prone to error.  As the storage was on our network, I was able to mount the location of the files so that it was straightforward to add files via import - I scripted it as I've got quite a few to do, but it would be possible to do the same manually.

 

I understand the main limit is any limit imposed by a web browser (if you use it), the quality of connection and the patience of the researcher rather than any actual limits in EPrints.

 

Lizz

 

--
Lizz Jennings BA MSc ACLIP MCLIP (Revalidated 2015)
Technical Data Officer
The Library 4.10, University of Bath, Bath, BA2 7AY UK
Ext. 3570 (External 01225 383570)
E.Jennings@bath.ac.uk

From: eprints-tech-bounces@ecs.soton.ac.uk <eprints-tech-bounces@ecs.soton.ac.uk> on behalf of Lessard Josée <josee.lessard@cirad.fr>
Sent: 19 September 2016 12:22
To: eprints-tech@ecs.soton.ac.uk
Subject: [EP-tech] Manage data sets with EPrints

 

Hello,
We are studying the possibility to use EPrints to manage data sets.
Is EPrints able to manage very large files (around 5GB) ?
Does anybody have any idea of the best way to do that (we especially have doubts about the relevance of doing such large uploads from the web interface) ?

All your advices will be really appreciated.

Best regards,

--

Josée Lessard

Documentaliste

Cirad-Dgdrs-Délégation à l'information scientifique et technique

TA 183/05 - Avenue Agropolis - 34398 Montpellier Cedex 5 (Tél: +33 4 67 61 57 37)



This message and any attachment are intended solely for the addressee
and may contain confidential information. If you have received this
message in error, please send it back to me, and immediately delete it. 

Please do not use, copy or disclose the information contained in this
message or in any attachment.  Any views or opinions expressed by the
author of this email do not necessarily reflect the views of the
University of Nottingham.

This message has been checked for viruses but the contents of an
attachment may still contain software viruses which could damage your
computer system, you are advised to perform your own checks. Email
communications with the University of Nottingham may be monitored as
permitted by UK legislation.