Send Eprints-tech mailing list submissions to
        eprints-tech@ecs.soton.ac.uk

To subscribe or unsubscribe via the World Wide Web, visit
        http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
or, via email, send a message with subject or body 'help' to
        eprints-tech-request@ecs.soton.ac.uk

You can reach the person managing the list at
        eprints-tech-owner@ecs.soton.ac.uk

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Eprints-tech digest..."


Today's Topics:

   1. Datafiles size limit of 10 GB (AndrikAZ@adf.bham.ac.uk)
   2. Re: Datafiles size limit of 10 GB (David R Newman)


----------------------------------------------------------------------

Message: 1
Date: Mon, 18 Oct 2021 08:58:41 +0000
From: "AndrikAZ@adf.bham.ac.uk" <a.andrikopoulou@bham.ac.uk>
Subject: [EP-tech] Datafiles size limit of 10 GB
To: "eprints-tech@ecs.soton.ac.uk" <eprints-tech@ecs.soton.ac.uk>
Message-ID: <2f84fc74cda3409db1d6ff4ebc0b6da2@adf.bham.ac.uk>
Content-Type: text/plain; charset="iso-8859-1"

CAUTION: This e-mail originated outside the University of Southampton.

Hello All,


In our Ubira eData<https://eur03.safelinks.protection.outlook.com/?url="">> repository, we have a limit on the uploaded datasets of 10 GB per record. There are cases though, with much larger datasets that have to be deposited in a single record. Would it be possible to exceed this 10 GB limit?


Any recommendation will be very appreciated.


Many thanks,

Angeliki


Angeliki Andrikopoulou
Research Data Librarian

Library Services
Skype: A.Andrikopoulou@bham.ac.uk<mailto:A.Andrikopoulou@bham.ac.uk>
e: A.Andrikopoulou@bham.ac.uk<mailto:A.Andrikopoulou@bham.ac.uk>
https://eur03.safelinks.protection.outlook.com/?url="">
Twitter<https://eur03.safelinks.protection.outlook.com/?url="">> / Instagram<https://eur03.safelinks.protection.outlook.com/?url="">> / Facebook<https://eur03.safelinks.protection.outlook.com/?url="">>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20211018/3d492284/attachment-0001.html

------------------------------

Message: 2
Date: Mon, 18 Oct 2021 11:36:36 +0100
From: David R Newman <drn@ecs.soton.ac.uk>
Subject: Re: [EP-tech] Datafiles size limit of 10 GB
To: <eprints-tech@ecs.soton.ac.uk>, "AndrikAZ@adf.bham.ac.uk"
        <a.andrikopoulou@bham.ac.uk>
Message-ID:
        <EMEW3|e60a30ee0a9b05f7cdddf750e5cbf8e7x9HBad03drn|ecs.soton.ac.uk|2aedd881-12ee-bed1-c4e2-e7a54cf1e69d@ecs.soton.ac.uk>
       
Content-Type: text/plain; charset="windows-1252"

Hi Angeliki,


I would normally advise against using EPrints for files larger than
10GB, as the time to upload can be quite long and as they is no in-built
failure recovery, there is a higher chance that uploads may fail and it
will ultimately take longer to upload than the same amount of data in
smaller files.? However, if the data is being uploaded from fairly
locally over a high bandwidth connections you may be OK.


The _javascript_ that manages uploads can configured to limit the max
upload size but this is not the case by default.? However, if you check
88_uploadmethod_file.js and there is code like:


checkFilesize: function(file){
 ??????? if (file.size < max_size)
 ??????? {
 ??????????? return 1;
 ??????? }
 ??????? eprints.currentRepository().phrase(
{'Plugin/Screen/EPrint/UploadMethod/File:filesize_too_big':{}
},function(phrase){ alert (file.name+": \n"+
phrase["Plugin/Screen/EPrint/UploadMethod/File:filesize_too_big"]); } ) ;
 ??????? return 0;
 ??? },


and max_size is set somewhere else in the script.? Then you can modify
the value for max_size to allow for bigger files.? If there is no
max_size set then you should be OK to upload any file size. However, be
sure to edit the right version of 88_uploadmethod_file.js as this can
appear on lib/, site_lib/ and archive level subdirectories.? You want to
edit the one at archive level.? If it does not exist copy the one from
site_lib or if that does not exist lib and then edit it at the archive
level
(archives/ARCHIVE_NAME/cfg/static/_javascript_/auto/88_uploadmethod_file.js).


I don't know if web browsers have built in upload limits anymore but if
they do I would not be surprised if 10GB was a limit they may have in
place.? So if you still cannot upload large files it may be worth
investigating if it is due to your web browser. However, if the upload
limit is not restricted by the setting of max_size, I would not be
surprised if the upload did fail at some point because such a large file
has more opporunity due to network and other issues.? There is also a
small possibility that 10GB leads to some integer overflow somewhere.?
It may be in the _javascript_ in 88_uploadmethod_file.js but I am not
aware of this being an issue but I have not tried to upload files over
2-3GB.


Regards


David Newman


On 18/10/2021 09:58, AndrikAZ--- via Eprints-tech wrote:
> *CAUTION:* This e-mail originated outside the University of Southampton.
>
> Hello All,
>
>
> In our Ubira eData
> <https://eur03.safelinks.protection.outlook.com/?url="">>?repository,
> we have a limit on the uploaded datasets?of 10 GB per record. There
> are cases though, with much larger datasets that have to be deposited
> in a single record. Would it be possible to exceed this 10 GB?limit?
>
>
> Any recommendation will be very appreciated.
>
>
> Many thanks,
>
> Angeliki
>
>
>
> Angeliki Andrikopoulou
>
> Research Data Librarian
>
> Library Services
>
> Skype:A.Andrikopoulou@bham.ac.uk <mailto:A.Andrikopoulou@bham.ac.uk>
>
> e: A.Andrikopoulou@bham.ac.uk <mailto:A.Andrikopoulou@bham.ac.uk>
>
> https://eur03.safelinks.protection.outlook.com/?url="">
> <https://eur03.safelinks.protection.outlook.com/?url="">>
>
> Twitter
> <https://eur03.safelinks.protection.outlook.com/?url="">>?/?Instagram
> <https://eur03.safelinks.protection.outlook.com/?url="">>?/
> Facebook
> <https://eur03.safelinks.protection.outlook.com/?url="">>
>
>
> *** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: https://eur03.safelinks.protection.outlook.com/?url="">
> *** EPrints community wiki: https://eur03.safelinks.protection.outlook.com/?url="">


--
This email has been checked for viruses by AVG.
https://eur03.safelinks.protection.outlook.com/?url="">
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20211018/82c9899a/attachment.html

------------------------------

_______________________________________________
Eprints-tech mailing list
Eprints-tech@ecs.soton.ac.uk
http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech


End of Eprints-tech Digest, Vol 157, Issue 23
*********************************************