EPrints Technical Mailing List Archive

See the EPrints wiki for instructions on how to join this mailing list and related information.

Message: #05134

< Previous (by date) | Next (by date) > | < Previous (in thread) | Next (in thread) > | Messages - Most Recent First | Threads - Most Recent First

[EP-tech] Re: Recollect plugin installation and migrating

Hi,
Might also be worth having a look at this:
http://wiki.eprints.org/w/Community_Contributions_Day_November_2015#Group_2:_Technical
 - we're working on this type of thing right now!

The Vagrant stuff might do exactly what you need for a 3.3.14 dev box!

Cheers,
John 

________________________________________
From: eprints-tech-bounces@ecs.soton.ac.uk <eprints-tech-bounces@ecs.soton.ac.uk> on behalf of Morrissey, Kahena <K.Morrissey@bolton.ac.uk>
Sent: 18 November 2015 14:01
To: eprints-tech@ecs.soton.ac.uk
Subject: [EP-tech] Re: Recollect plugin installation and migrating

Hi Brian,

Thank you. I will have a go in a test deployment.

Many thanks.

Best regards,
Kahena

MIS Officer | Information Systems & Technology
University of Bolton | Deane Road | Bolton | BL3 5AB
Email: k.morrissey@bolton.ac.uk

-----Original Message-----
From: Morrissey, Kahena
Sent: 17 November 2015 09:50
To: 'eprints-tech@ecs.soton.ac.uk'
Subject: [EP-tech] Re: Recollect plugin installation and migrating

Hello Everyone,

Thank you for the many responses.

Brian,

Regarding "migrating by hand" did you mean redoing each publication in turn OR doing a batch export (from EPrints without Recollect) then import to EPrints with Recollect?
We would like to be able to access both through the same portal/interface so integration of publications and data collections are what we are after.

Many thanks.

Best regards,
Kahena

MIS Officer | Information Systems & Technology
Email: k.morrissey@bolton.ac.uk | Tel: +44 (0)1204 903 207 | Ext. 3207

-----Original Message-----
From: eprints-tech-bounces@ecs.soton.ac.uk [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of eprints-tech-request@ecs.soton.ac.uk
Sent: 14 November 2015 12:00
To: eprints-tech@ecs.soton.ac.uk
Subject: Eprints-tech Digest, Vol 86, Issue 28

Send Eprints-tech mailing list submissions to
        eprints-tech@ecs.soton.ac.uk

To subscribe or unsubscribe via the World Wide Web, visit
        http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
or, via email, send a message with subject or body 'help' to
        eprints-tech-request@ecs.soton.ac.uk

You can reach the person managing the list at
        eprints-tech-owner@ecs.soton.ac.uk

When replying, please edit your Subject line so it is more specific than "Re: Contents of Eprints-tech digest..."


Today's Topics:

   1. Re: RIS plugin problems (utf8 and journal title)
      (George Mamalakis)
   2. Re: Recollect plugin installation and migrating repository
      (Brian D. Gregg)


----------------------------------------------------------------------

Message: 1
Date: Fri, 13 Nov 2015 19:23:34 +0200
From: George Mamalakis <mamalos@eng.auth.gr>
Subject: [EP-tech] Re: RIS plugin problems (utf8 and journal title)
To: eprints-tech@ecs.soton.ac.uk
Message-ID: <56461C96.7010802@eng.auth.gr>
Content-Type: text/plain; charset=utf-8; format=flowed

Thanks Ian, John and Stewart, I'll try and do my best (I'll submit the patched version and will try to build a bazaar package).

On 13/11/2015 05:13 ??, John Salter wrote:
> Also...
> Ideally, create a new repo here:
> https://github.com/eprintsug/
> for the code (maybe call it 'RIS import'?)
>
> For bonus points:
> Wrap it up as a Bazaar package
> http://wiki.eprints.org/w/Category:EPrints_Bazaar :o)
>
> Cheers,
> John
>
> -----Original Message-----
> From: eprints-tech-bounces@ecs.soton.ac.uk
> [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of Stewart
> Brownrigg
> Sent: 13 November 2015 14:50
> To: eprints-tech@ecs.soton.ac.uk
> Subject: [EP-tech] Re: RIS plugin problems (utf8 and journal title)
>
> Hi George,
>
> I originally posted the plugin.  When I submitted it, I expected, and am happy, that others would want to reuse and adapt the code.  Please can you submit a patched version of the plugin back on to the http://files.eprints.org website with a version number?
>
> Many thanks,
> Stewart
>
> Stewart Brownrigg | Library Systems Officer Learning and Research
> Systems Development, Information Services, University of Kent Room
> SE05, Cornwallis South East Canterbury, Kent, CT2 7NF, UK
> Tel: +44 (0)1227 823621
>
> http://www.kent.ac.uk/is | @ukclibraryit
>
> -----Original Message-----
> From: eprints-tech-bounces@ecs.soton.ac.uk
> [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of George
> Mamalakis
> Sent: 13 November 2015 10:12
> To: eprints-tech@ecs.soton.ac.uk
> Subject: [EP-tech] RIS plugin problems (utf8 and journal title)
>
> Hello everybody,
>
> I tried to use the RIS import plugin from:
> http://files.eprints.org/741/. The plugin wouldn't accept the publication field from Google scholar exported entries, nor would it allow UTF8 encoded strings to be imported (both problems have been spotted from the web import functionality). So, I tried to resolve them myself, and I found the following corrections that seem to solve the problems.
>
>
> diff -r d5f969263300 perl_lib/EPrints/Plugin/Import/RIS.pm
> --- a/perl_lib/EPrints/Plugin/Import/RIS.pm     Fri Nov 06 11:22:06 2015
> +0200
> +++ b/perl_lib/EPrints/Plugin/Import/RIS.pm     Fri Nov 13 11:57:54 2015
> +0200
> @@ -34,7 +34,6 @@
>        my( $plugin, %opts ) = @_;
>        my @ids;
>        my $fh = $opts{fh}; # File handle
> +  binmode( $fh, ":utf8" );
>        my @file = <$fh>;
>        my ( %record, @records ) = ();
>        my $lastkey = undef;
> @@ -237,9 +236,6 @@
>        # Publication title
>        &_join_multiple_field_data($epdata, $entry, ['T2', 'JF'],
> 'publication', ', ');
> +  &_join_multiple_field_data($epdata, $entry, ['T2', 'JO'],
> 'publication', ', ');
>        # Series title
>        &_join_field_data($epdata, $entry, 'T3', 'series', ', ');
>
> What I've done was to change the binmode of the file (borrowed from BibTeX import plugin) to accept utf8 encoded strings, and I've added one more entry for the publication field (journal title if I'm not mistaken) to be based on JO rather than JF (which is how scholar returns it).
>
> I am sending these changes to:
>
> a) help anyone having the same problems with the specific plugin,
> b) ask if these corrections are correct :), and
> c) also to ask what is the proper procedure of reporting these "bugs" so they'll be corrected permanently (eg. contact the maintainer directly, indirectly, what?).
>
> Thanks all for your answers in advance,
>
> George.
>
>
> --
> George Mamalakis
>
> IT and Security Officer,
> Electrical and Computer Engineer (Aristotle Univ. of Thessaloniki),
> PhD (Aristotle Univ. of Thessaloniki), MSc (Imperial College of
> London)
>
> School of Electrical and Computer Engineering Aristotle University of
> Thessaloniki
>
> phone number : +30 (2310) 994379
>
>
> *** Options:
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: http://www.eprints.org/tech.php/
> *** EPrints community wiki: http://wiki.eprints.org/
> *** EPrints developers Forum: http://forum.eprints.org/
>
> *** Options:
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: http://www.eprints.org/tech.php/
> *** EPrints community wiki: http://wiki.eprints.org/
> *** EPrints developers Forum: http://forum.eprints.org/
>
> *** Options:
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: http://www.eprints.org/tech.php/
> *** EPrints community wiki: http://wiki.eprints.org/
> *** EPrints developers Forum: http://forum.eprints.org/


--
George Mamalakis

IT and Security Officer,
Electrical and Computer Engineer (Aristotle Univ. of Thessaloniki), PhD (Aristotle Univ. of Thessaloniki), MSc (Imperial College of London)

School of Electrical and Computer Engineering Aristotle University of Thessaloniki

phone number : +30 (2310) 994379





------------------------------

Message: 2
Date: Fri, 13 Nov 2015 18:26:27 +0000
From: "Brian D. Gregg" <bdgregg@pitt.edu>
Subject: [EP-tech] Re: Recollect plugin installation and migrating
        repository
To: "eprints-tech@ecs.soton.ac.uk" <eprints-tech@ecs.soton.ac.uk>
Message-ID:
        <3a68bd43e27d44aa9ee3e45051856742@pitt-prodx-08.univ.pitt.edu>
Content-Type: text/plain; charset="us-ascii"

Kahena,

Installing the Recollect plugin will definitely change the workflow in an existing repository as well as add some fields and if I remember correctly other code that may not be wanted in an existing EPrints archive.  We were able to successfully integrate "Recollect" into our existing IR but as Adam has indicated much care should be used if doing so.  The package really is meant for those that are starting out with a new/clean EPrints repository with the mind set of only accepting data sets.

I would highly suggest you install this into a separate test/development archive first and then work the changes into your existing repository.  We decided to separately install Recollect into an empty clean separate EPrints installation first and then we determined what was different between our existing archive and the new Recollect archive and then migrated the changes by hand to our existing archive.  This seemed to be the safest process for us and during the process we reviewed the fields we already had with the new fields created.  Some of these kept, some of these we augmented and some of these we just decided we didn't need.  We essentially used the Recollect package to augment our existing dataset item type field wise and pretty much we ignored the rest.  This way we can now more accurately acquire data set items without losing the existing workflow/processes in our existing IR.

Hope this helps.

Brian.

Brian D. Gregg
Solutions Architect | Manager Systems Development University of Pittsburgh | University Library System
Address: 7500 Thomas Blvd.  Room 129 Pittsburgh, PA 15208
Tel: (412) 648-3264 | Email: bdgregg@pitt.edu | Fax: (412) 648-3585



-----Original Message-----
From: eprints-tech-bounces@ecs.soton.ac.uk [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of Lizz Jennings
Sent: Friday, November 13, 2015 11:27 AM
To: eprints-tech@ecs.soton.ac.uk
Subject: [EP-tech] Re: Recollect plugin installation and migrating repository

I would guess the biggest issue will be with making sure that the data types (Recollect uses data_collection instead of everything else including dataset) and metadata fields are mapping appropriately.  I'm not aware of it removing the old types (unless I've done something particularly bizarre with mine...).  The other thing is if you're migrating from a much older version of EPrints - that may introduce additional complications.

I'm not sure what would *break* from using it, but you might lose functionality or make stuff invisible.  I've not done it before, so am also guessing.

Lizz

--
Lizz Jennings BA MSc ACLIP MCLIP (Revalidated 2015) Technical Data Officer The Library 4.10, University of Bath, Bath, BA2 7AY UK Ext. 3570 (External 01225 383570) E.Jennings@bath.ac.uk Research Data Management: http://www.bath.ac.uk/research/data


-----Original Message-----
From: eprints-tech-bounces@ecs.soton.ac.uk [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of Field A.N.
Sent: 13 November 2015 15:45
To: eprints-tech@ecs.soton.ac.uk
Subject: [EP-tech] Re: Recollect plugin installation and migrating repository

Be careful, the ReCollect plugin "reprofiles" your repository (i.e. makes it significantly different).  It's really designed to turn your repository into a stand-alone data repository (please correct me if I'm wrong, EPrints community).

I would suggest having  a play, and then figuring out which items to migrate.  If there are significant changes to the database schema, migration may be difficult.  I don't have any direct experience with this, so I don't really know.

--
Adam Field
Business Relationship Manager and Community Lead EPrints Services
+44 (0)23 8059 8814





On 13 Nov 2015, at 14:58, Morrissey, Kahena wrote:

> Hi Everyone,
>
> We need to install the ReCollect plugin and realise that the recommended way of installing it is to do a fresh EPrints installation then install the plugin.
>
> My question is:  if this is done, is it then alright to migrate a repository from an EPrints repository (v3.3.11 on Ubuntu) ,that does not have the ReCollect plugin, to this new fresh installation?
>
> Any advice and/or web references on this would be greatly appreciated.
>
> Thank you in advance.
>
> Best regards,
> Kahena
>
> MIS Officer | Information Systems & Technology University of Bolton |
> Deane Road | Bolton | BL3 5AB
> Email: k.morrissey@bolton.ac.uk | Tel: +44 (0)1204 903 207
>
> *** Options:
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
> *** Archive: http://www.eprints.org/tech.php/
> *** EPrints community wiki: http://wiki.eprints.org/
> *** EPrints developers Forum: http://forum.eprints.org/


*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/

*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/



------------------------------

_______________________________________________
Eprints-tech mailing list
Eprints-tech@ecs.soton.ac.uk
http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech


End of Eprints-tech Digest, Vol 86, Issue 28
********************************************

*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/