EPrints Technical Mailing List Archive

Message: #07828

< Previous (by date) | Next (by date) > | < Previous (in thread) | Next (in thread) > | Messages - Most Recent First | Threads - Most Recent First

Re: [EP-tech] EPrints/Elements Merge Problems

Hi James,
Yes - and I've submitted a bug report to Symplectic - with a fix for their connector - which they've never rolled out *sigh*.

When two items are merged, and initially they both have documents in folder '01', all these then get put into the 'surviving EPrint's '01' directory.
Worse still, if both items have a file of the same name e.g. Doc1.pdf (but they are different files), one of them will overwrite the other - and you have data-loss :o|

You can see how many things are affected by this with the following query:
SELECT   eprintid, pos, count(*) as c FROM   document GROUP BY   eprintid, pos HAVING c > 1;

The issue is in Symplectic/RepoProcess/MergeManager.pm - and a call to:
	my $new_doc = $doc->clone($target);
This clone doesn't reset the 'pos' - so you get the results reported.

I'll put a gist together with the changes needed to resolve this.

Feel free to log it as a ticket with Symplectic...

Cheers,
John

-----Original Message-----
From: eprints-tech-bounces@ecs.soton.ac.uk [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of Newman D.R. via Eprints-tech
Sent: 16 May 2019 09:28
To: eprints-tech@ecs.soton.ac.uk; James Kerwin <jkerwin2101@gmail.com>
Subject: Re: [EP-tech] EPrints/Elements Merge Problems

Hi James,

Based on some experience with this it can be due to the symplectic_pids
table in EPrints getting out of sync.  I have in the past had to make
manual corrections to fix this.  It has never been clear to me what
caused the issue, as I only have access to the EPrints side.

I would take a look in this EPrints database table.  It has three IDs
two from Symplectic and one from EPrints.  A record with no outstanding
merge issues should have the same two Symplectic IDs and the associated
EPrint ID.  Sometimes I have not even been able to find the record I
need in this table based on a lookup against either the EPrint or
Symplectic ID.  Tell me what you find and I maybe able to advise
further or confirm whether this is or is not the issue you are
experiencing.

Regards

David Newman

On Thu, 2019-05-16 at 09:18 +0100, James Kerwin via Eprints-tech wrote:
> Hi All,
>
> This may be a question for the Symplectic list, but on the off-chance
> anybody has experienced similar problems... Has anybody had trouble
> with merging records in Elements and the result in EPrints being a
> complete mess?
>
> A record was merged recently and the results in EPrints are two
> documents in the same folder on the server (where the file download
> link points two).
>
> For example, there is usually one file per bottom level directory:
>
> Dir 01 = file1.pdf
> Dir 02 = file2.pdf
>
> and so on.
>
> I'm getting:
>
> Dir 01 = file1.pdf, file2.pdf
> Dir02 = file3.pdf
>
> Also the files showing Elements seem to be duplicating themselves and
> keeps changing to "deposit incomplete" Always one more of the
> duplicated file in Elements than is appearing in EPrints.
>
> I know I can tidy this up in EPrints, but I'd like to stop it
> happening altogether.
>
> Thanks,
> James
> *** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-
> tech
> *** Archive: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C0f9a9a3d3e6a48652d3408d6d9db7535%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=mFh%2FbEzghwpfctaSlkYHQDOe1guqIVeEkrDGaDROr5E%3D&amp;reserved=0
> *** EPrints community wiki: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C0f9a9a3d3e6a48652d3408d6d9db7535%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=CL0iedQ%2BLbcin5UUJS9qTHXKYnIw8ddqCHrk5qkoOIc%3D&amp;reserved=0
> *** EPrints developers Forum: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fforum.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C0f9a9a3d3e6a48652d3408d6d9db7535%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=enPZZuMGZP5UVOK%2BXsLqmGyctNCs3xus6oSCej86V1s%3D&amp;reserved=0

*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C0f9a9a3d3e6a48652d3408d6d9db7535%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=mFh%2FbEzghwpfctaSlkYHQDOe1guqIVeEkrDGaDROr5E%3D&amp;reserved=0
*** EPrints community wiki: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C0f9a9a3d3e6a48652d3408d6d9db7535%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=CL0iedQ%2BLbcin5UUJS9qTHXKYnIw8ddqCHrk5qkoOIc%3D&amp;reserved=0
*** EPrints developers Forum: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fforum.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C0f9a9a3d3e6a48652d3408d6d9db7535%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=enPZZuMGZP5UVOK%2BXsLqmGyctNCs3xus6oSCej86V1s%3D&amp;reserved=0