EPrints Technical Mailing List Archive

Message: #04744

[EP-tech] Re: Advanced Search by date

To: eprints-tech@ecs.soton.ac.uk
Subject: [EP-tech] Re: Advanced Search by date
From: Adam Field <af05v@ecs.soton.ac.uk>
Date: Tue, 22 Sep 2015 20:56:56 +0100

It appears you have database issues. I haven't seen the index table just disappearing. What user is mysql running as, and what are the permissions on the database directory? Can you post the tables you do have (i.e. what's returned by a SHOW TABELS command in the database).

Adam Field

Business Relationship Manager and Community Lead
EPrints Services

On 18 Sep 2015, at 13:44, Jérémy RAINGEARD <jeremy.raingeard@univ-tlse3.fr> wrote:

Hi Adam,

I tried your solution and it did nothing : not sorted out well and it
didn't appear in my eprint__ordervalues_fr table - I don't know if it's
useful or not. But I checked my logs after some tries and this is what I
found in it :

DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
DBD::mysql::st execute failed: Can't open file:
'./thesesups/event_queue.frm' (errno: 24) at
/opt/eprints3/perl_lib/EPrints/Database.pm line 3372, <DATA> line 151.
SQL ERROR (execute): SELECT `event_queue`.`eventqueueid` FROM
`event_queue` LEFT JOIN `event_queue__ordervalues_fr` ON
`event_queue`.`eventqueueid`=`event_queue__ordervalues_fr`.`eventqueueid` WHERE
`event_queue`.`status` = 'waiting' AND ((
`event_queue`.`start_time_year` < 2015 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` < 9 ) OR (
`event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
< 17 ) OR ( `event_queue`.`start_time_year` = 2015 AND
`event_queue`.`start_time_month` = 9 AND `event_queue`.`start_time_day`
= 17 )) GROUP BY `event_queue`.`eventqueueid`,
`event_queue__ordervalues_fr`.`priority`,
`event_queue__ordervalues_fr`.`start_time` ORDER BY
`event_queue__ordervalues_fr`.`priority` DESC,
`event_queue__ordervalues_fr`.`start_time` DESC
SQL ERROR (execute): Can't open file: './thesesups/event_queue.frm'
(errno: 24)
DBD::mysql::st fetch failed: fetch() without execute() at
/opt/eprints3/perl_lib/EPrints/Search/Condition.pm line 565, <DATA> line
151.
[Fri Sep 18 14:28:09 2015] ** Indexer process stopping
[Fri Sep 18 14:28:17 2015] ** Indexer process started

I don't find this event_queue.frm - because it's a temporary file for
MySQL ? - so I can't even see if it's a permission problem. Any idea
about this ?

Thank you.

Jeremy

Le 17/09/2015 16:09, Field A.N. a écrit :
Ah, if they aren't in the table, then they haven't been indexed. Choose an item that isn't ordering correctly, find its ID, then run:

epadmin reindex *repository_id* eprint *eprint_id*

...and see if it sorts itself out. Note that this queues it on the indexer rather than doing the work, so check whether the indexer is running (the 'status' button on the 'system toos' tab of the 'Admin' screen [though if your interface is in French, this might vary]). On the status page, you should see the number of index tasks decreasing.

If running that command sorts out that item, then run it again, but without the ID at the end. This will index all items, and might take a while, but it shouldn't be too long, as you only have 2572 eprints.

Let me know how it goes.

--
Adam Field
Business Relationship Manager and Community Lead
EPrints Services
+44 (0)23 8059 8814

On 17 Sep 2015, at 14:36, Jérémy RAINGEARD wrote:

Hi Adam and thank you.

You can find our repository at this address - some thesis are public,
some not : http://thesesups.ups-tlse.fr/
Just choose a subject for example and let the last option as it is
("trier les résultats").

Now, this is the advanced search aprt of my search.pl file - hope it's
what you need :

$c->{search}->{advanced} =
{
    search_fields => [
        { meta_fields => [ $EPrints::Utils::FULLTEXT ] },
        { meta_fields => [ "title" ] },
        { meta_fields => [ "creators_name" ] },
        { meta_fields => [ "dircreators_name" ] },
        { meta_fields => [ "abstract" ] },
        { meta_fields => [ "keywords" ] },
        { meta_fields => [ "subjects" ] },
        #{ meta_fields => [ "type" ] },
        { meta_fields => [ "divisions" ] },
        { meta_fields => [ "department" ] },

        #{ meta_fields => [ "ispublished" ] },
        #{ meta_fields => [ "refereed" ] },
        #{ meta_fields => [ "publication" ] },
        { meta_fields => [ "date" ] },
    ],
    preamble_phrase => "cgi/advsearch:preamble",
    title_phrase => "cgi/advsearch:adv_search",
    citation => "result",
    page_size => 20,
    order_methods => {

        "byyear"      => "-date/creators_name/title",

        "byyearoldest"     => "date/creators_name/title",
        "byname"       => "creators_name/-date/title",
        "bytitle"      => "title/creators_name/-date"
    },
    default_order => "byyear",
};

If necessary, I can add more content of this file or give you more details.

Thanks,

Jérémy

Le 17/09/2015 14:21, Field A.N. a écrit :
Hi Jérémy

Firstly, welcome to the community. I so happy that you've been able to work through most of your problems using our documentation, and in only two weeks!

Is your repository publicly visible? Can you give me its address so that I can have a play? Also, please post your advanced search configuration.

Best WIshes

--
Adam Field
Business Relationship Manager and Community Lead
EPrints Services
+44 (0)23 8059 8814

On 17 Sep 2015, at 09:18, Jérémy RAINGEARD wrote:

Hello,

My university asked me to help them with some eprints problems - I
didn't even know what eprints was - in only 2 weeks. I managed to
correct all problems thanks to your documentation, but I'm stuck with
the last problem and I have no error message to help me to resolve it.

First, when we used our advanced search and sorted results by date, it
only sorted it by author name even if we had a date > author > title
sorting. Now, I manage to sort it by date, but only from 2010 to 2015.
Before - probably an upgrade of eprints they told me - it's sometimes in
the right order, but sometimes not and, in this case, the order is by
the author name.

I don't know how to reorder the wrong ones. I checked my tables and saw
an "eprints__order_values_fr" - we don't use it's EN version. I don't
know if the problem is there but when thesis are in the good order, they
appear in this table and when they're in the wrong order, they're not in
it.

Could you please tell me how to correct this wrong behavior please ?
Thank you.

Jérémy

*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/
*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/

*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/

*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/

*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: http://www.eprints.org/tech.php/
*** EPrints community wiki: http://wiki.eprints.org/
*** EPrints developers Forum: http://forum.eprints.org/

References:
- [EP-tech] Advanced Search by date
  - From: Jérémy RAINGEARD <jeremy.raingeard@univ-tlse3.fr>
- [EP-tech] Re: Advanced Search by date
  - From: "Field A.N." <af05v@ecs.soton.ac.uk>
- [EP-tech] Re: Advanced Search by date
  - From: Jérémy RAINGEARD <jeremy.raingeard@univ-tlse3.fr>
- [EP-tech] Re: Advanced Search by date
  - From: "Field A.N." <af05v@ecs.soton.ac.uk>
- [EP-tech] Re: Advanced Search by date
  - From: Jérémy RAINGEARD <jeremy.raingeard@univ-tlse3.fr>

Prev by Date: [EP-tech] Re: Import Medatada and Files
Next by Date: [EP-tech] Re: How to set a field to be multilang (Imports brake)
Previous by thread: [EP-tech] Re: Advanced Search by date
Next by thread: [EP-tech] Re: Advanced Search by date
Index(es):
- Date
- Thread