EPrints Technical Mailing List Archive

Message: #07696

< Previous (by date) | Next (by date) > | < Previous (in thread) | Next (in thread) > | Messages - Most Recent First | Threads - Most Recent First

Re: [EP-tech] Error when running irstats

Hi Agung,
I think this might be a problem with how MySQL handles UTF-8 data.

What MySQL refers to as UTF-8 cannot handle 4-byte UTF-8 characters.
Yes - this is very stupid

This explains it well: https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmathiasbynens.be%2Fnotes%2Fmysql-utf8mb4&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=0Fe4vZYE86uDtRmBOifeCwDYg%2FDM6jkWk%2FWs0PBzMcA%3D&amp;reserved=0, and has some solutions.

This might also be useful:
https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Feprints%2Feprints%2Fissues%2F386&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=y12mxKDzFH2LE%2FJs7X01g19TtrVuz84%2F6fWjMCcgfe4%3D&amp;reserved=0

Does that help at all?

Cheers,
John

-----Original Message-----
From: eprints-tech-bounces@ecs.soton.ac.uk [mailto:eprints-tech-bounces@ecs.soton.ac.uk] On Behalf Of Yuri Carrer via Eprints-tech
Sent: 13 February 2019 08:04
To: eprints-tech@ecs.soton.ac.uk
Subject: Re: [EP-tech] Error when running irstats

in /usr/share/eprints3/lib/plugins/EPrints/Stats/Handler.pm , at the 
beginning.

Il 13/02/19 08:36, Ajunk Pracetio ha scritto:
> Hi,
>
> Where I can activate this debug?
>
> Thank you
>
> Best regards,
> Agung Prasetyo W.
>
> On Wed, Feb 13, 2019 at 2:16 PM Yuri via Eprints-tech 
> <eprints-tech@ecs.soton.ac.uk <mailto:eprints-tech@ecs.soton.ac.uk>> 
> wrote:
>
>     https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstackoverflow.com%2Fquestions%2F10957238%2Fincorrect-string-value-when-trying-to-insert-utf-8-into-mysql-via-jdbc&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=F0FowvE6uPr0dLweun1qESpuRSUqAdZtWZ4s6IYuFf0%3D&amp;reserved=0
>
>     maybe this?
>
>     \xF76 should be a four byte utf-8. But Eprints itself don't have this
>     problem, so it is something in Irstats connection or irstat tables
>     with
>     different column encoding. Anyway, you can activate
>
>     my $DEBUG_SQL = 0; (switch to 1) to debug the sql.
>
>     Il 13/02/19 01:58, Ajunk Pracetio via Eprints-tech ha scritto:
>     > Hi,
>     >
>     > Previously, I migrated eprints 3.3.12 to 3.4 on Ubuntu 12.04 LTS.
>     > Currently I have managed to move eprints from an old server to a
>     > server using Ubuntu 16.04 LTS.
>     >
>     > Only, when doing the irstats process, the *process_stats REPOID
>     > --setup --verbose* command appears an error like the following:
>     >
>     > *DBD::mysql::st execute failed: Incorrect string value: '\xF76' for
>     > column 'value' at row 1 at
>     > /usr/share/eprints3/lib/plugins/EPrints/Stats/Handler.pm line 653.
>     > ....
>     > DBD::mysql::st execute failed: Data too long for column 'value'
>     at row
>     > 1 at /usr/share/eprints3/lib/plugins/EPrints/Stats/Handler.pm
>     line 653.*
>     >
>     > Did this error occur because our previous database actually came
>     from
>     > the version of mysql 5.5.54 (eprints 3.3.12 and Ubuntu 12.04) and
>     > changed to mysql 5.7.25 (eprints 3.4 and Ubuntu 16.04).
>     >
>     > I have searched Google and haven't found a solution. Can anyone
>     help
>     > us with this error? Then will this error affect the amount of data
>     > displayed on IRStats?
>     >
>     > thank you.
>     >
>     > Best regards.
>     > Agung Prasetyo W.
>     >
>     > --
>     > Life isn't valuable if you don't have someone to care
>     >
>     > Blog :
>     https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fagungprasetyo.net%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=dCZ%2Bossnc8J13V7vBykC0vu%2BEJX3YCfH7kdkRMeYlX8%3D&amp;reserved=0
>
>     >
>     <https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fagungprasetyo.net%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=dCZ%2Bossnc8J13V7vBykC0vu%2BEJX3YCfH7kdkRMeYlX8%3D&amp;reserved=0>
>     > IG & Twitter : prazetyo
>     >
>     > *** Options:
>     http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
>     > *** Archive:
>     https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=VANda2EEXjGKyg63LDwQ6MN9GMZov5x2Ldj0SEXRXUY%3D&amp;reserved=0
>     > *** EPrints community wiki:
>     https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=X%2FGlGV90vn6PvNC66uSRlsor30u1lYwmQOtCFbk29Qs%3D&amp;reserved=0
>     > *** EPrints developers Forum:
>     https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fforum.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=a8c6GwhWVw2oPpqj6dpBPMe%2Ffw9v6MIkvXt1RBFcTT4%3D&amp;reserved=0
>     *** Options:
>     http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
>     *** Archive: https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=VANda2EEXjGKyg63LDwQ6MN9GMZov5x2Ldj0SEXRXUY%3D&amp;reserved=0
>     *** EPrints community wiki: https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=X%2FGlGV90vn6PvNC66uSRlsor30u1lYwmQOtCFbk29Qs%3D&amp;reserved=0
>     *** EPrints developers Forum: https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fforum.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=a8c6GwhWVw2oPpqj6dpBPMe%2Ffw9v6MIkvXt1RBFcTT4%3D&amp;reserved=0
>
>
>
> -- 
> Life isn't valuable if you don't have someone to care
>
> Blog : https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fagungprasetyo.net%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=dCZ%2Bossnc8J13V7vBykC0vu%2BEJX3YCfH7kdkRMeYlX8%3D&amp;reserved=0
> IG & Twitter : prazetyo

-- 
Yuri Carrer

  CAB - Centro di Ateneo per le Biblioteche, Università di Padova
  Tel: 049/827 3615 - Via Anghinoni, 3 - Padova


*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=VANda2EEXjGKyg63LDwQ6MN9GMZov5x2Ldj0SEXRXUY%3D&amp;reserved=0
*** EPrints community wiki: https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=X%2FGlGV90vn6PvNC66uSRlsor30u1lYwmQOtCFbk29Qs%3D&amp;reserved=0
*** EPrints developers Forum: https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fforum.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C3d6bf4f680ee4fb834d408d69292c893%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&amp;sdata=a8c6GwhWVw2oPpqj6dpBPMe%2Ffw9v6MIkvXt1RBFcTT4%3D&amp;reserved=0