Page view results are wrong after log import

@Mooash wrote:

I’ve been importing logs from a free API service I’m running (https://geojs.io) and it has been working great for 1-2 months however for about a week its been reporting the page views (the metric I actually care about) as completely wrong. Here is the output from an real log import:

Logs import summary
-------------------

    11888 requests imported successfully
    4 requests were downloads
    11 requests ignored:
        0 HTTP errors
        0 HTTP redirects
        0 invalid log lines
        0 requests did not match any known site
        11 requests did not match any --hostname
        0 requests done by bots, search engines...
        0 requests to static resources (css, js, images, ico, ttf...)
        0 requests to file downloads did not match any --download-extensions

Website import summary
----------------------

    11888 requests imported to 1 sites
        1 sites already existed
        0 sites were created:

    0 distinct hostnames did not match any existing site:



Performance summary
-------------------

    Total time: 44 seconds
    Requests imported per second: 269.99 requests per second

Processing your log data
------------------------

    In order for your logs to be processed by Piwik, you may need to run the following command:
     ./console core:archive --force-all-websites --force-all-periods=315576000 --force-date-last-n=1000

Whilst this does look right, the page views for the day only report around 8000 hits, which is completely off. The last few days are also off with 20k+ page views but only showing 4-6k views inside Piwik (completely off). I’ve tried invalidating the archive tables using the below:

root@piwik:/var/www/piwik# ./console core:invalidate-report-data --sites=13 --periods=all --dates=2017-10-27,2015-11-13
Invalidating day periods in 2017-10-27,2015-11-13 [segment = ]...
Invalidating week periods in 2017-10-27,2015-11-13 [segment = ]...
Invalidating month periods in 2017-10-27,2015-11-13 [segment = ]...
Invalidating year periods in 2017-10-27,2015-11-13 [segment = ]...

And reprocessing the logs however it didn’t work. Any idea what else I can do?

I’m running Ubuntu 16.04, Piwik 3.2.0 and PHP 7.0.22. I also had to run the below SQL a few weeks ago to get Piwik to import new logs as it was choking, could this be the cause of my issues?

ALTER TABLE `piwik_log_visit` CHANGE `visit_total_interactions` `visit_total_interactions` MEDIUMINT(5) UNSIGNED NULL DEFAULT '0';

Edit: it looks like the dates do sadly add up with that error. Image may be NSFW.
Clik here to view. Is there an easy way for me to undo the damage I’ve done?

Posts: 1

Participants: 1

Read full topic