Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 653702 - Gentoo Planet not indexing posts from rafaelmartins' blog
Summary: Gentoo Planet not indexing posts from rafaelmartins' blog
Status: RESOLVED FIXED
Alias: None
Product: Websites
Classification: Unclassified
Component: Planet (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Planet Gentoo
URL: http://feeds.rgm.io/rafaelmartins-gen...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2018-04-21 15:15 UTC by Rafael Martins (RETIRED)
Modified: 2018-07-13 08:42 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Rafael Martins (RETIRED) gentoo-dev 2018-04-21 15:15:52 UTC
Hi,

it seems that the Gentoo Planet is not even trying to index any posts from my blog feed. I can't see any HTTP request from Gentoo infra for a long time. Settings seems to be correct in the planet git repo.

Can you please check?

Thanks!

Reproducible: Always
Comment 1 Michael Palimaka (kensington) gentoo-dev 2018-04-21 22:34:55 UTC
I can't see any errors in the planet/universe cron email, CCIng infra for someone to check further in the backend.
Comment 2 Rafael Martins (RETIRED) gentoo-dev 2018-04-22 12:20:59 UTC
some time ago I got bug 569570, that was exactly the opposite of this bug: there where errors in the logs, but everything was fine from my side. maybe they are somewhat related?
Comment 3 Michael Palimaka (kensington) gentoo-dev 2018-04-26 12:50:27 UTC
I recall seeing that error in the mailed log, however that's no longer present. I don't have access to any other logs beyond the fetch log that's mailed to me and it doesn't include any errors for your blog, so we need to wait for someone from infra to look further.
Comment 4 Rafael Martins (RETIRED) gentoo-dev 2018-07-01 16:33:55 UTC
I ran venus with the planet settings from git, only changing paths, and it indexed my blog properly.
Comment 5 Rafael Martins (RETIRED) gentoo-dev 2018-07-02 08:34:55 UTC
Also, I spent some time investigating this yesterday, and found out that the OPML feed still lists the old feed URL: https://planet.gentoo.org/opml.xml
Comment 6 Michael Palimaka (kensington) gentoo-dev 2018-07-05 10:22:35 UTC
We need to wait for infra to investigate. The configuration looks correct (https://gitweb.gentoo.org/sites/planet.git/plain/configs/planet/rafaelmartins) and only infra has access to the box to check what is going on.
Comment 7 Rafael Martins (RETIRED) gentoo-dev 2018-07-05 17:29:16 UTC
(In reply to Michael Palimaka (kensington) from comment #6)
> We need to wait for infra to investigate. The configuration looks correct
> (https://gitweb.gentoo.org/sites/planet.git/plain/configs/planet/
> rafaelmartins) and only infra has access to the box to check what is going
> on.

yeah, according to my testing the configs are all fine, and seems to be an infra problem. thanks for looking at it
Comment 8 Rafael Martins (RETIRED) gentoo-dev 2018-07-13 08:42:11 UTC
I fixed this last night with help from jmbsvicetto. I'll explain the issue here for the record:

The current URL in my planet configs used to be an S3 bucket, redirecting to another S3 bucket. At some point I moved it all to a personal server, removing the redirect, but venus was still hitting the old url (that still happened to be valid, I do not deleted the old S3 bugs), despite the planet configs. It happened because Amazon S3 redirects are HTTP 301, that means permanent redirects, and venus cached that info.

I fixed the issue by making the old S3 bucket redirect back to the new URL, with 301, and now it works, even after I removed the redirects. And as the configured URLs and the final redirect URLs are the same, I think that things should work as expected now.

A venus cache clean could still be useful, though.