Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 880071 - Gentoo Forums phpBB Upgrade
Summary: Gentoo Forums phpBB Upgrade
Status: CONFIRMED
Alias: None
Product: Gentoo Infrastructure
Classification: Unclassified
Component: Forums (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Gentoo Infrastructure
URL:
Whiteboard:
Keywords:
Depends on: 911329
Blocks: 431106 698840 761073
  Show dependency tree
 
Reported: 2022-11-06 16:38 UTC by Chiitoo
Modified: 2024-01-17 17:00 UTC (History)
9 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Chiitoo gentoo-dev 2022-11-06 16:38:45 UTC
Per infra request, this bug is to track the progress of the upgrade from phpBB-2 to phpBB-3, which has been in progress since at least 2017.

We have several people around who technically can go through the migration, but as I understand it, there are some specifics related to our infra set-up that infra needs to handle.

Thank you.
Comment 1 Alec Warner (RETIRED) archtester gentoo-dev Security 2022-11-06 18:44:03 UTC
Dumping some state here:

The forums is running very old software; for a while now the forum-mods team has requested an upgrade.

I did some work in 2020-2021 to test the upgrade; I'm trying to document what I did on this bug.

On forumstest.gentoo.org:
 - Installed phpbb-3.3.1.tar.bz2 into /var/www/forumstest.gentoo.org/htdocs-3.3.1
 - Symlinked htdocs => htdocs-3.3.1 in that directory.
 - Clone https://anongit.gentoo.org/git/proj/forums.git into htdocs/styles/.gentoo-themes
 - Symlink htdocs/styles/gentoo => ./.gentoo-themes
 - edit htdocs/config.php to set the correct database username / password / databasename. For testing, I used 'forumstest_rw' as the user, the proper password, and 'gentoo_forummigration' as the tablename.
 - Then you can login to the 3.X forums and do a "conversion" in the installer.

The conversion will need the phpbb-2.x tablenames, and the user you are connecting to the DB will need RO access to the phpbb-2.x databases. The conversion itself:
 - Will take probably 1-2 days.
 - Its automated, but buggy.
 - Make sure you adjust the haproxy / nginx timeouts to be longer, we do not want the migration connection to drop; as it will disrupt the migration.
 - The migration is not resumable.
 - Connectivity is you => nginx => php-pool, you generally want 900s timeout for each hop?
 - Maybe longer.

Run: 
/etc/nginx/vhosts.d/puppet/forumstest.gentoo.org # diff -u ../forums.gentoo.org/vhost.conf vhost.conf

To see what nginx changes I did for the test migration.

The migration itself hit a few snags (I'll add more stuff later, this is an incomplete list of snags.)

 - We are basically making a copy of the forums database, its non-trivial size and we also have binlogs; so at one point we ran out of space on the DB servers. Ensure sufficient space is available (afaik we added more space to address this issue.)
 - There is some shared-key-prefix thing that was not properly set in the migration and the key is used to generate some assets; and the fact that this key was not properly copied meant some of the imports did not work right. I need to follow up in my IRC logs on this.
 - Some posts were not properly converted (probably an encoding issue) but it seemed like a small number so we had not considered it a blocker.
Comment 2 Alec Warner (RETIRED) archtester gentoo-dev Security 2022-11-06 18:48:21 UTC
Notes for myself: 2021-06-10 - 2021-07-02 was the last test; harvest it for the prefix key thing; I gotta run will update later.
Comment 3 Chiitoo gentoo-dev 2022-11-06 19:17:06 UTC
(In reply to Alec Warner from comment #1)
> Dumping some state here:

Thanks!

>  - Installed phpbb-3.3.1.tar.bz2 into

For any future runs, I would recommend using 3.0.x first, since the migration tool is a lot less tested on later releases (this should let us avoid some bugs, although I can't say for sure those will be anything we would see).

After migrating to 3.0.x, upgrade as one normally would (not sure how safe it is to go from 3.0.x straight to current).
Comment 4 Chiitoo gentoo-dev 2023-05-11 22:51:55 UTC
Friendly ping in case we're still doing this.  :]
Comment 5 Joe B 2024-01-06 01:55:40 UTC
I was wondering if this was still a thing. Started getting into Gentoo and i would like to browse on my phone instead of pinching and zooming