Wiki Upgrade - Revision history

Beka: Reverted edits by Benedict (talk) to last revision by Plausible deniability

2017-12-28T04:51:42Z

Reverted edits by Benedict (talk) to last revision by Plausible deniability

← Older revision		Revision as of 21:51, 27 December 2017
Line 98:		Line 98:
	*** $ vagrant up		*** $ vagrant up
	** Now, copy the SQL dump file into your running MediaWiki virtualbox instance		** Now, copy the SQL dump file into your running MediaWiki virtualbox instance
	*** # in LOCAL_TERMINAL... (the Vagrant host bridge interface always gets an IP ~~address~~ of 10.11.12.14)		*** # in LOCAL_TERMINAL... (the Vagrant host bridge interface always gets an IP addres of 10.11.12.13)
	*** $ scp -i .vagrant/machines/default/virtualbox/private_key upgraded_noisebridge_wiki.sql.bz2 vagrant@10.11.12.14:		*** $ scp -i .vagrant/machines/default/virtualbox/private_key upgraded_noisebridge_wiki.sql.bz2 vagrant@10.11.12.13:
	** Noisebridge's MediaWiki database was configured with aall tablenames prefixed with "noisebridge_mediawiki"		** Noisebridge's MediaWiki database was configured with aall tablenames prefixed with "noisebridge_mediawiki"
	** We want to ensure this naming convention continues to work with the new		** We want to ensure this naming convention continues to work with the new
Line 146:		Line 146:
	::: ...et cetera.		::: ...et cetera.
	** At this point you may be able to visit the Noisebridge site on your dev machine by going to:		** At this point you may be able to visit the Noisebridge site on your dev machine by going to:
	:: http://127.0.0.1/wiki/Noisebridge		:: http://127.0.0.1:8080/wiki/Noisebridge
	** If this doesn't work it's likely some step was omitted from this doc, in which case ask Kevin or Trent for support.		** If this doesn't work it's likely some step was omitted from this doc, in which case ask Kevin or Trent for support.

Benedict at 04:01, 28 December 2017

2017-12-28T04:01:29Z

← Older revision		Revision as of 21:01, 27 December 2017
Line 98:		Line 98:
	*** $ vagrant up		*** $ vagrant up
	** Now, copy the SQL dump file into your running MediaWiki virtualbox instance		** Now, copy the SQL dump file into your running MediaWiki virtualbox instance
	*** # in LOCAL_TERMINAL... (the Vagrant host bridge interface always gets an IP ~~addres~~ of 10.11.12.13)		*** # in LOCAL_TERMINAL... (the Vagrant host bridge interface always gets an IP address of 10.11.12.14)
	*** $ scp -i .vagrant/machines/default/virtualbox/private_key upgraded_noisebridge_wiki.sql.bz2 vagrant@10.11.12.13:		*** $ scp -i .vagrant/machines/default/virtualbox/private_key upgraded_noisebridge_wiki.sql.bz2 vagrant@10.11.12.14:
	** Noisebridge's MediaWiki database was configured with aall tablenames prefixed with "noisebridge_mediawiki"		** Noisebridge's MediaWiki database was configured with aall tablenames prefixed with "noisebridge_mediawiki"
	** We want to ensure this naming convention continues to work with the new		** We want to ensure this naming convention continues to work with the new
Line 146:		Line 146:
	::: ...et cetera.		::: ...et cetera.
	** At this point you may be able to visit the Noisebridge site on your dev machine by going to:		** At this point you may be able to visit the Noisebridge site on your dev machine by going to:
	:: http://127.0.0.1~~:8080~~/wiki/Noisebridge		:: http://127.0.0.1/wiki/Noisebridge
	** If this doesn't work it's likely some step was omitted from this doc, in which case ask Kevin or Trent for support.		** If this doesn't work it's likely some step was omitted from this doc, in which case ask Kevin or Trent for support.

Plausible deniability at 02:45, 28 December 2017

2017-12-28T02:45:28Z

← Older revision		Revision as of 19:45, 27 December 2017
Line 91:		Line 91:
	*** https://www.mediawiki.org/wiki/MediaWiki-Vagrant		*** https://www.mediawiki.org/wiki/MediaWiki-Vagrant
	*** Install vagrant and virtualbox (OS X: http://sourabhbajaj.com/mac-setup/Vagrant/README.html)		*** Install vagrant and virtualbox (OS X: http://sourabhbajaj.com/mac-setup/Vagrant/README.html)
			*** # Open a terminal (we'll call this LOCAL_TERMINAL)
	*** $ cd vagrant		*** $ cd vagrant
			*** # We're going with the most recent stable LTS release (Long-Term Support)
			*** $ vagrant hiera mediawiki::branch REL1_27
	*** $ ./setup.sh		*** $ ./setup.sh
	*** $ vagrant up		*** $ vagrant up
	** ~~How to~~ copy ~~files~~ into virtualbox instance		** Now, copy the SQL dump file into your running MediaWiki virtualbox instance
	*** ~~Find your eth1 ip address:~~		*** # in LOCAL_TERMINAL... (the Vagrant host bridge interface always gets an IP addres of 10.11.12.13)
	**** $ /sbin/ifconfig # ~~and remember that as MW_IP_ADDR~~		*** $ scp -i .vagrant/machines/default/virtualbox/private_key upgraded_noisebridge_wiki.sql.bz2 vagrant@10.11.12.13:
	**** $ scp -i .vagrant/machines/default/virtualbox/private_key ~~YOUR_FILE_HERE~~ vagrant@~~MW_IP_ADDR~~:		** Noisebridge's MediaWiki database was configured with aall tablenames prefixed with "noisebridge_mediawiki"
	** Noisebridge's MediaWiki database was configured with ~~a tablename prefix of~~ "noisebridge_mediawiki"		** We want to ensure this naming convention continues to work with the new
	*** ~~Change~~ this in /vagrant/LocalSettings.php:		*** Open a new terminal window or tab, and SSH into the running Vagrant instance (and let's refer to this shell as VAGRANT_TERMINAL)
	***: $wgDBprefix = "noisebridge_mediawiki";		**** $ cd vagrant
	** ~~Use the default database name 'wiki' -~~ do not be clever and configure a different name, because `wiki` is a baked-in default somewhere in vagrant's puppet scripts, or maybe in mediawiki's CLI scripts, but either way IT CANNOT BE OVERRIDDEN IN LocalSettings.php or DefaultSettings.php, or --conf, or the 'dbname-prefixname' CLI parameter		**** $ vagrant ssh
	** ~~You may~~ need to drop and ~~create~~ the MySQL database 'wiki' to eliminate the default MediaWiki 1.31 structure, to avoid problems overwriting it with our old MW 1.19 schema mysqldump		*** # In VAGRANT_TERMINAL, add (or change) the config var $wgDBprefix in /vagrant/LocalSettings.php
			**** $ vi /vagrant/LocalSettings.php
			****: $wgDBprefix = "noisebridge_mediawiki";
			**** (NOTE: do not be clever and configure a different database name, because it turns out that `wiki` is a baked-in default somewhere in vagrant's puppet scripts. Or, maybe in mediawiki's CLI scripts, but either way IT CANNOT BE OVERRIDDEN IN LocalSettings.php or DefaultSettings.php, or --conf, or the 'dbname-prefixname' CLI parameter. If you choose to change it, just know that it is a rabbit hole that will consume an hour of your life unproductively).
			** To install the Noisebridge.net wiki database on your MediaWiki-Vagrant instance, you will need to drop and recreate the MySQL database 'wiki' in order to eliminate the default MediaWiki 1.31 structure, to avoid problems overwriting it with our old MW 1.19 schema mysqldump
			** # Do this in VAGRANT_TERMINAL
	:: $ mysql		:: $ mysql
	:: > drop database wiki;		:: > drop database wiki;
	:: > create database wiki;		:: > create database wiki;
	:: > ^D		:: > ^D (that's a Control-D, as in hold down the Control key on your keyboard and strike the D key)
	:: $ mysql wiki < ~~the-uncompressed-mysqldump-file-you-were-provided-with.sql~~		:: $ bunzip2 -dc ~/upgraded_noisebridge_wiki.sql.bz2 \| mysql wiki < ~
	:: You may safely ignore messages like "Warning (Code 1300): Invalid utf8 character string: 'BD5A6D'"		:: (NOTE: You may safely ignore messages like "Warning (Code 1300): Invalid utf8 character string: 'BD5A6D'")
	** Now run the upgrade script:		** Now run the upgrade script: (in VAGRANT_TERMINAL)
	:: $ cd /vagrant/mediawiki/maintenance/		:: $ cd /vagrant/mediawiki/maintenance/
	:: $ mwscript update.php		:: $ mwscript update.php

Plausible deniability: improving page structure

2017-12-27T21:31:31Z

improving page structure

← Older revision		Revision as of 14:31, 27 December 2017
Line 76:		Line 76:
	=== Things We Deleted ===		=== Things We Deleted ===

	## purged password hashes - noisebridge_mediawikiuser.user_password all set to '' (empty string)		# purged password hashes - noisebridge_mediawikiuser.user_password all set to '' (empty string)
	### update <table> set <column>='';		## update <table> set <column> = ' ';
	## purged user emails - noisebridge_mediawikiuser.user_email all set to '' (empty string)		# purged user emails - noisebridge_mediawikiuser.user_email all set to '' (empty string)
	### update <table> set <column>='';		## update <table> set <column> = ' ';
			# purged noisebridge_mediawikiipblocks.ipb_address - replaced the composite primary key column with a sequence as follows: https://stackoverflow.com/questions/2643371/how-to-renumber-primary-index

	## purged noisebridge_mediawikiipblocks.ipb_address - replaced the composite primary key column with a sequence as follows: https://stackoverflow.com/questions/2643371/how-to-renumber-primary-index

	## truncated user watchlists (these are private)		## truncated user watchlists (these are private)
	### truncate table noisebridge_mediawikiwatchlist;		### truncate table noisebridge_mediawikiwatchlist;
			# truncated all protected tables (these might give private info on who protected the page?)
			## truncate table noisebridge_mediawikiprotected_titles;

	~~## truncated all protected tables (these might give private info on who protected the page?)~~		=== Overview and Instructions for Installing MediaWiki & Noisebridge Wiki via Vagrant ===
	~~### truncate table noisebridge_mediawikiprotected_titles;~~

	=== ~~Important How-tos~~ and ~~Gotchas~~ ===
	* MediaWiki upgrade for NB		* MediaWiki upgrade for NB
	** Follow directions for setting up local Vagrant instance on your development machine:		** Follow directions for setting up local Vagrant instance on your development machine:
			*** https://www.mediawiki.org/wiki/MediaWiki-Vagrant
	*** Install vagrant and virtualbox (OS X: http://sourabhbajaj.com/mac-setup/Vagrant/README.html)		*** Install vagrant and virtualbox (OS X: http://sourabhbajaj.com/mac-setup/Vagrant/README.html)
	*** $ cd vagrant		*** $ cd vagrant

192.241.210.237: /* Noisebridge Wiki Database Fixing w/ Kevin 2017.12.23 */

2017-12-24T07:16:33Z

Noisebridge Wiki Database Fixing w/ Kevin 2017.12.23

← Older revision		Revision as of 00:16, 24 December 2017
Line 69:		Line 69:


	== Noisebridge Wiki Database Fixing w/ Kevin 2017.12.23 ==		== Noisebridge Wiki Database Fixing w/ Kevin & Trent 2017.12.23 ==

	This is a log of what we did to a local copy of Noisebridge wiki database. These changes were not propogated to the live/production Noisebridge MediaWiki instance.		This is a log of what we did to a local copy of Noisebridge wiki database. These changes were not propogated to the live/production Noisebridge MediaWiki instance.

Plausible deniability at 07:10, 24 December 2017

2017-12-24T07:10:37Z

← Older revision		Revision as of 00:10, 24 December 2017
Line 90:		Line 90:
	### truncate table noisebridge_mediawikiprotected_titles;		### truncate table noisebridge_mediawikiprotected_titles;

			=== Important How-tos and Gotchas ===
			* MediaWiki upgrade for NB
			** Follow directions for setting up local Vagrant instance on your development machine:
			*** Install vagrant and virtualbox (OS X: http://sourabhbajaj.com/mac-setup/Vagrant/README.html)
			*** $ cd vagrant
			*** $ ./setup.sh
			*** $ vagrant up
			** How to copy files into virtualbox instance
			*** Find your eth1 ip address:
			**** $ /sbin/ifconfig # and remember that as MW_IP_ADDR
			**** $ scp -i .vagrant/machines/default/virtualbox/private_key YOUR_FILE_HERE vagrant@MW_IP_ADDR:
			** Noisebridge's MediaWiki database was configured with a tablename prefix of "noisebridge_mediawiki"
			*** Change this in /vagrant/LocalSettings.php:
			***: $wgDBprefix = "noisebridge_mediawiki";
			** Use the default database name 'wiki' - do not be clever and configure a different name, because `wiki` is a baked-in default somewhere in vagrant's puppet scripts, or maybe in mediawiki's CLI scripts, but either way IT CANNOT BE OVERRIDDEN IN LocalSettings.php or DefaultSettings.php, or --conf, or the 'dbname-prefixname' CLI parameter
			** You may need to drop and create the MySQL database 'wiki' to eliminate the default MediaWiki 1.31 structure, to avoid problems overwriting it with our old MW 1.19 schema mysqldump
			:: $ mysql
			:: > drop database wiki;
			:: > create database wiki;
			:: > ^D
			:: $ mysql wiki < the-uncompressed-mysqldump-file-you-were-provided-with.sql
			:: You may safely ignore messages like "Warning (Code 1300): Invalid utf8 character string: 'BD5A6D'"
			** Now run the upgrade script:
			:: $ cd /vagrant/mediawiki/maintenance/
			:: $ mwscript update.php
			:: If all goes as planned you'll see a bunch of advisory progress messages such as:
			::: Your composer.lock file is up to date with current dependencies!
			::: Going to run database updates for wiki-noisebridge_mediawiki
			::: Depending on the size of your database this may take a while!
			::: Abort with control-c in the next five seconds (skip this countdown with --quick) ... 0
			::: Turning off Content Handler DB fields for this part of upgrade.
			::: ...have ipb_id field in ipblocks table.
			::: ...have ipb_expiry field in ipblocks table.
			::: ...already have interwiki table
			::: ...indexes seem up to 20031107 standards.
			::: ...have rc_type field in recentchanges table.
			::: ...index new_name_timestamp already set on recentchanges table.
			::: ...have user_real_name field in user table.
			::: ...
			::: ...doing rev_id from 2001 to 2200
			::: ...doing rev_id from 2201 to 2400
			::: ...doing rev_id from 2401 to 2600
			::: ...doing rev_id from 2601 to 2800
			::: ...doing rev_id from 2801 to 3000
			::: ...checking 40 revisions for IP edits that need copying, between rev_ids 20100 and 20300
			::: ...checking 49 revisions for IP edits that need copying, between rev_ids 20301 and 20501
			::: ...checking 74 revisions for IP edits that need copying, between rev_ids 20502 and 20702
			::: ...checking 48 revisions for IP edits that need copying, between rev_ids 20703 and 20903
			::: ...checking 41 revisions for IP edits that need copying, between rev_ids 20904 and 21104
			::: ...et cetera.
			** At this point you may be able to visit the Noisebridge site on your dev machine by going to:
			:: http://127.0.0.1:8080/wiki/Noisebridge
			** If this doesn't work it's likely some step was omitted from this doc, in which case ask Kevin or Trent for support.

	=== FUTURE Database Hacking Plans ===		=== FUTURE Database Hacking Plans ===

192.241.210.237: added db hacking session

2017-12-24T04:02:58Z

added db hacking session

← Older revision		Revision as of 21:02, 23 December 2017
Line 66:		Line 66:

	</code>		</code>



			== Noisebridge Wiki Database Fixing w/ Kevin 2017.12.23 ==

			This is a log of what we did to a local copy of Noisebridge wiki database. These changes were not propogated to the live/production Noisebridge MediaWiki instance.


			=== Things We Deleted ===

			## purged password hashes - noisebridge_mediawikiuser.user_password all set to '' (empty string)
			### update <table> set <column>='';
			## purged user emails - noisebridge_mediawikiuser.user_email all set to '' (empty string)
			### update <table> set <column>='';


			## purged noisebridge_mediawikiipblocks.ipb_address - replaced the composite primary key column with a sequence as follows: https://stackoverflow.com/questions/2643371/how-to-renumber-primary-index

			## truncated user watchlists (these are private)
			### truncate table noisebridge_mediawikiwatchlist;

			## truncated all protected tables (these might give private info on who protected the page?)
			### truncate table noisebridge_mediawikiprotected_titles;


			=== FUTURE Database Hacking Plans ===


			==== FUTURE ACTION: After Upgrading we can expire everyone's password ====

			details here: https://noisebridge.net/wiki/Wiki_Upgrade
			and here: https://www.mediawiki.org/wiki/Manual:User_table#user_password_expires

			==== FUTURE ACTIONS ====

			# reduce permissions for inactive moderators, admins, etc, to "user".
			## really drop everyone and add current people back, to make it an intentional process
			## be very restrictive about CURRENT active users

192.241.210.237: added user table data dictionary

2017-12-24T02:34:36Z

added user table data dictionary

← Older revision		Revision as of 19:34, 23 December 2017
Line 53:		Line 53:

	=== Password Rollover ===		=== Password Rollover ===

			Here is the mediawiki default user table data dictionary: https://www.mediawiki.org/wiki/Manual:User_table

	We need to delete the password column and expire everyone's password. The old mediawiki only stores md5 hashed passwords with no salts, so we'll have to delete the whole thing		We need to delete the password column and expire everyone's password. The old mediawiki only stores md5 hashed passwords with no salts, so we'll have to delete the whole thing

185.38.14.215 at 17:30, 21 December 2017

2017-12-21T17:30:59Z

← Older revision		Revision as of 10:30, 21 December 2017
Line 64:		Line 64:

	</code>		</code>


	~~=== Sandbox ===~~

	I have some servers available that could be setup on-site and used to host a "copy" of the existing wiki and experiment with updating it. I tend to run Arch on these machines, like the one attached to "wheels" in Turing, I'd imagine putting a vagrant/virtualbox debian environment on there to start with.

	~~Planning to be around quite a bit next week and can work on this between CCC streams.~~

	~~[[User:Ⅹ\|Ⅹ]] ([[User talk:Ⅹ\|talk]]) 06:53, 21 December 2017 (UTC)~~

Ⅹ: sandbox/dev boxes

2017-12-21T06:53:35Z

sandbox/dev boxes

← Older revision		Revision as of 23:53, 20 December 2017
Line 64:		Line 64:

	</code>		</code>


			=== Sandbox ===

			I have some servers available that could be setup on-site and used to host a "copy" of the existing wiki and experiment with updating it. I tend to run Arch on these machines, like the one attached to "wheels" in Turing, I'd imagine putting a vagrant/virtualbox debian environment on there to start with.

			Planning to be around quite a bit next week and can work on this between CCC streams.

			[[User:Ⅹ\|Ⅹ]] ([[User talk:Ⅹ\|talk]]) 06:53, 21 December 2017 (UTC)