Difference between revisions of "Wikistats/ToDo"

From S23Wiki
Jump to: navigation, search
m ([x] Fix all [http://s23.org/wikistats/opensuse_html.php Opensuse] 302 redirects)
m (Tasks for Wikistats: [x] Fix the [http://s23.org/wikistats/scoutwiki_html.php ScoutWiki] JP Version URL)
Line 3: Line 3:
[1] Merge [http://s23.org/wikistats/gentoo_html.php Gentoo] -smallest table- back into Mediawikis (mutante)
[1] Merge [http://s23.org/wikistats/gentoo_html.php Gentoo] -smallest table- back into Mediawikis (mutante)
[x] Fix all [http://s23.org/wikistats/opensuse_html.php Opensuse] 302 redirects (mutante)
[x] Fix all [http://s23.org/wikistats/opensuse_html.php Opensuse] 302 redirects (mutante)
[1] Fix the [http://s23.org/wikistats/scoutwiki_html.php ScoutWiki] JP Version URL (mutante)
[x] Fix the [http://s23.org/wikistats/scoutwiki_html.php ScoutWiki] JP Version URL (mutante)
[1] Add HTTP Status column to [http://s23.org/wikistats/wikitravel_html.php WikiTravel] and [http://s23.org/wikistats/anarchopedias_html.php Anarchopedia] (mutante)
[1] Add HTTP Status column to [http://s23.org/wikistats/wikitravel_html.php WikiTravel] and [http://s23.org/wikistats/anarchopedias_html.php Anarchopedia] (mutante)
[ ] Multilingual seperated in table , see below
[ ] Multilingual seperated in table , see below

Revision as of 12:26, 27 April 2010

Tasks for Wikistats

<tasks> [1] Merge Gentoo -smallest table- back into Mediawikis (mutante) [x] Fix all Opensuse 302 redirects (mutante) [x] Fix the ScoutWiki JP Version URL (mutante) [1] Add HTTP Status column to WikiTravel and Anarchopedia (mutante) [ ] Multilingual seperated in table , see below [2] Reactive the Mediawiki extention for Wikistats, see WSA log below not working | Fatal error: Unsupported operand types in /var/www/w/includes/parser/LinkHolderArray.php on line 33 (mutante) [1] #Add/update a list of sites using a particular MediaWiki extension (qoreqyas) </tasks>

[23:59:30] <danny.b> i thought it would be like:
*** 2010-03-16
[00:00:55] <danny.b@> №  ↓ 	Language  ↓ 	Language (local)  ↓ 	Wiki  ↓ 	Good  ↓ 	Total  ↓ 	Edits  ↓ 	Admins  ↓ 	Users  ↓ 	Images  ↓ 	Updated  ↓
1 	English 	English 	en 	12056 	81933 	545316 	27 	208008 	7546 	2010-03-14 13:00:06
2 	French 	Français 	fr 	6748 	19273 	195935 	10 	7705 	152 	2010-03-14 13:00:09
3 	German 	Deutsch 	de 	2065 	26856 	216775 	13 	7906 	1625 	2010-03-14 13:00:12
5 	Czech 	Česky 	cs 	1517 	3723 	17463 	3 	1351 	4 	2010-03-14 13:00:22
6 	Spanish 	Español 	es 	912 	3986 	46042 	9 	11183 	23 	2010-03-14 13:00:07
7 	Italian 	Italiano 	it 	860 	8342 	55656 	3 	4176 	358 	2010-03-14 13:00:10
8 	Portuguese 	Português 	pt 	711 	4554 	24657 	1 	2730 	10 	2010-03-14 13:00:04
9 	Russian 	Russian language 	ru 	539 	1931 	18795 	2 	1944 	45 	2010-03-14 13:00:25
10 	Greek 	Ελληνικά 	el 	395 	2803 	19483 	3 	1161 	61 	2010-03-14 13:00:20
11 	Finnish 	Suomi 	fi 	224 	589 	3429 	2 	559 	1 	2010-03-14 13:00:23
12 	Japanese 	日本語 	ja 	118 	1325 	4948 	4 	1263 	2 	2010-03-14 13:00:03
-- 	Multilingual 	Multilingual 	beta 	1781 	6683 	64455 	16 	7946 	183 	2010-03-14 13:00:19

Regularly observe

WSA log

<wikistats type="wsalog"></wikistats>

Retrieve method codes

mysql> select textstats as method,count(id) as num_used from mediawikis group by textstats;
| method | num_used |
|      0 |     1097 |
|      1 |       26 |
|      2 |       72 |
|      3 |       18 |
|      4 |        1 |
|      5 |        2 |
6 rows in set (0.01 sec)

update schedule

See also

Detected Errors

<wikistats type="inactive"></wikistats>

Request for adding wikis

Please add these wikis:

Thank you, Sergey Chernyshev 17:34, 25 May 2009 (UTC)

The third one had not a working statistics, the other two are added. RobiH 18:57, 25 May 2009 (UTC)

Hello, I hope I'm right here, can you add the following German wikis (mediaWiki), they all have more than 1.000 articles:

Thank you!--Yatina 00:04, 19 August 2008 (CEST)

Done. RobiH 22:04, 19 August 2008 (CEST)

Hello, I have just noticed that my wiki is not in the list: WikiSara Can you add it, please?--G.E. 16:54, 3 December 2008 (CET)

It is a Wikia. It will automatically be included from the official Wikia hostlist as soon as it appears there. RobiH 17:40, 14 January 2009 (UTC)

Hi, I've also noticed that a wiki I work on is not on the list: *Wikia Gaming Thanks. -- Wikia Gaming - AlphaTwo

Gaming Wikia is listed as "Cheatbase". RobiH 17:38, 14 January 2009 (UTC)
Hi, according to thiswikia has more than 6000 wiki sites now.It seems that wikia wikis created in recent time were not automatically included.--Ffaarr 03:24, 18 February 2009 (UTC)
some of the newly created sites in wikia are in this list--Ffaarr 02:53, 20 February 2009 (UTC)

Before we had 3362 Wikias. What ? 3362 vs. > 6000 ?

Damn?! Really?

starting ./hostlists/update_wikia.sh

Warning: file_get_contents(http://www.wikia.com/dbdumps/dbdumps.html): failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found


Made new hostlist update script, fetching data from

http://www.wikia.com/wiki/Wikia:List_of_Wikia/A http://www.wikia.com/wiki/Wikia:List_of_Wikia/D http://www.wikia.com/wiki/Wikia:List_of_Wikia/H http://www.wikia.com/wiki/Wikia:List_of_Wikia/M http://www.wikia.com/wiki/Wikia:List_of_Wikia/Q http://www.wikia.com/wiki/Wikia:List_of_Wikia/T

found 7232 lines (wikis) in the update file after running it,..

now inserting...and trying to fetch data...

mysql> delete from wikia; Query OK, 3362 rows affected (0.06 sec)

inserting from new file (with --force so duplicates do not stop others from being inserted)


7201 Wikis in database

Mutante 12:04, 23 February 2009 (UTC)

Thank you very much for adding a lot of sites into stats.

But I found many of the sites included before are now not listed in. For example [1][2] etc. I tried to find the reason and just found that the list here are not auto-added but added by hand. So there are many sites missed in that list and some sites are listed twice.

The List of the New ones has been added. RobiH 16:32, 25 February 2009 (UTC)

I found this site [3] are the complete sites for wikia.(Even the sites created this week are included)Is this data convenient to be inserted in?

This List is password protected and cannot be harvested by our robot. RobiH 16:32, 25 February 2009 (UTC)

Thank you very much.--Ffaarr 14:04, 23 February 2009 (UTC)

Ffaarr, maybe, if you have more contacts with Wikia people, try to convince them its a nice thing to provide a URL with a list of ALL Wikias that can be seen public without having to login. It would be perfect if it was: complete (including ALL Wikias), free of dupes, always up to date or at least updated frequently, publicly accesible and in plain text, XML or some form that is easy to parse. Shouldnt be that much work for somebody who has Wikia shell access, i think, just have to find the right people to talk into it. Mutante 20:47, 25 February 2009 (UTC)

Thank you very much.Newly created sites(maybe after 2007)are all included in these lists and newly created sites are daily updated by bot. this list here(the list you just adde in) So the newer sites are very complete now and only some of old sites sites created before 2007 are not listed in. I'll try to ask wikia for more complete information.

Another question.Does sites hosted by wikia but with different domain(like wowwiki.com/ memory-alpha.org/ wiki.ffxiclopedia.org/ etc)listed in this table?Thank you very much.--Ffaarr 01:35, 26 February 2009 (UTC)

Added. RobiH 18:47, 3 March 2009 (UTC)
thank you very much.--Ffaarr 00:39, 4 March 2009 (UTC)

HI, I still didn't get answer from wikia. So I made a list of the main sites(sites with more articles) which are not listed in. here After added these sites I think it will make at least the list for 500+ article sites almost complete.Thank you --Ffaarr 02:59, 2 March 2009 (UTC)

I imported more wikis from the link you provided, actually 158 more that were not duplicates. Greets, Mutante 19:43, 4 March 2009 (UTC)

I'll take care of the list. Will ping you here once it's ready. --Avatar 05:28, 24 June 2009 (UTC)
Here it is:
Information is cached for 6 hours. If you need further information included into the list, tell me. --Avatar 11:21, 10 July 2009 (UTC)

Can you rename Betawiki to translatewiki.net? – 19:17, 7 May 2009 (UTC) (http://translatewiki.net/wiki/User:Nike)

Done. Mutante 21:06, 16 July 2009 (UTC)

Please add this wiki:


(is a new wiki in spanish and active with 20 articles at this moment) --Mnts 01:58, 11 August 2009 (UTC)

Please add New World Encyclopedia. Thanks! 23:54, 12 October 2009 (UTC)

Both done. RobiH 19:45, 13 October 2009 (UTC)

Bartender's Database

Hello! Can you please add http://www.bartendersdatabase.com ?
-- 14:03, 29 October 2009 (UTC)

Added. RobiH 21:04, 29 October 2009 (UTC)

Can you please add http://beta.brungame.com/w/index.php?title=Main_Page ? Thank you so much! Brunn 21:47, 4 April 2010 (UTC)


Can you please add http://Wiki69.org? I tried adding it, but I don't see it on the list. Thanks! -- 00:07, 14 April 2010 (UTC)

There it is. RobiH 16:55, 14 April 2010 (UTC)

Parsing error

It appears that the raw stats from the Wiki wikis are not being parsed properly. For example, the raw feed for Memory Alpha is


but the parsed and formatted stats line is

№	Name 			Good 	Total 	Edits 	Views 	Admins 	Users	 	Images 	Stub Ratio 	Last checked
12 	en.memory-alpha 	30318 	84194 	978820 	0 	510 	1373059 	22 	0.3601		2009-05-21 11:06:46

The admins stat is actually the active users number, and the images stat is actually the admins number.

Thanks! -- 14:24, 21 May 2009 (UTC)

I haved added "Active users" to the database, the update script and http://s23.org/wikistats/wikia_html.php?sort=ausers_desc . update is currently running ... Mutante 21:19, 29 May 2009 (UTC)

Incorrect image counts

Image counts on http://s23.org/wikistats/ look a wee bit questionable; zero images for all of editthis and 422 images for all uncyclomedia wikis? One individual wiki from one of these sets http://desciclopedia.org/wiki/Especial:Estatísticas is showing 77 525 images on the site's own MW1.16 statistics page - admittedly that is one of the larger wikis, but still it's one individual project among many.

Any chance that the MediaWiki 1.16 upgrades are breaking things? The "activeusers" field did not exist in special:statistics in some of the older MW versions but is standard now. (Not that this would explain Wikia, they're still running two versions behind Wikipedia and others) -- 23:09, 6 September 2009 (UTC)

I added the activeusers column to the update scripts and html pages of: wmspecials, wikiquotes, wikinews, wikibooks, wikisources, wikipedias, wiktionary, uncyclomedia, anarchopedias, wikiversity, gentoo.

Mediawikis, wikifur and wikia already had them. The others dont have activeusers columns in their stats yet.

For uncyclomedia i also added it in _wiki ,_csv, and _ssv. For wiktionary ,wikisources and wikipedia: _wiki . @Robih: But please check them and list for me what is missing now. Mutante 16:56, 4 October 2009 (UTC)

Add Creative Commons wiki

It is already in. RobiH 15:40, 14 July 2009 (UTC)

Add n:tr

Hi! Tr Wikinews is open: http://tr.wikinews.org/wiki/Ana_sayfa . Could you add it in http://s23.org/wikistats/wikinews_wiki.php ? Thanks, XalD 21:42, 14 August 2009 (UTC)

Alright, i have just added it. Greets, Mutante 21:06, 16 August 2009 (UTC)

Thanks a lot :) XalD 00:27, 26 August 2009 (UTC)


WikiFur's entries may need updating - we have completed our migration from Wikia - all sites are now hosted off subdomains of wikifur.com. furry.wikia.com should be going away by the end of the month. GreenReaper 05:29, 22 August 2009 (UTC)

Thanks for the info. What about http://www.wikilurv.se/ ? Mutante 18:57, 25 August 2009 (UTC)

WikiLurv is a separately-hosted and run wiki which is considered our Swedish partner, to the extent that we share interlanguage links and include them in our stats. It is not however hosted or controlled by WikiFur - the administrator decided they wanted the experience of running it themselves. TurriWiki is in a similar situation, except that it was founded separately a few months before WikiFur. GreenReaper 21:54, 25 August 2009 (UTC)
Oh, and there seems to be an additional entry in this list for "English Wikifur" with unrunescape.wikia.com as the address. It is a duplicate of the unrunescape entry. The admin values for TurriWiki and WikiLurv also appear to be incorrect. GreenReaper 22:23, 25 August 2009 (UTC)
I notice you have added a WikiIndex link - our article over there is here. It uses a copy of the stats from s23, modified for compactness and to use short URLs where available. There's also one for Uncyclopedia. We don't have a WikiHive page, but they appear to have moved to new URLs, for example http://socialsynergyweb.net/cgi-bin/wiki/HiveWiki/WikiaHive. GreenReaper 00:53, 28 November 2009 (UTC)

Add/update a list of sites using a particular MediaWiki extension

The list of wikis using mw:extension:SpecialNamespaces http://s23.org/wikistats/mediawiki_extensions.php?id=991 needs to be updated to reflect that the MediaWiki page about the extension was moved (from "simple namepaces" to "SpecialNamespaces"). The list of wikis known to use some form of the extension includes all Illogicopedias and those portions of Uncyclopedia (Uncyclomedia) hosted outside Wikia:

Illogicopedias (by language, ISO):

Uncyclomedia individual wikis (non-Wikia, by language, ISO):

Uncyclomedia (misc):


Hi, i have updated the short name in my database. See http://s23.org/wikistats/mediawiki_extensions.php?id=991 reflecting the new name now. Now i will have to let it update somehow.. hold on. Mutante 19:42, 21 September 2009 (UTC)


Hi! Could you add [[Category:Wikinews]] in http://s23.org/wikistats/wikinews_wiki.php ? On the bottom, please. Thanks, XalD 21:23, 27 October 2009 (UTC)

Done. Mutante 05:35, 3 November 2009 (UTC)

Add Filkipedia

Please add http://filkipedia.chaoscircle.com -- 17:39, 14 December 2009 (UTC)

Added. RobiH 20:16, 14 December 2009 (UTC)

Belarusian (Tarashkevitsa) language name for Wikipedia

Hello! Аccording to the language title in the localization messages file [4] and IANA language subtag registry [5] (plain text is used there) the proper name of the orthography is Taraškievica, not Tarashkevitsa. I raised this question on meta and got no objections till now [6]. Could you please rename Tarashkevitsa to Taraškievica for be-x-old Wikipedia and correspondingly update the link to the English Wikipedia article to either http://en.wikipedia.org/wiki/Taraškievica or http://en.wikipedia.org/wiki/Belarusian_(Taraškievica)_language ? Regards, —zedlik 03:23, 25 December 2009 (UTC)

Hi, I have made this change:

update wikipedias set lang="Belarusian (Taraškievica)" where prefix="be-x-old";

Is it good now? Mutante 19:43, 28 December 2009 (UTC)

Yes, now it looks great, thank you! —zedlik 00:44, 29 December 2009 (UTC)

Add LlamaWiki

Please add http://wiki.llamaslayers.net/. Thanks in advance! 16:47, 7 April 2010 (UTC)

Added. RobiH 17:04, 7 April 2010 (UTC)

Depth again

For wikis with <100,000 articles, increase the value of depth to be 500 for the depth to be irrelevant and be replaced by a --. Now this value is 300. Depth of ml.wikipedia is >300 and this depth increase has not been artificial.

I checked the source, and all i see is this:
if ($good==0) {

and the depth formula is:


so i did not really know how to fix what you are refering to. ?! Mutante 20:18, 10 April 2010 (UTC)

In this page, depth of malayalam wikipedia is shown as "--" instead of 301, which is the bug. This needs to be fixed. I had thought that there was a some code that showed if $depth >= 300, $depth = "--". Probably it is replaced somewhere else.. Where can I find the source code of the bot? --Jacob.jose 19:59, 11 April 2010 (UTC)

Ah, you are right, i found it:

if ($depth > 300 && $good < 100000) { $depth="--"; }

I have overlooked it somehow last time. Changed it to 500 like you proposed. Malayalam now reports a depth of 374 in [7]. Mutante 20:25, 13 April 2010 (UTC)