မေႃႇၵျူး:category tree/poscatboiler/data

Introduction

This is the documentation page for the main data module for Module:category tree/poscatboiler, as well as for its submodules. Collectively, these modules handle generating the descriptions and categorization for almost all category pages. The only current exception is topic pages such as Category:en:Birds and Category:zh:State capitals of Germany, and the corresponding non-language-specific pages such as Category:Birds and Category:State capitals of Germany; these are handled by Module:category tree/topic cat.

Originally, there were a large number of Module:category tree implementations, of which Module:category tree/poscatboiler was only one. It originally handled part-of-speech categories like Category:French nouns and Category:German lemmas (and corresponding "umbrella" categories such as Category:Nouns by language and Category:Lemmas by language); hence the name. However, it has long since been generalized, and the name no longer describes its current use.

The main data module at Module:category tree/poscatboiler/data does not contain data itself, but rather imports the data from its submodules, and applies some post-processing.

To find which submodule implements a specific category, use the search box on the right.
To add a new data submodule, copy an existing submodule and modify its contents. Then, add its name to the subpages list at the top of Module:category tree/poscatboiler/data.

	The text of any category page using this module should simply read `{{auto cat}}`.
	The correct way to invoke Module:category tree/poscatboiler on a given category page that it handles is through `{{auto cat}}`. You should not normally invoke `{{poscatboiler}}` directly. If you find a category page that directly invokes `{{poscatboiler}}`, it is probably old, from before when `{{auto cat}}` was created, and should be changed.

Concepts

The poscatboiler system internally distinguishes the following types of categories:

Language categories. These are of the form LANG LABEL (e.g. Category:French lemmas and Category:English learned borrowings from Late Latin). Here, LANG is the name of a language, and LABEL can be anything, but should generally describe a topic that can apply to multiple languages. Note that the language mentioned by LANG must currently be a regular language, not an etymology-only language. (Etymology-only languages include lects such as Provençal, considered a variety of Occitan, and Biblical Hebrew, considered a variety of Hebrew. See here for the list of such lects.) Most language categories have an associated umbrella category; see below.
Umbrella categories. These are normally of the form LABEL by language, and group all categories with the same label. Examples are Category:Lemmas by language and Category:Learned borrowings from Late Latin by language. Note that the label appears with an initial lowercase letter in a language category, but with an initial uppercase letter in an umbrella category, consistent with the general principle that category names are capitalized. Umbrella categories themselves are grouped into umbrella metacategories, which group related umbrella categories under a given high-level topic. Examples are Category:Lemmas subcategories by language (which groups umbrella categories describing different types of lemmas, such as Category:Nouns by language and Category:Interrogative adverbs by language) and Category:Terms derived from Proto-Indo-European roots (which groups umbrella categories describing terms derived from particular Proto-Indo-European roots, such as Category:Terms derived from the Proto-Indo-European root *preḱ- and Category:Terms derived from the Proto-Indo-European root *bʰeh₂- (speak)). The names of umbrella metacategories are not standardized (although many end in subcategories by language), and internally they are handled as raw categories; see below.
- Note that umbrella categories are just a special type of parent category with built-in support in the category-handling system. In particular, some types of categories have what is logically an umbrella category but which has a nonstandard name. These are handled as just another parent category, with a separate raw-category entry for the parent itself. An example is categories of the form LANG phrasebook/AREA (e.g. Category:English phrasebook/Health), whose umbrella category has the nonstandard name Phrasebooks by language/AREA (e.g. Category:Phrasebooks by language/Health). Another example is categories of the form LANG terms borrowed back into LANG, with a nonstandard umbrella category Category:Terms borrowed back into the same language. Both of these examples are handled by disabling the standard umbrella category support and listing the nonstandard umbrella category as an additional parent.
- Some umbrella categories are missing the by language suffix; an example is Category:Terms borrowed from Latin, which groups categories of the form LANG terms borrowed from Latin. There is special support for umbrella categories of this nature, so they do not need to be handled as described above for umbrella categories with nonstandard names.
Language-specific categories. These are of the same form LANG LABEL as regular language categories, but with the difference that the label in question applies only to a single language, rather than to all or a large group of languages. Examples are Category:Belarusian class 4c verbs, Category:Dutch separable verbs with bloot, and Category:Japanese kanji by kan'yōon reading. For these categories, it does not make sense to have a corresponding umbrella category.
Raw categories. These can have any form whatsoever, and may or may not have a language name in them. Examples are Category:Requests for images in Korean entries and Category:Terms with redundant transliterations/ru (which logically are language categories but do not follow the standard format of a language category); Category:Phrasebooks by language/Health (which is logically an umbrella category, but again with a nonstandard name); Category:Terms by etymology subcategories by language (an umbrella metacategory); and Category:Templates (a miscellaneous high-level category).

Under the hood, the poscatboiler system distinguishes two types of implementations for categories: individual labels (or individual raw categories), and handlers. Individual labels describe a single label, such as nouns or refractory rhymes. Similarly, an individual raw category describes a single raw category. Handlers, on the other hand, describe a whole class of similar labels or raw categories, e.g. labels of the form learned borrowings from SOURCE where SOURCE is any language or etymology language. Handlers are more powerful than individual labels, but require knowledge of Lua to implement.

Adding, removing or modifying categories

A sample entry is as follows (in this case, found in Module:category tree/poscatboiler/data/lemmas):

labels["adjectives"] = {
	description = "{{{langname}}} terms that give attributes to nouns, extending their definitions.",
	parents = {"lemmas"},
	umbrella_parents = "Lemmas subcategories by language",
}

This generates the description and categorization for all categories of the form "LANG adjectives" (e.g. Category:English adjectives or Category:Norwegian Bokmål adjectives), as well as for the umbrella category Category:Adjectives by language.

The meanings of these fields are as follows:

The description field gives the description text that will appear when a user visits the category page. Here, {{{langname}}} is automatically replaced with the name of the language in question. The text in this field is also used to generate the description of the umbrella category Category:Adjectives by language, by chopping off the {{{langname}}} and capitalizing the next letter.
The parents field gives the labels of the parent categories. For example, Category:English adjectives will have Category:English lemmas as its parent category, and Category:Norwegian Bokmål adjectives will have Category:Norwegian Bokmål lemmas as its parent category. The umbrella category Category:Adjectives by language will automatically be added as an additional parent.
The umbrella_parents field specifies the parent category of the umbrella category Category:Adjectives by language (i.e. the umbrella metacategory which this page belongs to; see #Concepts above).

Category label fields

The following fields are recognized for the object describing a label:

parents

A table listing one or more parent labels of this label. This controls the parent categories that the category is contained within, as well as the chain of breadcrumbs appearing across the top of the page (see below).

An item in the table can be either a single string (the parent label), or a table containing (at least) the two elements name and sort. In the latter case, name specifies the parent label name, while the sort value specifies the sort key to use to sort it in that category. The default sort key is the category's label.
If a parent label begins with Category: it is interpreted as a raw category name, rather than as a label name. It can still have its own sort key as usual.
The first listed parent controls the category's parent breadcrumb in the chain of breadcrumbs at the top of the page. (The breadcrumb of the category itself is determined by the breadcrumb setting, as described below.)

description

A plain English description for the label. This should generally be no longer than one sentence. Place additional, longer explanatory text in the additional= field described below, and put {{wikipedia}} boxes in the topright= field described below so that they are correctly right-aligned with the description. Template invocations and special template-like references such as {{{langname}}} and {{{langcode}}} will be expanded appropriately; see #Template substitutions in field values below.

breadcrumb

The text of the last breadcrumb that appears at the top of the category page.

By default, it is the same as the category label, with the first letter capitalized.
The value can be either a string, or a table containing two elements called name and nocap. In the latter case, name specifies the breadcrumb text, while nocap can be used to disable the automatic capitalization of the breadcrumb text that normally happens.
Note that the breadcrumbs collectively are the chain of links that serve as a navigation aid for the hierarchical organization of categories. For example, a category like Category:French adjectives will have a breadcrumb chain similar to "Fundamental » All languages » French » Lemmas » Adjectives", where each breadcrumb is a link to a category at the appropriate level. The last breadcrumb here is "Adjectives", and its text is controlled by this field.

displaytitle

Apply special formatting such as italics to the category page title, as with the {{DISPLAYTITLE:...}} magic word (see mw:Help:Magic words). The value of this is either a string (which should be the formatted category title, without the preceding Category:) or a Lua function to generate the formatted category title. A Lua function is most useful inside of a handler (see #Handlers below). The Lua function is passed two parameters, the raw category title (without the preceding Category:) and the language object of the category's language (or nil for umbrella categories), and should return the formatted category title (again without the preceding Category:). If the value of this field is a string, template invocations and special template-like references such as {{{langname}}} and {{{langcode}}} will be expanded appropriately; see below. See Module:category tree/poscatboiler/data/terms by etymology and Module:category tree/poscatboiler/data/lang-specific/nl for examples of using displaytitle=.

topright

Introductory text to display right-aligned, before the edit and recent-entries boxes on the right side. This field should be used for {{wikipedia}} and other similar boxes. Template invocations and special template-like references such as {{{langname}}} and {{{langcode}}} are expanded appropriately, just as with description=; see #Template substitutions in field values below. Compare the preceding= field, which is similar to topright= but used for left-aligned text placed above the description.

preceding

Introductory text to display directly before the text in the description= field. The difference between the two is that description= text will also be shown in the list of children categories shown on the parent category's page, while the preceding= text will not. For this reason, use preceding= instead of description= for {{also}} hatnotes and similar text, and keep description= relatively short. Template invocations and special template-like references such as {{{langname}}} and {{{langcode}}} are expanded appropriately, just as with description=; see #Template substitutions in field values below. Compare the topright= field, which is similar to preceding= but is right-aligned, placed above the edit and recent-entries boxes.

additional

Additional text to display directly after the text in the the description= field. The difference between the two is that description= text will also be shown in the list of children categories shown on the parent category's page, while the additional= text will not. For this reason, use additional= instead of description= for long explanatory notes, See also references and the like, and keep description= relatively short. Template invocations and special template-like references such as {{{langname}}} and {{{langcode}}} are expanded appropriately, just as with description=; see #Template substitutions in field values below.

umbrella

A table describing the umbrella category that collects all language-specific categories associated with this label, or the special value false to indicate that there is no umbrella category. The umbrella category is normally called "LABEL by language". For example, for adjectives, the umbrella category is named Category:Adjectives by language, and is a parent category (in addition to any categories specified using parents) of Category:English adjectives, Category:French adjectives, Category:Norwegian Bokmål adjectives, and all other language-specific categories holding adjectives. This table contains the following fields:

name: The name of the umbrella category. It defaults to "LABEL by language". You should not use this, even if the umbrella category has a nonstandard name, because if you set it, you will have to modify Module:auto cat to recognize the new name of the umbrella category. Instead, set umbrella = false and list the nonstandard umbrella category as an additional parent (and add a raw-category entry for the umbrella category itself; see the implementation of categories like Category:English terms borrowed back into English for an example).
description: A plain English description for the umbrella category. By default, it is derived from the description field of the category itself by removing any {{{langname}}}, {{{langcode}}} or {{{langcat}}} template parameter reference and capitalizing the remainder. Text is automatically added to the end indicating that this category is an umbrella category that only contains other categories, and does not contain pages describing terms.
parents: The parent category or categories of the umbrella category. This can either be a single string specifying a category (with or without the Category: prefix), a table with fields name (the category name) and sort (the sort key, as in the outer parents field described above), or a list of either type of entity.
breadcrumb: The last breadcrumb in the chain of breadcrumbs at the top of the category page; see above. By default, this is the category label (i.e. the same as the umbrella category name, minus the final "by language" text).
displaytitle: Apply special formatting such as italics to the umbrella category page title; see above.
topright: Like the topright= field on regular category pages; see above.
preceding: Like the preceding= field on regular category pages; see above.
additional: Like the additional= field on regular category pages; see above.
toc_template, toc_template_full: Override the table of contents bar used on umbrella pages. See below. It's unlikely you will ever need to set this.

umbrella_parents

The same as the parents subfield of the umbrella field. This typically specifies a single umbrella metacategory to which the page's corresponding umbrella page belongs; see #Concepts above). A separate field is provided for this because the umbrella's parent or parents always need to be given, whereas other umbrella properties can usually be defaulted. (In practice, you will find that most entries in a subpage of Module:category tree/poscatboiler/data do not explicitly specify the umbrella's parent. This is because a default value is supplied near the end of the "LABELS" section in which the entry is found.)

toc_template

The template or templates to use to display the "table of contents" bar for easier navigation on categories with multiple pages of entries. By default, categories with more than 200 entries or 200 subcategories display a language-appropriate table of contents bar whose contents are held in a template named CODE-categoryTOC, where CODE is the language code of the category's language. (If no such template exists, no table of contents bar is displayed. If the category has no associated language, as with umbrella pages, the English-language table of contents bar is used.) For example, the category Category:Spanish interjections (and other Spanish-language categories) use Template:es-categoryTOC to display a Spanish-appropriate table of contents bar. (In the case of Spanish, this includes entries for Ñ and for acute-accented vowels such as Á and Ó.) To override this behavior, specify a template or a list of templates in toc_template. The first template that exists will be used; if none of the specified templates exist, the regular behavior applies, i.e. the language-appropriate table of contents bar is selected.

Special strings such as {{{langcode}}} (to specify the language code of the category's language) can be used in the template names; see below.
Use the special value false to disable the table of contents bar.
An example of a category that uses this property is "LANG romanizations". For example, the category Category:Gothic romanizations would by default use the Gothic-specific template Template:got-categoryTOC to display a Gothic-script table of contents bar. This is inappropriate for this particular category, which contains Latin-script romanizations of Gothic terms rather than terms written in the Gothic script. To fix this, the "romanizations" label specifies a toc_template value of {"{{{langcode}}}-rom-categoryTOC", "en-categoryTOC"}, which first checks for a special Gothic-romanization-specific template Template:got-rom-categoryTOC (which in this case does exist), and falls back to the English-language table of contents template.

toc_template_full

Similar to toc_template but used for categories with large numbers of entries (specifically, more than 2,500 entries or 2,500 subcategories). If none of the specified templates exist, the templates listed in toc_template are tried, and if none of them exist either, the default behavior applies. In this case, the default behavior is to use a language-appropriate "full" table of contents template named CODE-categoryTOC/full, and if that doesn't exist, fall back to the regular table of contents template named CODE-categoryTOC. An example of a "full" table of contents template is Template:es-categoryTOC/full, which shows links for all two-letter combinations and appears on pages such as Category:Spanish nouns, with over 50,000 entries.

catfix

Specifies the language code of the language to use when calling the catfix() function in Module:utilities on this page. The catfix() function is used to ensure that page names in foreign scripts show up in the correct fonts and are linked to the correct language.

The default value is the category's language, if any (for example, the language LANG in pages of the form LANG LABEL). If the category has no associated language, or if the setting catfix = false is used, the catfix mechanism is not applied.
The setting catfix = false is used, for example, on the romanizations label (which holds Latin-script romanizations of foreign-script terms, rather than terms in the language's native script) and the redlinks labels (which holds pages linking to nonexistent terms in the language in question). If this is omitted, for example, then pages in Category:Manchu romanizations will show up oriented vertically despite being in Latin script, and pages in Category:Cantonese redlinks will show up using a double-width font despite mostly not being Cantonese-language pages.
The setting catfix = "en" is used for example on categories of the form Requests for translations into LANG (see Module:category tree/poscatboiler/data/entry maintenance) because these categories contain English pages need translations into a given language, rather than containing pages of that language.
Note that setting a particular language for catfix= will normally cause that language's table of contents page to display in place of the category's normal language, and setting a value of false will normally cause the English table of contents page to display. In both cases, this behavior can be overridden by specifying the toc_template= or toc_template_full= fields.

|hidden = true: Specifies that the category is hidden. This should be used for maintenance categories. (Hidden categories do not show up in the list of categories at the bottom of a page, but do show up when searched for in the search box.)
|can_be_empty = true: Specifies that the category should not be deleted when empty. This should be used for maintenance categories.

Template substitutions in field values

Template invocations can be inserted in the text of description, parents (both name and sort key), breadcrumb, toc_template and toc_template_full values, and will be expanded appropriately. In addition, the following special template-like invocations are recognized and replaced by the equivalent text:

{{PAGENAME}}: The name of the current page. (Note that two braces are used here instead of three, as with the other parameters described below.)
{{{langname}}}: The name of the language that the category belongs to. Not recognized in umbrella fields.
{{{langcode}}}: The code of the language that the category belongs to (e.g. en for English, de for German). Not recognized in umbrella fields.
{{{langcat}}}: The name of the language's main category, which adds "language" to the regular name. Not recognized in umbrella fields.

Raw categories

Raw categories are treated similarly to regular labels. The main differences are:

Handlers

It is also possible to have handlers that can handle arbitrarily-formed labels, e.g. "###-syllable words" for any ###; "terms in XXX script" for any XXX; or "learned borrowings from LANG" for any LANG. As an example, the following is the handler for "terms coined by COINER" (such as Category:English terms coined by Lewis Carroll):

table.insert(handlers, function(data)
	local coiner = data.label:match("^terms coined by (.+)$")
	if coiner then
		return {
			description = "{{{langname}}} terms coined by " .. coiner .. ".",
			breadcrumb = coiner,
			umbrella = false,
			parents = {{
				name = "coinages",
				sort = coiner,
			}},
		}
	end
end)

The handler checks if the passed-in label has a recognized form, and if so, returns an object that follows the same format as described above for directly-specified labels. In this case, the handler disables the umbrella category "Terms coined by COINER by language" because most people coin words in only one language.

The handler is passed a single argument data, which is an object containing the following fields:

label: the label;
lang: the language object of the language at the beginning of the category, or nil for no language (this happens with umbrella categories);
sc: the script code of the script mentioned in the category, if the category is of the form "LANG LABEL in SCRIPT", or nil otherwise;
args: a table of extra parameters passed to {{auto cat}}.

If the handler interprets the extra parameters passed as data.args, it should return two values: a label object (as described above), and the value true. Otherwise, an error will be thrown if any extra parameters are passed to {{auto cat}}. An example of a handler that interprets the extra parameters is the affix-cat handler in Module:category tree/poscatboiler/data/terms by etymology, which supports {{auto cat}} parameters |alt=, |sort=, |tr= and |sc=. The |alt= parameter in particular is used to specify extra diacritics to display on the affix that forms part of the category name, as in categories such as Category:Latin terms suffixed with -inus (properly -īnus).

For further examples, see Module:category tree/poscatboiler/data/words by number of syllables, Module:category tree/poscatboiler/data/terms by script or Module:category tree/poscatboiler/data/terms by etymology.

Note that if a handler is specified, the module should return a table holding both the label and handler data; see the above modules.

Language-specific labels

Support exists for labels that are specialized to particular languages. A typical label such as "verbs" applies to many languages, but some categories have labels that are specialized to a particular language, e.g. Category:Belarusian class 4c verbs or Category:Dutch prefixed verbs with ver-. Here, the label "class 4c verbs" is specific to Belarusian with a description and other properties only for this particular language, and similarly for the Dutch-specific label "prefixed verbs with ver-". Yet, it is desirable to integrate these categories into the poscatboiler hierarchy, so that e.g. breadcrumbs and other features are available. This can be done by creating a module such as Module:category tree/poscatboiler/data/lang-specific/be (for Belarusian) or Module:category tree/poscatboiler/data/lang-specific/nl (for Dutch), and specifying labels and/or handlers in the same fashion as is done for language-agnostic categories. See Module:category tree/poscatboiler/data/lang-specific/documentation for more information.

Subpages

local labels = {}
local raw_categories = {}
local handlers = {}
local raw_handlers = {}

local subpages = {
	"affixes and compounds",
	"characters",
	"entry maintenance",
	"families",
	"figures of speech",
	"language varieties",
	"languages",
	"ၶေႃႈတင်ႈ",
	"miscellaneous",
	"modules",
	"names",
	"non-lemma forms",
	"phrases",
	"rhymes",
	"scripts",
	"shortenings",
	"symbols",
	"templates",
	"terms by etymology",
	"terms by grammatical category",
	"terms by lexical property",
	"terms by semantic function",
	"terms by script",
	"terms by usage",
	"transliterations",
	"unicode",
	"wiktionary",
	"wiktionary maintenance",
	"word of the day",
}

-- Import subpages
for _, subpage in ipairs(subpages) do
	local datamodule = "Module:category tree/poscatboiler/data/" .. subpage
	local retval = require(datamodule)
	if retval["LABELS"] then
		for label, data in pairs(retval["LABELS"]) do
			if labels[label] and not retval["IGNOREDUP"] then
				error("Label " .. label .. " defined in both [["
					.. datamodule .. "]] and [[" .. labels[label].module .. "]].")
			end
			data.module = datamodule
			labels[label] = data
		end
	end
	if retval["RAW_CATEGORIES"] then
		for category, data in pairs(retval["RAW_CATEGORIES"]) do
			if raw_categories[category] and not retval["IGNOREDUP"] then
				error("Raw category " .. category .. " defined in both [["
					.. datamodule .. "]] and [[" .. raw_categories[category].module .. "]].")
			end
			data.module = datamodule
			raw_categories[category] = data
		end
	end
	if retval["HANDLERS"] then
		for _, handler in ipairs(retval["HANDLERS"]) do
			table.insert(handlers, { module = datamodule, handler = handler })
		end
	end
	if retval["RAW_HANDLERS"] then
		for _, handler in ipairs(retval["RAW_HANDLERS"]) do
			table.insert(raw_handlers, { module = datamodule, handler = handler })
		end
	end
end

-- Add child categories to their parents
local function add_children_to_parents(hierarchy, raw)
	for key, data in pairs(hierarchy) do
		local parents = data.parents
		if parents then
			if type(parents) ~= "table" then
				parents = {parents}
			end
			if parents.name or parents.module then
				parents = {parents}
			end
			for _, parent in ipairs(parents) do
				if type(parent) ~= "table" or not parent.name and not parent.module then
					parent = {name = parent}
				end
				if parent.name and not parent.module and type(parent.name) == "string" and not parent.name:find("^Category:") then
					local parent_is_raw
					if raw then
						parent_is_raw = not parent.is_label
					else
						parent_is_raw = parent.raw
					end
					-- Don't do anything if the child is raw and the parent is lang-specific,
					-- otherwise e.g. "Lemmas subcategories by language" will be listed as a
					-- child of every "LANG lemmas" category.
					-- FIXME: We need to rethink this mechanism.
					if not raw or parent_is_raw then
						local child_hierarchy = parent_is_raw and raw_categories or labels
						if child_hierarchy[parent.name] then
							local child = {name = key, sort = parent.sort, raw = raw}
							if child_hierarchy[parent.name].children then
								table.insert(child_hierarchy[parent.name].children, child)
							else
								child_hierarchy[parent.name].children = {child}
							end
						end
					end
				end
			end
		end
	end
end

add_children_to_parents(labels)
add_children_to_parents(raw_categories, true)

return {
	LABELS = labels, RAW_CATEGORIES = raw_categories,
	HANDLERS = handlers, RAW_HANDLERS = raw_handlers
}