World Library  
Flag as Inappropriate
Email this Article

Wordfilter

Article Id: WHEBN0002273502
Reproduction Date:

Title: Wordfilter  
Author: World Heritage Encyclopedia
Language: English
Subject: Content-control software, Expurgation, Neopets, Censorship, Internet censorship
Collection: Content-Control Software, Internet Censorship, Internet Forum Terminology
Publisher: World Heritage Encyclopedia
Publication
Date:
 

Wordfilter

A wordfilter (sometimes referred to as just "filter" or "censor") is a script typically used on Internet forums or chat rooms that automatically scans users' posts or comments as they are submitted and automatically changes or censors particular words or phrases.

The most primitive wordfilters search only for specific strings of letters, and remove or overwrite them regardless of their context. More advanced wordfilters make some exceptions for context (such as filtering "ass" but not "grass"), and the most advanced wordfilters may use regular expressions.

Contents

  • Functions of wordfilters 1
    • Removal of vulgar language 1.1
    • Cliché control 1.2
    • Vandalism control 1.3
    • Lameness filter 1.4
  • Circumventing filters 2
  • Censorship aspects 3
  • False positives 4
  • Implementation 5
  • See also 6
  • External links 7
  • References 8

Functions of wordfilters

Wordfilters can serve any of a number of functions.

Removal of vulgar language

A swear filter, also known as a profanity filter or language filter is a software subsystem which modifies text to remove words deemed offensive by the administrator or community of an online forum. Swear filters are common in custom-programmed chat rooms and online video games, primarily MMORPGs. This is not to be confused with content filtering, which is usually built into internet browsing programs by third-party developers to filter or block specific websites or types of websites. Swear filters are usually created or implemented by the developers of the Internet service.

Most commonly, wordfilters are used to censor language considered inappropriate by the operators of the forum or chat room. Expletives are typically partially replaced ('f*ck'), completely replaced ('****'), or replaced by nonsense words ('frak').[1] This relieves the administrators or moderators of the task of constantly patrolling the board to watch for such language. This may also help the message board avoid content-control software installed on users' computers or networks, since such software often blocks access to Web pages that contain vulgar language.

Filtered phrases may be permanently replaced as it is saved (example: phpBB 1.x), or the original phrase may be saved but displayed as the censored text. In some software users can view the text behind the wordfilter by quoting the post.

Swear filters typically take advantage of string replacement functions built into the programming language used to create the program, to swap out a list of inappropriate words and phrases with a variety of alternatives. Alternatives can include:

  • A sequence of shift-number characters, such as !@#$%^&*
  • Replacing a certain letter with a shift-number character, so the U in "fuck" would be replaced by a V to create "fvck", the S and/or I in "shit" would be replaced by a dollar sign ($) or exclamation mark (!) creating "$hit", "sh!t" or "$h!t" and so on.
  • Asterisks (*) of either a set length, or the length of the original word being filtered; for example, if "fuck" were to be filtered, it would appear as "****". Alternatively, posters often replace certain letters with an asterisk, creating "f*ck", "f**k", "f***" and so on.
  • Minced oaths such as "heck" or "darn", or invented words such as "flum".
  • Family friendly words or phrases, like "LOVE" or "I LOVE YOU", or completely different words which have nothing to do with the original word.
  • More appropriate alternatives, e.g., "butt" for "ass"
  • Deletion of the post. In this case, the entire post is blocked and there is usually no way to fix it.
  • Nothing at all. So if "fuck" were filtered, "fuck Mondays" would become "Mondays"

Some swear filters do a simple search for a string. Others have measures that ignore whitespace, and still others go as far as ignoring all non-alphanumeric characters and then filtering the plain text. This means that if the word "you" was set to be filtered, "y o u" or "y.o!u" would also be filtered.

Cliché control

Clichés—particular words or phrases constantly reused in posts, also known as "memes"—often develop on forums. Some users find that these clichés add to the fun, but other users find them tedious, especially when overused. Administrators may configure the wordfilter to replace the annoying cliché with a more embarrassing phrase, or remove it altogether.

Vandalism control

Internet forums are sometimes attacked by vandals who try to fill the forum with repeated nonsense messages, or by spammers who try to insert links to their commercial web sites. The site's wordfilter may be configured to remove the nonsense text used by the vandals, or to remove all links to particular websites from posts.

Lameness filter

Lameness filters are text-based wordfilters used by Slash-based websites to stop junk comments from being posted in response to stories. Some of the things they are designed to filter include:

  • Too many capital letters
  • Too much repetition
  • ASCII art
  • Comments which are too short or long
  • Use of HTML tags that try to break web pages
  • Comment titles consisting solely of "first post"
  • Any occurrence of a word or term deemed (by the programmers) to be offensive/vulgar

Circumventing filters

Since wordfilters are automated and look only for particular sequences of characters, users aware of the filters will sometimes try to circumvent them by changing their lettering just enough to avoid the filters. A user trying to avoid a vulgarity filter might use "shi-" instead of "shit", for example. Some administrators respond by revising the wordfilters to catch common substitutions; others may make filter evasion a punishable offense of its own.[2] A simple example of evading a wordfilter would be entering "f.uck" instead of "fuck" or using leet. More advanced techniques of wordfilter evasion include the use of images, using hidden tags (such as "fu[i][/i]ck"), or Cyrillic characters (i.e. a homograph spoofing attack).

Another method is to use a soft hyphen. A soft hyphen is only used to indicate where a word can be split when breaking text lines and is not displayed. By placing this halfway in a word, the word gets broken up and will in some cases not be recognised by the wordfilter.

Some more advanced filters, such as those in the online game RuneScape, can detect bypassing such as "sh1t" instead of "shit". However, the downside of sensitive wordfilters is that legitimate phrases get filtered out as well.

Censorship aspects

Wordfilters are coded into the Internet forums or chat rooms, and operate only on material submitted to the forum or chat room in question. This distinguishes wordfilters from content-control software, which is typically installed on an end user's PC or computer network, and which can filter all Internet content sent to or from the PC or network in question. Since wordfilters alter a user's words without his or her consent, some users still consider them to be censorship, while others consider them an acceptable part of a forum operator's right to control the contents of the forum.

False positives

A common quirk with wordfilters, often considered either comical or annoying by users, is that they often affect words that are not intended to be filtered. This is a typical problem when short words are filtered. For example, if the word "ass" is filtered, so are "assist", "classic", "assassin", and other words which contain the sequence. For example, one may see, "Do you need ***istance for playing cl***ical music?" Multiple words may be filtered if whitespace is ignored, resulting in "as suspected" becoming "****uspected". Prohibiting a phrase such as "hard on" will result in filtering innocuous statements such as "That was a hard one!" and "Sorry I was hard on you."

Some words that have been filtered accidentally can become replacements for profane words. One example of this is found on the Myst forum Mystcommunity. There, the word 'manuscript' was accidentally censored for containing the word 'anus', which resulted in 'm****cript'. The word was adopted as a replacement swear and carried over when the forum moved, and many substitutes, such as " 'scripting ", are used (though mostly by the older community members).

Place names may be filtered out unintentionally due to containing portions of swear words. In the early years of the internet, the British place name Penistone was often filtered out from spam and swear filters.[3]

Implementation

Many games, such as World of Warcraft, and more recently, Habbo Hotel and RuneScape allow the user to turn the filters off. Other games, especially free Massively multiplayer online games, such as Knight Online do not have such an option.

Other games such as Medal of Honor and Call of Duty (except Call of Duty: World at War, Call of Duty: Black Ops, and Call of Duty: Black Ops 2) do not give users the option to turn off scripted foul language, while Gears of War does.

See also

External links

  • Online Text Obfuscator — replaces characters with similar Unicode chars from different character sets (e.g. Cyrillic)

References

  1. ^ "When the **** did we get a wordfilter?". Retrieved 2006-10-01. 
  2. ^ "GameFAQs Terms of Use". GameFAQs. Retrieved 2008-08-04. 
  3. ^ Sheerin, Jude (29 March 2010). "How spam filters dictated Canadian magazine's fate".  
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
 
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
 
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.
 


Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.