Wikipedia:Artificial intelligence

Artificial intelligence is used on a number of Wikipedia and Wikimedia projects. This may be directly involved with creation of text content, or in support roles related to evaluating article quality, adding metadata, or generating images. As with any machine-generated content, care must be used when employing AI at scale or in applying it where the community consensus is to exercise more caution.

When exploring AI techniques and systems, the community consensus is to prefer human decisions over machine-generated outcomes until the implications are better understood.

Applications

edit

AI-related efforts on Wikipedia include but are not limited to:

Revision scoring

edit

The Objective Revision Evaluation Service (ORES) was started in 2015 as a project of the Wikimedia Foundation, and provides a revision score against machine learning models that have been trained in order to report article quality or vandalism. This is used in tools such as ClueBot NG to help immediately revert vandalism, or in evaluation tools like the Program and Events Dashboard to measure the outcomes of classwork, edit-a-thons, or organized editing campaigns.

Text translation

edit

Guidance can be found at Help:Translation#English Wikipedia policy requirements. There is a Content Translation Tool used across Wikimedia projects that can use the output of machine translation from one Wikipedia article to another, using services like Google Translate. However, on the English Wikipedia, it currently states that "machine translation is disabled for all users and this tool is limited to extended confirmed editors." As a result, only manual translation on the English Wikipedia is supported by the tool, though some users have used translation to Simple English as a workaround. Relatedly, there is a section of the Help:Translation page with the broad advice: "avoid machine translations." However, this guidance was last edited in 2016, and the state of the art for machine translation has advanced significantly since then, meriting a re-examination of that advice.

Article text generation

edit

The explosion of interest in ChatGPT in 2022 has led to increased curiosity in using generative AI to help compose Wikipedia articles. The status of machine-generated text from tools such as ChatGPT is generally accepted to be public domain, so the copyright issues are not a blocker to using the generated text from a legal standpoint. These issues are generally governed by Help:Adding open license text to Wikipedia#Converting and adding open license text to Wikipedia, which advises to make sure content is adjusted for style and that reliable sources are used. Conversations on the Village Pump and in some test articles (i.e. Artwork title) have noted positive aspects of machine generated text, but a serious warning that content must be checked for facts and accuracy and never used straight from ChatGPT.

A good general page looking at the issues can be found at: Wikipedia:Using neural network language models on Wikipedia.

A major community discussion took place on Village Pump (policy) found at: Wikipedia:Village pump (policy)/Archive 179#Wikipedia response to chatbot-generated content

Some user experiences can be found here:

Images and Commons

edit

Image metadata – There have been efforts from GLAM institutions to help supplement image keyword data with machine learning efforts. Among them include:

  • Computer aided tagging Started in 2019, "The computer-aided tagging tool is a feature in development by the Structured Data on Commons team to assist community members in identifying and labeling depicts statements for Commons files." See: c:Commons:Structured data/Computer-aided tagging
  • Metropolitan Museum of Art Tagging - This project used Met Museum tagging info to train a machine learning system to help predict new "depiction" recommendations for Wikidata. This resulted in a new Wikidata Game that helped add more than 4,000 new depiction (P180) statements to Wikidata. See the Met Museum blog post by Andrew Lih: "Combining AI and Human Judgment to Build Knowledge about Art on a Global Scale," March 4, 2019, [1]

Image generation

See also

edit

General

edit
  • Lih, Andrew (March 4, 2019). "Combining AI and Human Judgment to Build Knowledge about Art on a Global Scale". Metropolitan Museum of Art.

Wikimedia

edit

Demonstrations of generative AI using LLMs

edit