Coded exposure photography, also known as a flutter shutter, is the name given to any mathematical algorithm that reduces the effects of motion blur in photography. The key element of the coded exposure process is the mathematical formula that affects the shutter frequency. This involves the calculation of the relationship between the photon exposure of the light sensor and the randomized code. The camera is made to take a series of snapshots with random time intervals using a simple computer, this creates a blurred image that can be reconciled into a clear image using the algorithm.
Motion de-blurring technology grew due to increasing demand for clearer images in sporting events and other digital media.[1] The relative inexpensiveness of the coded exposure technology makes it a viable alternative to expensive cameras and equipment that are built to take millions of images per second.
History
editPhotography was developed to enable imaging of the visible world. Early cameras used film made of plastic coated with compounds of silver.[2] The film is highly sensitive to light. When photons (light) hit the film a reaction occurs which semi-permanently stores the data on its surface. This film is then developed by exposing it to several chemicals to create the image. The film is highly sensitive and the process is complicated. It must be stored away from light to prevent spoilage.[3]
Digital cameras use digital technologies to create images. This process involves exposing light-sensitive material to photons, creating electrical signals that are recorded in computer files.[4] This process is simple and has improved the availability of photography. One problem that digital cameras have faced is motion blur. Motion blur occurs when the camera or the subject are in motion. When motion blur happens, the resulting image is blurry, fuzzy edges and indistinct features. One solution to remove motion blur in photography is to increase the shutter speed of the camera. Unlike the coded exposure process, shutter speed is a purely physical process where the camera shutter is opened and closed more quickly, resulting in short exposure time.[5] This reduces the amount of motion that occupies each frame.[6] However shorter exposure times increase the 'noise', which can affect image quality.[7]
Coded exposure
editCoded exposure solves the motion blur problem without the negative effects of shorter exposure times. It is an algorithm designed to open the camera's shutter in a pattern that enables the image to be processed in such a way that motion blur and noise are almost completely removed.[8] Contrary to other methods of de-blurring, coded exposure does not require additional hardware beyond a digital camera.[9]
The key element of the coded exposure process is the formula that affects the shutter frequency.[10] The process calculates the relationship between the exposure of the light sensor and the randomized code.[11] The digital camera takes a series of snapshots at random intervals. This creates a blurred image that can be clarified given the code or the algorithm.[12] Together with compressed sensing, this technique can be effective.[13]
Application
editThe relative inexpensiveness of the coded exposure technology makes it a viable alternative to expensive cameras and equipment that take millions of images per second.[14] However, the algorithm and subsequent de-blurring is a complicated process that requires specialists who can write the programs and create templates for companies to work from. Ownership of the technology is subject to dispute; no patent covers it.[15]
Coded exposure could have application on live television. Accurate footage of sporting events requires a clear image and detail. Short exposure cameras have been used, but coded exposure is typically available at a lower cost. As of October 2019, the technology had not been widely used outside of a research environment.[16]
References
edit- ^ Pueo, Basilio (2016). "High speed cameras for motion analysis in sports science". Journal of Human Sport and Exercise. 11. doi:10.14198/jhse.2016.111.05. hdl:10045/61909. ISSN 1988-5202.
- ^ Woodford, Chris (11 July 2010). "Film cameras and 35mm photography – A simple introduction". Explain that Stuff. Retrieved 2019-05-13.
- ^ Woodford, Chris (12 May 2006). "How do digital cameras work?". Explain that Stuff. Retrieved 2019-05-13.
- ^ Tarrant, Jon (2006). Understanding Digital Cameras. ISBN 9780240520247.[page needed]
- ^ Pueo, Basilio (2016). "High speed cameras for motion analysis in sports science". Journal of Human Sport and Exercise. 11. doi:10.14198/jhse.2016.111.05. hdl:10045/61909. ISSN 1988-5202.
- ^ "Exposure, Aperture and Shutter Speed Explained | Photography Mad". www.photographymad.com. Retrieved 2019-05-13.
- ^ "Optimizing flutter shutter to minimize camera blur". ScienceDaily. Retrieved 2019-05-13.
- ^ "Optimizing flutter shutter to minimize camera blur". ScienceDaily. Retrieved 2019-05-13.
- ^ "Coded Exposure Photography (Flutter Shutter Deblur, SIGGRAPH 2006)". web.media.mit.edu. Retrieved 2019-05-13.
- ^ Tendero, Yohann; Osher, Stanley (2016-03-20). "On a mathematical theory of coded exposure". Research in the Mathematical Sciences. 3 (1): 4. doi:10.1186/s40687-015-0051-8. ISSN 2197-9847.
- ^ Tendero, Yohann; Osher, Stanley (2016-03-20). "On a mathematical theory of coded exposure". Research in the Mathematical Sciences. 3 (1): 4. doi:10.1186/s40687-015-0051-8. ISSN 2197-9847.
- ^ "Coded Exposure Photography (Flutter Shutter Deblur, SIGGRAPH 2006)". web.media.mit.edu. Retrieved 2019-05-14.
- ^ Tsutake, Chihiro; Yoshida, Toshiyuki (2018). Reduction of Poisson noise in coded exposure photography. 25th IEEE International Conference on Image Processing. doi:10.1109/ICIP.2018.8451407.
- ^ "The World's Fastest Camera Can Shoot 10 Trillion Frames Per Second". petapixel.com. 15 October 2018. Retrieved 2019-05-14.
- ^ Holloway, J.; Sankaranarayanan, A. C.; Veeraraghavan, A.; Tambe, S. (2012). "Flutter Shutter Video Camera for compressive sensing of videos". 2012 IEEE International Conference on Computational Photography (ICCP). pp. 1–9. doi:10.1109/ICCPhot.2012.6215211. ISBN 978-1-4673-1662-0. S2CID 3819978.
- ^ Holloway, J.; Sankaranarayanan, A. C.; Veeraraghavan, A.; Tambe, S. (2012). "Flutter Shutter Video Camera for compressive sensing of videos". 2012 IEEE International Conference on Computational Photography (ICCP). pp. 1–9. doi:10.1109/ICCPhot.2012.6215211. ISBN 978-1-4673-1662-0. S2CID 3819978.