Image stabilization

Image stabilization (IS) is a family of techniques that reduce blurring associated with the motion of a camera or other imaging device during exposure.

Generally, it compensates for pan and tilt (angular movement, equivalent to yaw and pitch) of the imaging device, though electronic image stabilization can also compensate for rotation.[1] It is used in image-stabilized binoculars, still and video cameras, astronomical telescopes, and also smartphones, mainly the high-end. With still cameras, camera shake is a particular problem at slow shutter speeds or with long focal length (telephoto or zoom) lenses. With video cameras, camera shake causes visible frame-to-frame jitter in the recorded video. In astronomy, the problem of lens-shake is amplified by variation in the atmosphere over time, which changes the apparent positions of objects over time.

Application in still photography

In photography, image stabilization can facilitate shutter speeds 2–4.5 stops slower (exposures 4–22.5 times longer), and even slower effective speeds have been reported.

The rule of thumb to determine the slowest shutter speed possible for hand-holding without noticeable blur due to camera shake is to take the reciprocal of the 35 mm equivalent focal length of the lens, also known as the "1/mm rule". For example, at a focal length of 125 mm on a 35 mm camera, vibration or camera shake could affect sharpness if the shutter speed is slower than 1/125 second. As a result of the 2–4.5 stops slower shutter speeds allowed by IS, an image taken at 1/125 second speed with an ordinary lens could be taken at 1/15 or 1/8 second with an IS-equipped lens and produce almost the same quality. The sharpness obtainable at a given speed can increase dramatically.[2] When calculating the effective focal length, it is important to take into account the image format a camera uses. For example, many digital SLR cameras use an image sensor that is 2/3, 5/8, or 1/2 the size of a 35 mm film frame. This means that the 35 mm frame is 1.5, 1.6, or 2 times the size of the digital sensor. The latter values are referred to as the crop factor, field-of-view crop factor, focal-length multiplier, or format factor. On a 2x crop factor camera, for instance, a 50 mm lens produces the same field of view as a 100 mm lens used on a 35 mm film camera, and can typically be handheld at 1/100 of a second.

However, image stabilization does not prevent motion blur caused by the movement of the subject or by extreme movements of the camera. Image stabilization is only designed for and capable of reducing blur that results from normal, minute shaking of a lens due to hand-held shooting. Some lenses and camera bodies include a secondary panning mode or a more aggressive 'active mode', both described in greater detail below under optical image stabilization.

Image-stabilization features can also be a benefit in astrophotography, when the camera is technically—but not effectively—fixed in place. The Pentax K-5 and K-r can use their sensor-shift capability to reduce star trails in reasonable exposure times, when equipped with the O-GPS1 GPS accessory for position data. In effect, the stabilization compensates for the Earth's motion, not the camera's.[3]

There are two types of implementation—lens-based, or body-based stabilization. These refer to where the stabilizing system is located. Both have their advantages and disadvantages.[4]

Techniques

Optical image stabilization

A comparison of close-up photographs of a calculator keypad with and without optical image stabilization

An optical image stabilizer, often abbreviated OIS, IS, or OS, is a mechanism used in a still camera or video camera that stabilizes the recorded image by varying the optical path to the sensor. This technology is implemented in the lens itself, as distinct from in-body image stabilization, which operates by moving the sensor as the final element in the optical path. The key element of all optical stabilization systems is that they stabilize the image projected on the sensor before the sensor converts the image into digital information.

Different companies have different names for the OIS technology, for example:

  • Vibration Reduction (VR) - Nikon (produced the first optical two-axis stabilized lens, a 38–105 mm f/4-7.8 zoom built into the Nikon Zoom 700VR (US: Zoom-Touch 105 VR) camera in 1994)[5][6]
  • Image Stabilizer (IS) - Canon introduced the EF 75-300mm F4-5.6 IS USM) in 1995. In 2009, they introduced their first lens (the EF 100mm F2.8 Macro L) to use a four-axis Hybrid IS.)
  • Anti-Shake (AS) - Minolta and Konica Minolta (Minolta introduced the first sensor-based 2-axis image stabilizer with the DiMAGE A1 in 2003)
  • IBIS - In Body Image Stabilisation - Olympus
  • Optical SteadyShot (OSS) - Sony (for Cyber-shot and several α E-mount lenses)
  • MegaOIS, PowerOIS - Panasonic and Leica
  • SteadyShot (SS), Super SteadyShot (SSS), SteadyShot INSIDE (SSI) - Sony (based on Konica Minolta's Anti-Shake originally, Sony introduced a 2-axis full-frame variant for the DSLR-A900 in 2008 and a 5-axis stabilizer for the full-frame ILCE-7M2 in 2014)
  • Optical Stabilization (OS) - Sigma
  • Vibration Compensation (VC) - Tamron
  • Shake Reduction (SR) - Pentax
  • PureView - Nokia (produced the first cell phone optical stabilised sensor, built into the Lumia 920)
  • UltraPixel - HTC (Image Stabilization is only available for the 2013 HTC One & 2016 HTC 10 with UltraPixel. It is not available for the HTC One (M8) or HTC Butterfly S, which also have UltraPixel)

Most high-end smartphones as of late 2014 use optical image stabilization for photos and videos.[7]

Lens-based

In Nikon and Canon's implementation, it works by using a floating lens element that is moved orthogonally to the optical axis of the lens using electromagnets.[8] Vibration is detected using two piezoelectric angular velocity sensors (often called gyroscopic sensors), one to detect horizontal movement and the other to detect vertical movement.[9] As a result, this kind of image stabilizer corrects only for pitch and yaw axis rotations,[10][11] and cannot correct for rotation around the optical axis. Some lenses have a secondary mode that counteracts vertical-only camera shake. This mode is useful when using a panning technique, and switching into this mode depends on the lens; sometimes it is done by using a switch on the lens, or it can be automatic.

Mainly for using video while walking to compensate jitter, Panasonic introduced Power Hybrid O.I.S + with 5-axis correction: axis rotation, horizontal rotation, vertical rotation, horizontal and vertical.[12]

Some of Nikon's more recent VR-enabled lenses offer an "active" mode for shooting from a moving vehicle, such as a car or boat, which is supposed to correct for larger shakes than the "normal" mode.[13] However, active mode used for normal shooting can produce poorer results than normal mode.[14] This is because active mode is optimized for reducing higher angular velocity movements (typically when shooting from a heavily moving platform using faster shutter speeds), where normal mode tries to reduce lower angular velocity movements over a larger amplitude and timeframe (typically body and hand movement when standing on a stationary or slowly moving platform while using slower shutter speeds).

Most manufacturers suggest that the IS feature of a lens be turned off when the lens is mounted on a tripod as it can cause erratic results and is generally unnecessary. Many modern image stabilization lenses (notably Canon's more recent IS lenses) are able to auto-detect that they are tripod-mounted (as a result of extremely low vibration readings) and disable IS automatically to prevent this and any consequent image quality reduction.[15] The system also draws battery power, so deactivating it when not needed extends the battery charge.

A disadvantage of lens-based image stabilization is cost. Each lens requires its own image stabilization system. Also, not every lens is available in an image-stabilized version. This is often the case for fast primes and wide-angle lenses. However, the fastest lens with image stabilisation is the Nocticron with a speed of f/1.2. While the most obvious advantage for image stabilization lies with longer focal lengths, even normal and wide-angle lenses benefit from it in low-light applications.

Lens-based stabilization also has advantages over in-body stabilization. In low-light or low-contrast situations, the autofocus system (which has no stabilized sensors) is able to work more accurately when the image coming from the lens is already stabilized. In cameras with optical viewfinders, the image seen by the photographer through the stabilized lens (as opposed to in-body stabilization) reveals more detail because of its stability, and it also makes correct framing easier. This is especially the case with longer telephoto lenses. This advantage does not occur on compact system cameras, because the sensor output to the screen or electronic viewfinder would be stabilized.

Sensor-shift

The sensor capturing the image can be moved in such a way as to counteract the motion of the camera, a technology often referred to as mechanical image stabilization. When the camera rotates, causing angular error, gyroscopes encode information to the actuator that moves the sensor.[16] The sensor is moved to maintain the projection of the image onto the image plane, which is a function of the focal length of the lens being used. Modern cameras can automatically acquire focal length information from modern lenses made for that camera. Some lenses can be retrofitted with a chip that communicates the focal length. Minolta and Konica Minolta used a technique called Anti-Shake (AS) now marketed as SteadyShot (SS) in the Sony α line and Shake Reduction (SR) in the Pentax K-series and Q series cameras, which relies on a very precise angular rate sensor to detect camera motion.[17] Olympus introduced image stabilization with their E-510 D-SLR body, employing a system built around their Supersonic Wave Drive.[18] Other manufacturers use DSPs to analyze the image on the fly and then move the sensor appropriately. Sensor shifting is also used in some cameras by Fujifilm, Samsung, Casio Exilim and Ricoh Caplio.[19]

The advantage with moving the image sensor, instead of the lens, is that the image can be stabilized even on lenses made without stabilization. This may allow the stabilization to work with many otherwise-unstabilized lenses, and reduces the weight and complexity of the lenses. Further, when sensor-based image stabilization technology improves, it requires replacing only the camera to take advantage of the improvements, which is typically far less expensive than replacing all existing lenses if relying on lens-based image stabilization. Some sensor-based image stabilization implementations are capable of correcting camera roll rotation, a motion that is easily excited by pressing the shutter button. No lens-based system can address this potential source of image blur. A by-product of available "roll" compensation is that the camera can automatically correct for tilted horizons in the optical domain, provided it is equipped with an electronic spirit level, such as the Pentax K-7/K-5 cameras.

One of the primary disadvantages of moving the image sensor itself is that the image projected to the viewfinder is not stabilized. However, this is not an issue on cameras that use an electronic viewfinder (EVF), since the image projected on that viewfinder is taken from the image sensor itself. Similarly, the image projected to a phase-detection autofocus system that is not part of the image sensor, if used, is not stabilized.

Some, but not all, camera-bodies capable of in-body stabilization can be pre-set manually to a given focal length. Their stabilization system corrects as if that focal length lens is attached, so the camera can stabilize older lenses, and lenses from other makers. This isn't viable with zoom lenses, because their focal length is variable. Some adapters communicate focal length information from the maker of one lens to the body of another maker. Some lenses that do not report their focal length can have a chip added to the lens, which reports a pre-programmed focal-length to the camera body. Sometimes, none of these techniques works, and image-stabilization simply cannot be used with such lenses.

In-body image stabilization requires the lens to have a larger output image circle because the sensor is moved during exposure and thus uses a larger part of the image. Compared to lens movements in optical image stabilization systems the sensor movements are quite large, so the effectiveness is limited by the maximum range of sensor movement, where a typical modern optically-stabilized lens has greater freedom. Both the speed and range of the required sensor movement increase with the focal length of the lens being used, making sensor-shift technology less suited for very long telephoto lenses, especially when using slower shutter speeds, because the available motion range of the sensor quickly becomes insufficient to cope with the increasing image displacement.

Dual

Free-hand museum shot of a historic universal theodolite taken without flash light but with dual image stabilization. The image was taken with a Panasonic Lumix DMC-GX8 and a Nocticron with almost two times the normal focal length of the camera system (42.5 mm) at F-Number 1.2 and with a polarizing filter in order to remove reflections from the transparent glass of the display case. ISO speed = 800, exposure time = 1/8 s, exposure value = 0.5.

Starting with the Panasonic Lumix DMC-GX8, announced in July 2015, and subsequently in the Panasonic Lumix DC-GH5, Panasonic, who formerly only equipped lens-based stabilization in its interchangeable lens camera system (of the Micro Four Thirds standard), introduced sensor-shift stabilization that works in concert with the existing lens-based system ("Dual IS").

In the mean time (2016), Olympus is also offering two lenses with image stabilization that can be synchronized with the in-built image stabilization system of the image sensors of Olympus' Micro Four Thirds cameras ("Sync IS"). With this technology a gain of 6.5 f-stops can be achieved without blurred images.[20] This is limited by the rotational movement of the surface of the Earth, that fools the accelerometers of the camera. Therefore, depending on the angle of view, the maximum exposure time should not exceed 1/3 second for long telephoto shots (with a 35-mm equivalent focal length of 800 millimeters) and a little more than ten seconds for wide angle shots (with a 35-mm equivalent focal length of 24 millimeters), if the movement of the Earth is not taken into consideration by the image stabilization process.[21]

In 2015, the Sony E camera system also allowed combining image stabilization systems of lenses and camera bodies, but without synchronizing the same degrees of freedom. In this case, only the independent compensation degrees of the in-built image sensor stabilization are activated to support lens stabilisation.[22]

Digital image stabilization

Real-time digital image stabilization, also called electronic image stabilization (EIS), is used in some video cameras. This technique shifts the electronic image from frame to frame of video, enough to counteract the motion.[23] It uses pixels outside the border of the visible frame to provide a buffer for the motion. This technique reduces distracting vibrations from videos by smoothing the transition from one frame to another. This technique does not affect the noise level of the image, except in the extreme borders when the image is extrapolated. It cannot do anything about existing motion blur, which may result in an image seemingly losing focus as motion is compensated.

Some still camera manufacturers marketed their cameras as having digital image stabilization when they really only had a high-sensitivity mode that uses a short exposure time—producing pictures with less motion blur, but more noise.[24] It reduces blur when photographing something that is moving, as well as from camera shake.

Others now also use digital signal processing (DSP) to reduce blur in stills, for example by sub-dividing the exposure into several shorter exposures in rapid succession, discarding blurred ones, re-aligning the sharpest sub-exposures and adding them together, and using the gyroscope to detect the best time to take each frame.[25][26][27]

Stabilization filters

Many video non-linear editing systems use stabilization filters that can correct a non-stabilized image by tracking the movement of pixels in the image and correcting the image by moving the frame.[28][29] The process is similar to digital image stabilization but since there is no larger image to work with the filter either crops the image down to hide the motion of the frame or attempts to recreate the lost image at the edge through spatial or temporal extrapolation.[30]

Online services, including Google's YouTube, are also beginning to provide 'video stabilization as a post-processing step after content is uploaded. This has the disadvantage of not having access to the realtime gyroscopic data, but the advantage of more computing power and the ability to analyze images both before and after a particular frame.[31]

Orthogonal transfer CCD

Used in astronomy, an orthogonal transfer CCD (OTCCD) actually shifts the image within the CCD itself while the image is being captured, based on analysis of the apparent motion of bright stars. This is a rare example of digital stabilization for still pictures. An example of this is in the upcoming gigapixel telescope Pan-STARRS being constructed in Hawaii.[32]

Stabilizing the camera body

A steadicam system

A technique that requires no additional capabilities of any camera body–lens combination consists of stabilizing the entire camera body externally rather than using an internal method. This is achieved by attaching a gyroscope to the camera body, usually using the camera's built-in tripod mount. This lets the external gyro stabilize the camera, and is typically used in photography from a moving vehicle, when a lens or camera offering another type of image stabilization is not available.[33]

This has been integrated into camcorders by allowing the sensor and lens assembly to move together within the camera housing. [34]

Another technique for stabilizing a video or motion picture camera body is the Steadicam system, which isolates the camera from the operator's body using a harness and a camera boom with a counterweight. [35]

Camera stabilizer

A camera stabilizer is any device or object that externally stabilizes the camera. This can refer to a Steadicam, a tripod, the camera operator's hand, or a combination of these.

In close-up photography, using rotation sensors to compensate for changes in camera-pointing-direction becomes insufficient. Moving, rather than tilting, the camera up/down or left/right by a fraction of a millimeter becomes noticeable if you are trying to resolve millimeter-size details on the object. Linear accelerometers in the camera, coupled with information such as the lens focal length and focused distance, can feed a secondary correction into the drive that moves the sensor or optics, to compensate for linear as well as rotational shake. [36]

In biological eyes

In many animals, including human beings, the inner ear functions as the biological analogue of an accelerometer in camera image stabilization systems, to stabilize the image by moving the eyes. When a rotation of the head is detected, an inhibitory signal is sent to the extraocular muscles on one side and an excitatory signal to the muscles on the other side. The result is a compensatory movement of the eyes. Typically eye movements lag the head movements by less than 10 ms.[37]

See also

References

  1. ↑ "Correct Excessive Shake in Final Cut Pro". Apple, Inc.
  2. ↑ Ken Rockwell, "Why IS and VR Matter"
  3. ↑ PENTAX O-GPS1 - News Release, Pentax.jp (archived)
  4. ↑ "Image Stabilization - Lens vs. Body". Bobatkins.com. Retrieved 2009-12-11.
  5. ↑ Nikon camera models 1992-1994 MIR
  6. ↑ Nikon Zoom 700VR Camera Gossip
  7. ↑ "15 smartphone cameras with optical image stabilization". December 14, 2014.
  8. ↑ What is Optical Image Stabilizer?, Technology FAQ, Canon Broadcast Equipment
  9. ↑ Glossary : Optical : Image Stabilization, Vincent Bockaert, Digital Photography Review
  10. ↑ "Archived copy". Archived from the original on January 12, 2009. Retrieved March 16, 2007.
  11. ↑ Mega OIS
  12. ↑ "Why does your compact camera need the O.I.S.?". Retrieved December 31, 2013.
  13. ↑ Vibration Reduction (VR) Technology
  14. ↑ CameraHobby: Nikon AF-S VR 70-200mm f2.8 Review
  15. ↑ "Technical report". Canon.com. Retrieved 2009-12-11.
  16. ↑ Development of a Test Method for Image Stabilization Systems
  17. ↑ Dynax 7D Anti-Shake Technology, Konica Minolta
  18. ↑ Olympus Image Stabilization Technology
  19. ↑ outdoorphotographer.com
  20. ↑ DL Cade: Olympus Says Earth’s Rotation Limits Image Stabilization to 6.5 Stops Max, petapixel.com, 26 September 2016, retrieved 26 October 2017
  21. ↑ Markus Bautsch: Optomechanische Bildstabilisierung, German, Optomechanical image stabilisation, in: Wikibook Digital imaging techniques, retrieved 30 October 2017
  22. ↑ A Comparison of How Olympus and Sony’s 5 Axis Stabilization Work, thephoblographer.com, 17 December 2014, retrieved 26 October 2017
  23. ↑ Chereau, R., Breckon, T.P. (September 2013). "Robust Motion Filtering as an Enabler to Video Stabilization for a Tele-operated Mobile Robot". Proc. SPIE Electro-Optical Remote Sensing, Photonic Technologies, and Applications VII (PDF). 8897. SPIE. pp. 1–17. doi:10.1117/12.2028360. Retrieved 5 November 2013.
  24. ↑ "Stop misleading 'Image Stabilization' labels: Digital Photography Review". Dpreview.com. 2007-01-05. Retrieved 2009-12-11.
  25. ↑ "Sony DSC-HX5V Features". sony.co.uk. 2010-04-01. Retrieved 2012-06-24.
  26. ↑ "Fujifilm FinePix HS20EXR features - Triple Image Stabilization". fujifilm.ca. 2011-01-05. Retrieved 2012-06-26.
  27. ↑ Zimmerman, Steven (12 October 2016). "Sony IMX378: Comprehensive Breakdown of the Google Pixel's Sensor and its Features". XDA Developers. Retrieved 17 October 2016.
  28. ↑ "The Event Videographer's Resource". EventDV.net. Retrieved 2009-12-11.
  29. ↑ "Stabilization per Software". studiodaily.com. 2011-02-28. Retrieved 2014-03-17.
  30. ↑ "Capabilities | Stabilization". 2d3. Retrieved 2009-12-11.
  31. ↑ "Secrets of Video Stabilization on YouTube". Google. May 15, 2013. Retrieved October 17, 2014.
  32. ↑ Pan-STARRS Orthogonal Transfer CCD Camera Design, Gareth Wynn-Williams, Institute for Astronomy
  33. ↑ Multimedia: Use Image Stabilization, Andy King, Web Site Optimization, 2004
  34. ↑ "Camcorder news - Sony". sony.co.uk. 2012-01-09. Retrieved 2012-06-26.
  35. ↑ Harris, Tom. "How Steadicams Work". HowStuffWorks.com. Discovery Communications LLC. Retrieved 2008-07-26.
  36. ↑ "Hybrid Image Stabilizer". Canon Global News Releases. canon.com. 2009-07-22. Retrieved 2012-06-26.
  37. ↑ Barnes, G. R. (1979). "Vestibulo-ocular function during co-ordinated head and eye movements to acquire visual targets". Investigative Ophthalmology & Visual Science. 287: 127–147. doi:10.1113/jphysiol.1979.sp012650. PMC 1281486. PMID 311828.

Top vlogging cameras

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.