High-dynamic-range (HDR) vision

Creating high-fidelity images of our world has been a continuous challenge, even as our understanding and skills have evolved. The acquisition and mapping of the rich and complex content of visual information rank high among the most demanding technical tasks. Now electronic image sensors can record a dynamic range from bright to dark of more than seven orders of magnitude, thus exceeding the ability of a human eye by more than a hundred times and displaying five orders of magnitude in brightness, resulting in CRT and LCD displays with more than 100-fold improvement. This first comprehensive account of high-dynamic-range (HDR) vision focusses on HDR real-time, high-speed digital video recording and also systematically presents HDR video transmission and display. The power of the eye-like, logarithmic optoelectronic conversion concept is demonstrated in machine-vision, medical, automotive, surveillance and cinematic applications, and it is extended to HDR sub-retinal implants for the vision impaired. While the book conveys the overall picture of HDR vision, specific knowledge of microelectronics and image processing is not required. It provides a quantitative summary of the major issues to allow the assessment of the state of the art and a glimpse at future developments. Selected experts share their know-how and expectations in this rapidly evolving art related to the single most powerful of our senses.

Bernd HoefflingerBernd Hoefflinger and Verena SchneiderBernd HoefflingerBernd HoefflingerMarkus Strobel and Volker GengenbachHans-Joerg SchoenherrBela Michael Rohrbacher and Michael Raasch and Roman LoubanPeter M. KnollChristine Harendt and Klaus-Martin IrionHeinz-Gerd Graf and Alexander Dollberg and Jan-Dirk Schulze Spüntrup and Karsten WarkentinGrzegorz Krawczyk and Karol Myszkowski and Daniel BroschRafal MantiukMichael Goesele and Karol MyszkowskiHelge Seetzen

1 The Eye and High-Dynamic-Range Vision	p. 1
References	p. 12
2 The High-Dynamic-Range Sensor	p. 13
2.1 General Considerations	p. 13
2.2 The HDRC (High-Dynamic-Range CMOS) Pixel	p. 19
2.3 The HDRC Sensor	p. 27
2.4 Fixed-Pattern Correction of HDR Imagers	p. 32
2.4.1 Physical Background of Logarithmic OECF	p. 32
2.4.2 Parameter Extraction with Software	p. 33
2.4.3 Effects of Parameter Variation on the OECF	p. 35
2.4.4 Presentation of Three Correction Algorithms	p. 37
2.4.5 New Parameterized Correction Algorithm	p. 38
2.4.6 Masking Process	p. 40
2.4.7 Algorithm Including Temperature	p. 41
2.4.8 Correction Procedure and Runtime	p. 46
2.4.9 Summary	p. 47
2.5 HDRC Dynamic Performance	p. 47
2.6 HDRC Sensor with Global Shutter	p. 53
References	p. 56
3 HDR Image Noise	p. 57
References	p. 63
4 High-Dynamic-Range Contrast and Color Management	p. 65
References	p. 71
5 HDR Video Cameras	p. 73
5.1 Introduction	p. 73
5.2 HDRC CamCube Miniaturized Camera Module	p. 75
5.2.1 Features of the HDRC CamCube	p. 76
5.2.2 Assembly Techniques	p. 76
5.2.3 System Design	p. 77
5.2.4 Application Example	p. 78
5.3 HDRC Camera Front-End	p. 78
5.4 Digital HDRC Camera Link™ System	p. 82
5.4.1 Features of the HDRC Camera Link Camera	p. 84
5.4.2 Features of the "IP3 Control" Software	p. 84
5.4.3 Application Example	p. 84
5.5 Intelligent HDRC GEVILUX CCTV Camera	p. 85
5.5.1 Features of the Camera	p. 85
5.6 HDR Video-Based Aircraft Docking Guidance	p. 90
5.6.1 Summary	p. 90
5.6.2 Introduction	p. 91
5.6.3 Operation	p. 92
5.6.4 Challenges to the Sensor System	p. 93
5.6.5 HDR Camera with Improved Sensitivity	p. 94
5.7 Conclusion	p. 97
References	p. 97
6 Lenses for HDR Imaging	p. 99
7 HDRC Cameras for High-Speed Machine Vision	p. 107
7.1 General Requirements	p. 107
7.2 Special Characteristics	p. 108
7.3 Methods for Obtaining the Specific Image Information	p. 109
7.4 Optoelectronic Transfer Function (Lookup Table, LUT)	p. 110
7.4.1 Mode 1: 1	p. 111
7.4.2 Mode Rec. 709	p. 111
7.4.3 Mode Stretched	p. 112
7.4.4 Mode CatEye	p. 112
7.4.5 Mode CatEye2	p. 112
7.5 Application Example Surface Inspection	p. 113
7.6 Evaluation Algorithms	p. 114
7.7 Robot Controlled Image-Processing System for Fully Automated Surface Inspection	p. 118
References	p. 121
8 HDR Vision for Driver Assistance	p. 123
8.1 Introduction	p. 123
8.2 Components for Predictive Driver Assistance Systems	p. 124
8.2.1 Ultrasonic Sensors	p. 124
8.2.2 Long Range Radar 77 GHz	p. 125
8.2.3 Video Sensor	p. 125
8.3 Driver Assistance Systems for Convenience and for Safety	p. 127
8.4 Video-BasedDriverAssistanceSystems	p. 128
8.4.1 Video System	p. 128
8.4.2 Image Processing	p. 130
8.5 Night Vision Improvement System	p. 130
8.6 Night Vision Enhancement by Image Presentation	p. 131
8.7 Night Vision Warning	p. 132
8.8 Sensor Data Fusion	p. 133
8.8.1 Lane Detection and Lane Departure Warning	p. 134
8.8.2 Traffic Sign Recognition	p. 134
8.9 Conclusion	p. 135
References	p. 136
9 Miniature HDRC Cameras for Endoscopy	p. 137
References	p. 139
10 HDR Sub-retinal Implant for the Vision Impaired	p. 141
10.1 Introduction	p. 141
10.2 Electronic HDR Photoreceptors	p. 142
10.3 The Differential Principle	p. 143
10.4 The Complete Amplifier Cell	p. 143
10.5 The Retinal Implant	p. 145
References	p. 145
11 HDR Tone Mapping	p. 147
11.1 Taxonomy	p. 148
11.1.1 Spatially Invariant Operators	p. 149
11.1.2 Spatially Variant Operators	p. 153
11.2 HDR Video: Specific Conditions and Requirements	p. 159
11.3 Tone Mapping for HDR Video	p. 161
11.3.1 Response Curve Compression	p. 161
11.3.2 Local Details Enhancement	p. 162
11.3.3 Temporal Luminance Adaptation	p. 163
11.3.4 Key Value	p. 164
11.3.5 Tone Mapping	p. 165
11.4 Simulating Perceptual Effects	p. 166
11.4.1 Scotopic Vision	p. 166
11.4.2 Visual Acuity	p. 167
11.4.3 Veiling Luminance	p. 168
11.4.4 Tone Mapping with Perceptual Effects	p. 169
11.5 Bilateral Tone Mapping for HDRC Video	p. 170
11.6 Summary	p. 175
References	p. 175
12 HDR Image and Video Compression	p. 179
12.1 Introduction	p. 179
12.2 Device-Referred and Scene-Referred Representation of Images	p. 180
12.3 HDR Image and Video Compression Pipeline	p. 180
12.4 HDR Image Formats	p. 181
12.4.1 Radiance's HDR Format	p. 181
12.4.2 LogLuv TIFF	p. 182
12.4.3 OpenEXR	p. 183
12.4.4 Subband Encoding - JPEG HDR	p. 183
12.5 HDR Extension to MPEG Video Compression	p. 184
12.6 Perceptual Encoding of HDR Color	p. 187
12.7 Software for HDR Image and Video Processing	p. 191
References	p. 191
13 HDR Applications in Computer Graphics	p. 193
13.1 Introduction	p. 193
13.2 Capturing HDR Image Data	p. 194
13.2.1 Multiexposure Techniques	p. 194
13.2.2 Photometric Calibration	p. 194
13.3 Image-Based Object Digitization	p. 196
13.3.1 Image-Based Capture of Spatially Varying BRDFs	p. 196
13.3.2 Acquisition of Translucent Objects	p. 197
13.4 Image-Based Lighting in Image Synthesis	p. 199
13.4.1 Rendering Techniques for Image-based Lighting	p. 200
13.4.2 A CAVE System for Interactive Global Illumination Modeling in Car Interior	p. 203
13.4.3 Interactive Lighting in Mixed Reality Applications	p. 205
13.5 Requirements for HDR Camera Systems	p. 206
References	p. 208
14 High-Dynamic Range Displays	p. 211
14.1 HDR Display Requirements	p. 211
14.2 HDR Display Design	p. 213
14.2.1 LED Backlight	p. 215
14.2.2 LCD Panel	p. 216
14.2.3 Image Processing Algorithm	p. 216
14.3 HDR Display Performance	p. 221
14.4 Alternative Implementation	p. 222
14.5 Conclusion	p. 222
References	p. 222
15 Appendix	p. 225
15.1 Symbols	p. 225
15.2 Abbreviations	p. 229
15.3 Glossary	p. 230
15.4 Some Useful Quantities and Relations	p. 231
15.5 Trademarks	p. 231
Index	p. 233

Available:*

On Order

Summary

Summary

Table of Contents