State-of-the-art technology and cutting-edge applications in image processing
Intelligent Image Processing examines the fundamentals of personal imaging and wearable computing with a concentration on the EyeTap technology invented by the author. EyeTap technology comprises eyeglasses or contact lenses that cause the eye itself to function, in effect, as if it were both a camera and a display. Modern embodiments of this invention use a laser system having no moving parts to provide infinite depth of focus from the inside of the eye, out to infinity. The invention eliminates the distinction between cyberspace and the real world, allowing a shared visual experience and shared visual memory among multiple users.
There are a wide range of commercial applications for this technology, including telephones that allow users to see each other's points of view, and systems that improve the sight of the visually impaired. These systems have been proven for electronic news gathering in hostile environments such as fires, floods, riots, and documenting human rights violations-all giving rise to a new genre of first-person cinematography. The invention blurs the boundary between seeing and recording, and the boundary between computing and thinking. It will radically change the way pictures are taken, memories are shared, and news is documented.
The author approaches the fundamental ideas of wearable computing and personal imaging by providing an historical overview of the subject that takes the reader from his original wearable photographic computer inventions of the 1970s, through to the modern EyeTap system. This fascinating technology promises to change the way we live and the way we communicate, and Intelligent Image Processing provides a detailed, technical, and stimulating guide for those who wish to learn about or contribute to this promising future.
Intelligent Image Processing describes the EyeTap technology that allows non-invasive tapping into the human eye through devices built into eyeglass frames. This isn't merely about a computer screen inside eyeglasses, but rather the ability to have a shared telepathic experience among viewers. Written by the developer of the EyeTap principle, this work explores the practical application and far-reaching implications this new technology has for human telecommunications.
Intelligent Imaging Processing beschreibt das EyeTap Prinzip, das von Autor Steve Mann entwickelt wurde. Die EyeTap-Technologie beschreibt das nicht-invasive Anzapfen des menschlichen Auges mit Hilfe eines computergesteuerten Laserstrahls, der sich im Gestell einer scheinbar gew hnlichen Brille verbirgt und ein Bild im Auge entstehen l t. Diese tragbare Computertechnik erm glicht auf diese Weise eine in der Tat telepathische Erfahrung, z.B. bei Videokonferenzen, hier sieht der Betrachter genau dasselbe, was sein Gegenst ck auch sieht. Diese neue Technologie hat zwar eine Vielzahl praktischer Anwendungsm glichkeiten, aber noch steckt sie in den Kinderschuhen.
STEVE MANN is Professor in the Department of Electrical Engineering and Computer Engineering at the University of Toronto.
Preface
1 Humanistic Intelligence as a Basis for Intelligent Image Processing
1.1 Humanistic Intelligence/
1.2 "WearComp" as Means of Realizing Humanistic Intelligence
1.3 Practical Embodiments of Humanistic Intelligence
2 Where on the Body is the Best Place for a Personal Imaging System?
2.1 Portable Imaging Systems
2.2 Personal Handheld Systems
2.3 Concomitant Cover Activities and the Videoclips Camera System
2.4 The Wristwatch Videophone: A Fully Functional "Always Ready" Prototype
2.5 Telepointer: Wearable Hands-Free Completely Self-Contained Visual Augmented Reality
2.6 Portable Personal Pulse Doppler Radar Vision System Based on Time-Frequency Analysis and q-Chirplet Transform
2.7 When Both Camera and Display are Headworn: Personal Imaging and Mediated Reality
2.8 Partially Mediated Reality
2.9 Seeing "Eye-to-Eye"
2.10 Exercises, Problem Sets, and Homework
3 The EyeTap Principle: Effectively Locating the Camera Inside the Eye as an Alternative to Wearable Camera Systems
3.1 A Personal Imaging System for Lifelong Video Capture
3.2 The EyeTap Principle
3.3 Practical Embodiments of EyeTap
3.4 Problems with Previously Known Camera Viewfinders
3.5 The Aremac
3.6 The Foveated Personal Imaging System
3.7 Teaching the EyeTap Principle
3.8 Calibration of EyeTap Systems
3.9 Using the Device as a Reality Mediator
3.10 User Studies
3.11 Summary and Conclusions
3.12 Exercises, Problem Sets, and Homework
4 Comparametric Equations, Quantigraphic Image Processing, and Comparagraphic Rendering
4.1 Historical Background
4.2 The Wyckoff Principle and the Range of Light
4.3 Comparametric Image Processing: Comparing Differently Exposed Images of the Same Subject Matter
4.4 The Comparagram: Practical Implementations of Comparanalysis
4.5 Spatiotonal Photoquantigraphic Filters
4.6 Glossary of Functions
4.7 Exercises, Problem Sets, and Homework
5 Lightspace and Antihomomorphic Vector Spaces
5.1 Lightspace
5.2 The Lightspace Analysis Function
5.3 The "Spotflash" Primitive
5.4 LAF?LSF Imaging ("Lightspace")
5.5 Lightspace Subspaces
5.6 "Lightvector" Subspace
5.7 Painting with Lightvectors: Photographic/Videographic Origins and Applications of WearComp-Based Mediated Reality
5.8 Collaborative Mediated Reality Field Trials
5.9 Conclusions
5.10 Exercises, Problem Sets, and Homework
6 VideoOrbits: The Projective Geometry Renaissance
6.1 VideoOrbits
6.2 Background
6.3 Framework: Motion Parameter Estimation and Optical Flow
6.4 Multiscale Implementations in 2-D
6.5 Performance and Applications
6.6 AGC and the Range of Light
6.7 Joint Estimation of Both Domain and Range Coordinate Transformations
6.8 The Big Picture
6.9 Reality Window Manager
6.10 Application of Orbits: The Photonic Firewall
6.11 All the World's a Skinner Box
6.12 Blocking Spam with a Photonic Filter
6.13 Exercises, Problem Sets, and Homework
Appendix A: Safety First!
Appendix B: Multiambic Keyer for Use While Engaged in Other Activities
B.1 Introduction
B.2 Background and Terminology on Keyers
B.3 Optimal Keyer Design: The Conformal Keyer
B.4 The Seven Stages of a Keypress
B.5 The Pentakeyer
B.6 Redundancy
B.7 Ordinally Conditional Modifiers
B.8 Rollover
B.8.1 Example of Rollover on a Cybernetic Keyer
B.9 Further Increasing the Chordic Redundancy Factor: A More Expressive Keyer
B.10 Including One Time Constant
B.11 Making a Conformal Multiambic Keyer
B.12 Comparison to Related Work
B.13 Conclusion
B.14 Acknowledgments
Appendix C: WearCam GNUX Howto
C.1 Installing GNUX on WearComps
C.2 Getting Started
C.3 Stop the Virus from Running
C.4 Making Room for an Operating System
C.5 Other Needed Files
C.6 Defrag /
323
C.7 Fips
C.8 Starting Up in GNUX with Ramdisk
Appendix D: How to Build a Covert Computer Imaging System into Ordinary Looking Sunglasses
D.1 The Move from Sixth-Generation WearComp to Seventh-Generation
D.2 Label the Wires!
D.3 Soldering Wires Directly to the Kopin CyberDisplay
D.4 Completing the Computershades
Bibliography
Index