Get a broad overview of the different modalities of immersive video technologies—from omnidirectional video to light fields and volumetric video—from a multimedia processing perspective.
From capture to representation, coding, and display, video technologies have been evolving significantly and in many different directions over the last few decades, with the ultimate goal of providing a truly immersive experience to users. After setting up a common background for these technologies, based on the plenoptic function theoretical concept, Immersive Video Technologies offers a comprehensive overview of the leading technologies enabling visual immersion, including omnidirectional (360 degrees) video, light fields, and volumetric video. Following the critical components of the typical content production and delivery pipeline, the book presents acquisition, representation, coding, rendering, and quality assessment approaches for each immersive video modality. The text also reviews current standardization efforts and explores new research directions.
With this book the reader will a) gain a broad understanding of immersive video technologies that use three different modalities: omnidirectional video, light fields, and volumetric video; b) learn about the most recent scientific results in the field, including the recent learning-based methodologies; and c) understand the challenges and perspectives for immersive video technologies.
1. Chapter 1 Introduction to immersive video technologies - p. 3 2. Chapter 2 Acquisition, representation, and rendering of omnidirectional videos - p. 27 3. Chapter 3 Streaming and user behavior in omnidirectional videos - p. 49 4. Chapter 4 Subjective and objective quality assessment for omnidirectional video - p. 85 5. Chapter 5 Omnidirectional video saliency - p. 123 6. Introduction - p. 159 7. Chapter 6 Acquisition of light field images & videos - p. 163 8. Chapter 7 Light field representation - p. 173 9. Chapter 8 Compression of light fields - p. 201 10. Chapter 9 Light field processing for media applications - p. 227 11. Chapter 10 Quality evaluation of light fields - p. 265 12. Chapter 11 Volumetric video – acquisition, interaction, streaming and rendering - p. 289 13. Chapter 12 MPEG immersive video - p. 327 14. Chapter 13 Point cloud compression - p. 357 15. Chapter 14 Coding of dynamic 3D meshes - p. 387 16. Chapter 15 Volumetric video streaming - p. 425 17. Chapter 16 Processing of volumetric video - p. 445 18. Chapter 17 Computational 3D displays - p. 469 19. Chapter 18 Subjective and objective quality assessment for volumetric video - p. 501 20. Chapter 19 MR in video guided liver surgery - p. 555 21. Chapter 20 Immersive media productions involving light fields and virtual production LED walls - p. 575 22. Chapter 21 Volumetric video as a novel medium for creative storytelling - p. 591 23. Chapter 22 Social virtual reality (VR) applications and user experiences - p. 609 24. Index - p. 649 25. Index - Continued - p. 663
Get a broad overview of the different modalities of immersive video technologies—from omnidirectional video to light fields and volumetric video—from a multimedia processing perspective.
From capture to representation, coding, and display, video technologies have been evolving significantly and in many different directions over the last few decades, with the ultimate goal of providing a truly immersive experience to users. After setting up a common background for these technologies, based on the plenoptic function theoretical concept, Immersive Video Technologies offers a comprehensive overview of the leading technologies enabling visual immersion, including omnidirectional (360 degrees) video, light fields, and volumetric video. Following the critical components of the typical content production and delivery pipeline, the book presents acquisition, representation, coding, rendering, and quality assessment approaches for each immersive video modality. The text also reviews current standardization efforts and explores new research directions.
With this book the reader will a) gain a broad understanding of immersive video technologies that use three different modalities: omnidirectional video, light fields, and volumetric video; b) learn about the most recent scientific results in the field, including the recent learning-based methodologies; and c) understand the challenges and perspectives for immersive video technologies.
1. Chapter 1 Introduction to immersive video technologies - p. 3 2. Chapter 2 Acquisition, representation, and rendering of omnidirectional videos - p. 27 3. Chapter 3 Streaming and user behavior in omnidirectional videos - p. 49 4. Chapter 4 Subjective and objective quality assessment for omnidirectional video - p. 85 5. Chapter 5 Omnidirectional video saliency - p. 123 6. Introduction - p. 159 7. Chapter 6 Acquisition of light field images & videos - p. 163 8. Chapter 7 Light field representation - p. 173 9. Chapter 8 Compression of light fields - p. 201 10. Chapter 9 Light field processing for media applications - p. 227 11. Chapter 10 Quality evaluation of light fields - p. 265 12. Chapter 11 Volumetric video – acquisition, interaction, streaming and rendering - p. 289 13. Chapter 12 MPEG immersive video - p. 327 14. Chapter 13 Point cloud compression - p. 357 15. Chapter 14 Coding of dynamic 3D meshes - p. 387 16. Chapter 15 Volumetric video streaming - p. 425 17. Chapter 16 Processing of volumetric video - p. 445 18. Chapter 17 Computational 3D displays - p. 469 19. Chapter 18 Subjective and objective quality assessment for volumetric video - p. 501 20. Chapter 19 MR in video guided liver surgery - p. 555 21. Chapter 20 Immersive media productions involving light fields and virtual production LED walls - p. 575 22. Chapter 21 Volumetric video as a novel medium for creative storytelling - p. 591 23. Chapter 22 Social virtual reality (VR) applications and user experiences - p. 609 24. Index - p. 649 25. Index - Continued - p. 663