On Photometric Stereo in the Presence of a Refractive Interface

Yvain Quéau; Robin Bruneau; Jean Mélou; Jean Denis Durou; François Lauze

doi:10.1007/978-3-031-31975-4_53

On Photometric Stereo in the Presence of a Refractive Interface

Yvain Quéau^*, Robin Bruneau, Jean Mélou, Jean Denis Durou, François Lauze

^*Corresponding author for this work

Image Analysis, Computational Modelling and Geometry

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

1 Citation (Scopus)

9 Downloads (Pure)

Abstract

We conduct a discussion on the problem of 3D-reconstruction by calibrated photometric stereo, when the surface of interest is embedded in a refractive medium. We explore the changes refraction induces on the problem geometry (surface and normal parameterization), and we put forward a complete image formation model accounting for refracted lighting directions, change of light density and Fresnel coefficients. We further show that as long as the camera is orthographic, lighting is directional and the interface is planar, it is easy to adapt classic methods to take into account the geometric and photometric changes induced by refraction. Moreover, we show on both simulated and real-world experiments that incorporating these modifications of PS methods drastically improves the accuracy of the 3D-reconstruction.

Original language	English
Title of host publication	Scale Space and Variational Methods in Computer Vision - 9th International Conference, SSVM 2023, Proceedings
Editors	Luca Calatroni, Marco Donatelli, Serena Morigi, Marco Prato, Matteo Santacesaria
Number of pages	13
Publisher	Springer
Publication date	2023
Pages	691-703
ISBN (Print)	9783031319747
DOIs	https://doi.org/10.1007/978-3-031-31975-4_53
Publication status	Published - 2023
Event	9th International Conference on Scale Space and Variational Methods in Computer Vision, SSVM 2023 - Santa Margherita di Pula, Italy Duration: 21 May 2023 → 25 May 2023

Conference

Conference	9th International Conference on Scale Space and Variational Methods in Computer Vision, SSVM 2023
Country/Territory	Italy
City	Santa Margherita di Pula
Period	21/05/2023 → 25/05/2023

Series	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14009 LNCS
ISSN	0302-9743

Bibliographical note

Funding Information:
Acknowledgements. This project was partially supported by the KU Data+ Project Phylorama, the ALICIA-Vision LabCom (ANR-19-LCV1-0002), and the Inclusive Museum Guide project (ANR-20-CE38-0007).

Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Access to Document

10.1007/978-3-031-31975-4_53

FulltextSubmitted manuscript, 2.34 MBLicence: Unspecified

Cite this

Quéau, Y., Bruneau, R., Mélou, J., Durou, J. D., & Lauze, F. (2023). On Photometric Stereo in the Presence of a Refractive Interface. In L. Calatroni, M. Donatelli, S. Morigi, M. Prato, & M. Santacesaria (Eds.), Scale Space and Variational Methods in Computer Vision - 9th International Conference, SSVM 2023, Proceedings (pp. 691-703). Springer. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Vol. 14009 LNCS https://doi.org/10.1007/978-3-031-31975-4_53

On Photometric Stereo in the Presence of a Refractive Interface. / Quéau, Yvain; Bruneau, Robin; Mélou, Jean; Durou, Jean Denis; Lauze, François.

Scale Space and Variational Methods in Computer Vision - 9th International Conference, SSVM 2023, Proceedings. ed. / Luca Calatroni; Marco Donatelli; Serena Morigi; Marco Prato; Matteo Santacesaria. Springer, 2023. p. 691-703 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 14009 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Quéau, Y, Bruneau, R, Mélou, J, Durou, JD & Lauze, F 2023, On Photometric Stereo in the Presence of a Refractive Interface. in L Calatroni, M Donatelli, S Morigi, M Prato & M Santacesaria (eds), Scale Space and Variational Methods in Computer Vision - 9th International Conference, SSVM 2023, Proceedings. Springer, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14009 LNCS, pp. 691-703, 9th International Conference on Scale Space and Variational Methods in Computer Vision, SSVM 2023, Santa Margherita di Pula, Italy, 21/05/2023. https://doi.org/10.1007/978-3-031-31975-4_53

Quéau Y, Bruneau R, Mélou J, Durou JD, Lauze F. On Photometric Stereo in the Presence of a Refractive Interface. In Calatroni L, Donatelli M, Morigi S, Prato M, Santacesaria M, editors, Scale Space and Variational Methods in Computer Vision - 9th International Conference, SSVM 2023, Proceedings. Springer. 2023. p. 691-703. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 14009 LNCS). https://doi.org/10.1007/978-3-031-31975-4_53

Quéau, Yvain ; Bruneau, Robin ; Mélou, Jean ; Durou, Jean Denis ; Lauze, François. / On Photometric Stereo in the Presence of a Refractive Interface. Scale Space and Variational Methods in Computer Vision - 9th International Conference, SSVM 2023, Proceedings. editor / Luca Calatroni ; Marco Donatelli ; Serena Morigi ; Marco Prato ; Matteo Santacesaria. Springer, 2023. pp. 691-703 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 14009 LNCS).

@inproceedings{b976cd82da904402a03fe7fe827a56ba,

title = "On Photometric Stereo in the Presence of a Refractive Interface",

abstract = "We conduct a discussion on the problem of 3D-reconstruction by calibrated photometric stereo, when the surface of interest is embedded in a refractive medium. We explore the changes refraction induces on the problem geometry (surface and normal parameterization), and we put forward a complete image formation model accounting for refracted lighting directions, change of light density and Fresnel coefficients. We further show that as long as the camera is orthographic, lighting is directional and the interface is planar, it is easy to adapt classic methods to take into account the geometric and photometric changes induced by refraction. Moreover, we show on both simulated and real-world experiments that incorporating these modifications of PS methods drastically improves the accuracy of the 3D-reconstruction.",

author = "Yvain Qu{\'e}au and Robin Bruneau and Jean M{\'e}lou and Durou, {Jean Denis} and Fran{\c c}ois Lauze",

note = "Funding Information: Acknowledgements. This project was partially supported by the KU Data+ Project Phylorama, the ALICIA-Vision LabCom (ANR-19-LCV1-0002), and the Inclusive Museum Guide project (ANR-20-CE38-0007). Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 9th International Conference on Scale Space and Variational Methods in Computer Vision, SSVM 2023 ; Conference date: 21-05-2023 Through 25-05-2023",

year = "2023",

doi = "10.1007/978-3-031-31975-4_53",

language = "English",

isbn = "9783031319747",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "691--703",

editor = "Luca Calatroni and Marco Donatelli and Serena Morigi and Marco Prato and Matteo Santacesaria",

booktitle = "Scale Space and Variational Methods in Computer Vision - 9th International Conference, SSVM 2023, Proceedings",

address = "Switzerland",

}

TY - GEN

T1 - On Photometric Stereo in the Presence of a Refractive Interface

AU - Quéau, Yvain

AU - Bruneau, Robin

AU - Mélou, Jean

AU - Durou, Jean Denis

AU - Lauze, François

N1 - Funding Information: Acknowledgements. This project was partially supported by the KU Data+ Project Phylorama, the ALICIA-Vision LabCom (ANR-19-LCV1-0002), and the Inclusive Museum Guide project (ANR-20-CE38-0007). Publisher Copyright: © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

PY - 2023

Y1 - 2023

N2 - We conduct a discussion on the problem of 3D-reconstruction by calibrated photometric stereo, when the surface of interest is embedded in a refractive medium. We explore the changes refraction induces on the problem geometry (surface and normal parameterization), and we put forward a complete image formation model accounting for refracted lighting directions, change of light density and Fresnel coefficients. We further show that as long as the camera is orthographic, lighting is directional and the interface is planar, it is easy to adapt classic methods to take into account the geometric and photometric changes induced by refraction. Moreover, we show on both simulated and real-world experiments that incorporating these modifications of PS methods drastically improves the accuracy of the 3D-reconstruction.

AB - We conduct a discussion on the problem of 3D-reconstruction by calibrated photometric stereo, when the surface of interest is embedded in a refractive medium. We explore the changes refraction induces on the problem geometry (surface and normal parameterization), and we put forward a complete image formation model accounting for refracted lighting directions, change of light density and Fresnel coefficients. We further show that as long as the camera is orthographic, lighting is directional and the interface is planar, it is easy to adapt classic methods to take into account the geometric and photometric changes induced by refraction. Moreover, we show on both simulated and real-world experiments that incorporating these modifications of PS methods drastically improves the accuracy of the 3D-reconstruction.

U2 - 10.1007/978-3-031-31975-4_53

DO - 10.1007/978-3-031-31975-4_53

M3 - Article in proceedings

AN - SCOPUS:85161175581

SN - 9783031319747

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 691

EP - 703

BT - Scale Space and Variational Methods in Computer Vision - 9th International Conference, SSVM 2023, Proceedings

A2 - Calatroni, Luca

A2 - Donatelli, Marco

A2 - Morigi, Serena

A2 - Prato, Marco

A2 - Santacesaria, Matteo

PB - Springer

T2 - 9th International Conference on Scale Space and Variational Methods in Computer Vision, SSVM 2023

Y2 - 21 May 2023 through 25 May 2023

ER -