IEEE SPS Distinguished Lecture:

Hierarchical joint classification models for multi-resolution, multi-temporal and multi-sensor remote sensing images. Application to natural disasters

Dr. Josiane Zerubia

INRIA, France

Event organized and sponsored by

IEEE Signal Processing Society Santa Clara Valley chapter

Schedule

8:00am - 8:05am: Announcements

8:05am - 9:30am: Talk followed by Q&A

Location: Online.

Please register on this page to get the meeting info sent on the day of the event.

Abstract

The capabilities to monitor the Earth's surface for example in the framework of the protection from environmental disasters such as floods or earthquakes play an important role in multiple social, economic, and human viewpoints. In this framework, accurate and time-efficient classification methods are important tools required to support the rapid and reliable assessment of ground changes and damages induced by a disaster. Given the substantial amount and variety of data available currently from last generation very-high resolution (VHR) satellite missions such as Pleiades, GeoEye, COSMO-SkyMed, or RadarSat-2, the main methodological difficulty is to develop classifiers that are powerful and flexible enough to utilize the benefits of multi-band, multi-resolution, multi-date, and multi-sensor input imagery. We propose a multi-date/multi-sensor and multi-resolution fusion based on explicit statistical modeling. The method combines a joint statistical model of multi- sensor and multi-temporal images through hierarchical Markov random field (MRF) modeling, leading to statistical supervised classification approaches. We have developed novel hierarchical Markov random field models, based on the marginal posterior modes (MPM) criterion, that support information extraction from multi-temporal and/or multi-sensor information and allow the joint supervised classification of multiple images taken over the same area at different times, from different sensors, and/or at different spatial resolutions. The developed methods have been experimentally validated with complex optical multi-spectral (Pleiades), X-band SAR (COSMO- Skymed), and C-band SAR (RadarSat-2) imagery taken after Haiti earthquake. The experimental results show that the methods are able to provide accurate classification maps from input heterogeneous imagery. Experimental results and comparisons with the state of the art suggest the effectiveness of the proposed approaches in fusing multiple information sources for classification purposes. The proposed techniques are interesting in terms of classification accuracy, spatial regularity of the classification maps, minimization of spatial artifacts, and tradeoff with respect to computation time.

Speaker Bio

Josiane Zerubia has been a permanent research scientist at INRIA since 1989 and director of research since July 1995 (DR 1st class since 2002). She was head of the PASTIS remote sensing laboratory (INRIA Sophia-Antipolis) from mid-1995 to 1997 and of the ARIANA research group (INRIA/CNRS/University of Nice), which worked on inverse problems in remote sensing and biological imaging, from 1998 to 2011. From 2012 to 2016, she was head of AYIN research group (INRIA-SAM) dedicated to models of spatio-temporal structure for high-resolution image processing with a focus on remote sensing and skincare imaging. She is head of AYANA exploratory research group since 2020. AYANA is an interdisciplinary project using knowledge in stochastic modeling, image processing, artificial intelligence, remote sensing and embedded electronics/computing.

She has been professor (PR1) at SUPAERO (ISAE) in Toulouse since 1999.

Before that, she was with the Signal and Image Processing Institute of the University of Southern California (USC) in Los-Angeles as a postdoc. She also worked as a researcher for the LASSY (University of Nice/CNRS) from 1984 to 1988 and in the Research Laboratory of Hewlett Packard in France and in Palo-Alto (CA) from 1982 to 1984. She received the MSc degree from the Department of Electrical Engineering at ENSIEG, Grenoble, France in 1981, the Doctor of Engineering degree, her PhD and her ‘Habilitation’, in 1986, 1988, and 1994 respectively, all from the University of Nice Sophia-Antipolis, France.

She is a Fellow of both the IEEE (2003- ) and the EURASIP (2019- ), and IEEE SP Society Distinguished Lecturer (2016-2017). She was a member of the IEEE IMDSP TC (SP Society) from 1997 to 2003, of the IEEE BISP TC (SP Society) from 2004 to 2012 and of the IVMSP TC (SP Society) from 2008 to 2013. She was associate editor of IEEE Trans. on IP from 1998 to 2002, area editor of IEEE Trans. on IP from 2003 to 2006, guest co-editor of a special issue of IEEE Trans. on PAMI in 2003, member of the editorial board of IJCV from 2004 to March 2013 and member-at-large of the Board of Governors of the IEEE SP Society from 2002 to 2004. She was also associate editor of the on-line resource « Earthzine » (IEEE CEO and GEOSS) from 2006 to mid-2018. She has been a member of the editorial board of the French Society for Photogrammetry and Remote Sensing (SFPT) since 1998, of the Foundation and Trends in Signal Processing since 2007 and member-at-large of the Board of Governors of the SFPT since 2014. She has been a member of the editorial board of the IEEE Signal Processing Magazine since September 2018. Finally, she has been member-at-large of the Awards Board of the IEEE SP Society since 2020.

She was co-chair of two workshops on Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR'01, Sophia Antipolis, France, and EMMCVPR'03, Lisbon, Portugal), co-chair of a workshop on Image Processing and Related Mathematical Fields (IPRM'02, Moscow, Russia), technical program chair of a workshop on Photogrammetry and Remote Sensing for Urban Areas (Marne La Vallée, France, 2003), co-chair of the special sessions at IEEE ICASSP 2006 (Toulouse, France) and IEEE ISBI 2008 (Paris, France), publicity chair of IEEE ICIP 2011 (Brussels, Belgium), tutorial co-chair of IEEE ICIP 2014 (Paris, France), general co-chair of the workshop EarthVision at IEEE CVPR 2015 (Boston, USA) and a member of the organizing committee and plenary talk co-chair of IEEE-EURASIP EUSIPCO 2015 (Nice, France). She also organized and chaired an international workshop on Stochastic Geometry and Big Data at Sophia Antipolis, France, in 2015. She was part of the organizing committees of the workshop EarthVision (co-chair) at IEEE CVPR 2017 (Honolulu, USA) and GRETSI 2017 symposium (Juan les Pins, France). She is scientific advisor and co-organizer of ISPRS 2020 congress postponed to July 2021 (Nice, France) and technical co-chair of IEEE-EURASIP EUSIPCO 2021 (Dublin, Ireland).

Her main research interest is in image processing using probabilistic models. She also works on parameter estimation, statistical learning and optimization techniques, and artificial intelligence.