{"id":39503,"date":"2016-09-26T13:05:33","date_gmt":"2016-09-26T13:05:33","guid":{"rendered":"http:\/\/www.labri.fr\/perso\/barla\/blog\/?p=39503"},"modified":"2019-08-13T16:12:35","modified_gmt":"2019-08-13T16:12:35","slug":"perceptual-encoding","status":"publish","type":"post","link":"https:\/\/www.labri.fr\/perso\/barla\/blog\/?p=39503","title":{"rendered":"Image decomposition"},"content":{"rendered":"<p id=\"top\" \/>\n<h3 class=\"wp-block-heading\">Challenge<\/h3>\n\n\n\n<p>Go from the 3-stimulus, 2 dimensional image to a multi-dimensional encoding of the ambient optic array.<\/p>\n\n\n\n<p>Decompose or rather <em>disentangle <\/em>different effects such as reflectance, highlights, lighting, transparency, etc from mere luminance. At the same time, allow for tolerance and invariance by defining what makes elements of the image be considered as &#8220;the same&#8221;. <em>Compensate <\/em>for distorsions due to perspective, shape, contours, depth to yield information about materials, size, proximity, location, etc.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"moz-text-html wp-block-heading\">At the <b>microscopic <\/b>level&#8230;<\/h3>\n\n\n\n<p class=\"moz-text-html\">&#8230; decomposition is based on <i>material.<br><\/i><br>Various families of light paths interacting with interfaces and media in a layered structure. Encapsulate wave-light phenomena, consider average over ensemble realizations (and time). Identify symmetries and relevant parametrizations, retain spectral resolution (polarization?). Decomposition in terms of material lobe properties and their evolution with varying incidence.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"moz-text-html wp-block-heading\">At the <b>surface <\/b>level&#8230;<\/h3>\n\n\n\n<p>\u2026 decomposition is based on <em>shape<\/em>.<\/p>\n\n\n\n<p>Characterize radiance gradient due to small variations in positions, normals, tangents and view. Analyze gradient fields at multiple scales, study their correlations especially at occluding contours. Identify how shape features are conveyed\u00a0 by compression\/stretching, spectral changes, instantaneous motion. Decomposition in terms of distorsions of textures, shading, reflections and spectra at multiple scales.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"moz-text-html wp-block-heading\">At the <b>sensor <\/b>level&#8230;<\/h3>\n\n\n\n<p>\u2026 decomposition is based on <em>layout.<\/em><\/p>\n\n\n\n<p>Identify internal and external occluding contours based on projected gradient fields structure and motion. Separate transparent objects from background, distributions of thin objects from each other. Rely on motion or disparity to further distinguish between apparently disjoint objects in the scene. Decomposition in terms of layers stacked and intertwined in depth with need of completion.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Challenge Go from the 3-stimulus, 2 dimensional image to a multi-dimensional encoding of the ambient optic array. Decompose or rather disentangle different effects such as reflectance, highlights, lighting, transparency, etc from mere luminance. At the same time, allow for tolerance and invariance by defining what makes elements of the image be considered as &#8220;the same&#8221;. &#8230; <a title=\"Image decomposition\" class=\"read-more\" href=\"https:\/\/www.labri.fr\/perso\/barla\/blog\/?p=39503\" aria-label=\"Read more about Image decomposition\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[651],"tags":[],"class_list":["post-39503","post","type-post","status-publish","format-standard","hentry","category-thoughts"],"_links":{"self":[{"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=\/wp\/v2\/posts\/39503","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=39503"}],"version-history":[{"count":5,"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=\/wp\/v2\/posts\/39503\/revisions"}],"predecessor-version":[{"id":40077,"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=\/wp\/v2\/posts\/39503\/revisions\/40077"}],"wp:attachment":[{"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=39503"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=39503"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.labri.fr\/perso\/barla\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=39503"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}