# Efficient robust image interpolation and surface properties using polynomial texture mapping

- Mingjing Zhang
^{1}and - Mark S Drew
^{1}Email author

**2014**:25

https://doi.org/10.1186/1687-5281-2014-25

© Zhang and Drew; licensee Springer. 2014

**Received: **10 August 2013

**Accepted: **16 April 2014

**Published: **1 May 2014

## Abstract

Polynomial texture mapping (PTM) uses simple polynomial regression to interpolate and re-light image sets taken from a fixed camera but under different illumination directions. PTM is an extension of the classical photometric stereo (PST), replacing the simple Lambertian model employed by the latter with a polynomial one. The advantage and hence wide use of PTM is that it provides some effectiveness in interpolating appearance including more complex phenomena such as interreflections, specularities and shadowing. In addition, PTM provides estimates of surface properties, i.e., chromaticity, albedo and surface normals. The most accurate model to date utilizes multivariate Least Median of Squares (LMS) robust regression to generate a basic matte model, followed by radial basis function (RBF) interpolation to give accurate interpolants of appearance. However, robust multivariate modelling is slow. Here we show that the robust regression can find acceptably accurate inlier sets using a much less burdensome 1D LMS robust regression (or ‘mode-finder’). We also show that one can produce good quality appearance interpolants, plus accurate surface properties using PTM before the additional RBF stage, provided one increases the dimensionality beyond 6D and still uses robust regression. Moreover, we model luminance and chromaticity separately, with dimensions 16 and 9 respectively. It is this separation of colour channels that allows us to maintain a relatively low dimensionality for the modelling. Another observation we show here is that in contrast to current thinking, using the original idea of polynomial terms in the lighting direction outperforms the use of hemispherical harmonics (HSH) for matte appearance modelling. For the RBF stage, we use Tikhonov regularization, which makes a substantial difference in performance. The radial functions used here are Gaussians; however, to date the Gaussian dispersion width and the value of the Tikhonov parameter have been fixed. Here we show that one can extend a theorem from graphics that generates a very fast error measure for an otherwise difficult leave-one-out error analysis. Using our extension of the theorem, we can optimize on both the Gaussian width and the Tikhonov parameter.

## Keywords

## 1 Introduction

*n*images captured using lighting from different directions. A typical rig would consist of a hemisphere of xenon flash lamps imaging an object, where directions to each light is known (Figure 1a). The basic idea in PTM is to improve on a simple Lambertian model for matte content, whereby the three components of the light direction are mapped to luminance, by extending the model to include a low-order polynomial of lighting-direction components. The strength of PTM, in comparison to a simple Lambertian photometric stereo (PST) [2] is that PTM can better model real radiance and to some extent grasp intricate dependencies due to self-shadowing and interreflections. Usually, some 40 to 80 images are captured. The better capture of details is the driving force behind the interest in this technique evinced by many museum professionals, with the original least squares (LS)-based PTM method already in use at major museums in the USA, including the Smithsonian, the Museum of Modern Art and the Fine Arts Museums of San Francisco, and is planned for the Metropolitan and the Louvre (M. Mudge, personal communication, Cultural Heritage Imaging). As well, some work has involved applying PTM

*in situ*for such applications as imaging palaeolithic rock art [3]. In such situations, one has to

*recover*lighting directions from the specular patch on a reflective sphere [4]; such a ‘highlight’ method [5] can also be applied to museum capture of small objects or to microscopic image capture.

PTM generates a matte model for the surface, where luminance (or RGB) is modelled at each pixel via a polynomial regression from light-direction components to luminance. Say, e.g. there are *n*=50 images, with *n* known normalized light-direction three-vectors a. Then in the original embodiment, a six-term polynomial model is fitted at each pixel separately, regressing onto that pixel’s *n* luminance values using LS regression. The main objectives of PTM are the ability to *re-light* pixels using the regression parameters obtained, as well as the recovery of surface properties: surface normal, colour and albedo. For re-lighting, the idea is simply that if the regression from the *n* in-sample light-directions a to *n* luminance values, *L* is known then substituting a new a will generate a new *L*, thus yielding a simple interpolation scheme for new, out-of-sample, light directions a.

In [6], we extend PTM in three ways: First, the six-term polynomial is changed so as to allow purely linear terms to model purely linear luminance exactly. Secondly, the LS regression for the underlying matte model is replaced by a robust regression, the least median of squares (LMS) method [7]. This means that only a majority of the *n* pixel values obtained at each pixel need be actually matte, with specularities and shadows automatically identified as outliers. With correctly identified matte pixels in hand, surface normals, albedos and pixel chromaticity are more accurately recovered. Thirdly, authors in [6] further add an additional interpolation level by modelling the part of in-sample pixel values that is not completely explained by the matte PTM model via a radial basis function (RBF) interpolation. The RBF model does a much better job of modelling features such as specularities that depend strongly on the lighting direction. As well, the RBF approach can make use of any shadow information to help model interpolated shadows, which change abruptly with lighting direction. The interpolation is still local to each pixel and, thus, does not attempt to bridge non-specular locales as in reflectance sharing, for example [8, 9]. In reflectance sharing, a *known* surface geometry is assumed, as opposed to the present paper. Here, we rely on the idea that there is at least a small contribution to specularity at any pixel, e.g. the sheen on skin or paintwork, so that we need not share across neighbouring pixels and can employ the RBF approach from [6]. For cast shadows, a more difficult feature to model, at each pixel the RBF model will utilize whatever shadow content is actually present across the whole set of *n* images from *n* lights.

- 1.
We introduce a more efficient, ‘mode-finder’ regression method to replace the computationally intensive multivariate LMS regression in the matte modelling stage. Compared to the 6D LMS regression, the mode-finder effectively reduces the number of unknowns from 6 to 1 and thus greatly reduces the processing time from

*O*(*n*^{6}log*n*) to*O*(*n*log*n*) ([7], p. 206). We found that this simplification introduces little reduction of accuracy. Although technically the mode-finder regression approach can be applied to the mode of either luminance or any colour components, we show that the mode of luminance provides the highest accuracy.

*n*luminance values at the current pixel, select one randomly; continue and adopt as the best estimate of the ‘mode’ that luminance which delivers the least median of squared residuals. What makes the LMS method powerful is that it provides strong mathematical guarantees on the performance given by choosing a much smaller subset than a simple exhaustive search and it also delivers an inlier band, automatically, thus classifying luminance values as usable or not. The multivariate version of LMS is similar: for 6D LMS, e.g., we randomly select six luminances and find residuals for a polynomial regression. Again, the number of selections is tremendously smaller than an exhaustive search, but nonetheless is very slow compared to a 1D search.

- 2.
We explore different combinations of basis functions for PTM. Firstly, we extend the classical polynomial models from 6D to 16D. Moreover, due to another observation we made that luminance reconstruction has a far greater impact on the re-lighted image quality than the reconstruction of chromaticity, we can reduce the dimension for chromaticity modelling with little loss of accuracy. Reducing the number of float regression coefficients makes a difference, when we multiply by millions of pixels. We found that 16D for luminance + 9D for chromaticity is a good balance between dimensionality and accuracy. Secondly, we compared the performance of the hemiSpherical harmonics (HSH) basis against the polynomial basis of the same order and found that, surprisingly, the polynomial model outperforms HSH in terms of the quality of appearance reconstruction, especially at large incident angles.

- 3.
We adopt a method to mathematically determine the optimal parameters used for the RBF interpolation stage. Previously in [6], we made use of an RBF network consisting of Gaussian radial functions to model the non-Lambertian contribution. The parameters in this model, including the Gaussian dispersion

*σ*and Tikhonov regularization coefficient*τ*, were taken heuristically and remained constant across all pixels. In this work, we start off from a theorem that minimizes error in a leave-one-out analysis by optimizing the Gaussian dispersion parameter. Such a theorem is not new, but here we extend its use to whole images and three-channel colour. More importantly, however, we also extend the theorem to optimize over the Tikhonov regularization. For the fairly large size matrices being inverted, these optimizations matter and make a substantial difference to results obtained.

Note that contributions 1 and 3 are direct improvements over the methodology of the PTM + RBF pipeline: Contribution 1 is aimed at increasing the efficiency of the first stage - matte modelling; contribution 3 is devoted to the optimization of the second stage - RBF interpolation. On the other hand, the goal of contribution 2 is to find an optimal set of basis functions. The discoveries made in contribution 2 can be applied to the matte modelling stage of PTM + RBF, as well as regular PTM with no RBF interpolation.

This paper is organized as follows: In Section 2 we review previous work in this area, and in Section 3 we provide a brief recapitulation of the PTM method. In Section 4 we introduce the notion of our contribution 1 - using a robust mode-finder instead of a full multivariate robust regression and explicate how we use the mode-finder and trimmed LS to realize outlier detection and recover surface properties. In Section 5, focusing on contribution 2, we test the appearance reconstruction with PTM separately applied to luminance and chromaticity and compare the reconstructed matte appearance for PTM and for HSH. In Section 6 we describe our contribution 3, i.e. how to use an optimized version of the RBF framework to interpolate specularity and shadows on reconstructed images. Finally, Section 7 presents concluding remarks.

## 2 Related work

Many methods for detecting outlier pixels in photometric methods have been proposed. Early examples include a four-light PST approach in which the values yielding significantly differing albedos are excluded [10–12]. In a similar five-light PST method [13], the highest and the lowest values, presumably corresponding to highlights and shadows, are simply discarded. Another four-light method [14] explicitly includes ambient illumination and surface integrability and adopts an iterative strategy using current surface estimates to accept or reject each additional light based on a threshold indicating a shadowed value. The problem with these methods is that they rely on throwing away only a small number of outlier pixel values, whereas our robust methods in the current and previous studies allow up to 50% of the pixel values discarded as outliers.

More recently, Willems et al. [15] used an iterative method to estimate normals. Initially, the pixel values within a certain range (10 to 240 out of 255) were used to estimate an initial normal map. In each of the following iterations, error residuals in normals for all lighting directions are computed and the normals are updated based only on those directions with small residuals. Sun et al. [16] showed that at least six light sources are needed to guarantee that every location on the surface is illuminated by at least three lights. They proposed a decision algorithm to discard only doubtful pixels, rather than throwing away all pixel values that lie outside a certain range. However, the validity of their method is based on the assumption that out of the six values for each pixel, there is at most one highlight pixels and two shadowed pixels. Julia et al. [17] utilized a factorization technique to decompose the luminance matrix into surface and light source matrices. The shadow and highlight pixels are considered as missing data, with the objective of reducing their influence on the result. Wu et al. [18] formulated the problem of surface normal recovery as a rank minimization problem, which can be solved via convex optimization. Their method is able to handle specularities and shadows as well as other non-Lambertian deviations. Compared to these methods, the algorithm proposed here is a good deal simpler, while producing excellent results.

A small number of recent studies utilize probability models as a mechanism to try to incorporate handling shadows and highlights into the PST formulation. Tang et al. [19] model normal orientations and discontinuities with two coupled Markov random fields (MRFs). They proposed a tensorial belief propagation method to solve the *maximum a posteriori* problem in the Markov network. Chandraker et al. [20] formulate PST as a shadow labelling problem where the labels of each pixel’s neighbours are taken into consideration, enforcing the smoothness of the shadowed region, and approximate the solution via a fast iterative graph-cut method. Another study [21] employs a maximum-likelihood (ML) imaging model for PST. In their method, an inlier map modelled via MRF is included in the ML model. However, the initial values of the inlier map would directly influence the final result, whereas our methods do not depend on the choice of any prior.

Yang et al. [22] include a dichromatic reflection model into PST and associated method for both estimating surface normals as well as separating the diffuse and specular components, based on a surface chromaticity invariant. Their method is able to reduce the specular effect even when the specular-free observability assumption (that is, each pixel is diffuse in at least one input image) is violated. However, this method does not address shadows and fails on surfaces that mix their own colours into the reflected highlights, such as metallic materials. Moreover, their method also requires knowledge of the lighting chromaticity - they suggest a simple white-patch estimator - whereas in our method, we have no such requirement. Kherada et al. [23] proposed a component-based mapping method. They decompose the captured images into direct and global components - single bounce of light from a surface, as opposed to illumination onto a point that is interreflected from all other points of the scene. They then model matte, shadow and specularity separately within each component. Their method is stated to provide a better appearance reconstruction than the original PTM [1], although at the cost of a much heavier computational load, but depends on a training phase and requires accurate disambiguation of direct and global contributions.

Aside from the polynomial basis, it is possible to use other types of basis function in PTM, as long as they provide a good approximation of the light-reflectance interaction. Spherical harmonics (SH), the angular portion of a set of solutions to the Laplace’s equations defined on a sphere, appear to be a good candidate for this purpose. Due to their appealing mathematical properties, they have been extensively applied in a great variety of topics in computer graphics, such as the modelling of BRDFs [24], early work on image-based rendering and re-lighting [25, 26], BRDF shading [27], irradiance environment maps [28], precomputed radiance transfer [29, 30], distant lighting [31, 32] and lighting-invariant object recognition [33]. However, in the context of PTM, we note that the incoming and outgoing lights are defined only on the upper hemisphere. Therefore, representation of such a hemispherical function using basis functions defined over the full spherical domain introduces discontinuities at the boundary of the hemisphere and requires a large number of coefficients [34]. Thus, it is more natural to map these functions to a basis set defined only over the upper hemisphere. In [34], a HSH basis derived from SH using shifted associated Legendre polynomials was proposed. This basis has been applied in surface modelling under distant illumination [35] and in shape description and reconstruction of surfaces [36]. Recent progress on HSH includes a HSH-based Helmholtz bidirectional reflectance basis [37] and noise-resistant Eigen hemispherical harmonics. In this study, we incorporate the HSH basis as proposed in [34] into the framework of PTM and compare its performance with the polynomial basis.

PTM and other similar reflectance transformation imaging (RTI) methods have found extensive applications in cultural heritage imaging and art conservation. Earl et al. use PTM to capture and visually examine a great variety of ancient artefacts, including bronze busts, coins, paintings, ceramics and cuneiform inscriptions [38–41]. Duffy [42] employed a highlighted RTI method to record the prehistoric rock inscriptions and carvings at the Roughting Linn rock site, UK. Padfield et al. [43] adopted PTM to digitally capture paintings in order to monitor their physical changes during conservation. These applications demonstrate the ability of PTM to visually enhance the captured images via different display modes, most notably specular enhancement and diffuse gain, allowing for inspection of features such as fingerprints and erasure marks that are otherwise much less visually prominent in regular images.

## 3 Matte modelling using PTM

### 3.1 Luminance

PTM models smooth dependence of images on lighting direction via polynomial regression. Here we briefly recapitulate PTM as amended by [6]: Suppose *n* images of a scene are taken with a fixed-position camera and lighting from *i*=1..*n* different lighting directions a^{
i
}=(*u*^{
i
}, *v*^{
i
}, *w*^{
i
})^{
T
}. Let each RGB image acquired be denoted ρ^{
i
}, and we also make use of luminance images, ${L}^{i}=\sum _{k=1}^{3}{\rho}_{k}^{i}$. Colour is re-inserted later, as is described in Section 3.4. It is also possible to ‘multiplex’ illumination by combining several lights at once in order to decrease noise [44], but here we simply use one light at a time.

This differs from the original PTM formulation [1] in that originally the polynomial used had been (*u*,*v*,*u*^{2},*v*^{2},*u* *v*,1), which unfortunately does not model a true Lambertian (linear) surface well since it must warp a non-linear model to suit linear data.

*x*,

*y*) separately, we can seek a polynomial regression six-vector of coefficients c(

*x*,

*y*) in a simple model, regressing lighting directions onto luminance:

*n*=50, then we could write this as

An example dataset (code named *Barb*) for PTM is displayed in Figure 1b, which was captured with a 50-light dome (i.e. *n*=50) similar to the one shown in Figure 1a. The dataset *Barb* has large specular and shadowed regions, which cannot be well addressed by the classical PTM model, and such datasets have typically been avoided. Thus, we find *Barb* an ideal representative dataset to test the accuracy and/or robustness of a re-lighting method. On other such difficult datasets we have tried, very similar results were found (see [6] for depictions of shiny and shadowed datasets).

### 3.2 Robust 6D regression

While the 6D LMS regression is slow, it is guaranteed to omit distracting features such as specularities and shadows. Due to the 50% breakdown point of LMS, it requires that at least half plus 1 of the luminance observations belong to a base matte reflectance that can be sufficiently addressed by a polynomial model. Fortunately, this requirement is satisfied for most pixels in real-world datasets. This regression method will be referred to Method:LMS in the following text.

### 3.3 Re-lighting

^{′}and estimated polynomial coefficients c(

*x*,

*y*), the approximated luminance can be expressed as:

Note that with Method:LMS, c(*x*,*y*) was obtained from a trimmed LS where only the matte observations are used. Therefore, the resulting *L*^{′}(*x*,*y*) is expected to show matte-only contents as well, and non-matte components can be later addressed by other methods (such as the RBF interpolation we will describe in Section 6). This contrasts the robust methods with Method:LS, which uses only PTM to capture both the matte and non-matte components (to some degree) at the same time. Also note that in Equation 4 only luminance is recovered. Colour would be re-introduced by multiplying the chromaticity and the albedo as in Equation 5 as discussed next.

### 3.4 Colour, normals and albedo

*L*consists of the sum of colour components:

*L*=

*R*+

*G*+

*B*. Luminance is given by the shading

*s*(e.g. this could in the simplest case be Lambertian shading, meaning surface normal dotted into light direction) times albedo

*α*: i.e.

*L*=

*s*

*α*. The chromaticity χ is defined as RGB colour ρ, made independent of intensity by dividing by the

*L*

_{1}norm:

*ω*=0 for outliers. As in [6], once inliers are identified we recover a robust estimate of chromaticity χ as the median of inlier values, for

*k*=1..3:

*n*×3 matrix A, suppose

*ω*

^{0}is an index variable giving the inlier subset of light directions:

*ω*

^{0}=(

*ω*≡1). Using just the inlier subset, a trimmed version of PST gives an estimate of normalized surface normal $\hat{\mathit{n}}\phantom{\rule{2.22144pt}{0ex}}$ and albedo

*α*via

where A^{
†
} is the Moore-Penrose pseudoinverse. Other weighting functions are also possible, such as the triangular function used by Method:QUANTILE which we will briefly describe in Section 4.1.

With chromaticity χ in hand, Equation 5 gives RGB pixel values ρ for the interpolated luminance *L*, and (7) above also gives us the properties albedo *α* and surface normal $\hat{\mathit{n}}\phantom{\rule{2.22144pt}{0ex}}$ intrinsic to the surface.

Institutional users of the PTM approach are indeed interested in appearance modelling for re-lighting, but they are also separately interested in surface properties, especially accurate surface normals, which carry much of the shape information.

## 4 Robust chromaticity/luminance modes

In this section, we present our first main contribution. As we mentioned in Section 3.2, despite its high robustness LMS can be very slow. Therefore, it is necessary to find a less computationally expensive robust method. Here, we suggest a simplified form of LMS - the mode-finder approach.

### 4.1 Robust mode-finder algorithm

The rationale of Method:MODE is that non-matte outlier observations usually take extreme values in luminance (for instance, shadowed and specular pixels may have an intensity close to 0 and 1, respectively), or their chromaticity may deviate from other matte observations (for instance, specular observations are usually more desaturated whereas shadowed regions appear darker).

Method:MODE may seem to be merely another example of previous thresholding methods. In a typical method of this type [45], the top 10% and the bottom 50% of luminance observations are simply discarded. Then, coefficient values sought are found using a triangular function to weight lighting directions in the resulting range. As in [6], we refer to this simple method as Method:QUANTILE and denote the original PTM method as Method:LS. However, Method:MODE is different from Method:QUANTILE in that the inlier range is calculated based on the distribution of the observation values rather than the empirical values and heuristic triangle functions previously employed. Simply put, Method:MODE lets the data itself dictate what values are in- and outliers.

### 4.2 Mode-finder versus LMS

In essence, both Method:LMS and Method:MODE attempt to fit a mathematical model to as many data points as possible by minimizing the median of residuals and then identify an inlier range around the fitted model. All observations that fall outside of this range are deemed outliers. The only difference between the two methods is the mathematical model used: Method:LMS fits the data with a 6D polynomial model, whereas Method:MODE approximates the observations with one single scalar constant, i.e. a 1D mathematical model.

*Barb*dataset (marked by a yellow cross in Figure 2a). In Figure 2b,c, the actual luminance observations at this pixel location from 50 lighting conditions are represented as either black solid dots (if they are identified as inliers) or red crosses (for outliers) and are sorted in ascending order. For comparison, the approximated luminance values are shown as blue circles. An observation is classified as outlier if (1) its value is outside the inlier band, marked with green shade enclosed by blue dashed lines or (2) its

*approximated*value (blue circle) is negative. Note that the major difference between Method:LMS (Figure 2b) and Method:Mode (Figure 2c) is that the 6D polynomial model in LMS generates an inlier band that closely approximates the actual data curve, whereas the 1D constant model in Method:MODE creates a wider, horizontal band. Despite this seemingly crucial difference, Method:MODE as a matter of fact correctly captures most of the outliers identified by Method:LMS. Although Method:MODE may throw away more data points than necessary, it would not negatively affect the accuracy of estimated polynomial coefficients since these unnecessarily excluded data points are matte anyway and a robust method is not affected by the sum of squared residuals as in LS.

### 4.3 Luminance versus chromaticity modes

As mentioned earlier in Subsection 4.1, the mode-finder can be applied on luminance but as well could be applied to colour components, since non-matte observations tend to have an altered chromaticity. For example, in Figure 2c, we have shown the outliers identified by Method:MODE on luminance. In Figure 2d, we apply mode-finder on green chromaticity only and find that the observations with outlying green components (red circles) tend to have outlying red chromaticities as well. In addition, the chromaticity outliers are also expected to largely overlap with the luminance outliers.

It is also possible to combine outliers obtained from different chromaticities or even mix luminance/chromaticity outliers in the hope of getting a more accurate outlier estimation. For example, we can estimate outliers using green chromaticity (this subset of outlier indices are denoted *c*_{green}) and red chromaticity (*c*_{red}) at the same time, and then take the outliers *c* that appear in both *c*_{green} and *c*_{red}, i.e. *c*=*c*_{green}∩*c*_{red}. We refer to such a combined method as ‘green & red’.

where ‘ >’ means better accuracy; using luminance alone is always best, (green & red) seems to be slightly worse than green only, and (green & red & lum) is between green and luminance. In comparison, using luminance with Method:QUANTILE has the worst performance.

## 5 Higher-dimensional LS-based PTM and hemispherical harmonics

In this section, we present our second contribution. First, we investigate what can be gained by increasing the dimensionality of the classical PTM model above 6D without including robust regression. In addition, we apply PTM with different dimensions to model luminance and chromaticity separately. The objective of this part of the investigation is to show that one can, in fact, go quite a long way towards accuracy of appearance modelling using only high-dimensional smooth regression, without the final step of RBF modelling, provided we separate modelling of luminance and chrominance.

Secondly, aside from polynomials, other sets of basis functions can be used to model lighting-surface interaction. One notable example is HSH [34] - it has also been suggested that one could replace a PTM polynomial basis by HSH instead [47]. HSH is mathematically very similar to SH which have already been extensively employed in computer graphics. The key difference between HSH and SH is that HSH is only defined for light directions that live on an upper hemisphere, making it more appropriate for our experimental setup.

The conclusions we reach are that (1) a higher dimension does indeed substantially improve the quality of the reconstructed appearance; (2) if we *split* the problem into modelling luminance and chrominance separately, rather than applying PTM to each component of colour, then we can reduce the dimensionality for chrominance, compared to that for luminance - we find that 16D for luminance and 9D for chrominance work well; and (3) surprisingly, PTM works better than HSH. Note that every dataset we tried behaved this same way.

### 5.1 Separation of luminance and chromaticity using LS-based PTM

*d*. In order to calculate the overall PSNR between the original and the approximated set of images, we make the individual images into collages, as the one shown in Figure 1b, and compute the similarity between the original and approximated collages. Here we traverse

*d*values 1, 4, 6, 9 and 16. We see that the reconstructed image quality improves steadily as dimensionality increases for both PTM and HSH (which will be covered in Section 5.2), and in fact PTM produces an acceptable (chosen to be PSNR ≥ 30 dB) reconstruction at

*d*=16. Second, we also investigate modelling the luminance and chromaticity separately, using different dimensionalities for each. (Note that only two of the components of χ need be modelled, since $\sum _{k=1}^{3}{\chi}_{k}\equiv 1$). Figure 4b shows results for dimension of luminance versus chrominance, for HSH (coloured surface) and PTM (black circles). We see that while a higher dimension for luminance is important (as in Figure 4a), the accuracy of approximation of chrominance is only mildly dependent upon dimension. The actual PSNR values plotted in Figure 4b are shown in Table 1.

**Comparison of PTM and HSH over various dimensionalities**

Chrom terms | Lum terms | |||||
---|---|---|---|---|---|---|

1 | 4 | 6 | 9 | 16 | ||

PTM basis | 1 | 19.66 | 24.19 | 26.15 | 28.40 | 31.15 |

4 | 19.84 | 24.50 | 26.53 | 28.74 | 31.55 | |

6 | 19.82 | 24.48 | 26.55 | 28.79 | 31.73 | |

9 | 19.77 | 24.45 | 26.50 | 28.99 |
| |

16 | 19.75 | 24.37 | 26.45 | 28.96 | 32.59 | |

HSH basis | 1 | 19.66 | 24.02 | 25.03 | 26.27 | 27.16 |

4 | 19.81 | 24.20 | 25.19 | 26.39 | 27.28 | |

6 | 19.79 | 24.19 | 25.24 | 26.45 | 27.38 | |

9 | 19.76 | 24.17 | 25.22 | 26.54 | 27.50 | |

16 | 19.75 | 24.14 | 25.21 | 26.54 | 27.57 |

Due to the two observations made above, we conclude that the quality of the reconstructed images is mainly determined by the luminance, rather than the chromaticities. Hence, in order to achieve a high PSNR with a given dimensionality, it is reasonable to assign a higher dimensionality for luminance and a relatively lower dimensionality for chromaticities. Here we adopt *d*=16 for luminance and *d*=9 for chromaticities, making the total number of dimensions 16+9×2=34.

### 5.2 Comparison of higher-dimension PTM and HSH

where ^{
†
} indicates forming a pseudoinverse using a small amount of regularization, with Tikhonov parameter (denoted *τ*) of, say, *τ*=10^{−3}.

We relegate the definition of HSH to Appendix 1. There we list explicitly the definition of the first 16 HSH basis functions, along with the first 16 PTM polynomials.

Recall that in Figure 4a, HSH is consistently outperformed by PTM of the same dimension. Even at a high dimension *d*=16, HSH still cannot produce an acceptable result. Similar results are shown in Figure 4b and Table 1.

We further compare the PSNR for each individual image in the dataset. Figure 4c,d shows PSNR for approximation of each image in the colour image set, using PTM and HSH, respectively. Here, as described in Section 5.1, *d*=16 for luminance and *d*=9 for chrominance are used. We see that as well as producing higher PSNR values, PTM also does not lose too much accuracy for lighting directions with large incident angles (lights low to the object), whereas HSH does very poorly at these boundary points.

**Comparison of modelling luminance + chromaticity and RGB**

Mean | Median | Mean bottom quartile | Mean top quartile | ||
---|---|---|---|---|---|

Lum + Chrom (16D + 9D ×2) | PTM | 32.60 | 32.80 | 28.58 | 36.37 |

HSH | 31.80 | 32.86 | 24.67 | 36.51 | |

RGB (11D ×3) | PTM | 30.35 | 30.49 | 25.71 | 34.20 |

HSH | 30.33 | 31.28 | 23.68 | 34.95 | |

RBF | 47.94 | 46.47 | 36.60 | 61.63 |

## 6 Specularities and shadows: RBF modelling

*N*-pixel images, the ‘excursion’ H is defined as the set of (

*N*×3×

*n*) non-matte colour values not explained by the R

_{matte}given by the basic PTM matte Equation 3, now extended to functions of the colour channel as well: the approximated colour matte image is given by

where C is the collection of all luminance-regression slopes. Since we include colour, all RBF quantities become functions of the colour channel as well. Throughout, we use the mode-finder efficient robust outlier finder to determine coefficients C.

Then a set of non-matte excursion colour values H is defined for our input set of colour images, via H = R − R_{matte} where R is the (*N*×3×*n*) set of input images. We follow [6] in carrying out RBF interpolation for interpolant light directions. But here we use the much faster luminance-mode approach Method:MODE for generating matte images and also for recovering the surface chromaticity, surface normal and albedo.

^{′}: an estimate is given by $\widehat{\eta}\phantom{\rule{2.77626pt}{0ex}}=\phantom{\rule{2.77626pt}{0ex}}\text{RBF}\left({\mathit{a}}^{\prime}\right)$. Thus, one arrives at an overall interpolant

Since in general we do not possess ground-truth data for acquired image sets, we can characterize the accuracy of appearance-interpolation methods by a leave-one-out analysis. In this approach, we carry out the entire image modelling task but omit, in turn, each of the input set images, thus yielding a modelling dimensionality decreased by 1. Since we know the left-out image’s appearance, we can generate an error characteristic by comparing the interpolated image with the actual one.

We will summarize how to use RBF interpolation and appearance reconstruction in Sections 6.1 and 6.2, respectively. Then in Section 6.3, we present a method to optimize the parameters of the radial Gaussian function, which serves as the third contribution in this work.

### 6.1 RBF

A brief recapitulation of the RBF calculation is in order, so as to explain the mechanism of developing a leave-one-out error measurement below.

As in [6], we first generate a matte interpolation structure from in-sample input images and then use RBF to model the excursion H, for the part of the input image which cannot be explained by a matte model. So first we model the luminance L, using either PTM or HSH. E.g. if we decide to use a 16D polynomial *p*(A), then luminance for in-sample images is modelled by L_{matte} = C (p(A))^{
†
}, where C is the set of polynomial coefficients. If there are *N* pixels and *n* lights, then L_{matte} is *N*×*n* and C is *N*×16, and the polynomial term above is 16×*n*.

*N*×3 set of chromaticities as in Equation 6 from which we can generate a matte colour image model for in-sample images R

_{matte}, for each if the

*i*=1..

*n*lighting directions, via

The dimensionality of R_{matte} is *N*×3×*n*. The set of excursions for all the input images H has this same dimensionality, and H=R−R_{matte}. Because the RBF modelling adopted in [6] includes a so-called polynomial term (actually, linear here), we have to extend H with a set of *N*×3×4 zeros. Call this extended excursion H^{′}.

For interpolation, we need a set of RBF coefficients **Ψ**^{′}, with dimensionality *N*×3×(*n*+4). We adopt Gaussian RBF basis functions *ϕ*(∥a−a^{
i
}∥),*i*=1..*n* (although of course other functions might be tried, such as multiquadric or inverse-multiquadric). We call the set *ϕ*(∥a^{
i
}−a^{
j
}∥) matrix **Φ**. Then **Φ** is extended into an (*n*+4)×(*n*+4) matrix **Φ**^{′} as in [6].

**Ψ**

^{′}over all the input lights as follows:

where the ^{
†
} means the Moore-Penrose pseudoinverse, guarding against reduced rank.

with Tikhonov parameter *τ*. Below, we mean to optimize this parameter using a clever mathematical theorem borrowed for this work.

### 6.2 Appearance reconstruction

Given a novel lighting direction a, appearance reconstruction from PTM coefficients C and RBF coefficients **Ψ**^{′} is quite straightforward: we generate a matte image by multiplying PTM coefficient matrix C by its corresponding combination of polynomial p(a) and then use recovered chromaticity χ to form a colour matte image. Then we form a new Gaussian function *ϕ* from new lighting direction a and simply multiply *ϕ* times the prestored RBF excursion coefficient set **Ψ**^{′} to generate a single-image excursion value *η*. The Gaussian radial basis function has the explicit form *ϕ*(a_{
i
},a_{
j
},*σ*)= exp(−*r*^{2}/*σ*^{2}), with radius *r* for light-direction vectors a_{
i
} and a_{
j
} given by *r*=∥a_{
i
}−a_{
j
}∥.

### 6.3 Optimization of dispersion σ and of Tikhonov parameter τ

In this subsection, we describe our third contribution, i.e. finding the best values for the Gaussian dispersion *σ* and the Tikhonov coefficient *τ* so as to optimize the reconstructed appearance. Since we have no ground truth for real input image sets, we test the accuracy of appearance modelling by simply leaving out one of the *n* input images at a time and attempting to reconstruct the left-out image.

To this end, here we borrow the work in [49] in determining a best value of the Gaussian dispersion parameter *σ* to minimize the leave-one-out error. However, here we mean to apply the method given in [49] to a whole image at once and include colour, extend RBF modelling to include the additional polynomial term and, finally and importantly, extend [49] to include Tihkonov regularization and its optimization.

The work [49] defines the optimum *σ* as that yielding the smallest error in reconstructing a leave-one-out image, using only the information from the other images. E.g. if the input set consists of 50 images, then we follow through matte and then RBF modelling using only 49 images and attempt to reconstruct the 50th image, and then repeat for each of the 50 light directions.

Modelling on the theorem given in [49] in Appendix 2, we generalize the theorem, which is aimed at optimizing RBF over the dispersion parameter *σ*, to also optimize over Tikhonov parameter *τ*. The resulting calculation from this theorem is so fast that it is simple to run any unconstrained non-linear optimizer such as the subspace trust-region method [50].

*k*th leave-one-out image, is simply as follows:

*error image*E is simply formed from the RBF coefficients

**Ψ**

^{′}, and a vector v generated as the solution to the following simple equation in terms of the (

*n*+4)×(

*n*+4) identity matrix I:

*σ*and

*τ*. Unsurprisingly, we see that RBF interpolation does best in the center of the cluster of lighting directions and worse when there is less supporting information, near the boundary of the cluster of light directions. We take as the optimum dispersion

*σ*and Tihkonov parameter value

*τ*as those which deliver the highest leave-one-out median PSNR over the set overall. Table 3 shows PSNR statistics for this leave-out-out RBF test. In comparison, we show in Figure 5b and also in the second line of Table 3 the results of a leave-one-out test using PTM matte modelling alone for dimensions 16 and 9 for luminance and chrominance, with no RBF stage. We notice that in a challenging leave-one-out test for interpolation, PTM does reasonably well. To put these plots in perspective, in Figure 5c, we also show the results for PTM + RBF in a leave-all-in setting: of course, the PSNR for PTM + RBF for leave-all-in is by far the best accuracy. In Figure 5d we show the in-sample correct image closest to the mean value of PSNR values for all leave-one-out RBF modelling, and in Figure 5e,f, we show the interpolants from using PTM + RBF and from using just PTM, respectively. Clearly, RBF provides a substantial boost in visual appearance, although PTM itself (with no RBF stage), with the higher dimensions we have specified, does produce a reasonable image. Nevertheless, qualitatively, using RBF does much better in that, without RBF, specularities are not well modelled and the shadows are wrong.

**PSNR statistics for leave-one-out test, using PTM + RBF, and using only PTM**

Mean | Median | Mean bottom | Mean top | |
---|---|---|---|---|

quartile | quartile | |||

PTM + RBF | 30.18 | 31.24 | 22.77 | 35.68 |

PTM | 29.15 | 29.54 | 22.23 | 34.16 |

## 7 Conclusions

In this paper, we have set out tests and conclusions that improve PTM modelling for appearance interpolation and surface property recovery. We found that increasing PTM dimensionality has a substantial effect on accuracy, more for the luminance channel than for colour. We found that a dimension of 16 for luminance and 9 for chromaticity, modelling luminance and chromaticity separately, delivered good performance. We found that for determining outliers, we could have almost as good accuracy using a much less burdensome robust 1D ‘location finder’ as in a more accurate but slower robust multivariate processing.

A second stage of modelling using RBF interpolation provides a large boost in accuracy of appearance modelling. Here we showed that Tikhonov regularization in calculating RBF coefficients was important, since we are inverting large matrices; and moreover we incorporated optimizing the Tikhonov parameter into an optimization theorem that had been initially aimed at only generating a best choice of Gaussian dispersion parameter for radial basis function networks.

Future work will include developing a real-time viewer including the new insights gained here.

## Appendix 1: hemispherical harmonics

*θ*∈[0,

*π*] is the altitude angle, and

*ϕ*∈[0,2

*π*] the azimuth angle. ${P}_{l}^{m}$ are the associated Legendre polynomials, orthogonal polynomial basis functions over [−1,+1], and ${K}_{l}^{m}$ are the normalization factors for these.

Now the hemispherical functions are defined only over the upper hemisphere, *θ*∈[0,*π*/2],*ϕ*∈[0,2*π*].

*l*=0..2, and the first 16 functions are stated explicitly in Equation 22.

*u*,

*v*,

*w*) with spherical polar coordinates:

*u*= sin

*θ*cos

*ϕ*,

*v*= sin

*θ*sin

*ϕ*,

*w*= cos

*θ*, so e.g. the PTM basis functions in Equation 1 are given by

## Appendix 2: leave-one-out optimization in RBF

It is useful to state explicitly how the optimization theorem in [49] goes over to the situation when Tikhonov regularization comes into play.

Firstly, we utilize three-band colour image data, rather than scalar data, and process whole images at once using vectorized programming in Matlab. However for clarity, below we state matters as they pertain to a single pixel and in one colour band.

*n*lights and

*n*input values at a pixel, e.g. for our exemplar dataset

*n*=50. Then we make (

*n*+4)×(

*n*+4) matrix

**Φ**(

*σ*), where here we are explicitly including dependence on a variable dispersion value

*σ*. For the (

*n*+4) vector of excursion values H (extended by four zeros to include the ‘polynomial’ RBF part), we begin by solving for the (

*n*+4) vector set of RBF coefficients ψ, which is the vector solution for the modelling equation

^{′}via

where *η*^{′} is the scalar value of interpolated excursion (for this pixel and colour channel).

*n*+ 3) because the

*k*th input-image case has been omitted. Suppose we denote this case using superscript (

*k*). That is, we aim for a solution ψ

^{(k)}of

*Lemma*: if vector v has v

_{ k }=0, then

That is, if we know the not-reduced-dimension equation holds, then for the special situation in which v_{
k
}=0, we can simply omit whatever value *b*_{
k
} may take on, for the reduced-dimension problem indicated by (*k*).

where e_{
k
} is the *k* th column of the unit matrix.

Notice that the *k* th component of β is zero.

**Φ**β:

Hence, by our lemma, β is the sought solution for the leave-one-out set of coefficients ψ^{(k)}; however, this statement is approximate and not exact because $\widehat{\mathit{\eta}}$ is only approximately (but very close to being equal to) η.

*σ*and

*τ*, we need only to generate the error estimate

*E*

_{ k }for the

*k*th case,

*k*=1..

*n*left-out lights, and apply some appropriate error measure such as median (

*E*

_{ k }) for choosing the least-error solution:

In practise, we found that utilizing this leave-one-out calculation is very fast and generates smaller interpolation errors when the resulting solution pair {*σ*, *τ*} is used for general interpolation for the dataset being optimized for by this leave-one-out procedure.

## Declarations

## Authors’ Affiliations

## References

- Malzbender T, Gelb D, Wolters H: Polynomial texture maps. In
*Proceedings of Computer Graphics, SIGGRAPH*. Los Angeles, California: ACM; 2001:519-528.Google Scholar - Woodham RJ: Photometric method for determining surface orientation from multiple images.
*Opt. Eng*1980, 19: 139-144.View ArticleGoogle Scholar - Mudge M, Malzbender T, Schroer C, Lum M: New reflection transformation imaging methods for rock art and multiple-viewpoint display. In
*7th International Symposium on Virtual Reality, Archaelogy and Cultural Heritage*. Nicosia, Cyprus: Eurographics,; 2006.Google Scholar - Sunkavalli K, Zickler T, Pfister H: Visibility subspaces: uncalibrated photometric stereo with shadows. In
*11th European Conference on Computer Vision–ECCV 2010*. Heraklion: Springer; 2010:251-264.Google Scholar - Earl G, Martinez K, Malzbender T: Archaeological applications of polynomial texture mapping: analysis, conservation and representation.
*J. Archaeological Sci*2010, 37: 1-11. 10.1016/j.jas.2009.08.005View ArticleGoogle Scholar - Drew M, Hel-Or Y, Malzbender T, Hajari N: Robust estimation of surface properties and interpolation of shadow/specularity components.
*Image Vis. Comput*2012, 30(4-5):317-331. 10.1016/j.imavis.2012.02.012View ArticleGoogle Scholar - Rousseeuw PJ, Leroy AM:
*Robust Regression and Outlier Detection*. New York: Wiley; 1987.MATHView ArticleGoogle Scholar - Zickler T, Enrique S, Ramamoorthi R, Belhumeur P: Reflectance sharing: image-based rendering from a sparse set of images. In
*Eurographics Symposium on Rendering Techniques*. Konstanz, Germany; 2005:253-265.Google Scholar - Zickler T, Ramamoorthi R, Enrique S, Belhumeur P: Reflectance sharing: predicting appearance from a sparse set of images of a known shape.
*IEEE Trans. Patt. Anal. Mach. Intell*2006, 28: 1287-1302.View ArticleGoogle Scholar - Coleman Jr EN, Jain R: Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry.
*Comput. Graph. Image Process*1982, 18: 309-328. 10.1016/0146-664X(82)90001-6View ArticleGoogle Scholar - Solomon F, Ikeuchi K: Extracting the shape and roughness of specular lobe objects using four light photometric stereo.
*IEEE Trans. Patt. Anal. Mach. Intell*1996, 18: 449-454. 10.1109/34.491627View ArticleGoogle Scholar - Barsky S, Petrou M: The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows.
*IEEE Trans. Patt. Anal. Mach. Intell*2003, 25(10):1239-1252. 10.1109/TPAMI.2003.1233898View ArticleGoogle Scholar - Rushmeier H, Taubin G, Guéziec A: Applying shape from lighting variation to bump map capture. In
*Eurographics Rendering Techniques 97*. Vienna: Springer; 1997:35-44.Google Scholar - Yuille A, Snow D: Shape and albedo from multiple images using integrability. In
*Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1997*. San Juan, Puerto Rico; 1997:158-164.View ArticleGoogle Scholar - Willems G, Verbiest F, Moreau W, Hameeuw H, Van Lerberghe K, Van Gool L: Easy and cost-effective cuneiform digitizing. In
*Proceedings of 6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (Short and Project Papers)*. Pisa, Italy; 2005:73-80.Google Scholar - Sun J, Smith M, Smith L, Midha S, Bamber J: Object surface recovery using a multi-light photometric stereo technique for non-Lambertian surfaces subject to shadows and specularities.
*Image Vis. Comput*2007, 25: 1050-1057. 10.1016/j.imavis.2006.04.025View ArticleGoogle Scholar - Lumbreras F, Sappa AD, Julià C: A factorization-based approach to photometric stereo.
*Int. J. Imag. Syst. Tech*2011, 21: 115-119. 10.1002/ima.20273View ArticleGoogle Scholar - Wu L, Ganesh A, Shi B, Matsushita Y, Wang Y, Ma Y: Robust photometric stereo via low-rank matrix completion and recovery. In
*Computer Vision – ACCV 2010*. Edited by: Lecture notes in computer science, no. 6494., Kimmel R, Klette R, Sugimoto A, Lecture notes in computer science, no. 6494. . Berlin Heidelberg: Springer; 2011:703-717.Google Scholar - Tang KL, Tang CK, Wong TT: Dense photometric stereo using tensorial belief propagation. In
*IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005*. San Diego, California; 2005:132-139.Google Scholar - Chandraker M, Agarwal S, Kriegman D: ShadowCuts: photometric stereo with shadows. In
*IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2007*. Minneapolis, Minnesota; 2007:1-8.Google Scholar - Verbiest F, Van Gool L: Photometric stereo with coherent outlier handling and confidence estimation. In
*IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2008*. Anchorage, Alaska; 2008:1-8.Google Scholar - Yang Q, Ahuja N: Surface reflectance and normal estimation from photometric stereo.
*Comput. Vis. Image Underst*2012, 116(7):793-802. 10.1016/j.cviu.2012.03.001View ArticleGoogle Scholar - Kherada S, Pandey P, Namboodiri A: Improving realism of 3D texture using component based modeling. In
*2012 IEEE Workshop on Applications of Computer Vision (WACV)*. Breckenridge, Colorado; 2012:41-47.View ArticleGoogle Scholar - Westin SH, Arvo JR, Torrance KE: Predicting reflectance functions from complex surfaces. In
*Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ‘92*. New York; 1992:255-264.View ArticleGoogle Scholar - Wong TT, Heng PA, Or SH, Ng WY: Image-based rendering with controllable illumination. In
*Proceedings of the Eurographics Workshop on Rendering Techniques 1997*. Vienna: Springer; 1997:13-22.Google Scholar - Nimeroff JS, Simoncelli E, Dorsey J: Efficient re-rendering of naturally illuminated environments. In
*Photorealistic Rendering Techniques, Focus on Computer Graphics*. Berlin Heidelberg: Springer; 1995:373-388.View ArticleGoogle Scholar - Kautz J, Sloan PP, Snyder J: Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics. In
*Proceedings of the 13th Eurographics Workshop on Rendering Techniques*. Pisa, Italy; 2002:291-296.Google Scholar - Ramamoorthi R, Hanrahan P: An efficient representation for irradiance environment maps. In
*Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques*. Los Angeles, California; 2001:497-500.Google Scholar - Sloan PP, Kautz J, Snyder J: Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In
*ACM Transactions on Graphics (TOG)*. ACM, New York; 2002:527-536.Google Scholar - Sloan PP, Sloan J, Hart J, Snyder J: Clustered principal components for precomputed radiance transfer.
*ACM Trans. Graph*2003, 22(3):382-391. 10.1145/882262.882281View ArticleGoogle Scholar - Basri R, Jacobs DW: Lambertian reflectance and linear subspaces.
*IEEE Trans. Patt. Anal. Mach. Intell*2003, 25: 218-233. 10.1109/TPAMI.2003.1177153View ArticleGoogle Scholar - Basri R, Jacobs D, Kemelmacher I: Photometric stereo with general, unknown lighting.
*Int. J. Comput. Vis*2007, 72: 239-257. 10.1007/s11263-006-8815-7View ArticleGoogle Scholar - Zhang L, Samaras D: Pose invariant face recognition under arbitrary unknown lighting using spherical harmonics. In
*Biometric Authentication. Lecture notes in computer science, vol 3087*. Heidelberg: Springer; 2004:10-23.Google Scholar - Gautron P, Křivánek J, Pattanaik SN, Bouatouch K: A novel hemispherical basis for accurate and efficient rendering. In
*Eurographics Symposium on Rendering Techniques 2004*. Eurographics Association, Norköping, Sweden; 2004:321-330.Google Scholar - Elhabian S, Rara H, Farag A:
*2011 Canadian Conference on Computer and Robot Vision (CRV).*St. Johns, Newfoundland; 2011:293-300.View ArticleGoogle Scholar - Huang H, Zhang L, Samaras D, Shen L, Zhang R, Makedon F, Pearlman J: Hemispherical harmonic surface description and applications to medical image analysis. In
*Third International Symposium on 3D Data Processing, Visualization, and Transmission*. Chapel Hill, North Carolina; 2006:381-388.View ArticleGoogle Scholar - Elhabian S, Rara H, Farag A: Towards accurate and efficient representation of image irradiance of convex-Lambertian objects under unknown near lighting. In
*2011 IEEE International Conference on Computer Vision (ICCV)*. Barcelona, Spain; 2011:1732-1737.View ArticleGoogle Scholar - Earl G, Martinez K, Malzbender T: Archaeological applications of polynomial texture mapping: analysis, conservation and representation.
*J. Archaeol. Sci*2010, 37(8):2040-2050. 10.1016/j.jas.2010.03.009View ArticleGoogle Scholar - Earl G, Beale G, Martinez K, Pagi H: Polynomial texture mapping and related imaging technologies for the recording, analysis and presentation of archaeological materials. In ISPRS Commission V Midterm Symposium. Newcastle, 21–24 June 2010); 218-223.Google Scholar
- Earl G, Basford PJ, Bischoff AS, Bowman A, Crowther C, Dahl J, Hodgson M, Martinez K, Isaksen L, Pagi H, Piquette KE, Kotoula E: Reflectance transformation imaging systems for ancient documentary artefacts. In
*EVA London 2011: Electronic Visualisation and the Arts*. (London; 2011.Google Scholar - Bridgman R, Earl G: Experiencing lustre: polynomial texture mapping of medieval pottery at the Fitzwilliam Museum. In
*Proceedings of the 7th International Congress of the Archaeology of the Ancient Near East (7th ICAANE)*. Edited by: Ancient & Modern Issues in Cultural Heritage. Colour & Light in Architecture, Art & Material Culture. Islamic Archeology., Matthews R, Curtis J, Symour M, Fletcher A, Gascoigne A, Glatz C, Simpson SJ, Taylor H, Tubb J, Chapman R, Ancient & Modern Issues in Cultural Heritage. Colour & Light in Architecture, Art & Material Culture. Islamic Archeology. . Harrasowitz, London; 2012:497-512.Google Scholar - Duffy S: Polynomial texture mapping at Roughting Linn rock art site. In
*Proceedings of the ISPRS Commission V Mid-Term Symposium: Close Range Image Measurement Techniques*. Newcastle, 21–24 June 2010); 213-217.Google Scholar - Padfield J, Saunders D, Malzbender T: Polynomial texture mapping: a new tool for examining the surface of paintings.
*ICOM Comm. Conserv*2005, 1: 504-510.Google Scholar - Schechner Y, Nayar S, Belhumeur P: Multiplexing for optimal lighting.
*IEEE Trans. Patt. Anal. Mach. Intell*2007, 29(8):1339-1354.View ArticleGoogle Scholar - Wenger A, Gardner A, Tchou C, Unger J, Hawkins T, Debevec P: Performance relighting and reflectance transformation with time-multiplexed illumination.
*ACM Trans. Graph*2005, 24(3):756-764. 10.1145/1073204.1073258View ArticleGoogle Scholar - Zhang M, Drew MS: Robust luminance and chromaticity for matte regression in polynomial texture mapping. In
*Workshops and Demonstrations in Computer Vision–ECCV 2012*. Firenze, Italy: Springer; 2012:360-369.View ArticleGoogle Scholar - Mudge M, Davis J, Scopigno R, Doerr M, Chalmers A, Wang O, Gunawardane P, Malzbender T: Image-based empirical information acquisition, scientific reliability, and long-term digital preservation for the natural sciences and cultural heritage. In
*Eurographics Tutorials*. Crete, 14–18 April 2008;Google Scholar - Tikhonov A, Arsenin V:
*Solutions of Ill-Posed Problems*. New York: Wiley; 1977.MATHGoogle Scholar - Rippa S: An algorithm for selecting a good value for the parameter c in radial basis function interpolation.
*Adv. Comput. Math*1999, 11(2–3):193-210.MATHMathSciNetView ArticleGoogle Scholar - Coleman T, Li Y: An interior, trust region approach for nonlinear minimization subject to bounds.
*SIAM J. Optimiz*1996, 6: 418-445. 10.1137/0806023MATHMathSciNetView ArticleGoogle Scholar - Abramowitz M, Stegun I:
*Handbook of Mathematical Functions: with Formulas, Graphs, and Mathematical Tables*. Dover, New York; 1965.Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License(http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.