Hsu

Back to Psych 221 Projects 2013

Background

-CFA Interpolation and why necessary -Effect of tampering on CFA interpolation

Methods

The expectation-maximization algorithm calculated an estimation of the linear model used to interpolate the Bayer array and generated the per-pixel probability that each sample pixel belonged to the calculated linear interpolation filter (need a reference). The probability map was then analyzed for periodic frequencies to determine whether of not the image had been tampered.

Expectation-Maximization Algorithm

Expectation

The expectation step of the algorithm estimates the per-pixel probability that the pixel belongs to the estimated linear model, α. Each color channel is described as

$f(x,y)=\sum _{u,v=-N}^N{\alpha }_{u,v}f(x+u,y+v)+n(x,y)$

where $n(x,y)=f(x,y)-\sum _{u,v=-N}^N{\alpha }_{u,v}f(x+u,y+v)$ is the residual error between the actual image and the estimated image. The residual error is approximated using a Gaussian function with zero mean and $\alpha$ standard deviation. The probability that each pixel is taken from the estimated linear model is calculated using the probability distribution function of the residual errors:

$P(x,y)=\frac{1}{\sigma \sqrt{2\pi }}exp[-\frac{1}{2{\sigma }^2}{(f(x,y)-\sum _{u,v=-N}^N{\alpha }_{u,v}f(x+u,y+v))}^2]$

Using this probability, the per-pixel probability that the image is estimated by the proposed $\alpha$ is calculated using Bayes' rule. In these calculations, only the proposed linear model and an unspecified non-linear model were considered as possibilities. The non-linear model M_{2} was estimated to be one over 255;

$\mathrm{Pr}\{𝑓\mathit{(}𝑥,𝑦\mathit{)}\in M_1\mid 𝑓\mathit{(}𝑥,𝑦\mathit{)}\}=\frac{\mathrm{Pr}\{𝑓\mathit{(}𝑥,𝑦\mathit{)}\mid 𝑓\mathit{(}𝑥,𝑦\mathit{)}\in M_1\}\mathrm{Pr}\{𝑓\mathit{(}𝑥,𝑦\mathit{)}\in M_1\}}{\sum _{i=1}^2\mathrm{Pr}\{𝑓\mathit{(}𝑥,𝑦\mathit{)}\mid 𝑓\mathit{(}𝑥,𝑦\mathit{)}\in M_i\}\mathrm{Pr}\{𝑓\mathit{(}𝑥,𝑦\mathit{)}\in M_i\}}$

The maximization step of the algorithm computes a revised α based on minimization of the residual error.

Tamper Detection

Measure of Similarity

Tamper detection was implemented by calculating the cosine similarity between an ideal probability map and the estimated probability map. The cosine similarity function is given by:

$M(p,s)=\frac{\sum _{w_x,w_y}P\times S}{\sqrt{\sum _{w_x,w_y}(P{)}^2}\times \sqrt{\sum _{w_x,w_y}(S{)}^2}}$

where P} is the Fourier transform of the calculated probability map and S is the Fourier transform of the ideal probability map for each channel. The similarity between the ideal and calculated probability maps determines whether or not the image has been modified; high similarity indicates that the given CFA interpolation of the image can be approximated using a linear array since the frequency content of the probability map will be close to ideal. In contrast, tampering changes the frequency content of the probability map and the frequencies between the ideal and real case will result in a lower similarity measure.

Show FFTs of ideal maps

Windowing

Given that the tampered areas in the training images were small areas of the main image, a sliding window was used to calculate the measure of similarity for segmented blocks of the image. Each window had a 50% overlap with it's neighbors.

Conclusions

- Buggy areas: places with large areas of pixels with the same pixel so that the probability map shows the same value for a large swath - Automation: normalization between different images - Use information about the CFA to determine tampering (i.e. threshold adjustment done based on CFA interpolation technique - Classification using frequency information between channels instead of processing them differently Could give better estimate in the case of CFA interpolators across multiple channels or get better estimate of frequency across different channels

References - Resources and related work

References

Software

Appendix I - Code and Data

Code

File:CodeFile.zip

Data

zip file with my data