Addressing Image Authenticity When Cameras Use Generative AI

May combine two claims.

Blind recovery works well on DIV2K for natural image super-resolution but cannot achieve good results on MARCONet and LOL because of a one-to-many mapping in the solution space.

“Blind recovery works well on DIV2K [10] for the natural image SR task but cannot achieve good results on MARCONet [37] and LOL [56] because there is a one-to-many mapping in the solution space that the model cannot resolve.”

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [37]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [56]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The (x, y, R, G, B) input variant performs better than the (x, y) input variant for MLP-based methods.

“The (x, y, R, G, B) input variant, which performs better than (x, y) input, is shown for [40,41,49].”

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [41]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [49]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

MLP-based competitors SIREN, NeRF, and hashgrid perform well when trained from scratch per image, but the training time is impractical for capture-time optimization.

“It can be observed that the MLP-based competitors SIREN [49], NeRF [40], and hashgrid [41] perform well when trained from scratch per image (the markers on the top-right of the plot) but the training time is impractical since this optimization has to be done at capture time.”

• cites [49]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [41]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The encoder and MLP decoder require only 180 KB of storage and can be saved as metadata within standard image formats such as JPEG and HEIC.

“Moreover, the encoder and MLP decoder require only 180 KB of storage and can be readily saved as metadata within standard image formats such as JPEG and HEIC.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In Figure S1, hallucinations alter the appearance of crops in an aerial scene.

“In the second image of an aerial scene, the appearance of the crops is altered due to hallucinations.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Figure 7 provides two selected text super-resolution examples where characters are altered.

“Fig. 7 showcases two hand-picked examples for text SR that cause characters to change.”

May combine two claims.

SIREN, NeRF, and hashgrid perform well when optimized per image until convergence, but their training times are impractical.

“While SIREN[49], NeRF[40] and hashgrid[41] perform well when optimized per image until convergence, training times are impractical.”

• cites [49]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [41]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Weighted error sampling is computationally more expensive and increases finetuning time compared to random sampling.

“Moreover, compared to random sampling, weighted error sampling is computationally more expensive and increases the time needed for finetuning.”

May combine two claims.

Our method enables recovery of the authentic face and a readable QR code.

“Our method allows the user to recover the authentic face and a readable QR code.”

May combine two claims.

Our method restores the flipped 'i' character without adding artifacts in uniform regions.

“Our method recovers the flipped character 'i' while not introducing any artifacts in the homogeneous regions.”

May combine two claims.

Our metadata-assisted approach improves storage footprint, execution time, and accuracy compared to alternative methods across super-resolution and low-light enhancement tasks.

“we also demonstrate through extensive experiments-on tasks such as super-resolution and low-light image enhancement-that our metadata-assisted approach offers improvements over alternative methods in terms of storage footprint, execution time, and accuracy.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Increasing the MLP hidden layers from two to three increases metadata size but does not notably change performance.

“Increasing the number of layers to three from our choice of two increases the metadata size, but did not yield any notable difference in performance.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In Figure 2, the gaze and the shape of the mouth and teeth are changed.

“Notice the change in gaze and the shape of the mouth and teeth.”

May combine two claims.

Our method achieves PSNR values of 32.96 dB on DIV2K, 31.26 dB on MARCO-Net, and 36.34 dB on LOL.

“Ours | - | 32.96 | 31.26 | 36.34”

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [37]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [56]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Our metadata overhead does not depend on image resolution, whereas the memory footprint of a residual image grows with image size.

“Also note that our metadata overhead is independent of image resolution, while the memory footprint of the residual image increases with image size.”

May combine two claims.

Models using just (x, y) do poorly during pretraining and find it difficult to achieve significant improvements within limited finetuning time.

“As expected, the models using just (x, y) do poorly during pretraining, and thereby, find it difficult to achieve significant improvements within the limited finetuning time.”

May combine two claims.

In the license plate example, the characters 'GQB' were altered to '608', and the Chinese phrase 争渡,争渡 was altered to 争澳, 争渡.

“In the license plate image, 'GQB' changed to '608', while the Chinese characters 争渡，争渡 became 争澳， 争渡.”

May combine two claims.

Sampling less frequently can speed up finetuning but decreases performance.

“Sampling less frequently could speed up the finetuning time, however, as shown, it comes with decreased performance.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The best performing methods for text super-resolution use generative loss functions.

“The best performing methods for text SR also use such generative loss functions [37,61].”

• cites [37]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [61]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The method operates independently of the AI module responsible for hallucinations, assuming no prior knowledge of this model and requiring no post-capture access to the camera ISP.

“Our solution operates independently of the AI module responsible for hallucinations, assuming no prior knowledge of this model and requiring no post-capture access to the camera ISP.”

• AssumptionThe authors state this as an assumption: No prior knowledge of the AI module responsible for hallucinations is available or needed.

Probably not a substantial claim: may not pass S3 (load-bearing).

Perceptual and generative losses used for image enhancement often introduce fake content.

“As noted in [47], perceptual and generative losses used for image enhancement often introduce fake content.”

• cites [47]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Capture-time metadata has been shown to significantly improve various image recovery tasks.

“Capturetime metadata has been shown to significantly improve various image recovery tasks.”

• cites [36]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [42]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [43]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [54]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

It is becoming increasingly feasible to run generative AI super-resolution solutions in real time on smartphone hardware.

“At the same time, it is becoming increasingly feasible to run such GenAI SR solutions in real time on smartphone hardware [27].”

• cites [27]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The only prior work addressing authenticity of camera-captured images is Punnappurath et al., which proposed a binary authentication mask computed at capture time and stored as metadata.

“To our knowledge, the only work to address the authenticity of camera-captured images is that of Punnappurath et al. [47], which proposed a binary authentication mask be computed at capture time and stored in the camera image as metadata.”

• cites [47]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Coordinate-based implicit neural representations such as SIREN and NeRF reconstruct images using an MLP that takes (x, y) coordinates as input.

“Coordinate-based implicit neural representations, such as SIREN [49] and NeRF [40], reconstruct images using an MLP that takes (x, y) coordinates as input.”

• cites [49]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Coordinate-based implicit neural representations are typically optimized per image and converge slowly.

“While these methods achieve excellent performance, they are typically optimized per image and converge slowly.”

• cites [49]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [40]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Models using perceptual and generative losses dominated recent challenges on low-light image enhancement and nighttime photography.

“Similarly, models using perceptual and generative losses dominated the recent challenges on low-light image enhancement and nighttime photography [16,48].”

• cites [16]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [48]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

MLPs are well-established as compact image representations, particularly in image compression.

“MLPs are well-established as compact image representations, particularly in image compression [50].”

• cites [50]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Hallucinated content can appear in images directly output by cameras because GenAI modules are increasingly integrated into camera hardware ISPs, especially in smartphones.

“Hallucinated content can appear even in images directly output by cameras due to the increasing integration of GenAI modules into modern camera hardware ISPs, particularly in smartphones.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Saving only the MLP decoder weights (53 KB) requires knowing the encoder's modality and obtaining its weights separately, which may be less practical.

“However, this necessitates that the encoder's modality is known and its specific weights are available at recovery time through some other mechanism, such as retrieving it from a secure online repository.”

• Also stated in: § Additional information · hedged

  “This may be less preferred in practice.”

Classified as probably not a substantial claim.

A camera's GenAI super-resolved image could be used as evidence against a car owner if the license plate is hallucinated.

“For example, a GenAI super-resolved image directly outputted by a camera could potentially be used as evidence against the car's owner of the hallucinated license plate.”

Classified as probably not a substantial claim.

All competing methods were evaluated on the same hardware.

“All competing methods were also evaluated on the same hardware.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Most hallucinations do not change how the scene is interpreted.

“As previously mentioned, most hallucinations do not affect the interpretation of the scene (e.g., the first image in Fig. 6).”

May combine two claims.

The user can extract the stored metadata post-capture and recover the authentic image.

“As shown in Fig. 3(B), the user can extract this metadata post-capture and recover the authentic image x = y -Θ([x, y, Φ(y)]).”

• AssumptionThe authors state this as an assumption: At capture time, the intermediate image on the ISP, which is the input to the hallucinatory AI model and the image to be recovered post-capture, is accessible.

Probably not a substantial claim: may not pass S3 (load-bearing).

Every ablation in Table 2 was finetuned for the same time budget as our method.

“Note that all ablations reported in Table 2 are after finetuning for the same time budget as our method.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The experiments were limited to a desktop GPU rather than on-device optimization, despite on-device optimization being required in practice.

“While on-device optimization is required in practice, we limit the experiments to a desktop GPU due to the challenges of re-implementing all comparison methods on device, and for the sake of fair comparison.”

Probably not a substantial claim: may not pass S3 (load-bearing).

For fair comparison, MLP-based comparison models were given three hidden layers and 128 neurons per layer, roughly matching the combined size of the proposed encoder and MLP.

“For fair comparison, we use models with three hidden layers and 128 neurons per layer such that the models have a size of 204 KB that roughly matches the combined size of our encoder and MLP.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Other methods were finetuned for the same amount of time as the proposed method.

“Other methods are also finetuned for the same amount of time as our method.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Under the selected settings, the hashgrid encoder has about 32 K parameters (128 KB), and the overall hashgrid model size is 184 KB.

“Under these settings, the encoder of the hashgrid [41] method has roughly 32 K parameters (128 KB).”

• Also stated in: § Additional information · plain

  “The MLP model is chosen to be similar to our method with two hidden layers and 64 neurons per layer, making the overall hashgrid model size 184 KB.”

• cites [41]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable).

When hallucinations change the meaning of an image, the consequences can be severe.

“However, when hallucinations alter the semantics, the consequences can be serious.”

May combine two claims.

Because the method uses only a reconstruction loss and no perceptual or generative losses, the resultant image does not risk introducing fake content.

“Since we use only a reconstruction loss and no perceptual or generative losses, our resultant image x does not risk introducing fake content.”