Skip to content

Save multi resolution image (#311)#320

Open
Gtortellier wants to merge 1 commit intopyronear:developfrom
Gtortellier:develop
Open

Save multi resolution image (#311)#320
Gtortellier wants to merge 1 commit intopyronear:developfrom
Gtortellier:develop

Conversation

@Gtortellier
Copy link

  • create an image with high resolution on bboxes part and low resolution elsewhere

  • save the image with the avif format and lower overall quality to save image weight

* create an image with high resolution on bboxes part and low resolution
  elsewhere

* save the image with the avif format and lower overall quality to save image weight
@MateoLostanlen
Copy link
Member

Hey! Thanks a lot for the PR, really interesting ideas here

First, sorry for the delay on the review, I’ll try to be more reactive going forward.

On the AVIF part, I’m a bit concerned about compatibility. Firefighters are not always using up to date browsers or environments, so we need to be extra careful here. From what I’ve seen, support is improving but still not fully reliable depending on the browser and especially the tooling we use. Do you know if you checked how well AVIF is handled on the frontend side, in our current stack? (display, zoom, annotations, etc.)

On the variable resolution idea (high res on bbox, lower elsewhere), I think it’s a very interesting optimization, but I’m a bit worried about using only this format for the dataset. It could introduce biases during training, since the model might learn artifacts from the resolution differences instead of actual smoke patterns. So I’d prefer not to replace the current images entirely with this approach.

Maybe a good compromise could be:

keep standard JPEG images for training and platform usage

optionally use AVIF for long term storage or archival to reduce size

Also, this is just a discussion, I still think it’s worth testing this in practice. I’d like to set this up on a test tower to capture:

  • classic JPEG
  • high resolution JPEG crops on detections
  • your proposed image

Curious to hear your thoughts, especially on the AVIF compatibility side

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

3 participants