Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add wisp finder monitor #1666

Merged
merged 17 commits into from
Feb 5, 2025
Merged

Conversation

bhilbert4
Copy link
Collaborator

Add an automated wisp finder monitor to JWQL. This tool finds new data, creates a scaled image of it, and uses a neural network to predict whether there is a wisp in the image. If a wisp is found, it sets the wisp flag in the Anomalies instance for the appropriate RootFileInfo instance.

This model is trained and currently works only for the wisps on NIRCam's B4 detector.

@bhilbert4 bhilbert4 self-assigned this Jan 13, 2025
@pep8speaks
Copy link

pep8speaks commented Jan 13, 2025

Hello @bhilbert4, Thank you for updating !

Cheers ! There are no PEP8 issues in this Pull Request. 🍻

Comment last updated at 2025-01-21 20:41:21 UTC

@bhilbert4 bhilbert4 changed the title [WIP]: Add wisp finder monitor Add wisp finder monitor Jan 21, 2025
@bhilbert4
Copy link
Collaborator Author

Here's a good test case for both test and ops servers:
python wisp_finder.py -s 59964 -e 59965
This should find a handful of PID 1837 obs 25 files, where some have wisps and some don't, and none are currently flagged in the anomaly database.

Copy link
Collaborator

@mfixstsci mfixstsci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bhilbert4 this is awesome! I am approving, with a few tasks:

  • Add the django model
  • Updates to the default config file.

@bhilbert4
Copy link
Collaborator Author

Django model and migration file are both present in the PR now.

@bhilbert4
Copy link
Collaborator Author

I've updated the config files on all three servers to include the new entry.

@mfixstsci mfixstsci merged commit 4d4711c into spacetelescope:develop Feb 5, 2025
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants