Skip to content

GCRCatalogs v1.1.0
Compare
Choose a tag to compare
@yymao yymao released this 30 Dec 15:36
· 282 commits to master since this release
v1.1.0
05c1f3c
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

The GCRCatalogs v1.1.0 release introduces the Run2.2i DR2 WFD and SkySim5000 catalogs. In addition, the Run2.2i DR6 catalogs have been renamed (postfix _wfd was dropped) for clarity. There is also schema change in the object catalogs. GCRCatalogs v1.1.0 now requires GCR v0.9.2.

See below for a complete list of changes. The "DC2 Runs Data Products and Add-ons" section of the README has also been updated to reflect the current list of recommended catalogs.

A code of conduct has been added to this repository.

New Catalogs

  • dc2_object_run2.2i_dr2_wfd: static object catalog for Run2.2i DR2 (up to Year 1; WFD visits only)
  • dc2_object_run2.2i_dr2_wfd_with_addons: same as dc2_object_run2.2i_dr2 but with all available add-ons (currently including only truth-match; metacal/photo-z not yet available)
  • skysim5000_v1.1.1: 5000 sq deg of extragalactic catalogs (also available are skysim5000_v1.1.1_image and skysim5000_v1.1.1_small for subsets of sky; we are also working on a parquet version of SkySim5000 for faster access)

Changes to DR6 Catalog Names

Please use the following catalogs for Run 2.2i DR6:

  • dc2_object_run2.2i_dr6: static object catalog for Run2.2i DR6 (up to Year 5; WFD+DDF visits; a small sky region was excluded)
  • dc2_object_run2.2i_dr6_with_addons: same as dc2_object_run2.2i_dr6 but with metacal and truth-match add-ons. Photo-z not yet available.

All DR6 catalogs whose names contain dr6_wfd, dr6a, dr6b, or dr6c have been deprecated.

Schema change

In DC2 object catalogs, the second moment columns have been renamed so that their unit is clear. In particular, Ixx, Ixy, Iyy, IxxPSF, IxyPSF, and IxyPSF have been renamed to Ixx_pixel, Ixy_pixel, Iyy_pixel, IxxPSF_pixel, IxyPSF_pixel, and IxyPSF_pixel, respectively.

Similarly, Ixx_<band>, Ixy_<band>, Iyy_<band>, IxxPSF_<band>, IxyPSF_<band>, and IxyPSF_<band> have been renamed to Ixx_pixel_<band>, Ixy_pixel_<band>, Iyy_pixel_<band>, IxxPSF_pixel_<band>, IxyPSF_pixel_<band>, and IxyPSF_pixel_<band>, respectively.

A similar schema change will be applied to the DC2 source catalogs in the next release.

Improvements for Catalog Users

  • The cosmoDC2 catalog reader now works with h5py v3+ (the version installed in desc-python-bleed)
  • Performance and memory efficiency for accessing parquet-based catalogs have been improved when the users use arrow >=0.16
  • New function get_available_catalog_names(...) was introduced as a shorthand for get_available_catalogs(names_only=True, ...)
  • Users can now set default root dir in their user configs (Note: most DESC members would not need to do this)
  • Upstream improvements from GCR v0.9.2 allow get_quantity_into() to work better with composite catalogs and quantity aliases

Improvements for Catalog Developers

  • Composite catalogs now can be configured with more specific options thanks to GCR v0.9.0. See the GCR v0.9.0 release note for details.

Many thanks to the whole DC2 team for preparing the data products, and to @JoanneBogart @heather999 @evevkovacs for help in preparing this release. This version should be available in conda-forge soon and in DESC environments next week.

Assets 2
Loading