Skip to content

Commit

Permalink
feat: add STAC created and updated dates TDE-1299 (#326)
Browse files Browse the repository at this point in the history 
### Motivation

All the existing STAC did not have a [`created` or `updated`
datetimes](https://github.com/radiantearth/stac-spec/blob/master/commons/common-metadata.md#date-and-time).
This information is useful for any data consumer to easily know when the
latest version of the data has been published.

### Modifications

A `created` and `updated` date have been set for the Collections, Items
`properties` and visual Assets.
The Item STAC file checksums have also been added to all the
Collections.
This has been done using [an
algorithm](linz/topo-imagery#1177) that has been
run on all the published dataset in `s3://nz-elevation/`.
_This PR is one step of this change. There is also a file copy for the
STAC Items that needs to be done separately._

### Verification

Generated a report of the new STAC files using [a date checker
script](https://github.com/blacha/stac-spider/blob/main/src/operations/date.check.ts).
  • Loading branch information
@paulfouquet
paulfouquet authored Nov 28, 2024
1 parent 66ef61f commit ec1c969
Show file tree
Hide file tree
Showing 159 changed files with 94,229 additions and 25,771 deletions.
1,313 changes: 1,125 additions & 188 deletions stac/auckland/auckland-north_2016-2018/dem_1m/2193/collection.json
View file

Large diffs are not rendered by default.

1,348 changes: 1,155 additions & 193 deletions stac/auckland/auckland-north_2016-2018/dsm_1m/2193/collection.json
View file

Large diffs are not rendered by default.

585 changes: 501 additions & 84 deletions stac/auckland/auckland-south_2016-2017/dem_1m/2193/collection.json
View file

Large diffs are not rendered by default.

599 changes: 513 additions & 86 deletions stac/auckland/auckland-south_2016-2017/dsm_1m/2193/collection.json
View file

Large diffs are not rendered by default.

606 changes: 519 additions & 87 deletions stac/bay-of-plenty/bay-of-plenty_2018-2019/dem_1m/2193/collection.json
View file

Large diffs are not rendered by default.

606 changes: 519 additions & 87 deletions stac/bay-of-plenty/bay-of-plenty_2018-2019/dsm_1m/2193/collection.json
View file

Large diffs are not rendered by default.

3,182 changes: 2,727 additions & 455 deletions stac/bay-of-plenty/bay-of-plenty_2019-2022/dem_1m/2193/collection.json
View file

Large diffs are not rendered by default.

3,182 changes: 2,727 additions & 455 deletions stac/bay-of-plenty/bay-of-plenty_2019-2022/dsm_1m/2193/collection.json
View file

Large diffs are not rendered by default.

156 changes: 78 additions & 78 deletions stac/bay-of-plenty/bay-of-plenty_2024/dem_1m/2193/collection.json
View file

Large diffs are not rendered by default.

156 changes: 78 additions & 78 deletions stac/bay-of-plenty/bay-of-plenty_2024/dsm_1m/2193/collection.json
View file

Large diffs are not rendered by default.

452 changes: 387 additions & 65 deletions stac/bay-of-plenty/tauranga-and-coast_2015/dem_1m/2193/collection.json
View file

Large diffs are not rendered by default.

452 changes: 387 additions & 65 deletions stac/bay-of-plenty/tauranga-and-coast_2015/dsm_1m/2193/collection.json
View file

Large diffs are not rendered by default.

158 changes: 135 additions & 23 deletions stac/bay-of-plenty/tauranga_2022/dem_1m/2193/collection.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -12,28 +12,138 @@
"type": "application/json"
},
{ "rel": "self", "href": "./collection.json", "type": "application/json" },
{ "rel": "item", "href": "./BD36_10000_0205.json", "type": "application/json" },
{ "rel": "item", "href": "./BD36_10000_0304.json", "type": "application/json" },
{ "rel": "item", "href": "./BD36_10000_0305.json", "type": "application/json" },
{ "rel": "item", "href": "./BD36_10000_0403.json", "type": "application/json" },
{ "rel": "item", "href": "./BD36_10000_0404.json", "type": "application/json" },
{ "rel": "item", "href": "./BD36_10000_0405.json", "type": "application/json" },
{ "rel": "item", "href": "./BD36_10000_0503.json", "type": "application/json" },
{ "rel": "item", "href": "./BD36_10000_0504.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0101.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0201.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0202.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0203.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0301.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0302.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0303.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0304.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0305.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0401.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0402.json", "type": "application/json" },
{ "rel": "item", "href": "./BD37_10000_0405.json", "type": "application/json" },
{ "rel": "item", "href": "./BD38_10000_0301.json", "type": "application/json" },
{ "rel": "item", "href": "./BD38_10000_0401.json", "type": "application/json" }
{
"rel": "item",
"href": "./BD36_10000_0205.json",
"type": "application/json",
"file:checksum": "1220179ecd0db4b0383d23d831053d05ecda29e06565772648251c1f06cdbc564449"
},
{
"rel": "item",
"href": "./BD36_10000_0304.json",
"type": "application/json",
"file:checksum": "1220bc1baac8238d3cdba1c1bc2b7a00e119b3ecaed6cb1afbc91c7c0323d868c33b"
},
{
"rel": "item",
"href": "./BD36_10000_0305.json",
"type": "application/json",
"file:checksum": "1220955337b6a91e941e2ebdac6d38e5f776360dc2f0c150ff3918845fa18e3cb2fa"
},
{
"rel": "item",
"href": "./BD36_10000_0403.json",
"type": "application/json",
"file:checksum": "1220a686d8f01fc590810a9044cb510020939f5af5ed6ceb04b31f7a843e5afe977e"
},
{
"rel": "item",
"href": "./BD36_10000_0404.json",
"type": "application/json",
"file:checksum": "122047e092e0496c9d01af1fa922f4316a513b34a6d72f005cbad4fe587eacbb4106"
},
{
"rel": "item",
"href": "./BD36_10000_0405.json",
"type": "application/json",
"file:checksum": "122046ccee72420a71d537ae67b7abc748d29e3da3dedb342b1d8ea29e6de5cd13c3"
},
{
"rel": "item",
"href": "./BD36_10000_0503.json",
"type": "application/json",
"file:checksum": "1220eced602a4161045e236145e58648530c68f3f4fc19b8efcfe870c5304e6fa9f7"
},
{
"rel": "item",
"href": "./BD36_10000_0504.json",
"type": "application/json",
"file:checksum": "1220f3768bb26e6b58263e04ab99f0c54d43a4d6a621be7f600d5048e0fcc080b487"
},
{
"rel": "item",
"href": "./BD37_10000_0101.json",
"type": "application/json",
"file:checksum": "12201d73019b17165e57aa1efa748a248722578d67d6cded36d9a06e0ff585cdc27d"
},
{
"rel": "item",
"href": "./BD37_10000_0201.json",
"type": "application/json",
"file:checksum": "122099516aa6466db815bd749159510be60698519372477178fdfafb2f9716c1302c"
},
{
"rel": "item",
"href": "./BD37_10000_0202.json",
"type": "application/json",
"file:checksum": "12203f591a09d2e7aa811469ea9d146fba4b1e015a0a37e0b0b5f412f55db93da269"
},
{
"rel": "item",
"href": "./BD37_10000_0203.json",
"type": "application/json",
"file:checksum": "12205dd5e23b44c02e05f72f41c2388927674af28ea8d04b76041da070f8ce651c54"
},
{
"rel": "item",
"href": "./BD37_10000_0301.json",
"type": "application/json",
"file:checksum": "12204e47850c05fed3bf6f0eba3220bb7fb59638cf40e7b5e8e27d32d99e9a44ba24"
},
{
"rel": "item",
"href": "./BD37_10000_0302.json",
"type": "application/json",
"file:checksum": "12204063bef06f324cc1a736566581dfa92a4f36f82d5c91ae4bce52da55788975f7"
},
{
"rel": "item",
"href": "./BD37_10000_0303.json",
"type": "application/json",
"file:checksum": "12209a85ccf030b400cf6ed279924be62f8811e50e979b74db6b0bb9d03c83b5d8be"
},
{
"rel": "item",
"href": "./BD37_10000_0304.json",
"type": "application/json",
"file:checksum": "12201561f202bc44a6a070f24b99a959d05eea9c7fd1e850b57c82835f3cbf395eac"
},
{
"rel": "item",
"href": "./BD37_10000_0305.json",
"type": "application/json",
"file:checksum": "12207e4638d8af4a1891571442197bc49fc8953895f97dab029e398afe066d616791"
},
{
"rel": "item",
"href": "./BD37_10000_0401.json",
"type": "application/json",
"file:checksum": "1220a148fc8c65a41e28f1cd12decf6babc9abe67a625fbad18cced3faac57f31a8c"
},
{
"rel": "item",
"href": "./BD37_10000_0402.json",
"type": "application/json",
"file:checksum": "122001d209b11084e4d5fca5dc040285dc2116181d9995f81a619fd6c6ea3c1ecfb5"
},
{
"rel": "item",
"href": "./BD37_10000_0405.json",
"type": "application/json",
"file:checksum": "12202e53f06d11963be446cc008cab80d9d598cc93a1a015ae29e2a410fba1b9a41d"
},
{
"rel": "item",
"href": "./BD38_10000_0301.json",
"type": "application/json",
"file:checksum": "1220cb21c9cddd951cde9010ab19996d57b80601f5c3de41ba916fa5e6dfa82dab10"
},
{
"rel": "item",
"href": "./BD38_10000_0401.json",
"type": "application/json",
"file:checksum": "1220dc78cfd56acc02c8d84b55c26fc0ccf79fd6fe586cf49e31ebab6ca58558d32d"
}
],
"providers": [
{ "name": "Woolpert", "roles": ["producer"] },
Expand All @@ -60,5 +170,7 @@
"file:size": 4039
}
},
"stac_extensions": ["https://stac-extensions.github.io/file/v2.0.0/schema.json"]
"stac_extensions": ["https://stac-extensions.github.io/file/v2.0.0/schema.json"],
"created": "2024-04-28T22:46:06Z",
"updated": "2024-11-14T01:59:26Z"
}
95 changes: 81 additions & 14 deletions stac/canterbury/amberley_2012/dem_1m/2193/collection.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -12,19 +12,84 @@
"type": "application/json"
},
{ "rel": "self", "href": "./collection.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0403.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0404.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0502.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0503.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0504.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0102.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0103.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0104.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0105.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0202.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0203.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0204.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0304.json", "type": "application/json" }
{
"rel": "item",
"href": "./BV24_10000_0403.json",
"type": "application/json",
"file:checksum": "1220f8176749ef150269da946c6731c6b0feefda4a8748b1cca7fd4640e9cc848461"
},
{
"rel": "item",
"href": "./BV24_10000_0404.json",
"type": "application/json",
"file:checksum": "1220f5dea6022bbf4353169f5d2f2e70a010ea3f22b4257bebb7b1a4b466bc7b4750"
},
{
"rel": "item",
"href": "./BV24_10000_0502.json",
"type": "application/json",
"file:checksum": "1220e2cf71554c4dd608ded71c30f7efc494d8836af7819ff498871f83b24bc088f0"
},
{
"rel": "item",
"href": "./BV24_10000_0503.json",
"type": "application/json",
"file:checksum": "1220485e825bc8ba90bda905622026d724547634d30e0e59e5e928e7af36e3a6ad4c"
},
{
"rel": "item",
"href": "./BV24_10000_0504.json",
"type": "application/json",
"file:checksum": "1220deec6abf7eed65d841809ca0320443a6d2e409ee3be779f3f4ee45ea37e146f4"
},
{
"rel": "item",
"href": "./BW24_10000_0102.json",
"type": "application/json",
"file:checksum": "12202617fd8da57018985135814c04728c537e014fd6444e2cc7eeaf1ea2c44a16e3"
},
{
"rel": "item",
"href": "./BW24_10000_0103.json",
"type": "application/json",
"file:checksum": "12208a957c4859fe4ab8d52952620f3874a4c1eaa49bf5b2d9be2b68b7435a846467"
},
{
"rel": "item",
"href": "./BW24_10000_0104.json",
"type": "application/json",
"file:checksum": "122024845a6ce648cfb49bacd5490882328b4872277bcac01d278987a868ec5c46bc"
},
{
"rel": "item",
"href": "./BW24_10000_0105.json",
"type": "application/json",
"file:checksum": "1220a1c85d9855b45420765a731b050d50fcf2d7a2f112da3070a11c0f5a11a10dc1"
},
{
"rel": "item",
"href": "./BW24_10000_0202.json",
"type": "application/json",
"file:checksum": "12208bf1cba20369b059e9e438a1052f5dc464be36ca6e28f733c65b6a5f2e6711a1"
},
{
"rel": "item",
"href": "./BW24_10000_0203.json",
"type": "application/json",
"file:checksum": "1220488b119684298077664e3776290a01db0fdc60bb7597cf25291cd845745be23e"
},
{
"rel": "item",
"href": "./BW24_10000_0204.json",
"type": "application/json",
"file:checksum": "1220872f0bc6df84b6ac39d34186518805261d2c1a68e528b6376f82fe9819753ac8"
},
{
"rel": "item",
"href": "./BW24_10000_0304.json",
"type": "application/json",
"file:checksum": "122045a5e4f6652a2f38f4ad5afb40eb787d6f60bc9efc04f322518c1a6bfadcc5d8"
}
],
"providers": [
{ "name": "Aerial Surveys", "roles": ["producer"] },
Expand All @@ -51,5 +116,7 @@
"file:size": 5354
}
},
"stac_extensions": ["https://stac-extensions.github.io/file/v2.0.0/schema.json"]
"stac_extensions": ["https://stac-extensions.github.io/file/v2.0.0/schema.json"],
"created": "2024-03-14T00:00:00Z",
"updated": "2024-11-14T01:59:26Z"
}
95 changes: 81 additions & 14 deletions stac/canterbury/amberley_2012/dsm_1m/2193/collection.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -12,19 +12,84 @@
"type": "application/json"
},
{ "rel": "self", "href": "./collection.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0403.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0404.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0502.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0503.json", "type": "application/json" },
{ "rel": "item", "href": "./BV24_10000_0504.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0102.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0103.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0104.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0105.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0202.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0203.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0204.json", "type": "application/json" },
{ "rel": "item", "href": "./BW24_10000_0304.json", "type": "application/json" }
{
"rel": "item",
"href": "./BV24_10000_0403.json",
"type": "application/json",
"file:checksum": "12201323a9579bbf0fce3094c20121f97280f06a28780ac00e8a07c66cbe8d0cc28f"
},
{
"rel": "item",
"href": "./BV24_10000_0404.json",
"type": "application/json",
"file:checksum": "1220dacd11b471052d118ae9227776cea398effe7c0476ac1a27b684a0a77e77ac5c"
},
{
"rel": "item",
"href": "./BV24_10000_0502.json",
"type": "application/json",
"file:checksum": "122048082ad370bb18f9eb112b89b9e78bb06bc7972184d4db5e707aefd48fa61c38"
},
{
"rel": "item",
"href": "./BV24_10000_0503.json",
"type": "application/json",
"file:checksum": "12203b53c96feaf680433f8bb00980f1b3beeebdadab22a88942b2d2b88fdf7ba043"
},
{
"rel": "item",
"href": "./BV24_10000_0504.json",
"type": "application/json",
"file:checksum": "12202c7f2af51348138995164fa3bd53af07c66b85c607f862d029e2745db98fbcfc"
},
{
"rel": "item",
"href": "./BW24_10000_0102.json",
"type": "application/json",
"file:checksum": "12204c4ff97e6f8943f50779672a9af6084c35fac64b1a859c8e62641a91a8f0c911"
},
{
"rel": "item",
"href": "./BW24_10000_0103.json",
"type": "application/json",
"file:checksum": "1220f41550dd4f4fc5cb4cb05a7bb2e4aedcb20dfb33e9bc41ac8bf9b0f3d65575e0"
},
{
"rel": "item",
"href": "./BW24_10000_0104.json",
"type": "application/json",
"file:checksum": "12200ee9930bc48b43edd0d8727c81e7fe1f90b51a716272cb55f88f0501c0598e63"
},
{
"rel": "item",
"href": "./BW24_10000_0105.json",
"type": "application/json",
"file:checksum": "1220531d3e8510dac87f572397b44338cd172ff217d364064ca6a89aee61bd95fb9b"
},
{
"rel": "item",
"href": "./BW24_10000_0202.json",
"type": "application/json",
"file:checksum": "1220cbe1895cdd9ace43b4ca55c4b682e1547f2c9ea2b18f98b9cf91861619de0a4c"
},
{
"rel": "item",
"href": "./BW24_10000_0203.json",
"type": "application/json",
"file:checksum": "1220e243746dfaf63ab064999d6928952d20d6e2eefed7ccc97968011ba7a88b08e9"
},
{
"rel": "item",
"href": "./BW24_10000_0204.json",
"type": "application/json",
"file:checksum": "122026f68901cf275986397c109c13a2680f33c163dd4d3339c54f99b50c3dcc008e"
},
{
"rel": "item",
"href": "./BW24_10000_0304.json",
"type": "application/json",
"file:checksum": "12208eec0204c39f3b1c609e11105dabe5ae6bed7f85f313cd93d8972fc876f0769d"
}
],
"providers": [
{ "name": "Aerial Surveys", "roles": ["producer"] },
Expand All @@ -51,5 +116,7 @@
"file:size": 5146
}
},
"stac_extensions": ["https://stac-extensions.github.io/file/v2.0.0/schema.json"]
"stac_extensions": ["https://stac-extensions.github.io/file/v2.0.0/schema.json"],
"created": "2024-03-14T00:00:00Z",
"updated": "2024-11-14T01:59:26Z"
}
Loading

0 comments on commit ec1c969

Please sign in to comment.