Skip to content

feat: create gedi-tiled-v2 collection and copy assets to public bucket - #89

Open
hrodmn wants to merge 1 commit into
mainfrom
feat/gedi-tiled-v2
Open

feat: create gedi-tiled-v2 collection and copy assets to public bucket#89
hrodmn wants to merge 1 commit into
mainfrom
feat/gedi-tiled-v2

Conversation

@hrodmn

@hrodmn hrodmn commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Just a collection (no items) for now, with a manifest.txt asset that can be provided to duckdb to query the entire dataset without s3:ListBucket permissions. I also added a SQL script asset that shows how to set up collection-wide access in duckdb.

Here is what the SQL looks like for using the manifest file (hrodmn-scratch is a non-public bucket in the SMDC-MAAP AWS account):

INSTALL httpfs;
LOAD httpfs;

SET VARIABLE gedi_v2_files = (
    SELECT list(href)
    FROM read_csv(
        's3://hrodmn-scratch/file-staging/nasa-map/gedi-tiled-v2/manifest.txt',
        header = false,
        columns = {'href': 'VARCHAR'}
    )
);

CREATE OR REPLACE VIEW gedi_tiled_v2 AS
SELECT *
FROM read_parquet(
    getvariable('gedi_v2_files'),
    hive_partitioning = true
);

Then you can do things like:

select count(*) from gedi_tiled_v2 where year = 2020;

Resolves https://github.com/NASA-IMPACT/active-maap-sprint/issues/1426

@hrodmn
hrodmn requested a review from jjfrench July 24, 2026 16:58
@hrodmn hrodmn self-assigned this Jul 24, 2026
@review-notebook-app

Copy link
Copy Markdown

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@jjfrench jjfrench left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

STAC Collection output looks good!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants