NUVIEW State Open Data submission

[mwielocha]

Issue #, if available:
n/a

Description of changes:
Add entry to NUVIEW State Open Data bucket maintained by NUVIEW, Inc.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

[pschmied]

Hi @mwielocha , I am taking a look at your draft tutorial notebook, and you're off to a great start! To meet our draft materials requirement, we'll want to see a first pass at the narrative questions in the tutorial template:

Q: What is one question that you have answered using these data? Can you show us how you came to that answer?

Q: What is one unanswered question that you think could be answered using these data? Do you have any recommendations or advice for someone wanting to answer this question?

In addition, perhaps for the final notebook version, I'd love to see if there's a visualization that illustrates something at the macro scale about these data. Not sure what that might be, but given that the data are somewhat inherently visual, if there were a way to "zoom out" and illustrate visually something about the dataset as a whole (even if it's a statistical feature), that could be interesting.

[mwielocha]

Hey @pschmied, thanks for the feedback!

I've updated the notebook with the missing answers. Let me know what you think.

As for larger scale visualization I do agree that this would be a very nice example to have in a notebook. Unfortunately most of the projects that we have so far are quite large. For example a lidar survey of the Copper River region of Alaska consists of more than 5k UTM grid cells (meaning that for each product type there are that many different las point cloud files or geotiffs for derived products). Since there is no easy way to spatial query data in an S3 bucket we'd have to visualize based on the directory structure which means downloading all those files in the notebook and then merging them into a mosaic. That would take quite some time I'm not even sure if gdal (or any other similar tool I know of) would be able to pull this off.

At NUVIEW we're currently building an online platform for visualization and discovery of data from this bucket for each state or organization that will be a part of this program. This platform will eventually be available to anyone that is interested in utilizing that dataset. Unfortunately we're not there yet with capabilities to be able to implement an example in a jupyter notebook.

I could select some scenes "by hand" and write an example like that but I'm not exactly sure how useful would that be for people coming to this repository.

I'd love to hear your thoughts, thanks!

[pschmied]

Thank you @mwielocha — I appreciate you addressing those questions, and entertaining the visualization question. Re visualization, no worries. Data size and notebook environment can indeed be a mismatch in such circumstances.

This all looks good to proceed as a draft. Thank you again!

[mwielocha]

@pschmied Thanks, we have everything setup in the account. The bucket was created from the pds template and I updated the yaml with SNS queue ARN. We already uploaded first batch of data, more coming soon. I think this is ready for review.

[pschmied]

Thank you @mwielocha - tagging in @cstner for those assets.

[cstner]

Can you give AWS (the upstream maintainers) the ability to modify your pull request per these instructions? https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/allowing-changes-to-a-pull-request-branch-created-from-a-fork

[mwielocha]

@cstner Hm it doesn't look like I have an option to do that. The checkbox is missing. Not sure why, the only clue I have is that the fork is under NUVIEW org and not a personal account.

[cstner]

Can you temporarily add me as a contributor? You can remove it once we have merged your yaml

[mwielocha]

@cstner I've sent an invite.

[cstner]

@mwielocha - I noticed that you have RequesterPays: True for your bucket. You should remove that as it's not needed with the AWS Open Data Sponsorship program.

[mwielocha]

@cstner done.