Skip to content

Commit

Permalink
first clean up
Browse files Browse the repository at this point in the history
  • Loading branch information
eeholmes committed Apr 26, 2024
1 parent c67f75b commit 2ec0065
Show file tree
Hide file tree
Showing 166 changed files with 15,300 additions and 51,727 deletions.
14 changes: 6 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,22 +1,20 @@

## NOAA HackDays 2024: Integrating Earth Data into Science Workflows
## EDMW 2024 - Workshop 3B: Introduction to using earth data in the cloud for scientific workflows

### Overview

The the era of big data in the earth sciences is here and learning how to effectively use oceanographic remote-sensing data, both in the cloud and on your computer, is a core skill for modern fisheries science and management. Learning how to access cloud-based data, visualize these data, use these data in models, and use the tools of modern reproducible and collaborative science is the main goal of these hackday events. Through these events, participants will gain experience with assessing remote-sensing data in the cloud, R and RStudio, Python and Jupyter notebooks, and collaborating with Git and GitHub.
Earth science data is increasingly available from the cloud and due to the size of many of these dataset (Tb and Pb in some cases), data workflows are transitioning to workflows that involve programmatic access with either cloud-native analysis or server-side processing . In this workshop, participants will take part in hands-on tutorials on working with earth data in the cloud with Python and/or R using a JupyterHub (cloud computing platform) provisioned for geospatial analysis. Participants will learn the basics of searching cloud resources via SpatioTemporal Asset Catalogs (STAC) and NASA Earth Data via Common Metadata Repository (CMR). Participants will go through tutorials to learn how to incorporate earth data into their science projects via cloud-native and server-side workflows. Participants will also be exposed to the Python and R suite of geospatial packages for gridded and other spatial data.

### Aims and Objectives

* Learn how to discover and use oceanographic remote-sensing data for species distribution modeling and other fisheries applications
* Learn how to discover and use oceanographic remote-sensing data in NASA Earth Data
* Familiarize participants with using remote-sensing data in R and Python with code.
* Obtain hands-on experience in using remote-sensing data for various science applications.
* Learn by working together on a group project.
* Obtain hands-on experience in using remote-sensing data for two science applications.
* Learn by doing and running through examples yourself.

### What to expect

* What is a hack event? See the [description of hackweeks](https://escience.washington.edu/using-data-science/hackweeks/) on the University of Washington eScience institute website:

*A hackweek is a participant-driven workshop that blends data science education, community building, and project work over a short period of time (one to two weeks). The events are highly immersive and allow participants to work directly with data science professionals to co-shape projects and educational outcomes. Hackweeks often help individuals and teams engage more effectively in open and reproducible science.* - eScience Institute, University of Washington
* We will have short introductions and then will work through tutorials together. You are encouraged to adapt the code to create output and examples for your own data and areas of interest.

* All tutorials and examples are developed openly and will be publicly available during and following the event. Participants will strengthen their practice of open science, using open source code and collaborating on their projects with course peers.

Expand Down
53 changes: 12 additions & 41 deletions _quarto.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,10 @@ execute:

website:
page-navigation: true
title: "2024 NOAA HackDays"
title: "2024 EDMW Workshop 3B"
favicon: "images/favicon-16x16.png"
site-url: https://nmfs-opensci.github.io/NOAAHackDays-2024
repo-url: https://github.com/nmfs-opensci/NOAAHackDays-2024
site-url: https://nmfs-opensci.github.io/EDMW-EarthData-Workshop-2024
repo-url: https://github.com/nmfs-opensci/EDMW-EarthData-Workshop-2024
repo-actions: [edit, issue, source]

page-footer: <img src="https://github.com/nmfs-opensci/assets/blob/main/logo/nmfs-opensci-logo2.png?raw=true" alt="NMFS Open Science logo" style="width:150px"><br />NMFS Open Science (2023)
Expand All @@ -32,7 +32,6 @@ website:
contents:
- overview.md
- team.md
# - schedule.md
- setup.md
- support.md
- coc.md
Expand Down Expand Up @@ -64,34 +63,16 @@ website:
href: content/02-rstudio.qmd
- text: Quarto
href: content/02-quarto.qmd
- text: Programming with AI
href: content/03-ai.md
- text: Loading data in R
href: r-tutorials/03-r-read-in-data.qmd
- text: Plotting with ggplot2
href: r-tutorials/04-r-ggplot2.qmd
- text: Maps!
href: r-tutorials/05-r-geospatial.qmd
- section: "Marine SDMs"
- section: "Earth Data in R"
contents:
- text: Lab Setup
href: r-tutorials/Lab-setup.qmd
- text: SDM 1
href: r-tutorials/SDM-lab1.qmd
- text: robis
href: r-tutorials/SDM-lab-robis.qmd
- text: spocc
href: r-tutorials/SDM-lab-spocc.qmd
- text: MaxEnt SDM
href: r-tutorials/Turtle_maxnet.qmd
- section: "Projects"
contents:
- projects/index.md
- projects/hackathon-projects.md
# - section: "Further Resources"
# contents:
# - content/XX-r-and-python-resources.md
# - content/XX-further-resources.md
- text: Searching & subsetting
- text: Getting the data
- text: Extract in a boundary
- text: Extract on a transect
- section: "Python Tutorials"
contents:
- section: "Data Access"
Expand All @@ -105,17 +86,7 @@ website:
contents:
- python-notebooks/02_Using_Data.ipynb
- python-notebooks/02_Graphing_Data.ipynb
- python-notebooks/02_Zarr_Access_netCDF.ipynb
- python-notebooks/02_Xarray_hvplot.ipynb
- python-notebooks/02_Xarray_hvplot.ipynb
- section: "Machine Learning"
contents:
- section: "Applications"
contents:
- section: "IO Zarr Database"
contents:
- python-notebooks/04_Combining_Data.ipynb
- python-notebooks/04_Appending_Data.ipynb
- text: <img width=100px>
- text: <img src="/images/noaa_emblem_logo-2022.png" width=100px>
href: https://fisheries.noaa.gov
Expand All @@ -127,11 +98,11 @@ website:
href: https://dhub.opensci.live/
text: "JupyterHub"
- icon: wechat
href: https://github.com/nmfs-opensci/NOAAHackDays-2024/discussions
href: https://github.com/nmfs-opensci/EDMW-EarthData-Workshop-2024/discussions
text: "Discussions"
# - icon: slack
# href: https://app.slack.com/client/T05PV2USY56/C05P7QP47UL
# text: "Slack"
- icon: github
href: https://github.com/nmfs-opensci/EDMW-EarthData-Workshop-2024
text: "Repo"
- icon: globe
href: https://github.com/nmfs-opensci
text: "GH org"
Expand Down
Binary file modified content/sst.nc
Binary file not shown.
Loading

0 comments on commit 2ec0065

Please sign in to comment.