Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Integration:  dvc git github
Wei Ji b4caf70dfe
:bookmark: v0.4.0
3 years ago
7ee3e04188
# What's Changed
3 years ago
b8392c5a59
:sparkles: Crossover track analysis over Subglacial Lake Conway
3 years ago
7ee3e04188
# What's Changed
3 years ago
c93eded7b1
:sparkles: Active subglacial lake mega-cluster analysis
3 years ago
da2342f497
:pushpin: Install pointCollection properly via pip
3 years ago
1512910bf4
:robot: Add stickler style checker configured for black code style
4 years ago
66dc627497
:package: Refresh ATL11 Zarr data to 20200930
3 years ago
acd08b8b5e
:arrow_up: Bump conda from 4.8.2 to 4.9.2
3 years ago
6b5fb8344c
:tada: Initial commit
4 years ago
4c5daf0520
:bug: Sort dataframe by time before calculating height anomaly
3 years ago
1dac092e95
:package: Detect active subglacial lakes up to 20200930
3 years ago
1dac092e95
:package: Detect active subglacial lakes up to 20200930
3 years ago
2296a7ae8b
:package: Download ATL06 files up to 20200930
3 years ago
2296a7ae8b
:package: Download ATL06 files up to 20200930
3 years ago
66dc627497
:package: Refresh ATL11 Zarr data to 20200930
3 years ago
66dc627497
:package: Refresh ATL11 Zarr data to 20200930
3 years ago
85b6ffa870
:globe_with_meridians: Add Amundsen Sea Embayment region
3 years ago
85b6ffa870
:globe_with_meridians: Add Amundsen Sea Embayment region
3 years ago
16687b0627
:alien: Use for-loop to generate df_dhdt of all Antarctic regions
3 years ago
16687b0627
:alien: Use for-loop to generate df_dhdt of all Antarctic regions
3 years ago
748aa0b37b
:ok_hand: Optimize for-loops for processing ICESat-2 tracks
3 years ago
748aa0b37b
:ok_hand: Optimize for-loops for processing ICESat-2 tracks
3 years ago
1872ad031f
:chart_with_upwards_trend: Cascade plots of a few subglacial lakes
3 years ago
1872ad031f
:chart_with_upwards_trend: Cascade plots of a few subglacial lakes
3 years ago
9a16201c38
:arrow_up: Bump poetry from 1.1.2 to 1.1.4, pip from 20.2.3 to 20.3.1
3 years ago
9a16201c38
:arrow_up: Bump poetry from 1.1.2 to 1.1.4, pip from 20.2.3 to 20.3.1
3 years ago
ab2ba20d06
:heavy_plus_sign: Add pint-pandas and uncertainties
3 years ago
7ee3e04188
# What's Changed
3 years ago
Storage Buckets

README.md

You have to be logged in to leave a comment. Sign In

DeepIceDrain

Mapping and monitoring deep subglacial water activity in Antarctica using remote sensing and machine learning.

GitHub top language Code style: black Test DeepIceDrain package Dependabot Status License

Ice Surface Elevation trends over Antactica Active Subglacial Lake filling event
ICESat-2 ATL11 rate of height change over time in Antarctica 2018-10-14 to 2020-09-30 dsm_whillans_ix_cycles_3-8.gif

DeepIceDrain Pipeline Part 1 Exploratory Data Analysis DeepIceDrain Pipeline Part 2 Subglacial Lake Analysis

Along track view of an ATL11 Ground Track Elevation time-series at Crossover Points
alongtrack_whillans_ix_1080_pt3 crossover_anomaly_whillans_ix_2018-10-14_2020-09-30

Getting started

Quickstart

Launch in Pangeo Binder (Interactive jupyter lab environment in the cloud).

Binder

Usage

Once you've properly installed the deepicedrain package (see installation instructions further below), you'll have access to a wide range of tools for downloading and performing quick calculations on ICESat-2 datasets. The example below shows how to calculate ice surface elevation change on a sample ATL11 dataset between ICESat's Cycle 3 and Cycle 4.

import deepicedrain
import xarray as xr

# Loads a sample ATL11 file from the intake catalog into xarray
atl11_dataset: xr.Dataset = deepicedrain.catalog.test_data.atl11_test_case.read()

# Calculate elevation change in metres from ICESat-2 Cycle 3 to Cycle 4
delta_height: xr.DataArray = deepicedrain.calculate_delta(
      dataset=atl11_dataset, oldcyclenum=3, newcyclenum=4, variable="h_corr"
)

# Quick plot of delta_height along the ICESat-2 track
delta_height.plot()

ATL11 delta_height along ref_pt track

Installation

Basic

To just try out the scripts, download the environment.yml file from the repository and run the commands below:

cd deepicedrain
conda env create --name deepicedrain --file environment.yml
pip install git+https://github.com/weiji14/deepicedrain.git

Intermediate

To help out with development, start by cloning this repo-url

git clone <repo-url>

Then I recommend using conda to install the non-python binaries. The conda virtual environment will also be created with Python and poetry installed.

cd deepicedrain
conda env create -f environment.yml

Activate the conda environment first.

conda activate deepicedrain

Then install the python libraries listed in the pyproject.toml/poetry.lock file.

poetry install

Finally, double-check that the libraries have been installed.

poetry show

(Optional) Install jupyterlab extensions for interactive bokeh visualizations.

jupyter labextension install @pyviz/jupyterlab_pyviz
jupyter labextension install dask-labextension

jupyter labextension list  # ensure that extensions are installed

Advanced

This is for those who want full reproducibility of the conda environment, and more computing power by using Graphical Processing Units (GPU).

Making an explicit conda-lock file (only needed if creating a new conda environment/refreshing an existing one).

conda env create -f environment.yml
conda list --explicit > environment-linux-64.lock

Creating/Installing a virtual environment from a conda lock file. See also https://docs.conda.io/projects/conda/en/latest/user-guide/tasks/manage-environments.html#building-identical-conda-environments.

conda create --name deepicedrain --file environment-linux-64.lock
conda install --name deepicedrain --file environment-linux-64.lock

If you have a CUDA-capable GPU, you can also install the optional "cuda" packages to accelerate some calculations.

poetry install --extras cuda

Running jupyter lab

conda activate deepicedrain
python -m ipykernel install --user --name deepicedrain  # to install conda env properly
jupyter kernelspec list --json                          # see if kernel is installed
jupyter lab &

This work would not be possible without inspiration from the following cool open source projects! Go check them out if you have time.

Tip!

Press p or to see the previous file or, n or to see the next file

About

Mapping and monitoring deep subglacial water activity in Antarctica using remote sensing and machine learning, with ICESat-2!

Collaborators 1

Comments

Loading...