J Michael Johnson

NOAA-Affiliate;Lynker

 Recent Activity

ABSTRACT:

This data release provides the historic streamflow simulations from versions 1.2, 2.0, and 2.1 of the National Water Model re-structured for time series extraction. The data is hosted on a distributed set of THREDDS Data Servers and is accessible via OPeNDAP at the following URLs:

Version 1.2
(https://thredds.hydroshare.org/thredds/catalog/nwm/retrospective/catalog.html?dataset=NWM_Retrospective/nwm_retro_full.ncml)
- Spans 1993-01-01 00:00:00 to 2017-12-31 23:00:00
- Contains 219,144 hourly time steps for
- 2,729,077 NHD reaches

Version 2.0
(https://thredds.hydroshare.org/thredds/catalog/nwm/retrospective/catalog.html?dataset=NWM_Retrospective/nwm_v2_retro_full.ncml)
- Spans 1993-01-01 00:00:00 to 2018-12-31 00:00:00
- Contains 227,904 hourly time steps for
- 2,729,076 NHD reaches

Version 2.1
(https://cida.usgs.gov/thredds/catalog/demo/morethredds/nwm/nwm_v21_retro_full.ncml)
- Spans 1979-02-02 18:00:00 to 2020-12-31 00:00:00
- Contains 367,439 hourly time steps for
- 2,776,738 NHD reaches

The `nwmTools` R package provides easier interaction with the OPeNDAP resources. Package documentation can be found here (https://mikejohnson51.github.io/nwmTools/) and the GitHub repository here (https://github.com/mikejohnson51/nwmTools).

This effort is supported by the Consortium of Universities for the Advancement of Hydrologic Science, Inc. under the HydroInformatics Fellowship.

Current Publication:

J.M. Johnson, David L. Blodgett, Keith C. Clarke, Jon Pollack. (2020). "Restructuring and serving web-accessible streamflow data from the NOAA National Water Model historic simulations". _Nature Scienfic Data_.

Show More

ABSTRACT:

Hydrofabric artifacts are needed to execute the NOAA Next Generation (NextGen) Water Resource Modeling framework. This resource contains the outlinks needed to access this data for research and development. The primary landing page for these resources can be found at https://noaa-owp.github.io/hydrofabric/ with detailed documentation of the geopackage contents at https://noaa-owp.github.io/hydrofabric/schema.html.

Show More

ABSTRACT:

This data release provides the reanalysis streamflow data from versions 1.2, 2.0, and 2.1 of the National Water Model structured for timeseries extraction. The impact of this is that user can query time series for a given NHDPlusV2 COMID without downloading the hourly CONUS files and extracting the sample of relevant values.

The data is hosted on the RENCI THREDDS Data Server and is accessible via OPeNDAP at the follwoing URLs:

Version 1.2
(https://thredds.hydroshare.org/thredds/catalog/nwm/retrospective/catalog.html?dataset=NWM_Retrospective/nwm_retro_full.ncml)
- Spans 1993-01-01 00:00:00 to 2017-12-31 23:00:00
- Contains 219,144 hourly time steps for
- 2,729,077 NHD reaches

Version 2.0
(https://thredds.hydroshare.org/thredds/catalog/nwm/retrospective/catalog.html?dataset=NWM_Retrospective/nwm_v2_retro_full.ncml)
- Spans 1993-01-01 00:00:00 to 2018-12-31 00:00:00
- Contains 227,903 hourly time steps for
- 2,729,076 NHD reaches

Version 2.1
(https://cida.usgs.gov/thredds/catalog/demo/morethredds/nwm/nwm_v21_retro_full.ncml)
- Spans 1979-02-02 18:00:00 to 2020-12-31 00:00:00
- Contains 227,903 hourly time steps for
- 2,729,076 NHD reaches

Raw Data
(https://registry.opendata.aws/nwm-archive/)
- 227,000+ hourly netCDF files (depending on version)

## DDS

The data description structure (DDS) can be viewed at the NcML page for each respective resource (linked above). More broadly each resource includes:

- A _1D_ time array - **hours** since 1970-01-01 00:00
- A _1D_ latitude array - **coordinate** (Y) information
- A _1D_ longitude array - **coordinate** (X) information WGS84
- A _1D_ feature_id array - **NHDPlus V2 COMID** (NWM forecast ID)
- A _2D_ streamflow array - **Q (cms)** [feature_id, time]

## R package

The `nwmTools` R package provides easier interaction with the OPeNDAP resources. Package documentation can be found [here](https://mikejohnson51.github.io/nwmTools/) and the GitHub repository [here](https://github.com/mikejohnson51/nwmTools).

# Collaborators:

[Mike Johnson](https://mikejohnson51.github.io/), [David Blodgett](https://www.usgs.gov/staff-profiles/david-l-blodgett?qt-staff_profile_science_products=3#qt-staff_profile_science_products)

# Support:

This effort is supported by the Consortium of Universities for the Advancement of Hydrologic Science, Inc. under the HydroInformatics Fellowship. See program [here](https://www.cuahsi.org/data-models/hydroinformatics-innovation-fellowship/)

# Publications

J.M. Johnson, David L. Blodgett, Keith C. Clarke, Jon Pollack. (2020). "Restructuring and serving web-accessible streamflow data from the NOAA National Water Model historic simulations". _Nature Scienfic Data_. (**In Review**)

Show More

ABSTRACT:

These files contain a curated set NHDPlusV2 flowline and 'Value Added Attributes' in tabular form for easier attribute based analysis and query. They were taken from national seamless geodatabase provided by the EPA. Utilities for access have been built into the USGS-nhdplusTools package and the parquet file is intended to support Python users directly.

``` r
install.package(nhdplusTools)
library(nhdplusTools)

get_vaa("slope")

comid slope
1 8318793 0.06083397
2 8318787 0.09534391
3 8318775 0.11273792
4 8318785 0.15142342
5 8318789 0.16246142
6 8318801 0.10504926
```

Roughness estimates have been added following the details in the README.md below.

Show More

ABSTRACT:

The file contains some station data used in a UCSB project for mapping station locations.

Show More

 Contact

Resources
All 0
Collection 0
Resource 0
App Connector 0
Resource Resource
harvey_hand_ufokn
Created: Jan. 17, 2020, 3:15 a.m.
Authors: Johnson, Mike

ABSTRACT:

Testing compiled HAND raster for ufokn query.

Show More
Resource Resource
NWM retro testing bed
Created: Jan. 18, 2020, 12:53 a.m.
Authors: Johnson, Mike

ABSTRACT:

Testing resource for thredds access

Show More
Resource Resource

ABSTRACT:

This data release provides the reanalysis streamflow data from versions 1.2 and 2.0 of the National Water Model structured for feature level extraction. The impact of this is that user can query time series for a given NHDPlusV2 COMID without downloading the hourly CONUS files and extracting the sample of relevant values.

The data is hosted on the RENCI THREDDS Data Server and is accessible via OPeNDAP at athe follwoing URLs:

Version 1.2
(http://thredds.hydroshare.org/thredds/dodsC/nwm_retrospective/nwm_retro_full.ncml.html)
- Spans 1993-01-01 to 2017-12-31
- Contains 219,144 hourly time steps for
- 2729077 NHD reaches

Version 2.0
(http://thredds.hydroshare.org/thredds/dodsC/nwm_retrospective/nwm_v2_retro_full.ncml.html)
- Spans 1993-01-01 to 2018-12-31
- Contains 227,903 hourly time steps for
- 2,729,076 NHD reaches

Raw Data
(https://registry.opendata.aws/nwm-archive/)
- 227,000+ hourly netCDF files (depending on version)

Show More
Resource Resource
Station Data
Created: Sept. 8, 2020, 6:46 a.m.
Authors: Turner, Will · Johnson, J Michael · Will Turner

ABSTRACT:

The file contains some station data used in a UCSB project for mapping station locations.

Show More
Resource Resource
NHDPlus Value Added Attributes - no geometries
Created: Nov. 11, 2020, 1:48 a.m.
Authors: Johnson, J Michael

ABSTRACT:

These files contain a curated set NHDPlusV2 flowline and 'Value Added Attributes' in tabular form for easier attribute based analysis and query. They were taken from national seamless geodatabase provided by the EPA. Utilities for access have been built into the USGS-nhdplusTools package and the parquet file is intended to support Python users directly.

``` r
install.package(nhdplusTools)
library(nhdplusTools)

get_vaa("slope")

comid slope
1 8318793 0.06083397
2 8318787 0.09534391
3 8318775 0.11273792
4 8318785 0.15142342
5 8318789 0.16246142
6 8318801 0.10504926
```

Roughness estimates have been added following the details in the README.md below.

Show More
Resource Resource

ABSTRACT:

This data release provides the reanalysis streamflow data from versions 1.2, 2.0, and 2.1 of the National Water Model structured for timeseries extraction. The impact of this is that user can query time series for a given NHDPlusV2 COMID without downloading the hourly CONUS files and extracting the sample of relevant values.

The data is hosted on the RENCI THREDDS Data Server and is accessible via OPeNDAP at the follwoing URLs:

Version 1.2
(https://thredds.hydroshare.org/thredds/catalog/nwm/retrospective/catalog.html?dataset=NWM_Retrospective/nwm_retro_full.ncml)
- Spans 1993-01-01 00:00:00 to 2017-12-31 23:00:00
- Contains 219,144 hourly time steps for
- 2,729,077 NHD reaches

Version 2.0
(https://thredds.hydroshare.org/thredds/catalog/nwm/retrospective/catalog.html?dataset=NWM_Retrospective/nwm_v2_retro_full.ncml)
- Spans 1993-01-01 00:00:00 to 2018-12-31 00:00:00
- Contains 227,903 hourly time steps for
- 2,729,076 NHD reaches

Version 2.1
(https://cida.usgs.gov/thredds/catalog/demo/morethredds/nwm/nwm_v21_retro_full.ncml)
- Spans 1979-02-02 18:00:00 to 2020-12-31 00:00:00
- Contains 227,903 hourly time steps for
- 2,729,076 NHD reaches

Raw Data
(https://registry.opendata.aws/nwm-archive/)
- 227,000+ hourly netCDF files (depending on version)

## DDS

The data description structure (DDS) can be viewed at the NcML page for each respective resource (linked above). More broadly each resource includes:

- A _1D_ time array - **hours** since 1970-01-01 00:00
- A _1D_ latitude array - **coordinate** (Y) information
- A _1D_ longitude array - **coordinate** (X) information WGS84
- A _1D_ feature_id array - **NHDPlus V2 COMID** (NWM forecast ID)
- A _2D_ streamflow array - **Q (cms)** [feature_id, time]

## R package

The `nwmTools` R package provides easier interaction with the OPeNDAP resources. Package documentation can be found [here](https://mikejohnson51.github.io/nwmTools/) and the GitHub repository [here](https://github.com/mikejohnson51/nwmTools).

# Collaborators:

[Mike Johnson](https://mikejohnson51.github.io/), [David Blodgett](https://www.usgs.gov/staff-profiles/david-l-blodgett?qt-staff_profile_science_products=3#qt-staff_profile_science_products)

# Support:

This effort is supported by the Consortium of Universities for the Advancement of Hydrologic Science, Inc. under the HydroInformatics Fellowship. See program [here](https://www.cuahsi.org/data-models/hydroinformatics-innovation-fellowship/)

# Publications

J.M. Johnson, David L. Blodgett, Keith C. Clarke, Jon Pollack. (2020). "Restructuring and serving web-accessible streamflow data from the NOAA National Water Model historic simulations". _Nature Scienfic Data_. (**In Review**)

Show More
Resource Resource

ABSTRACT:

Hydrofabric artifacts are needed to execute the NOAA Next Generation (NextGen) Water Resource Modeling framework. This resource contains the outlinks needed to access this data for research and development. The primary landing page for these resources can be found at https://noaa-owp.github.io/hydrofabric/ with detailed documentation of the geopackage contents at https://noaa-owp.github.io/hydrofabric/schema.html.

Show More
Resource Resource

ABSTRACT:

This data release provides the historic streamflow simulations from versions 1.2, 2.0, and 2.1 of the National Water Model re-structured for time series extraction. The data is hosted on a distributed set of THREDDS Data Servers and is accessible via OPeNDAP at the following URLs:

Version 1.2
(https://thredds.hydroshare.org/thredds/catalog/nwm/retrospective/catalog.html?dataset=NWM_Retrospective/nwm_retro_full.ncml)
- Spans 1993-01-01 00:00:00 to 2017-12-31 23:00:00
- Contains 219,144 hourly time steps for
- 2,729,077 NHD reaches

Version 2.0
(https://thredds.hydroshare.org/thredds/catalog/nwm/retrospective/catalog.html?dataset=NWM_Retrospective/nwm_v2_retro_full.ncml)
- Spans 1993-01-01 00:00:00 to 2018-12-31 00:00:00
- Contains 227,904 hourly time steps for
- 2,729,076 NHD reaches

Version 2.1
(https://cida.usgs.gov/thredds/catalog/demo/morethredds/nwm/nwm_v21_retro_full.ncml)
- Spans 1979-02-02 18:00:00 to 2020-12-31 00:00:00
- Contains 367,439 hourly time steps for
- 2,776,738 NHD reaches

The `nwmTools` R package provides easier interaction with the OPeNDAP resources. Package documentation can be found here (https://mikejohnson51.github.io/nwmTools/) and the GitHub repository here (https://github.com/mikejohnson51/nwmTools).

This effort is supported by the Consortium of Universities for the Advancement of Hydrologic Science, Inc. under the HydroInformatics Fellowship.

Current Publication:

J.M. Johnson, David L. Blodgett, Keith C. Clarke, Jon Pollack. (2020). "Restructuring and serving web-accessible streamflow data from the NOAA National Water Model historic simulations". _Nature Scienfic Data_.

Show More