{"id":281,"date":"2024-01-25T03:16:32","date_gmt":"2024-01-25T03:16:32","guid":{"rendered":"https:\/\/www.ccsgeo.com\/?p=281"},"modified":"2024-01-25T03:16:32","modified_gmt":"2024-01-25T03:16:32","slug":"open-data-discovery-great-lakes-aquatic-habitat-framework","status":"publish","type":"post","link":"https:\/\/www.ccsgeo.com\/index.php\/2024\/01\/25\/open-data-discovery-great-lakes-aquatic-habitat-framework\/","title":{"rendered":"Open Data Discovery: Great Lakes Aquatic Habitat Framework"},"content":{"rendered":"\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">Exploring the Great Lakes through data.<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">I was perusing Reddit the other day and I came across a post where a user was looking for high quality lake bottom bathymetry for Lake Superior. From some past projects I had done, I remembered that there was an open data site that shared high quality ecological data for the Great Lakes which included DEMs of all of the lake bottoms. The <a href=\"https:\/\/www.glahf.org\/\" data-type=\"link\" data-id=\"https:\/\/www.glahf.org\/\">Great Lakes Aquatic Habitat Framework<\/a> (GLAHF) is more than just an open data repository. It also aims to provide a spatial framework for:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>&#8230;the standardization of geospatial data to a hierarchically nested set of grid cells to be used as building blocks for informing management decisions and developing other spatial products such as aquatic habitat classification, nearshore assessment, and decisions support tools.<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I have not had a chance to explore the framework but more information about it can be found here: <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/www.sciencedirect.com\/science\/article\/abs\/pii\/S0380133015000659?via%3Dihub\">https:\/\/www.sciencedirect.com\/science\/article\/abs\/pii\/S0380133015000659?via%3Dihub<\/a><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Data and Maps<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The GLAHF also provides a number of static map products, a <a href=\"https:\/\/www.glahf.org\/explorer\/\" data-type=\"link\" data-id=\"https:\/\/www.glahf.org\/explorer\/\">custom web application<\/a>, and downloadable data. The static maps built from data available on the site are impressive:<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/glahf.sites.uofmhosting.net\/wp-content\/uploads\/hydrogeoforms.jpg\" alt=\"\"\/><figcaption class=\"wp-element-caption\">Hydrogeoforms of the Great Lakes showing underwater topology. <\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">One of the only downsides is that most of the data appears to be provided via geodatabases. Geodatabases can be used in QGIS via the OpenFileGDB specification but it cannot handle file geodatabase rasters. When researching this, I came across an interesting project on Github called <a href=\"https:\/\/github.com\/r-barnes\/ArcRasterRescue\/blob\/master\/README.md\" data-type=\"link\" data-id=\"https:\/\/github.com\/r-barnes\/ArcRasterRescue\/blob\/master\/README.md\">ArcRasterRescue<\/a> which is designed to get at these rasters. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It is relatively easy to setup ArcRasterRescue to export rasters inside a file geodatabase to geotiffs on Ubuntu. First you can either download the package using git, or the zip file directly from here: <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/github.com\/r-barnes\/ArcRasterRescue\/releases\">https:\/\/github.com\/r-barnes\/ArcRasterRescue\/releases<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Unpack the files to a location of your choice. Then, download the required packages. (Note: I did not try this with Docker but an image appears to be available):<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>$sudo apt install cmake libgdal-dev zlib1g-dev g++<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Once the dependencies are installed, cd into the ArcRasterRescue-1.0.1 folder and run the following: <br><br>~\/ArcRasterRescue-1.0.1$ <strong>cmake -DCMAKE_BUILD_TYPE=RelWithDebInfo<br><\/strong><br>Then run: <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">~\/ArcRasterRescue-1.0.1$ <strong>make<\/strong> <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This should create the arc_raster_rescue.exe file in the ArcRasterRescue-1.0.1 folder:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"722\" height=\"99\" src=\"https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/image-19.png\" alt=\"\" class=\"wp-image-294\" srcset=\"https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/image-19.png 722w, https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/image-19-300x41.png 300w\" sizes=\"auto, (max-width: 722px) 100vw, 722px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Now you can run the program to see which rasters exist within a geodatabase. I ran this against the Lake Superior Bathymetry dataset: <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>$ .\/arc_raster_rescue.exe \/path\/geodatabase.gdb\/ <\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As noted in the README, the path MUST have a slash at the end. <\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"737\" height=\"123\" src=\"https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-23-22-36-06.png\" alt=\"\" class=\"wp-image-307\" srcset=\"https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-23-22-36-06.png 737w, https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-23-22-36-06-300x50.png 300w\" sizes=\"auto, (max-width: 737px) 100vw, 737px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">The program found a single raster with id 0 called bathymetry_superior. Now we can extract it: <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">$ .\/arc_raster_rescue.exe \/path\/bathymetry_superior.gdb\/ 0 \/outputpath\/test.tiff<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"740\" height=\"360\" src=\"https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-23-22-35-16-1.png\" alt=\"\" class=\"wp-image-308\" srcset=\"https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-23-22-35-16-1.png 740w, https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-23-22-35-16-1-300x146.png 300w\" sizes=\"auto, (max-width: 740px) 100vw, 740px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Success! We can now add the .tiff to QGIS as a raster layer. I repeated the same process with the mean ice coverage dataset and exported the 2014 ice coverage layer using ArcRasterRescue: <\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"476\" src=\"https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/image-21-1024x476.png\" alt=\"\" class=\"wp-image-298\" srcset=\"https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/image-21-1024x476.png 1024w, https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/image-21-300x140.png 300w, https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/image-21-768x357.png 768w, https:\/\/www.ccsgeo.com\/wp-content\/uploads\/2024\/01\/image-21.png 1298w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Mean ice coverage (%) for 2014<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">While nothing flashy, this open data source provides a wealth of valuable physical, biological and even socioeconomic data for the Great Lakes. And even if you don&#8217;t have access to ArcGIS, you can use ArcRasterRescue to extract the data that is provided as raster datasets inside file geodatabases. I hope you can use this data to explore one of my favourite geographic features on the planet. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">References: <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/www.glahf.or\">https:\/\/www.glahf.or<\/a>g<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/github.com\/r-barnes\/ArcRasterRescue\/tree\/master\">https:\/\/github.com\/r-barnes\/ArcRasterRescue\/tree\/master<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Exploring the Great Lakes through data. I was perusing Reddit the other day and I came across a post where a user was looking for high quality lake bottom bathymetry for Lake Superior. From some past projects I had done, I remembered that there was an open data site that shared high quality ecological data [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":311,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_crdt_document":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[13,20,15,14,12],"tags":[],"class_list":["post-281","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-foss","category-geography","category-open-data-discovery","category-qgis","category-workflow"],"_links":{"self":[{"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/posts\/281","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/comments?post=281"}],"version-history":[{"count":23,"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/posts\/281\/revisions"}],"predecessor-version":[{"id":312,"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/posts\/281\/revisions\/312"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/media\/311"}],"wp:attachment":[{"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/media?parent=281"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/categories?post=281"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ccsgeo.com\/index.php\/wp-json\/wp\/v2\/tags?post=281"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}