Friday, December 11, 2015

Raster Analysis for Frac Sand Mining location

Objective

The raster analysis would be the final step into our ongoing semester long project to locate and determine the most suitable locations for Frac sand mines within Trempealeau county. The objectives within the lab was to generate two separate rasters one which was all suitable land for frac sand mining. This first map included parameters such as  land cover, geologic criteria, distance from rail terminals, slope of the area, and needed to included suitable water table depth. The second map was a map generated to look at any potential risk factors in the county. The risks that where being addressed where distances from streams, residential areas, schools, parks and also wanted to make sure the mine would not be on prime farmland. Once both maps were created we then could combine the two datasets to generate a final map showing the most suitable area for a frac sand mine to be located within Trempealeau county.

Methods:

The preliminary steps to the project where to set all of our environmental settings to generate easier outputs. Some of the setting that we set where within the raster analysis and included the extent to be masked by the boundary of the southern half of the county, the cell size to match our lowest resolution raster in this case was about 98. and to set the snipping to our county to process all rasters to this outcome.
Once our initial environments where set we then could start to generate the model used to locate all suitable land.
For each of the parameters we needed to run similar tools. For most we needed to convert the feature to a raster. Then needed to make sure all of the features we would be using where in the same coordinate system to have all of the units the same. This would allow us to run analysis on distance and have common units. If they where not like as in the case for the rail terminals we needed to project them accordingly. I chose to use NAD 1983 Wisconsin state plane meters.
After for most of the features we needed to either change the ranks to our personally determined set of three (3=highly suitable, 2= average, 1= low suitability). Table of all determined ranks can be found in figure 1.  For the others we first needed to run Euclidian distance to determine the bets locations from the features. Once the distance was set we then could reclassify and apply suitable ranks.

Figure 1: Table of ranks for all suitability models ran within the raster analysis


The second map was designed to show high risk areas which would equate to low suitability. All areas addressed were ranks in same order but the criteria was based on risk factors, for example a highly suitable area represented by a 3 in rank would be equivalent to low risk area. This rank system allowed us to add all ranked values when combining both maps. As in the case for the first model the steps for each parameter were very similar. We first needed to generate a raster out of the feature class, then needed to run either a distance or reclassification based on previously determined scale. Both final models can be found in figure 2 and 3.
Keep in mind all of the ranks were determined individually by each student based on our own knowledge and may not be the best rank for each parameter because of these maps are complete opinionated and should not be used as real suitable locations.


Figure 2: suitability model used to determine best location based on land cover parameters. Also includes raster calculation for final best mine locations.
Figure 3: Risk model generated with parameters of high risk areas to keep mines away from. All reclassification where placed for most suitable equating to lowest risk.






Results

After analysis was run on both of the models there was a series of locations generated to show suitable land for the mines to be located. The total raster calculation for both models equated to the bets location being a total of 15 possible points. I then chose to reclassify the maps into three categories to simplify the display. I chose to rank the top three calculation to be most suitable the nest four to be average suitability and the remaining to be low suitability. The first map created (figure 4) displays all suitable areas based on land cover type. the second (figure 5) displays all land cover that is low risk and therefor high suitability. Finally after adding the two raster's together we generated a final map displaying the bets locations for frac sand mines in Trempealeau County (figure 5).

Figure 4: displays the raster output from both of the suitability models displaying the best ranked location as highly suitable in dark brown colors

Figure 5: final map output locating the optimal location for frac sand mines combing the two suitability models. The best locations are displayed in red. followed by average areas in brown and last all other locations in yellow.



Sources
Trempealeau county database
Esri online help
NLCD database
University of Wisconsin Eau Claire

 

 

Thursday, November 19, 2015

Exercise 7 Network Analysis

Background:

In exercise seven we where running a continuation to the original topic we had discussed in exercise five when we looked at the frac sand mining in Wisconsin. Our initial objective for the lab was to locate all of the mines recognized by the WDNR and analyze the overall impact the trucking had on the county roads. Before we could do this we needed to gain some background knowledge to the situation. To obtain this synopsis we where given a recent study conducted that was very similar to our project but specifically located in the Chippewa county of Wisconsin. The study was run by Maria Hart et. al. through the university of Wisconsin Madison. They wanted to find the impact on the transportation roads the trucking had and if the counties would be able to afford the turmoil the constant running of sand would cause. They found that the entire process itself is very demanding on roads for the process requires a lot of water, sand, chemicals, and equipment. Also since most of the mines are located in farm land and generally away from local towns it requires lots of trucking to mine locations. In one of the papers that they had found a conservative estimate of amount of trips could be upwards of 2700 times for one mine fracturing. and if the mine has different oil it can lead to multiple mine fractures (White paper). In total they found that both in bound and out bound truck tons would equate in Chippewa county alone to be about 2.2 million tons. Considering this it is easy to see the implications that amount of weight on the same road over and over could cause a lot of damage. Since the trucks are always taking the shortest route to the rail terminal to off load the product.
Although most of the local governments for Chippewa county and other counties throughout the state have conducted studies to find the most suitable route for the trucks to travel based off of shortest route optimal pavement conditions and other factors the notion that maintenance solely relies on the counties is appalling. Take for example Chippewa county, which has a median income of only 26,000 they are now going to be asked to raise their own taxes to upkeep and repair the roads that is only making profit for most companies that are not even locally based. Income that they may not ever see once it is collected. I hope that through more studies and hypothetical situations as the one we have conducted government agencies will see that they need to step in and regulate and aid these small communities to protect not only their road systems but also there environments as well. 

Methods:

For our own hypothetical exercise we now had the necessary information needed to understand what analysis we where looking for, but our next task was to run the process. We already had our previously placed geocoded mines and where now given the actual mine location but we needed to query out some specific aspects of these mines and mine terminals to run our transportation analysis. Starting we needed to build a python script which could be used to query out and make the feature classes that selected only active mines, all mines that only had mine in type and to remove all mines that where within 1.5 km of a rail terminal. The full script can be found within my stand alone blog post of all python scripts made over the semester. Once the script had successfully run we where able to utilize these newly created feature classes for our network analysis. 
The analysis would be run using ArcMap by placing the mine final mine locations which consisted of all active mines that where fully labeled as mines only and not within 1.5 km of a rail line. This feature class would act as out location in our analysis. We then needed to place all rail terminals in our map and use them as our facilities. However, we only needed the terminals that where rail and rail compatible so we needed to manually query out all other terminals like air and make a separate feature class. Once here we where now ready to run the analysis for the nearest m terminal from each mine. The outcome would be our route needed in our calculations. 
From here we needed to build a model to run our feature classes and calculate our analysis. We built a model that would be able to run all of the features through the analysis and would calculate our own new fields which would show our total mileage of roads travel per county and cost per county. The model (figure 1.1) has a couple of logistics that are worth noting are that in order to calculate mileage and cost we needed to project the map into a useful units. I had chose to use Wisconsin state coordinate system which used feet as the linear units.Next we needed to summarize the counties based on length to determine the total feet traveled in each county. 
The last steps where very quick but essential for figuring out how much each county would hypothetically need to pay in to maintain their roads. We needed to add two fields to our summarized table the first being total miles traveled hypothetically saying each truck would travel 100 round trip times in a year. The last was a cost per county field which multiplied the amount traveled by .022 which was the hypothetical amount said it would cost per mile traveled. 
Figure 1.1: Model used to generate final table showing cost in US dollars each county would need to pay to maintain there roads. 
The final table that was generated from the map and then displayed within my results is as follows.
Final table generated form the model that shows the total length of road traveled in miles and cost per county in US dollars.

Results:

The results of the study where very intriguing for I would have imagined that the mines would have effected more counties within Wisconsin after visually seeing the extent that the frac sand is located in the state. The results that I had generated although completely hypothetical showed that the two counties most greatly effected by trucking of material for mining where Chippewa county and Wood county. Both would need more than 300 dollars per year greatly differing from the other counties of Wisconsin. The graph below (figure 1.2) shows the full results in form of dollar values. One aspect that needs to be considered when looking at these results where the routes of the trucking. As figure 1.3 shows in some cases the mines needed to truck a long distance and even in some cases across counties boundaries to reach a rail terminal. It is this fact that in my opinion leads to many issues within governmental cost, for how do counties determine how needs to cover the cost of the destruction if the mine is in one county but the terminal unfortunately is in another. This hopefully can be solved peacefully or can eventually be subsidized by federal agencies. 
Figure 1.2: showing the total cost per each county effected by trucking of frac sand in Wisconsin.

Figure 1.3: shows a graduated scale of the counties cost and the routes taken by the trucking throughout the state of Wisconsin. All numbers for cost are hypothetical and do not represent true values.  

Conclusion:

In the end although the numbers where completely hypothetical this project was very eye opening to a real life problem that is occurring as we are running these tests. This lab was very helpful to not only gain a better understanding of the programs Arc offers but to also see how scientist are utilizing these exact methods in the field to solve a real world issue. After completing the exercise I now have gained a better understanding for some of the programs but also have a deeper compassion for searching for solutions to such issues that effect me as a Wisconsinite. It is issues like these that will directly effect my taxes and infrastructures within this beautiful state I love. I only can hope that soon more people will run similar test with true data to display to multiple federal agencies and finally gain support for maintenance of our important roadways. 


sources:
ESRI geodataset
University of Wisconsin Eau Claire Geography Department
National Center for Freight and Infrastructure research and education White Paper : Maria Hart et al. UW Madison

Thursday, November 12, 2015

Raster Maps created from Pythin script

After completing the Python script we where then able to utilize our three DEM's that have been produced. The maps where representations of three different raster's including, elevation, vegetation, and boundary data. (figure 1.1). We also where tasked with finding and displaying metadata form each of the sources that we collected the original zip file. With the metadata we where to place them in a table to show lineage, scale, and accuracy of the data and attributes. (figure 1.2)



Figure 1.1: shows the county boundaries in Wisconsin highlighting Trempealeau county in red and the three clipped raster's.



Metadata from the sources of all maps collected

Exercise 6: Geocoding and normalization of data

Goal:

The goal of this project was to illustrate to our class the difficulties that can arise when trying to normalize data that is collaborated form outside sources. It was also designed to show how challenging geocoding can be depending on the information provided in the data set. For the assignment we where tasked to normalize a set of mine addresses given to us through a Wisconsin DNR dataset. The original dataset had come to us in a way where we needed to extract key features from the dataset like the mine unique id field, the mine name, and any information given about the address. In some cases it was a street address other times it was only stated using the PLSS form of surveying. In either case we found that we needed to put a lot of effort into keeping consistent extraction into our own designed tables (figure 1.1 will show the normalized table). Once normalized we could then create a shape file which could later be used to geocode to the actual location. Finally we then needed to compare our results to our classmates to see how much variation occurred.

Methods:

To start the assignment we first needed to normalize the data. For most of us we decided to use a similar format as the one shown to us in the demonstration by Dr. Hupy. We where also advised to create a separate column for the PLSS address making it easier to find and be able to portray that information if needed. We then needed to manually go through each unique mine id and find all of the mines that had been assigned to us with a code. Once acquired we just needed to type in all information provided to our table and complete the table. The final product is shown below.
Figure 1.1: normalized table of the 21 mine sites given to me to geocode from the WDNR table

After we then could extract our table into Arcmap to produce a shape file. With this shape file now imported into Arcmap we then needed to geocode all of the addresses. To accomplish this we first needed to open our geocoding toolbar. From there we could process our table. With the original process I received 14 matches one tie and 6 unmatched. Now although this seems like a good start I was quick to find out this was not the case. From here we needed to use a lot of mental skill and tools to find the actual mine. To start I first went to all of the mines that did not match and needed to place a location of the mine. I used the PLSS finder and a imagery base map to find the locations I thought where the mine sites. To accomplish this I would enter all of the PLSS information into the database and then get an idea of where the location may be. After by overlaying the PLSS quarter quarter sections onto my map over the imagery I was able to get within the area of the mine and visually look for the location to match an address. Although this only solved the issues for the unmatched mines. I then went back through all of the mines to make sure the where properly placed. I found that 15 of my 21 mines where not in the right location and needed to be manually moved in the same process.

After the geocoding was completed I then could extract my properly placed points into a shared file for all of our classmates to use.

For the next objective we where then asked to compare our results to two things. We where asked to find the variation between groups to see how much our mine sites varied and we where also to compare how far off our personally placed mines where to the actual mines. I had found the distance variation between groups and between my own mines and the actual using a couple of steps. First I needed to query out all mines that where not applicable to the situation and queried all mines that had the same mine id as my own mines. With the new selected feature class I was able to then project both sets into UTM to make sure the units where in meters and run a near tool to find the distance from each map to the nearest mine between groups and mine in one data frame and between the actual site and my own in another data frame.

Results:

After running the queries and the near tools the results where shocking. I had found that only a few of my mine location had been close to my classmates groups by distance of meters. However, majority of them where significantly off. This was perplexing to me since we where all given the same datset and yet we where that far off in our findings. For the second near table I was a little closer I had majority of my mines near the actual mine, however, there was about 7 mines that I was not even within the right ball park of correct location. I am not sure as to why this may be the case, might have to do with outdated bsaemap or with improper data normalizing. Either way the results are shown below in figure 1.2-1.4.



Figure 1.2: location of my maps in comparison to the other three classmates with the same location geocoded.
Figure 1.3: near table tool showing the closest mine synced with distance away in meters
Figure 1.3: comparison of actual miens to my personally geocoded mines

Figure 1.4: displaying the distance from my mine locations to the actual mine in meters.



 Discussion/Conclusion:

This lab was very helpful to my skills in GIS I was bale to witness first hand the complications that can arise from improperly entered data, and how normalization of a dataset can be key to display of data and geocoding in future applications. Since you are not always given consistent data or data that is complete this lab is a great representation of real world issues that can arise in a job, field work. It developed and introduced all of us to the skills we will need and the mind set we need to have when setting up data collection to save from future headaches of normalizing.
There was a few errors that had arises throughout this activity that are worth noting. First was the inherent error that is very relevant to this lab. If the person who had collected the data would have used more domains and subtypes along with creating a few more columns for some of the information the data would not have needed to be normalized to the extent that it was by us. Also With the class being trained through a demo on how to normalize and some tips on how to arrange the data you can say there was some gross error involved later on when some groups didn't have a mine unique value and the data needed to be manipulated to be compared in the near tool.

I would have to say if we where asked to achieve a hundred percent accuracy with this data and be hundred percent consistent between our classmates placement we would have needed to communicate and agree on a standard way of normalization of data along with acquiring a more consistent and completed data set that would have provided better location for the actual mine site.

Altogether the activity was very useful and helpful in understanding all of the complications that can arise from data normalization and inherent error. I also enjoyed being able to work with other classmates to see how each person can have a different view on the same task. I always appreciate seeing the work of fellow peers for it allows me to asses my own efforts and skills and see what I need to improve on and what I can capitalize on and help others improve in their own skills.

Python Scripts

Script 1:

For the first python script that we ran we where tasked to design a script to clip our Trempealeau county Wisconsin area with three different raster models. The script that we where to design was made by importing arcpy and all environments into PyScripter for Python 3.2. After the environments where in we then needed to establish a list of all the three TIF raster's that we where using. Once we have produced a list of raster's we then needed to create a for loop for the raster's so all three of the raster's we had downloaded , including the DEM from USGS, the NLCD, and the NASS, it was these three raster's that we wanted to run through our clip. By creating this for loop we then could write a code for the raster's to run through a projection getting all of them to be projected into the same coordinate system which was NAD 1983 HARN Wis Trempealeau county. By projecting all three raster's in this projection it allows for minimal distortion and can display all mines in the appropriate location. Once they where in the proper projection we then could run a clip for the raster to only give us a print out of the county we were interested in, last we then extracted the new clipped map to our geo-database and could use the new maps to display our mining areas. The full script that was created is in figure 1.1.

Figure 1.1: Python script for exercise five, script is a representation of how to use a list and for loop to run a clip function on Trempealeau county Wisconsin

Python Script II (selecting active mines for analysis):

The second python script we where tasked to design was a script for selecting and narrowing our total mines in Wisconsin. The script was aimed to select out all mines that where a)active mines (currently in use), b) where all mines that where completely a mine ( not a processing plant or loading station), and c) all mines that where not adjacent to a rail line. Last we needed to write a code that excluded all of the mines that could be found within one and a half kilometers of a rail line. By querying out these three selection we where able to make a complete feature class that would later be used in our data analysis for calculating the total impact on the county road systems that the truckers from the mine to the rail station where causing.
Figure 1.1: displays the python script used to query out all mines needed in exercise 7






Monday, October 19, 2015

Frac Sand Mining in Wisconsin Overview

Frac Sand Mining Overview

Wisconsin has always been known for a few things like cheese production, cold winters, and the famous Packer football team. However, a long standing tradition that dates back about a hundred years that goes unnoticed is sand mining. Sand mining in Wisconsin has been one of this states past times, specifically the mining of frac sand which is a rare quartz sand used in new modern mining techniques. This so called " frac sand" has now become so useful in mining all over the country that production of frac sand mining has increased significantly and as seen in figure 1.1 it is most abundantly found in the south western region of Wisconsin.

Figure 1.1: shows best locations across the central areas of the US that hold the best frac sand deposits shown in red.
With new advances in the mining industry like horizontal mining a process in which one can now turn the pipe and drill parallel to the ground allowing us to reach a desired depth and then drill sideways keeping in the hot zone for the material to be extracted. The other process that was adapted with horizontal drilling was fracking. Fracking is a process that requires a few key components being, the drill crew, water air pressure and frac sand. Once the crew has reached its target material which can be oil, natural gas, or other material they then can drill horizontal and start fracking. Fracking is carried out with a constant flow of a mix of water and silica sand ( frac sand) being pumped into the ground causing shoots off the pipes in multiple directions like a spider web reaching out from one wall to the next. These shoots allow for more material to be reached with less pipes and effort needed to go into production. This new high tech method of drilling is revolutionizing our ability to obtain precious resources. However, with every upside to an equation there needs to be a opposing view. With such a high concentration of sand being located in the south west region of Wisconsin it has caused a lot of companies to start tapping into every variable area for mining sand. With the sand being rare but in high demand it has started an almost gold rush like mind set for many people seeking a high pay out.

Figure 1.2 shows silica sand mining areas (red) and locations of silica sand , frac sand, (yellow).

Although with any upside to a story there is always the oposition. With the dollar signs glowing in the miners eyes there is always concerns in the eyes of people who are living in theses mining areas. A few of the concerns that have been raised over the years are, cancer gain due to inhaling air, water quality issues with run off, and loss of critical habitat to mining areas. Each of these key opposing views holds a strong defense with the continuous mining in these specific areas science has shown an increase in cancerous causing air quality from breathing in sand fragments for a long period of time. They have also shown that the run off from the mines and mining processes of filtration have contaminated local water systems. Last when the mines are done being used or abandoned not much has been done to restore the large areas that have been completely altered from there original fauna. With each issue there are copious answers to how to fix them, but the question is what way will people follow and what is the best practice to fix the issue quickly inexpensively.

It is this question that is driving a large number of new and innovation geographers to jobs. The new spatial techniques that have been invented in the last decade have allowed for communities to not only track air quality, water issues, and restoration but now allows them to display them spatially over a time scale to show past, present and potential future areas. Hopefully through legislation, local and state government, and passionate field workers we will be able to utilize this great gift of silica sand in Wisconsin to bring stronger more sustainable communities that can work together in harmony extracting this rare and useful resource.





Sources:
http://www.wqow.com/story/28183900/2015/02/24/public-will-have-chance-to-share-questions-concerns-about-frac-sand
http://dnr.wi.gov/topic/Mines/Deposit.html
http://dnr.wi.gov/topic/Mines/documents/SilicaSandMiningFinal.pdf