Earthquake

Start of a project to bring in information from a website with an Application Programming Interface (API). We are going to use a modified version of "Project: Fetching Current Weather Data" from "Automate the boring stuff with Python" by Al Sweigart

What is going on below?

We import libraries to dela with json, reuest from the server and the pandas library.

In [1]:

import json, requests
import pandas as pd
from pandas import json_normalize

In this section we creating a string made up of the URL.

Requesting the information from the site with the URL we created and pass back the information. Data comes from the US Geological survey https://www.usgs.gov/about/about-us/who-we-are and one of their earthquake feeds.

Then print out what was returned.

In [2]:

url='https://earthquake.usgs.gov/earthquakes/feed/v1.0/summary/all_hour.geojson'
response= requests.get(url)
response.raise_for_status()

Now we need load the data which is in JSON form into a Python version.

The data coming from the website as many levels we need to convert the lists into a form we can use ie. normalise/normalize it https://pandas.pydata.org/pandas-docs/version/1.2.0/reference/api/pandas.json_normalize.html

In [3]:

quakeData = json.loads(response.text)
df = json_normalize(quakeData['features'])

Plots some maps

To do the map plotting we need to add four new modules

plotly https://plotly.com/python/ geopandas https://geopandas.org/en/stable/getting_started/introduction.html shapely https://isbe.bwk.tue.nl/education/Python/04_02_Shapely.html folium mapclassify https://towardsdatascience.com/data-101s-spatial-visualizations-and-analysis-in-python-with-folium-39730da2adf

In [4]:

!pip install plotly
!pip install geopandas
!pip install shapely
!pip install folium mapclassify

Requirement already satisfied: plotly in /opt/conda/lib/python3.10/site-packages (5.11.0)
Requirement already satisfied: tenacity>=6.2.0 in /opt/conda/lib/python3.10/site-packages (from plotly) (8.1.0)
Requirement already satisfied: geopandas in /opt/conda/lib/python3.10/site-packages (0.12.2)
Requirement already satisfied: shapely>=1.7 in /opt/conda/lib/python3.10/site-packages (from geopandas) (2.0.0)
Requirement already satisfied: pyproj>=2.6.1.post1 in /opt/conda/lib/python3.10/site-packages (from geopandas) (3.4.1)
Requirement already satisfied: pandas>=1.0.0 in /opt/conda/lib/python3.10/site-packages (from geopandas) (1.4.3)
Requirement already satisfied: fiona>=1.8 in /opt/conda/lib/python3.10/site-packages (from geopandas) (1.8.22)
Requirement already satisfied: packaging in /opt/conda/lib/python3.10/site-packages (from geopandas) (21.3)
Requirement already satisfied: attrs>=17 in /opt/conda/lib/python3.10/site-packages (from fiona>=1.8->geopandas) (22.1.0)
Requirement already satisfied: cligj>=0.5 in /opt/conda/lib/python3.10/site-packages (from fiona>=1.8->geopandas) (0.7.2)
Requirement already satisfied: munch in /opt/conda/lib/python3.10/site-packages (from fiona>=1.8->geopandas) (2.5.0)
Requirement already satisfied: six>=1.7 in /opt/conda/lib/python3.10/site-packages (from fiona>=1.8->geopandas) (1.16.0)
Requirement already satisfied: click-plugins>=1.0 in /opt/conda/lib/python3.10/site-packages (from fiona>=1.8->geopandas) (1.1.1)
Requirement already satisfied: certifi in /opt/conda/lib/python3.10/site-packages (from fiona>=1.8->geopandas) (2022.6.15)
Requirement already satisfied: setuptools in /opt/conda/lib/python3.10/site-packages (from fiona>=1.8->geopandas) (64.0.3)
Requirement already satisfied: click>=4.0 in /opt/conda/lib/python3.10/site-packages (from fiona>=1.8->geopandas) (8.1.3)
Requirement already satisfied: python-dateutil>=2.8.1 in /opt/conda/lib/python3.10/site-packages (from pandas>=1.0.0->geopandas) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /opt/conda/lib/python3.10/site-packages (from pandas>=1.0.0->geopandas) (2022.2)
Requirement already satisfied: numpy>=1.21.0 in /opt/conda/lib/python3.10/site-packages (from pandas>=1.0.0->geopandas) (1.23.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /opt/conda/lib/python3.10/site-packages (from packaging->geopandas) (3.0.9)
Requirement already satisfied: shapely in /opt/conda/lib/python3.10/site-packages (2.0.0)
Requirement already satisfied: numpy>=1.14 in /opt/conda/lib/python3.10/site-packages (from shapely) (1.23.1)
Requirement already satisfied: folium in /opt/conda/lib/python3.10/site-packages (0.14.0)
Requirement already satisfied: mapclassify in /opt/conda/lib/python3.10/site-packages (2.4.3)
Requirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (from folium) (1.23.1)
Requirement already satisfied: jinja2>=2.9 in /opt/conda/lib/python3.10/site-packages (from folium) (3.1.2)
Requirement already satisfied: branca>=0.6.0 in /opt/conda/lib/python3.10/site-packages (from folium) (0.6.0)
Requirement already satisfied: requests in /opt/conda/lib/python3.10/site-packages (from folium) (2.28.1)
Requirement already satisfied: pandas>=1.0 in /opt/conda/lib/python3.10/site-packages (from mapclassify) (1.4.3)
Requirement already satisfied: scikit-learn in /opt/conda/lib/python3.10/site-packages (from mapclassify) (1.1.2)
Requirement already satisfied: scipy>=1.0 in /opt/conda/lib/python3.10/site-packages (from mapclassify) (1.9.0)
Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from mapclassify) (2.8.8)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from jinja2>=2.9->folium) (2.1.1)
Requirement already satisfied: python-dateutil>=2.8.1 in /opt/conda/lib/python3.10/site-packages (from pandas>=1.0->mapclassify) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /opt/conda/lib/python3.10/site-packages (from pandas>=1.0->mapclassify) (2022.2)
Requirement already satisfied: charset-normalizer<3,>=2 in /opt/conda/lib/python3.10/site-packages (from requests->folium) (2.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /opt/conda/lib/python3.10/site-packages (from requests->folium) (1.26.11)
Requirement already satisfied: idna<4,>=2.5 in /opt/conda/lib/python3.10/site-packages (from requests->folium) (3.3)
Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/lib/python3.10/site-packages (from requests->folium) (2022.6.15)
Requirement already satisfied: threadpoolctl>=2.0.0 in /opt/conda/lib/python3.10/site-packages (from scikit-learn->mapclassify) (3.1.0)
Requirement already satisfied: joblib>=1.0.0 in /opt/conda/lib/python3.10/site-packages (from scikit-learn->mapclassify) (1.1.0)
Requirement already satisfied: six>=1.5 in /opt/conda/lib/python3.10/site-packages (from python-dateutil>=2.8.1->pandas>=1.0->mapclassify) (1.16.0)

What is happening here

Quick overview but would benefit from greater detail

1. Importing the ability to create points and also the new modified form of DataFrame GeoDataFrame with a DataFrame with the added ability to define shapes
2. The returned data has the co-ordinates as a list of three numbers. For ease the co-ordinates are converted from the list individually and the longitude and latitude are given their own columns in the DataFrame.
3. Now we can use the longitude and latitude to makes a plot on points.

In [5]:

from shapely.geometry import Point
from geopandas import GeoDataFrame

longitude_df=[]
latitude_df=[]
#dfg=df.get('geometry.coordinates')
df['lon'] = pd.DataFrame(df['geometry.coordinates'].tolist())[0]
df['lat'] = pd.DataFrame(df['geometry.coordinates'].tolist())[1]
geometry = [Point(xy) for xy in zip(df.lon, df.lat)]
df = df.drop(['lon', 'lat'], axis=1)
gdf = GeoDataFrame(df, crs="EPSG:4326", geometry=geometry)

In [6]:

gdf.plot("properties.mag", legend=True) 

Out[6]:

<AxesSubplot:>

Pretty pictures time!

1. First one is just placing points on a graph based on longitude and latitude
2. Second does same put combines it with an interactive map

The graph above is an interactive map so may be some issues displaying them in a PDF initialling. If you save it as a HTML file it is there.

In [7]:

gdf.explore("properties.mag", legend=True) 

Extract of the map

All views are the authors and do not reflect the views of any organisations the author is associated with. Twitter: @scottturneruon