Title Page Copyright and Credits Mastering Geospatial Analysis with Python Packt Upsell Why subscribe? PacktPub.com Contributors About the authors About the reviewer Packt is searching for authors like you Preface Who this book is for What this book covers To get the most out of this book Download the example code files Download the color images Conventions used Get in touch Reviews Package Installation and Management Introducing Anaconda Installing Python using Anaconda Running a Jupyter Notebook Running a Notebook Creating a new Notebook Adding code Managing Python packages Managing packages with Anaconda Navigator Online searching for packages using Anaconda Cloud Managing Python packages with conda Managing Python packages using pip Upgrading and uninstalling the package with pip Python virtual environments Virtual environments using Anaconda Managing environments with conda  Virtual environments using virtualenv Summary Introduction to Geospatial Code Libraries Geospatial Data Abstraction Library (GDAL) and the OGR Simple Features Library Installing GDAL Installing GDAL using Anaconda3 Installing GDAL using conda Installing GDAL using pip Installing a second GDAL version using pip Other recommended GDAL resources GEOS Installing GEOS Shapely Installing Shapely Fiona Installing Fiona Python shapefile library (pyshp) Installing pyshp pyproj Installing pyproj Rasterio Rasterio dependencies Installation of Rasterio GeoPandas GeoPandas installation GeoPandas dependencies How it all works together Summary Introduction to Geospatial Databases Installing PostgreSQL and PostGIS on Windows Installing PostgreSQL and PostGIS on Mac Working with PostgreSQL and PostGIS using Python Connecting to PostgreSQL using psycopg2 Installing psycopg2 Connecting to the database and creating a table Adding data to the table Shapely Querying the data Changing the CRS Buffer Distance and near Lines in the database Length of a line Intersecting lines Polygons in the database Point in polygon Summary Data Types, Storage, and Conversion Raster and vector data Shapefiles GeoJSON KML GeoPackage Raster data formats Reading and writing vector data with GeoPandas Reading and writing vector data with OGR Reading and writing raster data with Rasterio Reading and writing raster data using GDAL Summary Vector Data Analysis OGR Simple Features Library OGR batch commands ogrmerge The OGR library and Python bindings OGR's main modules and classes Creating polygon geometry with OGR Creating polygon geometry from GeoJSON Basic geometric operations Writing polygon data to a newly created shapefile Using a spatial filter to select features Shapely and Fiona Shapely objects and classes Shapely methods for geospatial analysis Fiona's data model Creating geometries with Shapely Applying geometrical methods with Shapely Reading JSON geometries with Shapely Reading data with Fiona Accessing vector geometry in shapefiles using Shapely and Fiona GeoPandas Geospatial analysis with GeoPandas Selecting and plotting geometry data with GeoPandas and Matplotlib Mapping wildfire data with GeoPandas Why data inspection matters Summary Raster Data Processing Raster operations using GDAL Using the GDAL library to load and query rasters Using GDAL to create rasters Raster operations using PostgreSQL Loading rasters into PostgreSQL Performing queries on rasters using PostgreSQL Querying raster metadata Queries returning geometry Queries returning values Summary Geoprocessing with Geodatabases A crime dashboard Building a crime database Creating the tables Populating the data Mapping queries Incidents by date Incidents in a polygon Buffers Nearest neighbor Interactive widgets Charts Triggers Summary Automating QGIS Analysis Working in the Python console Loading layers Processing a layer Layer properties Feature properties Drawing a layer from PostGIS Drawing points Drawing polygons from PostGIS Adding, editing, and deleting features Adding features to an existing layer Deleting features from an existing layer Editing features from an existing layer Selecting features using expressions Using toolboxes in Python Writing custom toolboxes Summary ArcGIS API for Python and ArcGIS Online Introducing the ArcGIS API for Python and ArcGIS Online A Pythonic web API Installing the API Testing the API Troubleshooting Authenticating your Esri user accounts Different Esri user accounts Different modules of the ArcGIS API for Python Exercise 1 – importing the API and using the map widget Creating a personalized ArcGIS Online account Exercise 2 – searching, displaying, and describing geospatial content Exercise 3 – working with raster data and the API's geoprocessing functions Summary Geoprocessing with a GPU Database Cloud geodatabase solutions Big data processing MapD architecture Cloud versus local versus combined Creating a MapD instance in the cloud Finding the AMI Opening an AWS account Creating a key pair Launching an instance Picking a version Searching for an instance Setting up a security group Immerse environment Logging in to Immerse Default dashboards NYC taxi dataset Importing a CSV Creating a chart Selections with the SQL EDITOR Use geospatial data Connecting to the database using a terminal PuTTYgen Connection configuration Using the private key Installing pymapd The conda install command The pip install command Creating a connection User and password Data cursor Creating a table Insert statements Using Apache Arrow to load data Contains queries Other available spatial SQL commands Summary Flask and GeoAlchemy2 Flask and its component modules Setup Installing modules using pip Installing Flask using pip Installing Flask-SQLAlchemy via pip Installing GeoAlchemy2 using pip Installing Flask-WTForms and WTForms using pip Installing psycopg2 using pip Installing SQLAlchemy-Utils using pip Installing pyshapefile (or pyshp) using pip Installing pygeoif using pip Writing a Flask application Downloading the data from a data source County, district, state, and arena shapefiles Creating the database and data tables Adding the PostGIS extension tables to the new database Defining the database tables The declarative base Database table model classes  Table properties Creating the tables Inserting data into the new data tables Importing the required modules Locating and reading the shapefiles Accessing shapefile data Using queries Components of the Flask application Folder structure and the controller object Models Forms Views Dissecting the view Using forms Evaluating the request method POST requests Spatial queries Relationship query The web map template Running the web application locally Summary GeoDjango Installing and configuring Django and GeoDjango Steps from Django to GeoDjango Installing Django Installing PostGIS and psycopg2 Creating the database GDAL/OGR Modifying Windows environment variables Creating a project and application Command-line argument – startproject What is created by startproject? Creating an application using manage.py What is created by manage.py Configuring settings.py Adding a new database connection Adding new installed apps Creating the application manage.py Generating data models Multipolygons  Database migrations makemigrations  sqlmigrate migrate LayerMapping Running the layer mapping  Administrative panel GeoDjango administrative panel admin.py createsuperuser runserver URLs URL patterns Views Required folders and files forms.py templates folder Writing views index view queryarena function arena view Running the application Summary Geospatial REST API Writing a REST API in Python REST JSON Python for REST API Flask REST modules Other frameworks Variables in Flask URLs Number converters Other data converters Request methods GET POST Other available request methods PUT DELETE The REST API application Application components Application folder and file structure app.py __init__.py The database models.py Importing required modules Declaring the session Declaring the models forms.py views.py Importing modules Base URL Arenas Getting all arenas Getting arenas by ID Getting arenas by name A geospatial query States Getting all states Getting a state by ID Getting a state by name Getting arenas by state Counties Getting a county by ID Getting a county by name Districts Getting all districts Getting a district by ID Getting a district by name API POST endpoints   New arenas The view function The addarena.html head The addarena.html script The addarena.html form Sending a POST request using the requests library Deleting an arena Running the REST API locally Deploying Flask to IIS Flask and web servers WSGI Installing the WFastCGI module and FastCGI Configuring FastCGI Root server settings and Environment Variables Summary Cloud Geodatabase Analysis and Visualization How to install CARTOframes Additional resources Jupyter Notebooks The CARTO API key Package dependencies The CARTO Data Observatory Signing up for a CARTO account A free trial of CARTO Adding a dataset The API key Adding a dataset Virtual environments Installing virtualenv Running virtualenv Activating the virtual environment Installing modules in virtualenv Modules to use Using Jupyter Notebook Connecting to an account Saving credentials Accessing a dataset Selecting individual rows Loading a CSV dataset Loading a shapefile Installing GeoPandas Writing to CARTO Loading CSV with geometry Geospatial analysis Editing and updating datasets overwrite=True Creating a map Summary Automating Cloud Cartography All things cartographic How to integrate Mapbox into your GIS  Mapbox tools MapboxGL.js Mapbox Python SDK Installing the Python SDK Getting started with Mapbox Signing up for a Mapbox account Creating an API token Adding data to a Mapbox account Tilesets Datasets Example – uploading a GeoJSON dataset Example – uploading data as a tileset Mapbox Studio Customizing a basemap Adding a tileset Virtual environment Installing MapboxGL – Jupyter Installing Jupyter Notebooks Installing Pandas and GeoPandas Using the Jupyter Notebook server Importing data using GeoPandas Creating point data from polygons Data cleanup  Saving the points as GeoJSON Adding the points to a map Creating a graduated color visualization Automatically setting colors, sizes, and breaks Creating a choropleth map Saving the map Creating a heat map Uploading data using the Mapbox Python SDK Creating the dataset Loading the data into the dataset Reading data from a dataset Deleting a row Summary Python Geoprocessing with Hadoop What is Hadoop? Installing the Hadoop framework Installing Linux Installing Docker Install Hortonworks Hadoop basics Connecting via Secure Shell Ambari Esri GIS tools for Hadoop HDFS and Hive in Python Summary Other Books You May Enjoy Leave a review - let other readers know what you think
Mastering Geospatial Analysis with Python
Published by
Packt Publishing, 2018