unicef/download_admin_shapefiles_and_import_geojson_to_elasticsearch

Name: download_admin_shapefiles_and_import_geojson_to_elasticsearch

Owner: unicef

Description: MagicBox

Created: 2016-09-13 16:23:26.0

Updated: 2017-08-16 20:24:20.0

Pushed: 2017-04-11 02:59:52.0

Homepage: null

Size: 64

Language: JavaScript

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

Get shapefiles for all countries, store geojson in ElasticSearch

• This is a component of MagicBox
• Requires the GDAL - Geospatial Data Abstraction Library to convert shapefile to geojson
  • (On Mac OSX: brew install gdal)
  • Ubuntu

What it does

app.js

• Downloads gadm series 2.8 zipped shapefiles for each country.
• Unzips them
• Creates geojson files

import_admins_elasticsearch.js

• Imports admins to ElasticSearch

Run

node app.js

Import admins to ElasticSearch (For aggegating mobility by airport to admin)

• ElasticSearch must be installed curl -XDELETE localhost:9200/admins

`curl -XPOST localhost:9200/admins -d '{ “mappings”: {

"admin": {
  "properties": {
    "geometry": {
      "type": "geo_shape"
    },
    "ISO": {
      "type": "string"
    },
    "admin_level": {
      "type": "integer"
    },
    "admin_id": {
      "type": "string"
    },
    "pub_src": {
      "type": "string"
    }
  }
}

} }' `

Trouble with Canada and Australia

rm ./data/gadm2-8/CAN* ogr2ogr -f GeoJSON data/gadm2-8/CAN_2.geojson data/unzipped/CAN/CAN_adm2.shp ogr2ogr -f GeoJSON data/gadm2-8/CAN_1.geojson data/unzipped/CAN/CAN_adm1.shp rm ./data/gadm2-8/AUS_2.geojson ogr2ogr -f GeoJSON data/gadm2-8/AUS_2.geojson data/unzipped/AUS/AUS_adm2.shp

Run

nohup node import_admins_elasticsearch.js -d gadm2-8> nohup1.out 2>&1&

• To import a different admin set, add new directory with geojson in data directory node import_admins_elasticsearch.js -d santiblanko, for instance

Admin meta info Unique ID:

GADM 0 features: ID_0
GADM 1 features: ID_0, ID_1.
GADM 2, also has ID_0, ID_1, ID_2.
For unique id : country_ISO-ID_0-ID_1-ID_2-admin_name.downcased

Shapefile sources:

• GADM 2.8
• Colombia: github
• ogr2ogr -f GeoJSON -t_srs crs:84 COL_2.geojson mpio.shp
• Decided to replace GADM Colombia admins 1&2 with depto.shp(1) and mpio.shp(2)
  • ID_0: 53 (from GADM Colombia ID_0)
  • ID_1: properties.DPTO
  • ID_2: properties.WCOLGEN02_