geosolutions-it/dati-ckan-docker

Name: dati-ckan-docker

Owner: GeoSolutions

Description: Support for making ckan plus dcatap_it plugins running under docker

Forked from: italia/dati-ckan-docker

Created: 2017-11-23 10:59:00.0

Updated: 2018-02-09 09:32:34.0

Pushed: 2018-05-07 11:04:05.0

Homepage: null

Size: 12343

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

CKAN Docker based infrastructure

This project provides everything you need to run ckan plus a set of plugins for supporting Italian open data. It has been currently used only in testing environments but we think it can provide a good base for running a production service (please feel free to contribute with pull requests to this end).

Docker containers for ckan + plugin dcat + dcat-ap-it

Container images details:

- Ckan 2.6.2
    Extensions:
    0   "stats"
    1   "text_view"
    2   "image_view"
    3   "recline_view"
    4   "harvest"
    5   "ckan_harvester"
    6   "dcat"
    7   "dcat_rdf_harvester"
    8   "dcat_json_harvester"
    9   "dcat_json_interface"
    10  "dcatapit_pkg"
    11  "dcatapit_org"
    12  "dcatapit_config"
    13  "dcatapit_harvester"

- Solr 6.2.1

- Redis server v=4.0.0 sha=00000000:0 malloc=jemalloc-4.0.3 bits=64 build=77e2b28390619b67

- PostgreSQL 9.6

Follow these steps to run the Docker images:

1. git clone https://github.com/italia/dati-ckan-docker.git
2. cd dati-ckan-docker
3. ./build_local.sh #it will build the images needed by docker-compoose
4. docker-compose up -d # it will run all the needed containers
5. ./init.sh # it will configure the plugins and it will create all the vocabolaries

Then you can open the ckan home http://localhost:5000. The init.sh script creates an admin user with the following credentials: ckanadmin/ckanpassword

CKAN Harvest

http://localhost:5000/harvest

Ckan starts automatically the harvesting function.

You can see logs during harvesting import with following command:

docker logs ckan -f

If there is some error during harvesting you can connect to the docker container, verify if some process are dead and restart the harvesting processes with following commands:

Connect to ckan container and verify the processes:

docker exec -it ckan /bin/bash

Once in the container run:

ps -ef

You need to find both these processes as output of the “ps -ef” command:

/usr/bin/python /usr/local/bin/paster –plugin=ckanext-harvest harvester gather_consumer -c /etc/ckan/default/ckan.ini

/usr/bin/python /usr/local/bin/paster –plugin=ckanext-harvest harvester fetch_consumer -c /etc/ckan/default/ckan.ini

If one of those processes is missing you can restart it with the following commands:

. /usr/lib/ckan/default/bin/activate

Then:

Either

nohup paster –plugin=ckanext-harvest harvester gather_consumer –config /etc/ckan/default/ckan.ini &

Or (you can run both in case both processes are missing)

nohup paster –plugin=ckanext-harvest harvester fetch_consumer –config /etc/ckan/default/ckan.ini &