AUTHOR

Jake Ross

Cloud

Refers to architectural components that live in the cloud. Currently the cloud provider is Google Cloud.

Web Portal

The web portal is a wordpress site host on GCP. It provides the public landing page for the WDI project. It should include basic information about the project, a link to the CKAN and links to a list of apps. The apps are built on top of the services WDI provides. The two classes of services being consider currently are CKAN and SensorThings

Apps

What kind of apps? Example?

See DemoApp. The DemoApp may or may not be used in production. We hope that building apps will be both an internal and external process. By simply exposing the data in a standard schema and service we hope others will being to build new apps or incorporate the data in existing apps.

As this project scales up a management app will be necessary. Some basic features

1. dashboard

   1. shows current activity of the services. what is running?

   2. Links to GCP

2. ETL

   1. shows active etl processes

   2. allows management of the etl cluster.

      1. the etl process will potentially to run continuously and automatically

      2. on demand etl of datasets needs to be facilitated

3. sensorthings management

   1. delete locations/things/datastreams

   2. single/batch edits

API Management

What service performs this API proxy ? To where? Use case (i.e. customer goes to /my/dataset and redirects to agency X at /our/dataset ) etc..

Apigee is being consider to handle API management. The api management layer provides many benefits. in addition to controlling access to the underlying api’s it can be used to marshaling the data from the underlying api’s.

Backend APIs

Agency

Data Collection

Data Storage