Google Cloud Storage

Google Cloud Storage is a secure, cloud-based storage service.

The process below explains how to route your streaming Connect data into a Google Cloud Storage bucket.

Setup

Google Cloud Platform Console

  1. Log in to the Google Cloud Platform console.
  2. Create a bucket by following Google's provided process described here.
  3. Create a JSON Formatted Private Key via the UI following the steps described here.
  4. Download the private key and open the file. You will paste the private key in the next step.

    This is an example of a JSON-formatted private key. REDACTED appears where sensitive information would normally appear.

    {
      "type": "service_account",
      "project_id": "REDACTED",
      "private_key_id": "REDACTED",
      "private_key": "-----BEGIN PRIVATE KEY-----\nREDACTED\n-----END PRIVATE KEY-----\n",
      "client_email": "REDACTED@REDACTED.iam.gserviceaccount.com",
      "client_id": "REDACTED",
      "auth_uri": "https://accounts.google.com/o/oauth2/auth",
      "token_uri": "https://accounts.google.com/o/oauth2/token",
      "auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
      "client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/REDACTED%40 REDACTED.iam.gserviceaccount.com"
    }

Dashboard

  1. Open your project from the dashboard, then click Settings and select Connect Integrations.

  2. Under the Connections heading, click Google Cloud Storage.

  3. Configure a new Google Cloud Storage integration:
    • Enter a user-friendly name and description.
    • Enter the Bucket Name for the bucket you created in the Google Cloud Platform setup steps above.
    • Paste the JSON-formatted private key in to the Private key in JSON format field.
      Note

      Once saved, the private key will not appear again. %%ENCRYPTED%% will appear instead. You can still make changes to the private key by pasting the updated JSON text in to the field.

    • Check the box for gzip if you would like your data compressed to save on storage space.

    • Choose one or more event type:

      • Opens
      • Closes
      • Custom Events
      • Screen Viewed
      • Sends
      • Control
      • Tag Changes
      • First Opens
      • Uninstalls
      • Push Bodies
      • Rich Read, Delivery, and Delete Events
      • In-App Message Expiration, Resolution, and Display Events
      • Web Notify Session
      • Web Notify Click disabled
  4. Click the Save button.

Structure and Files

Your bucket's directory structure and files will be named using the following patterns:

JSON
appKey + "/" + integrationId + "/JSON/" + year + "_" + month + "_" + day + "/" + year + "_" + month + "_" + day + "_" + hour + "_" + minute + "_" + second + ".json"

There will be one file generated per hour, assuming a relevant event occurred within that hour.

Note

File size maximum is 15 GB. If the volume of events for an app results in a file exceeding 15 GB, you may instead see multiple files.

Use Cases

Once you have integrated Connect with Google Cloud Storage, your Connect data will be directed into your storage bucket once per hour. From there, how you use the data is up to you, but some potential ideas are:

  • Output files with user-level send and open information, and import these files into your CRM system.

  • Combine output data with Google Big Query to perform detailed analysis of your users.
Tip

Be sure to regularly audit your Connect Google Cloud bucket. Connect outputs large amounts of data, which can lead to expensive Google Cloud bills if not managed appropriately.