Data Streaming

Data Streaming gives you the autonomy to configure your streaming services by yourself. With Data Streaming terabytes of data can be continuously captured and sent so that you can base your business decisions on dynamically updated information.

The Data Streaming screen lists your Delivery Streams in cards that display the following information:

  • Delivery Stream name;

  • Whether it is active or inactive;

  • Destination: the destination of the delivery stream (Datadog or AWS S3);

  • Creation Date: date you first configured the delivery stream.

  • By enabling the export of traces to AWS S3 or Datadog, there may be an increase in the charges for these services, which is not related to Sensedia.

  • Activation/deactivation of Data Streaming may take up to 15 minutes.

Configuring a new delivery stream

You have two destination options for the delivery stream:

Datadog

To create a new delivery stream with Datadog as destination, follow the steps below:

If you prefer, follow the steps on video.

  1. Access Data Streaming from the left menu or click the card located on your Analytics home screen.

  2. Click + NEW DELIVERY STREAM.

  3. Complete the fields:

    • Destination: Select Datadog;

    • Delivery stream name: Define a name for the delivery stream. Do not use spaces or special characters;

    • Site: Select the Datadog site to which your metrics and traces will be sent;

    • API key: Enter your API key. This information can be found in Datadog under Organization Settings  API Keys.

  4. Click ACTIVATE to confirm activation of the Delivery stream.

To export traces to Datadog, you will need the APM Host license. For more information, see the Datadog billing model.

animation showing steps to create data streaming to datadog

AWS S3

To create a new delivery stream with AWS S3 as destination, follow the steps below:

If you prefer, follow the steps on video.

  1. Access Data Streaming from the left menu or click the card located on your Analytics home screen.

  2. Click + NEW DELIVERY STREAM.

  3. Complete the fields:

    • Destination: Select AWS S3;

    • Delivery stream name: Define a name for the delivery stream. Do not use spaces or special characters;

    • AWS Region: Select the region where your AWS S3 is hosted;

    • Bucket name: Enter an AWS S3 bucket to which the data streams will be sent. You must be the owner of this bucket in order to have the required permissions to use it as destination;

    • Key: Enter the access key ID for your resource;

      The access key you enter must have at least writing permission on the AWS S3 bucket (PutObject) specified when creating the Data Streaming.

    • Secret: Enter the secret access key.

  4. Click ACTIVATE to confirm activation of the Delivery stream.

animation showing steps to create data streaming to aws

  • The traces will be exported as a compressed gzip object. Inside it, the traces will be in JSON format following the OpenTelemetry standard.

  • Each exported object can contain multiple traces.


Watch the video on Data Streaming:


Information about Data Transfer has been removed from Data Streaming.


Editing delivery stream settings

To change the Datadog website or API Key — for Datadog as destination; or to change the bucket, AWS Region, access key or secret — for AWS S3 as destination, follow the steps below:

  1. Access Data Streaming from the left menu or click the card located on your Analytics home screen.

  2. Find the Delivery Stream you want to edit. You can search by name or part of it.

  3. Click pencil icon representing edit action.

  4. Change the information and click SAVE.

Once changed, the previous settings cannot be recovered.

Deleting a delivery stream

To delete a delivery stream, click trash can icon representing the delete action.

Deleted delivery streams cannot be recovered. It may take several minutes for the deletion to take place.
Thanks for your feedback!
EDIT

Share your suggestions with us!
Click here and then [+ Submit idea]