title | titleSuffix | description | ms.author | author | ms.service | ms.subservice | ms.topic | ms.custom | ms.date |
---|---|---|---|---|---|---|---|---|---|
Transform data in Twilio (Preview) |
Azure Data Factory & Azure Synapse |
Learn how to transform data in Twilio (Preview) by using Data Factory or Azure Synapse Analytics. |
jianleishen |
jianleishen |
data-factory |
data-movement |
conceptual |
synapse |
04/12/2022 |
[!INCLUDEappliesto-adf-asa-md]
This article outlines how to use Data Flow to transform data in Twilio (Preview). To learn more, read the introductory article for Azure Data Factory or Azure Synapse Analytics.
Important
This connector is currently in preview. You can try it out and give us feedback. If you want to take a dependency on preview connectors in your solution, please contact Azure support.
This Twilio connector is supported for the following activities:
Use the following steps to create a Twilio linked service in the Azure portal UI.
-
Browse to the Manage tab in your Azure Data Factory or Synapse workspace and select Linked Services, then select New:
:::image type="content" source="media/doc-common-process/new-linked-service.png" alt-text="Screenshot of creating a new linked service with Azure Data Factory U I.":::
:::image type="content" source="media/doc-common-process/new-linked-service-synapse.png" alt-text="Screenshot of creating a new linked service with Azure Synapse U I.":::
-
Search for Twilio (Preview) and select the Twilio (Preview) connector.
:::image type="content" source="media/connector-twilio/twilio-connector.png" alt-text="Screenshot showing selecting Twilio connector.":::
-
Configure the service details, test the connection, and create the new linked service.
:::image type="content" source="media/connector-twilio/configure-twilio-linked-service.png" alt-text="Screenshot of configuration for Twilio linked service.":::
The following sections provide information about properties that are used to define Data Factory and Synapse pipeline entities specific to Twilio.
The following properties are supported for the Twilio linked service:
Property | Description | Required |
---|---|---|
type | The type property must be set to Twilio. | Yes |
userName | The account SID of your Twilio account. | No |
password | The auth token of your Twilio account. Mark this field as SecureString to store it securely. Or, you can reference a secret stored in Azure Key Vault. | Yes |
Example:
{
"name": "TwilioLinkedService",
"properties": {
"type": "Twilio",
"typeProperties": {
"userName": "<account SID>",
"password": {
"type": "SecureString",
"value": "<auth token>"
}
}
}
}
When transforming data in mapping data flow, you can read resources from Twilio. For more information, see the source transformation in mapping data flows. You can only use an inline dataset as source type.
The below table lists the properties supported by Twilio source. You can edit these properties in the Source options tab.
Name | Description | Required | Allowed values | Data flow script property |
---|---|---|---|---|
Resource | The type of resources that data flow fetch from Twilio. | Yes | Messages Calls |
resource |
From | The phone number with country code, for example +17755425856 . |
No | String | from |
To | The phone number with country code, for example +17755425856 . |
No | String | to |
When you use Twilio as source type, the associated data flow script is:
source(allowSchemaDrift: true,
validateSchema: false,
store: 'twilio',
format: 'rest',
resource: 'Messages',
from: '+17755425856') ~> TwilioSource
For a list of data stores supported as sources and sinks by the copy activity, see Supported data stores.