Data factory is a multi-tenant service that has the following default limits in place to make sure customer subscriptions are protected from each other's workloads. Many of the limits can be easily raised for your subscription up to the maximum limit by contacting support.
| Resource | Default Limit | Maximum Limit |
|---|---|---|
| data factories in an Azure subscription | 50 | Contact support |
| pipelines within a data factory | 2500 | Contact support |
| datasets within a data factory | 5000 | Contact support |
| concurrent slices per dataset | 10 | 10 |
| bytes per object for pipeline objects 1 | 200 KB | 200 KB |
| bytes per object for dataset and linked service objects 1 | 100 KB | 2000 KB |
| HDInsight on-demand cluster cores within a subscription 2 | 60 | Contact support |
| Cloud data movement unit 3 | 32 | Contact support |
| Retry count for pipeline activity runs | 1000 | MaxInt (32 bit) |
1 Pipeline, dataset, and linked service objects represent a logical grouping of your workload. Limits for these objects do not relate to amount of data you can move and process with the Azure Data Factory service. Data factory is designed to scale to handle petabytes of data.
2 On-demand HDInsight cores are allocated out of the subscription that contains the data factory. As a result, the above limit is the Data Factory enforced core limit for on-demand HDInsight cores and is different from the core limit associated with your Azure subscription.
3 Cloud data movement unit (DMU) is being used in a cloud-to-cloud copy operation. It is a measure that represents the power (a combination of CPU, memory, and network resource allocation) of a single unit in Data Factory. You can achieve higher copy throughput by leveraging more DMUs for some scenarios. Refer to Cloud data movement units section on details.
| Resource | Default lower limit | Minimum limit |
|---|---|---|
| Scheduling interval | 15 minutes | 15 minutes |
| Interval between retry attempts | 1 second | 1 second |
| Retry timeout value | 1 second | 1 second |
Azure Resource Manager has limits for API calls. You can make API calls at a rate within the Azure Resource Manager API limits.