Part 3–Loading Data into Azure SQL Data Warehouse

Sign in to queue

The Discussion

  • User profile image
    JSAD

    Instead of using AZcopy to copy files to Blob storage. Would using SSIS be better? Wondering if it is probably more maintainable to put everything in an SSIS package?

  • User profile image
    ctestaoneill

    Hi JSAD,

    So sorry for the delayed response.

    You could use SSIS, but you wouldn't be able to take full advantage of the MPP - Massively Parallel Processing capability that Azure SQL Data Warehouse has to offer.

    So If SSIS is really important, why not do all the SSIS work and then output them to files in Azure Blob Storage, and then use Ploybase to load those cleaned files.

    This will be more performant that connect SSIS to Azure Data Warehouse directly, especially when huge volumes of data are involved

  • User profile image
    MisiekBest

    Very useful, clearly and accurately explained. Thank you!

    p.s.
    According to https://blogs.msdn.microsoft.com/sqlcat/2017/05/17/azure-sql-data-warehouse-loading-patterns-and-strategies/
    the number of readers for DWU1000 is 80. But I can not find these numbers anywhere in the official documentation...

Add Your 2 Cents