Exporting data to PARQUET file and ADLS Gen2 using Azure Synapse Serverless

Exporting query data is quite simple as one-two-three:

One:

define your file format

 

Two:

define your file location (note: you should have read/write/list permission the path)

 

 

Three:

Create external table in particular location, using format and path from previous steps:

 

Took 43sec to save 10M rows with 10 columns, each having numbers from 1 to 10 000 000 ๐Ÿ™‚

msg output:

 

Now, how does it look like in DL?

 

So far drawbacks are:

  1. You do not have control over a parquet block size nor filename
  2. Deleting an external table does not delete a parquet file, which in some scenarios is a good thing ๐Ÿ˜‰
  3. No partitioning

Leave a Reply