3 New Data Transformation Functions in ADF

This article is contributed. See the original author and article here.

Azure Data Factory and Azure Synapse Analytics Mapping Data Flows provides powerful, easy-to-use, data transformation at cloud scale. We’ve recently introduced 3 new data transformation functions to our rich data flow expression language: collectUnique(), substringIndex(), and topN().

• collectUnique()
  
  
  
  • Create a new collection of values into an array. ADF will automatically dedupe elements in the array for you.
  
  
  
  


• substringIndex()
  
  
  
  • Extracts the substring before n ccurrences of the delimiter.
  
  
  
  


• topN()
  
  
  
  • ADF will sort your data based on the column or expression that you provide and then return the top n results.
  
  
  
  

Find the documentation for all ADF data flow transformation functions at this link here.

Brought to you by Dr. Ware, Microsoft Office 365 Silver Partner, Charleston SC.