Steps to Associate Old IP address to New Service Fabric cluster.

by Contributed | Dec 24, 2020 | Technology

This article is contributed. See the original author and article here.

Assume you have a Existing Cluster

Resource Group: oldsf-rg

Cluster name: oldsfcluster

Step 1:

Go to Resource Group(oldsf-rg)- > Public IP address resource ->Configuration

Ensure you have static assignment, if not yet (If its Dynamic, when you associate old Public IP address to new Sf cluster, the IP address will get changed)

Step 2:

Please delete all the resources from the resource group (oldsf-rg) except your Public-Ip address resource.

Note: Do not delete the resource group directly, rather I would suggest you to delete the each resources separately in below order one by one( Since some resource will have dependency)

Order:

• Virtual machine scale set


• Service Fabric cluster


• Storage account (both)


• Virtual network


• Network security group


• Load Balancer

Now you will be having only Public IP address resource under your resource group (oldsf-rg)

Step 3:

Please create the new SF cluster with your desired configurations

Assume New SF name : newsfcluster

Please Note: Both Old and New Cluster has to be in Same region.

Once successful.

Step 4:

Go to New Resource group -> Load balancer resource-> Frontend IP configuration( left pane)

You will be able to see a dropdown as shown below, where your old Public IP address will be listed.

Associate the New LB to Old IP address and click on “Save”

Deployment Starts, please wait till the Deployment succeeded.

Step 5:

Once successful, Please verify below:

Old Public IP address is associated with New LB resource

Old Public IP address with New VMSS

Now you should be able to RDP into new node using old Public IP address (IPaddress:3389 )

Try Accessing the SFX with Public IP address:

https://XX.XXX.XXX.XXX:19080/Explorer/index.html#/

However when you click on SFX/Management Endpoint the one in Portal, you may get below Error:

Reason: Management Endpoint Domain is still pointing to Old DNS name which is no more resolving to Old public IP.

Step 6:

To map Management Endpoint Domain to New DNS name.

Go to new Public IP address resource -> Configuration

Copy the DNS value and Change the DNS name to some random value

And paste on Old Public IP address -> Configuration -> DNS name label

 Now Azure-Portal-> SF cluster should point to new DNS name and SFX link should be accessible:

Implement Fill Down in ADF and Synapse Data Flows

by Contributed | Dec 23, 2020 | Technology

This article is contributed. See the original author and article here.

“Fill down” is an operation common in data prep and data cleansing meant to solve the problem with data sets when you want to replace NULL values with the value from the previous non-NULL value in the sequence. Here is how to implement this in ADF and Synapse data flows.

Note that this operation can have negative performance implications because you must create a synthetic window across your entire data set with a “dummy” category value. Additionally, you must sort by a value to create the proper data sequence to find the previous non-NULL value.

In this case, my products data is missing the Color value in several rows. To fix this, I applied the fill down pattern in the Window transformation to fill in the NULL values:

To achieve this, I used the coalesce formula in the Window transformation: 

coalesce(Color, last(Color, true()))

The key to make this work is to first set the Window “over” clause to your entire data set. If you do not already have a value that is the same across all rows, you can set a synthetic window value in a Derived Column. In my case, I set an integer value of 1 to a column called “dummy”.

Next, the Window sorting should be sorted by the column that sets the proper ordering such that the previous non-NULL value will be your fill value. In my case, I used the Surrogate Key transformation to create an incrementing key to sort by.

The final fill-down pattern looks something like this:

To make this easy to add to your data flow pipelines, I added the script-behind as a data flow snippet to our online recipes here.

I’ve also included this snippet below. This creates the synthetic category as “dummy” and sorts by a surrogate key. You can remove the surrogate key and use your own data-specific sort key. This code snippet assumes you’ve already added a Source transformation to your data flow called source1.

source1 derive(dummy = 1) ~> DerivedColumn

DerivedColumn keyGenerate(output(sk as long),

	startAt: 1L) ~> SurrogateKey

SurrogateKey window(over(dummy),

	asc(sk, true),

	Rating2 = coalesce(Color, last(Color, true()))) ~> Window1

Microsoft Teams Voice – Mid-Day Café 01-11-2021

by Contributed | Dec 23, 2020 | Technology

This article is contributed. See the original author and article here.

  Join us January 11^th at 12 noon eastern for the Kickoff of Mid-Day Café as we feature Microsoft’s Raj Gopalakrishnan, Sr. Director and Principal Program Manager, Enterprise Engineering, Microsoft Teams. Raj will be presenting on Microsoft Teams Voice and taking your questions. Additionally, Microsoft’s Samantha Brown, Mark Litwin, Pete Anello, and Patrick Miller, will be joining me to bring you the latest in Microsoft News, Events, and more.

Mid-Day Café is a new, weekly, fast paced, live web series by the HLS Group. Join us each Monday at 12 noon eastern.

September 11^th Lineup:

• Welcome and Introductions.


• Mid-Day Café News in 2!


• Upcoming HLS Events in 1!


• Microsoft Teams Voice featuring Raj Gopalakrishnan.


• Open Q&A


• Wrap Up

How to join:

• Click here to download the .ics calendar invite to add to your calendar.   


• Click here on Jan 11, at 12 noon eastern to access the webcast directly.  

Thanks for visiting – Michael Gannotti   LinkedIn | Twitter

Michael Gannotti