How to Copy Millions of Files by using Copy Activity with Rerun Mechanism in Azure Data Factory Tutorial 2021, in this video we are going to learn How to Copy Millions of Files by using Copy Activity with Rerun Mechanism in Azure Data Factory Azure Data Factory Tutorial 2021, Azure Data Factory Step by Step - ADF Tutorial 2021 - ADF Tutorial 2021 Step by Step ADF Tutorial - Azure Data Factory Tutorial 2021
--www.mssqltips.com/sqlserverti...
1) create above link to create and load dbo.Calendar table.
2) create table for your specific load
create table dbo.LoadLog (id int identity(1,1),startdate date,enddate date,LoadStatus varchar(10))
3) Load data into dbo.Loadlog table from dbo.Calendar for specific time.
insert into dbo.LoadLog(startdate,enddate)
Select TheDate as startdate,DateAdd(DAY,1,cast(TheDate as date)) as EndDate
from dbo.Calendar where theyear=2021 -- this can be (2019,2020,2021) in your case.
4) use this query in your lookup to get the list of date range
Select * from dbo.LoadLog is null
5) use this sp inside forech loop to update files moved to completed for specific date
Create procedure dbo.LoadStatue
@id int
as
begin
update dbo.LoadLog
set LoadStatus='Completed'
where id=@id
end
Azure Data Factory Tutorial for beginners
Azure Data Factory Tutorial 2021
Step by step Azure Data Factory Tutorial
Real-time Azure Data Factory Tutorial
Scenario-based training on Azure Data Factory
Best ADF Tutorial on youtube
#AzureDataFactory #ADFTutorial2021
Негізгі бет Ғылым және технология How to Copy Millions of Files by using Copy Activity with Rerun Mechanism in Azure Data Factory
Пікірлер: 8