Please note that after recent UI changes in Azure You can find Linked Services under Manage tab in the Data Factory portal 😊
@mohammedashfaq3892
4 жыл бұрын
Great explanation, thanks for this note i was wondering where exactly the linked services was. This makes clear to me. Appreciate.
@AdamMarczakYT
4 жыл бұрын
Thanks! While I can’t recreate all the content whenever Microsoft decides to make minor UI changes I can surely let you know in the comments :) For major changes or new version of the services we will still get updated videos :)
@sunnybruno8530
3 жыл бұрын
Hi Adam, please where exactly can I find the managed tab, so as to get to the linked services?
@rodrickedwards2759
2 жыл бұрын
@@sunnybruno8530 The manage tab on the left nav. Probably the last icon for you.
@MichalPCode
3 жыл бұрын
That diagram at the start was fantastic! Very clear and explaining everything! Dzięki wielkie!
@AdamMarczakYT
3 жыл бұрын
Glad it helped! Dziękuje!
@jamilarheasison6973
3 жыл бұрын
Adam, you have no idea how this is very helpful to me. Especially that I'm in a new project that has to work with everything about Azure. I used to study in Microsoft website for the Data Engineering certifications and all of these terms are very new to me that I'm losing hope with being able to understand it fully. I'm so glad that I stumbled upon your channel in hopes of understanding all of this and you're the only one I watch when I need help. All your videos have helped me even get a promotion at work. I thank you from the deepest bottom of my heart and I hope you continue making this! I support you with all my might! (Sorry for my bad english)
@AdamMarczakYT
3 жыл бұрын
This is fantastic read. This is the reason why I created this channel, thank you!
@RithDil
2 жыл бұрын
Yeah, for me too. I'm so glad to see this video. Thanks Adam
@loshyourik
4 жыл бұрын
I'm totally new into data management in Azure and I'm amazed cool explanation + slides + a demo from scratch thanks a lot!
@AdamMarczakYT
4 жыл бұрын
You're very welcome!
@sankaranarayanans8814
5 жыл бұрын
I didn't get sleep while watching this video. Clear explanation with a perfect scenario ... Keep it up bro.. :-)
@AdamMarczakYT
5 жыл бұрын
Thanks! Comments like this only make me want to do more!
@mohammedashfaq3892
4 жыл бұрын
Agreed bro, I got a new project which involve data factory and ETL assignments.
@daneghi3737
3 жыл бұрын
You are the best --very clear explanation -Thank you I will definitely get a ADF job soon
@AdamMarczakYT
3 жыл бұрын
Best of luck!
@daneghi3737
3 жыл бұрын
@@AdamMarczakYT Thank you Adam
@kal_jorEl
4 жыл бұрын
I can't thank you enough for giving this tutorial. Absolutely fantastic. The Analogy makes so much sense and your presentation is also very good. Subscribed.
@AdamMarczakYT
4 жыл бұрын
Awesome! Cheers! Glad my content is of help to you! :)
@dgh25
Жыл бұрын
Amazing how Microsoft couldn't do a simple explanation of this. Their documentation is retarded. Always the same with Microsoft - totally useless when it comes to explanation and documentation.
@priyankagupta119
2 жыл бұрын
You are amazing in delivery any content in the simplest way. I liked your videos.
@Stinkys8050
4 жыл бұрын
Wow, this is precisely what I was looking for. Thanks for this great tutorial.
@AdamMarczakYT
4 жыл бұрын
Glad it was helpful!
@madhusudhanaerappareddy856
2 ай бұрын
Very nice pictorial presentation in the beginning to make things clear, why were using the Data factory components like linked service, dataset and copy activities. Loved the way you started by giving example of a ware house to move the furniture to home.
@na_ira_
2 жыл бұрын
I was so scared about starting Azure topics. This is making my life so easy. Perfect explanations with great presentations. The examples make it easy to retain. Thank you!
@pat_mueller
2 ай бұрын
how about today bro?
@na_ira_
2 ай бұрын
@@pat_mueller I hate azure
@fadiabusafat5162
3 жыл бұрын
Cheers Adam. Amazing Tutorial. Keep moving on and please always made familiar with your tutorials.
@nicholasgregory4774
3 жыл бұрын
This tutorial is EXACTLY what I was looking for. Subscribed to your channel 7 minutes in. Thank you for the time and effort you're putting into these tutorials. Bookmarked an additional 3 videos to watch after this.
@AdamMarczakYT
3 жыл бұрын
Awesome, thank you! :)
@LifeatAustralia
Жыл бұрын
Amazing tutorial, really helpful for the beginners. Appreciate your work Adam!
@EdwinVeenboer
2 жыл бұрын
i am doing DP-203 at the moment and was really struggling with this. Thank you for clearing things up. You're a great teacher!
@hariharannatarajan
4 жыл бұрын
There are very few demos available for Data Factory out in the internet and this will for sure top the list. Thank you for the excellent content Adam :)
@AdamMarczakYT
4 жыл бұрын
Thanks, this is amazing to hear.
@jahanviMath6452
3 жыл бұрын
Very well explained. I have passed azure fundamentals by watching your AZ 900 Episodes. Thank you so much for all your work 🙏🙏 now watching to clear data engineering 🙏
@AdamMarczakYT
3 жыл бұрын
Fantastic, congrats!
@krillis0n
Жыл бұрын
THANK YOU! Finally someone has a helpful tutorial!
@blaaarrghh
3 жыл бұрын
Well this was one of the best introduction videos I've seen. Not too compilicated, not too fast.
@AdamMarczakYT
3 жыл бұрын
Glad you think so! Thanks!
@greenshadowooo
Жыл бұрын
A very detail introduction!! Really appreciate your effectiveness and effort.👍👍👍
@fahadaijaz4
4 жыл бұрын
This is the probably the best tutorial presentation I've ever seen.
@AdamMarczakYT
4 жыл бұрын
Thank you :)
@shivadarjani6990
3 жыл бұрын
Perfect and clear tutorial! Thanks Adam!
@AdamMarczakYT
3 жыл бұрын
Glad it was helpful!
@sreenijatumuluri7890
3 жыл бұрын
Thanks a lot for such clear explanation, completed all ADF videos in one go! You got a new subscriber, glad I discovered this content.
@AdamMarczakYT
3 жыл бұрын
Welcome aboard! Thanks!
@stevemac4105
4 жыл бұрын
awesome tutorial. In last 24 hours, I have watched dozens of lab but this was the best I have come across. will you please share a complex lab work using ADF
@AdamMarczakYT
4 жыл бұрын
Awesome Steve! Thanks! Did you had a chance to check my playlist on Data Factory? There is already few follow up videos on this topic and next will be out tomorrow.
@dks82
3 жыл бұрын
very well articulated with great scenario!! Adam's way :)
@AdamMarczakYT
3 жыл бұрын
Thank you :)
@vinceking5721
4 жыл бұрын
good explanation of something completely new to me - it now makes sense - thanks
@AdamMarczakYT
4 жыл бұрын
Glad it was helpful!
@pramodnithan8859
4 жыл бұрын
Great Explanation. Perfect tutorial for Beginners. Thank you for the efforts. Appreciable :)
@AdamMarczakYT
4 жыл бұрын
You're very welcome! Thanks :)
@pavantej9666
4 жыл бұрын
Explanation is crystal clear. Thanks for making this.
@AdamMarczakYT
4 жыл бұрын
Glad you think so! Thanks!
@jsonify
2 жыл бұрын
I absolutely love your tutorials. So very informative. Is there any chance you might do a tutorial on converting an AVRO file that was stored in a Data Lake, to a CSV that can be stored in the SQL DB? This seems like it should be a pretty straight forward out-of-the-box solution, but the AVRO body looks like it needs to be decoded in Data Factory first. Thank you!
@paulhernandezgermany
3 жыл бұрын
Really good tutorial, I really like the analogy and the graphics. Just one comment, maybe too purist, but at the end you clear the table before load the data and said this is a typical "upsert", which from my point-of-view is a "new load" pattern. An "upsert" would be the same as a "merge" and does not drop the records but just load the table incrementally. Anyway, great job!
@AdamMarczakYT
3 жыл бұрын
Thanks Paul, totally agreed, this is an overwrite scenario. A true upsert means insert and update without necessarily deleting old rows. A true upsert using merge in ADF requires you to load data to a staging table and then execute stored procedure with merge query. This complicates things but not by that much :) Alternative approach is using mapping data flow to create merged table in memory using ADF and then overwrite target table. This way you can avoid staging tables. Thanks for stopping by and such a careful attention to details. A lot changed in my approach and fluency since the day that video was recorded, hope new ones are even better :) Thanks!
@michalhutny7356
5 жыл бұрын
Great work Adam! I'm waiting on second part of Azure Data Factory, but this time with SSIS packages usage :)
@AdamMarczakYT
5 жыл бұрын
I might in future just to cover entire ADF scope of features but I have some strong opinions on SSIS. I just personally think there are much better options available in the cloud instead of SSIS. I only use SSIS if I do 'lift-up' from existing solutions, I never use it for new projects. Thanks for watching and commenting!
@matthewgoss883
4 жыл бұрын
Adam Marczak - Azure for Everyone - Could you share an overview of options for those of us rooted in SSIS?
@MarimuthuSA
3 жыл бұрын
Clear explanation and very much useful video.
@AdamMarczakYT
3 жыл бұрын
Glad it was helpful!
@MarimuthuSA
3 жыл бұрын
@@AdamMarczakYT Yes Adam, I had no idea about it ADF before, however your excellent explanation made me to understand much better.
@johng5295
4 жыл бұрын
I'm impressed. Very well explained. Thanks in a million.
@AdamMarczakYT
4 жыл бұрын
Thanks John! :)
@andresfd89
2 жыл бұрын
Thank you so much for this! very easy and well explained.
@KineasGaming
5 жыл бұрын
I've never worked with Azure Data Factory, but now I watched your video... it seems it would be a nice option to be considered in some past situations (csv to cosmos db bulk loads)! Hahaha! Good to know for the near future. Thanks for the effort Adam! ^^
@AdamMarczakYT
5 жыл бұрын
Thanks. Hope it helps! It's really quick once you know it.
@keerthikaarivalagan6747
2 жыл бұрын
Such a clear and understanding video Thanks for this✨
@generaltalksoflife
3 жыл бұрын
Hello Sir, could you please create 1) a video on incremental data load from azure sql db (source) to csv file in blob storage single file ( target). 2) a video on incremental data load from azure sql db (source) to azure sql db ( target). It will be very helpful. Thanks Sir. Love you 🌸💐🏵🙏🙏🙏
@AdamMarczakYT
3 жыл бұрын
Thanks for the ideas, maybe!
@bolaadegunwa7739
Жыл бұрын
You pretty much simplified this. Thanks buddie.
@cultofIOS
Жыл бұрын
This awesome tutorial. Thanks much Adam. Of course subscribed!!!!!
@jagadeeshpinninti
4 жыл бұрын
A perfect video to know ADF👌 Please do more videos on ADF
@AdamMarczakYT
4 жыл бұрын
Already got few, feel free to check them out. Rest assured more are coming for sure!
@samarjeetkahlon2884
4 жыл бұрын
perfectly explained, simple to understand
@AdamMarczakYT
4 жыл бұрын
Awesome, thanks!
@MrRamesh2k
2 жыл бұрын
well explained even kids can understand
@navneethparthasarathy8395
Жыл бұрын
Hope you come up with some courses for Azure Exams. That will be really helpful to the community of Azure learners . This video was fantastic
@happyferret1
2 жыл бұрын
Does all of your videos applicable for dp-203? Sorry, I'm new to azure and would like to practice towards data engineering. Can I practice all of your videos towards data engineering? TIA
@charlesdelanoy
3 жыл бұрын
Thanks Adam, great video. I went through the steps and it's all working. The Azure screens and the process has slightly changed through, e.g. Data Flows which was in preview is now mainstream...etc.
@AdamMarczakYT
3 жыл бұрын
Thanks Charles, I wouldn't say that Data Flows are mainstream now but they are surely more popular than before. I do have small tutorial on them too :) Thanks for watching :)
@LunjunMou
10 ай бұрын
This is a concise and right to the point DEMO for Data Factory! We are just about to start our AZURE Journey and this is definitely a good start point! Thank you very much Adam!
@swetharajamma4228
4 жыл бұрын
Hi Adam, Good explanation thanks a lot . Have small query . Before starting on career as azure Data factory developer or engineer . what are the prerequisite skills or knowledge is needed . Kindly check on this and reply . It helps a lot
@AdamMarczakYT
4 жыл бұрын
Thanks. Check out DP-100 and DP-200 exam skills measured PDFs and check the skills tested. If you will feel you know everything from DP-100 or that it might be too easy then go for DP-200. docs.microsoft.com/en-us/learn/certifications/exams/dp-100 docs.microsoft.com/en-us/learn/certifications/exams/dp-200
@Ptelearn4free
3 жыл бұрын
Hey Adam..what is the best process or method to extract say 50 gb of data using azure from the source. .Also how can we process unstructured data using azure
@AdamMarczakYT
3 жыл бұрын
Unfortunately this is too broad question to answer but if you need to move 50gb of data Azure Data Factory will do just fine.
@siddharthkrishna8688
4 жыл бұрын
If we have 1500 tables from SAP HANA to have delta capability ( with different columns for timestamp) which would be most optimal approach in SAP DATA Factory? Please suggest. I understand in COPY operation we can select multiple tables but to add DELTA logic doesnt seem feasible. Thanks in advance. Also if we run into a situation where duplicate data is pushed in the Azure SQL as target would that be updated or just neglected as incompatible dataset. Source is SAP HANA and Target is Azure SQL DW.
@AdamMarczakYT
4 жыл бұрын
Check this article on incremental loads using ADF docs.microsoft.com/en-us/azure/data-factory/tutorial-incremental-copy-overview
@brentcos9370
3 жыл бұрын
I'm a beginner and I've been using MS SQL Server (Management Studio) and MS Visual Studio(2019) SSIS to perform ETL. Is Azure Data Factory a better way method for ETL? Is that how to think about it or is it just the "cloud" version of what I'm currently doing? Thanks and great vid!
@AdamMarczakYT
3 жыл бұрын
In my opinion yes, SSIS is no longer very actively developed. But in general it's very good to invest in learning new technologies. ADF also scales better for large datasets.
@krishnamurthyhunagund1049
3 жыл бұрын
Superb!!
@AdamMarczakYT
3 жыл бұрын
Thank you! Cheers!
@sunnybruno8530
3 жыл бұрын
Hi Adam. Your video was really helpful in understanding ETL with ADF but when I implement your steps, everything works aside the pipeline copy data (after I click on debug). It keeps failing and I have repeated the steps carefully multiple times but kept having same problem.. Please how do I rectify this?
@AdamMarczakYT
3 жыл бұрын
Honestly hard to tell without seeing an error, but let me say this. I've done this demo thousand of times, it works, always. In my opinion you maybe missed one step in the process which might be confusing you. Try deleting the pipeline and configure everything again, sometimes it's easier than look for the error.
@suhels5873
3 жыл бұрын
Hi Adam Great Explanation. Thank you so much. can you make a video for ADF Project explanation and rolls and responsibilities. Please. It will helpful very helpful for us. Thank you.
@AdamMarczakYT
3 жыл бұрын
I make technical tutorials, but thanks for the suggestion, I'll think about it :)
@srinivasulureddy7265
4 жыл бұрын
Hi Adam,How will you handle incremental load? (you are getting 100 files, file name have name and date, based on that date (cashbreak_17-10-2020.csv) How will you get that date and load previous day files only)??
@AdamMarczakYT
4 жыл бұрын
Check out MS guide for incremental load technique with ADF. Although there are plenty of other techniques available docs.microsoft.com/en-us/azure/data-factory/tutorial-incremental-copy-overview?WT.mc_id=AZ-MVP-5003556
@yeahjustlikethat
3 жыл бұрын
that was wild thanks dude. What would be a scenario for triggering a new runtime, file modified? Perhaps with some unique keys, only upload the new ones.
@raigonzales9582
3 жыл бұрын
This is cool. I am new to Data Factory and would like to know if Pipelines from ADF, can trigger a post deployment trigger to Azure DevOps Pipeline? Appreciate your comment on this Adam
@AdamMarczakYT
3 жыл бұрын
You could try DevOps REST API docs.microsoft.com/en-us/rest/api/azure/devops/?WT.mc_id=AZ-MVP-5003556&view=azure-devops-rest-6.1
@rajdeepmandal2597
4 жыл бұрын
Hi Adam, can you please suggest if it is possible to fetch Azure DevOps analytic view as data source which can be pulled through ADF and store the data in csv format in ADLS?
@AdamMarczakYT
4 жыл бұрын
Based on this doc docs.microsoft.com/en-us/azure/devops/report/powerbi/data-available-in-analytics?view=azure-devops you can pull some data via OData connector but I have never tried. It's a good starting point.
@ektayadav3987
3 жыл бұрын
Very good explanation..i will try to use it
@AdamMarczakYT
3 жыл бұрын
Great 👍
@Tech-ub8dd
11 ай бұрын
thanks adam, great video!
@naveenshindhe2893
3 жыл бұрын
Thank you for the efforts. Can you please make a video by using ODATA as the source and putting in some table by using Azure Data Factory, Thanks
@AdamMarczakYT
3 жыл бұрын
Thank you, OData load using REST connector is surely interesting topic, maybe!
@venkatkurimimdla3360
3 жыл бұрын
Really Amazing !!!!The way you explained it was simply WOW!!!!! Thanks Adammmm
@AdamMarczakYT
3 жыл бұрын
My pleasure!
@shashibhushansingh1628
2 жыл бұрын
great explanation you are fantastic
@khalidhamid2853
3 жыл бұрын
Hi Adam, thanks for all this explanation, do you have an idea how much will be the cost monthly if I use a free trail version to do these labs? Thanks.
@AdamMarczakYT
3 жыл бұрын
No idea, sorry! You pay based on how much you use it. Doing just these exercises should be very cheap.
@bathini14
4 жыл бұрын
getting special characters in datasets (file and.blob) when specifying encoding data UTF-8. Please help.
@AdamMarczakYT
4 жыл бұрын
If you have set up everything correctly including file contents and dataset settings then it should work flawlessly. Make sure also your DB has proper column types. Good luck!
@hiteshjoshi3148
3 жыл бұрын
Hi Sir I am more from excel side I have learned power bi and. Tsql so I want to learn it rather ssis how do I I donno rest APIs , python ,power shell can I learn it
@AdamMarczakYT
3 жыл бұрын
You can learn it if you want :) Just put your mind to it! I believe in you so you can too!
@jihaneb4796
3 жыл бұрын
thank you for this video, a very well put content with a clear explanation. Wishing you all the best
@AdamMarczakYT
3 жыл бұрын
Glad it was helpful!
@minhaaj
3 жыл бұрын
great videos. keep it up
@AdamMarczakYT
3 жыл бұрын
Thanks, will do!
@Shubhamsharma-il7fy
4 жыл бұрын
can somebody suggest me tutorials on deploying data factory via python sdk very important
@AdamMarczakYT
4 жыл бұрын
here are examples with python sdk docs.microsoft.com/en-us/python/api/overview/azure/datafactory?view=azure-python
@eerosiljander4622
2 жыл бұрын
THIS WAS JUST GREAT ADAM. LIKE MALYSZ IN SKI-JUMPING AT HIS BEST :) !
@michaeli6416
3 жыл бұрын
thanks for explaining this concept, it helped a lot. i think the CSV file on github is different from the one you used to demo(headers) because I kept getting mapping source error while debugging
@AdamMarczakYT
3 жыл бұрын
Thanks, I think you are right. I couldn't find the original sample, but provided SQL and CSV should match without any issues, all other tasks are importing schema automatically so there shouldn't be any issues I hope. Let me know if I missed anything. Thanks!
@LuigiZambetti
3 жыл бұрын
Could you make a playlist on Azure Data Factory for absolute beginners?
@AdamMarczakYT
3 жыл бұрын
Thanks, I do have playlist like this on my channel, feel free to check it out! :)
@harishkonakandla
3 жыл бұрын
What are the drawbacks of Azure Data Factory? Panel asked me in an interview.
@AdamMarczakYT
3 жыл бұрын
This is an open question, I personally don't like those. There is no official list of drawbacks created by MS so panel asks for your experience with ADF, feel free to google for 'adf disadvantages' and read some blogs. You will see they all talk about different things because it's very objective topic and often I don't agree with what they describe, for some I do agree.
@sexypradeepkumar
4 жыл бұрын
Does the blob storage , sql database are separate license or part of azure data factor? what is included as part of data factory?
@AdamMarczakYT
4 жыл бұрын
Hey. Azure does not include anything by default and does not bundle products. You pay by each component separately so you can choose each component on per needed basis.
@gurjitsingh9054
Жыл бұрын
Excellent mate ! you made ADF so simple to learn.
@markbock5455
4 жыл бұрын
First off, I would like to say that this was a very comprehensive tutorial! I am getting the following error on debug and I cannot determine why. { "errorCode": "2200", "message": "ErrorCode=UserErrorMissingPropertyInPayload,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Required property 'fileName' is missing in payload.,Source=Microsoft.DataTransfer.ClientLibrary,'", "failureType": "UserError", "target": "Copy data1", "details": [] }
@AdamMarczakYT
4 жыл бұрын
Thanks Mark! When you click validate a panel on the right hand side will appear with list of errors. If you click on the error it will bring you to the place where the error occurred. In your case it seems that fileName is missing on dataset.
@nicolemwanaidi1488
3 жыл бұрын
Hi Adam. Is there a way that I can move data to SSMS without having to manually create the table schema first within SSMS? I tried to move some data using ADF but had to manually create the table in SSMS and it was not a very interesting process especially because it was a very wide table. TIA
@AdamMarczakYT
3 жыл бұрын
There is a checkbox in copy activity to create table if it doesn't exist. Just make sure the schema is correct because automatic detection of column types doesn't always work the best when reading from flat files.
@nicolemwanaidi1488
3 жыл бұрын
Thank you
@snmailist1470
4 жыл бұрын
Thank you for precious explanation. Good for entry point 👍👍👍👍
@AdamMarczakYT
4 жыл бұрын
My pleasure
@NazarRud
Жыл бұрын
Nice explanation, thanks a lot
@tanimasaxena5984
4 жыл бұрын
Great tutorial. Thankyou! In ADF can you let me know how can we load partial data using select query?
@AdamMarczakYT
4 жыл бұрын
Thanks :) There is option to select query (checkbox) in the source tab of copy activity.
@abhiroopghatak9442
3 жыл бұрын
great stuff Adam .... Do we have any playlist for az 204 ?
@AdamMarczakYT
3 жыл бұрын
Thanks, maybe! :)
@joyaljjoy
Жыл бұрын
For someone who never used azure, I got the basic understanding of it.
@nielsd9261
3 жыл бұрын
Great video Adam! thanks ;) I just have one question, if you would get a weekly csv. export. for example Sales2020w01.csv, Sales 2020w02.csv, Sales2020w03.csv. How would you reuse the pipeline in the video to insert these different files every week without having to create a new dataset/pipeline each time?
@AdamMarczakYT
3 жыл бұрын
Hey, this is a great question. Check out my data factory parametrization video which talks about exactly that :)
@awwalhameed6711
Жыл бұрын
Your video is very educative, will like to connect with you one on one. Thanks!
@AdamMarczakYT
Жыл бұрын
Any time, thanks!
@vishvesbhesania7767
3 жыл бұрын
Hi Adam, Thank you for awesome detailed video, well explained ! Being an ETL Developer(SSIS,SQL), i am planning to move on to Azure data factory. Is there anything that i should learn as part of it? like Scala,Databricks,Data lake ? can you help me on that please ?
@AdamMarczakYT
3 жыл бұрын
I'd learn Databricks for sure, maybe Python instead of Scala but Scala is good too :) Data Lake too but the new one, Gen2.
@govthamreddy
3 жыл бұрын
Great Video.I have one query i have json files in blob storage, how can i perform queries on json content in azure.
@AdamMarczakYT
3 жыл бұрын
Thanks! There are many ways, probably the best is to load JSON to SQL db and just query the tables. Otherwise you can use databricks for that too.
@rakeshmishra4650
3 жыл бұрын
Hi Adam, great stuff. Could you please make a video on how to handle SCD Type 2 in Azure data factory. I'd be glad if you make a tutorial on this.
@AdamMarczakYT
3 жыл бұрын
Hey, thanks for the idea. Maybe in the future :)
@shobhanganta8578
3 жыл бұрын
Thanks for your time in posting this video, this is very informative for beginners
@AdamMarczakYT
3 жыл бұрын
Glad it was helpful!
@ihebbibani7122
3 жыл бұрын
Very well Explained , you deserve a subscription which is already .Excellent Work ! Excellent Voice ! Excellent Pedagogy ! You can really be happy as I never mince my words :)
@AdamMarczakYT
3 жыл бұрын
Welcome aboard! I appreciate the support :)
@kprazzyj6860
4 жыл бұрын
Hey Adam, You are making things very easy to understand by showing it in the portal... I have a quick question for you in this video, is there a better alternative to delete the table in the pre-copy script field..? Is there a way to add the latest blobs on a daily basis to SQL table by appending it..? because deleting a table with big data will cost us more right..?
@AdamMarczakYT
4 жыл бұрын
I never delete tables in the pre-copy script, sometimes I truncate, sometimes I just insert. Depending on the scenario. Copy activity inserts data so it's just append by default. Thanks for watching :)
@NBK88_IL_IND
3 жыл бұрын
Great Explanation. Perfect tutorial for Beginners. Thank you for the efforts. Appreciable
@AdamMarczakYT
3 жыл бұрын
You're very welcome!
@tjvillanueva396
3 жыл бұрын
Hi Adam - Where do you transform your data in Azure? I have used Data Factory in moving files, - is it on Azure Analysis services? FYI - I am not handling big data, just a typical data warehouse
@AdamMarczakYT
3 жыл бұрын
I use data factory mapping data flows if I need very simple transformations, if I need complex or large scale transformations I use databricks. AAS is just in memory engine for fast reporting and analytics capabilities.
@tjvillanueva396
3 жыл бұрын
@@AdamMarczakYT Hi, thanks for your reply. Im planning to use databricks, but check that the price is a bit pricey - Where do you think i can find a pricing tutorial for databricks?
@tjvillanueva396
3 жыл бұрын
@@AdamMarczakYT - Hi Adam, have you tried looping over blob files?
@kimp2002
3 жыл бұрын
Great content Adam! Very easy to follow, just what I was looking for to get a basic understanding of Azure Data Factory. Thanks!
@AdamMarczakYT
3 жыл бұрын
Great to hear! Thanks for watching and commenting Kim :)
@mladenzvjerac4073
2 жыл бұрын
Bravo!
@DeshaKannada
Жыл бұрын
Can someone explain me.. why do u still use SQL server ?? Only for structured or small data we can use SQL server... Of we hve instructed of semi structure then ? Wch db to use?
@venkateshkannan7398
4 жыл бұрын
Great video Adam! All the thumbs down people, go get a life!
@AdamMarczakYT
4 жыл бұрын
Thanks! 👍
@bathini14
4 жыл бұрын
Hey Adam You are Awesome...
@AdamMarczakYT
4 жыл бұрын
Thank you soo much :)
@raviv5109
4 жыл бұрын
As usual, thank you Adam! One request, can you create short video on Custom Activity and can we request python script from Custom Activity. Thank you in Advance!
@AdamMarczakYT
4 жыл бұрын
Thanks, Custom Activity is interesting topic. I added it to the list of potential topics, thanks for suggestion. I will definitely consider it.
@geeks_football5751
3 жыл бұрын
Best session . I understood every thing.thanks for such a great content
Пікірлер: 1 М.