question

aRookieBIdev avatar image
aRookieBIdev asked

File Transfer in SSIS

Hi All, I have to perform a file transfer of around 20,000 pdfs which is approximately 15gb of data together. I need to execute the transfer from ssis , which allows me to choose from several options. What is your recommendation for the best approach to execute this efficiently . Thanks
ssissql-server-2012c#file
4 comments
10 |1200

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

JohnM avatar image JohnM commented ·
It has to be via SSIS? In this situation I'd use Powershell to facilitate this in batches. I have used Powershell in conjunction with Robocopy as well with great results to move a large number of files.
0 Likes 0 ·
aRookieBIdev avatar image aRookieBIdev commented ·
Thanks..Yes it has to be in ssis .. due to a framework restriction. However i could use c#/powershell to do the copy. I will check the robocopy options..
0 Likes 0 ·
JohnM avatar image JohnM commented ·
Other than using the file system task, I'm not sure on any type of best practices to facilitate this through SSIS. I would batch them out by created date or something just to manage how many files are being moved at once. Do they have to be moved all at once?
0 Likes 0 ·
aRookieBIdev avatar image aRookieBIdev commented ·
Yes they do all have to be moved.. Batching them is a good idea.. I will have rename them as well as I move..
0 Likes 0 ·

0 Answers

·

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.