File Transfer in SSIS

Hi All, I have to perform a file transfer of around 20,000 pdfs which is approximately 15gb of data together. I need to execute the transfer from ssis , which allows me to choose from several options. What is your recommendation for the best approach to execute this efficiently . Thanks

10 |1200

Attachments: Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

JohnM commented · Oct 10, 2016 at 05:41 PM

It has to be via SSIS? In this situation I'd use Powershell to facilitate this in batches. I have used Powershell in conjunction with Robocopy as well with great results to move a large number of files.

0 ·

aRookieBIdev commented · Oct 10, 2016 at 06:24 PM

Thanks..Yes it has to be in ssis .. due to a framework restriction. However i could use c#/powershell to do the copy. I will check the robocopy options..

0 ·

JohnM commented · Oct 10, 2016 at 06:35 PM

Other than using the file system task, I'm not sure on any type of best practices to facilitate this through SSIS. I would batch them out by created date or something just to manage how many files are being moved at once. Do they have to be moved all at once?

0 ·

aRookieBIdev commented · Oct 10, 2016 at 06:40 PM

Yes they do all have to be moved.. Batching them is a good idea.. I will have rename them as well as I move..

0 ·