question

aRookieBIdev avatar image
aRookieBIdev asked

SSIS FUZZY LOOKUP MEMORY FULL

We have implemented Fuzzy Lookup for one of the requirement .Source Count is around 60000 and Fuzzy Lookup happens on around 40 million records.We also have indexes. It takes around 2.5 hours.Kindly let me know which is the best way to go about this. Since the sql log memory gets full when the fuzzy look up happens. Also please explain what fuzzy look up exactly does in the background? why does it use the sql log space? why does it create its own indexes? Thanks, Kannan
ssisperformancelog-file-sizefuzzy
10 |1200
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

1 Answer

·
Dave Morrison avatar image
Dave Morrison answered
Hi Kannan, what are you trying to achieve by using the fuzzy lookup. Its pretty process intensive and is rarely the right tool for the job. You say the actual sql log file is getting full? The fuzzy lookup does create temp tables and the such in order to function, I guess you're using full recovery mode on the database and the pure volume of transactions is simply flooding your log.
10 |1200
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.