Best practices for using Fuzzy-grouping & Fuzzy-Look up

Where can I find best practices for using Fuzzy grouping & Fuzzy look up components? I need to process 10 000 000 records but I can't, I get an out-of-memory message. I have 8 MB in RAM.

Any idea or suggestion?


more ▼

asked Oct 23, 2009 at 01:13 PM in Default

avatar image

11 1 1 3

This is slightly offtopic, but if you are handling very large datasets with any kind of frequency or concern for performance, you may want to consider more than 8GB of RAM. With databases in general and large datasets in particular, increasing the RAM is one of the best overall ways to improve performance. (Of course this should always be in addition to, not in place of, optimizing your code).

Jul 15, 2010 at 04:19 PM TimothyAWiseman
(comments are locked)
10|1200 characters needed characters left

1 answer: sort voted first

Hi Felix,

you can take a look into this article. it will explain you how to change the buffer manager settings. this amount of rows are to big to process, so you're getting without memory/buffer available to finish the processing.. you can try to increase the DefaultBufferSize property of your package and see if this solves your problem

more ▼

answered Oct 23, 2009 at 03:20 PM

avatar image

Felipe Ferreira
306 1 2 3

(comments are locked)
10|1200 characters needed characters left
Your answer
toggle preview:

Up to 2 attachments (including images) can be used with a maximum of 524.3 kB each and 1.0 MB total.

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here



Answers and Comments

SQL Server Central

Need long-form SQL discussion? SQLserverCentral.com is the place.



asked: Oct 23, 2009 at 01:13 PM

Seen: 3552 times

Last Updated: Oct 23, 2009 at 06:01 PM

Copyright 2018 Redgate Software. Privacy Policy