|
Where can I find best practices for using Fuzzy grouping & Fuzzy look up components? I need to process 10 000 000 records but I can't, I get an out-of-memory message. I have 8 MB in RAM. Any idea or suggestion? Thanks.
(comments are locked)
|
|
Hi Felix, you can take a look into this article. it will explain you how to change the buffer manager settings. this amount of rows are to big to process, so you're getting without memory/buffer available to finish the processing.. you can try to increase the DefaultBufferSize property of your package and see if this solves your problem
(comments are locked)
|
Your answer
This is slightly offtopic, but if you are handling very large datasets with any kind of frequency or concern for performance, you may want to consider more than 8GB of RAM. With databases in general and large datasets in particular, increasing the RAM is one of the best overall ways to improve performance. (Of course this should always be in addition to, not in place of, optimizing your code).