x

CDC SSIS package attempting to load duplicates

Hi all

Im having issues with an ssis package that processes change from a source db to a destination db. The package is set up to only process net changes and has multiple tables being loaded simultaneously.

The task sequence is 1) mark initial load start, 2) Mark initial load end, 3) Get processing range, 4) Mark Processing range. The package runs the initial load and the first incremental successfully (the first incremental is an update for rows that were added to source system whilst the initial package was loading). Then all subsequent incrementals fail as they try to insert duplicate rows into destination primary keys.

The cdc state variable sequence is;

ILSTART/IR/0x0000006E0000C4A00002//TS/2014-08-01T10:10:06.3579147/

ILEND/IR/0x0000006E0000C4A00002/0x0000006E0000C4B00002/TS/2014-08-01T10:11:39.0315573/

ILUPDATE/CS/0x0000006E0000C4A00002/CE/0x0000006E0000C4B00002/IR/0x0000006E0000C4A00002/0x0000006E0000C4B00002/TS/2014-08-01T10:12:05.8086365/

TFEND/CS/0x0000006E0000C4B00002/TS/2014-08-01T10:12:11.9693469/

TFSTART/CS/0x0000006E0000C4B00002/CE/0x00000F760000CFDF003D/TS/2014-08-01T10:26:54.5238988/

I cant understand how duplicate rows are making it through to the destination. Any ideas where I have gone wrong?

thanks in advance

more ▼

asked Aug 01, 2014 at 10:53 AM in Default

avatar image

DataArchitect
50 6 7 11

(comments are locked)
10|1200 characters needed characters left

0 answers: sort voted first
Be the first one to answer this question
toggle preview:

Up to 2 attachments (including images) can be used with a maximum of 524.3 kB each and 1.0 MB total.

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

SQL Server Central

Need long-form SQL discussion? SQLserverCentral.com is the place.

Topics:

x1221
x11

asked: Aug 01, 2014 at 10:53 AM

Seen: 1597 times

Last Updated: Aug 01, 2014 at 10:59 AM

Copyright 2017 Redgate Software. Privacy Policy