Data validate tools (ETL tools) for SQL server

I have some data in Excel and need to import into database. Is there any tool that can validate and maybe clean the data? Does Red Gate have such tool?

The input will be Excel. Given table constraints, eg. CHECK, UNIQUE KEY, datetime format, NOT NULL. Desire output should be as least shows which lines are having problems, and then fix some trivial error automatically, like fill in default value for NULL columns, automatically correct datetime format.

I know using Python can build such a script. But just wonder what's the popular way to do this. Thanks.

more ▼

asked May 14, 2010 at 06:44 PM in Default

Stan gravatar image

81 10 10 12

(comments are locked)
10|1200 characters needed characters left

1 answer: sort voted first

SQL Server Integration Services (SSIS) is the tool (SQL2005 onwards) that came bundled with SQL Server. You use this to develop ETL processes between many different data source and SQL Server.

Prior to SQL 2005, you would have used Data Transformation Services (DTS)

more ▼

answered May 15, 2010 at 04:04 AM

Kev Riley gravatar image

Kev Riley ♦♦
53.8k 47 49 76

Thanks. So is there any component provided in SSIS can shows which lines are invalid data if given table constraints, eg. CHECK, UNIQUE KEY, datetime format, NOT NULL. And any component can fix some trivial errors.

I know some of the checking rules still have to be make by SQL statement (via execute SQL task component), but I wish to find more standard method.
May 15, 2010 at 04:13 PM Stan
(comments are locked)
10|1200 characters needed characters left
Your answer
toggle preview:

Up to 2 attachments (including images) can be used with a maximum of 524.3 kB each and 1.0 MB total.

New code box

There's a new way to format code on the site - the red speech bubble logo will automatically format T-SQL for you. The original code box is still there for XML, etc. More details here.

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here



Answers and Comments

SQL Server Central

Need long-form SQL discussion? SQLserverCentral.com is the place.



asked: May 14, 2010 at 06:44 PM

Seen: 851 times

Last Updated: May 14, 2010 at 07:24 PM