We have a data warehouse which reads millions of data from source system. Currently the staging population process takes lot of time even though the method is bulk load.
I have been told that “SELECT….INTO” works very fast.
I am planning to use (redesign the staging load process) “SELECT….INTO” this method to load the data into staging area.
The plan is…
- Drop all staging tables
- Run “SELECT….INTO” queries using stored procs. - this would create table with staging data
- Run the further process to load the staged data into dimensions & facts
Does this make any sense?
Datawarehouse experts - Can you please comment on this?