Preview Content - log in or become a member

SSIS Conditional split transformation

This article was created to achieve very specific task; for easier to understand tutorial (covering different scenarios in more details) please visit SSIS Conditional Split Tutorial

SSIS Conditional split transformation allows you to split source rows (query) into multiple groups in data flow which you can direct to different destination paths. In this tutorial I will use SSIS 2008 R2 and my own real-life example. The screenshot and explanation should be fairly similar in other versions of SQL Server for instance SSIS 2005 and SSIS 2012.

SSIS Conditional split transformation is very useful for usually applying business rules where certain rows need to have slightly different transformation applied (data cleansing) or need to be re-directed to different destination for user input. Another example is to split source into equal groups which is less common example but this is something I need to do in order to achieve parallel processing. Althought I used for parallel processing in control flow you could use this method to achieve better performance inside data flow as well.

In my example I will want to get a list of ProxyIPAddresses (100 rows) and split them into 10 groups and put them into 10 different recordset destinations. After extracting my ProxyIPAddresses (100 rows) I perform validation with 30s timeout and it used to take about 20-30 minutes. Once I performed split into 10 groups and run the same packages 10 times in parallel in control flow. The time decreased to 2-3 minutes and it didn't use much more resources as most of it was wait.

Not that we covered purpose of conditional split let's move on to the actual example.

In my example I started with adding OLEDB Source and conditional split. See below screenshot.

Are you a member? Log In

Membership plans from just 6.00 USD*

* Currency: USD (US Dollar )
2500+ accounts so far

Plans:
Bronze
6.00 USD
Silver
9.00 USD
Gold
12.00 USD
6 Courses
T-SQL (3), SSRS (1), SSIS(1), Excel (1)
Watch Video
75 Mini Courses
T-SQL (34), SSRS (7), SSIS(16), + more
300+ videos and 300+ Articles
38
(part of
Courses)
Progress Tracking
21 Interview Q&As pages
T-SQL (8), SSRS (3), SSIS(4), Other (6)
Forum
11 Webinar Recordings
T-SQL (1), SSRS (9), Career(1)
1 DIY Project (beta)
70-461 Tests
Watch Video
60 days, 100% Money Back Guarantee
Instant Activation
Duration:
Bronze
Silver
Gold
Valid for: 1 month 6.00 USD
sign up
9.00 USD
sign up
12.00 USD
sign up
Valid for: 3 months
10% off
16.00 USD
sign up
24.00 USD
sign up
32.00 USD
sign up
Valid for: 6 months
20% off
28.00 USD
sign up
43.00 USD
sign up
57.00 USD
sign up
Valid for: 1 year
30% off
50.00 USD
sign up
75.00 USD
sign up
100.00 USD
sign up
Valid for: 2 years
40% off
86.00 USD
sign up
129.00 USD
sign up
172.00 USD
sign up
Valid for: lifetime
50% off
108.00 USD
sign up
162.00 USD
sign up
216.00 USD
sign up


Did you find this page useful?
+4  |  -0
(4 Votes)