This blog post is about type two slowly changing dimensions (SCD2). This is when an attribute change in row 1 results in SSIS expiring the current row and inserting a new dimension table row like this -->
Category: Ssis20 Results
Even though many people think data warehouses ETLs (extract, transform and load) should contain insert data flows only, the vast majority of people I work with also have to deal with updates. Many also have to handle marking data warehouse rows as IsDeleted = "Y" in their ODS and EDW data repositories.
If you are working with a dimension table with less than 500K rows (an estimate), a traditional lookup task might work just fine. The data flow would look like this:
We understand that the world of data can seem daunting, especially when you're a n00b. For those of you that fall in that category, as a Product Engineer, I offer this advice: "All you need is dedication and the foresight to start small and slowly scale up. With this mindset, you'll achieve great things."
In case you missed yesterday's Intro to SSIS webinar, or would simply like a refresher of some of the main topics covered, I invite you to continue reading this blog post.
In a previous blog post, Pragmatic Works Data Analyst, Achara McNair-Tarfa, told us why she hates SSIS. She revisited with Brian Knight, our founder and CEO, to learn his top five SSIS tips and about how Pragmatic Works’ products can help make your day to day life with SSIS easier.
Many of us think of databases as our main source of data. But there are so many other data sources out there. Different teams within your business use different systems that hold unique data that they need for reports and decisions for their team. Pragmatic Works’ Task Factory product can help all your teams easily get the data they need.
Moving data from columns to rows can be a tricky task and accomplished in a variety of ways. That may be through a series of unions in T-SQL, but that’s just ugly and means lots of passes at the data potentially. You could use a T-SQL unpivot, which isn’t bad and usually my preferred method. The problem is you may not always have the option to use T-SQL.What if your source is a flat file or a database that doesn’t support unpivot?
Recently I was afforded the opportunity to speak at several different events, all of which I thoroughly enjoyed. I was able to speak on Azure Machine Learning first at the Arizona SQL Server Users Group meeting. I really appreciate all who attended as we had quite a crowd. Since the meeting is held practically on Arizona State University’s Tempe Campus, it was great to see a number of students attending, most likely due to Ram’s continued marketing efforts on meetup.com. After talking to him about it, I was impressed at his success at improving attendance by promoting the event on Meetup, and wonder if many SQL Server User Groups have experienced the same benefits. If you have, please let me know. Thanks Joe for taking a picture of the event too.
You’ve just completed building your SSIS package; your hopes are set high on your newly created project becoming the company's number one tool for data building, organization and formatting. Surely that unreachable career tier level will finally be reached with the successful execution of just this one package within SSIS. You save your work and immediately execute the newly created package just to be greeted by a series of ugly error messages.
Greetings everyone, and thank you for taking the time to look at this blog. This is my first post and I hope I’m able to answer some of your questions about building packages in SSIS. In this post I will be showing you how to use the object variable to make packages dynamic while using Task Factory, a SSIS product by Pragmatic Works.
Need help with this topic? Ask the author below.