| The Complete Weekly Roundup of SQL Server News | Hand-picked content to sharpen your professional edge |
| A New World of Data I started in the early days of SQL Server, when having a gigabyte of disk storage was unheard of, much less a gigabyte of RAM. My watch has more storage space than the mainframe we replaced with an early version of SQL Server years ago. The technical possibilities and amounts of data we are capable of storing have changed rapidly every year of my professional life. When I got started, we strictly focused on automating processes that were previously paper-based. Once organizations started to get paper-based processes automated, they realized they could start analyzing that data and find out interesting things a lot faster than with paper spreadsheets. With basic processes automated, we started attempting to store not only store transactional data, but data about every movement that any customer makes on our websites, social media, along with recording and translating phone calls (with permission, obviously) to hopefully find details that can increase the income of companies without increasing spending. One of my first databases I designed as the lead data architect was to capture data from student web browsers working for a school system ISP. We captured a lot of data, but never did much with it because, as we realize now, relational databases are not great for capturing and analyzing un-, or even semi-structured data, especially when you have to adapt the structures over time for new needs and requirements. New, fail-fast development methodologies coupled with the desire to capture more and more data is equal parts amazing and terrifying. With the advent of unstructured data storage, there is a feeling that we can just store the data, then go back and analyze it later when we know what we are looking for. There is nothing generally wrong with this concept, but there is an old saying that the devil mixes truth in with the lies to make them sound believable. The problem lies with dealing with this vast data that is being stored. If it is not designed and catalogued as well as possible initially, the burden of analyzing the data will be too much. Let’s make the data of today into the answers to the questions of tomorrow. Just by spending a reasonable amount of time designing, ideally when data structures are new, we can make it that much easier on future data scientists to figure out what we were doing and come up with realistic understanding of the past that can help predict and shape the future. Louis Davidson (@drsql) Join the debate, and respond to the editorial on the forums |
The Weekly News | All the headlines and interesting SQL Server information that we've collected over the past week, and sometimes even a few repeats if we think they fit. |
Vendors/3rd Party Products |
In the latest version of Data Masker for SQL Server, it’s now much easier to rapidly identify sensitive data that needs masking, set up appropriate rules, see which masking rules are applied to which column, and locate what sensitive data you've yet to mask. We’ve also improved the performance of commonly used masking rules, which lets you run masking operations 3 times faster. |
Now in it’s 4th year, the State of Database DevOps report continues to deliver valuable insights. In the report, you will learn multiple tactics to improve the quality of database code deployment, whether it is by changing the type of environment used for development, enhancing your code review practices, or your change management/approval practices. Download your copy today. |
Basically, we need to put all the SQL Agent Job .sql scripts into a git repo. Then we need a PowerShell script that executes each .sql script against the necessary target databases. |
Database mail is a critical part of getting notifications from your SQL Server when things go wrong. The problem comes when you have a database mail SMTP account where... |
The single most important thing to remember about Extended Events is that this functionality is not simply a replacement for Profiler/Trace, but a whole new tool with new functionality.... |
Is there any safe way to ‘update statistics’ without causing major slow downs? As far as a safe way to update statistics. It is best to rebuild statistics in... |
For some reason I have friends / colleagues tellin... |
Introduction: Who is not aware of a SQL Database? ... |
SQL Server 2019 Big Data Clusters is one of the cool new features that’s available with the release of SQL Server 2019. The idea behind SQL Server 2019 Bid... |
Conferences, Classes, Events, and Webinars |
Free Webinar - Thursday 20 February, 4-5pm GMT / 10-11am CST - Want to combine the state-based development experience implemented in SQL Source Control and Source Control for Oracle with the customizable power of migrations-based deployments? Join this session to discover how Redgate's new flexible workflow allows exactly this. |
Have you ever had this issue? You are trying to ex... |
Abandoning a data warehouse for a data lake may not be the answer. Over the last few decades, we’ve seen an explosion in the use of data warehousing within the IT industry. |
Database Design, Theory and Development |
Phil Factor explains the factors that determine wh... |
DevOps and Continuous Delivery (CI/CD) |
As developers should not have access to production data, it’s possible that duplicate values can sneak in during migrations. In this article of the series, Phil Factor demonstrates a... |
ETL/SSIS/Azure Data Factory/Biml |
For a limited time, I am making DtsConfig Management – a feature of SSIS Catalog Compare – available in the latest (free) version of SSIS Catalog Browser. Am I... |
HA/DR/Always On/Clustering |
I have written a few blogs where I explained a few... |
Rob Sewell forwards on some exciting news: A noteb... |
Performance Tuning SQL Server |
I wanted to write an article about the interleaved execution, but what you’ll see here is a good illustration of the improvements in SQL Server database engine since the version SQL Server 2012. |
Microsoft has added a group of features called Intelligent Query Processing to SQL Server 2017 and 2019. In this article, Greg Larsen explains one of the features, Scalar UDF... |
PowerPivot/PowerQuery/PowerBI |
DAX contains a host of time-intelligence functions with exotic names such as SAMEPERIODLASTYEAR and PARALLELPERIOD. In the last article in this series, Andy Brown explains how to write measures... |
For those who are new to Power BI Paginated Reports, this blog should help you hit the ground running and create reports with high productivity. |
Besides the built-in cross-filtering and cross-highlighting among visuals, Power BI supports two explicit filtering options: slicers and filters. Which one to use? |
Over the past few weeks, I’ve been putting together a series of posts on how to connect to the Power BI Rest API programmatically to extract inventory and usage data from the service. |
This is Part 2 in developing an Income Statement in Power BI. Part 1 can be found here. The example files used for this post can be found here. |
Last week’s post showed an M function that took Power Query diagnostics data and formatted in a way that made it suitable for visualisation in a Power BI Decomposition... |
Thanks for watching this week's Power BI news roun... |
With Power BI real-time streaming, you can stream ... |
In the past week or so, the Microsoft Data Platfor... |
I had the pleasure of presenting a full-day pre-co... |
Jess Pomfret (newly awarded MVP!) is hosting month’s T-SQL Tuesday, and asked us to share our favorite life hacks – something that makes our day easier. I have two that I consider indispensable. |
In 2020, my main personal goal is to reduce doing harm, and this has been mainly inspired by the work of Kim Crayton and the #causeascene Guiding Principles. Kim... |
For this month’s T-SQL Tuesday, Jess Pomfret asked for our favorite life hacks. My life hack is a half-hour hourglass. (Halfhourglass?) Seriously, an actual physical object: I keep it... |
Simply put, we are not always going to agree. Please, take this as someone who was nicknamed “The Scary DBA” for reasons comic and tragic. I’ve screwed up a... |
Jess Pomfret (newly awarded MVP!) is hosting month’s T-SQL Tuesday, and asked us to share our favorite life hacks – something that makes our day easier. I have... |
Calculating a distance on a map sounds straightforward, but it can be confusing how many different ways there are to do this in R. This complexity arises because there are different ways of defining ‘distance’ on the Earth’s surface. |
This blog post is a part of a series on SQL Server... |
Today is Safer Internet Day which marks the annual occurrence of parents thinking about their kids' online presence (before we go back to thinking very little about it tomorrow!) |
This demanded a cross-industry summit—so now med... |
Act was “a deliberate and sweeping intrusion,”... |
I have lots of little life hacks, but the one that I want to mention today is Aggregates of Aggregates using Windowing Functions. |
Did you know that a native STRING_SPLIT function b... |
Itzik Ben-Gan discusses missing T-SQL features lik... |
Sometimes we have a date and we need to extract components of the date. For example, we might have a date and wonder what's the year or we have... |
This email has been sent to {email}. To be removed from this list, please click here. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. Note: This is not the SQLServerCentral.com daily newsletter list, and unsubscribing to this newsletter will not stop you receiving the SQL Server Central daily newsletters. If you want to be removed from that list, you can follow the instructions on the daily newsletter. |
|
|