Problems displaying this newsletter? View online.
SQL Server Central
Featured Contents
Question of the Day
The Voice of the DBA
 

Fitting Into RAM

This editorial was originally published on Sept 21, 2018. It is being republished as Steve is on vacation.

RAM has always been a fairly limited resource in most of the computer systems I've worked with in my career. Often there is never enough RAM, and I'd always like more, often to speed up the systems. That has somewhat changed with laptops, as 16 GB really works well for me most of the time. Not that I wouldn't take a 32GB machine, but I'm waiting for them to become more common and smaller.

This has especially been true for database servers. It seems that I've rarely had a database server that could fit my entire database in RAM. Even now, I have an over-provisioned server for SQLServerCentral which has plenty of spare capacity, but I'm still slightly short on RAM. The target level for SQL Server is about one GB more than I have set. Not really worth complaining about, but still I don't have the RAM I'd like.

Last week I wrote about someone that attacked the RDBMS as old and troublesome technology. As a part of this, a method of storing all data in memory was presented. I'm not sure I think this is actually a good or practical idea for most systems, but I did wonder about the idea of data space and size. Certainly I have seen plenty of index space in databases, and certainly there is more index data than other data at times, but I suspect that's not the case for many databases.

Regardless, I was curious if anyone has large databases that couldn't fit into RAM these days. If you think about the largest database you have, how big is it, in terms of data size. Not allocated size, but the total data space used. Would this fit into RAM if you could get 1TB or 2TB of memory? If you can, what about index sizes, are they large? There are a few scripts in this thread if you need one.

I suspect there are certainly databases that don't fit into RAM, and likely plenty of instances with more than 1 database that don't have enough RAM. I still see plenty of people with less than 64GB on their servers, so that's a battle still being fought. I certainly wouldn't advocate an in-memory only database, likely because there are going to be other issues, but it's still an interesting thought. Certainly my server has only 60GB allocated and the databases are well over that in aggregate.

Maybe asking for a bit more RAM on those critical servers is the way to go, especially if you think you can get the entire database into memory.

Steve Jones - SSC Editor

Join the debate, and respond to today's editorial on the forums

 
 Featured Contents
Stairway to DAX and Power BI

Stairway to DAX and Power BI - Level 22: Time Intelligence – Dates Functions: The DAX NEXT() Functions

Bill Pearson from SQLServerCentral

Business Intelligence Architect, Analysis Services Maestro, and author Bill Pearson introduces four very similar DAX Time Intelligence functions related to Date: NEXTDAY(), NEXTMONTH(). NEXTQUARTER() and NEXTYEAR(). He discusses the syntax, uses and operation of each function, and then provides hands-on exposure to it in Power BI.

External Article

First speakers announced for Summit 2023

Additional Articles from Redgate

Your first speakers in the lineup for PASS Data Community Summit 2023 have been announced! Check out the full details for this year's Pre-Cons and Learning Pathways, and find out why some of our speakers are particularly excited for what’s in store this year.

External Article

The difference between libraries and frameworks

Additional Articles from SimpleTalk

The concept behind frameworks and libraries is to provide reusable code that you can use to perform everyday tasks so that developers don’t have to write all of the code from scratch for every project. However, there are some differences that you need to understand as you start writing code, which I will cover in this article.

Blog Post

From the SQL Server Central Blogs - Storytelling for DBAs and Other Technical Folk 

Kevin3NF from Dallas DBAs

(for your reading pleasure, written by Jules. –ed) We have all had that sinking feeling of defeat: you’ve just finished explaining a very important and highly technical thing to...

Blog Post

From the SQL Server Central Blogs - Microsoft Fabric introduction video

James Serra from James Serra's Blog

I blogged about Microsoft Fabric a few weeks ago, and wanted to follow up with an introduction video that covers the basics so hopefully you will understand the major...

Microsoft Power BI Quickstart Guide cover

Microsoft Power BI Quick Start Guide: The ultimate beginner's guide to data modeling, visualization, digital storytelling, and more, 3rd Edition

Steve Jones - SSC Editor from SQLServerCentral

Bring your data to life with this accessible yet fast-paced introduction to Power BI, now in color.

 

 Question of the Day

Today's question (by Steve Jones - SSC Editor):

 

Managed Instance Differential Backups

If I have an Azure SQL Managed Instance, how often does Microsoft run the automated differential backups.

Think you know the answer? Click here, and find out if you are right.

 

 

 Yesterday's Question of the Day (by Steve Jones - SSC Editor)

Data Engineering in Fabric

One of the parts of Microsoft Fabric is the data engineering section. What does this consist of?

Answer: This is the data movement and cleansing area, with a Lakehouse, Spark jobs, notebooks scheduled to run and data pipeline in ADF

Explanation: Data Engineering in Microsoft Fabric includes the Lakehouse, Spark jobs run, notebooks scheduled and run, and the data pipelines run from ADF. Ref: What is Data Engineering in Microsoft Fabric? - https://learn.microsoft.com/en-us/fabric/data-engineering/data-engineering-overview

Discuss this question and answer on the forums

 

 

 

Database Pros Who Need Your Help

Here's a few of the new posts today on the forums. To see more, visit the forums.


SQL 2012 - General
Can I install SQL failover on a single node WSFC cluster? - For depressing reasons, I'm installing 2012. Don't ask.  For some other reasons I've had to create a single node WSFC cluster (& will add a node later).  I want to install SQL FCI (not standalone) but I'm struggling.  It could be lots of things, group policy, permissions ...  but ... Q 1  - is it […]
SQL Server 2019 - Administration
List SPN for NT Service\MSSQLServer account - Does anyone know how to list the SPN for the NT Service\MSSQLServer account ? I've created the following combinations and nothing is working setspn -L MSSQLSERVER setspn -L NT Service\MSSQLSERVER setspn -L "NT Service\MSSQLSERVER" setspn -L 'NT Service\MSSQLSERVER' When the VM was created via terraform the NT Service\MSSQLSERVER account was used to run the service […]
File extensions errors - Processed: Jun 27 2023 3:02AM, LogDate: Jun 27 2023 3:01AM, Server: [WARNING] === At least 4 extensions for file {XXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXX} (sql\ntdbms\hekaton\engine\hadr\mtlog.cpp : 6063) What do the above warnings mean? Do they need to be investigated - if yes-how do we troubleshoot them or can they be ignored. Thanks      
SQL Server 2019 - Development
Arithmetic overflow error when using POWER function - Hello, Any help appreciated. This code should perform a internal rate of return (IRR) calculation. It generates correct data based on what was provided to me using Excel's IRR function. It looks like as GETDATE() gets close to my hard coded date the error is generated. Any suggestion to prevent the error would be appreciated. […]
Preventing Arithmetic overflow error when using POWER function - Hello, Any help appreciated. This code should perform a internal rate of return (IRR) calculation. It generates correct data based on what was provided to me using Excel's IRR function. It looks like as GETDATE() gets close to my hard coded date the error is generated. Any suggestion to prevent the error would be appreciated. […]
Update view from dynamic sql - I'm using the code below to change the name of the columns in a view but it doesn't actually update the view. What do I need to do so that the view is updated? Thanks.   DECLARE @code4 VARCHAR(9); SET @code4 = CONVERT(VARCHAR(2),month(DATEADD(MONTH,DATEDIFF(MONTH, 0, GETDATE()) - 4, 0))) + ' - ' +CONVERT(VARCHAR(4),year(DATEADD(MONTH,DATEDIFF(MONTH, 0, GETDATE()) […]
DELETE with SELECT and join in SQL SERVER - I have a select statement below which gives the expected results of duplicate data. I want to convert this statement to a DELETE Statement to delete items leaving a single item but getting error. Below is my query. Sample data SampleOne 2016-10-14 12:44:39.460 SampleOne 2016-10-14 12:44:39.460 SampleTwo 2016-10-14 12:44:39.460 SampleTwo 2016-10-14 12:44:39.460 SELECT t.* FROM […]
Out of 3 same/ similar rows, remove two and keep one - Hello everyone, I would like to ask someone for an advice. I am not even a 100% sure it is doable, but it might be. I have a table that returns the same or almost the same rows of information often times 3 times. Basically there are 3 types of Transactions: 1. GL Posted - […]
SQL Azure - Administration
How to read file metadata from an Azure Blob location? - Anyone recommend the best way to accomplish this? Powershell? Or can you do this via external data sources?   All I need to do is read file metadata from folders in azure blob storage so I can get the filename and date file created for audit purposes.   Thanks in advance!
Reporting Services
SSRS reports URL in database - We would like to include userID in the reportURL, so that later we can see the report execution data for specific users. I know we can query the database using ExecutionLog3, but I don't see a URL field included. Any where store that information, what is the best way to get report execution counts for […]
Integration Services
How to skip Deleted Servers - I have a SQL table with some servers and a package which runs of those servers. 1.Execute task to list the servers from the table. 2.For each loopcontainer inside which I have data flow task which in turn has oledbsource and oledbdestination. The package runs fine when all servers are present.If a server is deleted […]
T-SQL
Use BCP and a format file to export data to a text file - I would like to use BCP and a format file to export data to a text file in a fixed length format. Fields export. The length and starting and ending position. Last Name Length 20 Position 1-20 First Name Length 15 Position 21-36 Social Security Number Length 9 Position 37 46 AddressLine1 Length 30 Position […]
SQL Server 2022 - Administration
SQL Server running on Linux, instance starts almost 2 mins after the service - SQL Server (2022) running on Linux (SuSE 15.4), instance starts almost 2 mins after the service. When the system starts, systemctl status mssql-server.service reports, something like Active: active (running) since Wed 2023-06-28 15:47:57 UTC; 2min 43s ago However, sql server is not available immidately, has to wait almost 2 mins before can be queried. When […]
SQL Server 2022 - Development
how to identify sql scripts not in stored procs w/o using trace - I'm storing off various stats about procs on a daily basis. On e of them stores each sql statement in each proc w/ runtimes and other information.   My issue is there are power bi reports and sql job step that are not using procs but have embedded the sql scripts directly in them . […]
issue with text column in dbo.syscomments - I wrote a process to store off all sql objects daily. There is one that stores off all stored procedures contents daily. The text column in the dbo.syscomments table is being stored locally in another table whose column is a varchar(max). It stores each proc in 4000 char chunks. So there will be one record […]
 

 

RSS FeedTwitter

This email has been sent to {email}. To be removed from this list, please click here. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com.
©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved.
webmaster@sqlservercentral.com

 

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -