SQL TRANSACTION MANAGEMENT WITH JSON INPUT PARAMETER AND NESTED STORED PROCEDURES ON SQL SERVER
This article is aimed to introduce SQL developers to the management of sql transaction with the context of json parameters and nested stored procedures. In order to reuse programmatical object in SQL server (procedures, functions), a SQL developer might need to use nested stored procedures…
Moving Files and Subfolders Using PowerShell
We usually come across situations where we need to move files and folders to another directory say for archival or some other purpose. There are many scripting languages which can be used for it but we are going to see here the power of PowerShell…
How to monitor your Sql server Jobs
When the company’s organization become large and production database servers have hundreds of jobs running with different schedule, the DBA might lose track of what job must be run successfully and in a timely matter. Various reasons such as sql server maintenance windows could require…
The Importance of Protecting Your Data: Introduction and Focus on the Rebase Server Solution
Many organizations are now facing with a lot of compliance regulations, from SOCII to PCI, GDPR to KYC compliance and many audits are done to understand how they protect their data from external hacking but also internal employees. The biggest threat might not be the…
Sql server: use of views and filtered indexes
Hello, I have been working lately with several companies, within Ecommerce, telecommunications and payments industries and they all had a team that needed to work on looking at last week or last month invoicing and ordering from clients. The issue was that for 2 companies,…
SQL server: Purging data using switch out
On very large database tables, most of my clients have decided to archive the data by extracting them first and then purging old data based on a Date column using something like : DELETE FROM <SchemaName>.<TableName> WHERE <DateField> < GETDATE() – X days. Not only…
Clustered Columstore and Nonclustered filtered indexes
Hello DBA friends, I had the most bizarre experience on a SQL server 2016 (sp2). On the cumulative hotfixes after, the closest one from the error is this one : https://support.microsoft.com/en-us/help/4316858 It is still not quite the error that I got though. With a client,…
Should you shard or centralize your database ?
Preamble: Nowadays, business tends to get very big database very quickly and they usually need to find ways to manage functionally and physically data in a more efficient matter, both for security and performance reasons. In many ways, centralizing the operating database can make your…
Phase 2: AE and search patterns
Hello again, This time, I implemented the same code but with encryption and hashing, encryption with a symetric key for the email addresses and hashing for the dictionary. This would be similar as implementing random encryption for the email address field and deterministic encryption for…
Phase 1: AE and search patterns
As I was saying in an earlier article, Always Encrypted is a key element of the GDPR compliance implementation: how to encrypt and be able to search the personal data. It is rather better not to be able to search as you can increase encryption…
SQL server: Indexed views and filtered indexes: making your very large database smaller.
Hello, For many clients, I have been able to manage very complex tuning with indexed views and filtered indexes. Indexed views: virtual framework physically maintained! Of course, indexed views are schema binding. Schema binding tables via indexed views offer additional advantage in terms of securing…
Rolling Snapshot dbs setup to correct quickly large errors on production
Hello Guys, You might have wondered if there was a solution that could keep a version of your database in case you/a process made a huge mistake (large update without the where for example) on a production database. You also want the solution to avoid…
SQL server: how to improve multi-threaded inserts on frequently-accessed tables
Hello again, So today we will talk about an issue that I have seen in two of my clients. One of them is a very suffessful Ecommerce that persists the shopping carts (not in cookie) and has millions of users storing in the cart products,…
Data vs Database management
I wrote this article a few years ago noting a change in paradigm where data was more important than database…. meaning the ACID paradigm enforced by the database engine was somewhat an old fashioned way of thinking of data storage…. Is this true? Any point…
The dynamic filtered indexes
I have struggled with one client on queries that were dealing with date ranges or type ranges or many filters, on very large tables with low density in many cases, and you knew one index would really improves it but it was based on some filter…
SQL server tuning: DML for multiple rows in one shot
hello guys, Today’s topic relate to a series of trainings I spent doing at one of the top 10 ECommerce in Europe as a database/etl architect for 2 years time. The idea of those series were to train junior to senior level developpers on how…
Telecommuting! the key for social progress!
Hello Guys again, Although my blog main concern is about SQL server, I like to share my experience in the telecommuting field, misconceptions and reality. Telecommuters works more efficiently than Onsite people: TRUE I believe hiring telecommuters is eventually more efficient than OnSite people. A…
Musings on optimizing your OLAP processing in SSAS: measures and partitions
There are many ways to set up your cube but there are definite best practices to implement if you want to scale your cube. The first point will just remind us that a cube is an analytical tool and should not be used as a…
SQL server: musings about distributed environments, distributed transactions, and project development cycle
1. Understanding the concept One of the main challenges to a distributed system is how to handle transactions across several servers and technologies. What if your application connect for the same transactions to several web services or database servers and if any failure occurs, need…
Data partitioning on Sql Server Express, Standard and Enterprise edition – Part 1
Before going into details in how to setup data partitioning on SQL server, it is important to understand data partitioning concept. So first, I will give a simple definition of what it is. Understanding the concept Data partitioning is a way to spread data on…