Windows Server 2022: How to set up disk quota

Following our disk quota overview article, we will now look at how to set up and configure a simple use case for quota management in Windows Server 2022.

At the most basic level, quotas can be applied to an entire disk volume for specified users or everybody.
Note: The best practice is to refrain from enabling disk quotas on the drive where the operating system is installed. In our examples below, an additional drive has been connected where the permissions will be applied.

Disk quotas for all users

In our first example, we will enable disk quotas for all users accessing the server.

  • To enable this, open Windows Explorer.
  • Select This PC.

  • Right-click on the drive where the quota will be enabled and select Properties.

  • Under Properties, select the Quota tab.
  • Tick the box next to Enable the quota management.
  • Tick the box next to Deny disk space to users exceeding the quota limit.

  • Select the radio button Limit disk space to (This will allow setting a disk limit and warning level.)
  • Select a value and select KB, MB, or GB from the dropdown as per requirements.
  • Click Apply and restart the computer.

    All users accessing this disk will now be limited to the storage limit applied.

Disk quotas for specific users

In our second example, we will enable disk quotas for specific users accessing the server.

  • To enable this, open Windows Explorer.
  • Select This PC.

  • Right-click on the drive where the quota will be enabled and select Properties.

  • Under Properties, select the Quota tab.
  • Tick the box next to Enable the quota management.
  • Tick the box next to Deny disk space to users exceeding the quota limit.
  • Select the radio button Limit disk space to  (This will allow setting a disk limit and warning level. )
  • Select a value and select KB, MB, or GB from the dropdown as per requirements.
  • Click Apply.
  • Click on the Quota Entries button.
  • When the Quota Entries open, select Quota on the top left and click New Quota Entry.
  • Enter a username to search for and click Check Names.
  • In our example, we have created a local user on the server with the name “Quota.”
  • When the name is found, click OK.
  • A pop-up will appear to apply a quota.
  • Select the radio button next to Limit disk space to (This will allow setting a disk limit and warning level. )
  • Select a value and select KB, MB, or GB from the dropdown as per requirements.
  • Select the desired values and click OK.
  • A new quota has been applied for the specified user.

Conclusion

Now that quotas are in place, limits can easily be increased or decreased in both scenarios.
Should you no longer wish to limit space, untick the two tick boxes in reverse order.
First, untick Deny disk space to users exceeding quota limit, and then untick Enable quota management.

Windows Server 2022: Disk Quota Overview

What is disk quota management?

Disk quota management is a feature in Windows Server 2022 to impose limits on how much storage a user account is allowed to utilize.

Why is disk quota management critical?

Managing the amount of space that a user may use, as well as enforcing a policy of the type of files they may save, assists the IT administration team in ensuring that the available storage space is not used disproportionately by a small number of users.

What file systems support disk quotas?

Disk quotas can be managed in both Windows and Linux systems.
For Windows systems, Windows Server 2000 or newer is required and only supports the NTFS file system.
For Linux systems, ext2, ext3, ext4, and XFS filesystems are supported.

Who can enable disk quotas?

Any member of the administrator group can enable this feature for the organization.

What types of limits are available?

There are two types of limits. Soft and hard.
Soft limits can be exceeded with warnings.
Hard limits cannot be exceeded.

Practical example

In this scenario, we have three user accounts allocated an equal amount of storage space on our server.
Each user account has been given a soft limit of 8 GB.
Each user account has been given a hard limit of 10 GB.

User 1 is on 7.9 GB and saves one file of 200 MB.
This now takes the current disk usage to 8.1 GB.
User 1 will receive a warning that they have exceeded the soft limit but can continue to save information.

User 1 ignores the soft limit and attempts to save a 3 GB file.
As User 1 is currently on 8.1 GB, this would require up to 11.1 GB.
User 1 will receive an error message due to insufficient space.
User 1 has three options:

  • Delete enough files to free up the required space.
  • Move ownership to User 2 or User 3.
  • Request additional space from the IT administrator.

Conclusion

Control of shared storage space is invaluable to the IT administration team.
Please refer to our step-by-step guide on how to implement disk quotas on Windows Server 2022 next.

Quota Management on Windows Server 2022

Creating quotas is a convenient way to manage capacity. With Windows Server 2022, this is easily achievable.

File Server Resource Manager

File Server Resource Manager (FSRM) is Microsoft’s recommended approach to managing and organizing data kept on Windows Server 2022.

The File Server Resource Manager consists of the below five features:

  • File Classification Infrastructure – Organise files and implement policies.
  • File Management Tasks – Implement conditional policies or tasks.
  • Quota Management – Restrict available space on shared folders.
  • File Screening Management – Limit the type of files that users can save. For example, preventing the storage of MP3’s on the files
  • server.
  • Storage Reports – Generate reports for disk utilization, data organization, and unauthorized activities.

Let’s discuss File Server Resource Manager’s quota management feature.

File Server Resource Manager Setup

Before setting up Quota Management, the File Server Resource Manager will need to be installed on Windows Server 2022.

Installation can be achieved through the GUI Server Manager.

Here are the steps for installing the tool:

  1. Log on to Windows Server 2022.
    Open Server Manager.
    Click on “Manage.”
    Graphical user interface, text, application

Description automatically generated
    Select “Add Roles and Features.”
    Graphical user interface, text, application

Description automatically generated
  2. If prompted with the “Before You Begin” screen, click “Next.”
    Graphical user interface, text, application

Description automatically generated
  3. Select “Role-based or feature-based installation” and click “Next.”
    Graphical user interface, text, application, email

Description automatically generated
  4. Select the server to install the feature on and click “Next.”
    Graphical user interface, text, application

Description automatically generated
  5. Under “Select Server Roles,” expand “File and Storage Services.”
  6. Next, expand “File and iSCSI Services.”
  7. Select “File Server Resource Manager” and click “Next.” Graphical user interface, text, application

Description automatically generated
  8. Select “Add Features”
    Graphical user interface, text, application

Description automatically generated
  9. Click “Next.”
  10. Start the installation process by clicking “Install.”
    Graphical user interface, text, application

Description automatically generated
  11. Once complete, select “Close.”
    Graphical user interface, text, application

Description automatically generated
  12. File Server Resource Manager can now be accessed via the Start menu or the Administrative Tools in the Control Panel.

Quota Creation with File Server Resource Manager

Managing quotas is the best way to define how much space is available to a user, or group of users, on a file server. For example, limit users to 5GB on a shared folder. This rule would prevent users from adding data to the folder that exceeds 5GB.

File Server Resource Manager can also be configured to send notifications whenever a specified threshold is reached. For example, specify that an email is at 85% of the available space being consumed.

Creating quotas using the FSRM tool is a two-step process:
Create a template
Create a quota

A) Create a template

In order to set quotas, a quota template needs to be created. This template can be custom or chosen from a default template already in the File Server Resource Manager.

The recommended approach is to only create quotas from templates. Managing quotas is simplified by changing templates. In addition, the process of central management of quotas eases the enforcement of storage policy rules.

To create a quota template:

  1. Open the File Server Resource Manager.
    Expand the “Quota Management” in the left-hand pane.

Right-click “Quota Templates.”

Select “Create Quota Template.”
Graphical user interface, application

Description automatically generated with medium confidence

  1. Mandatory fields for creating a template are the name, space limit, and selecting either a hard or soft quota.

Hard quotas will prevent users from exceeding the specified limit. Hard quotas are an excellent choice for controlling available storage.
Soft quotas are primarily for monitoring purposes as they will warn but not prevent passing a specified limit.
Graphical user interface, text, application, email

Description automatically generated

  1. To set threshold notifications, select “Add.”
    Configure the desired options.
    Select “OK” to complete the template creation.
    Graphical user interface, text, application, email

Description automatically generated

B) Create a quota

After setting up the quota template or using a default quota template, create the quota.

Quota creation steps:

  1. Right-click on the File Server Resource Manager’s dashboard “Quotas.”
  2. Select “Create Quota.”
  3. On the “Create Quota” window, in the “Quota path” section, select “Browse.”

Browse to the path that requires quota enablement

Select either the “Create quota on the path” or the “Auto apply template and create quotas on existing and new subfolders…” option.

The quota will only be applied to the primary folder if you select the first option.

For example, limiting the parent folder to 5GB shares the space for all subfolders.
The quota will apply to the subfolders by selecting the second option.
For example, limiting the parent folder to 5GB allows each subfolder an individual quota of 5GB.

  1. Select “Derive properties from this quota template”.
  2. Select the template you created in section A above.
  3. Select “Create.”
    Graphical user interface, application, Word

Description automatically generated
    Graphical user interface, text, application, email

Description automatically generated
  4. After creating the quota, it will be visible on the File Server Resource Manager dashboard. Limits will now be applied to the shared resource.
    Graphical user interface, text, application, email

Description automatically generated

Do you want to learn about NTFS Permissions, Share Permissions, and how to use them?

Managing Disk Quotas on Windows Server 2019

Disk quota management provides a way of controlling the disk space available to users accessing the server and storing files.

When a user exceeds their quota, then they can no longer add additional data.

The File Server Resource Manager (FSRM) feature in Windows Server 2019 gives system administrators the ability to set the storage quota as well as determine the type of files that can be saved on the file server.

What is FSRM in Windows Server?

FSRM is a Windows Server feature which allows you to classify and save data in file servers. FSRM gives you extra control of the data on your computer.

The history of FSRM dates back to 2005 when Microsoft launched the product. It was initially used in the Windows 2003 server R3 edition. The feature provides a one-in-all solution, especially for volumes that keep increasing.

Disk quotas have been there for a long time. Without them, people could upload large volumes of data (mostly pirated videos, movies or MP3 songs) into your servers.

The large volume uploads can slow down your server and increase your operating costs. It also presents a challenge with copyright content.

Some tools, like Windows Explorer, allow you to assign quotas to volumes, but with some limitations.

Administrators can easily switch to Windows Server 2019 via the Storage Migration Service. With a myriad of useful features, Windows Server 2019 is the ultimate server for modern businesses.

You can integrate your server with existing applications and utilize every storage feature of FSRM.

The Storage Migration service identifies your old server’s data and moves it to your new server.

Whether you want to move into the cloud or latest Azure’s servers, this migration service is your best tool.

The migration server works with all servers from Windows Server 2003 to Server 2019.

It has no limitations, and will only require you to domain-link your old and new server. However, it only supports file transfers and not applications; you’ll have to manually reinstall your applications later.

FSRM Features

FSRM has the following five main features that help in accomplishing its tasks:

i. File classification structure

This disk quota feature automates all the data arranging processes. It helps administrators to access and use meaningful data.

In Windows Server 2019, the file classification structure comes with additional features for organizing server data more logically.

Examples of classification structures in Windows Servers include dynamic access control, file expiration, and file encryption. The dynamic access control policy limits users from accessing some files. Windows Server 2019 has complex file encryption techniques that protect your data from unauthorized users.

ii. File management tasks

This feature is available in most Windows Server versions. It assists the admin to apply policies or conditions on the data depending on how they are classified.

Such conditions include file properties, such as the date it was modified, file location, and last access date. The files classification can be done automatically by following the stipulated classification rules.

Alternatively, you can manually classify them by altering the file properties.

iii. Quota management

This feature enables an administrator to limit the size of folders or volumes. It is a useful feature, especially for new volumes and folders.

Besides, you can use this feature to create quota templates, which you can apply later to new folders and volumes.

iv. Storage reports

This component of FSRM is useful in identifying disk usage trends. It also helps administrators to understand how FSRM carries out data classification.

You can use the feature to monitor whether users are uploading unauthorized files.

v. File screening management

End-users may upload large gigabytes of data into your servers, resulting into a slow server with high manageability costs. You may also encounter challenges with compliance due to pirated movies and other content.

The file screening management feature helps you to tackle this problem by allowing you to regulate what end users can upload to your server.

File screening also lets you limit the extensions one can store in your shared files. For instance, you can create a file that prevents users from adding m4a. files on personal folders in the shared server system.

NB: FSRM only supports volumes with NTFS formats. It doesn’t support resilient volume types.

As we’ll demonstrate later, you can configure and manage these features that come with the File Server Resource Manager by using the FSRM app or the Windows PowerShell utility.

What you can do with FSRM

  • Create a policy that allows access to folders and files depending on their organization in the file server
  • Expire a file that has not been modified for a certain period of time
  • Create up to 200 Megabyte (MB) quota for each user and notify them when their storage usage exceeds 180MB
  • Schedule a day for reporting, such as Sundays. From the report, you can gauge the most accessed files in the previous two days before the report.
  • Prevent users from adding music to personal shared folders
  • Generate a file classification rule that categorizes files with more than ten types of information as having identifiable information.

Benefits of FSRM

1. Supports advanced quota management capabilities

Some tools, like Windows Explorer, have lesser capabilities for arranging and managing quotas. FSRM not only brings you a centralized console for managing your quotas per volume, but also per folders and per files. It has on-top notifications that you can use to effectively manage your quotas.

With FSRM quota tools, you can apply quotas on different paths in the same volume. NTFS quotas allow you to apply quotas per volume only and are less useful.

To apply a quota to different paths, you’ll need to set a quota template. Therefore, you can simply modify these quotas by updating the template. You can also create both soft and hard quotas.

2. Regulates server content

Managing quotas is not enough. You may need to keep potentially sensitive data off your servers. Piracy concerns are a major issue and require compliance from all stakeholders. Keep off pirated movies, MP3s or MP4s off your server, as having them could infringe on copyright regulations.

Copyright infringement is a serious offense and could lead to consequences like server closure. So, you need to be on the safe side by enabling the file screening capability. You can introduce file screening on a volume, folder, or file. For instance, you can stop users from saving files with .mp3 extension into C:/Personal finance.

Since the folder belongs only to finance-related files, other items like mp3 songs shouldn’t be allowed in the folder. If a user tries to save the file into the folder, the system generates an error.

The pop-up error will affect all users who want to upload such content to the server. Such users will not upload unwanted content to the site, hence improving your data management strategy. More so, you can monitor users who violate your regulations by posting unauthorized content.

To implement file screening, you will have to use file groups. Besides, you can apply file exclusions when configuring the file groups.

For example, you may want to block video files except those with .mp4 patterns. This way, users will be unable to save files unless they meet your defined pattern requirements. File exclusion is also possible with certain naming formats.

As such, users will be unable to save files unless they match your stipulated naming format.

3. Generates storage utilization reports

FSRM is probably the first tool which provides the data and statistics of volume usage. Microsoft initially perceived the tool to be used as a departmental server.

You can use FSRM to generate the following data reports:

  • File location
  • Duplicate files
  • Last modified date
  • Last access date
  • File type
  • Files and folder by property
  • Folder by property
  • Least and most recently accessed files
  • Quota usage

These properties make FSRM an effective storage resource manager.

4. Locates files easily

FSRM allows you to locate files by sorting them. You can locate files easily by using file properties or performing tasks against these files.

Furthermore, you can search your files by sorting them using the last modified, name, or creation time property. Alternatively, you can use its location or file type property to locate a file easily among many other files.

How to install FSRM step-by-step

FSRM is the best tool for managing quotas and creating file screens. The techniques for installing the tool differ with every Windows Server edition. However, the basic rules apply to Windows Server 2019.

You’ll be required to download FSRM before starting the installation.

There are two main methods for installing FSRM in Windows Server 2019:

  • PowerShell installation
  • Graphical User Interface (GUI) installation

1. PowerShell installation

To install the FSRM role feature, you can follow the steps below:

  1. Open the PowerShell utility by pressing Windows key+ R
  2. Type PowerShell and press OK
  3. In the next window that appears, type the command below and press Enter:

Install-WindowsFeature -Name FS-Resource-Manager, RSAT-FSRM-Mgmt

Entering the code will initiate the installation process for the FSRM role. You don’t have to restart your computer after the installation completes.

The FS-Resource-Manager will install FSRM while RSAT-FSRM-Mgmt will install the FSRM feature. This feature is important for accessing the GUI component, which manages FSRM. With the feature, you can easily run a server without the GUI. You’ll only be required to install the RSAT remotely; you can then access the FSRM system remotely.

2. GUI installation

In case you want to install FSRM using the GUI instead of PowerShell, you’ll use the Server Manager. With the GUI, you’ll have to perform many tasks than when using the PowerShell installation.

Here are the steps for installing FSRM using GUI.

Open Server Manager and click on ‘Add roles and Features’:

On the next Window, click ‘Next’:

On the next screen, choose the “role-based or feature-based” option:

Choose a virtual hard disk or server you want to add its roles and features. Then, click “Next”:

On the “Select server roles” page, expand the File and Storage services tab:

After checking the “File Server Resource Manager” box, click the “Next” button.

The next page will prompt you to install FSRM RSAT tools. Click “Add Features” and proceed:

Confirm the FSRM installation.

After waiting for the installation to complete, you can launch the FSRM from the server manager:

To access FSRM, Go to Tools > File Server Resource Manager:

The FSRM window will open:

Configuring quotas

As mentioned earlier, quotas put a limit on the disk space allowed on a drive or a folder. Importantly, quotas come in handy when sharing a personal drive among many users. For example, you can put a limit of 10 GB on a drive or a folder.

There are two types of quotas:

  • Quota on the path—this is a scenario where quota is applied on the main folder only
  • Auto apply template and create quota—this is where the main folder together with the sub folders are all under a defined quota. That is, if you apply a quota of 10 GB on the parent folder, each of the subfolders will have a quota of 10 GB

Creating quota templates

Before embarking on creating quotas, let’s talk about how to create quota templates or predefined templates. Here are the steps.

First, right click on Quota Templates and click on ‘Create Quota Template’ option:

Specify the quota name and the quota limit, as shown below. A hard quota implies that you cannot exceed the limit. For soft quota, you get notified when you exceed the limit.

When all is done, click ‘OK’:

If you wish to send notifications via email, click the ‘Add’ button:

Then, fill out all the necessary details, such as the threshold for getting notifications and the administrator’s email.

Then click “OK”:

How to configure FSRM

Configuring FSRM is a piece of cake that consists of three main areas:

  • Quota management
  • File screening
  • Storage reporting

1. How to create and manage quotas

In a shared server system, users can add their files to the server. To prevent overwhelming the server, the administrator can use quotas to allocate each user a storage portion.

There are two main types of quotas:

  • Soft quotas whereby users can exceed the set limit. The administrator assesses the users in a specific path and their current storage usage; and, once the soft limit is passed, the server sends a usage warning or generates event logs.
  • Hard quotas whereby a user cannot exceed the set limit. Once a user reaches the limits, they will be unable to store more data to the file path.
How to create a quota

First, go to the FSRM management interface and select “Quotas”. Then, Select the “Create Quota” option:

Next, you can create a new quota by specifying various options, such as:

  • The path for new quota—indicates the path for your new quota. Alternatively, you can apply it to existing folders and subfolders.
  • Custom quota properties—you can choose soft and hard quota limits. For a soft limit, you’ll need to enter a warning notification.

Lastly, click the Create button.

Finally, the quota will now be created, and you can see it from the console, as shown below:

2. Configuring file screening

File screening is restricting some file formats from being stored in a path. It is only possible with file names and not file contents.

FSRM comes with two categories of file screening:

  • Active screening—does not allow users to save restricted files
  • Passive screening—enables users to save restricted data but with monitoring
How to configure file screening template

If you want to create a file screening template, right click on the File Screen Template option:

In the pull-down menu, click on “Create File Screen Template”. Then, fill all the required details in the Template Window:

3. Generating reports

FSRM allows you to generate various reports that assist with your file server management tasks. You can schedule these reports over a certain period to monitor disk usage trends.

The reports can help you to monitor a user or groups of users who may attempt to store unauthorized files on your server. The FSRM tool allows you to generate such reports instantly.

To access your reports, you can open the file report tasks. Click “generate report” and press “OK”. The system will generate a DHTML report and prompt you to open it.

Conclusion

Those are the everyday tasks you can perform with the File Server Resource Manager 2019. You can also perform complex tasks such as File Server Classification.

Do you have any comments or questions?

Please post them below.

Report the NTFS Permissions of Folders and Shares – fast and simple to use!

Protect yourself and your clients against security leaks and get your free trial of the easiest and fastest NTFS Permission Reporter now!

Windows Server Deduplication: An Essential Introduction

Deduplication is one of the useful features of Windows Server since the launch of the 2008 R2 version.

It is a native feature added through the server manager that gives system administrators enough time to plan server storage and network volume management.

Most Server administrators rarely talk about this feature until it is time to address the organization’s storage crunch.

Data deduplication works by identifying similar data blocks and saving a copy as the central source, thus  reducing the spread of data all over the storage areas. Deduplication takes place on a file or block level, giving you more space in the server.

Special hardware components, which are relatively expensive, are required to explore the block level deduplication. The reason behind extra hardware is the complex processing requirements involved.

The file level deduplication is not complicated and, thus, does not require the additional hardware. As such, in most cases, administrators implementing deduplication prefer the file approach.

When to Apply Windows Server Deduplication

Since Windows Server file deduplication works on the file level, its operations work on a higher level than a block level, as it tries to match chunks of data.

File deduplication is an operating system level, meaning that you can enable this feature within a virtual guest in a hypervisors environment.

Growth in industries is also driving the demand for deduplication, although storage hardware components are becoming bigger and affordable.

Deduplication is all about fulfilling this growing demand.

Why is Deduplication Feature Found on Servers?

Severs are central to any organization’s data, as users store their information on repositories. Not all users embrace new technology on how to handle their work, while others feel safe making multiple copies of the same work.

Since most Server administrators do the work of  managing and backing up users’ data, using the Windows deduplication feature greatly enhances their productivity.

Data deduplication in a straightforward feature and will take a few minutes to make it active.

Deduplication is one of the server roles found on Windows Servers, and you do not need a restart for it to work.

However, it is safe to do so to make sure the entire process is configured correctly.

Preparing for Windows Server Duplication

  • Click on start
  • Click on the run command window
  • Enter the following command and press enter (this command runs against selected volume to analyze potential space for storage): DDEval.exe
  • Right click on the volume in Server Manager to activate data deduplication

The following wizard will guide you through the deduplication process depending on the type of server in place. (Choose a VDI or Hyper-V configuration or File Server)

Set up The Timing for Deduplication

Deduplication should run on scheduled time to reduce the strain on existing resources. You should not aim to save storage space at the expense of overworking the server.

The timing should be set when there is little strain on the server to allow for quick and effective deduplication.

Deduplication is a task that requires more CPU time because of the numerous activities and processes taken by each job.

Other deduplication demands include optimization, integrity scheduling, and garbage collection. All these deduplication activities should be running at peak hours unless the server has enough resources to withstand system slowdowns.

The capacity that deduplication reclaims varies depending on server use and storage available.

General files, ISOs, office applications files, and virtual disks usually consume much of the storage allocations.

Benefits of Windows Server Deduplication

Windows Server deduplication brings several benefits to an organization, including the following:

  • Reduced storage allocation

Deduplication can reduce storage space for files and backups. Therefore, an enterprise can get more storage space, reducing the annual cost of storage hardware. With enough storage, there is a lot of efficiency and speed, which eliminates the need for installing backup tapes.

  • Efficient volume replication

Deduplication ensures that only unique data is written to the disk, which reduces network traffic.

  • Increasing network bandwidth

If deduplication is configured to run at the source, then there is no need to transfer files over the network.

  • Cost-effective solution

Since power consumption is reduced, there is less space required for extra storage of both local and remote locations. The organization buys and spends less on storage maintenance, thus reducing the overall storage costs.

  • Fast file recovery process

Deduplication ensures faster file recoveries and restorations without straining the day’s business activities.

Features of Deduplication

1. Transparency and Ease of Use

Installation is straightforward on the target volume(s). Running applications and users will not know when deduplication is taking place.

The file system works well with NTFS file requirements. However, files using the encryption mode, Encrypted File System (EFS), files that have a capacity smaller than 32KB, or those with Extended Attributes (EAs), cannot be processed during deduplication.

In such cases, file interaction takes place through NTFS, and not deduplication. A file with an alternative data stream will only have its primary data stream deduplicated, as the alternative will be left on the disk.

2. Works on Primary Data

This feature, once installed on the primary data volumes, will operate without interfering with the server’s primary objective.

This feature will ignore hot data (active files at the time of deduplication) until it reaches a given number of days. The skipping of such files maintains consistency of the active files and shortens the deduplication time.

This feature uses the following approach when processing special files:

  • Post procession: when new files are created, the files go directly to the NTFS volume where they are evaluated on a regular schedule. The background processing confirms file eligibility for deduplication, every hour, by default. The scheduling for confirmation time is flexible
  • File age: a setting on the deduplication feature called MinimumFileAgeDays controls how long a file should stay on the queue before it is processed. The default number of days is 5. The administrator can configure it to 0 to process all files.
  • Type of file and location exclusions: you can instruct the deduplication feature not to process specific file types. You can choose to ignore CAB files, which do not help the process in any way as well as any other file type that requires a lot of compression space such as PNG files. There is an option of directing the feature not to process a particular folder.

3. Portability

Any volume that is under deduplication runs as an automatic unit. The volume can be backed up and moved to a different location.

Moving it to another server means that anything that was in that file is accessible on its new site.

The only thing that you need to change is schedule timings because the native task scheduler controls the scheduler.

If the new server location does not have a running deduplication feature, you can only access the files that have not been deduplicated.

4. Minimal Use of Resources

The default operations of the deduplication feature use minimal resources on the primary server.

In case the process is active, and there is a shortage of resources, deduplication will surrender the resources to the active process and resumes when enough is available.

Here’s how storage resources are utilized:

  • The hash index storage method uses low resources and reduces read/write operations to scale large datasets and deliver high edit/search performance. The index footprint left behind is excessively low and uses a temporary partition.
  • Deduplication verifies the amount of space before it executes. If no storage space is available, it will keep trying at regular intervals. You can schedule and run any deduplication tasks during off-peak hours or during idle time.

5. Sub-file Segmentation

The process segments files into different sizes, such as between 32 to 128 KB using an innovative algorithm developed by Microsoft and other researchers.

The segmentation splits each file into a sequence depending on its content. A Rabin fingerprint, which is a system based on the sliding Window hash, helps to identify the chunk boundaries.

The average size of every segment is 64KB and it is compressed and placed into a chunk store that is hidden in a folder located at the System Volume Information (SVI) folder.

A reparse point, which is a pointer to the map of all data streams, helps in replacing the normal files when requested.

6.BranchCache

Another feature you can get from deduplication is that sub-file segmentation and indexing engine is shared with BranchCache feature.

This sharing is important because when a Windows Server is running and all the data segments are already indexed, they can be quickly sent over the network as needed, consequently saving a lot of network traffic within the office or the branch.

How Does Deduplication Affect Data Access?

The fragmentations created by deduplication are stored on the disk as file segments that are spread all over, increasing the seek time.

Upon the processing of each file, the filter driver will work overtime to maintain the sequence by keeping the segments together in a random fashion.

Deduplication keeps a file cache to avoid repeating file segments, helping in their quick access. In case multiple users access the same resource simultaneously, that access pattern enables speeding up of the deduplication for each user.

Here are some important points to note:

  • No much difference is noted when opening an Office document; users cannot tell whether the feature is running or not
  • When copying one bulky file, deduplication will send end-to-end copy that is likely to be 1.5 times faster than it would take a non-deduplicated file.
  • During the transfer of multiple bulky files simultaneously, cache helps to transfer the file 30% times faster
  • When the file-server load simulator (File Server Capacity Tool) is used to test multiple file access scenarios, a reduction of about 10% in the number of users supported will be noticed.
  • Data optimization increases between 20-35 MB/Sec per job that easily translates to 100GB/hour for a single 2TB volume running on one core CPU with a 1GB RAM. This is an indicator that multiple volumes can be processed if additional CPU, disk resources, and memory allocations are available.

Reliability and Risk Preparedness

Even when you configure the server environment using RAID, there is still the risk of data corruption and loss attributed to disk malfunctioning, control errors, and firmware bugs.

Other environmental risks to stored data include radiation or disk vibrations.

Deduplication raises the risk of disk corruption, especially when one file segment referring to thousands of other files is located in a bad sector.

Such a scenario gives a possibility of losing thousands of users’ data.

Backups

Using the Windows Server Backup tool runs a selective file restore API to enable backup applications to pull files out of the optimized backup.

Detect and Report

When a deduplication filter comes across a corrupted file or section of the disk, a quick checksum validation will be done on data and metadata.

This validation helps to recognize any data corruption during file access, hence reducing accumulated failures.

Redundancy

An extra copy of critical data is created, and any file segment with more than 100 references is collected as most popular chunks.

Repair

Once the deduplication process is active, scanning and fixing of errors becomes a continuous process.

Inspection of the deduplication process and host volumes takes place on a regular basis to scrub any logged errors and fix them from alternative copies.

An optional deep scrubber will walk through the whole data set by identifying errors and fixing them, if possible.

When the disk configurations are set to mirror each other, deduplication will look for a better copy on the other side and use it as a replacement.

If there are no other alternatives, data will be recovered from an existing backup.

Verdict on Deduplication

Some of the features described above does not work in all Window Server 2012 editions and may be subject to limitations.

Deduplication was built for volumes that support the NTFS data structure.

Therefore, it cannot be used with Cluster Shared Volumes (CSV).

Also, Live Virtual Machines (VMs) and active SQL databases are not supported by deduplication.

Deduplication Data Evaluation Tool

To get a better understanding of the deduplication environment, Microsoft created a portable evaluation tool that installs into the \Windows\System32\ directory.

The tool can be tested on Windows 7 and later Windows operating systems.

It is installed through the DDPEval.exe and supports local drives, mapped, unmapped, and remote shares.

If you are using Windows NAS or an EMC /NetApp NAS, you can test it on a remote share.

Conclusion

The Windows Server native deduplication feature is now becoming a popular feature.

It mirrors the needs of a typical server administrator working in production deployments.

However, planning for deduplication before implementation is necessary because of the various  situations in which its use may not be applicable.

Windows Server 2016 —What’s New in Data Deduplication

Deduplication eliminates the need to repeat data to create a single instance. The creation of the single instance improves storage utility and efficiencies in a network with heavy network transfers.

Some may confuse deduplication with data compression, which identifies repeat data within single files and encodes the redundancy.

In simple terms, deduplication is a continuous process that eliminates excess copies of data; therefore, decreasing storage demands.

Data deduplication applies to Windows Server, the Semi-annual Channel, and Windows Server 2016.

Data deduplication in Windows Server 2016 is a highly optimized, manageable, and flexible process.

Here are the updated and new data deduplication features in Windows Server 2016.

The Updated Features

Here are two of the updated features.

1. Support for Large Volumes

In earlier versions, volumes were partitioned to fit data sizes that are above 10TB.

However, in Windows Server 2016, data deduplication supports volume sizes of up to 64TB.

  • What is the Added Value?

The volumes in Windows Server 2012 R2 had to be appropriately portioned in the correct sizes to ensure optimization demands keep up with the rate of data transfer.

The implication here was that data deduplication could only work on volumes with data of 10TB or less. The performance also depended on existing workloads on write patterns.

  • What is Different?

Windows Server 2012 R2 uses a single thread and an input and an output queue for every volume.

This is to maximize optimization and make sure jobs do not fall behind, which can affect the volume’s overall saving rate. This way, large data sets have to be broken into small volumes.

The volume size depends on the expected partition size; the maximum size is between 6 and 7TB for high volumes and 9 and 10TB for low volumes.

Windows Server 2016 has a new way of working with data deduplication: it runs on more than one thread and uses multiple inputs and outputs for every volume.

This introduces a new routine that was only possible after dividing data into small chunks.

2. Support for Large Files

In earlier versions, any file approaching the 1TB size was not eligible for deduplication.

However, Windows Server 2016 supports files with a maximum size of 1TB.

  • What is the Added Value?

In Windows Server 2012 R2, you cannot deduplicate large files due to reduced performance in the deduplication process queue.

In Windows Server 2016, deduplication of files of up to 1TB is possible.

Consequently, this enables you to save a large volume of work; for example, reduplicating large backup files.

  • What is Different?

Windows Server 2016 deduplication process uses new streaming and mapping structures to improve the deduplication output and its access.

Besides, the process can now be optimized when there is a failure, instead of restarting the entire process. Deduplication affects files with a capacity of 1TB.

The New Features

Here are three of the new features.

1. Support for Nano Servers

Nano servers support is a new feature that is available in any Nano Server Deployment option in Windows Server 2016.

  • What is the Added Value?

Nano servers is a headless deployment in Windows Server 2016 that need a smaller system for tracing resources. It enables quick startups and needs fewer updates and restarts than the Windows Server Core Deployment version.

2. Simple Backup Support

The Windows Server 2012 R2 support Virtualized Backups, like Microsoft Data Protection Manager, after successful manual configurations.

Windows Server 2016 has some new default backups that allow for seamless data deduplication for Virtual backups.

  • What is the Added Value?

For this to happen in earlier versions of the Windows Server, you needed to manually tune deduplication settings, as opposed to Windows Server 2016 that has a simplified process for its Virtualized backup applications.

Server 2016 enables deduplication for each volume, just the same way as the General Purpose File Servers.

3. Support for Clusters Operating System Rolling Upgrade

Data deduplication is capable of supporting the new Cluster OS Rolling Upgrade feature in Windows Server 2016.

  • What is the Added Value?

The failover clusters in Windows Server 2012 R2 can have a mix of nodes that run deduplication alongside nodes that operate Windows Server 2016 versions of deduplication.

This improvement adds full access to the data that is being deduplicated during the rolling upgrade.

Consequently, it allows the gradual rollout of the new version of data deduplication on an existing Windows Server 2012 R2 cluster without experiencing downtimes during the upgrading process.

  • What is Different?

In earlier versions of the Windows Server, a failover cluster required that all nodes in a cluster must be of the same Windows Server version.

However, in Windows Server 2016 version, the rolling upgrades allow clusters to run in mixed modes.

Four Best Free Disk Space Analyzing Tools

More Space! The Four Best Free Disk Space Analyzing Tools for Windows Servers

Having sufficient hard drive space is the desire of every computer user. Who doesn’t constantly check to find out whether there is enough disk space left for a new application, picture, or anything else?

With a good analyzing tool, you can conveniently examine what is taking up most of the room in your hard drive, and take appropriate actions to reclaim your resources.

Here are four of the best free tools you can use to scan your hard drive and pinpoint files and folders unnecessarily consuming extra space on your Windows machine.

1. WinDirStat

WinDirStat is a powerful, free tool you can use to analyze the space available in your hard drive.

You can download it from here.

It has a simple, beautiful interface, which enables you to see exactly what’s consuming drive space. After you’ve launched WinDirStat, it will begin to scan your hard drive, and display the results in three panes.

The top-left pane displays a directory list displaying the size occupied by folders and files. The biggest folders are at the top of the list, allowing you to easily identify the big space consumers.

The top-right pane displays the various file types on your local disk, together with the amount of space they consume.

The bottom pane displays a “treemap”, which is a color-coded representation of what is using the drive’s space.

For instance, if you click on any directory in the directory list, and click the ‘+” button to expand its contents, you’ll see a corresponding area highlighted in the treemap. You can click any area on the tree to see the folder or file it represents.

If you want to delete any folder or file from your hard disk, right-click on it and select the “Delete” option.

 

2. SpaceSniffer

This free tool displays the data associated with the space occupied by files and folders in a nice-looking visual treemap. This way, you can easily identify which items are consuming the largest amount of space in your hard disk.

You can download the tool from here.

 

As you can see from the above screenshot, after the scanning process is complete, SpaceSniffer utilizes blocks of various sizes to demonstrate the sizes of the files (default color is blue) and folders (default color is brown).

If you want to get more information about any particular file or folder, just double click its respective block, and you’ll be sent deeper the rabbit the hole—to eventually right click to access other options like “Delete”.

You can do filtering to get some specific results. For example, on the filter field, you can type *.jpg and press enter, and the results will have only JPEG files.

In case you want to export the results, then under the “File” tab, click “Export to file”, and follow the prompts.

3. TreeSize

TreeSize, the free version, is another excellent tool you can use to analyze your hard disk space. It has a slick interface to assist you quickly keep an eye on your hard drive usage.

You can download it here.

Once a scan is completed, TreeSize will display the results for your analysis. The section on the left shows the amount of space each folder occupies—with the colored bar visualizing the extent of the occupied disk space. You can click on a folder to open it and see the sub-folders. You’ll notice that longer and opaque bars represent larger folders, and vice versa.

The three visualization options available are pie chart, bar chart, and treemap. The option you choose will be displayed at the center of the tool.

 

Under the “Extensions” view, you’ll find different types of files, and the size of their occupied space. You can also see the amount of space every computer user utilizes under the “Users” view.

 

On the bottom-left section, there is a drive list that displays used and free disk space on each single drive. The S.M.A.R.T. (Self Monitoring Analysis and Reporting Technology) is a unique feature that scans the hard drive and gives its health condition. If failure is displayed in the column, it indicates that you should replace your hard drive as soon as possible.

<tree03>

4. Windows 10 in-built tool

Is a bird in hand worth two in the bush?

Then, if you can’t access any of the above tools for any reason, then you can use the in-built Storage settings tool that comes with Windows 10. It can be your bird in hand to assist you quickly identify the heavy space consumers in your hard drive.

To use this feature, click “Settings”, “System”, and then select “Storage” from the ensuing list. Here, you’ll be presented with a list of items consuming the drive’s space.

If you click any category, you’ll be able to see how space is utilized in the chosen drive. For instance, you’ll be presented with a list of applications available in your system, which you can sort according the space they consume.

Even though this in-built Windows 10 does not have extensive features like the others, it’s a quick way of analyzing your disk space, and save yourself the hassle of downloading and installing a third-party software.

What’s New in Storage in Windows Server 2019 and 2016

Window Server Edition 2016 and 2019 have new features, which have made it possible to use storage migration capabilities for storing data.

The migration service helps in keeping inventory when moving from one platform to another.

This article will try to explain what is new in the storage systems of Windows Server 2016, Windows Server 2019, and other semiannual releases.

We will start by highlighting some of the key features added in the two server systems.

Managing Storage with Windows Admin Center

The Windows Admin Center is a new feature that runs on Windows Server 2019 and some latest versions of Windows.

It is the central location where an App handles the server functions, clusters, and hyper-converged infrastructure containing storage locations.

The Admin Center does this as part of the new server configurations.

Storage Migration Service

The Storage Migration Service is the latest technology that makes it easy to move servers from old to new server versions.

All the events take place via a graphical interface that displays data on the servers and transfers data and configurations to the new servers; thereafter, it optimally moves old server identities to the new ones, ensuring the settings for apps and users are matched.

Storage Spaces Direct Improvements (Available in Server 2019 only)

Several improvements have been made to Storage Spaces Direct in Server 2019, though they are not available in Windows Server, Semi-Annual channel.

Here are some of the improvements:

1. Deduplication and Compression of ReFS Volume

You will be able to store up to 10X more data on the same storage space using deduplication and compression of the ReFS system.

You only need to turn on this feature, using a single click, on the Windows Admin Center.

The increase in storage sizes, with an option to compress data, amplifies the saving rates.

Furthermore, the multi-threaded post processing feature assists in keeping performance impact low.

However, it supports a volume of up to 64TB and with each file reaching 1TB.

2. Native Support for Persistent Memory

Windows Server 2019 comes with native support for persistent memory.  This allows you to speed up performance for the continuous creation of memory modules, including the Intel Optane DC PM and NVDIMM-N.

You can use persistent memory as your cache to accelerate the active working set or use it as an extra space needed to facilitate low latency.

Of course, you can manage persistent memory the same way you can manage any other storage device in Windows Admin Center or PowerShell.

3. Nested Resiliency for Two-Node Hyper-Converged Infrastructure on the Edges

The all new software resiliency option, inspired by RAID 5 + 1, helps in surviving two hardware failures.

The nested resiliency for the two-node Storage Spaces Direct cluster offers continuous accessible storage for programs and virtual machines, even when one server node fails.

4. Two-Server Cluster Using USB Flash Drive as a Witness

You an use a low-cost USB flash plugged into your router to act as a witness between two servers in a cluster.

If the server is down, the USB will know which of the servers has more data.

5. Improved Windows Admin Center

The opportunity to manage and monitor Storage Spaces Direct with the newly built dashboard lets you create, delete, open, and expand volumes, with a few clicks.

You can follow performances of IOPS and IO latency, from the entire clusters to the individual hard disks and SSDs.

6. Increased Performance Logs Visibility

You can use the built-in history feature to see your server’s resource utilization and performance capabilities.

It has more than 50 counters that automatically collect  memory, computation, storage and network data, and store them in the cluster for a full year.

This feature works without the need to install or configure anything.

7. Scale up to 4PB for Every Cluster

The Windows Server 2019 Storage Spaces Direct feature supports up to 4 petabytes (PB) (4,000 terabytes).

This way, you can get to the level of multi-petabyte scale, which makes sense in media servers for backup and archiving purposes.

Other capacity guides are increased as well; for instance, you can create volumes reaching 64, and not 32.

More so, the clusters can be stitched together into a set to make the scaling that fits within one storage namespace.

8. Accelerated Parity is now 2X Faster

You can now create Storage Spaces Direct Volumes that are part mirror and part parity.

For example, you can mix RAID-1 and RAID -5/6 to harness the advantages of both.

In Windows Server 2019, the performance of mirror accelerated parity is twice that of Windows Server 2016, due to optimizations.

9. Drive Latency Outline Detection

Using proactive monitoring and the built-in outlier detection, which is an inspiration from Microsoft Azure, you can know which drives have abnormal latency.

You can see the failing drives that have been labeled automatically in the PowerShell and Windows Admin Center.

10. Manual Delimiting of Volume Allocations to Increase Fault Tolerance

In Storage Spaces Direct, the Admin can now manually change the limit of volume allocations.

Delimiting is usually done to increase fault tolerance in specific circumstances that consider management  complexities.

Storage Replica

The Storage Replica has the following improvements:

1. Introduction of Storage Replica in Windows Server, Standard Edition

It is now possible to use Storage Replica with Windows Server, Standard Edition, as well as the Datacenter editions.

Running Storage Replica on Windows Server, Standard Edition has the following weaknesses:

  • Storage replica can replicate a single volume and not an unlimited volume number
  • Volume varies with some taking up to 2TB, instead of taking an unlimited size

2. Storage Replica Log Performance Improvements

The Storage Replica comes with improvements that enhance the tracking of logs.

To get the increased performance, all members of the replication group must run Windows Server 2019.

3. Test Failover Improvements

You can mount a temporary snapshot of the replicated storage on destination server for testing or backing up purposes.

4. Windows Admin Center Support

Support for the graphical management of replication is made possible via the Server Manager Tool.

This involves server-to-server replication, cluster-to-cluster, and stretch cluster replication.

5. Miscellaneous Improvements

Storage Replica also has the following improvements:

  • Changes to asynchronous stretch cluster behaviors for automatic failover to take place.
  • Multiple bug fixes

SMB

SMB1 and Guest Authentication Removal

Windows Server does not install the SMB1 client and server by default, while, at the same time, the ability to authenticate guests in SMB2 if off by default.

SMB2/SMB3 Security and Compatibility

More options for security and applications compatibility were added, including disabling opLocks in SMB2+ for old applications.

This also covers the need for signing encryption on every connection from the client.

Data Deduplication

Data Deduplication Supports ReFS

You’ll not need to choose between the advantages of a modern file system with ReFS and Data Deduplication.

Anytime you enable Data Deduplication, enabling ReFS is also possible now.

Data Port API for Optimized Ingress/egress to Deduplicated Volumes

As a developer, you’ll now enjoy the advantages of data deduplication and possibilities of storing data in an efficient manner

File Server Resource Manager

The Windows Server 2019 can prevent the File Resources Manager service from creating a change (USN) journal on storage volumes.

This is to create and conserve more space on every volume; however, it will disable real-time classification.

This is the same effect that takes place in Windows Storage Server, Version 1803.

What’s New in Storage in Windows Server, Version 1709

Server Version 1709 is the first Windows Server release with a Semi-Annual Channel, which is a channel that is fully supported in production for 18 months, with a new version coming in every six months.

Storage Replica

Disaster recovery and protection is an added function of the Storage Replica, which is now expanded to include:

  • Test Failover

You now have an option of mounting the destination storage through a test failover.

You can also mount the snapshots temporarily for both testing and backup purposes.

  • Windows Admin Center Support

Thee is support for the graphical applications that are managing replications. You can access it via the  Server Manager Tool.

Storage Replica also has the following improvements:

  • Changes to asynchronous cluster behaviors to enable automatic failover
  • Multiple bug fixes

What’s New in Storage in Windows Server 2016

1. Storage Spaces Direct

The Storage Spaces Direct feature facilitates the availability and scalability of storage using servers with local storage.

This implies that it’s now possible to deploy and manage software that control storage systems, unlocking the use of new classes of storage devices.

These devices include SATA, SSD, and NVMe disks. Achieving such storage capabilities may not be possible using clustered Storage Spaces with Shared Disks.

What Value Does this Change Add?

Storage Spaces Direct allows service providers and enterprises to use industry standard servers with local storage.

The idea is to build highly available and scalable software-defined storage.

The use of servers with local storage decreases complexity, as it increases scalability and allows the use of storage devices such as SATA solid state disks. This lowers the cost of flash storage or NVMe sold state Disks

Storage Spaces Direct Removes the need to have a shared SAS fabric, which simplifies deployment and configuration.

This means that the server uses the network as the storage fabric while leveraging the SMB3 and SMB Direct (RDMA) for both high speed and low latency, as well as good use of the processing unit.

Adding more servers to the configuration increases storage capacity and input and output performance.

The Windows Server 2016 Storage Spaces Direct works differently, as explained below.

2. Storage Replica

It enables the storage, block-level stretching of failover clusters between sites, as well as the synchronous replication between servers.

Synchronous replication enables mirroring of data in physical sites with consistent volumes to ensure no data is lost at the file system level.

Asynchronous replication may increase the possibility of data loss.

What Value Does this Change Add?

It provides a single vendor disaster recovery solution for both planned and unplanned power loss situations.

You can use SMB3 transport and gain from proven performance, scalability, and reliability.

It will help you to:

  • Stretch Windows failover clusters further
  • Use Microsoft end-to-end software for storage and clustering, such as Hyper-V, Scale-Out File Server, Storage Replica, Storage Spaces, ReFS/ NTFS, and deduplication

It helps in reducing complexity costs by:

  • Being hardware agnostic with no specific requirements for storage configurations like DAS or SAN
  • Allowing for the storage of commodities and network technologies
  • Featuring easy graphical management interface for nodes and clusters through failover cluster manager
  • Including comprehensive and large scale scripting options through the Windows PowerShell
  • Helping in the reduction of downtimes and enhancing  large scale productivity
  • Providing supportability and performance metrics and diagnostic capabilities

What Works Differently

The functionality is new in Windows Server 2016

3. Storage Quality of Service

In Windows Server 2016, you can use the Storage Quality of Service (QoS) feature as a central monitor for end-to-end storage performance and developing management policies using Hyper-V and CSV clusters.

What Value Does this Change Add?

You can change the QoS policies in a CSV and assign one or more virtual disks on Hyper-V machines.

The storage automatically adjusts itself to meet the fluctuating policies and workloads.

This way, each policy can give a minimum reserve or create a maximum to be used when collecting data.

For example, a single virtual hard disk, a tenant, a service or a virtual machine can be used.

You can use Windows PowerShell or WMI to perform the following:

  • Create policies on CSV cluster
  • Assign the policies to virtual hard disks
  • Enumerate policies on the CSV clusters
  • Monitor flow performance and status of the policies

If you have several virtual hard disks sharing the same policy and performance is shared to meet the demands within the policy’s minimum and maximum settings, it means that the policy can manage virtual hard disks and a single or multiple virtual machines that constitute a service owned by a tenant.

What Works Differently

This is a new feature in Windows Server 2016.

The management of minimum reserves and monitoring the flow of all virtual disks over a cluster using a single command and central policy-based management are not possible in the previous Server releases.

4. Data Deduplication

Function

New or Updated

Description

Support large volumes

Updated Before Windows Server 2016, you had to specify sizes. Anything above 10TB did not qualify for deduplication. Server 2016 supports deduplication sizes of up to 64TB

Large file support

Updated Before Windows Server 2016, files with 1TB could not deduplicate. Server 2016 supports deduplication of files up to 1TB.

Nano Server Support

New Deduplication is available and fully supported for Server 2016

Simple Backup Support

New Windows Server 2012 R2 supported Virtual backups using the Microsoft’s Data Protection Manager. Windows Server 2016 simple backup is possible and is seamless

Cluster OS Rolling Upgrades Support

New Deduplication supports Cluster OS Rolling Upgrade and is available in Windows Server 2016

5. SMB Hardening Improvements for SYSVOL and NETLOGON Connections

Windows 10 and Windows Server 2016 client connections to the Active Directory Domain Service, the SYSVOL, and NETLOGON now all share domain controllers that require SMB signing and authentication via Kerberos.

What Value Does this Change Add?

It reduces the possibility of man-in-the-middle attacks

What Works Differently?

If the SMB and mutual authentication are not available, Windows 10 or Server 2016 will not access the domain-based Group Policy Scripts.

It is also good to note that the registry values of the settings are not present by default; the hardening rules will apply until a new policy change comes in through Group Policy or any relevant registry values.

6. Work Folders Improvements

The added changes to notifications are there when the Work Folder server is running on Windows Server 2016, and the Work Folder is on a client running Windows 10.

What Value Does this Change Add?

In Windows Server 2012 R2, when the changes in files are synchronized to the Work Folder, clients will get notified of the impending changes and wait for at least 10 minutes for the update to materialize.

When running Windows Server 2016, the Work Folders will immediately notify the Windows 10 client, and the synchronization changes take effect immediately.

What Works Differently

This is a new feature in Windows 2016.

For this feature to work, the client accessing the Work Folders must be a Windows 10.

In case you are using older clients, or if the Work Folder is on Windows Server 2012 R2, the client will poll every 10 minutes for any new changes.

7. ReFS Improvements

The ReFS (Resilient File System) offers support for large scale data storage allocation with varying workloads, reliability, resiliency, and scalability.

What Values Does this Change Add?

ReFS brings in the following improvements:

  • Implementing new storage tiers that help in delivering fast performance and increased capacity
  • Multipling resiliency on the same virtual disk through mirroring and parity tiers
  • Enhancing responsiveness to drifting working sets
  • Introducing a block of cloning and improvements to VM operations such as vhdx checkpoint merge operations
  • Helping in the recovery of leaked storage and keeping them from being corrupted

What Works Differently?

These functionalities are new in Windows Server 2016.

Conclusion

With so many features available in Windows Server 2019, this article covered the fully supported features.

At the time of writing this post, some features were partially supported in earlier versions but are getting full support in the latest Server versions.

From this read, you can see that Windows Server 2019 is a good upgrade experience.

Windows Server Disk Quota – Troubleshooting

DISK QUOTA CHALLENGES AND TROUBLESHOOTING

Disk quotas come in handy and allow system administrators to equitably distribute disk space among multiple users in shared servers or PCs. This avoids a situation where a careless user ends up filling the entire hard drive and wreaking havoc in the system. However, quotas do not always work as intended.

As easy as it may seem in setting up disk quotas, sometimes things may go a bit askew. Occasionally, users can get allocated a volume of disk space which is less than what was specified in the settings. This usually happens when the server runs out of space. However, there are situations where you may get the impression that they have received less hard drive space than what was configured. The reason behind this is the misconception that shrouds the meaning of quota allocation when it comes to a user’s files. What users do not realize is that quotas take into account all files that are owned by a user. And this includes files in the recycle bin. This is true especially if disk quotas are implemented on local PCs. Since the recycle bin resides on the PC, this is scenario or discrepancy is most likely to occur.

Another unusual thing that may arise is the unavailability of space despite a user relinquishing the ownership of their files. A user may create a file, change its ownership but still, the file will be counted in the quota.

Another confusing scenario is the use of compressed folders. Windows looks at compressed folders not in their compressed size, but rather, in their original size. This means that quotas look at compressed files in their original uncompressed format, not according to the current size they occupy on the hard drive in their compressed format.

Sometimes, when the disk space limit is exceeded, the user may realize that deleting files in the volume may not free up space as expected. This occurrence has been noted in Windows Server 2008 R2. This happens due to incorrect filling of the file content structure when the deletion happens.

As a solution to this issue, Microsoft released a hotfix which can be downloaded from their official site via this link https://support.microsoft.com/hotfix/kbhotfix.aspx?kbnum=2679054&kbln=en-US

Once you apply the hotfix, run the command below

dirquota quota scan /path: d:\users\scratch

For instance, the above command will apply on scratch folder located in users directory.

After running the command, reboot the system to effect the hotfix settings.

This occurs because the file context structure is not filled in correctly when you delete the files.

In case a user is using a system whose hard drive is formatted using FAT or FAT-32 filesystem, they’ll be required to format it to NTFS filesystem since NTFS filesystem is the only filesystem that acknowledges the concept of quotas as well as file ownership. This compels the system administrator to first perform a file backup of the files contained in the FAT & FAT-32 partitions and later format the volumes to NTFS filesystem. This can be quite tedious and cumbersome. It’s therefore important to ensure all volumes are formatted in NTFS filesystem if you are planning to have several users using or backing up data in the system. This is because disk quotas only work with NTFS volumes only.

Windows Server Disk Quota – Setup and Configure

In the previous post, we looked at the disk quota functionality and how quotas are handy in limiting disk space utilization for shared systems. This is crucial in ensuring that all users get equal space allocation and systems’ performance is kept at an optimal level. In this post, we’ll take a practical approach and see how we can manage and control disk space utilization to prevent users from filling up the hard disk and leaving no more space for anyone. To recap some of the important features about disk quotas, the quota can only be applied to volumes which have been formatted in NTFS filesystem. They are mostly used in corporate networks but can as well be used on a home PC running Windows OS including the basic Windows 10 home. You can choose to set quotas per individual user or apply them on everyone. However, you cannot implement limits on groups. For best practices, quotas should be configured or set per volume basis and not per computer, and upon execution, newly added users will begin using them as expected. That said, let’s dive deeper and see how you can implement this functionality to manage and control hard drive space utilization.

Setting Quota Limits

Although implementing quotas can be done on any disk volume, it can prove quite tricky setting limits on Drive C, which is the Windows installation volume. Try as much as possible to enable quotas on secondary volumes or partitions and plan accordingly. There are two ways of setting quotas. You can set them per account or on a volume basis. Let’s see how you can set quotas on Account basis:

Setting up Quota Per Account basis on Windows

If you want to set disk space limit on end users, while at the same time having your account occupy unlimited space, follow the steps outlined below:

  1. Fire up the File Explorer. This is done by using the (Windows key + E) shortcut.
  2. On Windows 10, Locate This PC tab and click on it.
  3. Under “Devices and drives,” right-click on the preferred drive that you wish to manage. In the menu that appears, select Properties option.
  4. Select the Quota tab.
  5. Click the Show Quota settings tab.
  6. The Quota status Windows will open. Check the first option, which is the Enable quota management option.
  7. Just below the option in 6 above, Locate and Check the Deny disk space to users exceeding quota limit option. This option enables disk space limitation.
  8. Next, Click on the Quote Entries button at the bottom right corner of the window
  9. In case the account you want to restrict is not listed, click Quota, and select New Quota Entry.
  10. In the “Select Users” tab, click on the Advanced button. This displays a pop up window
  11. Next, click on the Find Now button.
  12. At the bottom of the Windows, a list of user accounts will be listed. Select the account you’d want to effect limits on.
  13. Next, Press OK.
  14. Press OK again in the previous Window.
  15. Select the Limit disk space to radio button option.
  16. Set the desired volume of space you’d want and specify the restriction unit size (for instance, MB, GB or TB).
  17. Set the preferred space size before a warning is triggered and specify the size unit (for instance, MB, GB or TB).
  18. Click on Apply option.
  19. Finally, Click on OK.

After following and completing the above procedure, the quotas will take effect immediately users login in. Users will be restricted to the amount of disk space size set and get a warning when approaching the limit as specified in step 16 and 17 above.

Setting up Quota Per Volume basis on Windows

Should you decide to limit the available storage space for all users, follow the steps outlined below:

  1. Fire up File Explorer. This is done by using the (Windows key + E) shortcut.
  2. On Windows 10, Locate This PC tab and click on it.
  3. Under the “Devices and drives,” section, right-click on the preferred drive that you wish to manage. In the menu that appears, select Properties option.
  4. Hit on the Quota tab.
  5. Click the Show Quota Settings tab.
  6. The Quota status Windows will open. Check the first option, which is the Enable quota management option.
  7. Next, Locate and Check the Deny disk space to users exceeding quota limit option. This option enables disk space limitation.
  8. Select the Limit disk space to option.
  9. Set the desired amount of space and specify the size unit (e.g., MB, GB).
  10. Set the amount of space before a warning is triggered to the user and specify the size unit (for example, MB or GB).
  11. Click Apply.
  12. Click OK.
  13. Finally, Reboot your computer.

Once you completed the above procedure, all accounts on your system will now be able to use part of the total available disk space storage. A warning will be triggered to alert or warn users that they’re approaching their maximum storage quota. Should the threshold be reached, users will no longer be able to create and store any more files on the volume. They will either have to delete existing files or move them to another location.

One can always adjust – increase or decrease – the storage quota by making changes to the Limit disk space to & Set warning level to options in step 8

If you decide that you no longer want to put restrictions on the hard disk volume users can use on a drive, you can use the same instructions. In step number 8, select Do not limit disk usage option and uncheck the Deny disk space to users exceeding quota limit as well as the Enable quota management options.

In summary, we have seen how you can plan and implement disk quotas on Windows Systems, both on per user account and volume basis. In the next post, we’ll see some of the challenges that are likely to occur and how you can go around them.