2016-05-12 14:51:24 +00:00
|
|
|
/*
|
|
|
|
* CDDL HEADER START
|
|
|
|
*
|
|
|
|
* The contents of this file are subject to the terms of the
|
|
|
|
* Common Development and Distribution License, Version 1.0 only
|
|
|
|
* (the "License"). You may not use this file except in compliance
|
|
|
|
* with the License.
|
|
|
|
*
|
|
|
|
* You can obtain a copy of the license at usr/src/OPENSOLARIS.LICENSE
|
|
|
|
* or http://www.opensolaris.org/os/licensing.
|
|
|
|
* See the License for the specific language governing permissions
|
|
|
|
* and limitations under the License.
|
|
|
|
*
|
|
|
|
* When distributing Covered Code, include this CDDL HEADER in each
|
|
|
|
* file and include the License file at usr/src/OPENSOLARIS.LICENSE.
|
|
|
|
* If applicable, add the following below this CDDL HEADER, with the
|
|
|
|
* fields enclosed by brackets "[]" replaced with your own identifying
|
|
|
|
* information: Portions Copyright [yyyy] [name of copyright owner]
|
|
|
|
*
|
|
|
|
* CDDL HEADER END
|
|
|
|
*/
|
|
|
|
/*
|
Native Encryption for ZFS on Linux
This change incorporates three major pieces:
The first change is a keystore that manages wrapping
and encryption keys for encrypted datasets. These
commands mostly involve manipulating the new
DSL Crypto Key ZAP Objects that live in the MOS. Each
encrypted dataset has its own DSL Crypto Key that is
protected with a user's key. This level of indirection
allows users to change their keys without re-encrypting
their entire datasets. The change implements the new
subcommands "zfs load-key", "zfs unload-key" and
"zfs change-key" which allow the user to manage their
encryption keys and settings. In addition, several new
flags and properties have been added to allow dataset
creation and to make mounting and unmounting more
convenient.
The second piece of this patch provides the ability to
encrypt, decyrpt, and authenticate protected datasets.
Each object set maintains a Merkel tree of Message
Authentication Codes that protect the lower layers,
similarly to how checksums are maintained. This part
impacts the zio layer, which handles the actual
encryption and generation of MACs, as well as the ARC
and DMU, which need to be able to handle encrypted
buffers and protected data.
The last addition is the ability to do raw, encrypted
sends and receives. The idea here is to send raw
encrypted and compressed data and receive it exactly
as is on a backup system. This means that the dataset
on the receiving system is protected using the same
user key that is in use on the sending side. By doing
so, datasets can be efficiently backed up to an
untrusted system without fear of data being
compromised.
Reviewed by: Matthew Ahrens <mahrens@delphix.com>
Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov>
Reviewed-by: Jorgen Lundman <lundman@lundman.net>
Signed-off-by: Tom Caputi <tcaputi@datto.com>
Closes #494
Closes #5769
2017-08-14 17:36:48 +00:00
|
|
|
* Copyright (c) 2017, Datto, Inc. All rights reserved.
|
2016-05-12 14:51:24 +00:00
|
|
|
*/
|
|
|
|
|
|
|
|
#ifdef _KERNEL
|
|
|
|
#include <linux/module.h>
|
|
|
|
#include <linux/kernel.h>
|
|
|
|
#include <linux/init.h>
|
|
|
|
#else
|
|
|
|
#define __exit
|
|
|
|
#define __init
|
|
|
|
#endif
|
|
|
|
|
|
|
|
#include <sys/crypto/common.h>
|
|
|
|
#include <sys/crypto/api.h>
|
|
|
|
#include <sys/crypto/impl.h>
|
|
|
|
#include <sys/crypto/sched_impl.h>
|
|
|
|
#include <sys/modhash_impl.h>
|
|
|
|
#include <sys/crypto/icp.h>
|
|
|
|
|
|
|
|
/*
|
|
|
|
* Changes made to the original Illumos Crypto Layer for the ICP:
|
|
|
|
*
|
|
|
|
* Several changes were needed to allow the Illumos Crypto Layer
|
|
|
|
* to work in the Linux kernel. Almost all of the changes fall into
|
|
|
|
* one of the following categories:
|
|
|
|
*
|
|
|
|
* 1) Moving the syntax to the C90: This was mostly a matter of
|
|
|
|
* changing func() definitions to func(void). In a few cases,
|
|
|
|
* initializations of structs with unions needed to have brackets
|
|
|
|
* added.
|
|
|
|
*
|
|
|
|
* 2) Changes to allow userspace compilation: The ICP is meant to be
|
|
|
|
* compiled and used in both userspace and kernel space (for ztest and
|
|
|
|
* libzfs), so the _KERNEL macros did not make sense anymore. For the
|
|
|
|
* same reason, many header includes were also changed to use
|
|
|
|
* sys/zfs_context.h
|
|
|
|
*
|
|
|
|
* 3) Moving to a statically compiled architecture: At some point in
|
|
|
|
* the future it may make sense to have encryption algorithms that are
|
|
|
|
* loadable into the ICP at runtime via separate kernel modules.
|
|
|
|
* However, considering that this code will probably not see much use
|
|
|
|
* outside of zfs and zfs encryption only requires aes and sha256
|
|
|
|
* algorithms it seemed like more trouble than it was worth to port over
|
|
|
|
* Illumos's kernel module structure to a Linux kernel module. In
|
|
|
|
* addition, The Illumos code related to keeping track of kernel modules
|
|
|
|
* is very much tied to the Illumos OS and proved difficult to port to
|
|
|
|
* Linux. Therefore, the structure of the ICP was simplified to work
|
|
|
|
* statically and several pieces of code responsible for keeping track
|
|
|
|
* of Illumos kernel modules were removed and simplified. All module
|
|
|
|
* initialization and destruction is now called in this file during
|
|
|
|
* Linux kernel module loading and unloading.
|
|
|
|
*
|
|
|
|
* 4) Adding destructors: The Illumos Crypto Layer is built into
|
|
|
|
* the Illumos kernel and is not meant to be unloaded. Some destructors
|
|
|
|
* were added to allow the ICP to be unloaded without leaking
|
|
|
|
* structures.
|
|
|
|
*
|
|
|
|
* 5) Removing CRYPTO_DATA_MBLK related structures and code:
|
|
|
|
* crypto_data_t can have 3 formats, CRYPTO_DATA_RAW, CRYPTO_DATA_UIO,
|
|
|
|
* and CRYPTO_DATA_MBLK. ZFS only requires the first 2 formats, as the
|
|
|
|
* last one is related to streamed data. To simplify the port, code
|
|
|
|
* related to this format was removed.
|
|
|
|
*
|
|
|
|
* 6) Changes for architecture specific code: Some changes were needed
|
|
|
|
* to make architecture specific assembly compile. The biggest change
|
|
|
|
* here was to functions related to detecting CPU capabilities for amd64.
|
|
|
|
* The Illumos Crypto Layer used called into the Illumos kernel's API
|
|
|
|
* to discover these. They have been converted to instead use the
|
|
|
|
* 'cpuid' instruction as per the Intel spec. In addition, references to
|
|
|
|
* the sun4u' and sparc architectures have been removed so that these
|
|
|
|
* will use the generic implementation.
|
|
|
|
*
|
|
|
|
* 7) Removing sha384 and sha512 code: The sha code was actually very
|
2019-08-30 21:26:07 +00:00
|
|
|
* easy to port. However, the generic sha384 and sha512 code actually
|
2016-05-12 14:51:24 +00:00
|
|
|
* exceeds the stack size on arm and powerpc architectures. In an effort
|
|
|
|
* to remove warnings, this code was removed.
|
|
|
|
*
|
|
|
|
* 8) Change large allocations from kmem_alloc() to vmem_alloc(): In
|
|
|
|
* testing the ICP with the ZFS encryption code, a few allocations were
|
|
|
|
* found that could potentially be very large. These caused the SPL to
|
|
|
|
* throw warnings and so they were changed to use vmem_alloc().
|
|
|
|
*
|
|
|
|
* 9) Makefiles: Makefiles were added that would work with the existing
|
|
|
|
* ZFS Makefiles.
|
|
|
|
*/
|
|
|
|
|
|
|
|
void __exit
|
|
|
|
icp_fini(void)
|
|
|
|
{
|
2016-06-15 22:47:05 +00:00
|
|
|
skein_mod_fini();
|
2016-05-12 14:51:24 +00:00
|
|
|
sha2_mod_fini();
|
|
|
|
sha1_mod_fini();
|
2016-06-15 22:47:05 +00:00
|
|
|
edonr_mod_fini();
|
2016-05-12 14:51:24 +00:00
|
|
|
aes_mod_fini();
|
|
|
|
kcf_sched_destroy();
|
|
|
|
kcf_prov_tab_destroy();
|
|
|
|
kcf_destroy_mech_tabs();
|
|
|
|
mod_hash_fini();
|
|
|
|
}
|
|
|
|
|
|
|
|
/* roughly equivalent to kcf.c: _init() */
|
|
|
|
int __init
|
|
|
|
icp_init(void)
|
|
|
|
{
|
|
|
|
/* initialize the mod hash module */
|
|
|
|
mod_hash_init();
|
|
|
|
|
|
|
|
/* initialize the mechanisms tables supported out-of-the-box */
|
|
|
|
kcf_init_mech_tabs();
|
|
|
|
|
|
|
|
/* initialize the providers tables */
|
|
|
|
kcf_prov_tab_init();
|
|
|
|
|
|
|
|
/*
|
|
|
|
* Initialize scheduling structures. Note that this does NOT
|
|
|
|
* start any threads since it might not be safe to do so.
|
|
|
|
*/
|
|
|
|
kcf_sched_init();
|
|
|
|
|
|
|
|
/* initialize algorithms */
|
|
|
|
aes_mod_init();
|
2016-06-15 22:47:05 +00:00
|
|
|
edonr_mod_init();
|
2016-05-12 14:51:24 +00:00
|
|
|
sha1_mod_init();
|
|
|
|
sha2_mod_init();
|
2016-06-15 22:47:05 +00:00
|
|
|
skein_mod_init();
|
2016-05-12 14:51:24 +00:00
|
|
|
|
|
|
|
return (0);
|
|
|
|
}
|
|
|
|
|
2018-02-16 01:53:18 +00:00
|
|
|
#if defined(_KERNEL)
|
2016-05-12 14:51:24 +00:00
|
|
|
module_exit(icp_fini);
|
|
|
|
module_init(icp_init);
|
Retire legacy test infrastructure
* Removed zpios kmod, utility, headers and man page.
* Removed unused scripts zpios-profile/*, zpios-test/*,
zpool-config/*, smb.sh, zpios-sanity.sh, zpios-survey.sh,
zpios.sh, and zpool-create.sh.
* Removed zfs-script-config.sh.in. When building 'make' generates
a common.sh with in-tree path information from the common.sh.in
template. This file and sourced by the test scripts and used
for in-tree testing, it is not included in the packages. When
building packages 'make install' uses the same template to
create a new common.sh which is appropriate for the packaging.
* Removed unused functions/variables from scripts/common.sh.in.
Only minimal path information and configuration environment
variables remain.
* Removed unused scripts from scripts/ directory.
* Remaining shell scripts in the scripts directory updated to
cleanly pass shellcheck and added to checked scripts.
* Renamed tests/test-runner/cmd/ to tests/test-runner/bin/ to
match install location name.
* Removed last traces of the --enable-debug-dmu-tx configure
options which was retired some time ago.
Reviewed-by: Giuseppe Di Natale <dinatale2@llnl.gov>
Signed-off-by: Brian Behlendorf <behlendorf1@llnl.gov>
Closes #6509
2017-08-16 00:26:38 +00:00
|
|
|
MODULE_AUTHOR(ZFS_META_AUTHOR);
|
2016-07-29 16:43:23 +00:00
|
|
|
MODULE_LICENSE(ZFS_META_LICENSE);
|
Retire legacy test infrastructure
* Removed zpios kmod, utility, headers and man page.
* Removed unused scripts zpios-profile/*, zpios-test/*,
zpool-config/*, smb.sh, zpios-sanity.sh, zpios-survey.sh,
zpios.sh, and zpool-create.sh.
* Removed zfs-script-config.sh.in. When building 'make' generates
a common.sh with in-tree path information from the common.sh.in
template. This file and sourced by the test scripts and used
for in-tree testing, it is not included in the packages. When
building packages 'make install' uses the same template to
create a new common.sh which is appropriate for the packaging.
* Removed unused functions/variables from scripts/common.sh.in.
Only minimal path information and configuration environment
variables remain.
* Removed unused scripts from scripts/ directory.
* Remaining shell scripts in the scripts directory updated to
cleanly pass shellcheck and added to checked scripts.
* Renamed tests/test-runner/cmd/ to tests/test-runner/bin/ to
match install location name.
* Removed last traces of the --enable-debug-dmu-tx configure
options which was retired some time ago.
Reviewed-by: Giuseppe Di Natale <dinatale2@llnl.gov>
Signed-off-by: Brian Behlendorf <behlendorf1@llnl.gov>
Closes #6509
2017-08-16 00:26:38 +00:00
|
|
|
MODULE_VERSION(ZFS_META_VERSION "-" ZFS_META_RELEASE);
|
2016-05-12 14:51:24 +00:00
|
|
|
#endif
|