zfs/module/zfs
Jitendra Patidar 361a7e8211
log xattr=sa create/remove/update to ZIL
As such, there are no specific synchronous semantics defined for
the xattrs. But for xattr=on, it does log to ZIL and zil_commit() is
done, if sync=always is set on dataset. This provides sync semantics
for xattr=on with sync=always set on dataset.

For the xattr=sa implementation, it doesn't log to ZIL, so, even with
sync=always, xattrs are not guaranteed to be synced before xattr call
returns to caller. So, xattr can be lost if system crash happens, before
txg carrying xattr transaction is synced.

This change adds xattr=sa logging to ZIL on xattr create/remove/update
and xattrs are synced to ZIL (zil_commit() done) for sync=always.
This makes xattr=sa behavior similar to xattr=on.

Implementation notes:
The actual logging is fairly straight-forward and does not warrant
additional explanation.
However, it has been 14 years since we last added new TX types
to the ZIL [1], hence this is the first time we do it after the
introduction of zpool features. Therefore, here is an overview of the
feature activation and deactivation workflow:

1. The feature must be enabled. Otherwise, we don't log the new
    record type. This ensures compatibility with older software.
2. The feature is activated per-dataset, since the ZIL is per-dataset.
3. If the feature is enabled and dataset is not for zvol, any append to
    the ZIL chain will activate the feature for the dataset. Likewise
    for starting a new ZIL chain.
4. A dataset that doesn't have a ZIL chain has the feature deactivated.

We ensure (3) by activating on the first zil_commit() after the feature
was enabled. Since activating the features requires waiting for txg
sync, the first zil_commit() after enabling the feature will be slower
than usual. The downside is that this is really a conservative
approximation: even if we never append a 'TX_SETSAXATTR' to the ZIL
chain, we pay the penalty for feature activation. The upside is that the
user is in control of when we pay the penalty, i.e., upon enabling the
feature.

We ensure (4) by hooking into zil_sync(), where ZIL destroy actually
happens.

One more piece on feature activation, since it's spread across
multiple functions:

zil_commit()
  zil_process_commit_list()
    if lwb == NULL // first zil_commit since zil_open
      zil_create()
        if no log block pointer in ZIL header:
          if feature enabled and not active:
	    // CASE 1
            enable, COALESCE txg wait with dmu_tx that allocated the
	    log block
         else // log block was allocated earlier than this zil_open
          if feature enabled and not active:
	    // CASE 2
            enable, EXPLICIT txg wait
    else // already have an in-DRAM LWB
      if feature enabled and not active:
        // this happens when we enable the feature after zil_create
	// CASE 3
        enable, EXPLICIT txg wait

[1] da6c28aaf6

Reviewed-by: Matthew Ahrens <mahrens@delphix.com>
Reviewed-by: Christian Schwarz <christian.schwarz@nutanix.com>
Reviewed-by: Ahelenia Ziemiańska <nabijaczleweli@nabijaczleweli.xyz>
Reviewed-by: Ryan Moeller <freqlabs@FreeBSD.org>
Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov>
Signed-off-by: Jitendra Patidar <jitendra.patidar@nutanix.com>
Closes #8768 
Closes #9078
2022-02-22 13:06:43 -08:00
..
Makefile.in Updated the lz4 decompressor 2022-01-07 10:36:49 -08:00
THIRDPARTYLICENSE.cityhash OpenZFS 8484 - Implement aggregate sum and use for arc counters 2018-06-06 09:35:59 -07:00
THIRDPARTYLICENSE.cityhash.descrip OpenZFS 8484 - Implement aggregate sum and use for arc counters 2018-06-06 09:35:59 -07:00
abd.c Rename fallthrough to zfs_fallthrough 2022-02-15 08:58:59 -08:00
aggsum.c More aggsum optimizations 2021-06-07 09:02:47 -07:00
arc.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
blkptr.c Add zstd support to zfs 2020-08-20 10:30:06 -07:00
bplist.c Fast Clone Deletion 2019-07-26 10:54:14 -07:00
bpobj.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
bptree.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
bqueue.c Implement Redacted Send/Receive 2019-06-19 09:48:12 -07:00
btree.c Add `--enable-asan` and `--enable-ubsan` switches 2022-02-03 14:35:38 -08:00
dataset_kstats.c Introduce write-mostly sums 2021-05-27 14:27:29 -06:00
dbuf.c Remove unneeded "extern inline" function declarations 2022-02-08 10:48:57 -08:00
dbuf_stats.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
ddt.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
ddt_zap.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
dmu.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
dmu_diff.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
dmu_object.c Introduce CPU_SEQID_UNSTABLE 2020-11-02 11:51:12 -08:00
dmu_objset.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
dmu_recv.c module: mark arguments used 2022-02-18 09:34:03 -08:00
dmu_redact.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
dmu_send.c Report dnodes with faulty bonuslen 2022-02-03 14:28:19 -08:00
dmu_traverse.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
dmu_tx.c module: mark arguments used 2022-02-18 09:34:03 -08:00
dmu_zfetch.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
dnode.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
dnode_sync.c Report dnodes with faulty bonuslen 2022-02-03 14:28:19 -08:00
dsl_bookmark.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
dsl_crypt.c module: icp: fold away all key formats except CRYPTO_KEY_RAW 2022-02-15 16:25:07 -08:00
dsl_dataset.c Silence uninitialized warnings in dsl_dataset.c 2022-02-14 10:04:50 -08:00
dsl_deadlist.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
dsl_deleg.c Reduce loaded range tree memory usage 2019-10-09 10:36:03 -07:00
dsl_destroy.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
dsl_dir.c Remove unneeded "extern inline" function declarations 2022-02-08 10:48:57 -08:00
dsl_pool.c module: mark arguments used 2022-02-18 09:34:03 -08:00
dsl_prop.c Rename fallthrough to zfs_fallthrough 2022-02-15 08:58:59 -08:00
dsl_scan.c Report dnodes with faulty bonuslen 2022-02-03 14:28:19 -08:00
dsl_synctask.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
dsl_userhold.c Replace sprintf()->snprintf() and strcpy()->strlcpy() 2020-06-07 11:42:12 -07:00
edonr_zfs.c module: mark arguments used 2022-02-18 09:34:03 -08:00
fm.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
gzip.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
hkdf.c module: icp: rip out insane crypto_req_handle_t mechanism, inline KM_SLEEP 2022-02-15 16:25:37 -08:00
lz4.c lz4: Cherrypick fix for CVE-2021-3520 2022-01-12 16:14:36 -08:00
lz4_zfs.c Updated the lz4 decompressor 2022-01-07 10:36:49 -08:00
lzjb.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
metaslab.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
mmp.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
multilist.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
objlist.c Implement Redacted Send/Receive 2019-06-19 09:48:12 -07:00
pathname.c Replace ZFS on Linux references with OpenZFS 2020-10-08 20:10:13 -07:00
range_tree.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
refcount.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
rrwlock.c Rename refcount.h to zfs_refcount.h 2020-07-29 16:35:33 -07:00
sa.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
sha256.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
skein_zfs.c module: mark arguments used 2022-02-18 09:34:03 -08:00
spa.c Add spa _os() hooks 2022-02-15 15:54:25 -08:00
spa_boot.c Add include files for prototypes 2020-06-18 12:21:25 -07:00
spa_checkpoint.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
spa_config.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
spa_errlog.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
spa_history.c module: mark arguments used 2022-02-18 09:34:03 -08:00
spa_log_spacemap.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
spa_misc.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
spa_stats.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
space_map.c Annotated dprintf as printf-like 2021-06-22 21:53:45 -07:00
space_reftree.c Reduce loaded range tree memory usage 2019-10-09 10:36:03 -07:00
txg.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
uberblock.c MMP interval and fail_intervals in uberblock 2019-03-21 12:47:57 -07:00
unique.c Reduce loaded range tree memory usage 2019-10-09 10:36:03 -07:00
vdev.c Add `--enable-asan` and `--enable-ubsan` switches 2022-02-03 14:35:38 -08:00
vdev_cache.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
vdev_draid.c Verify dRAID empty sectors 2022-01-04 16:46:32 -08:00
vdev_draid_rand.c Distributed Spare (dRAID) Feature 2020-11-13 13:51:51 -08:00
vdev_indirect.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
vdev_indirect_births.c module: zfs: vdev: shim out vdev_indirect_births_verify() 2021-12-23 09:42:29 -08:00
vdev_indirect_mapping.c module: zfs: vdev: shim out vdev_indirect_mapping_verify() 2021-12-23 09:42:41 -08:00
vdev_initialize.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
vdev_label.c Rename fallthrough to zfs_fallthrough 2022-02-15 08:58:59 -08:00
vdev_mirror.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
vdev_missing.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
vdev_queue.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
vdev_raidz.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
vdev_raidz_math.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
vdev_raidz_math_aarch64_neon.c Linux 5.0 compat: SIMD compatibility 2019-07-12 09:31:20 -07:00
vdev_raidz_math_aarch64_neon_common.h FreeBSD: fix the build with Clang 11 2020-08-17 15:40:17 -07:00
vdev_raidz_math_aarch64_neonx2.c Linux 5.0 compat: SIMD compatibility 2019-07-12 09:31:20 -07:00
vdev_raidz_math_avx2.c FreeBSD: fix the build with Clang 11 2020-08-17 15:40:17 -07:00
vdev_raidz_math_avx512bw.c Refactor ccompile.h to not include system headers 2020-07-25 20:09:50 -07:00
vdev_raidz_math_avx512f.c FreeBSD: fix the build with Clang 11 2020-08-17 15:40:17 -07:00
vdev_raidz_math_impl.h Distributed Spare (dRAID) Feature 2020-11-13 13:51:51 -08:00
vdev_raidz_math_powerpc_altivec.c Prefix zfs internal endian checks with _ZFS 2020-07-28 13:02:49 -07:00
vdev_raidz_math_powerpc_altivec_common.h FreeBSD: fix the build with Clang 11 2020-08-17 15:40:17 -07:00
vdev_raidz_math_scalar.c Rename fallthrough to zfs_fallthrough 2022-02-15 08:58:59 -08:00
vdev_raidz_math_sse2.c FreeBSD: fix the build with Clang 11 2020-08-17 15:40:17 -07:00
vdev_raidz_math_ssse3.c Refactor ccompile.h to not include system headers 2020-07-25 20:09:50 -07:00
vdev_rebuild.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
vdev_removal.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
vdev_root.c Distributed Spare (dRAID) Feature 2020-11-13 13:51:51 -08:00
vdev_trim.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
zap.c Remove unneeded "extern inline" function declarations 2022-02-08 10:48:57 -08:00
zap_leaf.c Remove unneeded "extern inline" function declarations 2022-02-08 10:48:57 -08:00
zap_micro.c Remove unneeded "extern inline" function declarations 2022-02-08 10:48:57 -08:00
zcp.c Clean up CSTYLEDs 2022-01-26 11:38:52 -08:00
zcp_get.c Correct compilation errors reported by GCC 10/11 2022-02-20 19:20:00 -08:00
zcp_global.c OpenZFS 8600 - ZFS channel programs - snapshot 2018-02-08 15:29:24 -08:00
zcp_iter.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
zcp_set.c Support setting user properties in a channel program 2020-02-14 13:41:42 -08:00
zcp_synctask.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
zfeature.c Throw const on some strings 2020-10-02 17:44:10 -07:00
zfs_byteswap.c module: mark arguments used 2022-02-18 09:34:03 -08:00
zfs_fm.c module/*.ko: prune .data, global .rodata 2022-01-14 15:37:55 -08:00
zfs_fuid.c Add `const` to nvlist functions to properly expose their real behavior 2021-12-06 18:19:13 -07:00
zfs_ioctl.c module: mark arguments used 2022-02-18 09:34:03 -08:00
zfs_log.c log xattr=sa create/remove/update to ZIL 2022-02-22 13:06:43 -08:00
zfs_onexit.c file reference counts can get corrupted 2021-07-10 19:00:37 -06:00
zfs_quota.c File incorrectly zeroed when receiving incremental stream that toggles -L 2020-06-09 10:41:01 -07:00
zfs_ratelimit.c Change checksum & IO delay ratelimit values 2018-03-04 17:34:51 -08:00
zfs_replay.c log xattr=sa create/remove/update to ZIL 2022-02-22 13:06:43 -08:00
zfs_rlock.c Add a "try" operation for range locks 2020-07-06 11:53:31 -07:00
zfs_sa.c log xattr=sa create/remove/update to ZIL 2022-02-22 13:06:43 -08:00
zfs_vnops.c module: mark arguments used 2022-02-18 09:34:03 -08:00
zil.c log xattr=sa create/remove/update to ZIL 2022-02-22 13:06:43 -08:00
zio.c Enable encrypted raw sending to pools with greater ashift 2022-02-16 11:52:02 -08:00
zio_checksum.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
zio_compress.c module: zfs: fix unused, remove argsused 2021-12-23 09:42:47 -08:00
zio_inject.c module: mark arguments used 2022-02-18 09:34:03 -08:00
zle.c Add include files for prototypes 2020-06-18 12:21:25 -07:00
zrlock.c Remove dead code 2020-06-18 12:21:18 -07:00
zthr.c Avoid memory allocations in the ARC eviction thread 2022-01-21 10:28:13 -08:00
zvol.c module: mark arguments used 2022-02-18 09:34:03 -08:00