OpenZFS on Linux and FreeBSD

Go to file

Rob N 30d581121b dnode_is_dirty: check dnode and its data for dirtiness Over its history this the dirty dnode test has been changed between checking for a dnodes being on `os_dirty_dnodes` (`dn_dirty_link`) and `dn_dirty_record`. `de198f2d9` Fix lseek(SEEK_DATA/SEEK_HOLE) mmap consistency `2531ce372` Revert "Report holes when there are only metadata changes" `ec4f9b8f3` Report holes when there are only metadata changes `454365bba` Fix dirty check in dmu_offset_next() `66aca2473` SEEK_HOLE should not block on txg_wait_synced() Also illumos/illumos-gate@c543ec060d illumos/illumos-gate@2bcf0248e9 It turns out both are actually required. In the case of appending data to a newly created file, the dnode proper is dirtied (at least to change the blocksize) and dirty records are added. Thus, a single logical operation is represented by separate dirty indicators, and must not be separated. The incorrect dirty check becomes a problem when the first block of a file is being appended to while another process is calling lseek to skip holes. There is a small window where the dnode part is undirtied while there are still dirty records. In this case, `lseek(fd, 0, SEEK_DATA)` would not know that the file is dirty, and would go to `dnode_next_offset()`. Since the object has no data blocks yet, it returns `ESRCH`, indicating no data found, which results in `ENXIO` being returned to `lseek()`'s caller. Since coreutils 9.2, `cp` performs sparse copies by default, that is, it uses `SEEK_DATA` and `SEEK_HOLE` against the source file and attempts to replicate the holes in the target. When it hits the bug, its initial search for data fails, and it goes on to call `fallocate()` to create a hole over the entire destination file. This has come up more recently as users upgrade their systems, getting OpenZFS 2.2 as well as a newer coreutils. However, this problem has been reproduced against 2.1, as well as on FreeBSD 13 and 14. This change simply updates the dirty check to check both types of dirty. If there's anything dirty at all, we immediately go to the "wait for sync" stage, It doesn't really matter after that; both changes are on disk, so the dirty fields should be correct. Sponsored-by: Klara, Inc. Sponsored-by: Wasabi Technology, Inc. Reviewed-by: Brian Behlendorf <behlendorf1@llnl.gov> Reviewed-by: Alexander Motin <mav@FreeBSD.org> Reviewed-by: Rich Ercolani <rincebrain@gmail.com> Signed-off-by: Rob Norris <rob.norris@klarasystems.com> Closes #15571 Closes #15526		2023-11-28 09:07:57 -08:00
.github	Refine some details for the github actions update	2023-03-16 10:00:14 -07:00
cmd	zdb: Fix zdb '-O\|-r' options with -e/exported zpool	2023-11-27 13:41:58 -08:00
config	config/zfs-build.m4: add Gentoo's bash-completion path	2023-10-09 12:50:06 -07:00
contrib	Packaging: Auto-generate changelog during configure (#15528 )	2023-11-16 08:58:47 -08:00
etc	Revert "systemd: Use non-absolute paths in Exec* lines"	2023-06-07 11:14:05 -07:00
include	FreeBSD: Fix ZFS so that snapshots under .zfs/snapshot are NFS visible	2023-11-27 16:31:03 -08:00
lib	freebsd: remove __FBSDID macro use	2023-11-17 14:02:09 -08:00
man	zdb: show BRT statistics and dump its contents	2023-11-27 13:35:07 -08:00
module	dnode_is_dirty: check dnode and its data for dirtiness	2023-11-28 09:07:57 -08:00
rpm	zfs-dkms: fix shell-init error message	2023-11-27 13:17:48 -08:00
scripts	RAID-Z expansion feature	2023-11-08 10:19:41 -08:00
tests	zdb: show BRT statistics and dump its contents	2023-11-27 13:35:07 -08:00
udev	Replace dead opensolaris.org license link	2022-07-11 14:16:13 -07:00
.cirrus.yml	CI: add FreeBSD build with Cirrus CI	2023-10-06 08:50:26 -07:00
.editorconfig	Add an .editorconfig; document git whitespace settings	2020-01-27 13:32:52 -08:00
.gitignore	Packaging: Auto-generate changelog during configure (#15528 )	2023-11-16 08:58:47 -08:00
.gitmodules	.gitmodules: link to openzfs github repository	2021-04-12 09:37:23 -07:00
.mailmap	mailmap: initial, trying to tidy up a lot of the commit history	2023-10-10 08:54:30 -07:00
AUTHORS	AUTHORS: update with missing names	2023-10-10 08:55:42 -07:00
CODE_OF_CONDUCT.md	Documentation corrections	2022-12-22 11:34:28 -08:00
COPYRIGHT	Fix typos	2020-06-09 21:24:09 -07:00
LICENSE	Update build system and packaging	2018-05-29 16:00:33 -07:00
META	Linux 6.6 compat: META	2023-11-14 09:55:28 -08:00
Makefile.am	Process `script` directory for all configs	2022-10-27 16:45:14 -07:00
NEWS	Fix NEWS file	2020-08-26 21:44:41 -07:00
NOTICE	Update build system and packaging	2018-05-29 16:00:33 -07:00
README.md	FreeBSD: Fix the build on FreeBSD 12	2023-11-27 12:58:03 -08:00
RELEASES.md	Add RELEASES.md file	2021-04-02 16:33:40 -07:00
TEST	Remove CI builder customization from TEST	2020-03-16 10:46:03 -07:00
autogen.sh	Ubuntu 22.04 integration: ShellCheck	2022-11-18 11:24:48 -08:00
configure.ac	Packaging: Auto-generate changelog during configure (#15528 )	2023-11-16 08:58:47 -08:00
copy-builtin	copy-builtin: add hooks with sed/>>	2022-05-10 10:17:43 -07:00
zfs.release.in	Move zfs.release generation to configure step	2012-07-12 12:22:51 -07:00

README.md

OpenZFS is an advanced file system and volume manager which was originally developed for Solaris and is now maintained by the OpenZFS community. This repository contains the code for running OpenZFS on Linux and FreeBSD.

Official Resources

Documentation - for using and developing this repo
ZoL Site - Linux release info & links
Mailing lists
OpenZFS site - for conference videos and info on other platforms (illumos, OSX, Windows, etc)

Installation

Full documentation for installing OpenZFS on your favorite operating system can be found at the Getting Started Page.

Contribute & Develop

We have a separate document with contribution guidelines.

We have a Code of Conduct.

Release

OpenZFS is released under a CDDL license. For more details see the NOTICE, LICENSE and COPYRIGHT files; UCRL-CODE-235197

Supported Kernels

The META file contains the officially recognized supported Linux kernel versions.
Supported FreeBSD versions are any supported branches and releases starting from 12.4-RELEASE.