Commit Graph

2950 Commits

Author SHA1 Message Date
Brian Behlendorf e4c253b3e3 Merge branch 'gcc-init-pragmas' into refs/top-bases/gcc-branch 2009-12-11 16:21:19 -08:00
Brian Behlendorf 2a5101737e Merge commit 'refs/top-bases/gcc-init-pragmas' into gcc-init-pragmas 2009-12-11 16:21:18 -08:00
Brian Behlendorf 404d3c8509 Merge branch 'gcc-debug' into refs/top-bases/gcc-branch 2009-12-11 16:21:16 -08:00
Brian Behlendorf 6be4f70345 Merge commit 'refs/top-bases/gcc-debug' into gcc-debug 2009-12-11 16:21:15 -08:00
Brian Behlendorf 9f1c6b0416 Merge branch 'gcc-cast' into refs/top-bases/gcc-branch 2009-12-11 16:21:13 -08:00
Brian Behlendorf 912a3fa030 Merge commit 'refs/top-bases/gcc-cast' into gcc-cast 2009-12-11 16:21:12 -08:00
Brian Behlendorf 69dcaf00f3 Merge branch 'gcc-c90' into refs/top-bases/gcc-branch 2009-12-11 16:21:11 -08:00
Brian Behlendorf ac0fb4a24e Merge commit 'refs/top-bases/gcc-c90' into gcc-c90 2009-12-11 16:21:10 -08:00
Brian Behlendorf 058ac9ba78 Pull in latest man pages as part of update-zfs.sh
The script has been updated to download the latest documentations
packages for Solaris and extract the needed ZFS man pages.  These
will still need a little markup to handle changes between the
Solaris and Linux versions of ZFS.  Howver, they should be pretty
minor I've tried hard to keep the interface the same.

In additional to the script update the zdb, zfs, and zpool man
pages have been added to the repo.
2009-12-11 16:15:33 -08:00
Brian Behlendorf 4e7da53a39 Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-12-11 12:08:06 -08:00
Brian Behlendorf acd798cfd4 Merge commit 'refs/top-bases/zfs-branch' into zfs-branch 2009-12-11 12:07:23 -08:00
Brian Behlendorf f8d093f69b Merge branch 'gcc-branch' into refs/top-bases/zfs-branch 2009-12-11 12:07:23 -08:00
Brian Behlendorf 0cc4cdb30d Merge commit 'refs/top-bases/gcc-branch' into gcc-branch 2009-12-11 12:07:22 -08:00
Brian Behlendorf b76d12a644 Merge branch 'gcc-64bit-constants' into refs/top-bases/gcc-branch 2009-12-11 12:07:22 -08:00
Brian Behlendorf f76a6daca5 Use check_disk_change() instead of revalidate_disk().
For 2.6.27 kernels are earlier revalidate_disk() was not available.
However, check_disk_change() has been available for far longer and
will properly inform the kernel of the volume change for both older
and newer kernels.
2009-12-11 12:02:45 -08:00
Brian Behlendorf 0dad9b2f9a Adding missed * in debug ASSERT. 2009-12-11 12:02:05 -08:00
Brian Behlendorf 8f1eb1049b Use MAXOFFSET_T instead of SPEC_MAXOFFSET_T for 32-bit arch. 2009-12-11 12:01:16 -08:00
Brian Behlendorf ba7ccf8ccd Cast to unsigned long long for 32-bit arches 2009-12-11 11:41:04 -08:00
Brian Behlendorf 69c72b0f0a Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-24 15:51:48 -08:00
Brian Behlendorf 0ec3a0ef62 Add udev rules to zfs-test package 2009-11-24 15:48:16 -08:00
Brian Behlendorf 2d2abbee13 Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-24 14:59:33 -08:00
Brian Behlendorf 07a35df315 The libuuid and libblkid have been split from e2fsprogs in fc12,
el6, and ch5 systems.  Additionally, correct ZFS filesystem detection
has not yet been added to these packages so for now disable blkid.
2009-11-24 14:54:33 -08:00
Brian Behlendorf f59958534a Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-24 14:18:13 -08:00
Brian Behlendorf c8bd25ac98 Add 'srpm' --with-config option for creation of spec files. 2009-11-24 14:13:25 -08:00
Brian Behlendorf 3038a20c9c Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-24 13:28:16 -08:00
Brian Behlendorf 9441b7efc4 Add chaos5 and rhel6 macro's to the zfs-modules.spec.in 2009-11-24 13:24:25 -08:00
Brian Behlendorf 5c2e3c5b64 Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-24 12:48:05 -08:00
Brian Behlendorf eb6f06154b Prep for 0.4.7 tag, updated META and ChangeLog. 2009-11-24 12:43:40 -08:00
Brian Behlendorf 0b03d82241 Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-20 16:21:28 -08:00
Brian Behlendorf c14a8b2272 Ensure *.order and *.markers build products are removed by distclean rule. 2009-11-20 16:17:16 -08:00
Brian Behlendorf fb1b00e9f4 Linux ZVOL implementation; kernel-side changes
At last a useful user space interface for the Linux ZFS port arrives.
With the addition of the ZVOL real ZFS based block devices are available
and can be compared head to head with Linux's MD and LVM block drivers.
The Linux ZVOL has not yet had any performance work done but from a user
perspective it should be functionally complete and behave like any other
Linux block device.

The ZVOL has so far been tested using zconfig.sh on the following x86_64
based platforms: FC11, CHAOS4, RHEL5, RHEL6, and SLES11.  However, more
testing is required to ensure everything is working as designed.

What follows in a somewhat detailed list of changes includes in this
commit to make ZVOL's possible.  A few other issues were addressed in
the context of these changes which will also be mentioned.

* Added module/zfs/zvol.c which is based off the original Solaris ZVOL
implementation but rewritten to intergrate with the Linux block device
APIs.  The basic design remains the similar in Linux with the major
change being request processing.  Request processing is handled by
registering a request function which the elevator calls once all request
merges is finished and the elevator unplugs.  This function is called
under a spin lock and the request structure is passed to the block driver
to be queued for IO.  The elevator must be notified asyncronously once
the request completes or fails with an error.  This allows us the block
driver a chance to handle many request concurrently.  For the ZVOL we
maintain a taskq with a service thread per core.  As requests are delivered
by the elevator each request is dispatched to the taskq.  The task queue
handles each request with a write or read helper function which basically
copies the request data in to our out of the DMU object.  Writes single
completion as soon as the DMU has the data unless they are marked sync.
Reads are all handled syncronously however the elevator will merge many
small reads in to a large read before it submitting the request.

* Cachine is worth specifically mentioning.  Because both the Linux VFS
and the ZFS ARC both want to fully manage the cache we unfortunately
end up with two caches.  This means our memory foot print is larger
than otherwise expected, and it means we have an extra copy between
the caches, but it does not impact correctness.  All syncs are barrior
requests I believe are handled correctly.  Longer term there is lots of
room for improvement here but it will require fairly extensive changes
to either the Linux VFS and VM layer, or additional DMU interfaces to
handle managing buffer not directly allocated by the ARC.

* Added module/zfs/include/sys/blkdev.h which contains all the Linux
compatibility foo which is required to handle changes in the Linux block
APIs from 2.6.18 thru 2.6.31 based kernels.

* The dmu_{read,write}_uio interfaces which don't make sense on Linux
have been modified to dmu_{read,write}_req functions which consume the
standard Linux IO request structure.  Their function fundamentally
remains the same so this happily worked out pretty cleanly.

* The /dev/zfs character device is no longer created through the half
implemented Solaris driver DDI interfaces.  It is now simply created
with it's own major number as a Linux misc device which greatly simplifies
everything.  It is only capable of handling ioctls() but this fits nicely
because that's all it ever has to do.  The ZVOL devices unlike in Solaris
do not leverage the same major number as /dev/zfs but instead register
their own major.  Because only one major is allocated and space is reserved
for 16 partitions per-device there is a limit of 16384 concurrent ZVOL
devices.  By using multiple majors like the scsi driver this limit could
be addressed if it becomes a problem.

* The {spa,zfs,zvol}_busy() functions have all be removed because they
are not required on a Linux system.  Under Linux the registered module
exit function will not be called while the are still references to the
module.  Once the exit function is called however it must succeed or
block, it may not fail so returning an error on module unload makes to
sense under Linux.

* With the addition of ZVOL support all the HAVE_ZVOL defines were removed
for obvious reasons.  However, the HAVE_ZPL defines have been relocated
in to the linux-{kernel,user}-disk topic branches and must remain until
the ZPL is implemented.
2009-11-20 11:06:59 -08:00
Brian Behlendorf 49fdb13bc8 Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-20 10:30:50 -08:00
Brian Behlendorf cac1bc41dc Merge commit 'refs/top-bases/zfs-branch' into zfs-branch 2009-11-20 10:29:49 -08:00
Brian Behlendorf 77c347db31 Merge branch 'gcc-branch' into refs/top-bases/zfs-branch 2009-11-20 10:29:48 -08:00
Brian Behlendorf 9c8765a219 Merge commit 'refs/top-bases/gcc-branch' into gcc-branch 2009-11-20 10:29:48 -08:00
Brian Behlendorf 0f315a58bb Merge branch 'gcc-uninit' into refs/top-bases/gcc-branch 2009-11-20 10:29:47 -08:00
Brian Behlendorf 23304dc828 Add 16 drive promise JBOD zpool configs for small test setup. 2009-11-20 10:12:41 -08:00
Brian Behlendorf 6fabeffd3b Additional ZVOL compatibility autoconf checks and zconfig ZVOL sanity test. 2009-11-20 10:04:56 -08:00
Brian Behlendorf 3191b962f6 Prevent gcc uninit compiler warning in zfs_range_unlock_reader(). 2009-11-20 09:59:58 -08:00
Brian Behlendorf 31f893c17c Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-16 10:37:15 -08:00
Brian Behlendorf 915205a6e8 Add autoconf checks for zvol integration. 2009-11-16 10:31:10 -08:00
Brian Behlendorf 50e6c144e6 Merge commit 'refs/top-bases/linux-kernel-disk' into linux-kernel-disk 2009-11-15 16:28:08 -08:00
Brian Behlendorf 844280cb2c Merge branch 'feature-branch' into refs/top-bases/zfs-branch 2009-11-15 16:27:02 -08:00
Brian Behlendorf d00a0ea8a0 Merge commit 'refs/top-bases/zfs-branch' into zfs-branch 2009-11-15 16:27:02 -08:00
Brian Behlendorf 368cfaefdb Merge commit 'refs/top-bases/feature-branch' into feature-branch 2009-11-15 16:27:00 -08:00
Brian Behlendorf 71ccaccb2b Merge commit 'refs/top-bases/feature-pthreads' into feature-pthreads 2009-11-15 16:27:00 -08:00
Brian Behlendorf 475e214ce1 Merge commit 'refs/top-bases/feature-commit-cb' into feature-commit-cb 2009-11-15 16:27:00 -08:00
Brian Behlendorf f056747e61 Merge branch 'feature-pthreads' into refs/top-bases/feature-branch 2009-11-15 16:27:00 -08:00
Brian Behlendorf 65f6d4b712 Merge commit 'refs/top-bases/feature-zap-cursor-to-key' into feature-zap-cursor-to-key 2009-11-15 16:26:58 -08:00
Brian Behlendorf 8c5797df77 Merge branch 'feature-zap-cursor-to-key' into refs/top-bases/feature-branch 2009-11-15 16:26:58 -08:00