diff options
Diffstat (limited to 'doc/releases/firefly.rst')
| -rw-r--r-- | doc/releases/firefly.rst | 1787 |
1 files changed, 0 insertions, 1787 deletions
diff --git a/doc/releases/firefly.rst b/doc/releases/firefly.rst deleted file mode 100644 index 0b2d943b8..000000000 --- a/doc/releases/firefly.rst +++ /dev/null @@ -1,1787 +0,0 @@ -======= -Firefly -======= - -Firefly is the 6th stable release of Ceph. It is named after the -firefly squid (Watasenia scintillans). - -v0.80.11 Firefly -================ - -This is a bugfix release for Firefly. This Firefly 0.80.x is nearing -its planned end of life in January 2016 it may also be the last. - -We recommend that all Firefly users upgrade. - -For more detailed information, see :download:`the complete changelog -<../changelog/v0.80.11.txt>`. - -Notable Changes ---------------- - -* build/ops: /etc/init.d/radosgw restart does not work correctly (`issue#11140 <http://tracker.ceph.com/issues/11140>`_, `pr#5831 <http://github.com/ceph/ceph/pull/5831>`_, Dmitry Yatsushkevich) -* build/ops: Fix -Wno-format and -Werror=format-security options clash (`issue#13417 <http://tracker.ceph.com/issues/13417>`_, `pr#6207 <http://github.com/ceph/ceph/pull/6207>`_, Boris Ranto) -* build/ops: ceph-common needs python-argparse on older distros, but doesn't require it (`issue#12034 <http://tracker.ceph.com/issues/12034>`_, `pr#5217 <http://github.com/ceph/ceph/pull/5217>`_, Nathan Cutler) -* build/ops: ceph.spec.in running fdupes unnecessarily (`issue#12301 <http://tracker.ceph.com/issues/12301>`_, `pr#5224 <http://github.com/ceph/ceph/pull/5224>`_, Nathan Cutler) -* build/ops: ceph.spec.in: 50-rbd.rules conditional is wrong (`issue#12166 <http://tracker.ceph.com/issues/12166>`_, `pr#5225 <http://github.com/ceph/ceph/pull/5225>`_, Nathan Cutler) -* build/ops: ceph.spec.in: useless %py_requires breaks SLE11-SP3 build (`issue#12351 <http://tracker.ceph.com/issues/12351>`_, `pr#5394 <http://github.com/ceph/ceph/pull/5394>`_, Nathan Cutler) -* build/ops: fedora21 has junit, not junit4 (`issue#10728 <http://tracker.ceph.com/issues/10728>`_, `pr#6203 <http://github.com/ceph/ceph/pull/6203>`_, Ken Dreyer, Loic Dachary) -* build/ops: upstart: configuration is too generous on restarts (`issue#11798 <http://tracker.ceph.com/issues/11798>`_, `pr#5992 <http://github.com/ceph/ceph/pull/5992>`_, Sage Weil) -* common: Client admin socket leaks file descriptors (`issue#11535 <http://tracker.ceph.com/issues/11535>`_, `pr#4633 <http://github.com/ceph/ceph/pull/4633>`_, Jon Bernard) -* common: FileStore calls syncfs(2) even it is not supported (`issue#12512 <http://tracker.ceph.com/issues/12512>`_, `pr#5529 <http://github.com/ceph/ceph/pull/5529>`_, Danny Al-Gaaf, Kefu Chai, Jianpeng Ma) -* common: HeartBeat: include types (`issue#13088 <http://tracker.ceph.com/issues/13088>`_, `pr#6038 <http://github.com/ceph/ceph/pull/6038>`_, Sage Weil) -* common: Malformed JSON command output when non-ASCII strings are present (`issue#7387 <http://tracker.ceph.com/issues/7387>`_, `pr#4635 <http://github.com/ceph/ceph/pull/4635>`_, Kefu Chai, Tim Serong) -* common: Memory leak in Mutex.cc, pthread_mutexattr_init without pthread_mutexattr_destroy (`issue#11762 <http://tracker.ceph.com/issues/11762>`_, `pr#5403 <http://github.com/ceph/ceph/pull/5403>`_, Ketor Meng) -* common: Thread:pthread_attr_destroy(thread_attr) when done with it (`issue#12570 <http://tracker.ceph.com/issues/12570>`_, `pr#6325 <http://github.com/ceph/ceph/pull/6325>`_, Piotr Dałek, Zheng Qiankun) -* common: ThreadPool add/remove work queue methods not thread safe (`issue#12662 <http://tracker.ceph.com/issues/12662>`_, `pr#5991 <http://github.com/ceph/ceph/pull/5991>`_, Jason Dillaman) -* common: buffer: critical bufferlist::zero bug (`issue#12252 <http://tracker.ceph.com/issues/12252>`_, `pr#5388 <http://github.com/ceph/ceph/pull/5388>`_, Haomai Wang) -* common: log: take mutex while opening fd (`issue#12465 <http://tracker.ceph.com/issues/12465>`_, `pr#5406 <http://github.com/ceph/ceph/pull/5406>`_, Samuel Just) -* common: recursive lock of md_config_t (0) (`issue#12614 <http://tracker.ceph.com/issues/12614>`_, `pr#5814 <http://github.com/ceph/ceph/pull/5814>`_, Josh Durgin) -* crush: take crashes due to invalid arg (`issue#11602 <http://tracker.ceph.com/issues/11602>`_, `pr#4769 <http://github.com/ceph/ceph/pull/4769>`_, Sage Weil) -* doc: backport v0.80.10 release notes to firefly (`issue#11090 <http://tracker.ceph.com/issues/11090>`_, `pr#5307 <http://github.com/ceph/ceph/pull/5307>`_, Loic Dachary, Sage Weil) -* doc: update docs to point to download.ceph.com (`issue#13162 <http://tracker.ceph.com/issues/13162>`_, `pr#5993 <http://github.com/ceph/ceph/pull/5993>`_, Alfredo Deza) -* fs: MDSMonitor: handle MDSBeacon messages properly (`issue#11590 <http://tracker.ceph.com/issues/11590>`_, `pr#5199 <http://github.com/ceph/ceph/pull/5199>`_, Kefu Chai) -* fs: client nonce collision due to unshared pid namespaces (`issue#13032 <http://tracker.ceph.com/issues/13032>`_, `pr#6087 <http://github.com/ceph/ceph/pull/6087>`_, Josh Durgin, Sage Weil) -* librbd: Objectcacher setting max object counts too low (`issue#7385 <http://tracker.ceph.com/issues/7385>`_, `pr#4639 <http://github.com/ceph/ceph/pull/4639>`_, Jason Dillaman) -* librbd: aio calls may block (`issue#11056 <http://tracker.ceph.com/issues/11056>`_, `pr#4854 <http://github.com/ceph/ceph/pull/4854>`_, Haomai Wang, Sage Weil, Jason Dillaman) -* librbd: internal.cc: 1967: FAILED assert(watchers.size() == 1) (`issue#12176 <http://tracker.ceph.com/issues/12176>`_, `pr#5171 <http://github.com/ceph/ceph/pull/5171>`_, Jason Dillaman) -* mon: Clock skew causes missing summary and confuses Calamari (`issue#11877 <http://tracker.ceph.com/issues/11877>`_, `pr#4867 <http://github.com/ceph/ceph/pull/4867>`_, Thorsten Behrens) -* mon: EC pools are not allowed as cache pools, disallow in the mon (`issue#11650 <http://tracker.ceph.com/issues/11650>`_, `pr#5389 <http://github.com/ceph/ceph/pull/5389>`_, Samuel Just) -* mon: Make it more difficult to delete pools in firefly (`issue#11800 <http://tracker.ceph.com/issues/11800>`_, `pr#4788 <http://github.com/ceph/ceph/pull/4788>`_, Sage Weil) -* mon: MonitorDBStore: get_next_key() only if prefix matches (`issue#11786 <http://tracker.ceph.com/issues/11786>`_, `pr#5360 <http://github.com/ceph/ceph/pull/5360>`_, Joao Eduardo Luis) -* mon: PaxosService: call post_refresh() instead of post_paxos_update() (`issue#11470 <http://tracker.ceph.com/issues/11470>`_, `pr#5358 <http://github.com/ceph/ceph/pull/5358>`_, Joao Eduardo Luis) -* mon: add a cache layer over MonitorDBStore (`issue#12638 <http://tracker.ceph.com/issues/12638>`_, `pr#5698 <http://github.com/ceph/ceph/pull/5698>`_, Kefu Chai) -* mon: adding exsting pool as tier with --force-nonempty clobbers removed_snaps (`issue#11493 <http://tracker.ceph.com/issues/11493>`_, `pr#5236 <http://github.com/ceph/ceph/pull/5236>`_, Sage Weil, Samuel Just) -* mon: ceph fails to compile with boost 1.58 (`issue#11576 <http://tracker.ceph.com/issues/11576>`_, `pr#5129 <http://github.com/ceph/ceph/pull/5129>`_, Kefu Chai) -* mon: does not check for IO errors on every transaction (`issue#13089 <http://tracker.ceph.com/issues/13089>`_, `pr#6091 <http://github.com/ceph/ceph/pull/6091>`_, Sage Weil) -* mon: get pools health'info have error (`issue#12402 <http://tracker.ceph.com/issues/12402>`_, `pr#5410 <http://github.com/ceph/ceph/pull/5410>`_, renhwztetecs) -* mon: increase globalid default for firefly (`issue#13255 <http://tracker.ceph.com/issues/13255>`_, `pr#6010 <http://github.com/ceph/ceph/pull/6010>`_, Sage Weil) -* mon: pgmonitor: wrong at/near target max“ reporting (`issue#12401 <http://tracker.ceph.com/issues/12401>`_, `pr#5409 <http://github.com/ceph/ceph/pull/5409>`_, huangjun) -* mon: register_new_pgs() should check ruleno instead of its index (`issue#12210 <http://tracker.ceph.com/issues/12210>`_, `pr#5404 <http://github.com/ceph/ceph/pull/5404>`_, Xinze Chi) -* mon: scrub error (osdmap encoding mismatch?) upgrading from 0.80 to ~0.80.2 (`issue#8815 <http://tracker.ceph.com/issues/8815>`_, `issue#8674 <http://tracker.ceph.com/issues/8674>`_, `issue#9064 <http://tracker.ceph.com/issues/9064>`_, `pr#5200 <http://github.com/ceph/ceph/pull/5200>`_, Sage Weil, Zhiqiang Wang, Samuel Just) -* mon: the output is wrong when runing ceph osd reweight (`issue#12251 <http://tracker.ceph.com/issues/12251>`_, `pr#5408 <http://github.com/ceph/ceph/pull/5408>`_, Joao Eduardo Luis) -* objecter: can get stuck in redirect loop if osdmap epoch == last_force_op_resend (`issue#11026 <http://tracker.ceph.com/issues/11026>`_, `pr#4597 <http://github.com/ceph/ceph/pull/4597>`_, Jianpeng Ma, Sage Weil) -* objecter: pg listing can deadlock when throttling is in use (`issue#9008 <http://tracker.ceph.com/issues/9008>`_, `pr#5043 <http://github.com/ceph/ceph/pull/5043>`_, Guang Yang) -* objecter: resend linger ops on split (`issue#9806 <http://tracker.ceph.com/issues/9806>`_, `pr#5062 <http://github.com/ceph/ceph/pull/5062>`_, Josh Durgin, Samuel Just) -* osd: Cleanup boost optionals for boost 1.56 (`issue#9983 <http://tracker.ceph.com/issues/9983>`_, `pr#5039 <http://github.com/ceph/ceph/pull/5039>`_, William A. Kennington III) -* osd: LibRadosTwoPools[EC]PP.PromoteSnap failure (`issue#10052 <http://tracker.ceph.com/issues/10052>`_, `pr#5050 <http://github.com/ceph/ceph/pull/5050>`_, Sage Weil) -* osd: Mutex Assert from PipeConnection::try_get_pipe (`issue#12437 <http://tracker.ceph.com/issues/12437>`_, `pr#5815 <http://github.com/ceph/ceph/pull/5815>`_, David Zafman) -* osd: PG stuck with remapped (`issue#9614 <http://tracker.ceph.com/issues/9614>`_, `pr#5044 <http://github.com/ceph/ceph/pull/5044>`_, Guang Yang) -* osd: PG::handle_advance_map: on_pool_change after handling the map change (`issue#12809 <http://tracker.ceph.com/issues/12809>`_, `pr#5988 <http://github.com/ceph/ceph/pull/5988>`_, Samuel Just) -* osd: PGLog: split divergent priors as well (`issue#11069 <http://tracker.ceph.com/issues/11069>`_, `pr#4631 <http://github.com/ceph/ceph/pull/4631>`_, Samuel Just) -* osd: PGLog::proc_replica_log: correctly handle case where entries between olog.head and log.tail were split out (`issue#11358 <http://tracker.ceph.com/issues/11358>`_, `pr#5287 <http://github.com/ceph/ceph/pull/5287>`_, Samuel Just) -* osd: WBThrottle::clear_object: signal on cond when we reduce throttle values (`issue#12223 <http://tracker.ceph.com/issues/12223>`_, `pr#5822 <http://github.com/ceph/ceph/pull/5822>`_, Samuel Just) -* osd: cache full mode still skips young objects (`issue#10006 <http://tracker.ceph.com/issues/10006>`_, `pr#5051 <http://github.com/ceph/ceph/pull/5051>`_, Xinze Chi, Zhiqiang Wang) -* osd: crash creating/deleting pools (`issue#12429 <http://tracker.ceph.com/issues/12429>`_, `pr#5526 <http://github.com/ceph/ceph/pull/5526>`_, John Spray) -* osd: explicitly specify OSD features in MOSDBoot (`issue#10911 <http://tracker.ceph.com/issues/10911>`_, `pr#4960 <http://github.com/ceph/ceph/pull/4960>`_, Sage Weil) -* osd: is_new_interval() fixes (`issue#11771 <http://tracker.ceph.com/issues/11771>`_, `issue#10399 <http://tracker.ceph.com/issues/10399>`_, `pr#5726 <http://github.com/ceph/ceph/pull/5726>`_, Samuel Just, Jason Dillaman) -* osd: make the all osd/filestore thread pool suicide timeouts separately configurable (`issue#11439 <http://tracker.ceph.com/issues/11439>`_, `pr#5823 <http://github.com/ceph/ceph/pull/5823>`_, Samuel Just) -* osd: object creation by write cannot use an offset on an erasure coded pool (`issue#11507 <http://tracker.ceph.com/issues/11507>`_, `pr#4632 <http://github.com/ceph/ceph/pull/4632>`_, Jianpeng Ma, Loic Dachary) -* osd: os/FileJournal: Fix journal write fail, align for direct io (`issue#12943 <http://tracker.ceph.com/issues/12943>`_, `pr#5619 <http://github.com/ceph/ceph/pull/5619>`_, Xie Rui) -* osd: osd/PGLog.cc: 732: FAILED assert(log.log.size() == log_keys_debug.size()) (`issue#12652 <http://tracker.ceph.com/issues/12652>`_, `pr#5820 <http://github.com/ceph/ceph/pull/5820>`_, Sage Weil) -* osd: read on chunk-aligned xattr not handled (`issue#12309 <http://tracker.ceph.com/issues/12309>`_, `pr#5235 <http://github.com/ceph/ceph/pull/5235>`_, Sage Weil) -* rgw: Change variable length array of std::strings (not legal in C++) to std::vector<std::string> (`issue#12467 <http://tracker.ceph.com/issues/12467>`_, `pr#4583 <http://github.com/ceph/ceph/pull/4583>`_, Daniel J. Hofmann) -* rgw: Civetweb RGW appears to report full size of object as downloaded when only partially downloaded (`issue#11851 <http://tracker.ceph.com/issues/11851>`_, `pr#5234 <http://github.com/ceph/ceph/pull/5234>`_, Yehuda Sadeh) -* rgw: Keystone PKI token expiration is not enforced (`issue#11367 <http://tracker.ceph.com/issues/11367>`_, `pr#4765 <http://github.com/ceph/ceph/pull/4765>`_, Anton Aksola) -* rgw: Object copy bug (`issue#11639 <http://tracker.ceph.com/issues/11639>`_, `pr#4762 <http://github.com/ceph/ceph/pull/4762>`_, Javier M. Mellid) -* rgw: RGW returns requested bucket name raw in "Bucket" response header (`issue#11860 <http://tracker.ceph.com/issues/11860>`_, `issue#12537 <http://tracker.ceph.com/issues/12537>`_, `pr#5730 <http://github.com/ceph/ceph/pull/5730>`_, Yehuda Sadeh, Wido den Hollander) -* rgw: Swift API: response for PUT on /container does not contain the mandatory Content-Length header when FCGI is used (`issue#11036 <http://tracker.ceph.com/issues/11036>`_, `pr#5170 <http://github.com/ceph/ceph/pull/5170>`_, Radoslaw Zarzynski) -* rgw: content length parsing calls strtol() instead of strtoll() (`issue#10701 <http://tracker.ceph.com/issues/10701>`_, `pr#5997 <http://github.com/ceph/ceph/pull/5997>`_, Yehuda Sadeh) -* rgw: delete bucket does not remove .bucket.meta file (`issue#11149 <http://tracker.ceph.com/issues/11149>`_, `pr#4641 <http://github.com/ceph/ceph/pull/4641>`_, Orit Wasserman) -* rgw: doesn't return 'x-timestamp' in header which is used by 'View Details' of OpenStack (`issue#8911 <http://tracker.ceph.com/issues/8911>`_, `pr#4584 <http://github.com/ceph/ceph/pull/4584>`_, Yehuda Sadeh) -* rgw: init some manifest fields when handling explicit objs (`issue#11455 <http://tracker.ceph.com/issues/11455>`_, `pr#5729 <http://github.com/ceph/ceph/pull/5729>`_, Yehuda Sadeh) -* rgw: logfile does not get chowned properly (`issue#12073 <http://tracker.ceph.com/issues/12073>`_, `pr#5233 <http://github.com/ceph/ceph/pull/5233>`_, Thorsten Behrens) -* rgw: logrotate.conf calls service with wrong init script name (`issue#12043 <http://tracker.ceph.com/issues/12043>`_, `pr#5390 <http://github.com/ceph/ceph/pull/5390>`_, wuxingyi) -* rgw: quota not respected in POST object (`issue#11323 <http://tracker.ceph.com/issues/11323>`_, `pr#4642 <http://github.com/ceph/ceph/pull/4642>`_, Sergey Arkhipov) -* rgw: swift smoke test fails on TestAccountUTF8 (`issue#11091 <http://tracker.ceph.com/issues/11091>`_, `issue#11438 <http://tracker.ceph.com/issues/11438>`_, `issue#12939 <http://tracker.ceph.com/issues/12939>`_, `issue#12157 <http://tracker.ceph.com/issues/12157>`_, `issue#12158 <http://tracker.ceph.com/issues/12158>`_, `issue#12363 <http://tracker.ceph.com/issues/12363>`_, `pr#5532 <http://github.com/ceph/ceph/pull/5532>`_, Radoslaw Zarzynski, Orit Wasserman, Robin H. Johnson) -* rgw: use correct objv_tracker for bucket instance (`issue#11416 <http://tracker.ceph.com/issues/11416>`_, `pr#4535 <http://github.com/ceph/ceph/pull/4535>`_, Yehuda Sadeh) -* tests: ceph-fuse crash in test_client_recovery (`issue#12673 <http://tracker.ceph.com/issues/12673>`_, `pr#5813 <http://github.com/ceph/ceph/pull/5813>`_, Loic Dachary) -* tests: kernel_untar_build fails on EL7 (`issue#11758 <http://tracker.ceph.com/issues/11758>`_, `pr#6000 <http://github.com/ceph/ceph/pull/6000>`_, Greg Farnum) -* tests: qemu workunit refers to apt-mirror.front.sepia.ceph.com (`issue#13420 <http://tracker.ceph.com/issues/13420>`_, `pr#6328 <http://github.com/ceph/ceph/pull/6328>`_, Yuan Zhou, Sage Weil) -* tools: src/ceph-disk : disk zap sgdisk invocation (`issue#11143 <http://tracker.ceph.com/issues/11143>`_, `pr#4636 <http://github.com/ceph/ceph/pull/4636>`_, Thorsten Behrens, Owen Synge) -* tools: ceph-disk: sometimes the journal symlink is not created (`issue#10146 <http://tracker.ceph.com/issues/10146>`_, `pr#5541 <http://github.com/ceph/ceph/pull/5541>`_, Dan van der Ster) -* tools: ceph-disk: support NVMe device partitions (`issue#11612 <http://tracker.ceph.com/issues/11612>`_, `pr#4771 <http://github.com/ceph/ceph/pull/4771>`_, Ilja Slepnev) -* tools: ceph-post-file fails on rhel7 (`issue#11836 <http://tracker.ceph.com/issues/11836>`_, `pr#5037 <http://github.com/ceph/ceph/pull/5037>`_, Joseph McDonald, Sage Weil) -* tools: ceph_argparse_flag has no regular 3rd parameter (`issue#11543 <http://tracker.ceph.com/issues/11543>`_, `pr#4582 <http://github.com/ceph/ceph/pull/4582>`_, Thorsten Behrens) -* tools: use a new disk as journal disk,ceph-disk prepare fail (`issue#10983 <http://tracker.ceph.com/issues/10983>`_, `pr#4630 <http://github.com/ceph/ceph/pull/4630>`_, Loic Dachary) - - -v0.80.10 Firefly -================ - -This is a bugfix release for Firefly. - -We recommend that all Firefly users upgrade. - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.10.txt>`. - -Notable Changes ---------------- - -* build/ops: ceph.spec.in: package mkcephfs on EL6 (`issue#11955 <http://tracker.ceph.com/issues/11955>`_, `pr#4924 <http://github.com/ceph/ceph/pull/4924>`_, Ken Dreyer) -* build/ops: debian: ceph-test and rest-bench debug packages should require their respective binary packages (`issue#11673 <http://tracker.ceph.com/issues/11673>`_, `pr#4766 <http://github.com/ceph/ceph/pull/4766>`_, Ken Dreyer) -* build/ops: run RGW as root (`issue#11453 <http://tracker.ceph.com/issues/11453>`_, `pr#4638 <http://github.com/ceph/ceph/pull/4638>`_, Ken Dreyer) -* common: messages/MWatchNotify: include an error code in the message (`issue#9193 <http://tracker.ceph.com/issues/9193>`_, `pr#3944 <http://github.com/ceph/ceph/pull/3944>`_, Sage Weil) -* common: Rados.shutdown() dies with Illegal instruction (core dumped) (`issue#10153 <http://tracker.ceph.com/issues/10153>`_, `pr#3963 <http://github.com/ceph/ceph/pull/3963>`_, Federico Simoncelli) -* common: SimpleMessenger: allow RESETSESSION whenever we forget an endpoint (`issue#10080 <http://tracker.ceph.com/issues/10080>`_, `pr#3915 <http://github.com/ceph/ceph/pull/3915>`_, Greg Farnum) -* common: WorkQueue: make wait timeout on empty queue configurable (`issue#10817 <http://tracker.ceph.com/issues/10817>`_, `pr#3941 <http://github.com/ceph/ceph/pull/3941>`_, Samuel Just) -* crush: set_choose_tries = 100 for erasure code rulesets (`issue#10353 <http://tracker.ceph.com/issues/10353>`_, `pr#3824 <http://github.com/ceph/ceph/pull/3824>`_, Loic Dachary) -* doc: backport ceph-disk man page to Firefly (`issue#10724 <http://tracker.ceph.com/issues/10724>`_, `pr#3936 <http://github.com/ceph/ceph/pull/3936>`_, Nilamdyuti Goswami) -* doc: Fix ceph command manpage to match ceph -h (`issue#10676 <http://tracker.ceph.com/issues/10676>`_, `pr#3996 <http://github.com/ceph/ceph/pull/3996>`_, David Zafman) -* fs: mount.ceph: avoid spurious error message (`issue#10351 <http://tracker.ceph.com/issues/10351>`_, `pr#3927 <http://github.com/ceph/ceph/pull/3927>`_, Yan, Zheng) -* librados: Fix memory leak in python rados bindings (`issue#10723 <http://tracker.ceph.com/issues/10723>`_, `pr#3935 <http://github.com/ceph/ceph/pull/3935>`_, Josh Durgin) -* librados: fix resources leakage in RadosClient::connect() (`issue#10425 <http://tracker.ceph.com/issues/10425>`_, `pr#3828 <http://github.com/ceph/ceph/pull/3828>`_, Radoslaw Zarzynski) -* librados: Translate operation flags from C APIs (`issue#10497 <http://tracker.ceph.com/issues/10497>`_, `pr#3930 <http://github.com/ceph/ceph/pull/3930>`_, Matt Richards) -* librbd: acquire cache_lock before refreshing parent (`issue#5488 <http://tracker.ceph.com/issues/5488>`_, `pr#4206 <http://github.com/ceph/ceph/pull/4206>`_, Jason Dillaman) -* librbd: snap_remove should ignore -ENOENT errors (`issue#11113 <http://tracker.ceph.com/issues/11113>`_, `pr#4245 <http://github.com/ceph/ceph/pull/4245>`_, Jason Dillaman) -* mds: fix assertion caused by system clock backwards (`issue#11053 <http://tracker.ceph.com/issues/11053>`_, `pr#3970 <http://github.com/ceph/ceph/pull/3970>`_, Yan, Zheng) -* mon: ignore osd failures from before up_from (`issue#10762 <http://tracker.ceph.com/issues/10762>`_, `pr#3937 <http://github.com/ceph/ceph/pull/3937>`_, Sage Weil) -* mon: MonCap: take EntityName instead when expanding profiles (`issue#10844 <http://tracker.ceph.com/issues/10844>`_, `pr#3942 <http://github.com/ceph/ceph/pull/3942>`_, Joao Eduardo Luis) -* mon: Monitor: fix timecheck rounds period (`issue#10546 <http://tracker.ceph.com/issues/10546>`_, `pr#3932 <http://github.com/ceph/ceph/pull/3932>`_, Joao Eduardo Luis) -* mon: OSDMonitor: do not trust small values in osd epoch cache (`issue#10787 <http://tracker.ceph.com/issues/10787>`_, `pr#3823 <http://github.com/ceph/ceph/pull/3823>`_, Sage Weil) -* mon: OSDMonitor: fallback to json-pretty in case of invalid formatter (`issue#9538 <http://tracker.ceph.com/issues/9538>`_, `pr#4475 <http://github.com/ceph/ceph/pull/4475>`_, Loic Dachary) -* mon: PGMonitor: several stats output error fixes (`issue#10257 <http://tracker.ceph.com/issues/10257>`_, `pr#3826 <http://github.com/ceph/ceph/pull/3826>`_, Joao Eduardo Luis) -* objecter: fix map skipping (`issue#9986 <http://tracker.ceph.com/issues/9986>`_, `pr#3952 <http://github.com/ceph/ceph/pull/3952>`_, Ding Dinghua) -* osd: cache tiering: fix the atime logic of the eviction (`issue#9915 <http://tracker.ceph.com/issues/9915>`_, `pr#3949 <http://github.com/ceph/ceph/pull/3949>`_, Zhiqiang Wang) -* osd: cancel_pull: requeue waiters (`issue#11244 <http://tracker.ceph.com/issues/11244>`_, `pr#4415 <http://github.com/ceph/ceph/pull/4415>`_, Samuel Just) -* osd: check that source OSD is valid for MOSDRepScrub (`issue#9555 <http://tracker.ceph.com/issues/9555>`_, `pr#3947 <http://github.com/ceph/ceph/pull/3947>`_, Sage Weil) -* osd: DBObjectMap: lock header_lock on sync() (`issue#9891 <http://tracker.ceph.com/issues/9891>`_, `pr#3948 <http://github.com/ceph/ceph/pull/3948>`_, Samuel Just) -* osd: do not ignore deleted pgs on startup (`issue#10617 <http://tracker.ceph.com/issues/10617>`_, `pr#3933 <http://github.com/ceph/ceph/pull/3933>`_, Sage Weil) -* osd: ENOENT on clone (`issue#11199 <http://tracker.ceph.com/issues/11199>`_, `pr#4385 <http://github.com/ceph/ceph/pull/4385>`_, Samuel Just) -* osd: erasure-code-profile set races with erasure-code-profile rm (`issue#11144 <http://tracker.ceph.com/issues/11144>`_, `pr#4383 <http://github.com/ceph/ceph/pull/4383>`_, Loic Dachary) -* osd: FAILED assert(soid < scrubber.start || soid >= scrubber.end) (`issue#11156 <http://tracker.ceph.com/issues/11156>`_, `pr#4185 <http://github.com/ceph/ceph/pull/4185>`_, Samuel Just) -* osd: FileJournal: fix journalq population in do_read_entry() (`issue#6003 <http://tracker.ceph.com/issues/6003>`_, `pr#3960 <http://github.com/ceph/ceph/pull/3960>`_, Samuel Just) -* osd: fix negative degraded objects during backfilling (`issue#7737 <http://tracker.ceph.com/issues/7737>`_, `pr#4021 <http://github.com/ceph/ceph/pull/4021>`_, Guang Yang) -* osd: get the currently atime of the object in cache pool for eviction (`issue#9985 <http://tracker.ceph.com/issues/9985>`_, `pr#3950 <http://github.com/ceph/ceph/pull/3950>`_, Sage Weil) -* osd: load_pgs: we need to handle the case where an upgrade from earlier versions which ignored non-existent pgs resurrects a pg with a prehistoric osdmap (`issue#11429 <http://tracker.ceph.com/issues/11429>`_, `pr#4556 <http://github.com/ceph/ceph/pull/4556>`_, Samuel Just) -* osd: ObjectStore: Don't use largest_data_off to calc data_align. (`issue#10014 <http://tracker.ceph.com/issues/10014>`_, `pr#3954 <http://github.com/ceph/ceph/pull/3954>`_, Jianpeng Ma) -* osd: osd_types: op_queue_age_hist and fs_perf_stat should be in osd_stat_t::o... (`issue#10259 <http://tracker.ceph.com/issues/10259>`_, `pr#3827 <http://github.com/ceph/ceph/pull/3827>`_, Samuel Just) -* osd: PG::actingset should be used when checking the number of acting OSDs for... (`issue#11454 <http://tracker.ceph.com/issues/11454>`_, `pr#4453 <http://github.com/ceph/ceph/pull/4453>`_, Guang Yang) -* osd: PG::all_unfound_are_queried_or_lost for non-existent osds (`issue#10976 <http://tracker.ceph.com/issues/10976>`_, `pr#4416 <http://github.com/ceph/ceph/pull/4416>`_, Mykola Golub) -* osd: PG: always clear_primary_state (`issue#10059 <http://tracker.ceph.com/issues/10059>`_, `pr#3955 <http://github.com/ceph/ceph/pull/3955>`_, Samuel Just) -* osd: PGLog.h: 279: FAILED assert(log.log.size() == log_keys_debug.size()) (`issue#10718 <http://tracker.ceph.com/issues/10718>`_, `pr#4382 <http://github.com/ceph/ceph/pull/4382>`_, Samuel Just) -* osd: PGLog: include rollback_info_trimmed_to in (read|write)_log (`issue#10157 <http://tracker.ceph.com/issues/10157>`_, `pr#3964 <http://github.com/ceph/ceph/pull/3964>`_, Samuel Just) -* osd: pg stuck stale after create with activation delay (`issue#11197 <http://tracker.ceph.com/issues/11197>`_, `pr#4384 <http://github.com/ceph/ceph/pull/4384>`_, Samuel Just) -* osd: ReplicatedPG: fail a non-blocking flush if the object is being scrubbed (`issue#8011 <http://tracker.ceph.com/issues/8011>`_, `pr#3943 <http://github.com/ceph/ceph/pull/3943>`_, Samuel Just) -* osd: ReplicatedPG::on_change: clean up callbacks_for_degraded_object (`issue#8753 <http://tracker.ceph.com/issues/8753>`_, `pr#3940 <http://github.com/ceph/ceph/pull/3940>`_, Samuel Just) -* osd: ReplicatedPG::scan_range: an object can disappear between the list and t... (`issue#10150 <http://tracker.ceph.com/issues/10150>`_, `pr#3962 <http://github.com/ceph/ceph/pull/3962>`_, Samuel Just) -* osd: requeue blocked op before flush it was blocked on (`issue#10512 <http://tracker.ceph.com/issues/10512>`_, `pr#3931 <http://github.com/ceph/ceph/pull/3931>`_, Sage Weil) -* rgw: check for timestamp for s3 keystone auth (`issue#10062 <http://tracker.ceph.com/issues/10062>`_, `pr#3958 <http://github.com/ceph/ceph/pull/3958>`_, Abhishek Lekshmanan) -* rgw: civetweb should use unique request id (`issue#11720 <http://tracker.ceph.com/issues/11720>`_, `pr#4780 <http://github.com/ceph/ceph/pull/4780>`_, Orit Wasserman) -* rgw: don't allow negative / invalid content length (`issue#11890 <http://tracker.ceph.com/issues/11890>`_, `pr#4829 <http://github.com/ceph/ceph/pull/4829>`_, Yehuda Sadeh) -* rgw: fail s3 POST auth if keystone not configured (`issue#10698 <http://tracker.ceph.com/issues/10698>`_, `pr#3966 <http://github.com/ceph/ceph/pull/3966>`_, Yehuda Sadeh) -* rgw: flush xml header on get acl request (`issue#10106 <http://tracker.ceph.com/issues/10106>`_, `pr#3961 <http://github.com/ceph/ceph/pull/3961>`_, Yehuda Sadeh) -* rgw: generate new tag for object when setting object attrs (`issue#11256 <http://tracker.ceph.com/issues/11256>`_, `pr#4571 <http://github.com/ceph/ceph/pull/4571>`_, Yehuda Sadeh) -* rgw: generate the "Date" HTTP header for civetweb. (`issue#11871,11891 <http://tracker.ceph.com/issues/11871,11891>`_, `pr#4851 <http://github.com/ceph/ceph/pull/4851>`_, Radoslaw Zarzynski) -* rgw: keystone token cache does not work correctly (`issue#11125 <http://tracker.ceph.com/issues/11125>`_, `pr#4414 <http://github.com/ceph/ceph/pull/4414>`_, Yehuda Sadeh) -* rgw: merge manifests correctly when there's prefix override (`issue#11622 <http://tracker.ceph.com/issues/11622>`_, `pr#4697 <http://github.com/ceph/ceph/pull/4697>`_, Yehuda Sadeh) -* rgw: send appropriate op to cancel bucket index pending operation (`issue#10770 <http://tracker.ceph.com/issues/10770>`_, `pr#3938 <http://github.com/ceph/ceph/pull/3938>`_, Yehuda Sadeh) -* rgw: shouldn't need to disable rgw_socket_path if frontend is configured (`issue#11160 <http://tracker.ceph.com/issues/11160>`_, `pr#4275 <http://github.com/ceph/ceph/pull/4275>`_, Yehuda Sadeh) -* rgw: Swift API. Dump container's custom metadata. (`issue#10665 <http://tracker.ceph.com/issues/10665>`_, `pr#3934 <http://github.com/ceph/ceph/pull/3934>`_, Dmytro Iurchenko) -* rgw: Swift API. Support for X-Remove-Container-Meta-{key} header. (`issue#10475 <http://tracker.ceph.com/issues/10475>`_, `pr#3929 <http://github.com/ceph/ceph/pull/3929>`_, Dmytro Iurchenko) -* rgw: use correct objv_tracker for bucket instance (`issue#11416 <http://tracker.ceph.com/issues/11416>`_, `pr#4379 <http://github.com/ceph/ceph/pull/4379>`_, Yehuda Sadeh) -* tests: force checkout of submodules (`issue#11157 <http://tracker.ceph.com/issues/11157>`_, `pr#4079 <http://github.com/ceph/ceph/pull/4079>`_, Loic Dachary) -* tools: Backport ceph-objectstore-tool changes to firefly (`issue#12327 <http://tracker.ceph.com/issues/12327>`_, `pr#3866 <http://github.com/ceph/ceph/pull/3866>`_, David Zafman) -* tools: ceph-objectstore-tool: Output only unsupported features when incomatible (`issue#11176 <http://tracker.ceph.com/issues/11176>`_, `pr#4126 <http://github.com/ceph/ceph/pull/4126>`_, David Zafman) -* tools: ceph-objectstore-tool: Use exit status 11 for incompatible import attemp... (`issue#11139 <http://tracker.ceph.com/issues/11139>`_, `pr#4129 <http://github.com/ceph/ceph/pull/4129>`_, David Zafman) -* tools: Fix do_autogen.sh so that -L is allowed (`issue#11303 <http://tracker.ceph.com/issues/11303>`_, `pr#4247 <http://github.com/ceph/ceph/pull/4247>`_, Alfredo Deza) - -v0.80.9 Firefly -=============== - -This is a bugfix release for firefly. It fixes a performance -regression in librbd, an important CRUSH misbehavior (see below), and -several RGW bugs. We have also backported support for flock/fcntl -locks to ceph-fuse and libcephfs. - -We recommend that all Firefly users upgrade. - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.9.txt>`. - -Adjusting CRUSH maps --------------------- - -* This point release fixes several issues with CRUSH that trigger - excessive data migration when adjusting OSD weights. These are most - obvious when a very small weight change (e.g., a change from 0 to - .01) triggers a large amount of movement, but the same set of bugs - can also lead to excessive (though less noticeable) movement in - other cases. - - However, because the bug may already have affected your cluster, - fixing it may trigger movement *back* to the more correct location. - For this reason, you must manually opt-in to the fixed behavior. - - In order to set the new tunable to correct the behavior:: - - ceph osd crush set-tunable straw_calc_version 1 - - Note that this change will have no immediate effect. However, from - this point forward, any 'straw' bucket in your CRUSH map that is - adjusted will get non-buggy internal weights, and that transition - may trigger some rebalancing. - - You can estimate how much rebalancing will eventually be necessary - on your cluster with:: - - ceph osd getcrushmap -o /tmp/cm - crushtool -i /tmp/cm --num-rep 3 --test --show-mappings > /tmp/a 2>&1 - crushtool -i /tmp/cm --set-straw-calc-version 1 -o /tmp/cm2 - crushtool -i /tmp/cm2 --reweight -o /tmp/cm2 - crushtool -i /tmp/cm2 --num-rep 3 --test --show-mappings > /tmp/b 2>&1 - wc -l /tmp/a # num total mappings - diff -u /tmp/a /tmp/b | grep -c ^+ # num changed mappings - - Divide the number of changed lines by the total number of lines in - /tmp/a. We've found that most clusters are under 10%. - - You can force all of this rebalancing to happen at once with:: - - ceph osd crush reweight-all - - Otherwise, it will happen at some unknown point in the future when - CRUSH weights are next adjusted. - -Notable Changes ---------------- - -* ceph-fuse: flock, fcntl lock support (Yan, Zheng, Greg Farnum) -* crush: fix straw bucket weight calculation, add straw_calc_version tunable (#10095 Sage Weil) -* crush: fix tree bucket (Rongzu Zhu) -* crush: fix underflow of tree weights (Loic Dachary, Sage Weil) -* crushtool: add --reweight (Sage Weil) -* librbd: complete pending operations before losing image (#10299 Jason Dillaman) -* librbd: fix read caching performance regression (#9854 Jason Dillaman) -* librbd: gracefully handle deleted/renamed pools (#10270 Jason Dillaman) -* mon: fix dump of chooseleaf_vary_r tunable (Sage Weil) -* osd: fix PG ref leak in snaptrimmer on peering (#10421 Kefu Chai) -* osd: handle no-op write with snapshot (#10262 Sage Weil) -* radosgw-admin: create subuser when creating user (#10103 Yehuda Sadeh) -* rgw: change multipart uplaod id magic (#10271 Georgio Dimitrakakis, Yehuda Sadeh) -* rgw: don't overwrite bucket/object owner when setting ACLs (#10978 Yehuda Sadeh) -* rgw: enable IPv6 for embedded civetweb (#10965 Yehuda Sadeh) -* rgw: fix partial swift GET (#10553 Yehuda Sadeh) -* rgw: fix quota disable (#9907 Dong Lei) -* rgw: index swift keys appropriately (#10471 Hemant Burman, Yehuda Sadeh) -* rgw: make setattrs update bucket index (#5595 Yehuda Sadeh) -* rgw: pass civetweb configurables (#10907 Yehuda Sadeh) -* rgw: remove swift user manifest (DLO) hash calculation (#9973 Yehuda Sadeh) -* rgw: return correct len for 0-len objects (#9877 Yehuda Sadeh) -* rgw: S3 object copy content-type fix (#9478 Yehuda Sadeh) -* rgw: send ETag on S3 object copy (#9479 Yehuda Sadeh) -* rgw: send HTTP status reason explicitly in fastcgi (Yehuda Sadeh) -* rgw: set ulimit -n from sysvinit (el6) init script (#9587 Sage Weil) -* rgw: update swift subuser permission masks when authenticating (#9918 Yehuda Sadeh) -* rgw: URL decode query params correctly (#10271 Georgio Dimitrakakis, Yehuda Sadeh) -* rgw: use attrs when reading object attrs (#10307 Yehuda Sadeh) -* rgw: use \r\n for http headers (#9254 Benedikt Fraunhofer, Yehuda Sadeh) - - -v0.80.8 Firefly -=============== - -This is a long-awaited bugfix release for firefly. It has several -important (but relatively rare) OSD peering fixes, performance issues -when snapshots are trimmed, several RGW fixes, a paxos corner case -fix, and some packaging updates. - -We recommend that all users for v0.80.x firefly upgrade when it is -convenient to do so. - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.8.txt>`. - -Notable Changes ---------------- - -* build: remove stack-execute bit from assembled code sections (#10114 Dan Mick) -* ceph-disk: fix dmcrypt key permissions (#9785 Loic Dachary) -* ceph-disk: fix keyring location (#9653 Loic Dachary) -* ceph-disk: make partition checks more robust (#9721 #9665 Loic Dachary) -* ceph: cleanly shut down librados context on shutdown (#8797 Dan Mick) -* common: add $cctid config metavariable (#6228 Adam Crume) -* crush: align rule and ruleset ids (#9675 Xiaoxi Chen) -* crush: fix negative weight bug during create_or_move_item (#9998 Pawel Sadowski) -* crush: fix potential buffer overflow in erasure rules (#9492 Johnu George) -* debian: fix python-ceph -> ceph file movement (Sage Weil) -* libcephfs,ceph-fuse: fix flush tid wraparound bug (#9869 Greg Farnum, Yan, Zheng) -* libcephfs: close fd befure umount (#10415 Yan, Zheng) -* librados: fix crash from C API when read timeout is enabled (#9582 Sage Weil) -* librados: handle reply race with pool deletion (#10372 Sage Weil) -* librbd: cap memory utilization for read requests (Jason Dillaman) -* librbd: do not close a closed parent image on failure (#10030 Jason Dillaman) -* librbd: fix diff tests (#10002 Josh Durgin) -* librbd: protect list_children from invalid pools (#10123 Jason Dillaman) -* make check improvemens (Loic Dachary) -* mds: fix ctime updates (#9514 Greg Farnum) -* mds: fix journal import tool (#10025 John Spray) -* mds: fix rare NULL deref in cap flush handler (Greg Farnum) -* mds: handle unknown lock messages (Yan, Zheng) -* mds: store backtrace for straydir (Yan, Zheng) -* mon: abort startup if disk is full (#9502 Joao Eduardo Luis) -* mon: add paxos instrumentation (Sage Weil) -* mon: fix double-free in rare OSD startup path (Sage Weil) -* mon: fix osdmap trimming (#9987 Sage Weil) -* mon: fix paxos corner cases (#9301 #9053 Sage Weil) -* osd: cancel callback on blacklisted watchers (#8315 Samuel Just) -* osd: cleanly abort set-alloc-hint operations during upgrade (#9419 David Zafman) -* osd: clear rollback PG metadata on PG deletion (#9293 Samuel Just) -* osd: do not abort deep scrub if hinfo is missing (#10018 Loic Dachary) -* osd: erasure-code regression tests (Loic Dachary) -* osd: fix distro metadata reporting for SUSE (#8654 Danny Al-Gaaf) -* osd: fix full OSD checks during backfill (#9574 Samuel Just) -* osd: fix ioprio parsing (#9677 Loic Dachary) -* osd: fix journal direct-io shutdown (#9073 Mark Kirkwood, Ma Jianpeng, Somnath Roy) -* osd: fix journal dump (Ma Jianpeng) -* osd: fix occasional stall during peering or activation (Sage Weil) -* osd: fix past_interval display bug (#9752 Loic Dachary) -* osd: fix rare crash triggered by admin socket dump_ops_in_filght (#9916 Dong Lei) -* osd: fix snap trimming performance issues (#9487 #9113 Samuel Just, Sage Weil, Dan van der Ster, Florian Haas) -* osd: fix snapdir handling on cache eviction (#8629 Sage Weil) -* osd: handle map gaps in map advance code (Sage Weil) -* osd: handle undefined CRUSH results in interval check (#9718 Samuel Just) -* osd: include shard in JSON dump of ghobject (#10063 Loic Dachary) -* osd: make backfill reservation denial handling more robust (#9626 Samuel Just) -* osd: make misdirected op checks handle EC + primary affinity (#9835 Samuel Just, Sage Weil) -* osd: mount XFS with inode64 by default (Sage Weil) -* osd: other misc bugs (#9821 #9875 Samuel Just) -* rgw: add .log to default log path (#9353 Alexandre Marangone) -* rgw: clean up fcgi request context (#10194 Yehuda Sadeh) -* rgw: convet header underscores to dashes (#9206 Yehuda Sadeh) -* rgw: copy object data if copy target is in different pool (#9039 Yehuda Sadeh) -* rgw: don't try to authenticate CORS peflight request (#8718 Robert Hubbard, Yehuda Sadeh) -* rgw: fix civetweb URL decoding (#8621 Yehuda Sadeh) -* rgw: fix hash calculation during PUT (Yehuda Sadeh) -* rgw: fix misc bugs (#9089 #9201 Yehuda Sadeh) -* rgw: fix object tail test (#9226 Sylvain Munaut, Yehuda Sadeh) -* rgw: make sysvinit script run rgw under systemd context as needed (#10125 Loic Dachary) -* rgw: separate civetweb log from rgw log (Yehuda Sadeh) -* rgw: set length for keystone token validations (#7796 Mark Kirkwood, Yehuda Sadeh) -* rgw: subuser creation fixes (#8587 Yehuda Sadeh) -* rpm: misc packaging improvements (Sandon Van Ness, Dan Mick, Erik Logthenberg, Boris Ranto) -* rpm: use standard udev rules for CentOS7/RHEL7 (#9747 Loic Dachary) - - -v0.80.7 Firefly -=============== - -This release fixes a few critical issues with v0.80.6, particularly -with clusters running mixed versions. - -We recommend that all v0.80.x Firefly users upgrade to this release. - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.7.txt>`. - -Notable Changes ---------------- - -* osd: fix invalid memory reference in log trimming (#9731 Samuel Just) -* osd: fix use-after-free in cache tiering code (#7588 Sage Weil) -* osd: remove bad backfill assertion for mixed-version clusters (#9696 Samuel Just) - - - -v0.80.6 Firefly -=============== - -This is a major bugfix release for firefly, fixing a range of issues -in the OSD and monitor, particularly with cache tiering. There are -also important fixes in librados, with the watch/notify mechanism used -by librbd, and in radosgw. - -A few pieces of new functionality of been backported, including improved -'ceph df' output (view amount of writeable space per pool), support for -non-default cluster names when using sysvinit or systemd, and improved -(and fixed) support for dmcrypt. - -We recommend that all v0.80.x Firefly users upgrade to this release. - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.6.txt>`. - -Notable Changes ---------------- - -* build: fix atomic64_t on i386 (#8969 Sage Weil) -* build: fix build on alpha (Michael Cree, Dmitry Smirnov) -* build: fix build on hppa (Dmitry Smirnov) -* build: fix yasm detection on x32 arch (Sage Weil) -* ceph-disk: fix 'list' function with dmcrypt (Sage Weil) -* ceph-disk: fix dmcrypt support (Alfredo Deza) -* ceph: allow non-default cluster to be specified (#8944) -* common: fix dup log messages to mon (#9080 Sage Weil) -* global: write pid file when -f is used (systemd, upstart) (Alexandre Oliva) -* librados: fix crash when read timeout is enabled (#9362 Matthias Kiefer, Sage Weil) -* librados: fix lock leaks in error paths (#9022 Pavan Rallabhandi) -* librados: fix watch resend on PG acting set change (#9220 Samuel Just) -* librados: python: fix aio_read handling with \0 (Mohammad Salehe) -* librbd: add interface to invalidate cached data (Josh Durgin) -* librbd: fix crash when using clone of flattened image (#8845 Josh Durgin) -* librbd: fix error path cleanup on open (#8912 Josh Durgin) -* librbd: fix null pointer check (Danny Al-Gaaf) -* librbd: limit dirty object count (Haomai Wang) -* mds: fix rstats for root and mdsdir (Yan, Zheng) -* mon: add 'get' command for new cache tier pool properties (Joao Eduardo Luis) -* mon: add 'osd pool get-quota' (#8523 Joao Eduardo Luis) -* mon: add cluster fingerprint (Sage Weil) -* mon: disallow nonsensical cache-mode transitions (#8155 Joao Eduardo Luis) -* mon: fix cache tier rounding error on i386 (Sage Weil) -* mon: fix occasional memory leak (#9176 Sage Weil) -* mon: fix reported latency for 'osd perf' (#9269 Samuel Just) -* mon: include 'max avail' in 'ceph df' output (Sage Weil, Xioaxi Chen) -* mon: persistently mark pools where scrub may find incomplete clones (#8882 Sage Weil) -* mon: preload erasure plugins (Loic Dachary) -* mon: prevent cache-specific settings on non-tier pools (#8696 Joao Eduardo Luis) -* mon: reduce log spam (Aanchal Agrawal, Sage Weil) -* mon: warn when cache pools have no hit_sets enabled (Sage Weil) -* msgr: fix trivial memory leak (Sage Weil) -* osd: automatically scrub PGs with invalid stats (#8147 Sage Weil) -* osd: avoid sharing PG metadata that is not durable (Samuel Just) -* osd: cap hit_set size (#9339 Samuel Just) -* osd: create default erasure profile if needed (#8601 Loic Dachary) -* osd: dump tid as JSON int (not string) where appropriate (Joao Eduardo Luis) -* osd: encode blacklist in deterministic order (#9211 Sage Weil) -* osd: fix behavior when cache tier has no hit_sets enabled (#8982 Sage Weil) -* osd: fix cache tier flushing of snapshots (#9054 Samuel Just) -* osd: fix cache tier op ordering when going from full to non-full (#8931 Sage Weil) -* osd: fix crash on dup recovery reservation (#8863 Sage Weil) -* osd: fix division by zero when pg_num adjusted with no OSDs (#9052 Sage Weil) -* osd: fix hint crash in experimental keyvaluestore_dev backend (Hoamai Wang) -* osd: fix leak in copyfrom cancellation (#8894 Samuel Just) -* osd: fix locking for copyfrom finish (#8889 Sage Weil) -* osd: fix long filename handling in backend (#8701 Sage Weil) -* osd: fix min_size check with backfill (#9497 Samuel Just) -* osd: fix mount/remount sync race (#9144 Sage Weil) -* osd: fix object listing + erasure code bug (Guang Yang) -* osd: fix race on reconnect to failed OSD (#8944 Greg Farnum) -* osd: fix recovery reservation deadlock (Samuel Just) -* osd: fix tiering agent arithmetic for negative values (#9082 Karan Singh) -* osd: improve shutdown order (#9218 Sage Weil) -* osd: improve subop discard logic (#9259 Samuel Just) -* osd: introduce optional sleep, io priority for scrub and snap trim (Sage Weil) -* osd: make scrub check for and remove stale erasure-coded objects (Samuel Just) -* osd: misc fixes (#9481 #9482 #9179 Sameul Just) -* osd: mix keyvaluestore_dev improvements (Haomai Wang) -* osd: only require CRUSH features for rules that are used (#8963 Sage Weil) -* osd: preload erasure plugins on startup (Loic Dachary) -* osd: prevent PGs from falling behind when consuming OSDMaps (#7576 Sage Weil) -* osd: prevent old clients from using tiered pools (#8714 Sage Weil) -* osd: set min_size on erasure pools to data chunk count (Sage Weil) -* osd: trim old erasure-coded objects more aggressively (Samuel Just) -* rados: enforce erasure code alignment (Lluis Pamies-Juarez) -* rgw: align object stripes with erasure pool alignment (#8442 Yehuda Sadeh) -* rgw: don't send error body on HEAD for civetweb (#8539 Yehuda Sadeh) -* rgw: fix crash in CORS preflight request (Yehuda Sadeh) -* rgw: fix decoding of + in URL (#8702 Brian Rak) -* rgw: fix object removal on object create (#8972 Patrycja Szabowska, Yehuda Sadeh) -* systemd: use systemd-run when starting radosgw (JuanJose Galvez) -* sysvinit: support non-default cluster name (Alfredo Deza) - - -v0.80.5 Firefly -=============== - -This release fixes a few important bugs in the radosgw and fixes -several packaging and environment issues, including OSD log rotation, -systemd environments, and daemon restarts on upgrade. - -We recommend that all v0.80.x Firefly users upgrade, particularly if they -are using upstart, systemd, or radosgw. - -Notable Changes ---------------- - -* ceph-dencoder: do not needlessly link to librgw, librados, etc. (Sage Weil) -* do not needlessly link binaries to leveldb (Sage Weil) -* mon: fix mon crash when no auth keys are present (#8851, Joao Eduardo Luis) -* osd: fix cleanup (and avoid occasional crash) during shutdown (#7981, Sage Weil) -* osd: fix log rotation under upstart (Sage Weil) -* rgw: fix multipart upload when object has irregular size (#8846, Yehuda Sadeh, Sylvain Munaut) -* rgw: improve bucket listing S3 compatibility (#8858, Yehuda Sadeh) -* rgw: improve delimited bucket listing (Yehuda Sadeh) -* rpm: do not restart daemons on upgrade (#8849, Alfredo Deza) - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.5.txt>`. - -v0.80.4 Firefly -=============== - -This Firefly point release fixes an potential data corruption problem -when ceph-osd daemons run on top of XFS and service Firefly librbd -clients. A recently added allocation hint that RBD utilizes triggers -an XFS bug on some kernels (Linux 3.2, and likely others) that leads -to data corruption and deep-scrub errors (and inconsistent PGs). This -release avoids the situation by disabling the allocation hint until we -can validate which kernels are affected and/or are known to be safe to -use the hint on. - -We recommend that all v0.80.x Firefly users urgently upgrade, -especially if they are using RBD. - -Notable Changes ---------------- - -* osd: disable XFS extsize hint by default (#8830, Samuel Just) -* rgw: fix extra data pool default name (Yehuda Sadeh) - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.4.txt>`. - - -v0.80.3 Firefly -=============== - -This is the third Firefly point release. It includes a single fix -for a radosgw regression that was discovered in v0.80.2 right after it -was released. - -We recommend that all v0.80.x Firefly users upgrade. - -Notable Changes ---------------- - -* radosgw: fix regression in manifest decoding (#8804, Sage Weil) - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.3.txt>`. - - -v0.80.2 Firefly -=============== - -This is the second Firefly point release. It contains a range of -important fixes, including several bugs in the OSD cache tiering, some -compatibility checks that affect upgrade situations, several radosgw -bugs, and an irritating and unnecessary feature bit check that -prevents older clients from communicating with a cluster with any -erasure coded pools. - -One someone large change in this point release is that the ceph RPM -package is separated into a ceph and ceph-common package, similar to -Debian. The ceph-common package contains just the client libraries -without any of the server-side daemons. - -We recommend that all v0.80.x Firefly users skip this release and use -v0.80.3. - -Notable Changes ---------------- - -* ceph-disk: better debug logging (Alfredo Deza) -* ceph-disk: fix preparation of OSDs with dmcrypt (#6700, Stephen F Taylor) -* ceph-disk: partprobe on prepare to fix dm-crypt (#6966, Eric Eastman) -* do not require ERASURE_CODE feature from clients (#8556, Sage Weil) -* libcephfs-java: build with older JNI headers (Greg Farnum) -* libcephfs-java: fix build with gcj-jdk (Dmitry Smirnov) -* librados: fix osd op tid for redirected ops (#7588, Samuel Just) -* librados: fix rados_pool_list buffer bounds checks (#8447, Sage Weil) -* librados: resend ops when pool overlay changes (#8305, Sage Weil) -* librbd, ceph-fuse: reduce CPU overhead for clean object check in cache (Haomai Wang) -* mon: allow deletion of cephfs pools (John Spray) -* mon: fix default pool ruleset choice (#8373, John Spray) -* mon: fix health summary for mon low disk warning (Sage Weil) -* mon: fix 'osd pool set <pool> cache_target_full_ratio' (Geoffrey Hartz) -* mon: fix quorum feature check (Greg Farnum) -* mon: fix request forwarding in mixed firefly+dumpling clusters 9#8727, Joao Eduardo Luis) -* mon: fix rule vs ruleset check in 'osd pool set ... crush_ruleset' command (John Spray) -* mon: make osd 'down' count accurate (Sage Weil) -* mon: set 'next commit' in primary-affinity reply (Ilya Dryomov) -* mon: verify CRUSH features are supported by all mons (#8738, Greg Farnum) -* msgr: fix sequence negotiation during connection reset (Guang Yang) -* osd: block scrub on blocked objects (#8011, Samuel Just) -* osd: call XFS hint ioctl less often (#8241, Ilya Dryomov) -* osd: copy xattr spill out marker on clone (Haomai Wang) -* osd: fix flush of snapped objects (#8334, Samuel Just) -* osd: fix hashindex restart of merge operation (#8332, Samuel Just) -* osd: fix osdmap subscription bug causing startup hang (Greg Farnum) -* osd: fix potential null deref (#8328, Sage Weil) -* osd: fix shutdown race (#8319, Sage Weil) -* osd: handle 'none' in CRUSH results properly during peering (#8507, Samuel Just) -* osd: set no spill out marker on new objects (Greg Farnum) -* osd: skip op ordering debug checks on tiered pools (#8380, Sage Weil) -* rados: enforce 'put' alignment (Lluis Pamies-Juarez) -* rest-api: fix for 'rx' commands (Ailing Zhang) -* rgw: calc user manifest etag and fix check (#8169, #8436, Yehuda Sadeh) -* rgw: fetch attrs on multipart completion (#8452, Yehuda Sadeh, Sylvain Munaut) -* rgw: fix buffer overflow for long instance ids (#8608, Yehuda Sadeh) -* rgw: fix entity permission check on metadata put (#8428, Yehuda Sadeh) -* rgw: fix multipart retry race (#8269, Yehuda Sadeh) -* rpm: split ceph into ceph and ceph-common RPMs (Sandon Van Ness, Dan Mick) -* sysvinit: continue startin daemons after failure doing mount (#8554, Sage Weil) - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.2.txt>`. - -v0.80.1 Firefly -=============== - -This first Firefly point release fixes a few bugs, the most visible -being a problem that prevents scrub from completing in some cases. - -Notable Changes ---------------- - -* osd: revert incomplete scrub fix (Samuel Just) -* rgw: fix stripe calculation for manifest objects (Yehuda Sadeh) -* rgw: improve handling, memory usage for abort reads (Yehuda Sadeh) -* rgw: send Swift user manifest HTTP header (Yehuda Sadeh) -* libcephfs, ceph-fuse: expose MDS session state via admin socket (Yan, Zheng) -* osd: add simple throttle for snap trimming (Sage Weil) -* monclient: fix possible hang from ill-timed monitor connection failure (Sage Weil) -* osd: fix trimming of past HitSets (Sage Weil) -* osd: fix whiteouts for non-writeback cache modes (Sage Weil) -* osd: prevent divide by zero in tiering agent (David Zafman) -* osd: prevent busy loop when tiering agent can do no work (David Zafman) - -For more detailed information, see :download:`the complete changelog <../changelog/v0.80.1.txt>`. - - -v0.80 Firefly -============= - -This release will form the basis for our long-term supported release -Firefly, v0.80.x. The big new features are support for erasure coding -and cache tiering, although a broad range of other features, fixes, -and improvements have been made across the code base. Highlights include: - -* *Erasure coding*: support for a broad range of erasure codes for lower - storage overhead and better data durability. -* *Cache tiering*: support for creating 'cache pools' that store hot, - recently accessed objects with automatic demotion of colder data to - a base tier. Typically the cache pool is backed by faster storage - devices like SSDs. -* *Primary affinity*: Ceph now has the ability to skew selection of - OSDs as the "primary" copy, which allows the read workload to be - cheaply skewed away from parts of the cluster without migrating any - data. -* *Key/value OSD backend* (experimental): An alternative storage backend - for Ceph OSD processes that puts all data in a key/value database like - leveldb. This provides better performance for workloads dominated by - key/value operations (like radosgw bucket indices). -* *Standalone radosgw* (experimental): The radosgw process can now run - in a standalone mode without an apache (or similar) web server or - fastcgi. This simplifies deployment and can improve performance. - -We expect to maintain a series of stable releases based on v0.80 -Firefly for as much as a year. In the meantime, development of Ceph -continues with the next release, Giant, which will feature work on the -CephFS distributed file system, more alternative storage backends -(like RocksDB and f2fs), RDMA support, support for pyramid erasure -codes, and additional functionality in the block device (RBD) like -copy-on-read and multisite mirroring. - - -Upgrade Sequencing ------------------- - -* If your existing cluster is running a version older than v0.67 - Dumpling, please first upgrade to the latest Dumpling release before - upgrading to v0.80 Firefly. Please refer to the :ref:`dumpling-upgrade` - documentation. - -* We recommend adding the following to the [mon] section of your - ceph.conf prior to upgrade:: - - mon warn on legacy crush tunables = false - - This will prevent health warnings due to the use of legacy CRUSH - placement. Although it is possible to rebalance existing data - across your cluster (see the upgrade notes below), we do not - normally recommend it for production environments as a large amount - of data will move and there is a significant performance impact from - the rebalancing. - -* Upgrade daemons in the following order: - - #. Monitors - #. OSDs - #. MDSs and/or radosgw - - If the ceph-mds daemon is restarted first, it will wait until all - OSDs have been upgraded before finishing its startup sequence. If - the ceph-mon daemons are not restarted prior to the ceph-osd - daemons, they will not correctly register their new capabilities - with the cluster and new features may not be usable until they are - restarted a second time. - -* Upgrade radosgw daemons together. There is a subtle change in behavior - for multipart uploads that prevents a multipart request that was initiated - with a new radosgw from being completed by an old radosgw. - - -Upgrading from v0.79 --------------------- - -* OSDMap's json-formatted dump changed for keys 'full' and 'nearfull'. - What was previously being outputted as 'true' or 'false' strings are - now being outputted 'true' and 'false' booleans according to json syntax. - -* HEALTH_WARN on 'mon osd down out interval == 0'. Having this option set - to zero on the leader acts much like having the 'noout' flag set. This - warning will only be reported if the monitor getting the 'health' or - 'status' request has this option set to zero. - -* Monitor 'auth' commands now require the mon 'x' capability. This matches - dumpling v0.67.x and earlier, but differs from emperor v0.72.x. - -* A librados WATCH operation on a non-existent object now returns ENOENT; - previously it did not. - -* Librados interface change: As there are no partial writes, the rados_write() - and rados_append() operations now return 0 on success like rados_write_full() - always has. This includes the C++ interface equivalents and AIO return - values for the aio variants. - -* The radosgw init script (sysvinit) how requires that the 'host = ...' line in - ceph.conf, if present, match the short hostname (the output of 'hostname -s'), - not the fully qualified hostname or the (occasionally non-short) output of - 'hostname'. Failure to adjust this when upgrading from emperor or dumpling - may prevent the radosgw daemon from starting. - -Upgrading from v0.72 Emperor ----------------------------- - -* See notes above. - -* The 'ceph -s' or 'ceph status' command's 'num_in_osds' field in the - JSON and XML output has been changed from a string to an int. - -* The recently added 'ceph mds set allow_new_snaps' command's syntax - has changed slightly; it is now 'ceph mds set allow_new_snaps true'. - The 'unset' command has been removed; instead, set the value to - 'false'. - -* The syntax for allowing snapshots is now 'mds set allow_new_snaps - <true|false>' instead of 'mds <set,unset> allow_new_snaps'. - -* 'rbd ls' on a pool which never held rbd images now exits with code - 0. It outputs nothing in plain format, or an empty list in - non-plain format. This is consistent with the behavior for a pool - which used to hold images, but contains none. Scripts relying on - this behavior should be updated. - -* The MDS requires a new OSD operation TMAP2OMAP, added in this release. When - upgrading, be sure to upgrade and restart the ceph-osd daemons before the - ceph-mds daemon. The MDS will refuse to start if any up OSDs do not support - the new feature. - -* The 'ceph mds set_max_mds N' command is now deprecated in favor of - 'ceph mds set max_mds N'. - -* The 'osd pool create ...' syntax has changed for erasure pools. - -* The default CRUSH rules and layouts are now using the 'bobtail' - tunables and defaults. Upgraded clusters using the old values will - now present with a health WARN state. This can be disabled by - adding 'mon warn on legacy crush tunables = false' to ceph.conf and - restarting the monitors. Alternatively, you can switch to the new - tunables with 'ceph osd crush tunables firefly,' but keep in mind - that this will involve moving a *significant* portion of the data - already stored in the cluster and in a large cluster may take - several days to complete. We do not recommend adjusting tunables on a - production cluster. - -* We now default to the 'bobtail' CRUSH tunable values that are first supported - by Ceph clients in bobtail (v0.56) and Linux kernel version v3.9. If you - plan to access a newly created Ceph cluster with an older kernel client, you - should use 'ceph osd crush tunables legacy' to switch back to the legacy - behavior. Note that making that change will likely result in some data - movement in the system, so adjust the setting before populating the new - cluster with data. - -* We now set the HASHPSPOOL flag on newly created pools (and new - clusters) by default. Support for this flag first appeared in - v0.64; v0.67 Dumpling is the first major release that supports it. - It is first supported by the Linux kernel version v3.9. If you plan - to access a newly created Ceph cluster with an older kernel or - clients (e.g, librados, librbd) from a pre-dumpling Ceph release, - you should add 'osd pool default flag hashpspool = false' to the - '[global]' section of your 'ceph.conf' prior to creating your - monitors (e.g., after 'ceph-deploy new' but before 'ceph-deploy mon - create ...'). - -* The configuration option 'osd pool default crush rule' is deprecated - and replaced with 'osd pool default crush replicated ruleset'. 'osd - pool default crush rule' takes precedence for backward compatibility - and a deprecation warning is displayed when it is used. - -* As part of fix for #6796, 'ceph osd pool set <pool> <var> <arg>' now - receives <arg> as an integer instead of a string. This affects how - 'hashpspool' flag is set/unset: instead of 'true' or 'false', it now - must be '0' or '1'. - -* The behavior of the CRUSH 'indep' choose mode has been changed. No - ceph cluster should have been using this behavior unless someone has - manually extracted a crush map, modified a CRUSH rule to replace - 'firstn' with 'indep', recompiled, and reinjected the new map into - the cluster. If the 'indep' mode is currently in use on a cluster, - the rule should be modified to use 'firstn' instead, and the - administrator should wait until any data movement completes before - upgrading. - -* The 'osd dump' command now dumps pool snaps as an array instead of an - object. - - -Upgrading from v0.67 Dumpling ------------------------------ - -* See notes above. - -* ceph-fuse and radosgw now use the same default values for the admin - socket and log file paths that the other daemons (ceph-osd, - ceph-mon, etc.) do. If you run these daemons as non-root, you may - need to adjust your ceph.conf to disable these options or to adjust - the permissions on /var/run/ceph and /var/log/ceph. - -* The MDS now disallows snapshots by default as they are not - considered stable. The command 'ceph mds set allow_snaps' will - enable them. - -* For clusters that were created before v0.44 (pre-argonaut, Spring - 2012) and store radosgw data, the auto-upgrade from TMAP to OMAP - objects has been disabled. Before upgrading, make sure that any - buckets created on pre-argonaut releases have been modified (e.g., - by PUTing and then DELETEing an object from each bucket). Any - cluster created with argonaut (v0.48) or a later release or not - using radosgw never relied on the automatic conversion and is not - affected by this change. - -* Any direct users of the 'tmap' portion of the librados API should be - aware that the automatic tmap -> omap conversion functionality has - been removed. - -* Most output that used K or KB (e.g., for kilobyte) now uses a - lower-case k to match the official SI convention. Any scripts that - parse output and check for an upper-case K will need to be modified. - -* librados::Rados::pool_create_async() and librados::Rados::pool_delete_async() - don't drop a reference to the completion object on error, caller needs to take - care of that. This has never really worked correctly and we were leaking an - object - -* 'ceph osd crush set <id> <weight> <loc..>' no longer adds the osd to the - specified location, as that's a job for 'ceph osd crush add'. It will - however continue to work just the same as long as the osd already exists - in the crush map. - -* The OSD now enforces that class write methods cannot both mutate an - object and return data. The rbd.assign_bid method, the lone - offender, has been removed. This breaks compatibility with - pre-bobtail librbd clients by preventing them from creating new - images. - -* librados now returns on commit instead of ack for synchronous calls. - This is a bit safer in the case where both OSDs and the client crash, and - is probably how it should have been acting from the beginning. Users are - unlikely to notice but it could result in lower performance in some - circumstances. Those who care should switch to using the async interfaces, - which let you specify safety semantics precisely. - -* The C++ librados AioComplete::get_version() method was incorrectly - returning an int (usually 32-bits). To avoid breaking library - compatibility, a get_version64() method is added that returns the - full-width value. The old method is deprecated and will be removed - in a future release. Users of the C++ librados API that make use of - the get_version() method should modify their code to avoid getting a - value that is truncated from 64 to to 32 bits. - - -Notable changes since v0.79 ---------------------------- - -* ceph-fuse, libcephfs: fix several caching bugs (Yan, Zheng) -* ceph-fuse: trim inodes in response to mds memory pressure (Yan, Zheng) -* librados: fix inconsistencies in API error values (David Zafman) -* librados: fix watch operations with cache pools (Sage Weil) -* librados: new snap rollback operation (David Zafman) -* mds: fix respawn (John Spray) -* mds: misc bugs (Yan, Zheng) -* mds: misc multi-mds fixes (Yan, Zheng) -* mds: use shared_ptr for requests (Greg Farnum) -* mon: fix peer feature checks (Sage Weil) -* mon: require 'x' mon caps for auth operations (Joao Luis) -* mon: shutdown when removed from mon cluster (Joao Luis) -* msgr: fix locking bug in authentication (Josh Durgin) -* osd: fix bug in journal replay/restart (Sage Weil) -* osd: many many many bug fixes with cache tiering (Samuel Just) -* osd: track omap and hit_set objects in pg stats (Samuel Just) -* osd: warn if agent cannot enable due to invalid (post-split) stats (Sage Weil) -* rados bench: track metadata for multiple runs separately (Guang Yang) -* rgw: fixed subuser modify (Yehuda Sadeh) -* rpm: fix redhat-lsb dependency (Sage Weil, Alfredo Deza) - - -Notable changes since v0.72 Emperor ------------------------------------ - -* buffer: some zero-copy groundwork (Josh Durgin) -* build: misc improvements (Ken Dreyer) -* ceph-conf: stop creating bogus log files (Josh Durgin, Sage Weil) -* ceph-crush-location: new hook for setting CRUSH location of osd daemons on start) -* ceph-disk: avoid fd0 (Loic Dachary) -* ceph-disk: generalize path names, add tests (Loic Dachary) -* ceph-disk: misc improvements for puppet (Loic Dachary) -* ceph-disk: several bug fixes (Loic Dachary) -* ceph-fuse: fix race for sync reads (Sage Weil) -* ceph-fuse, libcephfs: fix several caching bugs (Yan, Zheng) -* ceph-fuse: trim inodes in response to mds memory pressure (Yan, Zheng) -* ceph-kvstore-tool: expanded command set and capabilities (Joao Eduardo Luis) -* ceph.spec: fix build dependency (Loic Dachary) -* common: bloom filter improvements (Sage Weil) -* common: check preexisting admin socket for active daemon before removing (Loic Dachary) -* common: fix aligned buffer allocation (Loic Dachary) -* common: fix authentication on big-endian architectures (Dan Mick) -* common: fix config variable substitution (Loic Dachary) -* common: portability changes to support libc++ (Noah Watkins) -* common: switch to unordered_map from hash_map (Noah Watkins) -* config: recursive metavariable expansion (Loic Dachary) -* crush: default to bobtail tunables (Sage Weil) -* crush: fix off-by-one error in recent refactor (Sage Weil) -* crush: many additional tests (Loic Dachary) -* crush: misc fixes, cleanups (Loic Dachary) -* crush: new rule steps to adjust retry attempts (Sage Weil) -* crush, osd: s/rep/replicated/ for less confusion (Loic Dachary) -* crush: refactor descend_once behavior; support set_choose*_tries for replicated rules (Sage Weil) -* crush: usability and test improvements (Loic Dachary) -* debian: change directory ownership between ceph and ceph-common (Sage Weil) -* debian: integrate misc fixes from downstream packaging (James Page) -* doc: big update to install docs (John Wilkins) -* doc: many many install doc improvements (John Wilkins) -* doc: many many updates (John Wilkins) -* doc: misc fixes (David Moreau Simard, Kun Huang) -* erasure-code: improve buffer alignment (Loic Dachary) -* erasure-code: rewrite region-xor using vector operations (Andreas Peters) -* init: fix startup ordering/timeout problem with OSDs (Dmitry Smirnov) -* libcephfs: fix resource leak (Zheng Yan) -* librados: add C API coverage for atomic write operations (Christian Marie) -* librados: fix inconsistencies in API error values (David Zafman) -* librados: fix throttle leak (and eventual deadlock) (Josh Durgin) -* librados: fix watch operations with cache pools (Sage Weil) -* librados: new snap rollback operation (David Zafman) -* librados, osd: new TMAP2OMAP operation (Yan, Zheng) -* librados: read directly into user buffer (Rutger ter Borg) -* librbd: fix use-after-free aio completion bug #5426 (Josh Durgin) -* librbd: localize/distribute parent reads (Sage Weil) -* librbd: skip zeroes/holes when copying sparse images (Josh Durgin) -* mailmap: affiliation updates (Loic Dachary) -* mailmap updates (Loic Dachary) -* many portability improvements (Noah Watkins) -* many unit test improvements (Loic Dachary) -* mds: always store backtrace in default pool (Yan, Zheng) -* mds: cope with MDS failure during creation (John Spray) -* mds: fix cap migration behavior (Yan, Zheng) -* mds: fix client session flushing (Yan, Zheng) -* mds: fix crash from client sleep/resume (Zheng Yan) -* mds: fix many many multi-mds bugs (Yan, Zheng) -* mds: fix readdir end check (Zheng Yan) -* mds: fix Resetter locking (Alexandre Oliva) -* mds: fix respawn (John Spray) -* mds: inline data support (Li Wang, Yunchuan Wen) -* mds: misc bugs (Yan, Zheng) -* mds: misc fixes for directory fragments (Zheng Yan) -* mds: misc fixes for larger directories (Zheng Yan) -* mds: misc fixes for multiple MDSs (Zheng Yan) -* mds: misc multi-mds fixes (Yan, Zheng) -* mds: remove .ceph directory (John Spray) -* mds: store directories in omap instead of tmap (Yan, Zheng) -* mds: update old-format backtraces opportunistically (Zheng Yan) -* mds: use shared_ptr for requests (Greg Farnum) -* misc cleanups from coverity (Xing Lin) -* misc coverity fixes, cleanups (Danny Al-Gaaf) -* misc coverity fixes (Xing Lin, Li Wang, Danny Al-Gaaf) -* misc portability fixes (Noah Watkins, Alan Somers) -* misc portability fixes (Noah Watkins, Christophe Courtaut, Alan Somers, huanjun) -* misc portability work (Noah Watkins) -* mon: add erasure profiles and improve erasure pool creation (Loic Dachary) -* mon: add 'mon getmap EPOCH' (Joao Eduardo Luis) -* mon: allow adjustment of cephfs max file size via 'ceph mds set max_file_size' (Sage Weil) -* mon: allow debug quorum_{enter,exit} commands via admin socket -* mon: 'ceph osd pg-temp ...' and primary-temp commands (Ilya Dryomov) -* mon: change mds allow_new_snaps syntax to be more consistent (Sage Weil) -* mon: clean up initial crush rule creation (Loic Dachary) -* mon: collect misc metadata about osd (os, kernel, etc.), new 'osd metadata' command (Sage Weil) -* mon: do not create erasure rules by default (Sage Weil) -* mon: do not generate spurious MDSMaps in certain cases (Sage Weil) -* mon: do not use keyring if auth = none (Loic Dachary) -* mon: fix peer feature checks (Sage Weil) -* mon: fix pg_temp leaks (Joao Eduardo Luis) -* mon: fix pool count in 'ceph -s' output (Sage Weil) -* mon: handle more whitespace (newline, tab) in mon capabilities (Sage Weil) -* mon: improve (replicate or erasure) pool creation UX (Loic Dachary) -* mon: infrastructure to handle mixed-version mon cluster and cli/rest API (Greg Farnum) -* mon: MForward tests (Loic Dachary) -* mon: mkfs now idempotent (Loic Dachary) -* mon: only seed new osdmaps to current OSDs (Sage Weil) -* mon, osd: create erasure style crush rules (Loic Dachary, Sage Weil) -* mon: 'osd crush show-tunables' (Sage Weil) -* mon: 'osd dump' dumps pool snaps as array, not object (Dan Mick) -* mon, osd: new 'erasure' pool type (still not fully supported) -* mon: persist quorum features to disk (Greg Farnum) -* mon: prevent extreme changes in pool pg_num (Greg Farnum) -* mon: require 'x' mon caps for auth operations (Joao Luis) -* mon: shutdown when removed from mon cluster (Joao Luis) -* mon: take 'osd pool set ...' value as an int, not string (Joao Eduardo Luis) -* mon: track osd features in OSDMap (Joao Luis, David Zafman) -* mon: trim MDSMaps (Joao Eduardo Luis) -* mon: warn if crush has non-optimal tunables (Sage Weil) -* mount.ceph: add -n for autofs support (Steve Stock) -* msgr: fix locking bug in authentication (Josh Durgin) -* msgr: fix messenger restart race (Xihui He) -* msgr: improve connection error detection between clients and monitors (Greg Farnum, Sage Weil) -* osd: add/fix CPU feature detection for jerasure (Loic Dachary) -* osd: add HitSet tracking for read ops (Sage Weil, Greg Farnum) -* osd: avoid touching leveldb for some xattrs (Haomai Wang, Sage Weil) -* osd: backfill to multiple targets (David Zafman) -* osd: backfill to osds not in acting set (David Zafman) -* osd: cache pool support for snapshots (Sage Weil) -* osd: client IO path changes for EC (Samuel Just) -* osd: default to 3x replication -* osd: do not include backfill targets in acting set (David Zafman) -* osd: enable new hashpspool layout by default (Sage Weil) -* osd: erasure plugin benchmarking tool (Loic Dachary) -* osd: fix and cleanup misc backfill issues (David Zafman) -* osd: fix bug in journal replay/restart (Sage Weil) -* osd: fix copy-get omap bug (Sage Weil) -* osd: fix linux kernel version detection (Ilya Dryomov) -* osd: fix memstore segv (Haomai Wang) -* osd: fix object_info_t encoding bug from emperor (Sam Just) -* osd: fix omap_clear operation to not zap xattrs (Sam Just, Yan, Zheng) -* osd: fix several bugs with tier infrastructure -* osd: fix throttle thread (Haomai Wang) -* osd: fix XFS detection (Greg Farnum, Sushma Gurram) -* osd: generalize scrubbing infrastructure to allow EC (David Zafman) -* osd: handle more whitespace (newline, tab) in osd capabilities (Sage Weil) -* osd: ignore num_objects_dirty on scrub for old pools (Sage Weil) -* osd: improved scrub checks on clones (Sage Weil, Sam Just) -* osd: improve locking in fd lookup cache (Samuel Just, Greg Farnum) -* osd: include more info in pg query result (Sage Weil) -* osd, librados: fix full cluster handling (Josh Durgin) -* osd: many erasure fixes (Sam Just) -* osd: many many many bug fixes with cache tiering (Samuel Just) -* osd: move to jerasure2 library (Loic Dachary) -* osd: new 'chassis' type in default crush hierarchy (Sage Weil) -* osd: new keyvaluestore-dev backend based on leveldb (Haomai Wang) -* osd: new OSDMap encoding (Greg Farnum) -* osd: new tests for erasure pools (David Zafman) -* osd: preliminary cache pool support (no snaps) (Greg Farnum, Sage Weil) -* osd: reduce scrub lock contention (Guang Yang) -* osd: requery unfound on stray notify (#6909) (Samuel Just) -* osd: some PGBackend infrastructure (Samuel Just) -* osd: support for new 'memstore' (memory-backed) backend (Sage Weil) -* osd: track erasure compatibility (David Zafman) -* osd: track omap and hit_set objects in pg stats (Samuel Just) -* osd: warn if agent cannot enable due to invalid (post-split) stats (Sage Weil) -* rados: add 'crush location', smart replica selection/balancing (Sage Weil) -* rados bench: track metadata for multiple runs separately (Guang Yang) -* rados: some performance optimizations (Yehuda Sadeh) -* rados tool: fix listomapvals (Josh Durgin) -* rbd: add 'rbdmap' init script for mapping rbd images on book (Adam Twardowski) -* rbd: add rbdmap support for upstart (Laurent Barbe) -* rbd: expose kernel rbd client options via 'rbd map' (Ilya Dryomov) -* rbd: fix bench-write command (Hoamai Wang) -* rbd: make 'rbd list' return empty list and success on empty pool (Josh Durgin) -* rbd: prevent deletion of images with watchers (Ilya Dryomov) -* rbd: support for 4096 mapped devices, up from ~250 (Ilya Dryomov) -* rest-api: do not fail when no OSDs yet exist (Dan Mick) -* rgw: add 'status' command to sysvinit script (David Moreau Simard) -* rgw: allow multiple frontends (Yehuda Sadeh) -* rgw: allow use of an erasure data pool (Yehuda Sadeh) -* rgw: convert bucket info to new format on demand (Yehuda Sadeh) -* rgw: fixed subuser modify (Yehuda Sadeh) -* rgw: fix error setting empty owner on ACLs (Yehuda Sadeh) -* rgw: fix fastcgi deadlock (do not return data from librados callback) (Yehuda Sadeh) -* rgw: fix many-part multipart uploads (Yehuda Sadeh) -* rgw: fix misc CORS bugs (Robin H. Johnson) -* rgw: fix object placement read op (Yehuda Sadeh) -* rgw: fix reading bucket policy (#6940) -* rgw: fix read_user_buckets 'max' behavior (Yehuda Sadeh) -* rgw: fix several CORS bugs (Robin H. Johnson) -* rgw: fix use-after-free when releasing completion handle (Yehuda Sadeh) -* rgw: improve swift temp URL support (Yehuda Sadeh) -* rgw: make multi-object delete idempotent (Yehuda Sadeh) -* rgw: optionally defer to bucket ACLs instead of object ACLs (Liam Monahan) -* rgw: prototype mongoose frontend (Yehuda Sadeh) -* rgw: several doc fixes (Alexandre Marangone) -* rgw: support for password (instead of admin token) for keystone authentication (Christophe Courtaut) -* rgw: switch from mongoose to civetweb (Yehuda Sadeh) -* rgw: user quotas (Yehuda Sadeh) -* rpm: fix redhat-lsb dependency (Sage Weil, Alfredo Deza) -* specfile: fix RPM build on RHEL6 (Ken Dreyer, Derek Yarnell) -* specfile: ship libdir/ceph (Key Dreyer) -* sysvinit, upstart: prevent both init systems from starting the same daemons (Josh Durgin) - - -Notable changes since v0.67 Dumpling ------------------------------------- - -* build cleanly under clang (Christophe Courtaut) -* build: Makefile refactor (Roald J. van Loon) -* build: fix [/usr]/sbin locations (Alan Somers) -* ceph-disk: fix journal preallocation -* ceph-fuse, radosgw: enable admin socket and logging by default -* ceph-fuse: fix problem with readahead vs truncate race (Yan, Zheng) -* ceph-fuse: trim deleted inodes from cache (Yan, Zheng) -* ceph-fuse: use newer fuse api (Jianpeng Ma) -* ceph-kvstore-tool: new tool for working with leveldb (copy, crc) (Joao Luis) -* ceph-post-file: new command to easily share logs or other files with ceph devs -* ceph: improve parsing of CEPH_ARGS (Benoit Knecht) -* ceph: make -h behave when monitors are down -* ceph: parse CEPH_ARGS env variable -* common: bloom_filter improvements, cleanups -* common: cache crc32c values where possible -* common: correct SI is kB not KB (Dan Mick) -* common: fix looping on BSD (Alan Somers) -* common: migrate SharedPtrRegistry to use boost::shared_ptr<> (Loic Dachary) -* common: misc portability fixes (Noah Watkins) -* crc32c: fix optimized crc32c code (it now detects arch support properly) -* crc32c: improved intel-optimized crc32c support (~8x faster on my laptop!) -* crush: fix name caching -* doc: erasure coding design notes (Loic Dachary) -* hadoop: removed old version of shim to avoid confusing users (Noah Watkins) -* librados, mon: ability to query/ping out-of-quorum monitor status (Joao Luis) -* librados: fix async aio completion wakeup -* librados: fix installed header #includes (Dan Mick) -* librados: get_version64() method for C++ API -* librados: hello_world example (Greg Farnum) -* librados: sync calls now return on commit (instead of ack) (Greg Farnum) -* librbd python bindings: fix parent image name limit (Josh Durgin) -* librbd, ceph-fuse: avoid some sources of ceph-fuse, rbd cache stalls -* mds: avoid leaking objects when deleting truncated files (Yan, Zheng) -* mds: fix F_GETLK (Yan, Zheng) -* mds: fix LOOKUPSNAP bug -* mds: fix heap profiler commands (Joao Luis) -* mds: fix locking deadlock (David Disseldorp) -* mds: fix many bugs with stray (unlinked) inodes (Yan, Zheng) -* mds: fix many directory fragmentation bugs (Yan, Zheng) -* mds: fix mds rejoin with legacy parent backpointer xattrs (Alexandre Oliva) -* mds: fix rare restart/failure race during fs creation -* mds: fix standby-replay when we fall behind (Yan, Zheng) -* mds: fix stray directory purging (Yan, Zheng) -* mds: notify clients about deleted files (so they can release from their cache) (Yan, Zheng) -* mds: several bug fixes with clustered mds (Yan, Zheng) -* mon, osd: improve osdmap trimming logic (Samuel Just) -* mon, osd: initial CLI for configuring tiering -* mon: a few 'ceph mon add' races fixed (command is now idempotent) (Joao Luis) -* mon: allow (un)setting HASHPSPOOL flag on existing pools (Joao Luis) -* mon: allow cap strings with . to be unquoted -* mon: allow logging level of cluster log (/var/log/ceph/ceph.log) to be adjusted -* mon: avoid rewriting full osdmaps on restart (Joao Luis) -* mon: continue to discover peer addr info during election phase -* mon: disallow CephFS snapshots until 'ceph mds set allow_new_snaps' (Greg Farnum) -* mon: do not expose uncommitted state from 'osd crush {add,set} ...' (Joao Luis) -* mon: fix 'ceph osd crush reweight ...' (Joao Luis) -* mon: fix 'osd crush move ...' command for buckets (Joao Luis) -* mon: fix byte counts (off by factor of 4) (Dan Mick, Joao Luis) -* mon: fix paxos corner case -* mon: kv properties for pools to support EC (Loic Dachary) -* mon: make 'osd pool rename' idempotent (Joao Luis) -* mon: modify 'auth add' semantics to make a bit more sense (Joao Luis) -* mon: new 'osd perf' command to dump recent performance information (Samuel Just) -* mon: new and improved 'ceph -s' or 'ceph status' command (more info, easier to read) -* mon: some auth check cleanups (Joao Luis) -* mon: track per-pool stats (Joao Luis) -* mon: warn about pools with bad pg_num -* mon: warn when mon data stores grow very large (Joao Luis) -* monc: fix small memory leak -* new wireshark patches pulled into the tree (Kevin Jones) -* objecter, librados: redirect requests based on cache tier config -* objecter: fix possible hang when cluster is unpaused (Josh Durgin) -* osd, librados: add new COPY_FROM rados operation -* osd, librados: add new COPY_GET rados operations (used by COPY_FROM) -* osd: 'osd recover clone overlap limit' option to limit cloning during recovery (Samuel Just) -* osd: COPY_GET on-wire encoding improvements (Greg Farnum) -* osd: add 'osd heartbeat min healthy ratio' configurable (was hard-coded at 33%) -* osd: add option to disable pg log debug code (which burns CPU) -* osd: allow cap strings with . to be unquoted -* osd: automatically detect proper xattr limits (David Zafman) -* osd: avoid extra copy in erasure coding reference implementation (Loic Dachary) -* osd: basic cache pool redirects (Greg Farnum) -* osd: basic whiteout, dirty flag support (not yet used) -* osd: bloom_filter encodability, fixes, cleanups (Loic Dachary, Sage Weil) -* osd: clean up and generalize copy-from code (Greg Farnum) -* osd: cls_hello OSD class example -* osd: erasure coding doc updates (Loic Dachary) -* osd: erasure coding plugin infrastructure, tests (Loic Dachary) -* osd: experiemental support for ZFS (zfsonlinux.org) (Yan, Zheng) -* osd: fix RWORDER flags -* osd: fix exponential backoff of slow request warnings (Loic Dachary) -* osd: fix handling of racing read vs write (Samuel Just) -* osd: fix version value returned by various operations (Greg Farnum) -* osd: generalized temp object infrastructure -* osd: ghobject_t infrastructure for EC (David Zafman) -* osd: improvements for compatset support and storage (David Zafman) -* osd: infrastructure to copy objects from other OSDs -* osd: instrument peering states (David Zafman) -* osd: misc copy-from improvements -* osd: opportunistic crc checking on stored data (off by default) -* osd: properly enforce RD/WR flags for rados classes -* osd: reduce blocking on backing fs (Samuel Just) -* osd: refactor recovery using PGBackend (Samuel Just) -* osd: remove old magical tmap->omap conversion -* osd: remove old pg log on upgrade (Samuel Just) -* osd: revert xattr size limit (fixes large rgw uploads) -* osd: use fdatasync(2) instead of fsync(2) to improve performance (Sam Just) -* pybind: fix blacklisting nonce (Loic Dachary) -* radosgw-agent: multi-region replication/DR -* rgw: complete in-progress requests before shutting down -* rgw: default log level is now more reasonable (Yehuda Sadeh) -* rgw: fix S3 auth with response-* query string params (Sylvain Munaut, Yehuda Sadeh) -* rgw: fix a few minor memory leaks (Yehuda Sadeh) -* rgw: fix acl group check (Yehuda Sadeh) -* rgw: fix inefficient use of std::list::size() (Yehuda Sadeh) -* rgw: fix major CPU utilization bug with internal caching (Yehuda Sadeh, Mark Nelson) -* rgw: fix ordering of write operations (preventing data loss on crash) (Yehuda Sadeh) -* rgw: fix ordering of writes for mulitpart upload (Yehuda Sadeh) -* rgw: fix various CORS bugs (Yehuda Sadeh) -* rgw: fix/improve swift COPY support (Yehuda Sadeh) -* rgw: improve help output (Christophe Courtaut) -* rgw: misc fixes to support DR (Josh Durgin, Yehuda Sadeh) -* rgw: per-bucket quota (Yehuda Sadeh) -* rgw: validate S3 tokens against keystone (Roald J. van Loon) -* rgw: wildcard support for keystone roles (Christophe Courtaut) -* rpm: fix junit dependencies (Alan Grosskurth) -* sysvinit radosgw: fix status return code (Danny Al-Gaaf) -* sysvinit rbdmap: fix error 'service rbdmap stop' (Laurent Barbe) -* sysvinit: add condrestart command (Dan van der Ster) -* sysvinit: fix shutdown order (mons last) (Alfredo Deza) - - -v0.79 -===== - -This release is intended to serve as a release candidate for firefly, -which will hopefully be v0.80. No changes are being made to the code -base at this point except those that fix bugs. Please test this -release if you intend to make use of the new erasure-coded pools or -cache tiers in firefly. - -This release fixes a range of bugs found in v0.78 and streamlines the -user experience when creating erasure-coded pools. There is also a -raft of fixes for the MDS (multi-mds, directory fragmentation, and -large directories). The main notable new piece of functionality is a -small change to allow radosgw to use an erasure-coded pool for object -data. - - -Upgrading ---------- -* Erasure pools created with v0.78 will no longer function with v0.79. You - will need to delete the old pool and create a new one. - -* A bug was fixed in the authentication handshake with big-endian - architectures that prevent authentication between big- and - little-endian machines in the same cluster. If you have a cluster - that consists entirely of big-endian machines, you will need to - upgrade all daemons and clients and restart. - -* The 'ceph.file.layout' and 'ceph.dir.layout' extended attributes are - no longer included in the listxattr(2) results to prevent problems with - 'cp -a' and similar tools. - -* Monitor 'auth' read-only commands now expect the user to have 'rx' caps. - This is the same behavior that was present in dumpling, but in emperor - and more recent development releases the 'r' cap was sufficient. The - affected commands are:: - - ceph auth export - ceph auth get - ceph auth get-key - ceph auth print-key - ceph auth list - -Notable Changes ---------------- -* ceph-conf: stop creating bogus log files (Josh Durgin, Sage Weil) -* common: fix authentication on big-endian architectures (Dan Mick) -* debian: change directory ownership between ceph and ceph-common (Sage Weil) -* init: fix startup ordering/timeout problem with OSDs (Dmitry Smirnov) -* librbd: skip zeroes/holes when copying sparse images (Josh Durgin) -* mds: cope with MDS failure during creation (John Spray) -* mds: fix crash from client sleep/resume (Zheng Yan) -* mds: misc fixes for directory fragments (Zheng Yan) -* mds: misc fixes for larger directories (Zheng Yan) -* mds: misc fixes for multiple MDSs (Zheng Yan) -* mds: remove .ceph directory (John Spray) -* misc coverity fixes, cleanups (Danny Al-Gaaf) -* mon: add erasure profiles and improve erasure pool creation (Loic Dachary) -* mon: 'ceph osd pg-temp ...' and primary-temp commands (Ilya Dryomov) -* mon: fix pool count in 'ceph -s' output (Sage Weil) -* msgr: improve connection error detection between clients and monitors (Greg Farnum, Sage Weil) -* osd: add/fix CPU feature detection for jerasure (Loic Dachary) -* osd: improved scrub checks on clones (Sage Weil, Sam Just) -* osd: many erasure fixes (Sam Just) -* osd: move to jerasure2 library (Loic Dachary) -* osd: new tests for erasure pools (David Zafman) -* osd: reduce scrub lock contention (Guang Yang) -* rgw: allow use of an erasure data pool (Yehuda Sadeh) - - -v0.78 -===== - -This development release includes two key features: erasure coding and -cache tiering. A huge amount of code was merged for this release and -several additional weeks were spent stabilizing the code base, and it -is now in a state where it is ready to be tested by a broader user -base. - -This is *not* the firefly release. Firefly will be delayed for at -least another sprint so that we can get some operational experience -with the new code and do some additional testing before committing to -long term support. - -.. note:: Please note that while it is possible to create and test - erasure coded pools in this release, the pools will not be - usable when you upgrade to v0.79 as the OSDMap encoding will - subtlely change. Please do not populate your test pools - with important data that can't be reloaded. - -Upgrading ---------- - -* Upgrade daemons in the following order: - - #. Monitors - #. OSDs - #. MDSs and/or radosgw - - If the ceph-mds daemon is restarted first, it will wait until all - OSDs have been upgraded before finishing its startup sequence. If - the ceph-mon daemons are not restarted prior to the ceph-osd - daemons, they will not correctly register their new capabilities - with the cluster and new features may not be usable until they are - restarted a second time. - -* Upgrade radosgw daemons together. There is a subtle change in behavior - for multipart uploads that prevents a multipart request that was initiated - with a new radosgw from being completed by an old radosgw. - -* CephFS recently added support for a new 'backtrace' attribute on - file data objects that is used for lookup by inode number (i.e., NFS - reexport and hard links), and will later be used by fsck repair. - This replaces the existing anchor table mechanism that is used for - hard link resolution. In order to completely phase that out, any - inode that has an outdated backtrace attribute will get updated when - the inode itself is modified. This will result in some extra workload - after a legacy CephFS file system is upgraded. - -* The per-op return code in librados' ObjectWriteOperation interface - is now filled in. - -* The librados cmpxattr operation now handles xattrs containing null bytes as - data rather than null-terminated strings. - -* Compound operations in librados that create and then delete the same object - are now explicitly disallowed (they fail with -EINVAL). - -* The default leveldb cache size for the ceph-osd daemon has been - increased from 4 MB to 128 MB. This will increase the memory - footprint of that process but tends to increase performance of omap - (key/value) objects (used for CephFS and the radosgw). If memory in your - deployment is tight, you can preserve the old behavior by adding:: - - leveldb write buffer size = 0 - leveldb cache size = 0 - - to your ceph.conf to get back the (leveldb) defaults. - -Notable Changes ---------------- -* ceph-brag: new client and server tools (Sebastien Han, Babu Shanmugam) -* ceph-disk: use partx on RHEL or CentOS instead of partprobe (Alfredo Deza) -* ceph: fix combination of 'tell' and interactive mode (Joao Eduardo Luis) -* ceph-fuse: fix bugs with inline data and multiple MDSs (Zheng Yan) -* client: fix getcwd() to use new LOOKUPPARENT operation (Zheng Yan) -* common: fall back to json-pretty for admin socket (Loic Dachary) -* common: fix 'config dump' debug prefix (Danny Al-Gaaf) -* common: misc coverity fixes (Danny Al-Gaaf) -* common: throtller, shared_cache performance improvements, TrackedOp (Greg Farnum, Samuel Just) -* crush: fix JSON schema for dump (John Spray) -* crush: misc cleanups, tests (Loic Dachary) -* crush: new vary_r tunable (Sage Weil) -* crush: prevent invalid buckets of type 0 (Sage Weil) -* keyvaluestore: add perfcounters, misc bug fixes (Haomai Wang) -* keyvaluestore: portability improvements (Noah Watkins) -* libcephfs: API changes to better support NFS reexport via Ganesha (Matt Benjamin, Adam Emerson, Andrey Kuznetsov, Casey Bodley, David Zafman) -* librados: API documentation improvements (John Wilkins, Josh Durgin) -* librados: fix object enumeration bugs; allow iterator assignment (Josh Durgin) -* librados: streamline tests (Josh Durgin) -* librados: support for atomic read and omap operations for C API (Josh Durgin) -* librados: support for osd and mon command timeouts (Josh Durgin) -* librbd: pass allocation hints to OSD (Ilya Dryomov) -* logrotate: fix bug that prevented rotation for some daemons (Loic Dachary) -* mds: avoid duplicated discovers during recovery (Zheng Yan) -* mds: fix file lock owner checks (Zheng Yan) -* mds: fix LOOKUPPARENT, new LOOKUPNAME ops for reliable NFS reexport (Zheng Yan) -* mds: fix xattr handling on setxattr (Zheng Yan) -* mds: fix xattrs in getattr replies (Sage Weil) -* mds: force backtrace updates for old inodes on update (Zheng Yan) -* mds: several multi-mds and dirfrag bug fixes (Zheng Yan) -* mon: encode erasure stripe width in pool metadata (Loic Dachary) -* mon: erasure code crush rule creation (Loic Dachary) -* mon: erasure code plugin support (Loic Dachary) -* mon: fix bugs in initial post-mkfs quorum creation (Sage Weil) -* mon: fix error output to terminal during startup (Joao Eduardo Luis) -* mon: fix legacy CRUSH tunables warning (Sage Weil) -* mon: fix osd_epochs lower bound tracking for map trimming (Sage Weil) -* mon: fix OSDMap encoding features (Sage Weil, Aaron Ten Clay) -* mon: fix 'pg dump' JSON output (John Spray) -* mon: include dirty stats in 'ceph df detail' (Sage Weil) -* mon: list quorum member names in quorum order (Sage Weil) -* mon: prevent addition of non-empty cache tier (Sage Weil) -* mon: prevent deletion of CephFS pools (John Spray) -* mon: warn when cache tier approaches 'full' (Sage Weil) -* osd: allocation hint, with XFS support (Ilya Dryomov) -* osd: erasure coded pool support (Samuel Just) -* osd: fix bug causing slow/stalled recovery (#7706) (Samuel Just) -* osd: fix bugs in log merging (Samuel Just) -* osd: fix/clarify end-of-object handling on read (Loic Dachary) -* osd: fix impolite mon session backoff, reconnect behavior (Greg Farnum) -* osd: fix SnapContext cache id bug (Samuel Just) -* osd: increase default leveldb cache size and write buffer (Sage Weil, Dmitry Smirnov) -* osd: limit size of 'osd bench ...' arguments (Joao Eduardo Luis) -* osdmaptool: new --test-map-pgs mode (Sage Weil, Ilya Dryomov) -* osd, mon: add primary-affinity to adjust selection of primaries (Sage Weil) -* osd: new 'status' admin socket command (Sage Weil) -* osd: simple tiering agent (Sage Weil) -* osd: store checksums for erasure coded object stripes (Samuel Just) -* osd: tests for objectstore backends (Haomai Wang) -* osd: various refactoring and bug fixes (Samuel Just, David Zafman) -* rados: add 'set-alloc-hint' command (Ilya Dryomov) -* rbd-fuse: fix enumerate_images overflow, memory leak (Ilya Dryomov) -* rbdmap: fix upstart script (Stephan Renatus) -* rgw: avoid logging system events to usage log (Yehuda Sadeh) -* rgw: fix Swift range reponse (Yehuda Sadeh) -* rgw: improve scalability for manifest objects (Yehuda Sadeh) -* rgw: misc fixes for multipart objects, policies (Yehuda Sadeh) -* rgw: support non-standard MultipartUpload command (Yehuda Sadeh) - - - -v0.77 -===== - -This is the final development release before the Firefly feature -freeze. The main items in this release include some additional -refactoring work in the OSD IO path (include some locking -improvements), per-user quotas for the radosgw, a switch to civetweb -from mongoose for the prototype radosgw standalone mode, and a -prototype leveldb-based backend for the OSD. The C librados API also -got support for atomic write operations (read side transactions will -appear in v0.78). - -Upgrading ---------- - -* The 'ceph -s' or 'ceph status' command's 'num_in_osds' field in the - JSON and XML output has been changed from a string to an int. - -* The recently added 'ceph mds set allow_new_snaps' command's syntax - has changed slightly; it is now 'ceph mds set allow_new_snaps true'. - The 'unset' command has been removed; instead, set the value to - 'false'. - -* The syntax for allowing snapshots is now 'mds set allow_new_snaps - <true|false>' instead of 'mds <set,unset> allow_new_snaps'. - -Notable Changes ---------------- - -* osd: client IO path changes for EC (Samuel Just) -* common: portability changes to support libc++ (Noah Watkins) -* common: switch to unordered_map from hash_map (Noah Watkins) -* rgw: switch from mongoose to civetweb (Yehuda Sadeh) -* osd: improve locking in fd lookup cache (Samuel Just, Greg Farnum) -* doc: many many updates (John Wilkins) -* rgw: user quotas (Yehuda Sadeh) -* mon: persist quorum features to disk (Greg Farnum) -* mon: MForward tests (Loic Dachary) -* mds: inline data support (Li Wang, Yunchuan Wen) -* rgw: fix many-part multipart uploads (Yehuda Sadeh) -* osd: new keyvaluestore-dev backend based on leveldb (Haomai Wang) -* rbd: prevent deletion of images with watchers (Ilya Dryomov) -* osd: avoid touching leveldb for some xattrs (Haomai Wang, Sage Weil) -* mailmap: affiliation updates (Loic Dachary) -* osd: new OSDMap encoding (Greg Farnum) -* osd: generalize scrubbing infrastructure to allow EC (David Zafman) -* rgw: several doc fixes (Alexandre Marangone) -* librados: add C API coverage for atomic write operations (Christian Marie) -* rgw: improve swift temp URL support (Yehuda Sadeh) -* rest-api: do not fail when no OSDs yet exist (Dan Mick) -* common: check preexisting admin socket for active daemon before removing (Loic Dachary) -* osd: handle more whitespace (newline, tab) in osd capabilities (Sage Weil) -* mon: handle more whitespace (newline, tab) in mon capabilities (Sage Weil) -* rgw: make multi-object delete idempotent (Yehuda Sadeh) -* crush: fix off-by-one error in recent refactor (Sage Weil) -* rgw: fix read_user_buckets 'max' behavior (Yehuda Sadeh) -* mon: change mds allow_new_snaps syntax to be more consistent (Sage Weil) - - -v0.76 -===== - -This release includes another batch of updates for firefly -functionality. Most notably, the cache pool infrastructure now -support snapshots, the OSD backfill functionality has been generalized -to include multiple targets (necessary for the coming erasure pools), -and there were performance improvements to the erasure code plugin on -capable processors. The MDS now properly utilizes (and seamlessly -migrates to) the OSD key/value interface (aka omap) for storing directory -objects. There continue to be many other fixes and improvements for -usability and code portability across the tree. - -Upgrading ---------- - -* 'rbd ls' on a pool which never held rbd images now exits with code - 0. It outputs nothing in plain format, or an empty list in - non-plain format. This is consistent with the behavior for a pool - which used to hold images, but contains none. Scripts relying on - this behavior should be updated. - -* The MDS requires a new OSD operation TMAP2OMAP, added in this release. When - upgrading, be sure to upgrade and restart the ceph-osd daemons before the - ceph-mds daemon. The MDS will refuse to start if any up OSDs do not support - the new feature. - -* The 'ceph mds set_max_mds N' command is now deprecated in favor of - 'ceph mds set max_mds N'. - -Notable Changes ---------------- - -* build: misc improvements (Ken Dreyer) -* ceph-disk: generalize path names, add tests (Loic Dachary) -* ceph-disk: misc improvements for puppet (Loic Dachary) -* ceph-disk: several bug fixes (Loic Dachary) -* ceph-fuse: fix race for sync reads (Sage Weil) -* config: recursive metavariable expansion (Loic Dachary) -* crush: usability and test improvements (Loic Dachary) -* doc: misc fixes (David Moreau Simard, Kun Huang) -* erasure-code: improve buffer alignment (Loic Dachary) -* erasure-code: rewrite region-xor using vector operations (Andreas Peters) -* librados, osd: new TMAP2OMAP operation (Yan, Zheng) -* mailmap updates (Loic Dachary) -* many portability improvements (Noah Watkins) -* many unit test improvements (Loic Dachary) -* mds: always store backtrace in default pool (Yan, Zheng) -* mds: store directories in omap instead of tmap (Yan, Zheng) -* mon: allow adjustment of cephfs max file size via 'ceph mds set max_file_size' (Sage Weil) -* mon: do not create erasure rules by default (Sage Weil) -* mon: do not generate spurious MDSMaps in certain cases (Sage Weil) -* mon: do not use keyring if auth = none (Loic Dachary) -* mon: fix pg_temp leaks (Joao Eduardo Luis) -* osd: backfill to multiple targets (David Zafman) -* osd: cache pool support for snapshots (Sage Weil) -* osd: fix and cleanup misc backfill issues (David Zafman) -* osd: fix omap_clear operation to not zap xattrs (Sam Just, Yan, Zheng) -* osd: ignore num_objects_dirty on scrub for old pools (Sage Weil) -* osd: include more info in pg query result (Sage Weil) -* osd: track erasure compatibility (David Zafman) -* rbd: make 'rbd list' return empty list and success on empty pool (Josh Durgin) -* rgw: fix object placement read op (Yehuda Sadeh) -* rgw: fix several CORS bugs (Robin H. Johnson) -* specfile: fix RPM build on RHEL6 (Ken Dreyer, Derek Yarnell) -* specfile: ship libdir/ceph (Key Dreyer) - - -v0.75 -===== - -This is a big release, with lots of infrastructure going in for -firefly. The big items include a prototype standalone frontend for -radosgw (which does not require apache or fastcgi), tracking for read -activity on the osds (to inform tiering decisions), preliminary cache -pool support (no snapshots yet), and lots of bug fixes and other work -across the tree to get ready for the next batch of erasure coding -patches. - -For comparison, here are the diff stats for the last few versions:: - - v0.75 291 files changed, 82713 insertions(+), 33495 deletions(-) - v0.74 192 files changed, 17980 insertions(+), 1062 deletions(-) - v0.73 148 files changed, 4464 insertions(+), 2129 deletions(-) - -Upgrading ---------- - -- The 'osd pool create ...' syntax has changed for erasure pools. - -- The default CRUSH rules and layouts are now using the latest and - greatest tunables and defaults. Clusters using the old values will - now present with a health WARN state. This can be disabled by - adding 'mon warn on legacy crush tunables = false' to ceph.conf. - - -Notable Changes ---------------- - -* common: bloom filter improvements (Sage Weil) -* common: fix config variable substitution (Loic Dachary) -* crush, osd: s/rep/replicated/ for less confusion (Loic Dachary) -* crush: refactor descend_once behavior; support set_choose*_tries for replicated rules (Sage Weil) -* librados: fix throttle leak (and eventual deadlock) (Josh Durgin) -* librados: read directly into user buffer (Rutger ter Borg) -* librbd: fix use-after-free aio completion bug #5426 (Josh Durgin) -* librbd: localize/distribute parent reads (Sage Weil) -* mds: fix Resetter locking (Alexandre Oliva) -* mds: fix cap migration behavior (Yan, Zheng) -* mds: fix client session flushing (Yan, Zheng) -* mds: fix many many multi-mds bugs (Yan, Zheng) -* misc portability work (Noah Watkins) -* mon, osd: create erasure style crush rules (Loic Dachary, Sage Weil) -* mon: 'osd crush show-tunables' (Sage Weil) -* mon: clean up initial crush rule creation (Loic Dachary) -* mon: improve (replicate or erasure) pool creation UX (Loic Dachary) -* mon: infrastructure to handle mixed-version mon cluster and cli/rest API (Greg Farnum) -* mon: mkfs now idempotent (Loic Dachary) -* mon: only seed new osdmaps to current OSDs (Sage Weil) -* mon: track osd features in OSDMap (Joao Luis, David Zafman) -* mon: warn if crush has non-optimal tunables (Sage Weil) -* mount.ceph: add -n for autofs support (Steve Stock) -* msgr: fix messenger restart race (Xihui He) -* osd, librados: fix full cluster handling (Josh Durgin) -* osd: add HitSet tracking for read ops (Sage Weil, Greg Farnum) -* osd: backfill to osds not in acting set (David Zafman) -* osd: enable new hashpspool layout by default (Sage Weil) -* osd: erasure plugin benchmarking tool (Loic Dachary) -* osd: fix XFS detection (Greg Farnum, Sushma Gurram) -* osd: fix copy-get omap bug (Sage Weil) -* osd: fix linux kernel version detection (Ilya Dryomov) -* osd: fix memstore segv (Haomai Wang) -* osd: fix several bugs with tier infrastructure -* osd: fix throttle thread (Haomai Wang) -* osd: preliminary cache pool support (no snaps) (Greg Farnum, Sage Weil) -* rados tool: fix listomapvals (Josh Durgin) -* rados: add 'crush location', smart replica selection/balancing (Sage Weil) -* rados: some performance optimizations (Yehuda Sadeh) -* rbd: add rbdmap support for upstart (Laurent Barbe) -* rbd: expose kernel rbd client options via 'rbd map' (Ilya Dryomov) -* rbd: fix bench-write command (Hoamai Wang) -* rbd: support for 4096 mapped devices, up from ~250 (Ilya Dryomov) -* rgw: allow multiple frontends (Yehuda Sadeh) -* rgw: convert bucket info to new format on demand (Yehuda Sadeh) -* rgw: fix misc CORS bugs (Robin H. Johnson) -* rgw: prototype mongoose frontend (Yehuda Sadeh) - - - -v0.74 -===== - -This release includes a few substantial pieces for Firefly, including -a long-overdue switch to 3x replication by default and a switch to the -"new" CRUSH tunables by default (supported since bobtail). There is -also a fix for a long-standing radosgw bug (stalled GET) that has -already been backported to emperor and dumpling. - -Upgrading ---------- - -* We now default to the 'bobtail' CRUSH tunable values that are first supported - by Ceph clients in bobtail (v0.56) and Linux kernel version v3.9. If you - plan to access a newly created Ceph cluster with an older kernel client, you - should use 'ceph osd crush tunables legacy' to switch back to the legacy - behavior. Note that making that change will likely result in some data - movement in the system, so adjust the setting before populating the new - cluster with data. - -* We now set the HASHPSPOOL flag on newly created pools (and new - clusters) by default. Support for this flag first appeared in - v0.64; v0.67 Dumpling is the first major release that supports it. - It is first supported by the Linux kernel version v3.9. If you plan - to access a newly created Ceph cluster with an older kernel or - clients (e.g, librados, librbd) from a pre-dumpling Ceph release, - you should add 'osd pool default flag hashpspool = false' to the - '[global]' section of your 'ceph.conf' prior to creating your - monitors (e.g., after 'ceph-deploy new' but before 'ceph-deploy mon - create ...'). - -* The configuration option 'osd pool default crush rule' is deprecated - and replaced with 'osd pool default crush replicated ruleset'. 'osd - pool default crush rule' takes precedence for backward compatibility - and a deprecation warning is displayed when it is used. - -Notable Changes ---------------- - -* buffer: some zero-copy groundwork (Josh Durgin) -* ceph-disk: avoid fd0 (Loic Dachary) -* crush: default to bobtail tunables (Sage Weil) -* crush: many additional tests (Loic Dachary) -* crush: misc fixes, cleanups (Loic Dachary) -* crush: new rule steps to adjust retry attempts (Sage Weil) -* debian: integrate misc fixes from downstream packaging (James Page) -* doc: big update to install docs (John Wilkins) -* libcephfs: fix resource leak (Zheng Yan) -* misc coverity fixes (Xing Lin, Li Wang, Danny Al-Gaaf) -* misc portability fixes (Noah Watkins, Alan Somers) -* mon, osd: new 'erasure' pool type (still not fully supported) -* mon: add 'mon getmap EPOCH' (Joao Eduardo Luis) -* mon: collect misc metadata about osd (os, kernel, etc.), new 'osd metadata' command (Sage Weil) -* osd: default to 3x replication -* osd: do not include backfill targets in acting set (David Zafman) -* osd: new 'chassis' type in default crush hierarchy (Sage Weil) -* osd: requery unfound on stray notify (#6909) (Samuel Just) -* osd: some PGBackend infrastructure (Samuel Just) -* osd: support for new 'memstore' (memory-backed) backend (Sage Weil) -* rgw: fix fastcgi deadlock (do not return data from librados callback) (Yehuda Sadeh) -* rgw: fix reading bucket policy (#6940) -* rgw: fix use-after-free when releasing completion handle (Yehuda Sadeh) - - -v0.73 -===== - -This release, the first development release after emperor, includes -many bug fixes and a few additional pieces of functionality. The -first batch of larger changes will be landing in the next version, -v0.74. - -Upgrading ---------- - -- As part of fix for #6796, 'ceph osd pool set <pool> <var> <arg>' now - receives <arg> as an integer instead of a string. This affects how - 'hashpspool' flag is set/unset: instead of 'true' or 'false', it now - must be '0' or '1'. - -- The behavior of the CRUSH 'indep' choose mode has been changed. No - ceph cluster should have been using this behavior unless someone has - manually extracted a crush map, modified a CRUSH rule to replace - 'firstn' with 'indep', recompiled, and reinjected the new map into - the cluster. If the 'indep' mode is currently in use on a cluster, - the rule should be modified to use 'firstn' instead, and the - administrator should wait until any data movement completes before - upgrading. - -- The 'osd dump' command now dumps pool snaps as an array instead of an - object. - -- The radosgw init script (sysvinit) how requires that the 'host = ...' line in - ceph.conf, if present, match the short hostname (the output of 'hostname -s'), - not the fully qualified hostname or the (occasionally non-short) output of - 'hostname'. Failure to adjust this when upgrading from emperor or dumpling - may prevent the radosgw daemon from starting. - - -Notable Changes ---------------- - -* ceph-crush-location: new hook for setting CRUSH location of osd daemons on start -* ceph-kvstore-tool: expanded command set and capabilities (Joao Eduardo Luis) -* ceph.spec: fix build dependency (Loic Dachary) -* common: fix aligned buffer allocation (Loic Dachary) -* doc: many many install doc improvements (John Wilkins) -* mds: fix readdir end check (Zheng Yan) -* mds: update old-format backtraces opportunistically (Zheng Yan) -* misc cleanups from coverity (Xing Lin) -* misc portability fixes (Noah Watkins, Christophe Courtaut, Alan Somers, huanjun) -* mon: 'osd dump' dumps pool snaps as array, not object (Dan Mick) -* mon: allow debug quorum_{enter,exit} commands via admin socket -* mon: prevent extreme changes in pool pg_num (Greg Farnum) -* mon: take 'osd pool set ...' value as an int, not string (Joao Eduardo Luis) -* mon: trim MDSMaps (Joao Eduardo Luis) -* osd: fix object_info_t encoding bug from emperor (Sam Just) -* rbd: add 'rbdmap' init script for mapping rbd images on book (Adam Twardowski) -* rgw: add 'status' command to sysvinit script (David Moreau Simard) -* rgw: fix error setting empty owner on ACLs (Yehuda Sadeh) -* rgw: optionally defer to bucket ACLs instead of object ACLs (Liam Monahan) -* rgw: support for password (instead of admin token) for keystone authentication (Christophe Courtaut) -* sysvinit, upstart: prevent both init systems from starting the same daemons (Josh Durgin) |