diff options
Diffstat (limited to 'doc/releases/firefly.rst')
| -rw-r--r-- | doc/releases/firefly.rst | 1780 |
1 files changed, 1780 insertions, 0 deletions
diff --git a/doc/releases/firefly.rst b/doc/releases/firefly.rst new file mode 100644 index 00000000..5847bd1b --- /dev/null +++ b/doc/releases/firefly.rst @@ -0,0 +1,1780 @@ +v0.80.11 Firefly +================ + +This is a bugfix release for Firefly. This Firefly 0.80.x is nearing +its planned end of life in January 2016 it may also be the last. + +We recommend that all Firefly users upgrade. + +For more detailed information, see :download:`the complete changelog +<../changelog/v0.80.11.txt>`. + +Notable Changes +--------------- + +* build/ops: /etc/init.d/radosgw restart does not work correctly (`issue#11140 <http://tracker.ceph.com/issues/11140>`_, `pr#5831 <http://github.com/ceph/ceph/pull/5831>`_, Dmitry Yatsushkevich) +* build/ops: Fix -Wno-format and -Werror=format-security options clash (`issue#13417 <http://tracker.ceph.com/issues/13417>`_, `pr#6207 <http://github.com/ceph/ceph/pull/6207>`_, Boris Ranto) +* build/ops: ceph-common needs python-argparse on older distros, but doesn't require it (`issue#12034 <http://tracker.ceph.com/issues/12034>`_, `pr#5217 <http://github.com/ceph/ceph/pull/5217>`_, Nathan Cutler) +* build/ops: ceph.spec.in running fdupes unnecessarily (`issue#12301 <http://tracker.ceph.com/issues/12301>`_, `pr#5224 <http://github.com/ceph/ceph/pull/5224>`_, Nathan Cutler) +* build/ops: ceph.spec.in: 50-rbd.rules conditional is wrong (`issue#12166 <http://tracker.ceph.com/issues/12166>`_, `pr#5225 <http://github.com/ceph/ceph/pull/5225>`_, Nathan Cutler) +* build/ops: ceph.spec.in: useless %py_requires breaks SLE11-SP3 build (`issue#12351 <http://tracker.ceph.com/issues/12351>`_, `pr#5394 <http://github.com/ceph/ceph/pull/5394>`_, Nathan Cutler) +* build/ops: fedora21 has junit, not junit4 (`issue#10728 <http://tracker.ceph.com/issues/10728>`_, `pr#6203 <http://github.com/ceph/ceph/pull/6203>`_, Ken Dreyer, Loic Dachary) +* build/ops: upstart: configuration is too generous on restarts (`issue#11798 <http://tracker.ceph.com/issues/11798>`_, `pr#5992 <http://github.com/ceph/ceph/pull/5992>`_, Sage Weil) +* common: Client admin socket leaks file descriptors (`issue#11535 <http://tracker.ceph.com/issues/11535>`_, `pr#4633 <http://github.com/ceph/ceph/pull/4633>`_, Jon Bernard) +* common: FileStore calls syncfs(2) even it is not supported (`issue#12512 <http://tracker.ceph.com/issues/12512>`_, `pr#5529 <http://github.com/ceph/ceph/pull/5529>`_, Danny Al-Gaaf, Kefu Chai, Jianpeng Ma) +* common: HeartBeat: include types (`issue#13088 <http://tracker.ceph.com/issues/13088>`_, `pr#6038 <http://github.com/ceph/ceph/pull/6038>`_, Sage Weil) +* common: Malformed JSON command output when non-ASCII strings are present (`issue#7387 <http://tracker.ceph.com/issues/7387>`_, `pr#4635 <http://github.com/ceph/ceph/pull/4635>`_, Kefu Chai, Tim Serong) +* common: Memory leak in Mutex.cc, pthread_mutexattr_init without pthread_mutexattr_destroy (`issue#11762 <http://tracker.ceph.com/issues/11762>`_, `pr#5403 <http://github.com/ceph/ceph/pull/5403>`_, Ketor Meng) +* common: Thread:pthread_attr_destroy(thread_attr) when done with it (`issue#12570 <http://tracker.ceph.com/issues/12570>`_, `pr#6325 <http://github.com/ceph/ceph/pull/6325>`_, Piotr Dałek, Zheng Qiankun) +* common: ThreadPool add/remove work queue methods not thread safe (`issue#12662 <http://tracker.ceph.com/issues/12662>`_, `pr#5991 <http://github.com/ceph/ceph/pull/5991>`_, Jason Dillaman) +* common: buffer: critical bufferlist::zero bug (`issue#12252 <http://tracker.ceph.com/issues/12252>`_, `pr#5388 <http://github.com/ceph/ceph/pull/5388>`_, Haomai Wang) +* common: log: take mutex while opening fd (`issue#12465 <http://tracker.ceph.com/issues/12465>`_, `pr#5406 <http://github.com/ceph/ceph/pull/5406>`_, Samuel Just) +* common: recursive lock of md_config_t (0) (`issue#12614 <http://tracker.ceph.com/issues/12614>`_, `pr#5814 <http://github.com/ceph/ceph/pull/5814>`_, Josh Durgin) +* crush: take crashes due to invalid arg (`issue#11602 <http://tracker.ceph.com/issues/11602>`_, `pr#4769 <http://github.com/ceph/ceph/pull/4769>`_, Sage Weil) +* doc: backport v0.80.10 release notes to firefly (`issue#11090 <http://tracker.ceph.com/issues/11090>`_, `pr#5307 <http://github.com/ceph/ceph/pull/5307>`_, Loic Dachary, Sage Weil) +* doc: update docs to point to download.ceph.com (`issue#13162 <http://tracker.ceph.com/issues/13162>`_, `pr#5993 <http://github.com/ceph/ceph/pull/5993>`_, Alfredo Deza) +* fs: MDSMonitor: handle MDSBeacon messages properly (`issue#11590 <http://tracker.ceph.com/issues/11590>`_, `pr#5199 <http://github.com/ceph/ceph/pull/5199>`_, Kefu Chai) +* fs: client nonce collision due to unshared pid namespaces (`issue#13032 <http://tracker.ceph.com/issues/13032>`_, `pr#6087 <http://github.com/ceph/ceph/pull/6087>`_, Josh Durgin, Sage Weil) +* librbd: Objectcacher setting max object counts too low (`issue#7385 <http://tracker.ceph.com/issues/7385>`_, `pr#4639 <http://github.com/ceph/ceph/pull/4639>`_, Jason Dillaman) +* librbd: aio calls may block (`issue#11056 <http://tracker.ceph.com/issues/11056>`_, `pr#4854 <http://github.com/ceph/ceph/pull/4854>`_, Haomai Wang, Sage Weil, Jason Dillaman) +* librbd: internal.cc: 1967: FAILED assert(watchers.size() == 1) (`issue#12176 <http://tracker.ceph.com/issues/12176>`_, `pr#5171 <http://github.com/ceph/ceph/pull/5171>`_, Jason Dillaman) +* mon: Clock skew causes missing summary and confuses Calamari (`issue#11877 <http://tracker.ceph.com/issues/11877>`_, `pr#4867 <http://github.com/ceph/ceph/pull/4867>`_, Thorsten Behrens) +* mon: EC pools are not allowed as cache pools, disallow in the mon (`issue#11650 <http://tracker.ceph.com/issues/11650>`_, `pr#5389 <http://github.com/ceph/ceph/pull/5389>`_, Samuel Just) +* mon: Make it more difficult to delete pools in firefly (`issue#11800 <http://tracker.ceph.com/issues/11800>`_, `pr#4788 <http://github.com/ceph/ceph/pull/4788>`_, Sage Weil) +* mon: MonitorDBStore: get_next_key() only if prefix matches (`issue#11786 <http://tracker.ceph.com/issues/11786>`_, `pr#5360 <http://github.com/ceph/ceph/pull/5360>`_, Joao Eduardo Luis) +* mon: PaxosService: call post_refresh() instead of post_paxos_update() (`issue#11470 <http://tracker.ceph.com/issues/11470>`_, `pr#5358 <http://github.com/ceph/ceph/pull/5358>`_, Joao Eduardo Luis) +* mon: add a cache layer over MonitorDBStore (`issue#12638 <http://tracker.ceph.com/issues/12638>`_, `pr#5698 <http://github.com/ceph/ceph/pull/5698>`_, Kefu Chai) +* mon: adding exsting pool as tier with --force-nonempty clobbers removed_snaps (`issue#11493 <http://tracker.ceph.com/issues/11493>`_, `pr#5236 <http://github.com/ceph/ceph/pull/5236>`_, Sage Weil, Samuel Just) +* mon: ceph fails to compile with boost 1.58 (`issue#11576 <http://tracker.ceph.com/issues/11576>`_, `pr#5129 <http://github.com/ceph/ceph/pull/5129>`_, Kefu Chai) +* mon: does not check for IO errors on every transaction (`issue#13089 <http://tracker.ceph.com/issues/13089>`_, `pr#6091 <http://github.com/ceph/ceph/pull/6091>`_, Sage Weil) +* mon: get pools health'info have error (`issue#12402 <http://tracker.ceph.com/issues/12402>`_, `pr#5410 <http://github.com/ceph/ceph/pull/5410>`_, renhwztetecs) +* mon: increase globalid default for firefly (`issue#13255 <http://tracker.ceph.com/issues/13255>`_, `pr#6010 <http://github.com/ceph/ceph/pull/6010>`_, Sage Weil) +* mon: pgmonitor: wrong at/near target max“ reporting (`issue#12401 <http://tracker.ceph.com/issues/12401>`_, `pr#5409 <http://github.com/ceph/ceph/pull/5409>`_, huangjun) +* mon: register_new_pgs() should check ruleno instead of its index (`issue#12210 <http://tracker.ceph.com/issues/12210>`_, `pr#5404 <http://github.com/ceph/ceph/pull/5404>`_, Xinze Chi) +* mon: scrub error (osdmap encoding mismatch?) upgrading from 0.80 to ~0.80.2 (`issue#8815 <http://tracker.ceph.com/issues/8815>`_, `issue#8674 <http://tracker.ceph.com/issues/8674>`_, `issue#9064 <http://tracker.ceph.com/issues/9064>`_, `pr#5200 <http://github.com/ceph/ceph/pull/5200>`_, Sage Weil, Zhiqiang Wang, Samuel Just) +* mon: the output is wrong when runing ceph osd reweight (`issue#12251 <http://tracker.ceph.com/issues/12251>`_, `pr#5408 <http://github.com/ceph/ceph/pull/5408>`_, Joao Eduardo Luis) +* objecter: can get stuck in redirect loop if osdmap epoch == last_force_op_resend (`issue#11026 <http://tracker.ceph.com/issues/11026>`_, `pr#4597 <http://github.com/ceph/ceph/pull/4597>`_, Jianpeng Ma, Sage Weil) +* objecter: pg listing can deadlock when throttling is in use (`issue#9008 <http://tracker.ceph.com/issues/9008>`_, `pr#5043 <http://github.com/ceph/ceph/pull/5043>`_, Guang Yang) +* objecter: resend linger ops on split (`issue#9806 <http://tracker.ceph.com/issues/9806>`_, `pr#5062 <http://github.com/ceph/ceph/pull/5062>`_, Josh Durgin, Samuel Just) +* osd: Cleanup boost optionals for boost 1.56 (`issue#9983 <http://tracker.ceph.com/issues/9983>`_, `pr#5039 <http://github.com/ceph/ceph/pull/5039>`_, William A. Kennington III) +* osd: LibRadosTwoPools[EC]PP.PromoteSnap failure (`issue#10052 <http://tracker.ceph.com/issues/10052>`_, `pr#5050 <http://github.com/ceph/ceph/pull/5050>`_, Sage Weil) +* osd: Mutex Assert from PipeConnection::try_get_pipe (`issue#12437 <http://tracker.ceph.com/issues/12437>`_, `pr#5815 <http://github.com/ceph/ceph/pull/5815>`_, David Zafman) +* osd: PG stuck with remapped (`issue#9614 <http://tracker.ceph.com/issues/9614>`_, `pr#5044 <http://github.com/ceph/ceph/pull/5044>`_, Guang Yang) +* osd: PG::handle_advance_map: on_pool_change after handling the map change (`issue#12809 <http://tracker.ceph.com/issues/12809>`_, `pr#5988 <http://github.com/ceph/ceph/pull/5988>`_, Samuel Just) +* osd: PGLog: split divergent priors as well (`issue#11069 <http://tracker.ceph.com/issues/11069>`_, `pr#4631 <http://github.com/ceph/ceph/pull/4631>`_, Samuel Just) +* osd: PGLog::proc_replica_log: correctly handle case where entries between olog.head and log.tail were split out (`issue#11358 <http://tracker.ceph.com/issues/11358>`_, `pr#5287 <http://github.com/ceph/ceph/pull/5287>`_, Samuel Just) +* osd: WBThrottle::clear_object: signal on cond when we reduce throttle values (`issue#12223 <http://tracker.ceph.com/issues/12223>`_, `pr#5822 <http://github.com/ceph/ceph/pull/5822>`_, Samuel Just) +* osd: cache full mode still skips young objects (`issue#10006 <http://tracker.ceph.com/issues/10006>`_, `pr#5051 <http://github.com/ceph/ceph/pull/5051>`_, Xinze Chi, Zhiqiang Wang) +* osd: crash creating/deleting pools (`issue#12429 <http://tracker.ceph.com/issues/12429>`_, `pr#5526 <http://github.com/ceph/ceph/pull/5526>`_, John Spray) +* osd: explicitly specify OSD features in MOSDBoot (`issue#10911 <http://tracker.ceph.com/issues/10911>`_, `pr#4960 <http://github.com/ceph/ceph/pull/4960>`_, Sage Weil) +* osd: is_new_interval() fixes (`issue#11771 <http://tracker.ceph.com/issues/11771>`_, `issue#10399 <http://tracker.ceph.com/issues/10399>`_, `pr#5726 <http://github.com/ceph/ceph/pull/5726>`_, Samuel Just, Jason Dillaman) +* osd: make the all osd/filestore thread pool suicide timeouts separately configurable (`issue#11439 <http://tracker.ceph.com/issues/11439>`_, `pr#5823 <http://github.com/ceph/ceph/pull/5823>`_, Samuel Just) +* osd: object creation by write cannot use an offset on an erasure coded pool (`issue#11507 <http://tracker.ceph.com/issues/11507>`_, `pr#4632 <http://github.com/ceph/ceph/pull/4632>`_, Jianpeng Ma, Loic Dachary) +* osd: os/FileJournal: Fix journal write fail, align for direct io (`issue#12943 <http://tracker.ceph.com/issues/12943>`_, `pr#5619 <http://github.com/ceph/ceph/pull/5619>`_, Xie Rui) +* osd: osd/PGLog.cc: 732: FAILED assert(log.log.size() == log_keys_debug.size()) (`issue#12652 <http://tracker.ceph.com/issues/12652>`_, `pr#5820 <http://github.com/ceph/ceph/pull/5820>`_, Sage Weil) +* osd: read on chunk-aligned xattr not handled (`issue#12309 <http://tracker.ceph.com/issues/12309>`_, `pr#5235 <http://github.com/ceph/ceph/pull/5235>`_, Sage Weil) +* rgw: Change variable length array of std::strings (not legal in C++) to std::vector<std::string> (`issue#12467 <http://tracker.ceph.com/issues/12467>`_, `pr#4583 <http://github.com/ceph/ceph/pull/4583>`_, Daniel J. Hofmann) +* rgw: Civetweb RGW appears to report full size of object as downloaded when only partially downloaded (`issue#11851 <http://tracker.ceph.com/issues/11851>`_, `pr#5234 <http://github.com/ceph/ceph/pull/5234>`_, Yehuda Sadeh) +* rgw: Keystone PKI token expiration is not enforced (`issue#11367 <http://tracker.ceph.com/issues/11367>`_, `pr#4765 <http://github.com/ceph/ceph/pull/4765>`_, Anton Aksola) +* rgw: Object copy bug (`issue#11639 <http://tracker.ceph.com/issues/11639>`_, `pr#4762 <http://github.com/ceph/ceph/pull/4762>`_, Javier M. Mellid) +* rgw: RGW returns requested bucket name raw in "Bucket" response header (`issue#11860 <http://tracker.ceph.com/issues/11860>`_, `issue#12537 <http://tracker.ceph.com/issues/12537>`_, `pr#5730 <http://github.com/ceph/ceph/pull/5730>`_, Yehuda Sadeh, Wido den Hollander) +* rgw: Swift API: response for PUT on /container does not contain the mandatory Content-Length header when FCGI is used (`issue#11036 <http://tracker.ceph.com/issues/11036>`_, `pr#5170 <http://github.com/ceph/ceph/pull/5170>`_, Radoslaw Zarzynski) +* rgw: content length parsing calls strtol() instead of strtoll() (`issue#10701 <http://tracker.ceph.com/issues/10701>`_, `pr#5997 <http://github.com/ceph/ceph/pull/5997>`_, Yehuda Sadeh) +* rgw: delete bucket does not remove .bucket.meta file (`issue#11149 <http://tracker.ceph.com/issues/11149>`_, `pr#4641 <http://github.com/ceph/ceph/pull/4641>`_, Orit Wasserman) +* rgw: doesn't return 'x-timestamp' in header which is used by 'View Details' of OpenStack (`issue#8911 <http://tracker.ceph.com/issues/8911>`_, `pr#4584 <http://github.com/ceph/ceph/pull/4584>`_, Yehuda Sadeh) +* rgw: init some manifest fields when handling explicit objs (`issue#11455 <http://tracker.ceph.com/issues/11455>`_, `pr#5729 <http://github.com/ceph/ceph/pull/5729>`_, Yehuda Sadeh) +* rgw: logfile does not get chowned properly (`issue#12073 <http://tracker.ceph.com/issues/12073>`_, `pr#5233 <http://github.com/ceph/ceph/pull/5233>`_, Thorsten Behrens) +* rgw: logrotate.conf calls service with wrong init script name (`issue#12043 <http://tracker.ceph.com/issues/12043>`_, `pr#5390 <http://github.com/ceph/ceph/pull/5390>`_, wuxingyi) +* rgw: quota not respected in POST object (`issue#11323 <http://tracker.ceph.com/issues/11323>`_, `pr#4642 <http://github.com/ceph/ceph/pull/4642>`_, Sergey Arkhipov) +* rgw: swift smoke test fails on TestAccountUTF8 (`issue#11091 <http://tracker.ceph.com/issues/11091>`_, `issue#11438 <http://tracker.ceph.com/issues/11438>`_, `issue#12939 <http://tracker.ceph.com/issues/12939>`_, `issue#12157 <http://tracker.ceph.com/issues/12157>`_, `issue#12158 <http://tracker.ceph.com/issues/12158>`_, `issue#12363 <http://tracker.ceph.com/issues/12363>`_, `pr#5532 <http://github.com/ceph/ceph/pull/5532>`_, Radoslaw Zarzynski, Orit Wasserman, Robin H. Johnson) +* rgw: use correct objv_tracker for bucket instance (`issue#11416 <http://tracker.ceph.com/issues/11416>`_, `pr#4535 <http://github.com/ceph/ceph/pull/4535>`_, Yehuda Sadeh) +* tests: ceph-fuse crash in test_client_recovery (`issue#12673 <http://tracker.ceph.com/issues/12673>`_, `pr#5813 <http://github.com/ceph/ceph/pull/5813>`_, Loic Dachary) +* tests: kernel_untar_build fails on EL7 (`issue#11758 <http://tracker.ceph.com/issues/11758>`_, `pr#6000 <http://github.com/ceph/ceph/pull/6000>`_, Greg Farnum) +* tests: qemu workunit refers to apt-mirror.front.sepia.ceph.com (`issue#13420 <http://tracker.ceph.com/issues/13420>`_, `pr#6328 <http://github.com/ceph/ceph/pull/6328>`_, Yuan Zhou, Sage Weil) +* tools: src/ceph-disk : disk zap sgdisk invocation (`issue#11143 <http://tracker.ceph.com/issues/11143>`_, `pr#4636 <http://github.com/ceph/ceph/pull/4636>`_, Thorsten Behrens, Owen Synge) +* tools: ceph-disk: sometimes the journal symlink is not created (`issue#10146 <http://tracker.ceph.com/issues/10146>`_, `pr#5541 <http://github.com/ceph/ceph/pull/5541>`_, Dan van der Ster) +* tools: ceph-disk: support NVMe device partitions (`issue#11612 <http://tracker.ceph.com/issues/11612>`_, `pr#4771 <http://github.com/ceph/ceph/pull/4771>`_, Ilja Slepnev) +* tools: ceph-post-file fails on rhel7 (`issue#11836 <http://tracker.ceph.com/issues/11836>`_, `pr#5037 <http://github.com/ceph/ceph/pull/5037>`_, Joseph McDonald, Sage Weil) +* tools: ceph_argparse_flag has no regular 3rd parameter (`issue#11543 <http://tracker.ceph.com/issues/11543>`_, `pr#4582 <http://github.com/ceph/ceph/pull/4582>`_, Thorsten Behrens) +* tools: use a new disk as journal disk,ceph-disk prepare fail (`issue#10983 <http://tracker.ceph.com/issues/10983>`_, `pr#4630 <http://github.com/ceph/ceph/pull/4630>`_, Loic Dachary) + + +v0.80.10 Firefly +================ + +This is a bugfix release for Firefly. + +We recommend that all Firefly users upgrade. + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.10.txt>`. + +Notable Changes +--------------- + +* build/ops: ceph.spec.in: package mkcephfs on EL6 (`issue#11955 <http://tracker.ceph.com/issues/11955>`_, `pr#4924 <http://github.com/ceph/ceph/pull/4924>`_, Ken Dreyer) +* build/ops: debian: ceph-test and rest-bench debug packages should require their respective binary packages (`issue#11673 <http://tracker.ceph.com/issues/11673>`_, `pr#4766 <http://github.com/ceph/ceph/pull/4766>`_, Ken Dreyer) +* build/ops: run RGW as root (`issue#11453 <http://tracker.ceph.com/issues/11453>`_, `pr#4638 <http://github.com/ceph/ceph/pull/4638>`_, Ken Dreyer) +* common: messages/MWatchNotify: include an error code in the message (`issue#9193 <http://tracker.ceph.com/issues/9193>`_, `pr#3944 <http://github.com/ceph/ceph/pull/3944>`_, Sage Weil) +* common: Rados.shutdown() dies with Illegal instruction (core dumped) (`issue#10153 <http://tracker.ceph.com/issues/10153>`_, `pr#3963 <http://github.com/ceph/ceph/pull/3963>`_, Federico Simoncelli) +* common: SimpleMessenger: allow RESETSESSION whenever we forget an endpoint (`issue#10080 <http://tracker.ceph.com/issues/10080>`_, `pr#3915 <http://github.com/ceph/ceph/pull/3915>`_, Greg Farnum) +* common: WorkQueue: make wait timeout on empty queue configurable (`issue#10817 <http://tracker.ceph.com/issues/10817>`_, `pr#3941 <http://github.com/ceph/ceph/pull/3941>`_, Samuel Just) +* crush: set_choose_tries = 100 for erasure code rulesets (`issue#10353 <http://tracker.ceph.com/issues/10353>`_, `pr#3824 <http://github.com/ceph/ceph/pull/3824>`_, Loic Dachary) +* doc: backport ceph-disk man page to Firefly (`issue#10724 <http://tracker.ceph.com/issues/10724>`_, `pr#3936 <http://github.com/ceph/ceph/pull/3936>`_, Nilamdyuti Goswami) +* doc: Fix ceph command manpage to match ceph -h (`issue#10676 <http://tracker.ceph.com/issues/10676>`_, `pr#3996 <http://github.com/ceph/ceph/pull/3996>`_, David Zafman) +* fs: mount.ceph: avoid spurious error message (`issue#10351 <http://tracker.ceph.com/issues/10351>`_, `pr#3927 <http://github.com/ceph/ceph/pull/3927>`_, Yan, Zheng) +* librados: Fix memory leak in python rados bindings (`issue#10723 <http://tracker.ceph.com/issues/10723>`_, `pr#3935 <http://github.com/ceph/ceph/pull/3935>`_, Josh Durgin) +* librados: fix resources leakage in RadosClient::connect() (`issue#10425 <http://tracker.ceph.com/issues/10425>`_, `pr#3828 <http://github.com/ceph/ceph/pull/3828>`_, Radoslaw Zarzynski) +* librados: Translate operation flags from C APIs (`issue#10497 <http://tracker.ceph.com/issues/10497>`_, `pr#3930 <http://github.com/ceph/ceph/pull/3930>`_, Matt Richards) +* librbd: acquire cache_lock before refreshing parent (`issue#5488 <http://tracker.ceph.com/issues/5488>`_, `pr#4206 <http://github.com/ceph/ceph/pull/4206>`_, Jason Dillaman) +* librbd: snap_remove should ignore -ENOENT errors (`issue#11113 <http://tracker.ceph.com/issues/11113>`_, `pr#4245 <http://github.com/ceph/ceph/pull/4245>`_, Jason Dillaman) +* mds: fix assertion caused by system clock backwards (`issue#11053 <http://tracker.ceph.com/issues/11053>`_, `pr#3970 <http://github.com/ceph/ceph/pull/3970>`_, Yan, Zheng) +* mon: ignore osd failures from before up_from (`issue#10762 <http://tracker.ceph.com/issues/10762>`_, `pr#3937 <http://github.com/ceph/ceph/pull/3937>`_, Sage Weil) +* mon: MonCap: take EntityName instead when expanding profiles (`issue#10844 <http://tracker.ceph.com/issues/10844>`_, `pr#3942 <http://github.com/ceph/ceph/pull/3942>`_, Joao Eduardo Luis) +* mon: Monitor: fix timecheck rounds period (`issue#10546 <http://tracker.ceph.com/issues/10546>`_, `pr#3932 <http://github.com/ceph/ceph/pull/3932>`_, Joao Eduardo Luis) +* mon: OSDMonitor: do not trust small values in osd epoch cache (`issue#10787 <http://tracker.ceph.com/issues/10787>`_, `pr#3823 <http://github.com/ceph/ceph/pull/3823>`_, Sage Weil) +* mon: OSDMonitor: fallback to json-pretty in case of invalid formatter (`issue#9538 <http://tracker.ceph.com/issues/9538>`_, `pr#4475 <http://github.com/ceph/ceph/pull/4475>`_, Loic Dachary) +* mon: PGMonitor: several stats output error fixes (`issue#10257 <http://tracker.ceph.com/issues/10257>`_, `pr#3826 <http://github.com/ceph/ceph/pull/3826>`_, Joao Eduardo Luis) +* objecter: fix map skipping (`issue#9986 <http://tracker.ceph.com/issues/9986>`_, `pr#3952 <http://github.com/ceph/ceph/pull/3952>`_, Ding Dinghua) +* osd: cache tiering: fix the atime logic of the eviction (`issue#9915 <http://tracker.ceph.com/issues/9915>`_, `pr#3949 <http://github.com/ceph/ceph/pull/3949>`_, Zhiqiang Wang) +* osd: cancel_pull: requeue waiters (`issue#11244 <http://tracker.ceph.com/issues/11244>`_, `pr#4415 <http://github.com/ceph/ceph/pull/4415>`_, Samuel Just) +* osd: check that source OSD is valid for MOSDRepScrub (`issue#9555 <http://tracker.ceph.com/issues/9555>`_, `pr#3947 <http://github.com/ceph/ceph/pull/3947>`_, Sage Weil) +* osd: DBObjectMap: lock header_lock on sync() (`issue#9891 <http://tracker.ceph.com/issues/9891>`_, `pr#3948 <http://github.com/ceph/ceph/pull/3948>`_, Samuel Just) +* osd: do not ignore deleted pgs on startup (`issue#10617 <http://tracker.ceph.com/issues/10617>`_, `pr#3933 <http://github.com/ceph/ceph/pull/3933>`_, Sage Weil) +* osd: ENOENT on clone (`issue#11199 <http://tracker.ceph.com/issues/11199>`_, `pr#4385 <http://github.com/ceph/ceph/pull/4385>`_, Samuel Just) +* osd: erasure-code-profile set races with erasure-code-profile rm (`issue#11144 <http://tracker.ceph.com/issues/11144>`_, `pr#4383 <http://github.com/ceph/ceph/pull/4383>`_, Loic Dachary) +* osd: FAILED assert(soid < scrubber.start || soid >= scrubber.end) (`issue#11156 <http://tracker.ceph.com/issues/11156>`_, `pr#4185 <http://github.com/ceph/ceph/pull/4185>`_, Samuel Just) +* osd: FileJournal: fix journalq population in do_read_entry() (`issue#6003 <http://tracker.ceph.com/issues/6003>`_, `pr#3960 <http://github.com/ceph/ceph/pull/3960>`_, Samuel Just) +* osd: fix negative degraded objects during backfilling (`issue#7737 <http://tracker.ceph.com/issues/7737>`_, `pr#4021 <http://github.com/ceph/ceph/pull/4021>`_, Guang Yang) +* osd: get the currently atime of the object in cache pool for eviction (`issue#9985 <http://tracker.ceph.com/issues/9985>`_, `pr#3950 <http://github.com/ceph/ceph/pull/3950>`_, Sage Weil) +* osd: load_pgs: we need to handle the case where an upgrade from earlier versions which ignored non-existent pgs resurrects a pg with a prehistoric osdmap (`issue#11429 <http://tracker.ceph.com/issues/11429>`_, `pr#4556 <http://github.com/ceph/ceph/pull/4556>`_, Samuel Just) +* osd: ObjectStore: Don't use largest_data_off to calc data_align. (`issue#10014 <http://tracker.ceph.com/issues/10014>`_, `pr#3954 <http://github.com/ceph/ceph/pull/3954>`_, Jianpeng Ma) +* osd: osd_types: op_queue_age_hist and fs_perf_stat should be in osd_stat_t::o... (`issue#10259 <http://tracker.ceph.com/issues/10259>`_, `pr#3827 <http://github.com/ceph/ceph/pull/3827>`_, Samuel Just) +* osd: PG::actingset should be used when checking the number of acting OSDs for... (`issue#11454 <http://tracker.ceph.com/issues/11454>`_, `pr#4453 <http://github.com/ceph/ceph/pull/4453>`_, Guang Yang) +* osd: PG::all_unfound_are_queried_or_lost for non-existent osds (`issue#10976 <http://tracker.ceph.com/issues/10976>`_, `pr#4416 <http://github.com/ceph/ceph/pull/4416>`_, Mykola Golub) +* osd: PG: always clear_primary_state (`issue#10059 <http://tracker.ceph.com/issues/10059>`_, `pr#3955 <http://github.com/ceph/ceph/pull/3955>`_, Samuel Just) +* osd: PGLog.h: 279: FAILED assert(log.log.size() == log_keys_debug.size()) (`issue#10718 <http://tracker.ceph.com/issues/10718>`_, `pr#4382 <http://github.com/ceph/ceph/pull/4382>`_, Samuel Just) +* osd: PGLog: include rollback_info_trimmed_to in (read|write)_log (`issue#10157 <http://tracker.ceph.com/issues/10157>`_, `pr#3964 <http://github.com/ceph/ceph/pull/3964>`_, Samuel Just) +* osd: pg stuck stale after create with activation delay (`issue#11197 <http://tracker.ceph.com/issues/11197>`_, `pr#4384 <http://github.com/ceph/ceph/pull/4384>`_, Samuel Just) +* osd: ReplicatedPG: fail a non-blocking flush if the object is being scrubbed (`issue#8011 <http://tracker.ceph.com/issues/8011>`_, `pr#3943 <http://github.com/ceph/ceph/pull/3943>`_, Samuel Just) +* osd: ReplicatedPG::on_change: clean up callbacks_for_degraded_object (`issue#8753 <http://tracker.ceph.com/issues/8753>`_, `pr#3940 <http://github.com/ceph/ceph/pull/3940>`_, Samuel Just) +* osd: ReplicatedPG::scan_range: an object can disappear between the list and t... (`issue#10150 <http://tracker.ceph.com/issues/10150>`_, `pr#3962 <http://github.com/ceph/ceph/pull/3962>`_, Samuel Just) +* osd: requeue blocked op before flush it was blocked on (`issue#10512 <http://tracker.ceph.com/issues/10512>`_, `pr#3931 <http://github.com/ceph/ceph/pull/3931>`_, Sage Weil) +* rgw: check for timestamp for s3 keystone auth (`issue#10062 <http://tracker.ceph.com/issues/10062>`_, `pr#3958 <http://github.com/ceph/ceph/pull/3958>`_, Abhishek Lekshmanan) +* rgw: civetweb should use unique request id (`issue#11720 <http://tracker.ceph.com/issues/11720>`_, `pr#4780 <http://github.com/ceph/ceph/pull/4780>`_, Orit Wasserman) +* rgw: don't allow negative / invalid content length (`issue#11890 <http://tracker.ceph.com/issues/11890>`_, `pr#4829 <http://github.com/ceph/ceph/pull/4829>`_, Yehuda Sadeh) +* rgw: fail s3 POST auth if keystone not configured (`issue#10698 <http://tracker.ceph.com/issues/10698>`_, `pr#3966 <http://github.com/ceph/ceph/pull/3966>`_, Yehuda Sadeh) +* rgw: flush xml header on get acl request (`issue#10106 <http://tracker.ceph.com/issues/10106>`_, `pr#3961 <http://github.com/ceph/ceph/pull/3961>`_, Yehuda Sadeh) +* rgw: generate new tag for object when setting object attrs (`issue#11256 <http://tracker.ceph.com/issues/11256>`_, `pr#4571 <http://github.com/ceph/ceph/pull/4571>`_, Yehuda Sadeh) +* rgw: generate the "Date" HTTP header for civetweb. (`issue#11871,11891 <http://tracker.ceph.com/issues/11871,11891>`_, `pr#4851 <http://github.com/ceph/ceph/pull/4851>`_, Radoslaw Zarzynski) +* rgw: keystone token cache does not work correctly (`issue#11125 <http://tracker.ceph.com/issues/11125>`_, `pr#4414 <http://github.com/ceph/ceph/pull/4414>`_, Yehuda Sadeh) +* rgw: merge manifests correctly when there's prefix override (`issue#11622 <http://tracker.ceph.com/issues/11622>`_, `pr#4697 <http://github.com/ceph/ceph/pull/4697>`_, Yehuda Sadeh) +* rgw: send appropriate op to cancel bucket index pending operation (`issue#10770 <http://tracker.ceph.com/issues/10770>`_, `pr#3938 <http://github.com/ceph/ceph/pull/3938>`_, Yehuda Sadeh) +* rgw: shouldn't need to disable rgw_socket_path if frontend is configured (`issue#11160 <http://tracker.ceph.com/issues/11160>`_, `pr#4275 <http://github.com/ceph/ceph/pull/4275>`_, Yehuda Sadeh) +* rgw: Swift API. Dump container's custom metadata. (`issue#10665 <http://tracker.ceph.com/issues/10665>`_, `pr#3934 <http://github.com/ceph/ceph/pull/3934>`_, Dmytro Iurchenko) +* rgw: Swift API. Support for X-Remove-Container-Meta-{key} header. (`issue#10475 <http://tracker.ceph.com/issues/10475>`_, `pr#3929 <http://github.com/ceph/ceph/pull/3929>`_, Dmytro Iurchenko) +* rgw: use correct objv_tracker for bucket instance (`issue#11416 <http://tracker.ceph.com/issues/11416>`_, `pr#4379 <http://github.com/ceph/ceph/pull/4379>`_, Yehuda Sadeh) +* tests: force checkout of submodules (`issue#11157 <http://tracker.ceph.com/issues/11157>`_, `pr#4079 <http://github.com/ceph/ceph/pull/4079>`_, Loic Dachary) +* tools: Backport ceph-objectstore-tool changes to firefly (`issue#12327 <http://tracker.ceph.com/issues/12327>`_, `pr#3866 <http://github.com/ceph/ceph/pull/3866>`_, David Zafman) +* tools: ceph-objectstore-tool: Output only unsupported features when incomatible (`issue#11176 <http://tracker.ceph.com/issues/11176>`_, `pr#4126 <http://github.com/ceph/ceph/pull/4126>`_, David Zafman) +* tools: ceph-objectstore-tool: Use exit status 11 for incompatible import attemp... (`issue#11139 <http://tracker.ceph.com/issues/11139>`_, `pr#4129 <http://github.com/ceph/ceph/pull/4129>`_, David Zafman) +* tools: Fix do_autogen.sh so that -L is allowed (`issue#11303 <http://tracker.ceph.com/issues/11303>`_, `pr#4247 <http://github.com/ceph/ceph/pull/4247>`_, Alfredo Deza) + +v0.80.9 Firefly +=============== + +This is a bugfix release for firefly. It fixes a performance +regression in librbd, an important CRUSH misbehavior (see below), and +several RGW bugs. We have also backported support for flock/fcntl +locks to ceph-fuse and libcephfs. + +We recommend that all Firefly users upgrade. + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.9.txt>`. + +Adjusting CRUSH maps +-------------------- + +* This point release fixes several issues with CRUSH that trigger + excessive data migration when adjusting OSD weights. These are most + obvious when a very small weight change (e.g., a change from 0 to + .01) triggers a large amount of movement, but the same set of bugs + can also lead to excessive (though less noticeable) movement in + other cases. + + However, because the bug may already have affected your cluster, + fixing it may trigger movement *back* to the more correct location. + For this reason, you must manually opt-in to the fixed behavior. + + In order to set the new tunable to correct the behavior:: + + ceph osd crush set-tunable straw_calc_version 1 + + Note that this change will have no immediate effect. However, from + this point forward, any 'straw' bucket in your CRUSH map that is + adjusted will get non-buggy internal weights, and that transition + may trigger some rebalancing. + + You can estimate how much rebalancing will eventually be necessary + on your cluster with:: + + ceph osd getcrushmap -o /tmp/cm + crushtool -i /tmp/cm --num-rep 3 --test --show-mappings > /tmp/a 2>&1 + crushtool -i /tmp/cm --set-straw-calc-version 1 -o /tmp/cm2 + crushtool -i /tmp/cm2 --reweight -o /tmp/cm2 + crushtool -i /tmp/cm2 --num-rep 3 --test --show-mappings > /tmp/b 2>&1 + wc -l /tmp/a # num total mappings + diff -u /tmp/a /tmp/b | grep -c ^+ # num changed mappings + + Divide the number of changed lines by the total number of lines in + /tmp/a. We've found that most clusters are under 10%. + + You can force all of this rebalancing to happen at once with:: + + ceph osd crush reweight-all + + Otherwise, it will happen at some unknown point in the future when + CRUSH weights are next adjusted. + +Notable Changes +--------------- + +* ceph-fuse: flock, fcntl lock support (Yan, Zheng, Greg Farnum) +* crush: fix straw bucket weight calculation, add straw_calc_version tunable (#10095 Sage Weil) +* crush: fix tree bucket (Rongzu Zhu) +* crush: fix underflow of tree weights (Loic Dachary, Sage Weil) +* crushtool: add --reweight (Sage Weil) +* librbd: complete pending operations before losing image (#10299 Jason Dillaman) +* librbd: fix read caching performance regression (#9854 Jason Dillaman) +* librbd: gracefully handle deleted/renamed pools (#10270 Jason Dillaman) +* mon: fix dump of chooseleaf_vary_r tunable (Sage Weil) +* osd: fix PG ref leak in snaptrimmer on peering (#10421 Kefu Chai) +* osd: handle no-op write with snapshot (#10262 Sage Weil) +* radosgw-admin: create subuser when creating user (#10103 Yehuda Sadeh) +* rgw: change multipart uplaod id magic (#10271 Georgio Dimitrakakis, Yehuda Sadeh) +* rgw: don't overwrite bucket/object owner when setting ACLs (#10978 Yehuda Sadeh) +* rgw: enable IPv6 for embedded civetweb (#10965 Yehuda Sadeh) +* rgw: fix partial swift GET (#10553 Yehuda Sadeh) +* rgw: fix quota disable (#9907 Dong Lei) +* rgw: index swift keys appropriately (#10471 Hemant Burman, Yehuda Sadeh) +* rgw: make setattrs update bucket index (#5595 Yehuda Sadeh) +* rgw: pass civetweb configurables (#10907 Yehuda Sadeh) +* rgw: remove swift user manifest (DLO) hash calculation (#9973 Yehuda Sadeh) +* rgw: return correct len for 0-len objects (#9877 Yehuda Sadeh) +* rgw: S3 object copy content-type fix (#9478 Yehuda Sadeh) +* rgw: send ETag on S3 object copy (#9479 Yehuda Sadeh) +* rgw: send HTTP status reason explicitly in fastcgi (Yehuda Sadeh) +* rgw: set ulimit -n from sysvinit (el6) init script (#9587 Sage Weil) +* rgw: update swift subuser permission masks when authenticating (#9918 Yehuda Sadeh) +* rgw: URL decode query params correctly (#10271 Georgio Dimitrakakis, Yehuda Sadeh) +* rgw: use attrs when reading object attrs (#10307 Yehuda Sadeh) +* rgw: use \r\n for http headers (#9254 Benedikt Fraunhofer, Yehuda Sadeh) + + +v0.80.8 Firefly +=============== + +This is a long-awaited bugfix release for firefly. It has several +important (but relatively rare) OSD peering fixes, performance issues +when snapshots are trimmed, several RGW fixes, a paxos corner case +fix, and some packaging updates. + +We recommend that all users for v0.80.x firefly upgrade when it is +convenient to do so. + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.8.txt>`. + +Notable Changes +--------------- + +* build: remove stack-execute bit from assembled code sections (#10114 Dan Mick) +* ceph-disk: fix dmcrypt key permissions (#9785 Loic Dachary) +* ceph-disk: fix keyring location (#9653 Loic Dachary) +* ceph-disk: make partition checks more robust (#9721 #9665 Loic Dachary) +* ceph: cleanly shut down librados context on shutdown (#8797 Dan Mick) +* common: add $cctid config metavariable (#6228 Adam Crume) +* crush: align rule and ruleset ids (#9675 Xiaoxi Chen) +* crush: fix negative weight bug during create_or_move_item (#9998 Pawel Sadowski) +* crush: fix potential buffer overflow in erasure rules (#9492 Johnu George) +* debian: fix python-ceph -> ceph file movement (Sage Weil) +* libcephfs,ceph-fuse: fix flush tid wraparound bug (#9869 Greg Farnum, Yan, Zheng) +* libcephfs: close fd befure umount (#10415 Yan, Zheng) +* librados: fix crash from C API when read timeout is enabled (#9582 Sage Weil) +* librados: handle reply race with pool deletion (#10372 Sage Weil) +* librbd: cap memory utilization for read requests (Jason Dillaman) +* librbd: do not close a closed parent image on failure (#10030 Jason Dillaman) +* librbd: fix diff tests (#10002 Josh Durgin) +* librbd: protect list_children from invalid pools (#10123 Jason Dillaman) +* make check improvemens (Loic Dachary) +* mds: fix ctime updates (#9514 Greg Farnum) +* mds: fix journal import tool (#10025 John Spray) +* mds: fix rare NULL deref in cap flush handler (Greg Farnum) +* mds: handle unknown lock messages (Yan, Zheng) +* mds: store backtrace for straydir (Yan, Zheng) +* mon: abort startup if disk is full (#9502 Joao Eduardo Luis) +* mon: add paxos instrumentation (Sage Weil) +* mon: fix double-free in rare OSD startup path (Sage Weil) +* mon: fix osdmap trimming (#9987 Sage Weil) +* mon: fix paxos corner cases (#9301 #9053 Sage Weil) +* osd: cancel callback on blacklisted watchers (#8315 Samuel Just) +* osd: cleanly abort set-alloc-hint operations during upgrade (#9419 David Zafman) +* osd: clear rollback PG metadata on PG deletion (#9293 Samuel Just) +* osd: do not abort deep scrub if hinfo is missing (#10018 Loic Dachary) +* osd: erasure-code regression tests (Loic Dachary) +* osd: fix distro metadata reporting for SUSE (#8654 Danny Al-Gaaf) +* osd: fix full OSD checks during backfill (#9574 Samuel Just) +* osd: fix ioprio parsing (#9677 Loic Dachary) +* osd: fix journal direct-io shutdown (#9073 Mark Kirkwood, Ma Jianpeng, Somnath Roy) +* osd: fix journal dump (Ma Jianpeng) +* osd: fix occasional stall during peering or activation (Sage Weil) +* osd: fix past_interval display bug (#9752 Loic Dachary) +* osd: fix rare crash triggered by admin socket dump_ops_in_filght (#9916 Dong Lei) +* osd: fix snap trimming performance issues (#9487 #9113 Samuel Just, Sage Weil, Dan van der Ster, Florian Haas) +* osd: fix snapdir handling on cache eviction (#8629 Sage Weil) +* osd: handle map gaps in map advance code (Sage Weil) +* osd: handle undefined CRUSH results in interval check (#9718 Samuel Just) +* osd: include shard in JSON dump of ghobject (#10063 Loic Dachary) +* osd: make backfill reservation denial handling more robust (#9626 Samuel Just) +* osd: make misdirected op checks handle EC + primary affinity (#9835 Samuel Just, Sage Weil) +* osd: mount XFS with inode64 by default (Sage Weil) +* osd: other misc bugs (#9821 #9875 Samuel Just) +* rgw: add .log to default log path (#9353 Alexandre Marangone) +* rgw: clean up fcgi request context (#10194 Yehuda Sadeh) +* rgw: convet header underscores to dashes (#9206 Yehuda Sadeh) +* rgw: copy object data if copy target is in different pool (#9039 Yehuda Sadeh) +* rgw: don't try to authenticate CORS peflight request (#8718 Robert Hubbard, Yehuda Sadeh) +* rgw: fix civetweb URL decoding (#8621 Yehuda Sadeh) +* rgw: fix hash calculation during PUT (Yehuda Sadeh) +* rgw: fix misc bugs (#9089 #9201 Yehuda Sadeh) +* rgw: fix object tail test (#9226 Sylvain Munaut, Yehuda Sadeh) +* rgw: make sysvinit script run rgw under systemd context as needed (#10125 Loic Dachary) +* rgw: separate civetweb log from rgw log (Yehuda Sadeh) +* rgw: set length for keystone token validations (#7796 Mark Kirkwood, Yehuda Sadeh) +* rgw: subuser creation fixes (#8587 Yehuda Sadeh) +* rpm: misc packaging improvements (Sandon Van Ness, Dan Mick, Erik Logthenberg, Boris Ranto) +* rpm: use standard udev rules for CentOS7/RHEL7 (#9747 Loic Dachary) + + +v0.80.7 Firefly +=============== + +This release fixes a few critical issues with v0.80.6, particularly +with clusters running mixed versions. + +We recommend that all v0.80.x Firefly users upgrade to this release. + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.7.txt>`. + +Notable Changes +--------------- + +* osd: fix invalid memory reference in log trimming (#9731 Samuel Just) +* osd: fix use-after-free in cache tiering code (#7588 Sage Weil) +* osd: remove bad backfill assertion for mixed-version clusters (#9696 Samuel Just) + + + +v0.80.6 Firefly +=============== + +This is a major bugfix release for firefly, fixing a range of issues +in the OSD and monitor, particularly with cache tiering. There are +also important fixes in librados, with the watch/notify mechanism used +by librbd, and in radosgw. + +A few pieces of new functionality of been backported, including improved +'ceph df' output (view amount of writeable space per pool), support for +non-default cluster names when using sysvinit or systemd, and improved +(and fixed) support for dmcrypt. + +We recommend that all v0.80.x Firefly users upgrade to this release. + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.6.txt>`. + +Notable Changes +--------------- + +* build: fix atomic64_t on i386 (#8969 Sage Weil) +* build: fix build on alpha (Michael Cree, Dmitry Smirnov) +* build: fix build on hppa (Dmitry Smirnov) +* build: fix yasm detection on x32 arch (Sage Weil) +* ceph-disk: fix 'list' function with dmcrypt (Sage Weil) +* ceph-disk: fix dmcrypt support (Alfredo Deza) +* ceph: allow non-default cluster to be specified (#8944) +* common: fix dup log messages to mon (#9080 Sage Weil) +* global: write pid file when -f is used (systemd, upstart) (Alexandre Oliva) +* librados: fix crash when read timeout is enabled (#9362 Matthias Kiefer, Sage Weil) +* librados: fix lock leaks in error paths (#9022 Pavan Rallabhandi) +* librados: fix watch resend on PG acting set change (#9220 Samuel Just) +* librados: python: fix aio_read handling with \0 (Mohammad Salehe) +* librbd: add interface to invalidate cached data (Josh Durgin) +* librbd: fix crash when using clone of flattened image (#8845 Josh Durgin) +* librbd: fix error path cleanup on open (#8912 Josh Durgin) +* librbd: fix null pointer check (Danny Al-Gaaf) +* librbd: limit dirty object count (Haomai Wang) +* mds: fix rstats for root and mdsdir (Yan, Zheng) +* mon: add 'get' command for new cache tier pool properties (Joao Eduardo Luis) +* mon: add 'osd pool get-quota' (#8523 Joao Eduardo Luis) +* mon: add cluster fingerprint (Sage Weil) +* mon: disallow nonsensical cache-mode transitions (#8155 Joao Eduardo Luis) +* mon: fix cache tier rounding error on i386 (Sage Weil) +* mon: fix occasional memory leak (#9176 Sage Weil) +* mon: fix reported latency for 'osd perf' (#9269 Samuel Just) +* mon: include 'max avail' in 'ceph df' output (Sage Weil, Xioaxi Chen) +* mon: persistently mark pools where scrub may find incomplete clones (#8882 Sage Weil) +* mon: preload erasure plugins (Loic Dachary) +* mon: prevent cache-specific settings on non-tier pools (#8696 Joao Eduardo Luis) +* mon: reduce log spam (Aanchal Agrawal, Sage Weil) +* mon: warn when cache pools have no hit_sets enabled (Sage Weil) +* msgr: fix trivial memory leak (Sage Weil) +* osd: automatically scrub PGs with invalid stats (#8147 Sage Weil) +* osd: avoid sharing PG metadata that is not durable (Samuel Just) +* osd: cap hit_set size (#9339 Samuel Just) +* osd: create default erasure profile if needed (#8601 Loic Dachary) +* osd: dump tid as JSON int (not string) where appropriate (Joao Eduardo Luis) +* osd: encode blacklist in deterministic order (#9211 Sage Weil) +* osd: fix behavior when cache tier has no hit_sets enabled (#8982 Sage Weil) +* osd: fix cache tier flushing of snapshots (#9054 Samuel Just) +* osd: fix cache tier op ordering when going from full to non-full (#8931 Sage Weil) +* osd: fix crash on dup recovery reservation (#8863 Sage Weil) +* osd: fix division by zero when pg_num adjusted with no OSDs (#9052 Sage Weil) +* osd: fix hint crash in experimental keyvaluestore_dev backend (Hoamai Wang) +* osd: fix leak in copyfrom cancellation (#8894 Samuel Just) +* osd: fix locking for copyfrom finish (#8889 Sage Weil) +* osd: fix long filename handling in backend (#8701 Sage Weil) +* osd: fix min_size check with backfill (#9497 Samuel Just) +* osd: fix mount/remount sync race (#9144 Sage Weil) +* osd: fix object listing + erasure code bug (Guang Yang) +* osd: fix race on reconnect to failed OSD (#8944 Greg Farnum) +* osd: fix recovery reservation deadlock (Samuel Just) +* osd: fix tiering agent arithmetic for negative values (#9082 Karan Singh) +* osd: improve shutdown order (#9218 Sage Weil) +* osd: improve subop discard logic (#9259 Samuel Just) +* osd: introduce optional sleep, io priority for scrub and snap trim (Sage Weil) +* osd: make scrub check for and remove stale erasure-coded objects (Samuel Just) +* osd: misc fixes (#9481 #9482 #9179 Sameul Just) +* osd: mix keyvaluestore_dev improvements (Haomai Wang) +* osd: only require CRUSH features for rules that are used (#8963 Sage Weil) +* osd: preload erasure plugins on startup (Loic Dachary) +* osd: prevent PGs from falling behind when consuming OSDMaps (#7576 Sage Weil) +* osd: prevent old clients from using tiered pools (#8714 Sage Weil) +* osd: set min_size on erasure pools to data chunk count (Sage Weil) +* osd: trim old erasure-coded objects more aggressively (Samuel Just) +* rados: enforce erasure code alignment (Lluis Pamies-Juarez) +* rgw: align object stripes with erasure pool alignment (#8442 Yehuda Sadeh) +* rgw: don't send error body on HEAD for civetweb (#8539 Yehuda Sadeh) +* rgw: fix crash in CORS preflight request (Yehuda Sadeh) +* rgw: fix decoding of + in URL (#8702 Brian Rak) +* rgw: fix object removal on object create (#8972 Patrycja Szabowska, Yehuda Sadeh) +* systemd: use systemd-run when starting radosgw (JuanJose Galvez) +* sysvinit: support non-default cluster name (Alfredo Deza) + + +v0.80.5 Firefly +=============== + +This release fixes a few important bugs in the radosgw and fixes +several packaging and environment issues, including OSD log rotation, +systemd environments, and daemon restarts on upgrade. + +We recommend that all v0.80.x Firefly users upgrade, particularly if they +are using upstart, systemd, or radosgw. + +Notable Changes +--------------- + +* ceph-dencoder: do not needlessly link to librgw, librados, etc. (Sage Weil) +* do not needlessly link binaries to leveldb (Sage Weil) +* mon: fix mon crash when no auth keys are present (#8851, Joao Eduardo Luis) +* osd: fix cleanup (and avoid occasional crash) during shutdown (#7981, Sage Weil) +* osd: fix log rotation under upstart (Sage Weil) +* rgw: fix multipart upload when object has irregular size (#8846, Yehuda Sadeh, Sylvain Munaut) +* rgw: improve bucket listing S3 compatibility (#8858, Yehuda Sadeh) +* rgw: improve delimited bucket listing (Yehuda Sadeh) +* rpm: do not restart daemons on upgrade (#8849, Alfredo Deza) + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.5.txt>`. + +v0.80.4 Firefly +=============== + +This Firefly point release fixes an potential data corruption problem +when ceph-osd daemons run on top of XFS and service Firefly librbd +clients. A recently added allocation hint that RBD utilizes triggers +an XFS bug on some kernels (Linux 3.2, and likely others) that leads +to data corruption and deep-scrub errors (and inconsistent PGs). This +release avoids the situation by disabling the allocation hint until we +can validate which kernels are affected and/or are known to be safe to +use the hint on. + +We recommend that all v0.80.x Firefly users urgently upgrade, +especially if they are using RBD. + +Notable Changes +--------------- + +* osd: disable XFS extsize hint by default (#8830, Samuel Just) +* rgw: fix extra data pool default name (Yehuda Sadeh) + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.4.txt>`. + + +v0.80.3 Firefly +=============== + +This is the third Firefly point release. It includes a single fix +for a radosgw regression that was discovered in v0.80.2 right after it +was released. + +We recommend that all v0.80.x Firefly users upgrade. + +Notable Changes +--------------- + +* radosgw: fix regression in manifest decoding (#8804, Sage Weil) + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.3.txt>`. + + +v0.80.2 Firefly +=============== + +This is the second Firefly point release. It contains a range of +important fixes, including several bugs in the OSD cache tiering, some +compatibility checks that affect upgrade situations, several radosgw +bugs, and an irritating and unnecessary feature bit check that +prevents older clients from communicating with a cluster with any +erasure coded pools. + +One someone large change in this point release is that the ceph RPM +package is separated into a ceph and ceph-common package, similar to +Debian. The ceph-common package contains just the client libraries +without any of the server-side daemons. + +We recommend that all v0.80.x Firefly users skip this release and use +v0.80.3. + +Notable Changes +--------------- + +* ceph-disk: better debug logging (Alfredo Deza) +* ceph-disk: fix preparation of OSDs with dmcrypt (#6700, Stephen F Taylor) +* ceph-disk: partprobe on prepare to fix dm-crypt (#6966, Eric Eastman) +* do not require ERASURE_CODE feature from clients (#8556, Sage Weil) +* libcephfs-java: build with older JNI headers (Greg Farnum) +* libcephfs-java: fix build with gcj-jdk (Dmitry Smirnov) +* librados: fix osd op tid for redirected ops (#7588, Samuel Just) +* librados: fix rados_pool_list buffer bounds checks (#8447, Sage Weil) +* librados: resend ops when pool overlay changes (#8305, Sage Weil) +* librbd, ceph-fuse: reduce CPU overhead for clean object check in cache (Haomai Wang) +* mon: allow deletion of cephfs pools (John Spray) +* mon: fix default pool ruleset choice (#8373, John Spray) +* mon: fix health summary for mon low disk warning (Sage Weil) +* mon: fix 'osd pool set <pool> cache_target_full_ratio' (Geoffrey Hartz) +* mon: fix quorum feature check (Greg Farnum) +* mon: fix request forwarding in mixed firefly+dumpling clusters 9#8727, Joao Eduardo Luis) +* mon: fix rule vs ruleset check in 'osd pool set ... crush_ruleset' command (John Spray) +* mon: make osd 'down' count accurate (Sage Weil) +* mon: set 'next commit' in primary-affinity reply (Ilya Dryomov) +* mon: verify CRUSH features are supported by all mons (#8738, Greg Farnum) +* msgr: fix sequence negotiation during connection reset (Guang Yang) +* osd: block scrub on blocked objects (#8011, Samuel Just) +* osd: call XFS hint ioctl less often (#8241, Ilya Dryomov) +* osd: copy xattr spill out marker on clone (Haomai Wang) +* osd: fix flush of snapped objects (#8334, Samuel Just) +* osd: fix hashindex restart of merge operation (#8332, Samuel Just) +* osd: fix osdmap subscription bug causing startup hang (Greg Farnum) +* osd: fix potential null deref (#8328, Sage Weil) +* osd: fix shutdown race (#8319, Sage Weil) +* osd: handle 'none' in CRUSH results properly during peering (#8507, Samuel Just) +* osd: set no spill out marker on new objects (Greg Farnum) +* osd: skip op ordering debug checks on tiered pools (#8380, Sage Weil) +* rados: enforce 'put' alignment (Lluis Pamies-Juarez) +* rest-api: fix for 'rx' commands (Ailing Zhang) +* rgw: calc user manifest etag and fix check (#8169, #8436, Yehuda Sadeh) +* rgw: fetch attrs on multipart completion (#8452, Yehuda Sadeh, Sylvain Munaut) +* rgw: fix buffer overflow for long instance ids (#8608, Yehuda Sadeh) +* rgw: fix entity permission check on metadata put (#8428, Yehuda Sadeh) +* rgw: fix multipart retry race (#8269, Yehuda Sadeh) +* rpm: split ceph into ceph and ceph-common RPMs (Sandon Van Ness, Dan Mick) +* sysvinit: continue startin daemons after failure doing mount (#8554, Sage Weil) + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.2.txt>`. + +v0.80.1 Firefly +=============== + +This first Firefly point release fixes a few bugs, the most visible +being a problem that prevents scrub from completing in some cases. + +Notable Changes +--------------- + +* osd: revert incomplete scrub fix (Samuel Just) +* rgw: fix stripe calculation for manifest objects (Yehuda Sadeh) +* rgw: improve handling, memory usage for abort reads (Yehuda Sadeh) +* rgw: send Swift user manifest HTTP header (Yehuda Sadeh) +* libcephfs, ceph-fuse: expose MDS session state via admin socket (Yan, Zheng) +* osd: add simple throttle for snap trimming (Sage Weil) +* monclient: fix possible hang from ill-timed monitor connection failure (Sage Weil) +* osd: fix trimming of past HitSets (Sage Weil) +* osd: fix whiteouts for non-writeback cache modes (Sage Weil) +* osd: prevent divide by zero in tiering agent (David Zafman) +* osd: prevent busy loop when tiering agent can do no work (David Zafman) + +For more detailed information, see :download:`the complete changelog <../changelog/v0.80.1.txt>`. + + +v0.80 Firefly +============= + +This release will form the basis for our long-term supported release +Firefly, v0.80.x. The big new features are support for erasure coding +and cache tiering, although a broad range of other features, fixes, +and improvements have been made across the code base. Highlights include: + +* *Erasure coding*: support for a broad range of erasure codes for lower + storage overhead and better data durability. +* *Cache tiering*: support for creating 'cache pools' that store hot, + recently accessed objects with automatic demotion of colder data to + a base tier. Typically the cache pool is backed by faster storage + devices like SSDs. +* *Primary affinity*: Ceph now has the ability to skew selection of + OSDs as the "primary" copy, which allows the read workload to be + cheaply skewed away from parts of the cluster without migrating any + data. +* *Key/value OSD backend* (experimental): An alternative storage backend + for Ceph OSD processes that puts all data in a key/value database like + leveldb. This provides better performance for workloads dominated by + key/value operations (like radosgw bucket indices). +* *Standalone radosgw* (experimental): The radosgw process can now run + in a standalone mode without an apache (or similar) web server or + fastcgi. This simplifies deployment and can improve performance. + +We expect to maintain a series of stable releases based on v0.80 +Firefly for as much as a year. In the meantime, development of Ceph +continues with the next release, Giant, which will feature work on the +CephFS distributed file system, more alternative storage backends +(like RocksDB and f2fs), RDMA support, support for pyramid erasure +codes, and additional functionality in the block device (RBD) like +copy-on-read and multisite mirroring. + + +Upgrade Sequencing +------------------ + +* If your existing cluster is running a version older than v0.67 + Dumpling, please first upgrade to the latest Dumpling release before + upgrading to v0.80 Firefly. Please refer to the :ref:`dumpling-upgrade` + documentation. + +* We recommend adding the following to the [mon] section of your + ceph.conf prior to upgrade:: + + mon warn on legacy crush tunables = false + + This will prevent health warnings due to the use of legacy CRUSH + placement. Although it is possible to rebalance existing data + across your cluster (see the upgrade notes below), we do not + normally recommend it for production environments as a large amount + of data will move and there is a significant performance impact from + the rebalancing. + +* Upgrade daemons in the following order: + + #. Monitors + #. OSDs + #. MDSs and/or radosgw + + If the ceph-mds daemon is restarted first, it will wait until all + OSDs have been upgraded before finishing its startup sequence. If + the ceph-mon daemons are not restarted prior to the ceph-osd + daemons, they will not correctly register their new capabilities + with the cluster and new features may not be usable until they are + restarted a second time. + +* Upgrade radosgw daemons together. There is a subtle change in behavior + for multipart uploads that prevents a multipart request that was initiated + with a new radosgw from being completed by an old radosgw. + + +Upgrading from v0.79 +-------------------- + +* OSDMap's json-formatted dump changed for keys 'full' and 'nearfull'. + What was previously being outputted as 'true' or 'false' strings are + now being outputted 'true' and 'false' booleans according to json syntax. + +* HEALTH_WARN on 'mon osd down out interval == 0'. Having this option set + to zero on the leader acts much like having the 'noout' flag set. This + warning will only be reported if the monitor getting the 'health' or + 'status' request has this option set to zero. + +* Monitor 'auth' commands now require the mon 'x' capability. This matches + dumpling v0.67.x and earlier, but differs from emperor v0.72.x. + +* A librados WATCH operation on a non-existent object now returns ENOENT; + previously it did not. + +* Librados interface change: As there are no partial writes, the rados_write() + and rados_append() operations now return 0 on success like rados_write_full() + always has. This includes the C++ interface equivalents and AIO return + values for the aio variants. + +* The radosgw init script (sysvinit) how requires that the 'host = ...' line in + ceph.conf, if present, match the short hostname (the output of 'hostname -s'), + not the fully qualified hostname or the (occasionally non-short) output of + 'hostname'. Failure to adjust this when upgrading from emperor or dumpling + may prevent the radosgw daemon from starting. + +Upgrading from v0.72 Emperor +---------------------------- + +* See notes above. + +* The 'ceph -s' or 'ceph status' command's 'num_in_osds' field in the + JSON and XML output has been changed from a string to an int. + +* The recently added 'ceph mds set allow_new_snaps' command's syntax + has changed slightly; it is now 'ceph mds set allow_new_snaps true'. + The 'unset' command has been removed; instead, set the value to + 'false'. + +* The syntax for allowing snapshots is now 'mds set allow_new_snaps + <true|false>' instead of 'mds <set,unset> allow_new_snaps'. + +* 'rbd ls' on a pool which never held rbd images now exits with code + 0. It outputs nothing in plain format, or an empty list in + non-plain format. This is consistent with the behavior for a pool + which used to hold images, but contains none. Scripts relying on + this behavior should be updated. + +* The MDS requires a new OSD operation TMAP2OMAP, added in this release. When + upgrading, be sure to upgrade and restart the ceph-osd daemons before the + ceph-mds daemon. The MDS will refuse to start if any up OSDs do not support + the new feature. + +* The 'ceph mds set_max_mds N' command is now deprecated in favor of + 'ceph mds set max_mds N'. + +* The 'osd pool create ...' syntax has changed for erasure pools. + +* The default CRUSH rules and layouts are now using the 'bobtail' + tunables and defaults. Upgaded clusters using the old values will + now present with a health WARN state. This can be disabled by + adding 'mon warn on legacy crush tunables = false' to ceph.conf and + restarting the monitors. Alternatively, you can switch to the new + tunables with 'ceph osd crush tunables firefly,' but keep in mind + that this will involve moving a *significant* portion of the data + already stored in the cluster and in a large cluster may take + several days to complete. We do not recommend adjusting tunables on a + production cluster. + +* We now default to the 'bobtail' CRUSH tunable values that are first supported + by Ceph clients in bobtail (v0.56) and Linux kernel version v3.9. If you + plan to access a newly created Ceph cluster with an older kernel client, you + should use 'ceph osd crush tunables legacy' to switch back to the legacy + behavior. Note that making that change will likely result in some data + movement in the system, so adjust the setting before populating the new + cluster with data. + +* We now set the HASHPSPOOL flag on newly created pools (and new + clusters) by default. Support for this flag first appeared in + v0.64; v0.67 Dumpling is the first major release that supports it. + It is first supported by the Linux kernel version v3.9. If you plan + to access a newly created Ceph cluster with an older kernel or + clients (e.g, librados, librbd) from a pre-dumpling Ceph release, + you should add 'osd pool default flag hashpspool = false' to the + '[global]' section of your 'ceph.conf' prior to creating your + monitors (e.g., after 'ceph-deploy new' but before 'ceph-deploy mon + create ...'). + +* The configuration option 'osd pool default crush rule' is deprecated + and replaced with 'osd pool default crush replicated ruleset'. 'osd + pool default crush rule' takes precedence for backward compatibility + and a deprecation warning is displayed when it is used. + +* As part of fix for #6796, 'ceph osd pool set <pool> <var> <arg>' now + receives <arg> as an integer instead of a string. This affects how + 'hashpspool' flag is set/unset: instead of 'true' or 'false', it now + must be '0' or '1'. + +* The behavior of the CRUSH 'indep' choose mode has been changed. No + ceph cluster should have been using this behavior unless someone has + manually extracted a crush map, modified a CRUSH rule to replace + 'firstn' with 'indep', recompiled, and reinjected the new map into + the cluster. If the 'indep' mode is currently in use on a cluster, + the rule should be modified to use 'firstn' instead, and the + administrator should wait until any data movement completes before + upgrading. + +* The 'osd dump' command now dumps pool snaps as an array instead of an + object. + + +Upgrading from v0.67 Dumpling +----------------------------- + +* See notes above. + +* ceph-fuse and radosgw now use the same default values for the admin + socket and log file paths that the other daemons (ceph-osd, + ceph-mon, etc.) do. If you run these daemons as non-root, you may + need to adjust your ceph.conf to disable these options or to adjust + the permissions on /var/run/ceph and /var/log/ceph. + +* The MDS now disallows snapshots by default as they are not + considered stable. The command 'ceph mds set allow_snaps' will + enable them. + +* For clusters that were created before v0.44 (pre-argonaut, Spring + 2012) and store radosgw data, the auto-upgrade from TMAP to OMAP + objects has been disabled. Before upgrading, make sure that any + buckets created on pre-argonaut releases have been modified (e.g., + by PUTing and then DELETEing an object from each bucket). Any + cluster created with argonaut (v0.48) or a later release or not + using radosgw never relied on the automatic conversion and is not + affected by this change. + +* Any direct users of the 'tmap' portion of the librados API should be + aware that the automatic tmap -> omap conversion functionality has + been removed. + +* Most output that used K or KB (e.g., for kilobyte) now uses a + lower-case k to match the official SI convention. Any scripts that + parse output and check for an upper-case K will need to be modified. + +* librados::Rados::pool_create_async() and librados::Rados::pool_delete_async() + don't drop a reference to the completion object on error, caller needs to take + care of that. This has never really worked correctly and we were leaking an + object + +* 'ceph osd crush set <id> <weight> <loc..>' no longer adds the osd to the + specified location, as that's a job for 'ceph osd crush add'. It will + however continue to work just the same as long as the osd already exists + in the crush map. + +* The OSD now enforces that class write methods cannot both mutate an + object and return data. The rbd.assign_bid method, the lone + offender, has been removed. This breaks compatibility with + pre-bobtail librbd clients by preventing them from creating new + images. + +* librados now returns on commit instead of ack for synchronous calls. + This is a bit safer in the case where both OSDs and the client crash, and + is probably how it should have been acting from the beginning. Users are + unlikely to notice but it could result in lower performance in some + circumstances. Those who care should switch to using the async interfaces, + which let you specify safety semantics precisely. + +* The C++ librados AioComplete::get_version() method was incorrectly + returning an int (usually 32-bits). To avoid breaking library + compatibility, a get_version64() method is added that returns the + full-width value. The old method is deprecated and will be removed + in a future release. Users of the C++ librados API that make use of + the get_version() method should modify their code to avoid getting a + value that is truncated from 64 to to 32 bits. + + +Notable changes since v0.79 +--------------------------- + +* ceph-fuse, libcephfs: fix several caching bugs (Yan, Zheng) +* ceph-fuse: trim inodes in response to mds memory pressure (Yan, Zheng) +* librados: fix inconsistencies in API error values (David Zafman) +* librados: fix watch operations with cache pools (Sage Weil) +* librados: new snap rollback operation (David Zafman) +* mds: fix respawn (John Spray) +* mds: misc bugs (Yan, Zheng) +* mds: misc multi-mds fixes (Yan, Zheng) +* mds: use shared_ptr for requests (Greg Farnum) +* mon: fix peer feature checks (Sage Weil) +* mon: require 'x' mon caps for auth operations (Joao Luis) +* mon: shutdown when removed from mon cluster (Joao Luis) +* msgr: fix locking bug in authentication (Josh Durgin) +* osd: fix bug in journal replay/restart (Sage Weil) +* osd: many many many bug fixes with cache tiering (Samuel Just) +* osd: track omap and hit_set objects in pg stats (Samuel Just) +* osd: warn if agent cannot enable due to invalid (post-split) stats (Sage Weil) +* rados bench: track metadata for multiple runs separately (Guang Yang) +* rgw: fixed subuser modify (Yehuda Sadeh) +* rpm: fix redhat-lsb dependency (Sage Weil, Alfredo Deza) + + +Notable changes since v0.72 Emperor +----------------------------------- + +* buffer: some zero-copy groundwork (Josh Durgin) +* build: misc improvements (Ken Dreyer) +* ceph-conf: stop creating bogus log files (Josh Durgin, Sage Weil) +* ceph-crush-location: new hook for setting CRUSH location of osd daemons on start) +* ceph-disk: avoid fd0 (Loic Dachary) +* ceph-disk: generalize path names, add tests (Loic Dachary) +* ceph-disk: misc improvements for puppet (Loic Dachary) +* ceph-disk: several bug fixes (Loic Dachary) +* ceph-fuse: fix race for sync reads (Sage Weil) +* ceph-fuse, libcephfs: fix several caching bugs (Yan, Zheng) +* ceph-fuse: trim inodes in response to mds memory pressure (Yan, Zheng) +* ceph-kvstore-tool: expanded command set and capabilities (Joao Eduardo Luis) +* ceph.spec: fix build dependency (Loic Dachary) +* common: bloom filter improvements (Sage Weil) +* common: check preexisting admin socket for active daemon before removing (Loic Dachary) +* common: fix aligned buffer allocation (Loic Dachary) +* common: fix authentication on big-endian architectures (Dan Mick) +* common: fix config variable substitution (Loic Dachary) +* common: portability changes to support libc++ (Noah Watkins) +* common: switch to unordered_map from hash_map (Noah Watkins) +* config: recursive metavariable expansion (Loic Dachary) +* crush: default to bobtail tunables (Sage Weil) +* crush: fix off-by-one error in recent refactor (Sage Weil) +* crush: many additional tests (Loic Dachary) +* crush: misc fixes, cleanups (Loic Dachary) +* crush: new rule steps to adjust retry attempts (Sage Weil) +* crush, osd: s/rep/replicated/ for less confusion (Loic Dachary) +* crush: refactor descend_once behavior; support set_choose*_tries for replicated rules (Sage Weil) +* crush: usability and test improvements (Loic Dachary) +* debian: change directory ownership between ceph and ceph-common (Sage Weil) +* debian: integrate misc fixes from downstream packaging (James Page) +* doc: big update to install docs (John Wilkins) +* doc: many many install doc improvements (John Wilkins) +* doc: many many updates (John Wilkins) +* doc: misc fixes (David Moreau Simard, Kun Huang) +* erasure-code: improve buffer alignment (Loic Dachary) +* erasure-code: rewrite region-xor using vector operations (Andreas Peters) +* init: fix startup ordering/timeout problem with OSDs (Dmitry Smirnov) +* libcephfs: fix resource leak (Zheng Yan) +* librados: add C API coverage for atomic write operations (Christian Marie) +* librados: fix inconsistencies in API error values (David Zafman) +* librados: fix throttle leak (and eventual deadlock) (Josh Durgin) +* librados: fix watch operations with cache pools (Sage Weil) +* librados: new snap rollback operation (David Zafman) +* librados, osd: new TMAP2OMAP operation (Yan, Zheng) +* librados: read directly into user buffer (Rutger ter Borg) +* librbd: fix use-after-free aio completion bug #5426 (Josh Durgin) +* librbd: localize/distribute parent reads (Sage Weil) +* librbd: skip zeroes/holes when copying sparse images (Josh Durgin) +* mailmap: affiliation updates (Loic Dachary) +* mailmap updates (Loic Dachary) +* many portability improvements (Noah Watkins) +* many unit test improvements (Loic Dachary) +* mds: always store backtrace in default pool (Yan, Zheng) +* mds: cope with MDS failure during creation (John Spray) +* mds: fix cap migration behavior (Yan, Zheng) +* mds: fix client session flushing (Yan, Zheng) +* mds: fix crash from client sleep/resume (Zheng Yan) +* mds: fix many many multi-mds bugs (Yan, Zheng) +* mds: fix readdir end check (Zheng Yan) +* mds: fix Resetter locking (Alexandre Oliva) +* mds: fix respawn (John Spray) +* mds: inline data support (Li Wang, Yunchuan Wen) +* mds: misc bugs (Yan, Zheng) +* mds: misc fixes for directory fragments (Zheng Yan) +* mds: misc fixes for larger directories (Zheng Yan) +* mds: misc fixes for multiple MDSs (Zheng Yan) +* mds: misc multi-mds fixes (Yan, Zheng) +* mds: remove .ceph directory (John Spray) +* mds: store directories in omap instead of tmap (Yan, Zheng) +* mds: update old-format backtraces opportunistically (Zheng Yan) +* mds: use shared_ptr for requests (Greg Farnum) +* misc cleanups from coverity (Xing Lin) +* misc coverity fixes, cleanups (Danny Al-Gaaf) +* misc coverity fixes (Xing Lin, Li Wang, Danny Al-Gaaf) +* misc portability fixes (Noah Watkins, Alan Somers) +* misc portability fixes (Noah Watkins, Christophe Courtaut, Alan Somers, huanjun) +* misc portability work (Noah Watkins) +* mon: add erasure profiles and improve erasure pool creation (Loic Dachary) +* mon: add 'mon getmap EPOCH' (Joao Eduardo Luis) +* mon: allow adjustment of cephfs max file size via 'ceph mds set max_file_size' (Sage Weil) +* mon: allow debug quorum_{enter,exit} commands via admin socket +* mon: 'ceph osd pg-temp ...' and primary-temp commands (Ilya Dryomov) +* mon: change mds allow_new_snaps syntax to be more consistent (Sage Weil) +* mon: clean up initial crush rule creation (Loic Dachary) +* mon: collect misc metadata about osd (os, kernel, etc.), new 'osd metadata' command (Sage Weil) +* mon: do not create erasure rules by default (Sage Weil) +* mon: do not generate spurious MDSMaps in certain cases (Sage Weil) +* mon: do not use keyring if auth = none (Loic Dachary) +* mon: fix peer feature checks (Sage Weil) +* mon: fix pg_temp leaks (Joao Eduardo Luis) +* mon: fix pool count in 'ceph -s' output (Sage Weil) +* mon: handle more whitespace (newline, tab) in mon capabilities (Sage Weil) +* mon: improve (replicate or erasure) pool creation UX (Loic Dachary) +* mon: infrastructure to handle mixed-version mon cluster and cli/rest API (Greg Farnum) +* mon: MForward tests (Loic Dachary) +* mon: mkfs now idempotent (Loic Dachary) +* mon: only seed new osdmaps to current OSDs (Sage Weil) +* mon, osd: create erasure style crush rules (Loic Dachary, Sage Weil) +* mon: 'osd crush show-tunables' (Sage Weil) +* mon: 'osd dump' dumps pool snaps as array, not object (Dan Mick) +* mon, osd: new 'erasure' pool type (still not fully supported) +* mon: persist quorum features to disk (Greg Farnum) +* mon: prevent extreme changes in pool pg_num (Greg Farnum) +* mon: require 'x' mon caps for auth operations (Joao Luis) +* mon: shutdown when removed from mon cluster (Joao Luis) +* mon: take 'osd pool set ...' value as an int, not string (Joao Eduardo Luis) +* mon: track osd features in OSDMap (Joao Luis, David Zafman) +* mon: trim MDSMaps (Joao Eduardo Luis) +* mon: warn if crush has non-optimal tunables (Sage Weil) +* mount.ceph: add -n for autofs support (Steve Stock) +* msgr: fix locking bug in authentication (Josh Durgin) +* msgr: fix messenger restart race (Xihui He) +* msgr: improve connection error detection between clients and monitors (Greg Farnum, Sage Weil) +* osd: add/fix CPU feature detection for jerasure (Loic Dachary) +* osd: add HitSet tracking for read ops (Sage Weil, Greg Farnum) +* osd: avoid touching leveldb for some xattrs (Haomai Wang, Sage Weil) +* osd: backfill to multiple targets (David Zafman) +* osd: backfill to osds not in acting set (David Zafman) +* osd: cache pool support for snapshots (Sage Weil) +* osd: client IO path changes for EC (Samuel Just) +* osd: default to 3x replication +* osd: do not include backfill targets in acting set (David Zafman) +* osd: enable new hashpspool layout by default (Sage Weil) +* osd: erasure plugin benchmarking tool (Loic Dachary) +* osd: fix and cleanup misc backfill issues (David Zafman) +* osd: fix bug in journal replay/restart (Sage Weil) +* osd: fix copy-get omap bug (Sage Weil) +* osd: fix linux kernel version detection (Ilya Dryomov) +* osd: fix memstore segv (Haomai Wang) +* osd: fix object_info_t encoding bug from emperor (Sam Just) +* osd: fix omap_clear operation to not zap xattrs (Sam Just, Yan, Zheng) +* osd: fix several bugs with tier infrastructure +* osd: fix throttle thread (Haomai Wang) +* osd: fix XFS detection (Greg Farnum, Sushma Gurram) +* osd: generalize scrubbing infrastructure to allow EC (David Zafman) +* osd: handle more whitespace (newline, tab) in osd capabilities (Sage Weil) +* osd: ignore num_objects_dirty on scrub for old pools (Sage Weil) +* osd: improved scrub checks on clones (Sage Weil, Sam Just) +* osd: improve locking in fd lookup cache (Samuel Just, Greg Farnum) +* osd: include more info in pg query result (Sage Weil) +* osd, librados: fix full cluster handling (Josh Durgin) +* osd: many erasure fixes (Sam Just) +* osd: many many many bug fixes with cache tiering (Samuel Just) +* osd: move to jerasure2 library (Loic Dachary) +* osd: new 'chassis' type in default crush hierarchy (Sage Weil) +* osd: new keyvaluestore-dev backend based on leveldb (Haomai Wang) +* osd: new OSDMap encoding (Greg Farnum) +* osd: new tests for erasure pools (David Zafman) +* osd: preliminary cache pool support (no snaps) (Greg Farnum, Sage Weil) +* osd: reduce scrub lock contention (Guang Yang) +* osd: requery unfound on stray notify (#6909) (Samuel Just) +* osd: some PGBackend infrastructure (Samuel Just) +* osd: support for new 'memstore' (memory-backed) backend (Sage Weil) +* osd: track erasure compatibility (David Zafman) +* osd: track omap and hit_set objects in pg stats (Samuel Just) +* osd: warn if agent cannot enable due to invalid (post-split) stats (Sage Weil) +* rados: add 'crush location', smart replica selection/balancing (Sage Weil) +* rados bench: track metadata for multiple runs separately (Guang Yang) +* rados: some performance optimizations (Yehuda Sadeh) +* rados tool: fix listomapvals (Josh Durgin) +* rbd: add 'rbdmap' init script for mapping rbd images on book (Adam Twardowski) +* rbd: add rbdmap support for upstart (Laurent Barbe) +* rbd: expose kernel rbd client options via 'rbd map' (Ilya Dryomov) +* rbd: fix bench-write command (Hoamai Wang) +* rbd: make 'rbd list' return empty list and success on empty pool (Josh Durgin) +* rbd: prevent deletion of images with watchers (Ilya Dryomov) +* rbd: support for 4096 mapped devices, up from ~250 (Ilya Dryomov) +* rest-api: do not fail when no OSDs yet exist (Dan Mick) +* rgw: add 'status' command to sysvinit script (David Moreau Simard) +* rgw: allow multiple frontends (Yehuda Sadeh) +* rgw: allow use of an erasure data pool (Yehuda Sadeh) +* rgw: convert bucket info to new format on demand (Yehuda Sadeh) +* rgw: fixed subuser modify (Yehuda Sadeh) +* rgw: fix error setting empty owner on ACLs (Yehuda Sadeh) +* rgw: fix fastcgi deadlock (do not return data from librados callback) (Yehuda Sadeh) +* rgw: fix many-part multipart uploads (Yehuda Sadeh) +* rgw: fix misc CORS bugs (Robin H. Johnson) +* rgw: fix object placement read op (Yehuda Sadeh) +* rgw: fix reading bucket policy (#6940) +* rgw: fix read_user_buckets 'max' behavior (Yehuda Sadeh) +* rgw: fix several CORS bugs (Robin H. Johnson) +* rgw: fix use-after-free when releasing completion handle (Yehuda Sadeh) +* rgw: improve swift temp URL support (Yehuda Sadeh) +* rgw: make multi-object delete idempotent (Yehuda Sadeh) +* rgw: optionally defer to bucket ACLs instead of object ACLs (Liam Monahan) +* rgw: prototype mongoose frontend (Yehuda Sadeh) +* rgw: several doc fixes (Alexandre Marangone) +* rgw: support for password (instead of admin token) for keystone authentication (Christophe Courtaut) +* rgw: switch from mongoose to civetweb (Yehuda Sadeh) +* rgw: user quotas (Yehuda Sadeh) +* rpm: fix redhat-lsb dependency (Sage Weil, Alfredo Deza) +* specfile: fix RPM build on RHEL6 (Ken Dreyer, Derek Yarnell) +* specfile: ship libdir/ceph (Key Dreyer) +* sysvinit, upstart: prevent both init systems from starting the same daemons (Josh Durgin) + + +Notable changes since v0.67 Dumpling +------------------------------------ + +* build cleanly under clang (Christophe Courtaut) +* build: Makefile refactor (Roald J. van Loon) +* build: fix [/usr]/sbin locations (Alan Somers) +* ceph-disk: fix journal preallocation +* ceph-fuse, radosgw: enable admin socket and logging by default +* ceph-fuse: fix problem with readahead vs truncate race (Yan, Zheng) +* ceph-fuse: trim deleted inodes from cache (Yan, Zheng) +* ceph-fuse: use newer fuse api (Jianpeng Ma) +* ceph-kvstore-tool: new tool for working with leveldb (copy, crc) (Joao Luis) +* ceph-post-file: new command to easily share logs or other files with ceph devs +* ceph: improve parsing of CEPH_ARGS (Benoit Knecht) +* ceph: make -h behave when monitors are down +* ceph: parse CEPH_ARGS env variable +* common: bloom_filter improvements, cleanups +* common: cache crc32c values where possible +* common: correct SI is kB not KB (Dan Mick) +* common: fix looping on BSD (Alan Somers) +* common: migrate SharedPtrRegistry to use boost::shared_ptr<> (Loic Dachary) +* common: misc portability fixes (Noah Watkins) +* crc32c: fix optimized crc32c code (it now detects arch support properly) +* crc32c: improved intel-optimized crc32c support (~8x faster on my laptop!) +* crush: fix name caching +* doc: erasure coding design notes (Loic Dachary) +* hadoop: removed old version of shim to avoid confusing users (Noah Watkins) +* librados, mon: ability to query/ping out-of-quorum monitor status (Joao Luis) +* librados: fix async aio completion wakeup +* librados: fix installed header #includes (Dan Mick) +* librados: get_version64() method for C++ API +* librados: hello_world example (Greg Farnum) +* librados: sync calls now return on commit (instead of ack) (Greg Farnum) +* librbd python bindings: fix parent image name limit (Josh Durgin) +* librbd, ceph-fuse: avoid some sources of ceph-fuse, rbd cache stalls +* mds: avoid leaking objects when deleting truncated files (Yan, Zheng) +* mds: fix F_GETLK (Yan, Zheng) +* mds: fix LOOKUPSNAP bug +* mds: fix heap profiler commands (Joao Luis) +* mds: fix locking deadlock (David Disseldorp) +* mds: fix many bugs with stray (unlinked) inodes (Yan, Zheng) +* mds: fix many directory fragmentation bugs (Yan, Zheng) +* mds: fix mds rejoin with legacy parent backpointer xattrs (Alexandre Oliva) +* mds: fix rare restart/failure race during fs creation +* mds: fix standby-replay when we fall behind (Yan, Zheng) +* mds: fix stray directory purging (Yan, Zheng) +* mds: notify clients about deleted files (so they can release from their cache) (Yan, Zheng) +* mds: several bug fixes with clustered mds (Yan, Zheng) +* mon, osd: improve osdmap trimming logic (Samuel Just) +* mon, osd: initial CLI for configuring tiering +* mon: a few 'ceph mon add' races fixed (command is now idempotent) (Joao Luis) +* mon: allow (un)setting HASHPSPOOL flag on existing pools (Joao Luis) +* mon: allow cap strings with . to be unquoted +* mon: allow logging level of cluster log (/var/log/ceph/ceph.log) to be adjusted +* mon: avoid rewriting full osdmaps on restart (Joao Luis) +* mon: continue to discover peer addr info during election phase +* mon: disallow CephFS snapshots until 'ceph mds set allow_new_snaps' (Greg Farnum) +* mon: do not expose uncommitted state from 'osd crush {add,set} ...' (Joao Luis) +* mon: fix 'ceph osd crush reweight ...' (Joao Luis) +* mon: fix 'osd crush move ...' command for buckets (Joao Luis) +* mon: fix byte counts (off by factor of 4) (Dan Mick, Joao Luis) +* mon: fix paxos corner case +* mon: kv properties for pools to support EC (Loic Dachary) +* mon: make 'osd pool rename' idempotent (Joao Luis) +* mon: modify 'auth add' semantics to make a bit more sense (Joao Luis) +* mon: new 'osd perf' command to dump recent performance information (Samuel Just) +* mon: new and improved 'ceph -s' or 'ceph status' command (more info, easier to read) +* mon: some auth check cleanups (Joao Luis) +* mon: track per-pool stats (Joao Luis) +* mon: warn about pools with bad pg_num +* mon: warn when mon data stores grow very large (Joao Luis) +* monc: fix small memory leak +* new wireshark patches pulled into the tree (Kevin Jones) +* objecter, librados: redirect requests based on cache tier config +* objecter: fix possible hang when cluster is unpaused (Josh Durgin) +* osd, librados: add new COPY_FROM rados operation +* osd, librados: add new COPY_GET rados operations (used by COPY_FROM) +* osd: 'osd recover clone overlap limit' option to limit cloning during recovery (Samuel Just) +* osd: COPY_GET on-wire encoding improvements (Greg Farnum) +* osd: add 'osd heartbeat min healthy ratio' configurable (was hard-coded at 33%) +* osd: add option to disable pg log debug code (which burns CPU) +* osd: allow cap strings with . to be unquoted +* osd: automatically detect proper xattr limits (David Zafman) +* osd: avoid extra copy in erasure coding reference implementation (Loic Dachary) +* osd: basic cache pool redirects (Greg Farnum) +* osd: basic whiteout, dirty flag support (not yet used) +* osd: bloom_filter encodability, fixes, cleanups (Loic Dachary, Sage Weil) +* osd: clean up and generalize copy-from code (Greg Farnum) +* osd: cls_hello OSD class example +* osd: erasure coding doc updates (Loic Dachary) +* osd: erasure coding plugin infrastructure, tests (Loic Dachary) +* osd: experiemental support for ZFS (zfsonlinux.org) (Yan, Zheng) +* osd: fix RWORDER flags +* osd: fix exponential backoff of slow request warnings (Loic Dachary) +* osd: fix handling of racing read vs write (Samuel Just) +* osd: fix version value returned by various operations (Greg Farnum) +* osd: generalized temp object infrastructure +* osd: ghobject_t infrastructure for EC (David Zafman) +* osd: improvements for compatset support and storage (David Zafman) +* osd: infrastructure to copy objects from other OSDs +* osd: instrument peering states (David Zafman) +* osd: misc copy-from improvements +* osd: opportunistic crc checking on stored data (off by default) +* osd: properly enforce RD/WR flags for rados classes +* osd: reduce blocking on backing fs (Samuel Just) +* osd: refactor recovery using PGBackend (Samuel Just) +* osd: remove old magical tmap->omap conversion +* osd: remove old pg log on upgrade (Samuel Just) +* osd: revert xattr size limit (fixes large rgw uploads) +* osd: use fdatasync(2) instead of fsync(2) to improve performance (Sam Just) +* pybind: fix blacklisting nonce (Loic Dachary) +* radosgw-agent: multi-region replication/DR +* rgw: complete in-progress requests before shutting down +* rgw: default log level is now more reasonable (Yehuda Sadeh) +* rgw: fix S3 auth with response-* query string params (Sylvain Munaut, Yehuda Sadeh) +* rgw: fix a few minor memory leaks (Yehuda Sadeh) +* rgw: fix acl group check (Yehuda Sadeh) +* rgw: fix inefficient use of std::list::size() (Yehuda Sadeh) +* rgw: fix major CPU utilization bug with internal caching (Yehuda Sadeh, Mark Nelson) +* rgw: fix ordering of write operations (preventing data loss on crash) (Yehuda Sadeh) +* rgw: fix ordering of writes for mulitpart upload (Yehuda Sadeh) +* rgw: fix various CORS bugs (Yehuda Sadeh) +* rgw: fix/improve swift COPY support (Yehuda Sadeh) +* rgw: improve help output (Christophe Courtaut) +* rgw: misc fixes to support DR (Josh Durgin, Yehuda Sadeh) +* rgw: per-bucket quota (Yehuda Sadeh) +* rgw: validate S3 tokens against keystone (Roald J. van Loon) +* rgw: wildcard support for keystone roles (Christophe Courtaut) +* rpm: fix junit dependencies (Alan Grosskurth) +* sysvinit radosgw: fix status return code (Danny Al-Gaaf) +* sysvinit rbdmap: fix error 'service rbdmap stop' (Laurent Barbe) +* sysvinit: add condrestart command (Dan van der Ster) +* sysvinit: fix shutdown order (mons last) (Alfredo Deza) + + +v0.79 +===== + +This release is intended to serve as a release candidate for firefly, +which will hopefully be v0.80. No changes are being made to the code +base at this point except those that fix bugs. Please test this +release if you intend to make use of the new erasure-coded pools or +cache tiers in firefly. + +This release fixes a range of bugs found in v0.78 and streamlines the +user experience when creating erasure-coded pools. There is also a +raft of fixes for the MDS (multi-mds, directory fragmentation, and +large directories). The main notable new piece of functionality is a +small change to allow radosgw to use an erasure-coded pool for object +data. + + +Upgrading +--------- +* Erasure pools created with v0.78 will no longer function with v0.79. You + will need to delete the old pool and create a new one. + +* A bug was fixed in the authentication handshake with big-endian + architectures that prevent authentication between big- and + little-endian machines in the same cluster. If you have a cluster + that consists entirely of big-endian machines, you will need to + upgrade all daemons and clients and restart. + +* The 'ceph.file.layout' and 'ceph.dir.layout' extended attributes are + no longer included in the listxattr(2) results to prevent problems with + 'cp -a' and similar tools. + +* Monitor 'auth' read-only commands now expect the user to have 'rx' caps. + This is the same behavior that was present in dumpling, but in emperor + and more recent development releases the 'r' cap was sufficient. The + affected commands are:: + + ceph auth export + ceph auth get + ceph auth get-key + ceph auth print-key + ceph auth list + +Notable Changes +--------------- +* ceph-conf: stop creating bogus log files (Josh Durgin, Sage Weil) +* common: fix authentication on big-endian architectures (Dan Mick) +* debian: change directory ownership between ceph and ceph-common (Sage Weil) +* init: fix startup ordering/timeout problem with OSDs (Dmitry Smirnov) +* librbd: skip zeroes/holes when copying sparse images (Josh Durgin) +* mds: cope with MDS failure during creation (John Spray) +* mds: fix crash from client sleep/resume (Zheng Yan) +* mds: misc fixes for directory fragments (Zheng Yan) +* mds: misc fixes for larger directories (Zheng Yan) +* mds: misc fixes for multiple MDSs (Zheng Yan) +* mds: remove .ceph directory (John Spray) +* misc coverity fixes, cleanups (Danny Al-Gaaf) +* mon: add erasure profiles and improve erasure pool creation (Loic Dachary) +* mon: 'ceph osd pg-temp ...' and primary-temp commands (Ilya Dryomov) +* mon: fix pool count in 'ceph -s' output (Sage Weil) +* msgr: improve connection error detection between clients and monitors (Greg Farnum, Sage Weil) +* osd: add/fix CPU feature detection for jerasure (Loic Dachary) +* osd: improved scrub checks on clones (Sage Weil, Sam Just) +* osd: many erasure fixes (Sam Just) +* osd: move to jerasure2 library (Loic Dachary) +* osd: new tests for erasure pools (David Zafman) +* osd: reduce scrub lock contention (Guang Yang) +* rgw: allow use of an erasure data pool (Yehuda Sadeh) + + +v0.78 +===== + +This development release includes two key features: erasure coding and +cache tiering. A huge amount of code was merged for this release and +several additional weeks were spent stabilizing the code base, and it +is now in a state where it is ready to be tested by a broader user +base. + +This is *not* the firefly release. Firefly will be delayed for at +least another sprint so that we can get some operational experience +with the new code and do some additional testing before committing to +long term support. + +.. note:: Please note that while it is possible to create and test + erasure coded pools in this release, the pools will not be + usable when you upgrade to v0.79 as the OSDMap encoding will + subtlely change. Please do not populate your test pools + with important data that can't be reloaded. + +Upgrading +--------- + +* Upgrade daemons in the following order: + + #. Monitors + #. OSDs + #. MDSs and/or radosgw + + If the ceph-mds daemon is restarted first, it will wait until all + OSDs have been upgraded before finishing its startup sequence. If + the ceph-mon daemons are not restarted prior to the ceph-osd + daemons, they will not correctly register their new capabilities + with the cluster and new features may not be usable until they are + restarted a second time. + +* Upgrade radosgw daemons together. There is a subtle change in behavior + for multipart uploads that prevents a multipart request that was initiated + with a new radosgw from being completed by an old radosgw. + +* CephFS recently added support for a new 'backtrace' attribute on + file data objects that is used for lookup by inode number (i.e., NFS + reexport and hard links), and will later be used by fsck repair. + This replaces the existing anchor table mechanism that is used for + hard link resolution. In order to completely phase that out, any + inode that has an outdated backtrace attribute will get updated when + the inode itself is modified. This will result in some extra workload + after a legacy CephFS file system is upgraded. + +* The per-op return code in librados' ObjectWriteOperation interface + is now filled in. + +* The librados cmpxattr operation now handles xattrs containing null bytes as + data rather than null-terminated strings. + +* Compound operations in librados that create and then delete the same object + are now explicitly disallowed (they fail with -EINVAL). + +* The default leveldb cache size for the ceph-osd daemon has been + increased from 4 MB to 128 MB. This will increase the memory + footprint of that process but tends to increase performance of omap + (key/value) objects (used for CephFS and the radosgw). If memory in your + deployment is tight, you can preserve the old behavio by adding:: + + leveldb write buffer size = 0 + leveldb cache size = 0 + + to your ceph.conf to get back the (leveldb) defaults. + +Notable Changes +--------------- +* ceph-brag: new client and server tools (Sebastien Han, Babu Shanmugam) +* ceph-disk: use partx on RHEL or CentOS instead of partprobe (Alfredo Deza) +* ceph: fix combination of 'tell' and interactive mode (Joao Eduardo Luis) +* ceph-fuse: fix bugs with inline data and multiple MDSs (Zheng Yan) +* client: fix getcwd() to use new LOOKUPPARENT operation (Zheng Yan) +* common: fall back to json-pretty for admin socket (Loic Dachary) +* common: fix 'config dump' debug prefix (Danny Al-Gaaf) +* common: misc coverity fixes (Danny Al-Gaaf) +* common: throtller, shared_cache performance improvements, TrackedOp (Greg Farnum, Samuel Just) +* crush: fix JSON schema for dump (John Spray) +* crush: misc cleanups, tests (Loic Dachary) +* crush: new vary_r tunable (Sage Weil) +* crush: prevent invalid buckets of type 0 (Sage Weil) +* keyvaluestore: add perfcounters, misc bug fixes (Haomai Wang) +* keyvaluestore: portability improvements (Noah Watkins) +* libcephfs: API changes to better support NFS reexport via Ganesha (Matt Benjamin, Adam Emerson, Andrey Kuznetsov, Casey Bodley, David Zafman) +* librados: API documentation improvements (John Wilkins, Josh Durgin) +* librados: fix object enumeration bugs; allow iterator assignment (Josh Durgin) +* librados: streamline tests (Josh Durgin) +* librados: support for atomic read and omap operations for C API (Josh Durgin) +* librados: support for osd and mon command timeouts (Josh Durgin) +* librbd: pass allocation hints to OSD (Ilya Dryomov) +* logrotate: fix bug that prevented rotation for some daemons (Loic Dachary) +* mds: avoid duplicated discovers during recovery (Zheng Yan) +* mds: fix file lock owner checks (Zheng Yan) +* mds: fix LOOKUPPARENT, new LOOKUPNAME ops for reliable NFS reexport (Zheng Yan) +* mds: fix xattr handling on setxattr (Zheng Yan) +* mds: fix xattrs in getattr replies (Sage Weil) +* mds: force backtrace updates for old inodes on update (Zheng Yan) +* mds: several multi-mds and dirfrag bug fixes (Zheng Yan) +* mon: encode erasure stripe width in pool metadata (Loic Dachary) +* mon: erasure code crush rule creation (Loic Dachary) +* mon: erasure code plugin support (Loic Dachary) +* mon: fix bugs in initial post-mkfs quorum creation (Sage Weil) +* mon: fix error output to terminal during startup (Joao Eduardo Luis) +* mon: fix legacy CRUSH tunables warning (Sage Weil) +* mon: fix osd_epochs lower bound tracking for map trimming (Sage Weil) +* mon: fix OSDMap encoding features (Sage Weil, Aaron Ten Clay) +* mon: fix 'pg dump' JSON output (John Spray) +* mon: include dirty stats in 'ceph df detail' (Sage Weil) +* mon: list quorum member names in quorum order (Sage Weil) +* mon: prevent addition of non-empty cache tier (Sage Weil) +* mon: prevent deletion of CephFS pools (John Spray) +* mon: warn when cache tier approaches 'full' (Sage Weil) +* osd: allocation hint, with XFS support (Ilya Dryomov) +* osd: erasure coded pool support (Samuel Just) +* osd: fix bug causing slow/stalled recovery (#7706) (Samuel Just) +* osd: fix bugs in log merging (Samuel Just) +* osd: fix/clarify end-of-object handling on read (Loic Dachary) +* osd: fix impolite mon session backoff, reconnect behavior (Greg Farnum) +* osd: fix SnapContext cache id bug (Samuel Just) +* osd: increase default leveldb cache size and write buffer (Sage Weil, Dmitry Smirnov) +* osd: limit size of 'osd bench ...' arguments (Joao Eduardo Luis) +* osdmaptool: new --test-map-pgs mode (Sage Weil, Ilya Dryomov) +* osd, mon: add primary-affinity to adjust selection of primaries (Sage Weil) +* osd: new 'status' admin socket command (Sage Weil) +* osd: simple tiering agent (Sage Weil) +* osd: store checksums for erasure coded object stripes (Samuel Just) +* osd: tests for objectstore backends (Haomai Wang) +* osd: various refactoring and bug fixes (Samuel Just, David Zafman) +* rados: add 'set-alloc-hint' command (Ilya Dryomov) +* rbd-fuse: fix enumerate_images overflow, memory leak (Ilya Dryomov) +* rbdmap: fix upstart script (Stephan Renatus) +* rgw: avoid logging system events to usage log (Yehuda Sadeh) +* rgw: fix Swift range reponse (Yehuda Sadeh) +* rgw: improve scalability for manifest objects (Yehuda Sadeh) +* rgw: misc fixes for multipart objects, policies (Yehuda Sadeh) +* rgw: support non-standard MultipartUpload command (Yehuda Sadeh) + + + +v0.77 +===== + +This is the final development release before the Firefly feature +freeze. The main items in this release include some additional +refactoring work in the OSD IO path (include some locking +improvements), per-user quotas for the radosgw, a switch to civetweb +from mongoose for the prototype radosgw standalone mode, and a +prototype leveldb-based backend for the OSD. The C librados API also +got support for atomic write operations (read side transactions will +appear in v0.78). + +Upgrading +--------- + +* The 'ceph -s' or 'ceph status' command's 'num_in_osds' field in the + JSON and XML output has been changed from a string to an int. + +* The recently added 'ceph mds set allow_new_snaps' command's syntax + has changed slightly; it is now 'ceph mds set allow_new_snaps true'. + The 'unset' command has been removed; instead, set the value to + 'false'. + +* The syntax for allowing snapshots is now 'mds set allow_new_snaps + <true|false>' instead of 'mds <set,unset> allow_new_snaps'. + +Notable Changes +--------------- + +* osd: client IO path changes for EC (Samuel Just) +* common: portability changes to support libc++ (Noah Watkins) +* common: switch to unordered_map from hash_map (Noah Watkins) +* rgw: switch from mongoose to civetweb (Yehuda Sadeh) +* osd: improve locking in fd lookup cache (Samuel Just, Greg Farnum) +* doc: many many updates (John Wilkins) +* rgw: user quotas (Yehuda Sadeh) +* mon: persist quorum features to disk (Greg Farnum) +* mon: MForward tests (Loic Dachary) +* mds: inline data support (Li Wang, Yunchuan Wen) +* rgw: fix many-part multipart uploads (Yehuda Sadeh) +* osd: new keyvaluestore-dev backend based on leveldb (Haomai Wang) +* rbd: prevent deletion of images with watchers (Ilya Dryomov) +* osd: avoid touching leveldb for some xattrs (Haomai Wang, Sage Weil) +* mailmap: affiliation updates (Loic Dachary) +* osd: new OSDMap encoding (Greg Farnum) +* osd: generalize scrubbing infrastructure to allow EC (David Zafman) +* rgw: several doc fixes (Alexandre Marangone) +* librados: add C API coverage for atomic write operations (Christian Marie) +* rgw: improve swift temp URL support (Yehuda Sadeh) +* rest-api: do not fail when no OSDs yet exist (Dan Mick) +* common: check preexisting admin socket for active daemon before removing (Loic Dachary) +* osd: handle more whitespace (newline, tab) in osd capabilities (Sage Weil) +* mon: handle more whitespace (newline, tab) in mon capabilities (Sage Weil) +* rgw: make multi-object delete idempotent (Yehuda Sadeh) +* crush: fix off-by-one error in recent refactor (Sage Weil) +* rgw: fix read_user_buckets 'max' behavior (Yehuda Sadeh) +* mon: change mds allow_new_snaps syntax to be more consistent (Sage Weil) + + +v0.76 +===== + +This release includes another batch of updates for firefly +functionality. Most notably, the cache pool infrastructure now +support snapshots, the OSD backfill functionality has been generalized +to include multiple targets (necessary for the coming erasure pools), +and there were performance improvements to the erasure code plugin on +capable processors. The MDS now properly utilizes (and seamlessly +migrates to) the OSD key/value interface (aka omap) for storing directory +objects. There continue to be many other fixes and improvements for +usability and code portability across the tree. + +Upgrading +--------- + +* 'rbd ls' on a pool which never held rbd images now exits with code + 0. It outputs nothing in plain format, or an empty list in + non-plain format. This is consistent with the behavior for a pool + which used to hold images, but contains none. Scripts relying on + this behavior should be updated. + +* The MDS requires a new OSD operation TMAP2OMAP, added in this release. When + upgrading, be sure to upgrade and restart the ceph-osd daemons before the + ceph-mds daemon. The MDS will refuse to start if any up OSDs do not support + the new feature. + +* The 'ceph mds set_max_mds N' command is now deprecated in favor of + 'ceph mds set max_mds N'. + +Notable Changes +--------------- + +* build: misc improvements (Ken Dreyer) +* ceph-disk: generalize path names, add tests (Loic Dachary) +* ceph-disk: misc improvements for puppet (Loic Dachary) +* ceph-disk: several bug fixes (Loic Dachary) +* ceph-fuse: fix race for sync reads (Sage Weil) +* config: recursive metavariable expansion (Loic Dachary) +* crush: usability and test improvements (Loic Dachary) +* doc: misc fixes (David Moreau Simard, Kun Huang) +* erasure-code: improve buffer alignment (Loic Dachary) +* erasure-code: rewrite region-xor using vector operations (Andreas Peters) +* librados, osd: new TMAP2OMAP operation (Yan, Zheng) +* mailmap updates (Loic Dachary) +* many portability improvements (Noah Watkins) +* many unit test improvements (Loic Dachary) +* mds: always store backtrace in default pool (Yan, Zheng) +* mds: store directories in omap instead of tmap (Yan, Zheng) +* mon: allow adjustment of cephfs max file size via 'ceph mds set max_file_size' (Sage Weil) +* mon: do not create erasure rules by default (Sage Weil) +* mon: do not generate spurious MDSMaps in certain cases (Sage Weil) +* mon: do not use keyring if auth = none (Loic Dachary) +* mon: fix pg_temp leaks (Joao Eduardo Luis) +* osd: backfill to multiple targets (David Zafman) +* osd: cache pool support for snapshots (Sage Weil) +* osd: fix and cleanup misc backfill issues (David Zafman) +* osd: fix omap_clear operation to not zap xattrs (Sam Just, Yan, Zheng) +* osd: ignore num_objects_dirty on scrub for old pools (Sage Weil) +* osd: include more info in pg query result (Sage Weil) +* osd: track erasure compatibility (David Zafman) +* rbd: make 'rbd list' return empty list and success on empty pool (Josh Durgin) +* rgw: fix object placement read op (Yehuda Sadeh) +* rgw: fix several CORS bugs (Robin H. Johnson) +* specfile: fix RPM build on RHEL6 (Ken Dreyer, Derek Yarnell) +* specfile: ship libdir/ceph (Key Dreyer) + + +v0.75 +===== + +This is a big release, with lots of infrastructure going in for +firefly. The big items include a prototype standalone frontend for +radosgw (which does not require apache or fastcgi), tracking for read +activity on the osds (to inform tiering decisions), preliminary cache +pool support (no snapshots yet), and lots of bug fixes and other work +across the tree to get ready for the next batch of erasure coding +patches. + +For comparison, here are the diff stats for the last few versions:: + + v0.75 291 files changed, 82713 insertions(+), 33495 deletions(-) + v0.74 192 files changed, 17980 insertions(+), 1062 deletions(-) + v0.73 148 files changed, 4464 insertions(+), 2129 deletions(-) + +Upgrading +--------- + +- The 'osd pool create ...' syntax has changed for erasure pools. + +- The default CRUSH rules and layouts are now using the latest and + greatest tunables and defaults. Clusters using the old values will + now present with a health WARN state. This can be disabled by + adding 'mon warn on legacy crush tunables = false' to ceph.conf. + + +Notable Changes +--------------- + +* common: bloom filter improvements (Sage Weil) +* common: fix config variable substitution (Loic Dachary) +* crush, osd: s/rep/replicated/ for less confusion (Loic Dachary) +* crush: refactor descend_once behavior; support set_choose*_tries for replicated rules (Sage Weil) +* librados: fix throttle leak (and eventual deadlock) (Josh Durgin) +* librados: read directly into user buffer (Rutger ter Borg) +* librbd: fix use-after-free aio completion bug #5426 (Josh Durgin) +* librbd: localize/distribute parent reads (Sage Weil) +* mds: fix Resetter locking (Alexandre Oliva) +* mds: fix cap migration behavior (Yan, Zheng) +* mds: fix client session flushing (Yan, Zheng) +* mds: fix many many multi-mds bugs (Yan, Zheng) +* misc portability work (Noah Watkins) +* mon, osd: create erasure style crush rules (Loic Dachary, Sage Weil) +* mon: 'osd crush show-tunables' (Sage Weil) +* mon: clean up initial crush rule creation (Loic Dachary) +* mon: improve (replicate or erasure) pool creation UX (Loic Dachary) +* mon: infrastructure to handle mixed-version mon cluster and cli/rest API (Greg Farnum) +* mon: mkfs now idempotent (Loic Dachary) +* mon: only seed new osdmaps to current OSDs (Sage Weil) +* mon: track osd features in OSDMap (Joao Luis, David Zafman) +* mon: warn if crush has non-optimal tunables (Sage Weil) +* mount.ceph: add -n for autofs support (Steve Stock) +* msgr: fix messenger restart race (Xihui He) +* osd, librados: fix full cluster handling (Josh Durgin) +* osd: add HitSet tracking for read ops (Sage Weil, Greg Farnum) +* osd: backfill to osds not in acting set (David Zafman) +* osd: enable new hashpspool layout by default (Sage Weil) +* osd: erasure plugin benchmarking tool (Loic Dachary) +* osd: fix XFS detection (Greg Farnum, Sushma Gurram) +* osd: fix copy-get omap bug (Sage Weil) +* osd: fix linux kernel version detection (Ilya Dryomov) +* osd: fix memstore segv (Haomai Wang) +* osd: fix several bugs with tier infrastructure +* osd: fix throttle thread (Haomai Wang) +* osd: preliminary cache pool support (no snaps) (Greg Farnum, Sage Weil) +* rados tool: fix listomapvals (Josh Durgin) +* rados: add 'crush location', smart replica selection/balancing (Sage Weil) +* rados: some performance optimizations (Yehuda Sadeh) +* rbd: add rbdmap support for upstart (Laurent Barbe) +* rbd: expose kernel rbd client options via 'rbd map' (Ilya Dryomov) +* rbd: fix bench-write command (Hoamai Wang) +* rbd: support for 4096 mapped devices, up from ~250 (Ilya Dryomov) +* rgw: allow multiple frontends (Yehuda Sadeh) +* rgw: convert bucket info to new format on demand (Yehuda Sadeh) +* rgw: fix misc CORS bugs (Robin H. Johnson) +* rgw: prototype mongoose frontend (Yehuda Sadeh) + + + +v0.74 +===== + +This release includes a few substantial pieces for Firefly, including +a long-overdue switch to 3x replication by default and a switch to the +"new" CRUSH tunables by default (supported since bobtail). There is +also a fix for a long-standing radosgw bug (stalled GET) that has +already been backported to emperor and dumpling. + +Upgrading +--------- + +* We now default to the 'bobtail' CRUSH tunable values that are first supported + by Ceph clients in bobtail (v0.56) and Linux kernel version v3.9. If you + plan to access a newly created Ceph cluster with an older kernel client, you + should use 'ceph osd crush tunables legacy' to switch back to the legacy + behavior. Note that making that change will likely result in some data + movement in the system, so adjust the setting before populating the new + cluster with data. + +* We now set the HASHPSPOOL flag on newly created pools (and new + clusters) by default. Support for this flag first appeared in + v0.64; v0.67 Dumpling is the first major release that supports it. + It is first supported by the Linux kernel version v3.9. If you plan + to access a newly created Ceph cluster with an older kernel or + clients (e.g, librados, librbd) from a pre-dumpling Ceph release, + you should add 'osd pool default flag hashpspool = false' to the + '[global]' section of your 'ceph.conf' prior to creating your + monitors (e.g., after 'ceph-deploy new' but before 'ceph-deploy mon + create ...'). + +* The configuration option 'osd pool default crush rule' is deprecated + and replaced with 'osd pool default crush replicated ruleset'. 'osd + pool default crush rule' takes precedence for backward compatibility + and a deprecation warning is displayed when it is used. + +Notable Changes +--------------- + +* buffer: some zero-copy groundwork (Josh Durgin) +* ceph-disk: avoid fd0 (Loic Dachary) +* crush: default to bobtail tunables (Sage Weil) +* crush: many additional tests (Loic Dachary) +* crush: misc fixes, cleanups (Loic Dachary) +* crush: new rule steps to adjust retry attempts (Sage Weil) +* debian: integrate misc fixes from downstream packaging (James Page) +* doc: big update to install docs (John Wilkins) +* libcephfs: fix resource leak (Zheng Yan) +* misc coverity fixes (Xing Lin, Li Wang, Danny Al-Gaaf) +* misc portability fixes (Noah Watkins, Alan Somers) +* mon, osd: new 'erasure' pool type (still not fully supported) +* mon: add 'mon getmap EPOCH' (Joao Eduardo Luis) +* mon: collect misc metadata about osd (os, kernel, etc.), new 'osd metadata' command (Sage Weil) +* osd: default to 3x replication +* osd: do not include backfill targets in acting set (David Zafman) +* osd: new 'chassis' type in default crush hierarchy (Sage Weil) +* osd: requery unfound on stray notify (#6909) (Samuel Just) +* osd: some PGBackend infrastructure (Samuel Just) +* osd: support for new 'memstore' (memory-backed) backend (Sage Weil) +* rgw: fix fastcgi deadlock (do not return data from librados callback) (Yehuda Sadeh) +* rgw: fix reading bucket policy (#6940) +* rgw: fix use-after-free when releasing completion handle (Yehuda Sadeh) + + +v0.73 +===== + +This release, the first development release after emperor, includes +many bug fixes and a few additional pieces of functionality. The +first batch of larger changes will be landing in the next version, +v0.74. + +Upgrading +--------- + +- As part of fix for #6796, 'ceph osd pool set <pool> <var> <arg>' now + receives <arg> as an integer instead of a string. This affects how + 'hashpspool' flag is set/unset: instead of 'true' or 'false', it now + must be '0' or '1'. + +- The behavior of the CRUSH 'indep' choose mode has been changed. No + ceph cluster should have been using this behavior unless someone has + manually extracted a crush map, modified a CRUSH rule to replace + 'firstn' with 'indep', recompiled, and reinjected the new map into + the cluster. If the 'indep' mode is currently in use on a cluster, + the rule should be modified to use 'firstn' instead, and the + administrator should wait until any data movement completes before + upgrading. + +- The 'osd dump' command now dumps pool snaps as an array instead of an + object. + +- The radosgw init script (sysvinit) how requires that the 'host = ...' line in + ceph.conf, if present, match the short hostname (the output of 'hostname -s'), + not the fully qualified hostname or the (occasionally non-short) output of + 'hostname'. Failure to adjust this when upgrading from emperor or dumpling + may prevent the radosgw daemon from starting. + + +Notable Changes +--------------- + +* ceph-crush-location: new hook for setting CRUSH location of osd daemons on start +* ceph-kvstore-tool: expanded command set and capabilities (Joao Eduardo Luis) +* ceph.spec: fix build dependency (Loic Dachary) +* common: fix aligned buffer allocation (Loic Dachary) +* doc: many many install doc improvements (John Wilkins) +* mds: fix readdir end check (Zheng Yan) +* mds: update old-format backtraces opportunistically (Zheng Yan) +* misc cleanups from coverity (Xing Lin) +* misc portability fixes (Noah Watkins, Christophe Courtaut, Alan Somers, huanjun) +* mon: 'osd dump' dumps pool snaps as array, not object (Dan Mick) +* mon: allow debug quorum_{enter,exit} commands via admin socket +* mon: prevent extreme changes in pool pg_num (Greg Farnum) +* mon: take 'osd pool set ...' value as an int, not string (Joao Eduardo Luis) +* mon: trim MDSMaps (Joao Eduardo Luis) +* osd: fix object_info_t encoding bug from emperor (Sam Just) +* rbd: add 'rbdmap' init script for mapping rbd images on book (Adam Twardowski) +* rgw: add 'status' command to sysvinit script (David Moreau Simard) +* rgw: fix error setting empty owner on ACLs (Yehuda Sadeh) +* rgw: optionally defer to bucket ACLs instead of object ACLs (Liam Monahan) +* rgw: support for password (instead of admin token) for keystone authentication (Christophe Courtaut) +* sysvinit, upstart: prevent both init systems from starting the same daemons (Josh Durgin) |