====== Kraken ====== Kraken is the 11th stable release of Ceph. It is named after the mythical kraken, a legendary sea monster in Scandinavian folklore with cephalopod-like appearance. v11.2.1 Kraken ============== This is the first bugfix release for Kraken, and probably the last release of the Kraken series (Kraken will be declared "End Of Life" (EOL) when Luminous is declared stable). It contains a large number of bugfixes across all Ceph components. We recommend that all v11.2.x users upgrade. For more detailed information, see :download:`the complete changelog <../changelog/v11.2.1.txt>`. Notable Changes --------------- * In previous versions, if a client sent an op to the wrong OSD, the OSD would reply with ENXIO. The rationale here is that the client or OSD is clearly buggy and we want to surface the error as clearly as possible. We now only send the ENXIO reply if the osd_enxio_on_misdirected_op option is enabled (it's off by default). This means that a VM using librbd that previously would have gotten an EIO and gone read-only will now see a blocked/hung IO instead. * There was a bug introduced in Jewel (#19119) that broke the mapping behavior when an "out" OSD that still existed in the CRUSH map was removed with 'osd rm'. This could result in 'misdirected op' and other errors. The bug is now fixed, but the fix itself introduces the same risk because the behavior may vary between clients and OSDs. To avoid problems, please ensure that all OSDs are removed from the CRUSH map before deleting them. That is, be sure to do:: ceph osd crush rm osd.123 before:: ceph osd rm osd.123 * This release greatly improves control and throttling of the snap trimmer. It introduces the "osd max trimming pgs" option (defaulting to 2), which limits how many PGs on an OSD can be trimming snapshots at a time. And it restores the safe use of the "osd snap trim sleep" option, which defaults to 0 but otherwise adds the given number of seconds in delay between every dispatch of trim operations to the underlying system. Other Notable Changes --------------------- * build/ops: ceph-base missing dependency for psmisc in Ubuntu Xenial (`issue#19129 `_, `issue#19564 `_, `pr#14425 `_, Nathan Cutler) * build/ops: logrotate is missing from debian package (kraken, master) (`issue#19670 `_, `issue#19390 `_, `pr#14734 `_, Kefu Chai) * build/ops: selinux: Do parallel relabel on package install (`issue#20077 `_, `issue#20184 `_, `issue#20191 `_, `issue#20193 `_, `pr#15509 `_, Boris Ranto) * build/ops: spec file mentions non-existent ceph-create-keys systemd unit file, causing ceph-mon units to not be enabled via preset (`issue#19460 `_, `pr#14315 `_, Sébastien Han) * build/ops: systemd restarts Ceph Mon to quickly after failing to start (`issue#18635 `_, `issue#18721 `_, `pr#13185 `_, Wido den Hollander) * build/ops: systemd: Start OSDs after MONs (`issue#18907 `_, `issue#18516 `_, `pr#13494 `_, Boris Ranto) * ceph-disk: Add fix subcommand kraken back-port (`issue#19544 `_, `pr#14345 `_, Boris Ranto) * ceph-disk: does not support cluster names different than 'ceph' (`issue#18973 `_, `issue#17821 `_, `pr#13497 `_, Loic Dachary) * ceph-disk: enable directory backed OSD at boot time (`issue#19628 `_, `issue#19647 `_, `pr#14604 `_, Loic Dachary) * ceph-disk: error on _bytes2str (`issue#18431 `_, `issue#18371 `_, `pr#13501 `_, Kefu Chai) * ceph-disk: fails if OSD udev rule triggers prior to mount of /var (`issue#20150 `_, `issue#19941 `_, `pr#16092 `_, Loic Dachary) * ceph-disk: Fix getting wrong group name when --setgroup in bluestore (`issue#18956 `_, `pr#13488 `_, craigchi) * ceph-disk list reports mount error for OSD having mount options with SELinux context (`issue#19537 `_, `issue#17331 `_, `pr#14403 `_, Brad Hubbard) * ceph-disk prepare get wrong group name in bluestore (`issue#18997 `_, `pr#13543 `_, craigchi) * ceph-disk: Racing between partition creation & device node creation (`issue#20034 `_, `pr#16138 `_, Erwan Velu) * ceph-disk: separate ceph-osd --check-needs-\* logs (`issue#20010 `_, `issue#19888 `_, `pr#16135 `_, Loic Dachary) * cephfs: buffer overflow in test LibCephFS.DirLs (`issue#18941 `_, `issue#19045 `_, `pr#14571 `_, "Yan, Zheng") * cephfs: ceph-fuse crash during snapshot tests (`issue#18552 `_, `issue#18460 `_, `pr#14563 `_, Yan, Zheng) * cephfs: ceph-fuse does not recover after lost connection to MDS (`issue#19678 `_, `issue#18757 `_, `pr#16105 `_, Henrik Korkuc) * cephfs: client: fix the cross-quota rename boundary check conditions (`issue#18700 `_, `pr#14567 `_, Greg Farnum) * cephfs: Deadlock on two ceph-fuse clients accessing the same file (`issue#20028 `_, `issue#19635 `_, `pr#16191 `_, "Yan, Zheng") * cephfs: fragment space check can cause replayed request fail (`issue#18660 `_, `issue#18706 `_, `pr#14568 `_, "Yan, Zheng") * cephfs: MDS crashes on missing metadata object (`issue#18179 `_, `issue#18566 `_, `pr#14565 `_, Yan, Zheng) * cephfs: MDS heartbeat timeout during rejoin, when working with large amount of caps/inodes (`issue#19118 `_, `issue#19335 `_, `pr#14572 `_, John Spray) * cephfs: mds is crushed, after I set about 400 64KB xattr kv pairs to a file (`issue#19674 `_, `issue#19033 `_, `pr#16103 `_, Yang Honggang) * cephfs: MDS server crashes due to inconsistent metadata (`issue#19406 `_, `issue#19620 `_, `pr#14574 `_, John Spray) * cephfs: mds/StrayManager: avoid reusing deleted inode in StrayManager::_purge_stray_logged (`issue#18950 `_, `pr#14570 `_, Zhi Zhang) * cephfs: mount point break off problem after mds switch (`issue#19667 `_, `issue#19437 `_, `pr#16100 `_, Guan yunfei, Sage Weil) * cephfs: non-local quota changes not visible until some IO is done (`issue#17939 `_, `issue#19763 `_, `pr#16108 `_, John Spray) * cephfs: No output for ceph mds rmfailed 0 --yes-i-really-mean-it command (`issue#19483 `_, `issue#16709 `_, `pr#14573 `_, John Spray) * cephfs: normalize file open flags internally used by cephfs (`issue#19845 `_, `pr#14998 `_, Jan Fajerski) * cephfs: segfault in handle_client_caps (`issue#18306 `_, `issue#18616 `_, `pr#14566 `_, Yan, Zheng) * cephfs: speed up readdir by skipping unwanted dn (`issue#18531 `_, `pr#13028 `_, Xiaoxi Chen) * cephfs: src/test/pybind/test_cephfs.py fails (`issue#20500 `_, `issue#19890 `_, `pr#16114 `_, "Yan, Zheng") * cephfs: test_client_recovery.TestClientRecovery fails (`issue#18562 `_, `issue#18396 `_, `pr#14564 `_, Yan, Zheng) * cephfs test failures (ceph.com/qa is broken, should be download.ceph.com/qa) (`issue#18574 `_, `issue#18604 `_, `pr#13024 `_, John Spray) * cephfs: Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient) (`issue#18914 `_, `issue#19676 `_, `pr#16104 `_, "Yan, Zheng") * cephfs: test_open_inode fails (`issue#18899 `_, `issue#18661 `_, `pr#14569 `_, John Spray) * client: populate metadata during mount (`issue#18361 `_, `issue#18540 `_, `pr#12951 `_, John Spray) * client: segfault on ceph_rmdir path / (`issue#18612 `_, `issue#9935 `_, `pr#13030 `_, Michal Jarzabek) * cls_rbd: default initialize snapshot namespace for legacy clients (`issue#19413 `_, `issue#19833 `_, `pr#14934 `_, Jason Dillaman) * cls/rgw: list_plain_entries() stops before bi_log entries (`issue#19876 `_, `issue#20015 `_, `pr#15384 `_, Casey Bodley) * common: monitor creation with IPv6 public network segfaults (`issue#19465 `_, `issue#19371 `_, `pr#14323 `_, Fabian Grünbichler) * common: possible lockdep false alarm for ThreadPool lock (`issue#18819 `_, `issue#18894 `_, `pr#13487 `_, Mykola Golub) * core: api_misc: [ FAILED ] LibRadosMiscConnectFailure.ConnectFailure (`issue#19561 `_, `issue#15368 `_, `pr#14733 `_, Sage Weil) * core: bluestore bdev: flush no-op optimization is racy (`issue#20495 `_, `issue#19326 `_, `issue#19327 `_, `issue#19250 `_, `issue#19251 `_, `pr#14736 `_, Sage Weil) * core: improve control and throttling of the snap trimmer (`issue#19329 `_, `issue#19931 `_, `pr#14597 `_, Samuel Just, Greg Farnum) * core: two instances of omap_digest mismatch (`issue#19391 `_, `pr#14200 `_, Samuel Just, David Zafman) * doc: PendingReleaseNotes: warning about 'osd rm ...' and #13733 (`issue#19119 `_, `pr#14506 `_, Sage Weil) * doc: Python Swift client commands in Quick Developer Guide don't match configuration in vstart.sh (`issue#17746 `_, `issue#18571 `_, `pr#13044 `_, Ronak Jain) * doc: rgw: admin ops: fix the quota section (`issue#19397 `_, `issue#19462 `_, `pr#14521 `_, Chu, Hua-Rong) * fix: rgw crashed caused by shard id out of range when listing data log (`issue#20156 `_, `issue#19732 `_, `pr#16173 `_, redickwang) * fuse: TestVolumeClient.test_evict_client failure creating pidfile (`issue#18439 `_, `issue#18309 `_, `pr#12813 `_, Nathan Cutler) * librbd: allow to open an image without opening parent image (`issue#18609 `_, `issue#18325 `_, `pr#13132 `_, Ricardo Dias) * librbd: corrected resize RPC message backwards compatibility (`issue#19636 `_, `issue#19659 `_, `pr#14620 `_, Jason Dillaman) * librbd: Incomplete declaration for ContextWQ in librbd/Journal.h (`issue#18862 `_, `issue#18892 `_, `pr#14153 `_, Boris Ranto) * librbd: is_exclusive_lock_owner API should ping OSD (`issue#19467 `_, `issue#19287 `_, `pr#14480 `_, Jason Dillaman) * librbd: possible race in ExclusiveLock handle_peer_notification (`issue#19368 `_, `pr#14163 `_, Mykola Golub) * librbd: prevent self-blacklisting during break lock (`issue#18703 `_, `issue#18666 `_, `pr#13201 `_, Jason Dillaman) * make check fails with Error EIO: load dlopen(build/lib/libec_FAKE.so): build/lib/libec_FAKE.so: cannot open shared object file: No such file or directory (`issue#20487 `_, `issue#20345 `_, `issue#18876 `_, `pr#16069 `_, Kefu Chai, Kyr Shatskyy) * mds: assert fail when shutting down (`issue#19672 `_, `issue#19204 `_, `pr#16102 `_, John Spray) * mds: C_MDSInternalNoop::complete doesn't free itself (`issue#19664 `_, `issue#19501 `_, `pr#16099 `_, "Yan, Zheng") * mds: daemon goes readonly writing backtrace for a file whose data pool has been removed (`issue#19669 `_, `issue#19401 `_, `pr#16101 `_, John Spray) * mds: damage reporting by ino number is useless (`issue#18509 `_, `issue#19680 `_, `pr#16106 `_, John Spray) * mds: Decode errors on backtrace will crash MDS (`issue#18311 `_, `issue#18463 `_, `pr#12835 `_, John Spray) * mds: enable daemon to start when session ino info is corrupt (`issue#19710 `_, `issue#16842 `_, `pr#16107 `_, John Spray) * mds: failed filelock.can_read(-1) assertion in Server::_dir_is_nonempty (`issue#18707 `_, `issue#18578 `_, `pr#13555 `_, Yan, Zheng) * mds: finish clientreplay requests before requesting active state (`issue#18678 `_, `issue#18461 `_, `pr#13112 `_, Yan, Zheng) * mds: unresponsive when truncating a very large file (`issue#19755 `_, `issue#20026 `_, `pr#16190 `_, "Yan, Zheng") * mon: cache tiering: base pool last_force_resend not respected (racing read got wrong version) (`issue#18366 `_, `issue#18403 `_, `pr#13116 `_, Sage Weil) * mon crash on shutdown, lease_ack_timeout event (`issue#19928 `_, `issue#19825 `_, `pr#15084 `_, Kefu Chai, Alexey Sheplyakov) * mon: fail to form large quorum; msg/async busy loop (`issue#20230 `_, `issue#20315 `_, `pr#15729 `_, Haomai Wang) * mon: force_create_pg could leave pg stuck in creating state (`issue#19181 `_, `issue#18298 `_, `pr#13790 `_, Adam C. Emerson, Sage Weil) * mon/MonClient: make get_mon_log_message() atomic (`issue#19618 `_, `issue#19427 `_, `pr#14588 `_, Kefu Chai) * mon: 'osd crush move ...' doesnt work on osds (`issue#18682 `_, `issue#18587 `_, `pr#13500 `_, Sage Weil) * mon: osd crush set crushmap need sanity check (`issue#19302 `_, `issue#20365 `_, `pr#16143 `_, Loic Dachary) * mon: peon wrongly delete routed pg stats op before receive pg stats ack (`issue#18554 `_, `issue#18458 `_, `pr#13046 `_, Mingxin Liu) * mon/PGMap: factor mon_osd_full_ratio into MAX AVAIL calc (`issue#18522 `_, `issue#20035 `_, `pr#15237 `_, Sage Weil) * msg/simple/SimpleMessenger.cc: 239: FAILED assert(!cleared) (`issue#15784 `_, `issue#18378 `_, `pr#16133 `_, Sage Weil) * multisite: rest api fails to decode large period on 'period commit' (`issue#19505 `_, `issue#19616 `_, `issue#19614 `_, `issue#20244 `_, `issue#19488 `_, `issue#19776 `_, `issue#20293 `_, `issue#19746 `_, `pr#16161 `_, Casey Bodley, Abhishek Lekshmanan) * objecter: full_try behavior not consistent with osd (`issue#19560 `_, `issue#19430 `_, `pr#14732 `_, Sage Weil) * ojecter: epoch_barrier isn't respected in _op_submit() (`issue#19396 `_, `issue#19496 `_, `pr#14331 `_, Ilya Dryomov) * os/bluestore: deep decode onode value (`issue#20366 `_, `pr#15792 `_, Sage Weil) * os/bluestore: fix Allocator::allocate() int truncation (`issue#20884 `_, `issue#18595 `_, `pr#13011 `_, Sage Weil) * osd: allow client throttler to be adjusted on-fly, without restart (`issue#18791 `_, `issue#18793 `_, `pr#13216 `_, Piotr Dałek) * osd: An OSD was seen getting ENOSPC even with osd_failsafe_full_ratio passed (`issue#20544 `_, `issue#16878 `_, `issue#19340 `_, `issue#19841 `_, `issue#20672 `_, `pr#16134 `_, Sage Weil, David Zafman) * osd: bogus assert when checking acting set on recovery completion in rados/upgrade (`issue#18999 `_, `pr#13542 `_, Sage Weil) * osd: calc_clone_subsets misuses try_read_lock vs missing (`issue#18610 `_, `issue#18583 `_, `issue#18723 `_, `issue#17831 `_, `pr#14616 `_, Samuel Just) * osd: ceph degraded and misplaced status output inaccurate (`issue#18619 `_, `issue#19480 `_, `pr#14322 `_, David Zafman) * osd: condition object_info_t encoding on required (not up) features (`issue#18842 `_, `issue#18831 `_, `issue#18814 `_, `pr#13485 `_, Ilya Dryomov) * osd: do not send ENXIO on misdirected op by default (`issue#19622 `_, `pr#13253 `_, Sage Weil) * osd: FAILED assert(object_contexts.empty()) (live on master only from Jan-Feb 2017, all other instances are different) (`issue#20522 `_, `issue#20523 `_, `issue#18927 `_, `issue#18809 `_, `pr#16132 `_, Samuel Just) * osd: --flush-journal: sporadic segfaults on exit (`issue#18952 `_, `issue#18820 `_, `pr#13490 `_, Alexey Sheplyakov) * osd: Give requested scrubs a higher priority (`issue#19685 `_, `issue#15789 `_, `pr#14735 `_, David Zafman) * osd: Implement asynchronous scrub sleep (`issue#20033 `_, `issue#19986 `_, `issue#20173 `_, `issue#19497 `_, `pr#15526 `_, Brad Hubbard) * osd: leaked MOSDMap (`issue#19760 `_, `issue#18293 `_, `pr#14942 `_, Sage Weil) * osd: leveldb corruption leads to Operation not permitted not handled and assert (`issue#18037 `_, `issue#18418 `_, `pr#12790 `_, Nathan Cutler) * osd: metadata reports filestore when using bluestore (`issue#18677 `_, `issue#18638 `_, `pr#16083 `_, Wido den Hollander) * osd: New added OSD always down when full flag is set (`issue#19485 `_, `pr#14321 `_, Mingxin Liu) * osd: Object level shard errors are tracked and used if no auth available (`issue#20089 `_, `pr#15421 `_, David Zafman) * osd: os/bluestore: fix statfs to not include DB partition in free space (`issue#18599 `_, `issue#18722 `_, `pr#13284 `_, Sage Weil) * osd: osd/PrimaryLogPG: do not call on_shutdown() if (pg.deleting) (`issue#19902 `_, `issue#19916 `_, `pr#15066 `_, Kefu Chai) * osd: pg log split does not rebuild index for parent or child (`issue#19315 `_, `issue#18975 `_, `pr#14048 `_, Sage Weil) * osd: pglog: with config, don't assert in the presence of stale diverg… (`issue#17916 `_, `issue#19702 `_, `pr#14646 `_, Greg Farnum) * osd: publish PG stats when backfill-related states change (`issue#18497 `_, `issue#18369 `_, `pr#13295 `_, Sage Weil) * osd: Revert "PrimaryLogPG::failed_push: update missing as well" (`issue#18659 `_, `pr#13091 `_, David Zafman) * osd: unlock sdata_op_ordering_lock with sdata_lock hold to avoid missing wakeup signal (`issue#20443 `_, `pr#15962 `_, Alexey Sheplyakov) * pre-jewel "osd rm" incrementals are misinterpreted (`issue#19209 `_, `issue#19119 `_, `pr#13883 `_, Ilya Dryomov) * rbd: Add missing parameter feedback to 'rbd snap limit' (`issue#18601 `_, `pr#14537 `_, Tang Jin) * rbd: [api] is_exclusive_lock_owner shouldn't return -EBUSY (`issue#20266 `_, `issue#20182 `_, `pr#16187 `_, Jason Dillaman) * rbd: [api] temporarily restrict (rbd\_)mirror_peer_add from adding multiple peers (`issue#19256 `_, `issue#19324 `_, `pr#14545 `_, Jason Dillaman) * rbd: attempting to remove an image with incompatible features results in partial removal (`issue#18456 `_, `issue#18315 `_, `pr#13247 `_, Dongsheng Yang) * rbd: [cli] ensure positional arguments exist before casting (`issue#20264 `_, `issue#20185 `_, `pr#16186 `_, Jason Dillaman) * rbd: cli: map with cephx disabled results in error message (`issue#19035 `_, `issue#20517 `_, `pr#16298 `_, Jason Dillaman) * rbd: [ FAILED ] TestJournalTrimmer.RemoveObjectsWithOtherClient (`issue#18769 `_, `issue#18738 `_, `pr#14147 `_, Jason Dillaman) * rbd: Improve compatibility between librbd + krbd for the data pool (`issue#18771 `_, `issue#18653 `_, `pr#14539 `_, Jason Dillaman) * rbd: Issues with C API image metadata retrieval functions (`issue#19588 `_, `issue#19611 `_, `pr#15612 `_, Mykola Golub) * rbd: 'metadata_set' API operation should not change global config setting (`issue#18465 `_, `issue#18549 `_, `pr#14534 `_, Mykola Golub) * rbd-mirror: additional test stability improvements (`issue#18935 `_, `issue#18947 `_, `pr#14155 `_, Jason Dillaman) * rbd-mirror: deleting a snapshot during sync can result in read errors (`issue#19037 `_, `issue#18990 `_, `pr#14622 `_, Jason Dillaman) * rbd-mirror: ensure missing images are re-synced when detected (`issue#20022 `_, `issue#19811 `_, `pr#15486 `_, Jason Dillaman) * rbd-mirror: failover and failback of unmodified image results in split-brain (`issue#19872 `_, `issue#19858 `_, `pr#14974 `_, Jason Dillaman) * rbd-mirror: potential race mirroring cloned image (`issue#18501 `_, `issue#17993 `_, `pr#14533 `_, Jason Dillaman) * rbd-mirror: sporadic image replayer shut down failure (`issue#18493 `_, `issue#18441 `_, `pr#14531 `_, Jason Dillaman) * rbd-nbd: add signal handler (`issue#19621 `_, `issue#19349 `_, `pr#16098 `_, Kefu Chai, Pan Liu) * rbd-nbd: check /sys/block/nbdX/size to ensure kernel mapped correctly (`issue#18970 `_, `issue#17951 `_, `issue#18910 `_, `issue#18335 `_, `pr#14540 `_, Mykola Golub, Pan Liu) * rbd: Possible deadlock performing a synchronous API action while refresh in-progress (`issue#18495 `_, `issue#18419 `_, `pr#14532 `_, Jason Dillaman) * rbd: Potential IO hang if image is flattened while read request is in-flight (`issue#19832 `_, `issue#20154 `_, `pr#16184 `_, Jason Dillaman) * rbd: [qa] crash in journal-enabled fsx run (`issue#18618 `_, `issue#18632 `_, `pr#14538 `_, Jason Dillaman) * rbd: qemu crash triggered by network issues (`issue#18776 `_, `issue#18436 `_, `pr#13245 `_, Jason Dillaman) * rbd: 'rbd bench-write' will crash if --io-size is 4G (`issue#18422 `_, `issue#18557 `_, `pr#14536 `_, Gaurav Kumar Garg) * rbd: rbd_clone_copy_on_read ineffective with exclusive-lock (`issue#19173 `_, `issue#18888 `_, `pr#14543 `_, Venky Shankar) * rbd: rbd --pool=x rename y z does not work (`issue#18777 `_, `issue#18326 `_, `pr#14149 `_, Gaurav Kumar Garg) * rbd: refuse to use an ec pool that doesn't support overwrites (`issue#19081 `_, `issue#19336 `_, `pr#16096 `_, Jason Dillaman) * rgw: add apis to support ragweed suite (`issue#19809 `_, `pr#14852 `_, Yehuda Sadeh) * rgw: add the remove-x-delete feature to cancel swift object expiration (`issue#19472 `_, `issue#19074 `_, `pr#14522 `_, Jing Wenjun) * rgw: a few cases where rgw_obj is incorrectly initialized (`issue#19146 `_, `issue#19096 `_, `pr#13843 `_, Yehuda Sadeh) * rgw: anonymous user error code of getting object is not consistent with SWIFT (`issue#18806 `_, `issue#19178 `_, `pr#13877 `_, Jing Wenjun) * rgw: civetweb frontend segfaults in Luminous (`issue#19749 `_, `issue#19840 `_, `pr#16166 `_, Abhishek Lekshmanan, Jesse Williamson) * rgw: civetweb: move to post 1.8 version (`issue#19704 `_, `pr#14960 `_, Yehuda Sadeh) * rgw: "cluster [WRN] bad locator @X on object @X...." in cluster log (`issue#19212 `_, `issue#18980 `_, `pr#14065 `_, Casey Bodley) * rgw: crash when updating period with placement group (`issue#18772 `_, `issue#18631 `_, `pr#14511 `_, Orit Wasserman) * rgw: Custom data header support (`issue#19843 `_, `pr#15985 `_, Pavan Rallabhandi) * rgw: datalog trim can't work as expected (`issue#20263 `_, `issue#20190 `_, `pr#16175 `_, Zhang Shaowen) * rgw: DUMPABLE flag is cleared by setuid preventing coredumps (`issue#19147 `_, `issue#19089 `_, `pr#13845 `_, Brad Hubbard) * rgw: Error parsing xml when get bucket lifecycle (`issue#19363 `_, `issue#19534 `_, `pr#14528 `_, liuchang0812) * rgw: first write also tries to read object (`issue#18904 `_, `issue#18622 `_, `issue#18623 `_, `issue#18621 `_, `pr#14515 `_, Yehuda Sadeh) * rgw: fix break inside of yield in RGWFetchAllMetaCR (`issue#19322 `_, `issue#17655 `_, `pr#14067 `_, Casey Bodley) * rgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT (`issue#18476 `_, `pr#13006 `_, Radoslaw Zarzynski) * rgw: fix RadosGW hang during multi-chunk upload of AWSv4 (`issue#19837 `_, `issue#19754 `_, `pr#14939 `_, Radoslaw Zarzynski) * rgw: fix use of marker in List::list_objects() (`issue#19047 `_, `issue#18331 `_, `pr#14517 `_, Yehuda Sadeh) * rgw: 'gc list --include-all' command infinite loop the first 1000 items (`issue#19978 `_, `issue#20147 `_, `pr#16139 `_, Shasha Lu, fang yuxiang) * rgw: get wrong content when download object with specific range when compression was enabled (`issue#20100 `_, `issue#20268 `_, `pr#16178 `_, fang yuxiang) * rgw: health check errors out incorrectly (`issue#19025 `_, `issue#19157 `_, `pr#13866 `_, Pavan Rallabhandi) * rgw: Lifecycle thread will still handle the bucket even if it has been removed (`issue#20285 `_, `issue#20405 `_, `pr#16183 `_, Zhang Shaowen) * rgw: make sending Content-Length in 204 and 304 controllable (`issue#18985 `_, `issue#16602 `_, `pr#13514 `_, Radoslaw Zarzynski) * rgw: meta sync thread crash at RGWMetaSyncShardCR (`issue#20251 `_, `issue#20347 `_, `pr#16180 `_, Fang Yuxiang, Nathan Cutler) * rgw: multisite: after CreateBucket is forwarded to master, local bucket may use different value for bucket index shards (`issue#19745 `_, `issue#19759 `_, `pr#16290 `_, Shasha Lu) * rgw: multisite: EPERM when trying to read SLO objects as system/admin user (`issue#19027 `_, `issue#19475 `_, `pr#14523 `_, Casey Bodley) * rgw: multisite: fetch_remote_obj() gets wrong version when copying from remote (`issue#19608 `_, `pr#14606 `_, Zhang Shaowen, Casey Bodley) * rgw: multisite: RGWMetaSyncShardControlCR gives up on EIO (`issue#19160 `_, `issue#19019 `_, `pr#13868 `_, Casey Bodley) * rgw: multisite: segfault after changing value of rgw_data_log_num_shards (`issue#18488 `_, `issue#18548 `_, `pr#13181 `_, Casey Bodley) * rgw: multisite: some 'radosgw-admin data sync' commands hang (`issue#19236 `_, `issue#19354 `_, `pr#14142 `_, Shasha Lu) * rgw: multisite: some yields in RGWMetaSyncShardCR::full_sync() resume in incremental_sync() (`issue#19049 `_, `issue#18076 `_, `pr#13838 `_, Casey Bodley) * rgw: multisite: sync status reports master is on a different period (`issue#18709 `_, `issue#18064 `_, `pr#13176 `_, Abhishek Lekshmanan) * rgw: no http referer info in container metadata dump in swift API (`issue#18665 `_, `issue#18898 `_, `pr#13829 `_, Jing Wenjun) * rgw: "period update" does not remove short_zone_ids of deleted zones (`issue#15618 `_, `issue#19342 `_, `pr#14141 `_, Casey Bodley) * rgw: radosgw-admin: add the 'object stat' command to usage (`issue#19164 `_, `issue#19013 `_, `pr#13873 `_, Pavan Rallabhandi) * rgw: radosgw-admin period update reverts deleted zonegroup (`issue#18713 `_, `issue#17239 `_, `pr#13172 `_, Orit Wasserman) * rgw: 'radosgw-admin usage show' listing 0 bytes_sent/received (`issue#20261 `_, `pr#16174 `_, Pritha Srivastava) * rgw: 'radosgw-admin zone create' command with specified zone-id creates a zone with different id (`issue#19524 `_, `issue#19498 `_, `pr#14526 `_, Orit Wasserman) * rgw: Realm set does not create a new period (`issue#18333 `_, `issue#18499 `_, `pr#14509 `_, Orit Wasserman) * rgw: reduce log level of 'storing entry at' in cls_log (`issue#19835 `_, `issue#19839 `_, `pr#16165 `_, Willem Jan Withagen) * rgw: Response header of swift API returned by radosgw does not contain x-openstack-request-id. But Swift returns it (`issue#19443 `_, `issue#19573 `_, `pr#14529 `_, tone-zhang) * rgw: rgw_file: fix marker computation (`issue#20158 `_, `issue#19526 `_, `issue#18989 `_, `issue#19470 `_, `issue#19471 `_, `issue#18651 `_, `issue#20195 `_, `issue#19059 `_, `issue#19112 `_, `issue#19018 `_, `issue#19036 `_, `issue#19154 `_, `issue#19170 `_, `issue#19663 `_, `issue#19661 `_, `issue#19111 `_, `issue#18992 `_, `issue#18650 `_, `issue#18991 `_, `issue#19623 `_, `issue#19149 `_, `issue#19270 `_, `issue#19723 `_, `issue#19625 `_, `issue#19624 `_, `issue#19060 `_, `issue#19166 `_, `issue#18810 `_, `issue#19168 `_, `issue#19162 `_, `issue#19066 `_, `issue#18808 `_, `issue#19634 `_, `issue#19435 `_, `issue#19144 `_, `issue#19229 `_, `issue#18902 `_, `pr#13871 `_, Gui Hecheng, Matt Benjamin) * rgw: S3 create bucket should not do response in json (`issue#19172 `_, `issue#18889 `_, `pr#13875 `_, Abhishek Lekshmanan) * rgw: S3 v4 authentication issue with X-Amz-Expires (`issue#19477 `_, `issue#18828 `_, `pr#14524 `_, liuchang0812) * rgw: S3 v4 authentication issue with X-Amz-Expires (`issue#19725 `_, `issue#18828 `_, `pr#16162 `_, liuchang0812) * rgw: should parse the url to http host to compare with the container referer acl (`issue#18896 `_, `issue#18685 `_, `pr#13780 `_, Jing Wenjun) * rgw: slave zonegroup cannot enable the bucket versioning (`issue#18711 `_, `issue#18003 `_, `pr#13174 `_, Orit Wasserman) * rgw: Swift API: spurious newline after http body causes weird errors (`issue#18780 `_, `issue#18473 `_, `pr#13224 `_, Marcus Watts, Matt Benjamin) * rgw: swift API: cannot disable object versioning with empty X-Versions-Location (`issue#18852 `_, `issue#19175 `_, `pr#14519 `_, Jing Wenjun) * rgw: swift: disable revocation thread under certain circumstances (`issue#19499 `_, `issue#9493 `_, `issue#19777 `_, `pr#16164 `_, Marcus Watts) * rgw: Swift's at-root features (/crossdomain.xml, /info, /healthcheck) are broken (`issue#20031 `_, `issue#19520 `_, `pr#16168 `_, Radoslaw Zarzynski) * rgw: the swift container acl does not support field .ref (`issue#18909 `_, `issue#19180 `_, `issue#18484 `_, `issue#18796 `_, `pr#14516 `_, Jing Wenjun, Radoslaw Zarzynski) * rgw: typo in rgw_admin.cc (`issue#19156 `_, `issue#19026 `_, `pr#13864 `_, Ronak Jain) * rgw: unsafe access in RGWListBucket_ObjStore_SWIFT::send_response() (`issue#19574 `_, `issue#19249 `_, `pr#14530 `_, Yehuda Sadeh) * rgw: upgrade to multisite v2 fails if there is a zone without zone info (`issue#19331 `_, `issue#19231 `_, `pr#14137 `_, Danny Al-Gaaf, Orit Wasserman) * rgw: usage stats and quota are not operational for multi-tenant users (`issue#18364 `_, `issue#18843 `_, `issue#16355 `_, `pr#14513 `_, Radoslaw Zarzynski) * rgw: Use decoded URI when verifying TempURL (`issue#18590 `_, `issue#18627 `_, `pr#12986 `_, Michal Koutný) * rgw: VersionIdMarker and NextVersionIdMarker are not returned when listing object versions (`issue#20363 `_, `issue#19886 `_, `pr#16181 `_, Zhang Shaowen) * rgw: when converting region_map we need to use rgw_zone_root_pool (`issue#19195 `_, `issue#19356 `_, `pr#14144 `_, Orit Wasserman) * rgw: when uploading the objects continuesly in the versioned bucket, some objects will not sync (`issue#19766 `_, `issue#18208 `_, `pr#16163 `_, lvshuhua) * rgw: wrong object size after copy of uncompressed multipart objects (`issue#20269 `_, `issue#20071 `_, `pr#16179 `_, fang yuxiang) * rgw: zonegroupmap set does not work (`issue#18725 `_, `issue#19479 `_, `pr#14525 `_, Casey Bodley) * tests: AttributeError: Thrasher instance has no attribute 'ceph_objectstore_tool' (`issue#19064 `_, `issue#18799 `_, `pr#13609 `_, Nathan Cutler) * tests: backport Sage's fixes to qa/suites/upgrade/jewel-x (`issue#19651 `_, `pr#14612 `_, Sage Weil) * tests: ceph-object-corpus: kraken objects (`issue#20878 `_, `pr#14983 `_, Sage Weil) * tests: CMakeLists.txt: disable memstore make check test (`issue#17743 `_, `pr#16215 `_, Sage Weil) * tests: HEALTH_WARN pool rbd pg_num 244 > pgp_num 224 during upgrade (`issue#19771 `_, `issue#20024 `_, `pr#16137 `_, Kefu Chai) * tests: ignore bogus ceph-objectstore-tool error in ceph_manager (`issue#18805 `_, `issue#16263 `_, `pr#13239 `_, Nathan Cutler, Kefu Chai) * tests: insufficient timeout in radosbench task (`issue#20497 `_, `pr#16111 `_, Sage Weil) * tests: LibRadosMiscConnectFailure.ConnectFailure hang (`issue#20271 `_, `issue#19901 `_, `pr#16140 `_, Sage Weil) * tests: [librados_test_stub] cls_cxx_map_get_XYZ methods don't return correct value (`issue#19597 `_, `issue#19609 `_, `pr#16097 `_, Jason Dillaman) * tests: move swift.py task from teuthology to ceph, phase one (kraken) (`issue#20392 `_, `pr#15869 `_, Nathan Cutler, Sage Weil, Warren Usui, Greg Farnum, Ali Maredia, Tommi Virtanen, Zack Cerza, Sam Lang, Yehuda Sadeh, Joe Buck, Josh Durgin) * tests: ObjectStore/StoreTest.OnodeSizeTracking/2 fails on bluestore (`issue#20499 `_, `pr#16112 `_, xie xingguo) * tests: qa: ceph-ansible test tweaks (`issue#20882 `_, `pr#12984 `_, `pr#13618 `_, Tamil Muthamizhan, Yuri Weinstein) * tests: qa/suites/upgrade: add tiering test to hammer-jewel-x (`issue#20879 `_, `issue#19185 `_, `pr#14692 `_, Kefu Chai) * tests: qa/tasks: misc systemd updates (`issue#19719 `_, `pr#14702 `_, Vasu Kulkarni) * tests: qa/tasks: rbd-mirror daemon not properly run in foreground mode (`issue#20638 `_, `issue#20630 `_, `issue#20634 `_, `pr#16342 `_, Jason Dillaman) * tests: qa/tasks: set pgp = pg num on thrashing finish (`issue#20881 `_, `pr#13757 `_, Kefu Chai) * tests: qa/tasks/workunit: Backport repo fixes from master (`issue#19429 `_, `issue#19531 `_, `pr#14487 `_, Kefu Chai, Dan Mick) * tests: remove hard-coded image name from TestLibRBD.Mirror (`issue#18555 `_, `issue#19130 `_, `issue#19227 `_, `issue#18447 `_, `issue#19807 `_, `issue#19798 `_, `pr#16113 `_, Mykola Golub, Jason Dillaman) * tests: remove qa/suites/buildpackages (`issue#18849 `_, `issue#18846 `_, `pr#13298 `_, Loic Dachary) * tests: run certain upgrade/jewel-x tests on Xenial only (`issue#20877 `_, `pr#16493 `_, Nathan Cutler) * tests: run-rbd-unit-tests.sh assert in lockdep_will_lock, TestLibRBD.ObjectMapConsistentSnap (`issue#18822 `_, `issue#17447 `_, `pr#14151 `_, Jason Dillaman) * tests: SUSE yaml facets in qa/distros/all are out of date (`issue#18849 `_, `issue#18870 `_, `issue#18846 `_, `issue#18856 `_, `pr#13330 `_, Nathan Cutler) * tests: swift.py: clone the ceph-kraken branch (`issue#20520 `_, `pr#16131 `_, Nathan Cutler) * tests: test/librbd: decouple ceph_test_librbd_api from libceph-common (`issue#20175 `_, `issue#20351 `_, `pr#16195 `_, Kefu Chai) * tests: test_notify.py: assert(not image.is_exclusive_lock_owner()) on line 147 (`issue#19716 `_, `issue#19794 `_, `pr#14833 `_, Mykola Golub) * tests: test_notify.py: rbd.InvalidArgument: error updating features for image test_notify_clone2 (`issue#19692 `_, `issue#19693 `_, `pr#14641 `_, Jason Dillaman) * tests: use ceph-kraken branch for s3tests (`issue#18387 `_, `pr#12746 `_, Nathan Cutler) * tests: use librados API to retrieve config params (`issue#18668 `_, `issue#18617 `_, `pr#13102 `_, Jason Dillaman) * tests: various OpenStack tweaks (`issue#20882 `_, `pr#13707 `_, `pr#13641 `_, `pr#13635 `_, `pr#13633 `_, `pr#13613 `_, `pr#13283 `_, `pr#13673 `_, `pr#13638 `_, `pr#14485 `_, Zack Cerza) * tools: ceph-brag fails to count "in" mds (`issue#19333 `_, `issue#19192 `_, `pr#14098 `_, Peng Zhang) * tools: ceph-disk prepare writes osd log 0 with root owner (`issue#18538 `_, `issue#18606 `_, `pr#13026 `_, Samuel Matzek) * tools: RadosImport::import should return an error if Rados::connect fails (`issue#19351 `_, `issue#19319 `_, `pr#14095 `_, Brad Hubbard) v11.2.0 Kraken ============== This is the first release of the Kraken series. It is a stable release that will be maintained with bugfixes and backports until the next stable release, Luminous, is completed in the Spring of 2017. Major Changes from Jewel ------------------------ - *RADOS*: * The new *BlueStore* backend now has a stable disk format and is passing our failure and stress testing. Although the backend is still flagged as experimental, we encourage users to try it out for non-production clusters and non-critical data sets. * RADOS now has experimental support for *overwrites on erasure-coded* pools. Because the disk format and implementation are not yet finalized, there is a special pool option that must be enabled to test the new feature.  Enabling this option on a cluster will permanently bar that cluster from being upgraded to future versions. * We now default to the AsyncMessenger (``ms type = async``) instead of the legacy SimpleMessenger.  The most noticeable difference is that we now use a fixed sized thread pool for network connections (instead of two threads per socket with SimpleMessenger). * Some OSD failures are now detected almost immediately, whereas previously the heartbeat timeout (which defaults to 20 seconds) had to expire.  This prevents IO from blocking for an extended period for failures where the host remains up but the ceph-osd process is no longer running. * There is a new ``ceph-mgr`` daemon.  It is currently collocated with the monitors by default, and is not yet used for much, but the basic infrastructure is now in place. * The size of encoded OSDMaps has been reduced. * The OSDs now quiesce scrubbing when recovery or rebalancing is in progress. - *RGW*: * RGW now supports a new zone type that can be used for metadata indexing via ElasticSearch. * RGW now supports the S3 multipart object copy-part API. * It is possible now to reshard an existing bucket. Note that bucket resharding currently requires that all IO (especially writes) to the specific bucket is quiesced. * RGW now supports data compression for objects. * Civetweb version has been upgraded to 1.8 * The Swift static website API is now supported (S3 support has been added previously). * S3 bucket lifecycle API has been added. Note that currently it only supports object expiration. * Support for custom search filters has been added to the LDAP auth implementation. * Support for NFS version 3 has been added to the RGW NFS gateway. * A Python binding has been created for librgw. - *RBD*: * RBD now supports images stored in an *erasure-coded* RADOS pool using the new (experimental) overwrite support. Images must be created using the new rbd CLI "--data-pool " option to specify the EC pool where the backing data objects are stored. Attempting to create an image directly on an EC pool will not be successful since the image's backing metadata is only supported on a replicated pool. * The rbd-mirror daemon now supports replicating dynamic image feature updates and image metadata key/value pairs from the primary image to the non-primary image. * The number of image snapshots can be optionally restricted to a configurable maximum. * The rbd Python API now supports asynchronous IO operations. - *CephFS*: * libcephfs function definitions have been changed to enable proper uid/gid control. The library version has been increased to reflect the interface change. * Standby replay MDS daemons now consume less memory on workloads doing deletions. * Scrub now repairs backtrace, and populates `damage ls` with discovered errors. * A new `pg_files` subcommand to `cephfs-data-scan` can identify files affected by a damaged or lost RADOS PG. * The false-positive "failing to respond to cache pressure" warnings have been fixed. Upgrading from Kraken release candidate 11.1.0 ---------------------------------------------- * The new *BlueStore* backend had an on-disk format change after 11.1.0. Any BlueStore OSDs created with 11.1.0 will need to be destroyed and recreated. Upgrading from Jewel -------------------- * All clusters must first be upgraded to Jewel 10.2.z before upgrading to Kraken 11.2.z (or, eventually, Luminous 12.2.z). * The ``sortbitwise`` flag must be set on the Jewel cluster before upgrading to Kraken. The latest Jewel (10.2.8+) releases issue a health warning if the flag is not set, so this is probably already set. If it is not, Kraken OSDs will refuse to start and will print and error message in their log. * You may upgrade OSDs, Monitors, and MDSs in any order. RGW daemons should be upgraded last. * When upgrading, new ceph-mgr daemon instances will be created automatically alongside any monitors. This will be true for Jewel to Kraken and Jewel to Luminous upgrades, but likely not be true for future upgrades beyond Luminous. You are, of course, free to create new ceph-mgr daemon instances and destroy the auto-created ones if you do not with them to be colocated with the ceph-mon daemons. BlueStore --------- BlueStore is a new backend for managing data stored by each OSD on the directly hard disk or SSD. Unlike the existing FileStore implementation, which makes use of an XFS file system to store objects as files, BlueStore manages the underlying block device directly. Implements its own file system-like on-disk structure the is designed specifically for Ceph OSD workloads. Key features of BlueStore include: * Checksums on all data written to disk, with checksum verifications on all reads, enabled by default. * Inline compression support, which can be enabled on a per-pool or per-object basis via pool properties or client hints, respectively. * Efficient journaling. Unlike FileStore, which writes *all* data to its journal device, BlueStore only journals metadata and (in some cases) small writes, reducing the size and throughput requirements for its journal. As with FileStore, the journal can be colocated on the same device as other data or allocated on a smaller, high-performance device (e.g., an SSD or NVMe device). BlueStore journals are only 512 MB by default. The BlueStore on-disk format is expected to continue to evolve. However, we will provide support in the OSD to migrate to the new format on upgrade. .. note: BlueStore is still marked "experimental" in Kraken. We recommend its use for proof-of-concept and test environments, or other cases where data loss can be tolerated. Although it is stable in our testing environment, the code is new and bugs are inevitable. We hope that with user feedback from Kraken deployments we will have sufficient confidence to mark it stable (and the default) in the next major release (Luminous). In order to enable BlueStore, add the following to ceph.conf:: enable experimental unrecoverable data corrupting features = bluestore To create a BlueStore OSD, pass the --bluestore option to ceph-disk or ceph-deploy during OSD creation. Upgrade notes ------------- * The OSDs now avoid starting new scrubs while recovery is in progress. To revert to the old behavior (and do not let recovery activity affect the scrub scheduling) you can set the following option:: osd scrub during recovery = true * The list of monitor hosts/addresses for building the monmap can now be obtained from DNS SRV records. The service name used when querying the DNS is defined in the "mon_dns_srv_name" config option, which defaults to "ceph-mon". * The 'osd class load list' config option is a list of object class names that the OSD is permitted to load (or '*' for all classes). By default it contains all existing in-tree classes for backwards compatibility. * The 'osd class default list' config option is a list of object class names (or '*' for all classes) that clients may invoke having only the '*', 'x', 'class-read', or 'class-write' capabilities. By default it contains all existing in-tree classes for backwards compatibility. Invoking classes not listed in 'osd class default list' requires a capability naming the class (e.g. 'allow class foo'). * The 'rgw rest getusage op compat' config option allows you to dump (or not dump) the description of user stats in the S3 GetUsage API. This option defaults to false. If the value is true, the response data for GetUsage looks like:: "stats": { "TotalBytes": 516, "TotalBytesRounded": 1024, "TotalEntries": 1 } If the value is false, the response for GetUsage looks as it did before:: { 516, 1024, 1 } * The 'osd out ...' and 'osd in ...' commands now preserve the OSD weight. That is, after marking an OSD out and then in, the weight will be the same as before (instead of being reset to 1.0). Previously the mons would only preserve the weight if the mon automatically marked and OSD out and then in, but not when an admin did so explicitly. * The 'ceph osd perf' command will display 'commit_latency(ms)' and 'apply_latency(ms)'. Previously, the names of these two columns are 'fs_commit_latency(ms)' and 'fs_apply_latency(ms)'. We remove the prefix 'fs\_', because they are not filestore specific. * Monitors will no longer allow pools to be removed by default. The setting mon_allow_pool_delete has to be set to true (defaults to false) before they allow pools to be removed. This is a additional safeguard against pools being removed by accident. * If you have manually specified the monitor user rocksdb via the ``mon keyvaluedb = rocksdb`` option, you will need to manually add a file to the mon data directory to preserve this option:: echo rocksdb > /var/lib/ceph/mon/ceph-`hostname`/kv_backend New monitors will now use rocksdb by default, but if that file is not present, existing monitors will use leveldb. The ``mon keyvaluedb`` option now only affects the backend chosen when a monitor is created. * The 'osd crush initial weight' option allows you to specify a CRUSH weight for a newly added OSD. Previously a value of 0 (the default) meant that we should use the size of the OSD's store to weight the new OSD. Now, a value of 0 means it should have a weight of 0, and a negative value (the new default) means we should automatically weight the OSD based on its size. If your configuration file explicitly specifies a value of 0 for this option you will need to change it to a negative value (e.g., -1) to preserve the current behavior. * The ``osd crush location`` config option is no longer supported. Please update your ceph.conf to use the ``crush location`` option instead. * The static libraries are no longer included by the debian development packages (lib*-dev) as it is not required per debian packaging policy. The shared (.so) versions are packaged as before. * The libtool pseudo-libraries (.la files) are no longer included by the debian development packages (lib*-dev) as they are not required per https://wiki.debian.org/ReleaseGoals/LAFileRemoval and https://www.debian.org/doc/manuals/maint-guide/advanced.en.html. * The jerasure and shec plugins can now detect SIMD instruction at runtime and no longer need to be explicitly configured for different processors. The following plugins are now deprecated: jerasure_generic, jerasure_sse3, jerasure_sse4, jerasure_neon, shec_generic, shec_sse3, shec_sse4, and shec_neon. If you use any of these plugins directly you will see a warning in the mon log file. Please switch to using just 'jerasure' or 'shec'. * The librados omap get_keys and get_vals operations include a start key and a limit on the number of keys to return. The OSD now imposes a configurable limit on the number of keys and number of total bytes it will respond with, which means that a librados user might get fewer keys than they asked for. This is necessary to prevent careless users from requesting an unreasonable amount of data from the cluster in a single operation. The new limits are configured with ``osd_max_omap_entries_per_request``, defaulting to 131,072, and ``osd_max_omap_bytes_per_request``, defaulting to 4MB. * Calculation of recovery priorities has been updated. This could lead to unintuitive recovery prioritization during cluster upgrade. In case of such recovery, OSDs in the old version would operate on different priority ranges than new ones. Once upgraded, the cluster will operate on consistent values. Notable Changes --------------- * bluestore: add counter to trace blob splitting (`pr#11718 `_, xie xingguo) * bluestore: a few more cleanups (`pr#11780 `_, xie xingguo) * bluestore: avoid polluting shard info if need resharding (`pr#11439 `_, xie xingguo) * bluestore: avoid unnecessary call to init_csum() (`pr#12015 `_, xie xingguo) * bluestore: ceph-disk: adjust bluestore default device sizes (`pr#12530 `_, Sage Weil) * bluestore: ceph_test_objectstore: smaller device (`pr#11591 `_, Sage Weil) * bluestore: clean up Allocator::dump (`issue#18054 `_, `pr#12282 `_, Sage Weil) * bluestore: clear extent map on object removal (`pr#11603 `_, Sage Weil) * bluestore: compressor/ZLibCompressor: fix broken isal-l (`pr#11445 `_, Igor Fedotov) * bluestore: dedup if space overlap truly exists (`pr#11986 `_, xie xingguo) * bluestore: dedup omap_head, reuse nid instead (`pr#12275 `_, xie xingguo) * bluestore: deep fsck (`pr#11724 `_, Sage Weil) * bluestore: default bluestore_clone_cow=true (`pr#11540 `_, Sage Weil) * bluestore: drop inline_dirty from struct ExtentMap (`pr#11377 `_, xie xingguo) * bluestore: drop member "space" from Onode (`pr#12185 `_, xie xingguo) * bluestore: fix alloc release timing on sync submits (`pr#11983 `_, Sage Weil) * bluestore: fix bufferspace stats leak due to blob splitting (`pr#12039 `_, xie xingguo) * bluestore: fix collection_list end bound off-by-one (`pr#11771 `_, Sage Weil) * bluestore: fix compiler warnings (`pr#11905 `_, xie xingguo) * bluestore: fixes and cleanups (`pr#11761 `_, xie xingguo) * bluestore: fix escaping of chars > 0x80 (`pr#11502 `_, Sage Weil) * bluestore: fix extent shard span check (`pr#11725 `_, Sage Weil) * bluestore: fix has_aios (`pr#11317 `_, Sage Weil) * bluestore: Fix invalid compression statfs caused by clone op (`pr#11351 `_, Igor Fedotov) * bluestore: fix lack of resharding (`pr#11597 `_, Igor Fedotov) * bluestore: fix latency calculation (`pr#12040 `_, Pan Liu) * bluestore: fix onode vs extent key suffix (`pr#11452 `_, Sage Weil) * bluestore: fix potential memory leak (`pr#11893 `_, xie xingguo) * bluestore: fix race condtion during blob spliting (`pr#11422 `_, xiexingguo, xie xingguo) * bluestore: fix remove_collection to properly detect collection e… (`pr#11398 `_, Igor Fedotov) * bluestore: fix _split_collections race with osr_reap (`pr#11748 `_, Sage Weil) * bluestore: fix up compression tests and debug output (`pr#11350 `_, Sage Weil) * bluestore: fix writes that span existing shard boundaries (`pr#11451 `_, Sage Weil) * bluestore: flush before enumerating omap values (`issue#18140 `_, `pr#12328 `_, Sage Weil) * bluestore: formatting nits (`pr#11514 `_, xie xingguo) * bluestore: fsck: fix omap_head check (`pr#11726 `_, Sage Weil) * bluestore: GC infra refactor, more UTs and GC range calculation fixes (`pr#11482 `_, Igor Fedotov) * bluestore: KernelDevice: fix race in aio_thread vs aio_wait (`issue#17824 `_, `pr#12204 `_, Sage Weil) * bluestore: kv: dump rocksdb stats (`pr#12287 `_, Varada Kari, Jianpeng Ma, Sage Weil) * bluestore: kv/rocksdb: enable rocksdb write path breakdown (`pr#11696 `_, Haodong Tang) * bluestore: kv/RocksDBStore: rename option (`pr#11769 `_, Sage Weil) * bluestore: less code redundancy (`pr#11740 `_, xie xingguo) * bluestore: make 2q cache kin/kout size tunable (`pr#11599 `_, Haodong Tang) * bluestore: mark ops that can't tolerate ENOENT (`pr#12114 `_, Sage Weil) * bluestore: mempool: changes for bitmap allocator (`pr#11922 `_, Ramesh Chander) * bluestore: misc. fixes and cleanups (`pr#11964 `_, xie xingguo) * bluestore: move bluefs into its own mempool (`pr#11834 `_, Sage Weil) * bluestore: no garbage collection for uncompressed blobs (`pr#11539 `_, Roushan Ali, Sage Weil) * bluestore: optional debug mode to identify aio stalls (`pr#11818 `_, Sage Weil) * bluestore: os/bluestore: a few cleanups (`pr#11483 `_, Sage Weil) * bluestore: os/bluestore: avoid resharding if the last shard size fall below shar… (`pr#12447 `_, Igor Fedotov) * bluestore: os/bluestore: bitmap allocator dump functionality (`pr#12298 `_, Ramesh Chander) * bluestore: os/bluestore: bluestore_sync_submit_transaction = false (`pr#12367 `_, Sage Weil) * bluestore: os/bluestore: cleanup around Blob::ref_map (`pr#11896 `_, Igor Fedotov) * bluestore: os/bluestore: clear omap flag if parent has none (`pr#12351 `_, xie xingguo) * bluestore: os/bluestore: don't implicitly create the source object for clone (`pr#12353 `_, xie xingguo) * bluestore: os/bluestore: drop old bluestore preconditioning; replace with wal preextension of file size (`pr#12265 `_, Sage Weil) * bluestore: os/bluestore: fix global commit latency (`pr#12356 `_, xie xingguo) * bluestore: os/bluestore: fix ondisk encoding for blobs (`pr#12488 `_, Varada Kari, Sage Weil) * bluestore: os/bluestore: fix potential csum_order overflow (`pr#12333 `_, xie xingguo) * bluestore: os/bluestore: fix target_buffer value overflow in Cache::trim() (`pr#12507 `_, Igor Fedotov) * bluestore: os/bluestore: include modified objects in flush list even if onode unchanged (`pr#12541 `_, Sage Weil) * bluestore: os/bluestore: kill dead gc-related counters (`pr#12065 `_, xie xingguo) * bluestore: os/bluestore: kill overlay related options (`pr#11557 `_, xie xingguo) * bluestore: os/bluestore: misc coverity fixes/cleanups (`pr#12202 `_, Sage Weil) * bluestore: os/bluestore: preserve source collection cache during split (`pr#12574 `_, Sage Weil) * bluestore: os/bluestore: remove 'extents' from shard_info (`pr#12629 `_, Sage Weil) * bluestore: os/bluestore: simplified allocator interfaces to single apis (`pr#12355 `_, Ramesh Chander) * bluestore: os/bluestore: simplify allocator release flow (`pr#12343 `_, Sage Weil) * bluestore: os/bluestore: simplify can_split_at() (`pr#11607 `_, xie xingguo) * bluestore: os/bluestore: use iterator for erase() method directly (`pr#11490 `_, xie xingguo) * bluestore: os/kstore: rmcoll fix to satisfy store_test (`pr#11533 `_, Igor Fedotov) * bluestore: os: make filestore_blackhole -> objectstore_blackhole (`pr#11788 `_, Sage Weil) * bluestore: os: move_ranges_destroy_src (`pr#11237 `_, Manali Kulkarni, Sage Weil) * bluestore: readability improvements and doxygen fix (`pr#11895 `_, xie xingguo) * bluestore: reap collection after all pending ios done (`pr#11797 `_, Haomai Wang) * bluestore: reap ioc when stopping aio_thread. (`pr#11811 `_, Haodong Tang) * bluestore: refactor _do_write(); move initializaiton of csum out of loop (`pr#11823 `_, xie xingguo) * bluestore: remove duplicated namespace of tx state (`pr#11845 `_, xie xingguo) * bluestore: remove garbage collector staff (`pr#12042 `_, Igor Fedotov) * bluestore: set next object as ghobject_t::get_max() when start.hobj.i… (`pr#11495 `_, Xinze Chi, Haomai Wang) * bluestore: simplify blob status checking for small writes (`pr#11366 `_, xie xingguo) * bluestore: some more cleanups (`pr#11910 `_, xie xingguo) * bluestore: spdk: a few fixes (`pr#11882 `_, Yehuda Sadeh) * bluestore: speed up omap-key generation for same onode (`pr#11807 `_, xie xingguo) * bluestore: traverse buffer_map in reverse order when spliting BufferSpace (`pr#11468 `_, xie xingguo) * bluestore: update cache logger after 'trim_cache' operation (`pr#11695 `_, Haodong Tang) * bluestore: use bitmap allocator for bluefs (`pr#12285 `_, Sage Weil) * bluestore: use std::unordered_map for SharedBlob lookup (`pr#11394 `_, Sage Weil) * build/ops: AArch64: Detect crc32 extension support from assembler (`issue#17516 `_, `pr#11391 `_, Alexander Graf) * build/ops: boost: embedded (`pr#11817 `_, Sage Weil, Matt Benjamin) * build/ops: build: dump env during build (`issue#18084 `_, `pr#12284 `_, Sage Weil) * build/ops: ceph-detect-init: FreeBSD introduction of bsdrc (`pr#11906 `_, Willem Jan Withagen, Kefu Chai) * build/ops: ceph-disk: enable --runtime ceph-osd systemd units (`issue#17889 `_, `pr#12241 `_, Loic Dachary) * build/ops: ceph.spec: add pybind rgwfile (`pr#11847 `_, Haomai Wang) * build/ops,cleanup,bluestore: os/bluestore: remove build warning in a better way (`pr#11920 `_, Igor Fedotov) * build/ops: CMakeLists: add vstart-base target (`pr#12476 `_, Sage Weil) * build/ops: CMakeLists.txt: enable LTTNG by default (`pr#11500 `_, Sage Weil) * build/ops: common/buffer.cc: raw_pipe depends on splice(2) (`pr#11967 `_, Willem Jan Withagen) * build/ops,common: common/str_list.h: fix clang warning about std::move (`pr#12570 `_, Willem Jan Withagen) * build/ops,core: xio: fix build (`pr#11768 `_, Matt Benjamin) * build/ops: deb: add python dependencies where needed (`issue#17579 `_, `pr#11507 `_, Nathan Cutler, Kefu Chai) * build/ops: deb: add python-rgw packages (`pr#11832 `_, Sage Weil) * build/ops: debian: apply dh_python to python-rgw also (`pr#12260 `_, Kefu Chai) * build/ops: deb: update python-rgw dependencies to librgw2 (`pr#11885 `_, Casey Bodley) * build/ops: do_freebsd.sh: Build with SYSTEM Boost on FreeBSD (`pr#11942 `_, Willem Jan Withagen) * build/ops: do_freebsd.sh: Do not use LTTNG on FreeBSD (`pr#11551 `_, Willem Jan Withagen) * build/ops: do_freebsd.sh: Set options for debug building. (`pr#11443 `_, Willem Jan Withagen) * build/ops: FreeBSD: do_freebsd.sh (`pr#12090 `_, Willem Jan Withagen) * build/ops: FreeBSD:test/encoding/readable.sh": fix nproc and ls -v calls (`pr#11522 `_, Willem Jan Withagen) * build/ops: FreeBSD: update require packages (`pr#11512 `_, Willem Jan Withagen) * build/ops: git-archive-all.sh: use an actually unique tmp dir (`pr#12011 `_, Dan Mick) * build/ops: include/enc: make clang happy (`pr#11638 `_, Kefu Chai, Sage Weil) * build/ops: install-deps.sh: allow building on SLES systems (`pr#11708 `_, Nitin A Kamble) * build/ops: install-deps.sh: JQ is needed in one script (`pr#12080 `_, Willem Jan Withagen) * build/ops: Log: Replace namespace log with logging (`pr#11650 `_, Willem Jan Withagen) * build/ops: Merging before make check because it clearly breaks the build and the build part is done (`pr#11924 `_, Sage Weil) * build/ops: ok, w/upstream acks, merging--jenkins build did succeed (this is a build-only change) (`pr#12008 `_, Matt Benjamin) * build/ops: qa: Add ceph-ansible installer. (`issue#16770 `_, `pr#10402 `_, Warren Usui) * build/ops: rocksdb: do not build with --march=native (`pr#11677 `_, Kefu Chai) * build/ops: rocksdb: update to latest (`pr#12100 `_, Kefu Chai) * build/ops: rpm: Remove trailing whitespace in usermod command (SUSE) (`pr#10707 `_, Tim Serong) * build/ops: scripts/release-notes: allow title guesses from gh tags & description update (`pr#11399 `_, Abhishek Lekshmanan) * build/ops: systemd: Fix startup of ceph-mgr on Debian 8 (`pr#12555 `_, Mark Korenberg) * build/ops: tracing/objectstore.tp: add missing move_ranges\_... tp (`pr#11484 `_, Sage Weil) * build/ops: upstart: fix ceph-crush-location default (`issue#6698 `_, `pr#803 `_, Jason Dillaman) * build/ops: upstart: start ceph-all after static-network-up (`issue#17689 `_, `pr#11631 `_, Billy Olsen) * cephfs: add gid to asok status (`pr#11487 `_, Patrick Donnelly) * cephfs: API cleanup for libcephfs interfaces (`issue#17911 `_, `pr#12106 `_, Jeff Layton) * cephfs: ceph-fuse: start up log on parent process before shutdown (`issue#18157 `_, `pr#12347 `_, Greg Farnum) * cephfs: ceph_fuse: use sizeof get the buf length (`pr#11176 `_, LeoZhang) * cephfs,cleanup: ceph-fuse: start up log on parent process before shutdown (`issue#18157 `_, `pr#12358 `_, Kefu Chai) * cephfs: client: add pid to metadata (`issue#17276 `_, `pr#11359 `_, Patrick Donnelly) * cephfs: client: Client.cc: remove duplicated op type checking against CEPH_MD… (`pr#11608 `_, Weibing Zhang) * cephfs: client: don't take extra target inode reference in ll_link (`pr#11440 `_, Jeff Layton) * cephfs: client: fix mutex name typos (`pr#12401 `_, Yunchuan Wen) * cephfs: client: get caller's uid/gid on every libcephfs operation (`issue#17591 `_, `pr#11526 `_, Yan, Zheng) * cephfs: client: get gid from MonClient (`pr#11486 `_, Patrick Donnelly) * cephfs: client: improve failure messages/debugging (`pr#12110 `_, Patrick Donnelly) * cephfs: client/mds: Clear setuid bits when writing or truncating (`issue#18131 `_, `pr#12412 `_, Jeff Layton) * cephfs: client: put CapSnap not ptr in cap_snaps map (`pr#12111 `_, Patrick Donnelly) * cephfs: client: remove redundant initialization (`pr#12028 `_, Patrick Donnelly) * cephfs: client: remove unnecessary bufferptr[] for writev (`pr#11836 `_, Patrick Donnelly) * cephfs: client: remove unneeded layout on MClientCaps (`pr#11790 `_, John Spray) * cephfs: client: set metadata["root"] from mount method when it's called with … (`pr#12505 `_, Jeff Layton) * cephfs: client: trim_caps() do not dereference cap if it's removed (`pr#12145 `_, Kefu Chai) * cephfs: client: use unique_ptr (`pr#11837 `_, Patrick Donnelly) * cephfs: common/ceph_string: add ceph string constants for CEPH_SESSION_FORCE_RO (`pr#11516 `_, Zhi Zhang) * cephfs: Fix #17562 (backtrace check fails when scrubbing directory created by fsstress) (`issue#17562 `_, `pr#11517 `_, Yan, Zheng) * cephfs: fix missing ll_get for ll_walk (`issue#18086 `_, `pr#12061 `_, Gui Hecheng) * cephfs: get new fsmap after marking clusters down (`issue#7271 `_, `issue#17894 `_, `pr#1262 `_, Patrick Donnelly) * cephfs: Have ceph clear setuid/setgid bits on chown (`issue#18131 `_, `pr#12331 `_, Jeff Layton) * cephfs: libcephfs: add ceph_fsetattr&&ceph_lchmod&&ceph_lutime (`pr#11191 `_, huanwen ren) * cephfs: libcephfs: add readlink function in cephfs.pyx (`pr#12384 `_, huanwen ren) * cephfs: libcephfs and test suite fixes (`issue#18013 `_, `issue#17982 `_, `pr#12228 `_, Jeff Layton) * cephfs: libcephfs client API overhaul and update (`pr#11647 `_, Jeff Layton) * cephfs: lua: use simpler lua_next traversal structure (`pr#11958 `_, Patrick Donnelly) * cephfs: mds/Beacon: move C_MDS_BeaconSender class to .cc (`pr#10940 `_, Michal Jarzabek) * cephfs: mds/CDir.cc: remove unneeded use of count (`pr#11613 `_, Michal Jarzabek) * cephfs: mds/CInode.h: remove unneeded use of count (`pr#11371 `_, Michal Jarzabek) * cephfs: mds/DamageTable.cc: move shared ptrs (`pr#11435 `_, Michal Jarzabek) * cephfs: mds/DamageTable.cc: remove unneeded use of count (`pr#11625 `_, Michal Jarzabek) * cephfs: mds/DamageTable: move classes to .cc file (`pr#11450 `_, Michal Jarzabek) * cephfs: mds/flock: add const to member functions (`pr#11692 `_, Michal Jarzabek) * cephfs: mds/FSMap.cc: remove unneeded use of count (`pr#11402 `_, Michal Jarzabek) * cephfs: mds/FSMapUser.h: remove copy ctr and assign op (`pr#11509 `_, Michal Jarzabek) * cephfs: mds/InfoTable.h: add override to virtual functs (`pr#11496 `_, Michal Jarzabek) * cephfs: mds/InoTable.h: add override to virtual functs (`pr#11604 `_, Michal Jarzabek) * cephfs: mds/Mantle.h: include correct header files (`pr#11886 `_, Michal Jarzabek) * cephfs: mds/Mantle: pass parameters by const ref (`pr#11713 `_, Michal Jarzabek) * cephfs: mds/MDCache.h: remove unneeded call to clear func (`pr#11954 `_, Michal Jarzabek) * cephfs: mds/MDCache.h: remove unused functions (`pr#11908 `_, Michal Jarzabek) * cephfs: mds/MDLog: add const to member functions (`pr#11663 `_, Michal Jarzabek) * cephfs: mds/MDSMap.h: add const to member functions (`pr#11511 `_, Michal Jarzabek) * cephfs: mds/MDSRank: add const to member functions (`pr#11752 `_, Michal Jarzabek) * cephfs: mds/MDSRank.h: add override to virtual function (`pr#11727 `_, Michal Jarzabek) * cephfs: mds/MDSRank.h: make destructor protected (`pr#11651 `_, Michal Jarzabek) * cephfs: mds/MDSTableClient.h: add const to member funct (`pr#11681 `_, Michal Jarzabek) * cephfs: mds/Migrator.cc: remove unneeded use of count (`pr#11523 `_, Michal Jarzabek) * cephfs: mds/Migrator.h: add const to member functions (`pr#11819 `_, Michal Jarzabek) * cephfs: mds/Migrator.h: remove unneeded use of count (`pr#11833 `_, Michal Jarzabek) * cephfs: mds/Mutation.h: add const to member functions (`pr#11670 `_, Michal Jarzabek) * cephfs: mds/Mutation.h: simplify constructors (`pr#11455 `_, Michal Jarzabek) * cephfs: MDS: reduce usage of context wrapper (`pr#11560 `_, Yan, Zheng) * cephfs: mds/ScrubHeader.h: pass string by const reference (`pr#11904 `_, Michal Jarzabek) * cephfs: mds/server: merge the snapshot request judgment (`pr#11150 `_, huanwen ren) * cephfs: mds/SessionMap: add const to member functions (`pr#11541 `_, Michal Jarzabek) * cephfs: mds/SessionMap.cc: avoid copying and add const (`pr#11297 `_, Michal Jarzabek) * cephfs: mds/SessionMap.cc:put classes in unnamed namespace (`pr#11316 `_, Michal Jarzabek) * cephfs: mds/SessionMap.cc: remove unneeded use of count (`pr#11338 `_, Michal Jarzabek) * cephfs: mds/SessionMap.h: remove unneeded function (`pr#11565 `_, Michal Jarzabek) * cephfs: mds/SessionMap.h: remove unneeded use of count (`pr#11358 `_, Michal Jarzabek) * cephfs: mds/SnapRealm: remove unneeded use of count (`pr#11609 `_, Michal Jarzabek) * cephfs: mds/SnapServer.h: add override to virtual functs (`pr#11380 `_, Michal Jarzabek) * cephfs: mds/SnapServer.h: add override to virtual functs (`pr#11583 `_, Michal Jarzabek) * cephfs: mon/MDSMonitor: fix iterating over mutated map (`issue#18166 `_, `pr#12395 `_, John Spray) * cephfs: multimds: fix state check in Migrator::find_stale_export_freeze() (`pr#12098 `_, Yan, Zheng) * cephfs: osdc: After write try merge bh. (`issue#17270 `_, `pr#11545 `_, Jianpeng Ma) * cephfs: Partial organization of mds/ header sections (`pr#11959 `_, Patrick Donnelly) * cephfs: Port/bootstrap (`pr#827 `_, Yan, Zheng) * cephfs: Revert "osdc: After write try merge bh." (`issue#17270 `_, `pr#11262 `_, John Spray) * cephfs: Small pile of random cephfs fixes and cleanup (`pr#11421 `_, Jeff Layton) * cephfs: src/mds: fix MDSMap upgrade decoding (`issue#17837 `_, `pr#12097 `_, John Spray) * cephfs: systemd: add ceph-fuse service file (`pr#11542 `_, Patrick Donnelly) * cephfs: test fragment size limit (`issue#16164 `_, `pr#1069 `_, Patrick Donnelly) * cephfs: test readahead is working (`issue#16024 `_, `pr#1046 `_, Patrick Donnelly) * cephfs: test: temporarily remove fork()ing flock tests (`issue#16556 `_, `pr#11211 `_, John Spray) * cephfs: tool/cephfs: displaying "list" in journal event mode (`pr#11236 `_, huanwen ren) * cephfs: tools/cephfs: add pg_files command (`issue#17249 `_, `pr#11026 `_, John Spray) * cephfs: tools/cephfs: add scan_links command which fixes linkages errors (`pr#11446 `_, Yan, Zheng) * cephfs: update tests to enable multimds when needed (`pr#933 `_, Greg Farnum) * cleanup: build: The Light Clangtastic (`pr#11921 `_, Adam C. Emerson) * cleanup,common: common/blkdev: use realpath instead of readlink to resolve the recurs… (`pr#12462 `_, Xinze Chi) * cleanup,common: common/throttle: simplify Throttle::_wait() (`pr#11165 `_, xie xingguo) * cleanup,common: src/common: remove nonused config option (`pr#12311 `_, Wei Jin) * cleanup: coverity fix: fixing few coverity issue (`pr#9624 `_, Gaurav Kumar Garg) * cleanup: deprecate readdir_r() with readdir() (`pr#11805 `_, Kefu Chai) * cleanup: erasure-code: fix gf-complete warning (`pr#12150 `_, Kefu Chai) * cleanup: fix typos (`pr#12502 `_, xianxiaxiao) * cleanup: mds/FSMap.cc: prevent unneeded copy of map entry (`pr#11798 `_, Michal Jarzabek) * cleanup: mds/FSMap.h: add const and reference (`pr#11802 `_, Michal Jarzabek) * cleanup: mds/FSMap: pass shared_ptr by const ref (`pr#11383 `_, Michal Jarzabek) * cleanup: mds/SnapServer: add const to member function (`pr#11688 `_, Michal Jarzabek) * cleanup: mon/MonCap.h: add std::move for std::string (`pr#10722 `_, Michal Jarzabek) * cleanup: mon/OSDMonitor: only show interesting flags in health warning (`issue#18175 `_, `pr#12365 `_, Sage Weil) * cleanup: msg/async: assert(0) -> ceph_abort() (`pr#12339 `_, Li Wang) * cleanup: msg/AsyncMessenger: remove unneeded include (`pr#9846 `_, Michal Jarzabek) * cleanup: msg/async/rdma: fix disconnect log line (`pr#12254 `_, Adir Lev) * cleanup: msg/async: remove unused member variable (`pr#12387 `_, Kefu Chai) * cleanup: msg: fix format specifier for unsigned value id (`pr#11145 `_, Weibing Zhang) * cleanup: msg/Pipe: move DelayedDelivery class to cc file (`pr#10447 `_, Michal Jarzabek) * cleanup: msg/test: fix the guided compile-command to ceph_test_msgr (`pr#10490 `_, Yan Jun) * cleanup: osd/PGBackend: build_push_op segment fault (`pr#9357 `_, Zengran Zhang) * cleanup: osd/PG.h: change PGRecoveryStats struct to class (`pr#11178 `_, Michal Jarzabek) * cleanup: osd/PG.h: remove unneeded forward declaration (`pr#12135 `_, Li Wang) * cleanup: osd/ReplicatedPG: remove unneeded use of count (`pr#11251 `_, Michal Jarzabek) * cleanup: os/filestore: clean filestore perfcounters (`pr#11524 `_, Wei Jin) * cleanup: os/fs/FS.cc: condition on WITH_AIO for FreeBSD (`pr#11913 `_, Willem Jan Withagen) * cleanup,rbd: cls_rbd: silence compiler warnings (`pr#11363 `_, xiexingguo) * cleanup,rbd: journal: avoid logging an error when a watch is blacklisted (`issue#18243 `_, `pr#12473 `_, Jason Dillaman) * cleanup,rbd: journal: prevent repetitive error messages after being blacklisted (`issue#18243 `_, `pr#12497 `_, Jason Dillaman) * cleanup,rbd: librbd/ImageCtx: no need for virtual dtor (`pr#12220 `_, Sage Weil) * cleanup,rbd: rbd-mirror: configuration overrides for hard coded timers (`pr#11840 `_, Dongsheng Yang) * cleanup,rbd: rbd-mirror: set SEQUENTIAL and NOCACHE advise flags on image sync (`issue#17127 `_, `pr#12280 `_, Mykola Golub) * cleanup: remove unneeded forward declaration (`pr#12257 `_, Li Wang, Yunchuan Wen) * cleanup: remove unused declaration (`pr#12466 `_, Li Wang, Yunchuan Wen) * cleanup,rgw: rgw multisite: move lease up to RunBucketSync instead of child crs (`pr#11598 `_, Casey Bodley) * cleanup,rgw: rgw/rest: don't print empty x-amz-request-id (`pr#10674 `_, Marcus Watts) * cleanup,rgw: verified: f23 (`pr#12103 `_, Radoslaw Zarzynski) * cleanup: src/common/perf_counters.h: fix wrong word (`pr#11690 `_, zhang.zezhu) * cleanup: Wip ctypos (`pr#12495 `_, xianxiaxiao) * cleanup: xio: provide dout_prefix for XioConnection (`pr#9444 `_, Avner BenHanoch) * cleanup: yasm-wrapper: translate "-isystem $1" to "-i $1" (`pr#12093 `_, Kefu Chai) * cmake: add -Wno-unknown-pragmas to CMAKE_CXX_FLAGS (`pr#12128 `_, Kefu Chai) * cmake: check WITH_RADOSGW for fcgi and expat dependencies (`pr#11481 `_, David Disseldorp) * cmake: compile C code with c99 (`pr#12369 `_, Kefu Chai) * cmake: detect keyutils if WITH_LIBCEPHFS OR WITH_RBD (`pr#12359 `_, Kefu Chai) * cmake: do not link erasure tests again libosd (`pr#11738 `_, Kefu Chai) * cmake: find gperftools package for tcmalloc_minimal too (`pr#11403 `_, Bassam Tabbara) * cmake: fix boost build on ubuntu 16.10 yakkety (`pr#12143 `_, Bassam Tabbara) * cmake: Fix for cross compiling (`pr#11404 `_, Bassam Tabbara) * cmake: fix git version string, cleanup (`pr#11661 `_, Sage Weil) * cmake: librbd cleanup (`pr#11842 `_, Kefu Chai) * cmake: link tests against static librados (`issue#17260 `_, `pr#11575 `_, Kefu Chai) * cmake: pass CMAKE_BUILD_TYPE down to rocksdb (`pr#11767 `_, Kefu Chai) * cmake: remove include/Makefile.am (`pr#11666 `_, Kefu Chai) * cmake: replace civetweb symlink w/file copy (`pr#11900 `_, Matt Benjamin) * cmake: should link against ${ALLOC_LIBS} (`pr#11978 `_, Kefu Chai) * cmake: src/test/CMakeLists.txt: Exclude test on HAVE_BLKID (`pr#12301 `_, Willem Jan Withagen) * cmake: Support for embedding Ceph Daemons (`pr#11764 `_, Bassam Tabbara) * cmake: use external project for rocksdb (`pr#11385 `_, Bassam Tabbara) * common: Add throttle_get_started perf counter (`pr#12163 `_, Bartłomiej Święcki) * common: assert(0) -> ceph_abort() (`pr#12031 `_, Sage Weil) * common: auth: fix NULL pointer access when trying to delete CryptoAESKeyHandler instance (`pr#11614 `_, runsisi) * common,bluestore: compressor: fixes and tests; disable zlib isal (it's broken) (`pr#11349 `_, Sage Weil) * common,bluestore: mempool: mempool infrastructure, bluestore changes to use it (`pr#11331 `_, Allen Samuels, Sage Weil) * common: buffer: add advance(unsigned) back (`issue#17809 `_, `pr#11993 `_, Kefu Chai) * common: buffer: add copy(unsigned, ptr) back (`issue#17809 `_, `pr#12246 `_, Kefu Chai) * common: client/Client.cc: fix/silence "logically dead code" CID-Error (`pr#291 `_, Yehuda Sadeh) * common: common/strtol.cc: Get error testing also to work on FreeBSD (`pr#12034 `_, Willem Jan Withagen) * common: fix clang compilation error (`pr#12565 `_, Mykola Golub) * common: FreeBSD/EventKqueue.{h,cc} Added code to restore events on (thread)fork (`pr#11430 `_, Willem Jan Withagen) * common: log/LogClient: fill seq & who for syslog and graylog (`issue#16609 `_, `pr#10196 `_, Xiaoxi Chen) * common: make l_finisher_complete_lat more accurate (`pr#11637 `_, Pan Liu) * common: msg/simple/Accepter.cc: replace shutdown() with selfpipe event in poll() (FreeBSD) (`pr#10720 `_, Willem Jan Withagen) * common: osdc/Objecter: fix relock race (`issue#17942 `_, `pr#12234 `_, Sage Weil) * common: osdc/Objecter: handle race between calc_target and handle_osd_map (`issue#17942 `_, `pr#12055 `_, Sage Weil) * common: osd/osdmap: fix divide by zero error (`pr#12521 `_, Yunchuan Wen) * common: release g_ceph_context before returns (`issue#17762 `_, `pr#11733 `_, Kefu Chai) * common: Remove the runtime dependency on lsb_release (`issue#17425 `_, `pr#11365 `_, Brad Hubbard) * common: test/fio: fix global CephContext life cycle (`pr#12245 `_, Igor Fedotov) * core: auth: tolerate missing MGR keys during upgrade (`pr#11401 `_, Sage Weil) * core,bluestore: os/bluestore: fix warning and uninit variable (`pr#12032 `_, Sage Weil) * core,bluestore: os: fix offsets for move_ranges operation (`pr#11595 `_, Sage Weil) * core,bluestore: os: remove move_ranges_destroy_src (`pr#11791 `_, Sage Weil) * core: ceph-disk: allow using a regular file as a journal (`issue#17662 `_, `pr#11619 `_, Jayashree Candadai, Loic Dachary) * core: ceph-disk: resolve race conditions (`issue#17889 `_, `issue#17813 `_, `pr#12136 `_, Loic Dachary) * core,cephfs: osdc/ObjectCacher: wake up dirty stat waiters after removing buffers (`issue#17275 `_, `pr#11593 `_, Yan, Zheng) * core: ceph.in: allow 'flags' to not be present in cmddescs (`issue#18297 `_, `pr#12540 `_, Dan Mick) * core,cleanup: ceph-disk: do not create bluestore wal/db partitions by default (`issue#18291 `_, `pr#12531 `_, Loic Dachary) * core,cleanup,common: common/TrackedOp: remove unused 'now' in _dump() (`pr#12007 `_, John Spray) * core,cleanup: FileStore: Only verify split when it has been really done and done correctly (`pr#11731 `_, Li Wang) * core,cleanup: kv: remove snapshot iterator (`pr#12049 `_, Sage Weil) * core,cleanup: mon/MonClient.h: remove repeated searching of map (`pr#10601 `_, Michal Jarzabek) * core,cleanup: msg: Fix typos in socket creation error message (`pr#11907 `_, Brad Hubbard) * core,cleanup: osd/command tell: check pgid at the right time (`pr#11547 `_, Javeme) * core,cleanup: osd/OSDMap.cc: fix duplicated assignment for new_blacklist_entries (`pr#11799 `_, Ker Liu) * core,cleanup: osd/PG.cc: prevent repeated searching of map/set (`pr#11203 `_, Michal Jarzabek) * core,cleanup: osd/ReplicatedPG: remove redundant check for balance/localize read (`pr#10209 `_, runsisi) * core,cleanup: osd/ReplicatedPG: remove unneeded use of count (`pr#11242 `_, Michal Jarzabek) * core,cleanup: os/filestore: handle EINTR returned by io_getevents() (`pr#11890 `_, Pan Liu) * core,cleanup: os/ObjectStore: remove legacy tbl support (`pr#11770 `_, Jianpeng Ma) * core,cleanup: scan build fixes (`pr#12148 `_, Kefu Chai) * core,cleanup: src: rename ReplicatedPG to PrimaryLogPG (`pr#12487 `_, Samuel Just) * core,cleanup: Wip scrub misc (`pr#11397 `_, David Zafman) * core,common: buffer: put buffers in buffer_{data,meta} mempools (`pr#11839 `_, Sage Weil) * core,common: msg: add entity_addr_t types; add new entity_addrvec_t type (`pr#9825 `_, Zhao Junwang, Sage Weil) * core,common: msg/simple/Pipe: handle addr decode error (`issue#18072 `_, `pr#12221 `_, Sage Weil) * core: compress: Fix compilation failure from missing header (`pr#12108 `_, Adam C. Emerson) * core: denc: don't pass null instances into encoder fns (`issue#17636 `_, `pr#11577 `_, John Spray) * core: erasure-code: synchronize with upstream gf-complete (`issue#18092 `_, `pr#12382 `_, Loic Dachary) * core: FreeBSD/OSD.cc: add client_messenger to the avoid_ports set. (`pr#12463 `_, Willem Jan Withagen) * core: include/object: pass "snapid_t&" to bound_encode() (`pr#11552 `_, Kefu Chai) * core: kv/RocksDBStore: Don't update rocksdb perf_context if rocksdb_perf di… (`pr#12064 `_, Jianpeng Ma) * core: librados-dev: install inline_memory.h (`issue#17654 `_, `pr#11730 `_, Josh Durgin) * core: messages/MForward: reencode forwarded message if target has differing features (`pr#11610 `_, Sage Weil) * core,mgr: messages: fix out of range assertion (`pr#11345 `_, John Spray) * core: mon,ceph-disk: add lockbox permissions to bootstrap-osd (`issue#17849 `_, `pr#11996 `_, Loic Dachary) * core: mon: make it more clearly to debug for paxos state (`pr#12438 `_, song baisen) * core: mon/OSDMonitor: encode full osdmaps with features all OSDs can understand (`pr#11284 `_, Sage Weil) * core: mon/OSDMonitor: encode OSDMap::Incremental with same features as OSDMap (`pr#11596 `_, Sage Weil) * core: mon/OSDMonitor: newly created osd should not be wrongly marked in (`pr#11795 `_, runsisi) * core: mon/OSDMonitor: remove duplicate jewel/kraken flag warning (`pr#11775 `_, Josh Durgin) * core: mon/PGMap: PGs can be stuck more than one thing (`issue#17515 `_, `pr#11339 `_, Sage Weil) * core: mon: print the num_pools and num_objects in 'ceph -s -f json/json-p… (`issue#17703 `_, `pr#11654 `_, huangjun) * core: msg/async/AsyncConnection: dispatch write handler on keepalive2 (`issue#17664 `_, `pr#11601 `_, Ilya Dryomov) * core: msg/async: DPDKStack as AsyncMessenger backend (`pr#10748 `_, Haomai Wang) * core: msg/async/rdma: change log level: 0 -> 1 (`pr#12334 `_, Avner BenHanoch) * core: msg/async/rdma: don't use more buffers than what device capabilities … (`pr#12263 `_, Avner BenHanoch) * core: msg/async/rdma: ensure CephContext existed (`pr#12068 `_, Haomai Wang) * core: msg/async/rdma: event polling thread can block on event (`pr#12270 `_, Haomai Wang) * core: msg/async/rdma: fixup memory free (`pr#12236 `_, gongchuang) * core: msg/async/rdma: set correct value to memory manager (`pr#12299 `_, Adir Lev) * core: msg/async: set nonce before starting the workers (`pr#12390 `_, Kefu Chai) * core: msg: make loopback Connection feature accurate all the time (`pr#11183 `_, Sage Weil) * core: msg: seed random engine used for ms_type="random" (`pr#11880 `_, Casey Bodley) * core: msg/simple/Pipe: avoid returning 0 on poll timeout (`issue#18184 `_, `pr#12375 `_, Sage Weil) * core: msg/simple/Pipe::stop_and_wait: unlock pipe_lock for stop_fast_dispatching() (`issue#18042 `_, `pr#12307 `_, Samuel Just) * core: msg/simple: save the errno in case being changed by subsequent codes (`pr#10297 `_, Yan Jun) * core: osd/ECTransaction: only write out the hinfo if not delete (`issue#17983 `_, `pr#12141 `_, Samuel Just) * core: OSDMonitor: only reject MOSDBoot based on up_from if inst matches (`issue#17899 `_, `pr#12003 `_, Samuel Just) * core: osd,mon: require sortbitwise flag to upgrade beyond jewel (`pr#11772 `_, Sage Weil) * core: osd/osd_types: fix the osd_stat_t::decode() (`pr#12235 `_, Kefu Chai) * core: osd/PG: add "down" pg state (distinct from down+peering) (`pr#12289 `_, Sage Weil) * core: osd/PGLog::proc_replica_log,merge_log: fix bound for last_update (`issue#18127 `_, `pr#12340 `_, Samuel Just) * core: osd/ReplicatedPG: do_update_log_missing: take the pg lock in the callback (`issue#17789 `_, `pr#11754 `_, Samuel Just) * core: osd/ReplicatedPG::record_write_error: don't leak orig_reply on cancel (`issue#18180 `_, `pr#12450 `_, Samuel Just) * core: os/filestore: avoid to get the wrong hardlink number. (`pr#11841 `_, huangjun) * core: os/filestore/chain_xattr.h:uses ENODATA, so include compat.h (`pr#12279 `_, Willem Jan Withagen) * core: os/filestore: Fix erroneous WARNING: max attr too small (`issue#17420 `_, `pr#11246 `_, Brad Hubbard) * core: os/FileStore: fix fiemap issue in xfs when #extents > 1364 (`pr#11554 `_, Ning Yao) * core: os/filestore: fix journal logger (`pr#12099 `_, Wei Jin) * core: os/filestore: fix potential result code overwriting (`pr#11491 `_, xie xingguo) * core: os/filestore/HashIndex: fix list_by_hash_* termination on reaching end (`issue#17859 `_, `pr#11898 `_, Sage Weil) * core: os/ObjectStore: properly clear object map when replaying OP_REMOVE (`issue#17177 `_, `pr#11388 `_, Yan, Zheng) * core,performance: msg/async: ibverbs/rdma support (`pr#11531 `_, Haomai Wang, Zhi Wang) * core,performance: osd/OSDMap.cc: remove unneeded use of count (`pr#11221 `_, Michal Jarzabek) * core,performance: osd/PrimaryLogPG: don't truncate if we don't have to for WRITEFULL (`pr#12534 `_, Samuel Just) * core,performance: os/fs/FS: optimize aio::pwritev which make caller provide length. (`pr#9062 `_, Jianpeng Ma) * core,pybind,common: python-rados: implement new aio_execute (`pr#12140 `_, Iain Buclaw) * core,rbd,bluestore,rgw,performance,cephfs: fast denc encoding (`pr#11027 `_, Sage Weil) * core: remove spurious executable permissions on source code files (`pr#1061 `_, Samuel Just) * core: ReplicatedPG::failed_push: release read lock on failure (`issue#17857 `_, `pr#11914 `_, Kefu Chai) * core: rocksdb: update to latest, and make it the default for the mons (`pr#11354 `_, Sage Weil) * core: set dumpable flag after setuid (`issue#17650 `_, `pr#11582 `_, Patrick Donnelly) * core: systemd/ceph-disk: reduce ceph-disk flock contention (`issue#18049 `_, `issue#13160 `_, `pr#12200 `_, David Disseldorp) * core: tchaikov (`issue#17713 `_, `pr#11382 `_, Haomai Wang) * core,tests: ceph_test_rados_api_tier: dump hitset that we fail to decode (`issue#17945 `_, `pr#12057 `_, Sage Weil) * core,tests: common osd: Improve scrub analysis, list-inconsistent-obj output and osd-scrub-repair test (`issue#18114 `_, `pr#9613 `_, Kefu Chai, David Zafman) * core,tests: test,cmake: turn unit.h into unit.cc to speed up compilation (`pr#12194 `_, Kefu Chai) * core,tests: test/rados/list.cc: Memory leak in ceph_test_rados_api_list (`issue#18250 `_, `pr#12479 `_, Brad Hubbard) * core,tests: workunits/ceph-helpers.sh: Fixes for FreeBSD (`pr#12085 `_, Willem Jan Withagen) * core,tools: Added append functionality to rados tool. (`pr#11036 `_, Tomy Cheru) * core,tools: Tested-by: Huawen Ren (`issue#17400 `_, `pr#11276 `_, Kefu Chai) * core,tools: vstart: decrease pool size if <3 OSDs (`pr#11528 `_, John Spray) * crush: make counting of choose_tries consistent (`issue#17229 `_, `pr#10993 `_, Vicente Cheng) * crush: remove the crush_lock (`pr#11830 `_, Adam C. Emerson) * crush: Silence coverity warnings for test/crush/crush.cc (`pr#12436 `_, Brad Hubbard) * doc: Add doc about osd scrub {during recovery|chunk {min|max}| sleep} (`pr#12176 `_, Paweł Sadowski) * doc: Add docs about looking up Monitors through DNS (`issue#14527 `_, `pr#10852 `_, Wido den Hollander) * doc: add docs for raw compression (`pr#12244 `_, Casey Bodley) * doc: Add documentation about mon_allow_pool_delete before pool remove (`pr#11943 `_, Wido den Hollander) * doc: add infernalis EOL date (`pr#11925 `_, Ken Dreyer) * doc: adding changelog for v10.2.4 (`pr#12346 `_, Abhishek Lekshmanan) * doc: Add MON docs about pool flags and pool removal config settings (`pr#10853 `_, Wido den Hollander) * doc: add python-rgw doc (`pr#11859 `_, Kefu Chai) * doc: change the osd_max_backfills default to 1 (`issue#17701 `_, `pr#11658 `_, huangjun) * doc: clarify file deletion from OSD restricted pool behaviour (`issue#17937 `_, `pr#12054 `_, David Disseldorp) * doc: clarify mds deactivate purpose (`pr#11957 `_, Patrick Donnelly) * doc: common/Throttle: fix typo for BackoffThrottle (`pr#12129 `_, Wei Jin) * doc: correcting the object name (`pr#12354 `_, Uday Mullangi) * doc: Correcting the sample python tempurl generation script. (`issue#15258 `_, `pr#8712 `_, Diwakar Goel) * doc: Coverity and SCA fixes (`pr#7784 `_, Danny Al-Gaaf) * doc: doc/dev/osd_internals: add pgpool.rst (`pr#12500 `_, Brad Hubbard) * doc: doc/dev/perf: a few notes on perf (`pr#12168 `_, Sage Weil) * doc: doc/dev/perf: fix dittography (`pr#12317 `_, xie xingguo) * doc: doc/man: avoid file builtin to solve build error (`pr#11984 `_, Patrick Donnelly) * doc: doc/rados/configuration/ms-ref.rst: document a few async msgr options (`pr#12126 `_, Piotr Dałek) * doc: doc/rados/configuration/osd-config-ref.rst: document the fast mark down (`pr#12124 `_, Piotr Dałek) * doc: doc/release-notes: kraken release notes (draft) (`pr#12338 `_, Sage Weil) * doc: doc/releases: add links to kraken and v10.2.4 (`pr#12409 `_, Kefu Chai) * doc: doc/start/hardware-recommentdations: cosmetic (`pr#10585 `_, Zhao Junwang) * doc: Documentation syntax cleanup (`pr#11784 `_, John Spray) * doc: document osd tell bench (`issue#5431 `_, `pr#16 `_, Sage Weil) * doc: drop --journal-check from ceph-mds man page (`issue#17747 `_, `pr#11912 `_, Nathan Cutler) * doc: explain rgw_fcgi_socket_backlog in rgw/config-ref.rst (`pr#12548 `_, liuchang0812) * doc: final additions to 11.1.0-rc release notes (`pr#12448 `_, Abhishek Lekshmanan) * doc: Fix broken link for caps (`issue#17587 `_, `pr#11546 `_, Uday Mullangi) * doc: fix broken links (`issue#17587 `_, `pr#11518 `_, Uday Mullangi) * doc: fix dead link "Hardware Recommendations" (`pr#11379 `_, Leo Zhang) * doc: fix dead link of "os-recommendations" in troubleshooting-osd (`pr#11454 `_, Leo Zhang) * doc: Fixed mapping error in legacy mds command (`pr#11668 `_, Malte Fiala) * doc: Fix for worker arguments to cephfs-data-scan tool (`pr#12360 `_, Wido den Hollander) * doc: fix grammar/spelling in RGW sections (`pr#12329 `_, Ken Dreyer) * doc: Fixing the broken hyperlinks by pointing to correct documentation. (`pr#11617 `_, Uday Mullangi) * doc: fix librados example programs (`pr#11302 `_, Alexey Sheplyakov) * doc: fix mgr literal block rST syntax (`pr#11652 `_, Ken Dreyer) * doc: fix start development cluster operation in index.rst (`pr#11233 `_, Leo Zhang) * doc: fix the script for rebuild monitor db (`pr#11962 `_, Kefu Chai) * doc: fix typos (`pr#8751 `_, Li Peng) * doc: Flag deprecated mds commands and omit deprecated mon commands in help output (`pr#11434 `_, Patrick Donnelly) * doc: mailmap: change personal info (`pr#12310 `_, Wei Jin) * doc: mailmap updates sept (`pr#10955 `_, Yann Dupont) * doc: mds: fixup "mds bal mode" Description (`pr#12127 `_, huanwen ren) * doc: mention corresponding libvirt section in nova.conf (`pr#12584 `_, Marc Koderer) * doc: Modify documentation for mon_osd_down_out_interval (`pr#12408 `_, Brad Hubbard) * doc: network-protocol typos (`pr#9837 `_, Zhao Junwang) * doc: openstack glance mitaka uses show_multiple_locations (`pr#12020 `_, Sébastien Han) * doc: README.FreeBSD: update to match the bimonthly FreeBSD status report (`pr#11442 `_, Willem Jan Withagen) * doc: README: hint at where to look to diagnose test failures (`pr#11903 `_, Dan Mick) * doc: reformat SubmittingPatches with more rst syntax (`pr#11570 `_, Kefu Chai) * doc: release notes for 10.2.4 (`pr#12053 `_, Abhishek Lekshmanan) * doc: release notes for 10.2.5 (`issue#18207 `_, `pr#12410 `_, Loic Dachary) * doc: release notes for 11.0.2 (`pr#11369 `_, Abhishek Lekshmanan) * doc: Remove duplicate command for Ubuntu (`pr#12186 `_, chrone) * doc: reviewed-by: John Wilkins (`issue#17526 `_, `pr#11352 `_, Loic Dachary) * doc: reviewed-by: John Wilkins (`issue#17665 `_, `pr#11602 `_, Jason Dillaman) * doc: rgw: fix a typo in S3 java api example (`pr#11762 `_, Weibing Zhang) * doc: rm "type=rpm-md" from yum repositories (`pr#10248 `_, Ken Dreyer) * doc: Small styling fix to mirror documentation (`pr#9714 `_, Wido den Hollander) * doc: src/doc: fix class names in exports.txt (`pr#12000 `_, John Spray) * doc: standardize EPEL instructions (`pr#11653 `_, Ken Dreyer) * doc: update cinder key permissions for mitaka (`pr#12211 `_, Sébastien Han) * doc: Update crush-map.rst, fix a typo mistake (`pr#11785 `_, whu_liuchang) * doc: Update filestore xattr config documentation. (`pr#11826 `_, Bartłomiej Święcki) * doc: Update install-ceph-gateway.rst (`pr#11432 `_, Hans van den Bogert) * doc: Update keystone doc about v3 options (`pr#11392 `_, Proskurin Kirill) * doc: Update layout.rst, move commands to CODE block (`pr#11987 `_, liuchang0812) * doc: we can now run multiple MDS, so qualify warning (`issue#18040 `_, `pr#12184 `_, Nathan Cutler) * fs: add snapshot tests to mds thrashing (`pr#1073 `_, Yan, Zheng) * fs: enable ceph-fuse permission checking for all pjd suites (`pr#1187 `_, Greg Farnum) * fs: fix two frag_enable fragments (`issue#6143 `_, `pr#656 `_, Sage Weil) * fs: fix up dd testing again (`issue#10861 `_, `pr#373 `_, Greg Farnum) * fs: fuse_default_permissions = 0 for kernel build test (`pr#1109 `_, Patrick Donnelly) * fs: Mantle: A Programmable Metadata Load Balancer (`pr#10887 `_, Michael Sevilla) * fs: unify common parts of sub-suites (`issue#1737 `_, `pr#1282 `_, Patrick Donnelly) * librados: Add rados_aio_exec to the C API (`pr#11709 `_, Iain Buclaw) * librados: add timeout to watch/notify (`pr#11378 `_, Ryne Li) * librados: do not request osd ack if no completed completion is set (`pr#11204 `_, Sage Weil) * librados: For C-API, expose LIBRADOS_OPERATION_FULL_FORCE flag (`pr#9172 `_, Jianpeng Ma) * librados: improvements async IO in librados and libradosstriper (`pr#10049 `_, Sebastien Ponce) * librados: Memory leaks in object_list_begin and object_list_end (`issue#18252 `_, `pr#12482 `_, Brad Hubbard) * librados: postpone cct deletion (`pr#11659 `_, Kefu Chai) * librados: remove new setxattr overload to avoid breaking the C++ ABI (`issue#18058 `_, `pr#12206 `_, Josh Durgin) * librados: remove unused bufferlist from rados_write_op_rmxattr (`pr#12030 `_, Piotr Dałek) * librbd: add support for snapshot namespaces (`pr#11160 `_, Victor Denisov) * librbd: API changes to support separate data pool (`pr#11353 `_, Jason Dillaman) * librbd: batch object map updates during trim (`issue#17356 `_, `pr#11510 `_, Venky Shankar) * librbd: bug fixes for optional data pool support (`pr#11960 `_, Venky Shankar) * librbd: cannot access non-primary image when mirroring force disabled (`issue#16740 `_, `issue#17588 `_, `pr#11568 `_, Jason Dillaman) * librbd: cls_rbd updates for separate data pool (`issue#17422 `_, `pr#11327 `_, Jason Dillaman) * librbd: default features should be negotiated with the OSD (`issue#17010 `_, `pr#11808 `_, Mykola Golub) * librbd: diffs to clone's first snapshot should include parent diffs (`issue#18068 `_, `pr#12218 `_, Jason Dillaman) * librbd: do not create empty object map object on image creation (`issue#17752 `_, `pr#11704 `_, Jason Dillaman) * librbd: enabling/disabling rbd feature should report missing dependency (`issue#16985 `_, `pr#12238 `_, Gaurav Kumar Garg) * librbd: ensure consistency groups will gracefully fail on older OSDs (`pr#11623 `_, Jason Dillaman) * librbd: exclusive lock incorrectly initialized when switching to head revision (`issue#17618 `_, `pr#11559 `_, Jason Dillaman) * librbd: fix rollback if failed to disable mirroring for image (`pr#11260 `_, runsisi) * librbd: ignore error when object map is already locked by current client (`issue#16179 `_, `pr#12484 `_, runsisi) * librbd: ignore notify errors on missing image header (`issue#17549 `_, `pr#11395 `_, Jason Dillaman) * librbd: keep rbd_default_features setting as bitmask (`issue#18247 `_, `pr#12486 `_, Jason Dillaman) * librbd: mark request as finished after failed refresh (`issue#17973 `_, `pr#12160 `_, Venky Shankar) * librbd: minor cleanup (`pr#12078 `_, Dongsheng Yang) * librbd: new API method to force break a peer's exclusive lock (`issue#18429 `_, `issue#16988 `_, `issue#18327 `_, `pr#12889 `_, Jason Dillaman) * librbd: parse rbd_default_features config option as a string (`pr#11175 `_, Alyona Kiseleva, Alexey Sheplyakov) * librbd: possible assert failure creating image when using data pool (`pr#11641 `_, Venky Shankar) * librbd: proper check for get_data_pool compatibility (`issue#17791 `_, `pr#11755 `_, Mykola Golub) * librbd: properly order concurrent updates to the object map (`issue#16176 `_, `pr#12420 `_, Jason Dillaman) * librbd: release lock after demote (`issue#17880 `_, `pr#11940 `_, Mykola Golub) * librbd: remove consistency group rbd cli and API support (`issue#18231 `_, `pr#12475 `_, Jason Dillaman) * librbd: remove image header lock assertions (`issue#18244 `_, `pr#12472 `_, Jason Dillaman) * librbd: remove unused local variable (`pr#12388 `_, Yunchuan Wen) * librbd: silence the unused variable warning (`pr#11678 `_, Kefu Chai) * librbd: snap_get_limit compatibility check (`pr#11766 `_, Mykola Golub) * librbd: update internals to use optional separate data pool (`pr#11356 `_, Jason Dillaman) * librbd: use proper snapshot when computing diff parent overlap (`issue#18200 `_, `pr#12396 `_, Xiaoxi Chen) * log: optimize header file dependency (`pr#9768 `_, Xiaowei Chen) * mds: add debug assertion for issue #17636 (`pr#11576 `_, Yan, Zheng) * mds: add tests for mantle (programmable balancer) (`pr#1145 `_, Michael Sevilla) * mds: check if down mds is known (`issue#17670 `_, `pr#11611 `_, Patrick Donnelly) * mds: don't access mdsmap from log submit thread (`issue#18047 `_, `pr#12208 `_, Yan, Zheng) * mds: don't maintain bloom filters in standby replay (`issue#16924 `_, `pr#12133 `_, John Spray) * mds: enable rmxattr on pool_namespace attrs (`issue#17797 `_, `pr#11783 `_, John Spray) * mds: fix dropping events in standby replay (`issue#17954 `_, `pr#12077 `_, John Spray) * mds: fix EMetaBlob::fullbit xattr dump (`pr#11536 `_, Sage Weil) * mds: fix false "failing to respond to cache pressure" warning (`pr#11373 `_, Yan, Zheng) * mds: force client flush snap data before truncating objects (`issue#17193 `_, `pr#11994 `_, Yan, Zheng) * mds: handle bad standby_for_fscids in fsmap (`issue#17466 `_, `pr#11281 `_, John Spray) * mds: ignore 'session evict' when mds is replaying log (`issue#17801 `_, `pr#11813 `_, Yan, Zheng) * mds: include legacy client fsid in FSMap print (`pr#11283 `_, John Spray) * mds: more deterministic timing on frag split/join (`issue#17853 `_, `pr#12022 `_, John Spray) * mds: more unique_pointer changes (`pr#11635 `_, Patrick Donnelly) * mds: properly commit new dirfrag before splitting it (`issue#17990 `_, `pr#12125 `_, Yan, Zheng) * mds: release pool allocator memory after exceeding size limit (`issue#18225 `_, `pr#12443 `_, John Spray) * mds: remove duplicated log in handle_client_readdir (`pr#11806 `_, Zhi Zhang) * mds: remove "--journal-check" help text (`issue#17747 `_, `pr#11739 `_, Nathan Cutler) * mds: remove unused EFragment::OP_ONESHOT (`pr#11887 `_, John Spray) * mds: repair backtraces during scrub (`issue#17639 `_, `pr#11578 `_, John Spray) * mds: require MAY_SET_POOL to set pool_ns (`issue#17798 `_, `pr#11789 `_, John Spray) * mds: respawn using /proc/self/exe (`issue#17531 `_, `pr#11362 `_, Patrick Donnelly) * mds: revert "mds/Mutation: remove redundant _dump method" (`issue#17906 `_, `pr#11985 `_, Patrick Donnelly) * mds: use parse_filesystem in parse_role to handle exceptions and reuse parsing code (`issue#17518 `_, `pr#11357 `_, Patrick Donnelly) * mds: use projected path construction for access (`issue#17858 `_, `pr#12063 `_, Patrick Donnelly) * mds: use unique_ptr to simplify resource mgmt (`pr#11543 `_, Patrick Donnelly) * mgr: doc/mgr: fix mgr how long to wait to failover (`pr#11550 `_, huanwen ren) * mgr: init() return when connection daemons failed && add some err info (`pr#11424 `_, huanwen ren) * mgr: misc minor changes (`issue#17455 `_, `pr#11386 `_, xie xingguo) * mgr: PyModules.cc: remove duplicated if condition for fs_map (`pr#11639 `_, Weibing Zhang) * mgr: remove unnecessary C_StdFunction (`pr#11883 `_, John Spray) * mon: add missing space in warning message (`pr#11361 `_, Patrick Donnelly) * mon: clean legacy code (`pr#9643 `_, Wei Jin) * mon: clear duplicated logic in MDSMonitor (`pr#11209 `_, Zhi Zhang) * mon: Do not allow pools to be deleted by default (`pr#11665 `_, Wido den Hollander) * mon: fix "OSDs marked OUT wrongly after monitor failover" (`issue#17719 `_, `pr#11664 `_, Dong Wu) * mon: Forbidden copy and assignment function in monoprequest (`pr#9513 `_, song baisen) * mon: have mon-specific features & rework internal monmap structures (`pr#10907 `_, Joao Eduardo Luis) * mon: if crushtool config is empty use internal crush test (`pr#11765 `_, Bassam Tabbara) * mon: make MDSMonitor tolerant of slow mon elections (`issue#17308 `_, `pr#11167 `_, John Spray) * mon: MonmapMonitor: return success when monitor will be removed (`issue#17725 `_, `pr#11747 `_, Joao Eduardo Luis) * mon: move case CEPH_MSG_POOLOP to OSDs group (`pr#11848 `_, Javeme) * mon: osdmap's epoch should be more than 0 (`pr#9859 `_, Na Xie) * mon: OSDMonitor: fix the check error of pg creating (`issue#17169 `_, `pr#10916 `_, DesmondS) * mon: paxos add the timeout function when peon recovery (`pr#10359 `_, song baisen) * mon: preserve osd weight when marking osd out, then in (`pr#11293 `_, Sage Weil) * mon: prevent post-jewel OSDs from booting if require_jewel_osds is not set (`pr#11498 `_, Sage Weil) * mon: remove ceph-create-keys from mon startup (`issue#16036 `_, `pr#9345 `_, Owen Synge) * mon: remove the redudant jugement in LogMonitor tick function (`pr#10474 `_, song baisen) * mon: remove utime_t param in _dump (`pr#12029 `_, Patrick Donnelly) * mon: send updated monmap to its subscribers (`issue#17558 `_, `pr#11456 `_, Kefu Chai) * mon: small change on the HealthMonitor start_epoch function (`pr#10296 `_, songbaisen) * mon: support for building without leveldb + mon mkfs bug fix (`pr#11800 `_, Bassam Tabbara) * osd: add a pg _fastinfo attribute to reduce per-io metadata updates (`pr#11213 `_, Sage Weil) * osd: Add config option to disable new scrubs during recovery (`issue#17866 `_, `pr#11874 `_, Wido den Hollander) * osd: a few fast dispatch optimizations (`pr#12052 `_, Sage Weil) * osd: cleanup C_CompleteSplits::finish() (`pr#12094 `_, Jie Wang) * osd: clean up PeeringWQ::_dequeue(), remove unnecessary variable (`pr#12117 `_, Jie Wang) * osd: clean up process_peering_events (`pr#12009 `_, Jie Wang) * osdc/Objecter: resend pg commands on interval change (`issue#18358 `_, `pr#12910 `_, Samuel Just) * osd: condition OSDMap encoding on features (`pr#12166 `_, Sage Weil) * osd: default osd_scrub_during_recovery=false (`pr#12402 `_, Sage Weil) * osd: do not open pgs when the pg is not in pg_map (`issue#17806 `_, `pr#11803 `_, Xinze Chi) * osd: drop stray debug message (`pr#11296 `_, Sage Weil) * osd: EC Overwrites (`issue#17668 `_, `pr#11701 `_, Tomy Cheru, Samuel Just) * osd: enhance logging for osd network error (`pr#12458 `_, liuchang0812) * osd: fix CEPH_OSD_FLAG_RWORDERED (`pr#12603 `_, Sage Weil) * osd: fix duplicated id of incompat feature "fastinfo" (`pr#11588 `_, xie xingguo) * osd: fix ec scrub errors (`issue#17999 `_, `pr#12306 `_, Samuel Just) * osd: fixes to make rbd on ec work (`pr#12305 `_, Samuel Just) * osd: Fix map gaps again (bug 15943) (`issue#15943 `_, `pr#12571 `_, Samuel Just) * osd: fix memory leak from EC write workload (`issue#18093 `_, `pr#12256 `_, Sage Weil) * osd: fix rados write op hang (`pr#11143 `_, Yunchuan Wen) * osd: Fix read error propogation in ECBackend (`issue#17966 `_, `pr#12142 `_, Samuel Just) * osd: fix scrub boundary to not include a SnapSet (`pr#11255 `_, Samuel Just) * osd: fix signed/unsigned comparison warning (`pr#12400 `_, Greg Farnum) * osd: fix typo in PG::clear_primary_state (`pr#11513 `_, Brad Hubbard) * osd: Fix typos in PG::find_best_info (`pr#11515 `_, Brad Hubbard) * osd: fix typos in "struct OSDOp" comments (`pr#12350 `_, Chanyoung Park) * osd: Flush Journal on shutdown (`pr#11249 `_, Wido den Hollander) * osd: force watch PING to be write ordered (`issue#18310 `_, `pr#12590 `_, Samuel Just) * osd: handle EC recovery read errors (`issue#13937 `_, `pr#9304 `_, David Zafman) * osd: heartbeat peers need to be updated when a new OSD added into an existed cluster (`issue#18004 `_, `pr#12069 `_, Pan Liu) * osd: Increase priority for inactive PGs backfill (`pr#12389 `_, Bartłomiej Święcki) * osd: kill PG_STATE_SPLITTING (`pr#11824 `_, xie xingguo) * osd: mark queued flag for op (`pr#12352 `_, Yunchuan Wen) * osd: osdc: pass a string reference type to "osdmap->lookup_pg_pool_name" (`pr#12219 `_, Leo Zhang) * osd: osd/OSDMonitor: accept 'osd pool set ...' value as string (`pr#911 `_, David Zafman) * osd: PGLog: initialize writeout_from in PGLog constructor (`issue#12973 `_, `pr#558 `_, Sage Weil) * osd/PrimaryLogPG: don't update digests for objects with mismatched names (`issue#18409 `_, `pr#12803 `_, Samuel Just) * osd/PrimaryLogPG::failed_push: update missing as well (`issue#18165 `_, `pr#12911 `_, Samuel Just) * osd: print log when osd want to kill self (`pr#9288 `_, Haomai Wang) * osd: Remove extra call to reg_next_scrub() during splits (`issue#16474 `_, `pr#11206 `_, David Zafman) * osd: remove redudant call of heartbeat_check (`pr#12130 `_, Pan Liu) * osd: remove the lock heartbeat_update_lock, and change heatbeat_need\_… (`pr#12461 `_, Pan Liu) * osd: remove the redundant clear method in consume_map function (`pr#10553 `_, song baisen) * osd: Remove unused '_lsb_release_' declarations (`pr#11364 `_, Brad Hubbard) * osd: replace hb_out and hb_in with a single hb_peers (`issue#18057 `_, `pr#12178 `_, Pan Liu) * osd: ReplicatedPG: don't bless C_OSD_SendMessageOnConn (`issue#13304 `_, `pr#669 `_, Jason Dillaman) * osd: set server-side limits on omap get operations (`pr#12059 `_, Sage Weil) * osd: When deep-scrub errors present upgrade regular scrubs (`pr#12268 `_, David Zafman) * performance,bluestore: kv/MemDB: making memdb code adapt to generic maps (`pr#11436 `_, Ramesh Chander) * performance,bluestore: os/bluestore: allow default to buffered write (`pr#11301 `_, Sage Weil) * performance,bluestore: os/bluestore: bluestore_cache_meta_ratio = .5 (`pr#11919 `_, Sage Weil) * performance,bluestore: os/bluestore: reduce Onode in-memory footprint (`pr#12568 `_, Igor Fedotov) * performance,bluestore: os/bluestore: refactor bluestore_sync_submit_transaction (`pr#11537 `_, Sage Weil) * performance,bluestore: os/bluestore: speed up omap-key generation for same onode(the read paths) (`pr#11894 `_, xie xingguo) * performance,bluestore: os/bluestore: speedup the performance of multi-replication flow by switc… (`pr#11844 `_, Pan Liu) * performance,cephfs: Fix long stalls when calling ceph_fsync() (`issue#17563 `_, `pr#11710 `_, Jeff Layton) * performance,cleanup: Context: std::move the callback param in FunctionContext's ctor (`pr#11892 `_, Kefu Chai) * performance,cleanup: osd/PG.h: move shared ptr instead of copying it (`pr#11154 `_, Michal Jarzabek) * performance,common: common/config_opts.h: Optimized RocksDB WAL settings. (`pr#11530 `_, Mark Nelson) * performance,common: osd/OSDMap: improve the performance of pg_to_acting_osds (`pr#12190 `_, Pan Liu) * performance: msg/async: set ms_async_send_inline to false to improve small randread iops (`pr#11521 `_, Mark Nelson) * performance,tools: rados: add hints to rados bench (`pr#12169 `_, Sage Weil) * pybind: avoid "exception 'int' object is not iterable" (`pr#11532 `_, Javeme) * pybind,cephfs: ceph_volume_client: fix recovery from partial auth update (`issue#17216 `_, `pr#11304 `_, Ramana Raja) * pybind,cephfs: ceph_volume_client: set an existing auth ID's default mon caps (`issue#17800 `_, `pr#11917 `_, Ramana Raja) * pybind: ceph-rest-api: understand the new style entity_addr_t representation (`issue#17742 `_, `pr#11686 `_, Kefu Chai) * pybind: clean up mgr stuff for flake8 (`pr#11314 `_, John Spray) * pybind: fix build failure of rgwfile binding (`pr#11825 `_, Kefu Chai) * pybind: pybind/rados: add missing "length" requires for aio_execute() (`pr#12439 `_, Kefu Chai) * pybind: pybind/rados: Add @requires for all aio methods (`pr#12327 `_, Iain Buclaw) * qa: fixed distros links (`pr#12773 `_, Yuri Weinstein) * qa: Fixed link to centos distro (`pr#12768 `_, Yuri Weinstein) * qa/suites: switch from centos 7.2 to 7.x (`pr#12632 `_, Sage Weil) * qa/tasks/peer: update task based on current peering behavior (`issue#18330 `_, `pr#12614 `_, Sage Weil) * qa/tasks/workunit: clear clone dir before retrying checkout (`issue#18336 `_, `pr#12630 `_, Sage Weil) * qa: update Ubuntu image url after ceph.com refactor (`issue#18542 `_, `pr#12960 `_, Jason Dillaman) * qa/workunits/rbd/test_lock_fence.sh fails (`issue#18388 `_, `pr#12752 `_, Nathan Cutler) * rbd: added rbd-nbd fsx test case (`pr#1049 `_, Jason Dillaman) * rbd: add fsx journal replay test case (`pr#821 `_, Jason Dillaman) * rbd: add singleton to assert no rbdmap regression (`issue#14984 `_, `pr#902 `_, Nathan Cutler) * rbd: add some missing workunits (`pr#870 `_, Josh Durgin) * rbd: add support for separate image data pool (`issue#17424 `_, `pr#11355 `_, Jason Dillaman) * rbd: expose rbd unmap options (`issue#17554 `_, `pr#11370 `_, Ilya Dryomov) * rbd: fix json formatting for image and journal status output (`issue#18261 `_, `pr#12525 `_, Mykola Golub) * rbd: fix parsing of group and image specific pools (`pr#11632 `_, Victor Denisov) * rbd: journal: do not prematurely flag object recorder as closed (`issue#17590 `_, `pr#11520 `_, Jason Dillaman) * rbd: krbd: kernel client expects ip[:port], not an entity_addr_t (`pr#11902 `_, Ilya Dryomov) * rbd: --max_part and --nbds_max options for nbd map (`issue#18186 `_, `pr#12379 `_, Pan Liu) * rbd: move nbd test workload to separate client host from OSDs (`pr#1170 `_, Jason Dillaman) * rbd: provision volumes to format as XFS (`issue#6693 `_, `pr#1028 `_, Loic Dachary) * rbd: rbd-mirror: fix sparse read optimization in image sync (`issue#18146 `_, `pr#12368 `_, Mykola Golub) * rbd: rbd-mirror HA: move librbd::image_watcher::Notifier to librbd::object_watcher (`issue#17017 `_, `pr#11290 `_, Mykola Golub) * rbd: rbd-mirror: recovering after split-brain (`issue#16991 `_, `issue#18051 `_, `pr#12212 `_, Mykola Golub) * rbd: rbd-mirror: snap protect of non-layered image results in split-brain (`issue#16962 `_, `pr#11744 `_, Mykola Golub) * rbd: rbd-nbd: disallow mapping images >2TB in size (`issue#17219 `_, `pr#11741 `_, Mykola Golub) * rbd: rbd-nbd: invalid error code for "failed to read nbd request" messages (`issue#18242 `_, `pr#12483 `_, Mykola Golub) * rbd: rbd-nbd: restart parent process logger after forking (`issue#18070 `_, `pr#12222 `_, Jason Dillaman) * rbd: rbd-nbd: support disabling auto-exclusive lock transition logic (`issue#17488 `_, `pr#11438 `_, Mykola Golub) * rbd: rbd-nbd: support partition for rbd-nbd mapped raw block device (`issue#18115 `_, `pr#12259 `_, Pan Liu) * rbd: tests with rbd_skip_partial_discard option enabled (`pr#1077 `_, Mykola Golub) * rbd,tools: rbd : make option --stripe-unit w/ B/K/M work (`pr#12407 `_, Jianpeng Ma) * rbd: updated tests to use new rbd default feature set (`pr#842 `_, Jason Dillaman) * rbd: use snap_remove implementation from internal (`pr#12035 `_, Victor Denisov) * rgw: add default zone name (`issue#7009 `_, `pr#954 `_, Orit Wasserman) * rgw: add documentation for upgrading with rgw_region_root_pool (`pr#12138 `_, Orit Wasserman) * rgw: add option to log custom HTTP headers (rgw_log_http_headers) (`pr#7639 `_, Matt Benjamin) * rgw: add recovery procedure for upgrade to older version of jewel (`issue#17820 `_, `pr#11827 `_, Orit Wasserman) * rgw: add rgw_compression_type=random for teuthology testing (`pr#11901 `_, Casey Bodley) * rgw: add sleep to let the sync agent init (`pr#1136 `_, Orit Wasserman) * rgw: add suport for creating S3 type subuser of admin rest api (`issue#16682 `_, `pr#10325 `_, snakeAngel2015) * rgw: add support for the prefix parameter in account listing of Swift API (`issue#17931 `_, `pr#12047 `_, Radoslaw Zarzynski) * rgw: allow fastcgi idle timeout to be adjusted (`pr#230 `_, Sage Weil) * rgw: also approve, passed teuthology (many false positives in several classes) (`issue#17985 `_, `pr#12224 `_, Yehuda Sadeh, Sage Weil) * rgw: Anonymous users shouldn't be able to access requester pays buckets. (`issue#17175 `_, `pr#11719 `_, Zhang Shaowen) * rgw: aws4: add presigned url bugfix in runtime (`issue#16463 `_, `pr#10160 `_, Javier M. Mellid) * rgw: bucket resharding (`issue#17550 `_, `pr#11230 `_, Yehuda Sadeh) * rgw:bugfix for deleting objects name beginning and ending with underscores of one bucket using POST method of AWS's js sdk. (`issue#17888 `_, `pr#11982 `_, root) * rgw: Class member cookie is not initialized correctly in some coroutine's constructor. (`pr#11673 `_, Zhang Shaowen) * rgw: clean up RGWShardedOmapCRManager on early return (`issue#17571 `_, `pr#11505 `_, Casey Bodley) * rgw: clear data_sync_cr if RGWDataSyncControlCR fails (`issue#17569 `_, `pr#11506 `_, Casey Bodley) * rgw: compilation of the ASIO front-end is enabled by default. (`pr#12073 `_, Radoslaw Zarzynski) * rgw: compression uses optional::emplace instead of in-place factories (`pr#12021 `_, Radoslaw Zarzynski) * rgw: conform to the standard usage of string::find (`pr#10086 `_, Yan Jun) * rgw: data_extra_pool is unique per zone (`issue#17025 `_, `pr#1119 `_, Orit Wasserman) * rgw: delete entries_index in RGWFetchAllMetaCR (`issue#17812 `_, `pr#11816 `_, Casey Bodley) * rgw: do not abort when accept a CORS request with short origin (`pr#12381 `_, LiuYang) * rgw: do not enable both tcp and uds for fastcgi (`issue#5797 `_, `pr#479 `_, Andrew Schoen) * rgw: don't error out on empty owner when setting acls (`issue#6892 `_, `pr#877 `_, Loic Dachary, Nathan Cutler) * rgw: Don't loop forever when reading data from 0 sized segment. (`issue#17692 `_, `pr#11567 `_, Marcus Watts) * rgw: dont set CURLOPT_UPLOAD for GET requests (`issue#17822 `_, `pr#12105 `_, Casey Bodley) * rgw: don't store empty chains in gc (`issue#17897 `_, `pr#11969 `_, Yehuda Sadeh) * rgw: do quota tests on ubuntu (`issue#6382 `_, `pr#635 `_, Sage Weil) * rgw: dump objects in RGWBucket::check_object_index() (`issue#14589 `_, `pr#11324 `_, Yehuda Sadeh) * rgw: dump remaining coroutines when cr deadlock is detected (`pr#11580 `_, Casey Bodley) * rgw: extract host name from host:port string (`issue#17788 `_, `pr#11751 `_, Yehuda Sadeh) * rgw: Fixed problem with PUT with x-amz-copy-source when source object is compressed. (`pr#12253 `_, Adam Kupczyk) * rgw: fixes for virtual hosting of buckets (`issue#17440 `_, `issue#15975 `_, `issue#17136 `_, `pr#11280 `_, Casey Bodley, Robin H. Johnson) * rgw: fix etag in multipart complete (`issue#17794 `_, `issue#6830 `_, `issue#16129 `_, `issue#17872 `_, `pr#1269 `_, Casey Bodley, Orit Wasserman) * rgw: fix for bucket delete racing with mdlog sync (`issue#17698 `_, `pr#11648 `_, Casey Bodley) * rgw: fix for passing temporary in InitBucketSyncStatus (`issue#17661 `_, `pr#11594 `_, Casey Bodley) * rgw: fix for unsafe change of rgw_zonegroup (`issue#17962 `_, `pr#12075 `_, Casey Bodley) * rgw: fix indentation for cache_pools (`issue#8295 `_, `pr#251 `_, Sage Weil) * rgw: fix missing master zone for a single zone zonegroup (`issue#17364 `_, `pr#11965 `_, Orit Wasserman) * rgw: fix osd crashes when execute "radosgw-admin bi list --max-entries=1" command (`issue#17745 `_, `pr#11697 `_, weiqiaomiao) * rgw: fix put_acls for objects starting and ending with underscore (`issue#17625 `_, `pr#11566 `_, Orit Wasserman) * rgw: fix RGWSimpleRadosLockCR set_description() (`pr#11961 `_, Tianshan Qu) * rgw: fix the field 'total_time' of log entry in log show opt (`issue#17598 `_, `pr#11425 `_, weiqiaomiao) * rgw: fix uncompressed object size deduction in RGWRados::copy_obj_data. (`issue#17803 `_, `pr#11794 `_, Radoslaw Zarzynski) * rgw: frontend subsystem rework (`pr#10767 `_, Radoslaw Zarzynski, Casey Bodley, Matt Benjamin) * rgw: ftw (`issue#17888 `_, `pr#12262 `_, Casey Bodley) * rgw: get_system_obj does not use result of get_system_obj_state (`issue#17580 `_, `pr#11444 `_, Casey Bodley) * rgw: get_zonegroup() uses "default" zonegroup if empty (`issue#17372 `_, `pr#11207 `_, Yehuda Sadeh) * rgw: handle empty POST condition (`issue#17635 `_, `pr#11581 `_, Yehuda Sadeh) * rgw: handle Swift auth errors in a way compatible with new Tempests. (`issue#16590 `_, `pr#10021 `_, Radoslaw Zarzynski) * rgw: json encode/decode index_type, allow modification (`issue#17755 `_, `pr#11707 `_, Yehuda Sadeh) * rgw: loses realm/period/zonegroup/zone data: period overwritten if somewhere in the cluster is still running Hammer (`issue#17371 `_, `pr#11426 `_, Orit Wasserman) * rgw: make RGWLocalAuthApplier::is_admin_of() aware about system users. (`issue#18106 `_, `pr#12283 `_, Radoslaw Zarzynski) * rgw: metadata sync info should be shown at master zone of slave zoneg… (`issue#18091 `_, `pr#12187 `_, Jing Wenjun) * rgw: minor cleanup (`pr#10057 `_, Yan Jun) * rgw: move compression config into zone placement (`pr#12113 `_, Casey Bodley) * rgw: move xfs to a seperate directory (`pr#969 `_, Orit Wasserman) * rgw: multipart upload copy (`issue#12790 `_, `pr#11269 `_, Yehuda Sadeh, Javier M. Mellid) * rgw: need to close_section in lc list op (`pr#12232 `_, weiqiaomiao) * rgw: policy acl format should be xml (`pr#946 `_, Orit Wasserman) * rgw: radosgw-admin: more on placement configuration (`issue#18078 `_, `pr#12242 `_, Casey Bodley) * rgw: region conversion respects pre-existing rgw_region_root_pool (`issue#17963 `_, `pr#12076 `_, Casey Bodley) * rgw: remove a redundant judgement when listng objects. (`pr#10849 `_, zhangshaowen) * rgw: remove circular reference in RGWAsyncRadosRequest (`issue#17793 `_, `issue#17792 `_, `pr#11815 `_, Casey Bodley) * rgw: remove suggestion to upgrade libcurl (`pr#11630 `_, Casey Bodley) * rgw: remove unused variable "ostr" in rgw_b64.h and fix the comment (`pr#11329 `_, Weibing Zhang) * rgw: Replacing '+' with "%20" in canonical uri for s3 v4 auth. (`issue#17076 `_, `pr#10919 `_, Pritha Srivastava) * rgw: revert unintentional change to civetweb (`pr#12004 `_, Bassam Tabbara) * rgw: rgw-admin: new commands to control placement (`issue#18078 `_, `pr#12230 `_, Yehuda Sadeh) * rgw: RGWBucketSyncStatusManager uses existing async_rados (`issue#18083 `_, `pr#12229 `_, Casey Bodley) * rgw: rgw_file: apply missed base64 try-catch (`issue#17663 `_, `pr#11671 `_, Matt Benjamin) * rgw: RGWHTTPArgs::get_str() - return argument string that was set. (`pr#10672 `_, Marcus Watts) * rgw: rgw multisite: fix the increamtal bucket sync init (`issue#17624 `_, `pr#11553 `_, Zengran Zhang) * rgw: rgw multisite: use a rados lock to coordinate data log trimming (`pr#10546 `_, Casey Bodley) * rgw: RGW Python bindings - use explicit array (`pr#11831 `_, Daniel Gryniewicz) * rgw: rgw_rados.cc fix shard_num format for snprintf (`pr#11493 `_, Weibing Zhang) * rgw: rgw/rgw_file.cc: Add compat.h to allow CLOCK_MONOTONE (`pr#12309 `_, Willem Jan Withagen) * rgw: RGWSimpleRadosReadCR tolerates empty reads (`issue#17568 `_, `pr#11504 `_, Casey Bodley) * rgw: [RGW] Wip rgw compression (`pr#11494 `_, Alyona Kiseleva, Adam Kupczyk, Casey Bodley) * rgw: set duration for lifecycle lease (`issue#17965 `_, `pr#12231 `_, Yehuda Sadeh) * rgw: should assign 'olh_bl" to state.attrset[RGW_ATTR_OLH_ID_TAG] instead of 'bl' (`pr#10239 `_, weiqiaomiao) * rgw: skip empty http args in method parse() to avoid extra effort (`pr#11989 `_, Guo Zhandong) * rgw: split osd's in 2 nodes (`issue#15612 `_, `pr#1019 `_, Vasu Kulkarni) * rgw: support for x-robots-tag header (`issue#17790 `_, `pr#11753 `_, Yehuda Sadeh) * rgw: sync modules, metadata search (`pr#10731 `_, Yehuda Sadeh) * rgw: Update version of civetweb to 1.8 (`pr#11343 `_, Marcus Watts) * rgw: use civetweb if no frontend was configured (`pr#958 `_, Orit Wasserman) * rgw: use explicit flag to cancel RGWCoroutinesManager::run() (`issue#17465 `_, `pr#12452 `_, Casey Bodley) * rgw: valgrind fixes for kraken (`issue#18414 `_, `issue#18407 `_, `issue#18412 `_, `issue#18300 `_, `pr#12949 `_, Casey Bodley) * rgw: verified that failed check is in osd-scrub-repair.sh (`issue#17850 `_, `pr#11881 `_, Matt Benjamin) * rgw: we don't support btrfs any more (`pr#1132 `_, Orit Wasserman) * rgw: Wip rgwfile pybind (`pr#11624 `_, Haomai Wang) * tests,bluestore: os/bluestore: add UT for an estimation of Onode in-memory size (`pr#12532 `_, Igor Fedotov) * tests,bluestore: os/test/store_test: fix legacy bluestore cache settings application (`pr#11915 `_, Igor Fedotov) * tests: ceph-disk: force debug monc = 0 (`issue#17607 `_, `pr#11534 `_, Loic Dachary) * tests: ceph_objectstore_tool.py: Don't use btrfs on FreeBSD (`pr#10507 `_, Willem Jan Withagen) * tests: ceph_test_objectstore: fix Rename test (`pr#12261 `_, Sage Weil) * tests: check hostname --fqdn sanity before running make check (`issue#18134 `_, `pr#12297 `_, Nathan Cutler) * tests,cleanup,rbd: test/librbd: in test_notify set object-map and fast-diff features by default (`pr#11821 `_, Mykola Golub) * tests,cleanup: test_bloom_filter.cc: Fix a mismatch for the random_seed parameter (`pr#11774 `_, Willem Jan Withagen) * tests,cleanup: test/osd/osd-fast-mark-down.sh: remove unnecessary teardown() calls (`pr#12101 `_, Kefu Chai) * tests,cleanup: test/osd-scrub-repair.sh: use repair() instead of "ceph pg repair" (`pr#12036 `_, Kefu Chai) * tests,cleanup: test/rados: remove unused bufferlist variable (`pr#10221 `_, Yan Jun) * tests,common: test: add perf-reset test in test/perf_counters.cc (`pr#8948 `_, wangsongbo) * tests: disable failing tests (`issue#17561 `_, `issue#17757 `_, `pr#11714 `_, Loic Dachary) * tests: disable the echo when running get_timeout_delays() (`pr#12180 `_, Kefu Chai) * tests: do not use memstore.test_temp_dir in two tests (`issue#17743 `_, `pr#12281 `_, Loic Dachary) * tests: erasure-code: add k=2, m=2 for isa & jerasure (`issue#18188 `_, `pr#12383 `_, Loic Dachary) * tests: facilitate background process debug in ceph-helpers.sh (`issue#17830 `_, `pr#12183 `_, Loic Dachary) * tests: fix ceph-helpers.sh wait_for_clean delays (`issue#17830 `_, `pr#12095 `_, Loic Dachary) * tests: fix osd-scrub-repair.sh (`pr#12072 `_, David Zafman) * tests: Fix racey test by setting noout flag (tracker 17757) (`issue#17757 `_, `pr#11715 `_, David Zafman) * tests: merge ceph-qa-suite * tests: Minor clean-ups (`pr#12048 `_, David Zafman) * tests: minor make check cleanup (`pr#12146 `_, David Zafman) * tests: no python3 tests for ceph-disk (`issue#17923 `_, `pr#12025 `_, Loic Dachary) * tests: osd-crush.sh must retry crush dump (`issue#17919 `_, `pr#12016 `_, Loic Dachary) * tests: osd-scrub-repair.sh abort if add_something fails (`pr#12172 `_, Loic Dachary) * tests: os/memstore: fix a mem leak in MemStore::Collection::create_object() (`pr#12201 `_, Kefu Chai) * tests: os/memstore, os/filestore: fix store_test's to satisfy rm_coll behavi… (`pr#11558 `_, Igor Fedotov) * tests: paxos fixes (`issue#11913 `_, `pr#457 `_, John Spray) * tests: pin flake8 to avoid behavior changes (`issue#17898 `_, `pr#11971 `_, Loic Dachary) * tests: qa: fixed script to schedule rados and other suites with --subset option (`pr#12587 `_, Yuri Weinstein) * tests: qa/tasks/admin_socket: subst in repo name (`pr#12508 `_, Sage Weil) * tests: qa/tasks/ceph_deploy: use dev option instead of dev-commit (`pr#12514 `_, Vasu Kulkarni) * tests: qa/tasks/osd_backfill.py: wait for osd.[12] to start (`issue#18303 `_, `pr#12577 `_, Sage Weil) * tests: qa/workunits/cephtool/test.sh: FreeBSD has no distro. (`pr#11702 `_, Willem Jan Withagen) * tests: qa/workunits: include extension for nose tests (`pr#12572 `_, Sage Weil) * tests: qa/workunits/rados/test_envlibrados_for_rocksdb: force librados-dev install (`pr#11941 `_, Sage Weil) * tests,rbd: qa/workunits/rbd: fix (`issue#18271 `_, `pr#12511 `_, Sage Weil) * tests,rbd: qa/workunits/rbd: removed qemu-iotest case 077 (`issue#10773 `_, `pr#12366 `_, Jason Dillaman) * tests,rbd: qa/workunits/rbd: simplify running nbd test under build env (`pr#11781 `_, Mykola Golub) * tests,rbd: qa/workunits/rbd: use image id when probing for image presence (`issue#18048 `_, `pr#12195 `_, Mykola Golub) * tests,rbd: qa/workunits/rbd: use more recent qemu-iotests that support Xenial (`issue#18149 `_, `pr#12371 `_, Jason Dillaman) * tests,rbd: rbd-mirror: fix gmock warnings in bootstrap request unit tests (`issue#18156 `_, `pr#12344 `_, Mykola Golub) * tests,rbd: rbd-mirror: improve resiliency of stress test case (`issue#17416 `_, `pr#11326 `_, Jason Dillaman) * tests,rbd: test: new librbd discard after write test case (`pr#11645 `_, Jason Dillaman) * tests,rbd: test: skip TestLibRBD.DiscardAfterWrite if skip partial discard enabled (`issue#17750 `_, `pr#11703 `_, Jason Dillaman) * tests,rbd: test: TestJournalReplay test cases need to wait for event commit (`issue#17566 `_, `pr#11480 `_, Jason Dillaman) * tests: remove TestPGLog EXPECT_DEATH tests (`issue#18030 `_, `pr#12361 `_, Loic Dachary) * tests: save 9 characters for asok paths (`issue#16014 `_, `pr#12066 `_, Loic Dachary) * tests: sync ceph-erasure-code-corpus for using 'arch' not 'uname -p' (`pr#12024 `_, Kefu Chai) * tests: test/ceph_crypto: do not read ceph.conf in global_init() (`issue#18128 `_, `pr#12318 `_, Kefu Chai) * tests: test: ceph-objectstore-tool: should import platform before using it (`pr#12038 `_, Kefu Chai) * tests: test/ceph_test_msgr: do not use Message::middle for holding transient… (`issue#17728 `_, `pr#11680 `_, Kefu Chai) * tests: test: disable osd-scrub-repair and test-erasure-eio (`issue#17830 `_, `pr#12058 `_, Loic Dachary, Dan Mick) * tests: test: disable osd-scrub-repair and test-erasure-eio (`pr#11979 `_, Dan Mick) * tests: test: Don't write to a poolid that this test might not have created (`pr#12378 `_, David Zafman) * tests: test: enable unittest_dns_resolve (`pr#12209 `_, Kefu Chai) * tests: test/encoding/readable.sh: fix shell script warning (`pr#11527 `_, Willem Jan Withagen) * tests: TestErasureCodePluginJerasure must stop the log thread (`issue#17561 `_, `pr#11721 `_, Loic Dachary) * tests: test: fix test-erasure-eio and osd-scrub-repair races (17830) (`pr#11926 `_, David Zafman) * tests: test/osd-fast-mark-down.sh: wrong assumption on first subtest (`pr#12123 `_, Piotr Dałek) * tests: test/osd/osd-fast-mark-down.sh: introduce large timeout (`issue#17918 `_, `pr#12019 `_, Piotr Dałek) * tests: test/osd-scrub-repair.sh: Use test case specific object names to help… (`pr#11449 `_, David Zafman) * tests: test/store_test: fix errors on the whole test suite run caused by the… (`pr#11427 `_, Igor Fedotov) * tests: test_subman.sh: Don't use --tmpdir (`pr#11384 `_, Willem Jan Withagen) * tests: test: test-erasure-eio.sh fix recovery testing and enable it (`pr#12170 `_, David Zafman) * tests: The default changed to disallow pool delete as of #11665; the tests assume it's allowed. (`pr#11897 `_, Sage Weil) * tests: Turn off tests again due to Jenkins failures (`pr#12217 `_, David Zafman) * tests: unittest_throttle avoid ASSERT_DEATH (`issue#18036 `_, `pr#12393 `_, Loic Dachary) * tests: update rbd/singleton/all/formatted-output.yaml to support ceph-ci (`issue#18440 `_, `pr#12823 `_, Nathan Cutler) * tests: use shorter directories for tests (`issue#16014 `_, `pr#12046 `_, Loic Dachary) * tests: vstart.sh: fix bashism in the script (`pr#11889 `_, Mykola Golub) * tests: workunits/ceph-helpers.sh: FreeBSD returns a different errorstring. (`pr#12005 `_, Willem Jan Withagen) * tools: Adding ceph-lazy tool (`pr#11055 `_, gcharot) * tools: ceph-create-keys should not try forever to do things (`issue#17753 `_, `issue#12649 `_, `issue#16255 `_, `pr#11749 `_, Alfredo Deza) * tools: ceph_detect_init: add support for Alpine (`pr#8316 `_, John Coyle) * tools: ceph-disk: fix flake8 errors (`issue#17898 `_, `pr#11973 `_, Ken Dreyer) * tools: ceph-disk: prevent unnecessary tracebacks from subprocess.check_call (`issue#16125 `_, `pr#12414 `_, Alfredo Deza) * tools: ceph-post-file: single command to upload a file to cephdrop (`pr#505 `_, Dan Mick, Travis Rhoden) * tools: cleanup phase of cephfs-data-scan (`pr#12337 `_, Vishal Kanaujia) * tools: osdmaptool: additional tests (`pr#1196 `_, Sage Weil) * tools: osdmaptool: fix divide by zero error (`pr#12561 `_, Yunchuan Wen) * tools: rados: fix segfaults when run without --pool (`issue#17684 `_, `pr#11633 `_, David Disseldorp) * tools: rados: optionally support reading omap key from file (`issue#18123 `_, `pr#12286 `_, Jason Dillaman) * tools: script/run-coverity: update (`pr#12162 `_, Sage Weil) * tools: script/sepia_bt.sh: a script to prepare for debugging on teuthology@sepia (`pr#12012 `_, Kefu Chai) * tools: src/vstart.sh: Only execute btrfs if it is available (`pr#11683 `_, Willem Jan Withagen) * tools: tools/ceph-monstore-update-crush.sh: FreeBSD getopt is not compatible… (`pr#11525 `_, Willem Jan Withagen) v11.0.2 Kraken ============== This development checkpoint release includes a lot of changes and improvements to Kraken. This is the first release introducing ceph-mgr, a new daemon which provides additional monitoring & interfaces to external monitoring/management systems. There are also many improvements to bluestore, RGW introduces sync modules, copy part for multipart uploads and metadata search via elastic search as a tech preview. Notable Changes --------------- * bluestore: os/bluestore: misc fixes (`pr#10953 `_, Sage Weil) * bluestore: os/bluestore/BlueFS: do not op_file_update deleted files (`pr#10686 `_, Sage Weil) * bluestore: bluestore/BitAllocator: Fix deadlock with musl libc (`pr#10634 `_, John Coyle) * bluestore: bluestore/BlueFS: revert direct IO for WRITER_WAL (`pr#11059 `_, Mark Nelson) * bluestore: ceph-disk: support creating block.db and block.wal with customized size for bluestore (`pr#10135 `_, Zhi Zhang) * bluestore: compressor/zlib: switch to raw deflate (`pr#11122 `_, Piotr Dałek) * bluestore: do not use freelist to track bluefs_extents (`pr#10698 `_, Sage Weil) * bluestore: initialize csum_order properly (`pr#10728 `_, xie xingguo) * bluestore: kv/rocksdb: dump transactions on error (`pr#11042 `_, Somnath Roy) * bluestore: kv: In memory keyvalue db implementation (`pr#9933 `_, Ramesh Chander) * bluestore: os/bluestore/BitAllocator: batch is_allocated bit checks (`pr#10704 `_, Ramesh Chander) * bluestore: os/bluestore/BlueFS: For logs of rocksdb & bluefs only use directio. (`pr#11012 `_, Jianpeng Ma) * bluestore: os/bluestore/BlueFS: async compaction (`pr#10717 `_, Varada Kari, Sage Weil) * bluestore: os/bluestore/BlueFS: do not hold internal lock while waiting for IO (`pr#9898 `_, Varada Kari, Sage Weil) * bluestore: os/bluestore/BlueFS: do not start racing async compaction (`pr#11010 `_, Sage Weil) * bluestore: os/bluestore/BlueFS: don't inc l_bluefs_files_written_wal if overwrite. (`pr#10143 `_, Jianpeng Ma) * bluestore: os/bluestore/BlueFS: factor unflushed log into runway calculation (`pr#10966 `_, Sage Weil) * bluestore: os/bluestore/BlueFS: fix async compaction logging bug (`pr#10964 `_, Sage Weil) * bluestore: os/bluestore/BlueFS: log dirty files at sync time (`pr#11108 `_, Sage Weil) * bluestore: os/bluestore/BlueFS: only extend extent on same bdev (`pr#11023 `_, Sage Weil) * bluestore: os/bluestore/BlueFS: prevent concurrent async compaction (`pr#11095 `_, Sage Weil) * bluestore: os/bluestore/BlueFS: release completed aios (`pr#11268 `_, Sage Weil) * bluestore: os/bluestore/BlueFS: use StupidAllocator; fix async compaction bug (`pr#11087 `_, Sage Weil) * bluestore: os/bluestore/bluefs: add file refs check (`pr#10863 `_, xie xingguo) * bluestore: os/bluestore/bluefs: use map to track dirty files (`pr#10923 `_, xie xingguo) * bluestore: os/bluestore/bluefs_types: fix extent operator<< (`pr#10685 `_, Sage Weil) * bluestore: os/bluestore/bluestore_types: uint64_t for ref_map (`pr#11267 `_, Sage Weil) * bluestore: os/bluestore: Hint based allocation in bitmap Allocator (`pr#10978 `_, Ramesh Chander) * bluestore: os/bluestore: Remove bit alloc Woverloaded-virtual warnings (`pr#10082 `_, Ramesh Chander) * bluestore: os/bluestore: a few cleanups (`pr#11192 `_, xie xingguo) * bluestore: os/bluestore: a few fixes about the global csum setting (`pr#11195 `_, xie xingguo) * bluestore: os/bluestore: add assert to compress_extent_map (`pr#11240 `_, Sage Weil) * bluestore: os/bluestore: add cache-related stats (`pr#10961 `_, xie xingguo) * bluestore: os/bluestore: add checks and kill unreachable code (`pr#11077 `_, xie xingguo) * bluestore: os/bluestore: add error injection (`pr#11151 `_, Sage Weil) * bluestore: os/bluestore: add max blob size; fix compressed min blob size logic (`pr#11239 `_, Sage Weil) * bluestore: os/bluestore: add multiple finishers to bluestore (`pr#10780 `_, Ilsoo Byun) * bluestore: os/bluestore: add perf counters for compression effectiveness and space utilization measurements (`pr#10449 `_, Igor Fedotov) * bluestore: os/bluestore: apply "small encoding" for onode_t::extents map (`pr#10018 `_, Igor Fedotov) * bluestore: os/bluestore: avoid blob_t reencode when unchanged (`pr#10768 `_, Sage Weil) * bluestore: os/bluestore: binary search specified shard (`pr#11245 `_, xie xingguo) * bluestore: os/bluestore: change algorithm of compression header from string to int (`pr#10137 `_, xie xingguo) * bluestore: os/bluestore: compaction fixes (`pr#11279 `_, Sage Weil) * bluestore: os/bluestore: drop redundant call of get_blob (`pr#11275 `_, xie xingguo) * bluestore: os/bluestore: drop unreferenced spanning blobs (`pr#11212 `_, Sage Weil) * bluestore: os/bluestore: fix a few leaks (`pr#11068 `_, Sage Weil) * bluestore: os/bluestore: fix a few memory utilization leaks and wasters (`pr#11011 `_, Sage Weil) * bluestore: os/bluestore: fix crash in decode_some() (`pr#11312 `_, Sage Weil) * bluestore: os/bluestore: fix decoding hash of bnode (`pr#10773 `_, xie xingguo) * bluestore: os/bluestore: fix fsck() won't catch stray shard sometimes (`pr#11219 `_, xie xingguo) * bluestore: os/bluestore: fix gc when blob extends past eof (`pr#11282 `_, Sage Weil) * bluestore: os/bluestore: fix improper local var variable in collection_list meth… (`pr#10680 `_, Igor Fedotov) * bluestore: os/bluestore: fix incorrect pool decoding of bnode (`pr#10117 `_, xie xingguo) * bluestore: os/bluestore: fix leak of result-checking of _fsck_check_extents (`pr#11040 `_, xie xingguo) * bluestore: os/bluestore: fix leaks in our use of rocksdb (`pr#11250 `_, Sage Weil) * bluestore: os/bluestore: fix memory leak during bit_alloc testing (`pr#9935 `_, xie xingguo) * bluestore: os/bluestore: fix offset bug in _do_write_small. (`pr#11030 `_, amoxic) * bluestore: os/bluestore: fix onode cache addition race (`pr#11300 `_, Sage Weil) * bluestore: os/bluestore: fix potential access violation (`pr#10362 `_, xie xingguo) * bluestore: os/bluestore: fix potential access violation during rename (`pr#11033 `_, xie xingguo) * bluestore: os/bluestore: fix shard_info::dump() (`pr#11061 `_, xie xingguo) * bluestore: os/bluestore: fix spanning blob leak from ~ExtentMap (`pr#11223 `_, Somnath Roy) * bluestore: os/bluestore: fix statfs tests (`pr#10910 `_, Sage Weil) * bluestore: os/bluestore: fix when block device is not a multiple of the block size (`pr#10844 `_, Sage Weil) * bluestore: os/bluestore: fix write_big counter and some more cleanups (`pr#11344 `_, xie xingguo) * bluestore: os/bluestore: fix/improve csum error message (`pr#10938 `_, Sage Weil) * bluestore: os/bluestore: garbage collect partially overlapped blobs (`pr#11232 `_, Roushan Ali) * bluestore: os/bluestore: get rid off "isa-l" type in ZLibCompressor ctor (`pr#10931 `_, xie xingguo) * bluestore: os/bluestore: gifting bluefs more carefully (`pr#10950 `_, xie xingguo) * bluestore: os/bluestore: honour allow-eio flag; use global compressor if possible (`pr#10970 `_, xie xingguo) * bluestore: os/bluestore: improve required compression threshold (`pr#10080 `_, xie xingguo) * bluestore: os/bluestore: include bluefs space in statfs result (`pr#10795 `_, Sage Weil) * bluestore: os/bluestore: introduce power 2 macros for block alignment and rounding (`pr#10128 `_, xie xingguo) * bluestore: os/bluestore: make assert conditional with macro for allocator (`pr#11014 `_, Ramesh Chander) * bluestore: os/bluestore: make cache settings process-wide (`pr#11295 `_, Sage Weil) * bluestore: os/bluestore: make clone_range copy-on-write (`pr#11106 `_, Sage Weil) * bluestore: os/bluestore: make onode keys more efficient (and sort correctly) (`pr#11009 `_, xie xingguo, Sage Weil) * bluestore: os/bluestore: make trim() of 2Q cache more fine-grained (`pr#9946 `_, xie xingguo) * bluestore: os/bluestore: make zone/span size of bitmap-allocator configurable (`pr#10040 `_, xie xingguo) * bluestore: os/bluestore: misc cleanup and test fixes (`pr#11346 `_, Igor Fedotov) * bluestore: os/bluestore: misc cleanups (`pr#10201 `_, xie xingguo) * bluestore: os/bluestore: misc cleanups (`pr#11197 `_, Haomai Wang) * bluestore: os/bluestore: misc fixes (`pr#9999 `_, xie xingguo) * bluestore: os/bluestore: misc fixes (`pr#10771 `_, xie xingguo) * bluestore: os/bluestore: misc. fixes (`pr#11129 `_, xie xingguo) * bluestore: os/bluestore: more cleanups (`pr#11235 `_, xie xingguo) * bluestore: os/bluestore: more cleanups and fixes (`pr#11210 `_, xie xingguo) * bluestore: os/bluestore: narrow condition of sanity check when get_object_key() (`pr#11149 `_, xie xingguo) * bluestore: os/bluestore: narrow lock scope for cache trim() (`pr#10410 `_, xie xingguo) * bluestore: os/bluestore: optimize intrusive sets for size. (`pr#11319 `_, Mark Nelson) * bluestore: os/bluestore: pack a few more in-memory types (`pr#11328 `_, Sage Weil) * bluestore: os/bluestore: precondition rocksdb/bluefs during mkfs (`pr#10814 `_, Sage Weil) * bluestore: os/bluestore: prevent extent merging across shard boundaries (`pr#11216 `_, Sage Weil) * bluestore: os/bluestore: print bluefs_extents in hex (`pr#10689 `_, Sage Weil) * bluestore: os/bluestore: proper handling for csum enable/disable settings (`pr#10431 `_, Igor Fedotov) * bluestore: os/bluestore: refactor dirty blob tracking along with some related fixes (`pr#10215 `_, Igor Fedotov) * bluestore: os/bluestore: remove cmake warning from extent alloc functions (`issue#16766 `_, `pr#10492 `_, Ramesh Chander) * bluestore: os/bluestore: remove deferred_csum machinery (`pr#11243 `_, Sage Weil) * bluestore: os/bluestore: remove some copy-pastes (`pr#11017 `_, Igor Fedotov) * bluestore: os/bluestore: replace store with logger in Cache (`pr#10969 `_, xie xingguo) * bluestore: os/bluestore: shard extent map (`pr#10963 `_, Sage Weil) * bluestore: os/bluestore: simplify LRUCache::trim() (`pr#10109 `_, xie xingguo) * bluestore: os/bluestore: simplify calculation of collection key range (`pr#11166 `_, xie xingguo) * bluestore: os/bluestore: sloppy reshard boundaries to avoid spanning blobs (`pr#11263 `_, Sage Weil) * bluestore: os/bluestore: still more cleanups (`pr#11274 `_, xie xingguo) * bluestore: os/bluestore: switch spanning_blob_map to std::map (`pr#11336 `_, Sage Weil) * bluestore: os/bluestore: trim cache on reads (`pr#10095 `_, Sage Weil) * bluestore: os/bluestore: try to split blobs instead of spanning them (`pr#11264 `_, Sage Weil) * bluestore: os/bluestore: upgrade compression settings to atomics (`pr#11244 `_, xie xingguo) * bluestore: os/bluestore: use small encoding for bluefs extent and fnode (`pr#10375 `_, xie xingguo) * bluestore: os/bluestore: yet another statfs test fix (`pr#10926 `_, Igor Fedotov) * bluestore: os/bluestore:Fix size calculation in bitallocator (`pr#10377 `_, Ramesh Chander) * bluestore: os/bluestore: fix error handling of posix_fallocate() (`pr#10277 `_, xie xingguo) * bluestore: os/bluestore: use BE for gifting and reclaiming from bluefs (`pr#10294 `_, xie xingguo) * bluestore: os/bluestore: get rid off blob's ref_map for non-shared objects (`pr#9988 `_, Igor Fedotov) * bluestore: kv/MemDB: fix wrong output target and add sanity checks (`pr#10358 `_, xie xingguo) * bluestore: os/bluestore: add a boundary check of cache read (`pr#10349 `_, xie xingguo) * bluestore: os/bluestore: fix bitmap allocating failure if max_alloc_size is 0 (`pr#10379 `_, xie xingguo) * bluestore: os/bluestore: misc fixes (`pr#10327 `_, xie xingguo) * bluestore: kv/MemDB: misc fixes and cleanups (`pr#10295 `_, xie xingguo) * bluestore: rocksdb: pull up to master (4.12 + a few patches) (`pr#11069 `_, Sage Weil) * bluestore: test/store_test: extend Bluestore compression test to verify compress… (`pr#11080 `_, Igor Fedotov) * bluestore: test/store_test: fix statfs results check to consider SSD min_alloc_size (`pr#11096 `_, Igor Fedotov) * bluestore: unittest_bluestore_types: a few more types for sizeof (`pr#11323 `_, Sage Weil) * bluestore: ceph_test_objectstore: test clone_range and fix a few bugs (`pr#11103 `_, Sage Weil) * bluestore: kv: fix some bugs in memdb (`pr#10550 `_, Haodong Tang) * bluestore: os/bluestore/BlueFS: disable buffered io (`pr#10766 `_, Sage Weil) * build/ops,bluestore: test/objectstore/CMakeLists.txt: fix libaio conditional (`pr#11008 `_, Sage Weil) * build/ops,cephfs: client: added def for ACCESSPERMS when undefined (`pr#9835 `_, John Coyle) * build/ops,cephfs: deb: merge ceph-fs-common into ceph-common (`issue#16808 `_, `pr#10433 `_, Nathan Cutler) * build/ops,cephfs: man/Makefile-client.am: drop legacy cephfs tool (`pr#10444 `_, Nathan Cutler) * build/ops,cephfs: test: break out librados-using cephfs test (`issue#16556 `_, `pr#10452 `_, John Spray) * build/ops,common: common/dns_resolve: use ns_name_uncompress instead of ns_name_ntop (`pr#9755 `_, John Coyle) * build/ops,common: msg/async/net_handler.cc: make it more compatible with BSDs (`pr#10029 `_, Willem Jan Withagen) * build/ops,pybind: Include Python 3 bindings into the cmake build and make packages for them (`pr#10208 `_, Oleh Prypin) * build/ops,rbd: systemd: add install section to rbdmap.service file (`pr#10942 `_, Jelle vd Kooij) * build/ops,rbd: test: fix rbd-mirror workunit test cases for cmake (`pr#10076 `_, Jason Dillaman) * build/ops,rgw: rgw-ldap: add ldap lib to rgw lib deps based on build config (`pr#9852 `_, John Coyle) * build/ops: .gitignore: Add .pyc files globally (`pr#11076 `_, Brad Hubbard) * build/ops: Allow compressor build without YASM (`pr#10937 `_, Daniel Gryniewicz) * build/ops: CMake - stop pip checking for updates (`pr#10161 `_, Daniel Gryniewicz) * build/ops: CMakeList.txt: link ceph_objectstore_tool against fuse only if WITH_FUSE (`pr#10149 `_, Willem Jan Withagen) * build/ops: Cmake: fix using CMAKE_DL_LIBS instead of dl (`pr#10317 `_, Willem Jan Withagen) * build/ops: CmakeLists.txt: use LIB_RESOLV instead of resolv. (`pr#10972 `_, Willem Jan Withagen) * build/ops: Enable builds without ceph-test subpackage (`issue#16776 `_, `pr#10872 `_, Ricardo Dias) * build/ops: Fix libatomic_ops-devel in SUSE and specfile cleanup (`issue#16645 `_, `pr#10363 `_, Nathan Cutler) * build/ops: FreeBSD: Define CLOCK_REALTIME_COARSE in compat.h (`pr#10506 `_, Willem Jan Withagen) * build/ops: Gentoo support for ceph-disk / ceph-detect-init; pip speedup (`pr#8317 `_, Robin H. Johnson) * build/ops: LTTng-UST disabled for openSUSE (`issue#16937 `_, `pr#10592 `_, Michel Normand) * build/ops: Port ceph-brag to Python 3 (+ small fixes) (`pr#10064 `_, Oleh Prypin) * build/ops: Removes remaining reference to WITH_MDS (`pr#10286 `_, J. Eric Ivancich) * build/ops: Stop hiding errors from run-tox.sh (`issue#17267 `_, `pr#11071 `_, Dan Mick) * build/ops: Wip kill warnings (`pr#10881 `_, Kefu Chai) * build/ops: autogen: Fix rocksdb error when make dist (`pr#10988 `_, tianqing) * build/ops: autotools: remove a few other remaining traces (`pr#11019 `_, Sage Weil) * build/ops: build scripts: Enable dnf for Fedora >= 22 (`pr#11105 `_, Brad Hubbard) * build/ops: build: drop dryrun of autogen.sh from run-cmake-check.sh script (`pr#11013 `_, xie xingguo) * build/ops: ceph-disk tests: Let missing python interpreters be non-fatal (`pr#11072 `_, Dan Mick) * build/ops: ceph-disk: Compatibility fixes for Python 3 (`pr#9936 `_, Anirudha Bose) * build/ops: ceph-disk: do not activate device that is not ready (`issue#15990 `_, `pr#9943 `_, Boris Ranto) * build/ops: ceph-osd-prestart.sh: check existence of OSD data directory (`issue#17091 `_, `pr#10809 `_, Nathan Cutler) * build/ops: ceph-osd-prestart.sh: drop Upstart-specific code (`issue#15984 `_, `pr#9667 `_, Nathan Cutler) * build/ops: ceph-post-file replace DSA with RSA ssh key (`issue#14267 `_, `pr#10800 `_, David Galloway) * build/ops: ceph.spec.in: don't try to package __pycache__ for SUSE (`issue#17106 `_, `pr#10805 `_, Tim Serong) * build/ops: ceph.spec.in: fix rpm package building error (`pr#10115 `_, runsisi) * build/ops: changes for Clang and yasm (`pr#10417 `_, Willem Jan Withagen) * build/ops: cmake changes (`pr#10351 `_, Kefu Chai) * build/ops: cmake changes (`pr#10059 `_, Kefu Chai) * build/ops: cmake changes (`pr#10279 `_, Kefu Chai) * build/ops: cmake changes (`issue#16804 `_, `pr#10391 `_, Kefu Chai) * build/ops: cmake changes (`pr#10361 `_, Kefu Chai) * build/ops: cmake changes (`pr#10112 `_, Kefu Chai) * build/ops: cmake changes (`pr#10489 `_, Kefu Chai) * build/ops: cmake changes (`pr#10283 `_, Kefu Chai) * build/ops: cmake changes (`issue#16504 `_, `pr#9995 `_, Kefu Chai, Sage Weil, Dan Mick) * build/ops: cmake changes (`pr#9975 `_, Kefu Chai) * build/ops: cmake changes related to LTTng-UST (`pr#10917 `_, Kefu Chai) * build/ops: common/compressor: add libcommon as a dependency for zlib and snappy p… (`pr#11083 `_, Igor Fedotov) * build/ops: compat: add abstractions for non portable pthread name funcs (`pr#9763 `_, John Coyle) * build/ops: configure.ac: Use uname instead of arch. (`pr#9766 `_, John Coyle) * build/ops: configure.ac: add _LIBS variables for boost_system and boost_iostreams (`pr#9848 `_, John Coyle) * build/ops: configure.ac: fix res_query detection (`pr#9820 `_, John Coyle) * build/ops: debian and cmake cleanups (`pr#10788 `_, Kefu Chai) * build/ops: debian: bump compat to 9 (`issue#16744 `_, `pr#10366 `_, Kefu Chai) * build/ops: debian: python related changes (`pr#10322 `_, Kefu Chai) * build/ops: debian: replace SysV rbdmap with systemd service (`pr#10435 `_, Ken Dreyer) * build/ops: debian: set libexec dir to correct value as autotools did (`pr#10096 `_, Daniel Gryniewicz) * build/ops: do_cmake.sh: set up initial plugin dir (`pr#10067 `_, Sage Weil) * build/ops: fix /etc/os-release parsing in install-deps.sh (`pr#10981 `_, Nathan Cutler) * build/ops: fix the rpm build for centos (`pr#10289 `_, Oleh Prypin, Josh Durgin) * build/ops: force Python 3 packages to build in SUSE (`issue#17106 `_, `pr#10894 `_, Dominique Leuenberger, Nathan Cutler) * build/ops: install-deps.sh based on /etc/os-release (`issue#16522 `_, `pr#10017 `_, Jan Fajerski) * build/ops: install-deps: exit non-zero when we cannot match distro (`pr#10941 `_, Gregory Meno) * build/ops: isa-l: add isa-l library as a submodule (`pr#10066 `_, Alyona Kiseleva) * build/ops: jerasure: include generic objects in neon jerasure lib (like sse3/4) (`pr#10879 `_, Dan Mick) * build/ops: logrotate: Run as root/ceph (`pr#10587 `_, Boris Ranto) * build/ops: lttng: build the tracepoint provider lib from .c files in repo (`pr#11196 `_, Kefu Chai) * build/ops: make-dist: generate ceph.spec (`issue#16501 `_, `pr#9986 `_, Sage Weil) * build/ops: make-dist: set rpm_release correctly for release builds (`pr#11334 `_, Dan Mick) * build/ops: make-srpm.sh: A simple script to make the srpm for ceph. (`pr#11064 `_, Ira Cooper) * build/ops: makefile: change librgw_file_* as check_PROGRAMS (`issue#16646 `_, `pr#10229 `_, Brad Hubbard) * build/ops: remove autotools (`pr#11007 `_, Sage Weil) * build/ops: rpm: Do not start targets on update (`pr#9968 `_, Nathan Cutler, Boris Ranto) * build/ops: rpm: ExclusiveArch for suse_version (`issue#16936 `_, `pr#10594 `_, Michel Normand) * build/ops: rpm: Fix creation of mount.ceph symbolic link for SUSE distros (`pr#10353 `_, Ricardo Dias) * build/ops: rpm: add udev BuildRequires to provide /usr/lib/udev directory (`issue#16949 `_, `pr#10608 `_, Nathan Cutler) * build/ops: rpm: build rpm with cmake (`pr#10016 `_, Kefu Chai) * build/ops: rpm: drop obsolete libs-compat and python-ceph-compat metapackages (`issue#16353 `_, `pr#9757 `_, Nathan Cutler) * build/ops: rpm: fix permissions for /etc/ceph/rbdmap (`issue#17395 `_, `pr#11217 `_, Ken Dreyer) * build/ops: rpm: fix shared library devel package names and dependencies (`issue#16345 `_, `issue#16346 `_, `pr#9744 `_, Nathan Cutler, Ken Dreyer) * build/ops: rpm: move mount.ceph from ceph-base to ceph-common and add symlink in /sbin for SUSE (`issue#16598 `_, `pr#10147 `_, Nathan Cutler) * build/ops: run-cmake-check.sh: Remove redundant calls (`pr#11116 `_, Brad Hubbard) * build/ops: script: improve ceph-release-notes regex (`pr#10729 `_, Nathan Cutler) * build/ops: src/CMakeLists.txt: remove double flag -Wno-invalid-offsetof (`pr#10443 `_, Willem Jan Withagen) * build/ops: src/CMakeLists.txt: remove unneeded libraries from ceph-dencoder target (`pr#10478 `_, Willem Jan Withagen) * build/ops: src/global/pidfile.cc: Assign elements in structures individually (`pr#10516 `_, Willem Jan Withagen) * build/ops: src/kv/CMakeLists.txt: force rocksdb/include to first include directory (`pr#11194 `_, Willem Jan Withagen) * build/ops: test/common/test_util.cc: FreeBSD does not have distro information (`pr#10547 `_, Willem Jan Withagen) * build/ops: test: make check using cmake (`pr#10116 `_, Kefu Chai, Sage Weil) * build/ops: verfied f23 (`pr#10222 `_, Kefu Chai) * build/ops: yasm-wrapper: dont echo the yasm command line (`pr#10819 `_, Casey Bodley) * build/ops: .gitignore: exclude coredumps, logfiles and temporary testresults (`pr#8150 `_, Willem Jan Withagen) * build/ops: this fixes the broken build (`pr#9992 `_, Haomai Wang) * build/ops: mrgw: search for cmake build dir. (`pr#10180 `_, Abhishek Lekshmanan) * build/ops: mrun, mstart.sh, mstop.sh: search for cmake build directory (`pr#10097 `_, Yehuda Sadeh) * build/ops: arm64 fixes(`pr#10438 `_, Dan Mick) * build/ops: Wip kill warnings (`pr#10934 `_, Kefu Chai) * build/ops: systemd: add osd id to service description (`pr#10091 `_, Ruben Kerkhof) * build/ops: fix wrong indent caused compile warning (`pr#10014 `_, Wanlong Gao) * build/ops: ceph-detect-init: fix the py3 test (`pr#10266 `_, Kefu Chai) * build/ops: ceph.spec: fix ceph-mgr version requirement (`pr#11285 `_, Sage Weil) * build/ops: make-dist/ceph.spec.in: Fix srpm build breakage. (`pr#10404 `_, Ira Cooper) * build/ops: master: remove SYSTEMD_RUN from initscript (`issue#16440 `_, `issue#7627 `_, `pr#9871 `_, Vladislav Odintsov) * build/ops: rocksdb: revert the change introduced by dc41731 (`pr#10595 `_, Kefu Chai) * build/ops: do_freebsd*.sh: rename do_freebsd-cmake.sh to do_freebsd.sh (`pr#11088 `_, Kefu Chai) * build/ops: gcc 6.1.1 complains about missing include: . 4.8.3 does not c… (`pr#10747 `_, Daniel Oliveira) * build/ops: selinux: Allow ceph to manage tmp files (`issue#17436 `_, `pr#11259 `_, Boris Ranto) * build/ops: selinux: allow read /proc//cmdline (`issue#16675 `_, `pr#10339 `_, Kefu Chai) * cephfs,common: osdc/Journaler: move C_DelayFlush class to .cc (`pr#10744 `_, Michal Jarzabek) * cephfs,core,rbd: ObjectCacher: fix bh_read_finish offset logic (`issue#16002 `_, `pr#9606 `_, Greg Farnum) * cephfs,core,rbd: osdc/ObjectCacher: move C_ReadFinish, C_RetryRead (`pr#10781 `_, Michal Jarzabek) * cephfs: Add ceph_ll_setlk and ceph_ll_getlk (`pr#9566 `_, Frank S. Filz) * cephfs: CephFS: misc. cleanups and remove legacy cephfs tool (`issue#16195 `_, `issue#16035 `_, `issue#15923 `_, `pr#10243 `_, John Spray) * cephfs: Clean up handling of "/.." in ceph client (`pr#10691 `_, Jeff Layton) * cephfs: Client: fixup param type and return value (`pr#10463 `_, gongchuang) * cephfs: Client: pass "UserPerm" struct everywhere for security checks (`issue#16367 `_, `issue#17368 `_, `pr#11218 `_, Greg Farnum) * cephfs: First pile of statx patches (`pr#10922 `_, Sage Weil, Jeff Layton) * cephfs: Fix attribute handling at lookup time (`issue#16668 `_, `pr#10386 `_, Jeff Layton) * cephfs: Inotable repair during forward scrub (`pr#10281 `_, Vishal Kanaujia) * cephfs: Server: drop locks and auth pins if wait for pending truncate (`pr#9716 `_, xie xingguo) * cephfs: Small interface cleanups for struct ceph_statx (`pr#11093 `_, Jeff Layton) * cephfs: build ceph-fuse on OSX (`pr#9371 `_, Yan, Zheng) * cephfs: ceph-fuse: link to libtcmalloc or jemalloc (`issue#16655 `_, `pr#10258 `_, Yan, Zheng) * cephfs: ceph_volume_client: store authentication metadata (`issue#15406 `_, `issue#15615 `_, `pr#9864 `_, John Spray, Ramana Raja) * cephfs: client/barrier: move C_Block_Sync class to .cc (`pr#11001 `_, Michal Jarzabek) * cephfs: client/filer: cleanup the redundant judgments of _write&&_fallocate (`pr#10062 `_, huanwen ren) * cephfs: client: add missing client_lock for get_root (`pr#10027 `_, Patrick Donnelly) * cephfs: client: discard mds map if it is identical to ours (`pr#9774 `_, xie xingguo) * cephfs: client: fast abort if underlying statsf() call failed; end scope of std::hex properly (`pr#9803 `_, xie xingguo) * cephfs: client: fix access violation (`pr#9793 `_, xie xingguo) * cephfs: client: fix readdir vs fragmentation race (`issue#17286 `_, `pr#11147 `_, Yan, Zheng) * cephfs: client: fix segment fault in Client::_invalidate_kernel_dcache(). (`issue#17253 `_, `pr#11170 `_, Yan, Zheng) * cephfs: client: fix shutdown with open inodes (`issue#16764 `_, `pr#10419 `_, John Spray) * cephfs: client: include COMPLETE and ORDERED states in cache dump (`pr#10485 `_, Greg Farnum) * cephfs: client: kill compiling warning (`pr#9994 `_, xie xingguo) * cephfs: client: misc fixes (`pr#9838 `_, xie xingguo) * cephfs: client: move Inode specific cleanup to destructor (`pr#10168 `_, Patrick Donnelly) * cephfs: client: note order of member init in cons (`pr#10169 `_, Patrick Donnelly) * cephfs: client: properly set inode number of created inode in replay request (`issue#17172 `_, `pr#10957 `_, Yan, Zheng) * cephfs: client: protect InodeRef with client_lock (`issue#17392 `_, `pr#11225 `_, Yan, Zheng) * cephfs: doc/mds: fixup mds doc (`pr#10573 `_, huanwen ren) * cephfs: fuse_ll: fix incorrect error settings of fuse_ll_mkdir() (`pr#9809 `_, xie xingguo) * cephfs: include/ceph_fs.h: guard `#define CEPH_SETATTR_*` with #ifndef (`pr#10265 `_, Kefu Chai) * cephfs: libcephfs: Fix the incorrect integer conversion in libcephfs_jni.cc (`pr#10640 `_, wenjunhuang) * cephfs: libcephfs: add unmount function in cephfs.pyx (`pr#10774 `_, huanwen ren) * cephfs: libcephfs: fix portability-related error settings (`pr#9794 `_, xie xingguo) * cephfs: libcephfs: kill compiling warning (`pr#10622 `_, xie xingguo) * cephfs: mds/CDir: remove the part of judgment for _next_dentry_on_set (`pr#10476 `_, zhang.zezhu) * cephfs: mds/CInode: fix potential fin hanging (`pr#9773 `_, xie xingguo) * cephfs: mds/MDBalancer: cleanup (`pr#10512 `_, huanwen ren) * cephfs: mds/MDCache: kill a comipler warning (`pr#11254 `_, xie xingguo) * cephfs: mds/MDSMap default metadata pool to -1 (was: output None instead of 0 when no fs present.) (`issue#16588 `_, `pr#10202 `_, Xiaoxi Chen) * cephfs: mds/MDSTable: add const to member functions (`pr#10846 `_, Michal Jarzabek) * cephfs: mds/SessionMap.h: change statement to assertion (`pr#11289 `_, Michal Jarzabek) * cephfs: mds/SnapRealm.h: add const to member functions (`pr#10878 `_, Michal Jarzabek) * cephfs: mds/server: clean up handle_client_open() (`pr#11120 `_, huanwen ren) * cephfs: mon/MDSMonitor: move C_Updated class to .cc file (`pr#10668 `_, Michal Jarzabek) * cephfs: osdc/mds: fixup pos parameter in the journaler (`pr#10200 `_, huanwen ren) * cephfs: reduce unnecessary mds log flush (`pr#10393 `_, Yan, Zheng) * cephfs: tools/cephfs: Remove cephfs-data-scan tmap_upgrade (`issue#16144 `_, `pr#10100 `_, Douglas Fuller) * cephfs: ceph_fuse: use sizeof get the buf length (`pr#11176 `_, LeoZhang) * cli: retry when the mon is not configured (`issue#16477 `_, `pr#11089 `_, Loic Dachary) * cmake: Add -pie to CMAKE_EXE_LINKER_FLAGS (`pr#10755 `_, Tim Serong) * cmake: Fix FCGI include directory (`pr#9983 `_, Tim Serong) * cmake: Fix mismatched librgw VERSION / SOVERSION (`pr#10754 `_, Tim Serong) * cmake: FreeBSD specific excludes in CMakeLists.txt (`pr#10973 `_, Willem Jan Withagen) * cmake: FreeBSD specific excludes in CMakeLists.txt files (`pr#10517 `_, Willem Jan Withagen) * cmake: Really add FCGI_INCLUDE_DIR to include_directories for rgw (`pr#10139 `_, Tim Serong) * cmake: Removed README.cmake.md, edited README.md (`pr#10028 `_, Ali Maredia) * cmake: Support tcmalloc_minimal allocator (`pr#11111 `_, Bassam Tabbara) * cmake: add dependency from ceph_smalliobenchrbd to cls libraries (`pr#10870 `_, J. Eric Ivancich) * cmake: add_subdirectory(include) (`pr#10360 `_, Kefu Chai) * cmake: ceph_test_rbd_mirror does not require librados_test_stub (`pr#10164 `_, Jason Dillaman) * cmake: cleanup Findgperftools.cmake (`pr#10670 `_, Kefu Chai) * cmake: correct ceph_test_librbd/ceph_test_rbd_mirror linkage (`issue#16882 `_, `pr#10598 `_, Jason Dillaman) * cmake: disable -fvar-tracking-assignments for ceph_dencoder.cc (`pr#10275 `_, Kefu Chai) * cmake: disable unittest_async_compressor (`pr#10394 `_, Kefu Chai) * cmake: do not link against unused objects or libraries (`pr#10837 `_, Kefu Chai) * cmake: enable ccache for rocksdb too (`pr#11100 `_, Bassam Tabbara) * cmake: exclude non-public symbols in shared libraries (`issue#16556 `_, `pr#10472 `_, Kefu Chai) * cmake: fix incorrect dependencies to librados (`pr#10145 `_, Jason Dillaman) * cmake: fix the FTBFS introduced by dc8b3ba (`pr#10282 `_, Kefu Chai) * cmake: fix the build of unittest_async_compressor (`pr#10400 `_, Kefu Chai) * cmake: fix the tracing header dependencies (`pr#10906 `_, Kefu Chai) * cmake: fix unittest_rbd_mirror failures under non-optimized builds (`pr#9990 `_, Jason Dillaman) * cmake: fix wrong path introduced by bb163e9 (`pr#10643 `_, Kefu Chai) * cmake: fixes (`pr#10092 `_, Daniel Gryniewicz) * cmake: fixes for pypi changes (`pr#10204 `_, Kefu Chai) * cmake: include(SIMDExt) in src/CMakeLists.txt (`pr#11003 `_, Kefu Chai) * cmake: install ceph_test_cls_rgw (`pr#10025 `_, Kefu Chai) * cmake: install ceph_test_rados_striper_api_* (`pr#10541 `_, Kefu Chai) * cmake: install platlib into a subdir of build-base dir (`pr#10666 `_, Kefu Chai) * cmake: make py3 a nice-to-have (`issue#17103 `_, `pr#11015 `_, Kefu Chai) * cmake: pass -DINTEL* to gf-complete cflags (`pr#10956 `_, tone.zhang, Kefu Chai) * cmake: pass cmake's compiler and flags to compile RocksDB into build (`pr#10418 `_, Willem Jan Withagen) * cmake: recompile erasure src for different variants (`pr#10772 `_, Kefu Chai) * cmake: remove WITH_MDS option (`pr#10186 `_, Ali Maredia) * cmake: remove more autotools hacks (`pr#11229 `_, Sage Weil) * cmake: remove unnecessary linked libs from libcephfs (`issue#16556 `_, `pr#10081 `_, Kefu Chai) * cmake: rework NSS and SSL (`pr#9831 `_, Matt Benjamin) * cmake: set ARM_CRC_FLAGS from the CRC test rather than ARM_NEON_FLAGS (`issue#17250 `_, `pr#11028 `_, Dan Mick) * cmake: specify distutils build path explicitly (`pr#10568 `_, Kefu Chai) * cmake: supress more warnings (`pr#10469 `_, Willem Jan Withagen) * cmake: use PERF_LOCAL_FLAGS only if defined (`issue#17104 `_, `pr#10828 `_, Michel Normand) * cmake: use stock Find* modules. (`pr#10178 `_, Kefu Chai) * cmake: work to get inital FreeBSD stuff (`pr#10352 `_, Willem Jan Withagen) * cmake: find GIT_VER variables if there is no .git dir (`pr#11499 `_, Ali Maredia) * common,bluestore: Isa-l extention for zlib compression plugin (`pr#10158 `_, Alyona Kiseleva, Dan Mick) * common,bluestore: compressor/zlib: zlib wrapper fix (`pr#11079 `_, Igor Fedotov) * common: auth/cephx: misc fixes (`pr#9679 `_, xie xingguo) * common: common/PluginRegistry: improve error output for shared library load fa… (`pr#11081 `_, Igor Fedotov) * common: common/Throttle.h: remove unneeded class (`pr#10902 `_, Michal Jarzabek) * common: common/Timer.h: delete copy constr and assign op (`pr#11046 `_, Michal Jarzabek) * common: common/WorkQueue: add std move (`pr#9729 `_, Michal Jarzabek) * common: compressor: zlib compressor plugin cleanup (`pr#9782 `_, Alyona Kiseleva) * common: erasure-code: Runtime detection of SIMD for jerasure and shec (`pr#11086 `_, Bassam Tabbara) * common: global: log which process/command sent a signal (`pr#8964 `_, song baisen) * common: include/assert: clean up ceph assertion macros (`pr#9969 `_, Sage Weil) * common: instantiate strict_si_cast not strict_si_cast (`issue#16398 `_, `pr#9934 `_, Kefu Chai) * common: lockdep: verbose even if no logging is set (`pr#10576 `_, Willem Jan Withagen) * common: messages/MOSDMap: mark as enlighten OSDMap encoder (`pr#10843 `_, Sage Weil) * common: mon/Monitor.cc:replce lock/unlock with Mutex:Lockr (`pr#9792 `_, Michal Jarzabek) * common: msg/AsyncMessenger.cc: remove code duplication (`pr#10030 `_, Michal Jarzabek) * common: msg/async: less verbose debug messages at debug_ms=1 (`pr#11205 `_, Sage Weil) * common: msg/async: remove static member variable (`issue#16686 `_, `pr#10440 `_, Kefu Chai) * common: only call crypto::init once per CephContext (`issue#17205 `_, `pr#10965 `_, Casey Bodley) * common: osdc/ObjectCacher: change iterator to const_iterator and add const to member functions (`pr#9644 `_, Michal Jarzabek) * common: preforker: prevent call to 'write' on an fd that was already closed (`pr#10949 `_, Avner BenHanoch) * common: remove basename() dependency (`pr#9845 `_, John Coyle) * common: src/common/buffer.cc fix judgment for lseek (`pr#10130 `_, zhang.zezhu) * common: unknown hash type of judgment modification (`pr#9510 `_, huanwen ren) * common: Timer.cc: replace long types with auto (`pr#11067 `_, Michal Jarzabek) * common: TrackedOp: move ShardedTrackingData to .cc (`pr#10639 `_, Michal Jarzabek) * common: config_opts: fix comment(radio -> ratio) (`pr#10783 `_, xie xingguo) * common: src/common/dns_resolve.cc: reorder the includes (`pr#10505 `_, Willem Jan Withagen) * common: global/signal_handler: use sig_str instead of sys_siglist (`pr#10633 `_, John Coyle) * core,cephfs: Revert "osd/ReplicatedPG: for sync-read it don't cacl l_osd_op_r_prep… (`issue#16908 `_, `pr#10875 `_, Samuel Just) * core,cephfs: mon/mds: add err info when load_metadata is abnormal (`pr#10176 `_, huanwen ren) * core,common: osd/OSD.cc: remove unneeded returns (`pr#11043 `_, Michal Jarzabek) * core,pybind: python-rados: extends ReadOp/WriteOp API (`pr#9944 `_, Mehdi Abaakouk) * core,pybind: python-rados: implement new aio_stat. (`pr#11006 `_, Iain Buclaw) * core,pybind: qa/workunits/rados/test_python.sh: Allow specifying Python executable (`pr#10782 `_, Oleh Prypin) * core: os/filestore/LFNIndex: remove unused variable 'subdir_path' (`pr#8959 `_, huangjun) * core: Create ceph-mgr (`pr#10328 `_, John Spray, Tim Serong) * core: FileJournal: Remove obsolete _check_disk_write_cache function (`pr#11073 `_, Brad Hubbard) * core: Lua object class support (`pr#7338 `_, Noah Watkins) * core: OSD crash with Hammer to Jewel Upgrade: void FileStore::init_temp_collections() (`issue#16672 `_, `pr#10565 `_, David Zafman) * core: OSD.cc: remove unneeded return (`pr#9701 `_, Michal Jarzabek) * core: OSD: avoid FileStore finisher deadlock in osd_lock when shutdown OSD (`pr#11052 `_, Haomai Wang) * core: ObjectCacher: fix last_write check in bh_write_adjacencies() (`issue#16610 `_, `pr#10304 `_, Yan, Zheng) * core: ReplicatedPG: call op_applied for submit_log_entries based repops (`pr#9489 `_, Samuel Just) * core: Wip 16998 (`issue#16998 `_, `pr#10688 `_, Samuel Just) * core: ceph-create-keys: add missing argument comma (`pr#11123 `_, Patrick Donnelly) * core: ceph-create-keys: fix existing-but-different case (`issue#16255 `_, `pr#10415 `_, John Spray) * core: ceph-disk: partprobe should block udev induced BLKRRPART (`issue#15176 `_, `pr#9330 `_, Marius Vollmer, Loic Dachary) * core: ceph-disk: timeout ceph-disk to avoid blocking forever (`issue#16580 `_, `pr#10262 `_, Loic Dachary) * core: ceph-objectstore-tool: add a way to split filestore directories offline (`issue#17220 `_, `pr#10776 `_, Josh Durgin) * core: ceph.in: python 3 compatibility of the ceph CLI (`pr#9702 `_, Oleh Prypin) * core: ceph_mon: use readdir() as readdir_r() is deprecated (`pr#11047 `_, Kefu Chai) * core: cephx: Fix multiple segfaults due to attempts to encrypt or decrypt (`issue#16266 `_, `pr#9703 `_, Brad Hubbard) * core: https://github.com/ceph/ceph/pull/11052 (`pr#10371 `_, Yan Jun) * core: include write error codes in the pg log (`issue#14468 `_, `pr#10170 `_, Josh Durgin) * core: kv/MemDB: fix assert triggerred by m_total_bytes underflow (`pr#10471 `_, xie xingguo) * core: kv/RocksDB: add perfcounter for submit_transaction_sync operation (`pr#9770 `_, Haodong Tang) * core: logmon: check is_leader() before doing any work on get_trim_to() (`pr#10342 `_, song baisen) * core: memstore: clone zero-fills holes from source range (`pr#11157 `_, Casey Bodley) * core: message: optimization for message priority strategy (`pr#8687 `_, yaoning) * core: messages/MForward: fix encoding features (`issue#17365 `_, `pr#11180 `_, Sage Weil) * core: mgr/MgrClient: fix ms_handle_reset (`pr#11298 `_, Sage Weil) * core: mgr/MgrMap: initialize all fields (`issue#17492 `_, `pr#11308 `_, Sage Weil) * core: mon/ConfigKeyService: pass strings by const ref (`pr#10618 `_, Michal Jarzabek) * core: mon/LogMonitor: move C_Log struct to cc file (`pr#10721 `_, Michal Jarzabek) * core: mon/MonClient.h: pass strings by const reference (`pr#10605 `_, Michal Jarzabek) * core: mon/MonDBStore: fix assert which never fires (`pr#10706 `_, xie xingguo) * core: mon/MonitorDBStore: do not use snapshot iterator; close on close (`pr#10102 `_, Sage Weil) * core: mon/OSDMonitor.cc: remove use of boost assign (`pr#11060 `_, Michal Jarzabek) * core: mon/PGMonitor: batch filter pg states; add sanity check (`pr#9394 `_, xie xingguo) * core: mon/PGMonitor: calc the %USED of pool using used/(used+avail) (`issue#16933 `_, `pr#10584 `_, Kefu Chai) * core: mon/PGMonitor: move C_Stats struct to cc file (`pr#10719 `_, Michal Jarzabek) * core: mon/PaxosService: make the return value type inconsistent (`pr#10231 `_, zhang.zezhu) * core: mon/osdmonitor: fix incorrect output of "osd df" due to osd out (`issue#16706 `_, `pr#10308 `_, xie xingguo) * core: msg/AsyncMessenger: change return type to void (`pr#10230 `_, Michal Jarzabek) * core: msg/Messenger: add const and override to function (`pr#10183 `_, Michal Jarzabek) * core: msg/async/AsyncConnection: replace Mutex with std::mutex for peformance (`issue#16714 `_, `issue#16715 `_, `pr#10340 `_, Haomai Wang) * core: msg/async/Event: ensure not refer to member variable which may destroyed (`issue#16714 `_, `pr#10369 `_, Haomai Wang) * core: msg/async/kqueue: avoid remove nonexist kqueue event (`pr#9869 `_, Haomai Wang) * core: msg/async: Support close idle connection feature (`issue#16366 `_, `pr#9783 `_, Haomai Wang) * core: msg/async: allow other async backend implementations (`pr#10264 `_, Haomai Wang) * core: msg/async: avoid set out of range ms_async_op_threads option (`pr#11200 `_, Haomai Wang) * core: msg/async: connect authorizer fix + recv_buf size (`pr#9784 `_, Ilya Dryomov) * core: msg/async: harden error logic handle (`pr#9781 `_, Haomai Wang) * core: msg/async: remove fd output in log prefix (`pr#11199 `_, Haomai Wang) * core: msg/async: remove file event lock (`issue#16554 `_, `issue#16552 `_, `pr#10090 `_, Haomai Wang) * core: msg/simple/Pipe: eliminating casts for the comparing of len and recv_max_prefetch (`pr#10273 `_, zhang.zezhu) * core: msg/simple: fix wrong condition checking of writing TAG_CLOSE on closing (`pr#10343 `_, xie xingguo) * core: msg/simple: wait dispatch_queue until all pipes closed (`issue#16472 `_, `pr#9930 `_, Haomai Wang) * core: msg: make async backend default (`pr#10746 `_, Haomai Wang) * core: msg: mark daemons down on RST + ECONNREFUSED (`pr#8558 `_, Piotr Dałek) * core: os/FuseStore: fix several FuseStore issues (`pr#10723 `_, Sage Weil) * core: os/MemStore: move BufferlistObject to .cc file (`pr#10833 `_, Michal Jarzabek) * core: os/ObjectStore: fix return code of collection_empty() method (`pr#11050 `_, xie xingguo) * core: os/RocksDBStore: use effective Get API instead of iterator api (`pr#9411 `_, Jianjian Huo, Haomai Wang, Mark Nelson) * core: os/filestore/FDCache: fix bug when filestore_fd_cache_shards = 0 (`pr#11048 `_, jimifm) * core: os/filestore/FileJournal: error out if FileJournal is not a file (`issue#17307 `_, `pr#11146 `_, Kefu Chai) * core: os/filestore: add sanity checks and cleanups for mount() process (`pr#9734 `_, xie xingguo) * core: os/filestore: disable use of splice by default (`pr#11113 `_, Haomai Wang) * core: osd/OSD.cc: remove repeated searching of map (`pr#10986 `_, Michal Jarzabek) * core: osd/OSD.cc: remove unneeded searching of maps (`pr#11039 `_, Michal Jarzabek) * core: osd/OSD.h: add const to member functions (`pr#11114 `_, Michal Jarzabek) * core: osd/OSD.h: move some members under private (`pr#11121 `_, Michal Jarzabek) * core: osd/OSD.h: remove unneeded line (`pr#8980 `_, Michal Jarzabek) * core: osd/OSDMonitor: misc. cleanups (`pr#10739 `_, xie xingguo) * core: osd/OSDMonitor: misc. fixes (`pr#10491 `_, xie xingguo) * core: osd/ReplicatedBackend: add sanity check during build_push_op() (`pr#9491 `_, Yan Jun) * core: osd/ReplicatedPG: for sync-read it don't cacl l_osd_op_r_prepare_lat. (`pr#10365 `_, Jianpeng Ma) * core: osd/ReplicatedPG: remove class redeclaration (`pr#11041 `_, Michal Jarzabek) * core: osd/ReplicatedPG: remove unused param "op" from generate_subop() (`pr#10811 `_, jimifm) * core: osd/Watch: add consts to member functions (`pr#10251 `_, Michal Jarzabek) * core: osd/osd_type: check if pool is gone during check_new_interval() (`pr#10859 `_, xie xingguo) * core: osd/osdmonitor: pool of objects and bytes beyond quota should all be warn (`pr#9085 `_, huanwen ren) * core: osdc/objecter: misc fixes (`pr#10826 `_, xie xingguo) * core: pass string by const ref and add override to virtual function (`pr#9082 `_, Michal Jarzabek) * core: qa/workunits/objectstore/test_fuse.sh: make test_fuse.sh work with filestore (`pr#11057 `_, Sage Weil) * core: rados: add option to include clones when doing flush or evict (`pr#9698 `_, Mingxin Liu) * core: subman: use replace instead of format (`issue#16961 `_, `pr#10620 `_, Loic Dachary) * core: test/common/Throttle.cc: fix race in shutdown (`pr#10094 `_, Samuel Just) * core: test: add the necessary judgment (`pr#9694 `_, huanwen ren) * core: tox.ini: remove extraneous coverage --omit option (`pr#10943 `_, Josh Durgin) * core: udev: always populate /dev/disk/by-parttypeuuid (`issue#16351 `_, `pr#9885 `_, Loic Dachary) * core: os/FuseStore: remove unneeded header file (`pr#10799 `_, Michal Jarzabek) * core: os/MemStore: move OmapIteratorImpl to cc file (`pr#10803 `_, Michal Jarzabek) * core: os/Memstore.h: add override to virtual functions (`pr#10801 `_, Michal Jarzabek) * core: os/Memstore: move PageSetObject class to .cc file (`pr#10817 `_, Michal Jarzabek) * core: os/bluestore: remove unused head file. (`pr#11186 `_, Jianpeng Ma) * core: safe_io: Improve portability by replacing loff_t type usage with off_t. (`pr#9767 `_, John Coyle) * core: src/kv/MemDB.cc: the type of the parameter of push_back() does not match the ops's value_type (`pr#10455 `_, Willem Jan Withagen) * core: msg/simple: apply prefetch policy more precisely (`pr#10344 `_, xie xingguo) * core: CompatSet.h: remove unneeded inline (`pr#10071 `_, Michal Jarzabek) * core: Objclass perm feedback (`pr#10313 `_, Noah Watkins) * core: arch/arm.c: remove unnecessary variable read for simplicity (`pr#10821 `_, Weibing Zhang) * crush: don't normalize input of crush_ln iteratively (`pr#10935 `_, Piotr Dałek) * crush: reset bucket->h.items[i] when removing tree item (`issue#16525 `_, `pr#10093 `_, Kefu Chai) * crush: CrushCompiler.cc:884 (`pr#10952 `_, xu biao) * crush: CrushCompiler: error out as long as parse fails (`issue#17306 `_, `pr#11144 `_, Kefu Chai) * doc: Add documentation about snapshots (`pr#10436 `_, Greg Farnum) * doc: Add two options to radosgw-admin.rst manpage (`issue#17281 `_, `pr#11134 `_, Thomas Serlin) * doc: Changed config parameter "rgw keystone make new tenants" in radosgw multitenancy (`issue#17293 `_, `pr#11127 `_, SirishaGuduru) * doc: Modification for "TEST S3 ACCESS" section in "INSTALL CEPH OBJECT GATEWAY" page (`pr#9089 `_, la-sguduru) * doc: Update developer docs for cmake paths (`pr#11163 `_, John Spray) * doc: add "--orphan-stale-secs" to radosgw-admin(8) (`issue#17280 `_, `pr#11097 `_, Ken Dreyer) * doc: add $pid metavar conf doc (`pr#11172 `_, Patrick Donnelly) * doc: add Backporting section to Essentials chapter (`issue#15497 `_, `pr#10457 `_, Nathan Cutler) * doc: add Prepare tenant section to Testing in the cloud chapter (`pr#10413 `_, Nathan Cutler) * doc: add Upload logs to archive server section... (`pr#10414 `_, Nathan Cutler) * doc: add client config ref (`issue#16743 `_, `pr#10434 `_, Patrick Donnelly) * doc: add graphic for cap bit field (`pr#10897 `_, Patrick Donnelly) * doc: add missing PR to hammer 0.94.8 release notes (`pr#10900 `_, Nathan Cutler) * doc: add openSUSE instructions to quick-start-preflight (`pr#10454 `_, Nathan Cutler) * doc: add rgw_enable_usage_log option in Rados Gateway admin guide (`issue#16604 `_, `pr#10159 `_, Mike Hackett) * doc: add troubleshooting steps for ceph-fuse (`pr#10374 `_, Ken Dreyer) * doc: admin/build-doc: bypass sanity check if building doc (`issue#16940 `_, `pr#10623 `_, Kefu Chai) * doc: ceph-authtool man page option is --print-key not --print (`pr#9731 `_, Brad Hubbard) * doc: ceph-deploy mon add doesn't take multiple nodes (`pr#10085 `_, Chengwei Yang) * doc: clarify rbd size units (`pr#11303 `_, Ilya Dryomov) * doc: cleanup outdated radosgw description (`pr#11248 `_, Jiaying Ren) * doc: describe libvirt client logging (`pr#10542 `_, Ken Dreyer) * doc: do not list all major versions in get-packages.rst (`pr#10899 `_, Nathan Cutler) * doc: doc/cephfs: explain the various health messages (`pr#10244 `_, John Spray) * doc: doc/dev: Fix missing code section due to no lexer for "none" (`pr#9083 `_, Brad Hubbard) * doc: doc/radosgw: fix description of response elements 'Part' (`pr#10641 `_, weiqiaomiao) * doc: doc/radosgw: rename config.rst to config-fcgi.rst (`pr#10381 `_, Nathan Cutler) * doc: extend the CephFS troubleshooting guide (`pr#10458 `_, Greg Farnum) * doc: fix broken link in SHEC erasure code plugin (`issue#16996 `_, `pr#10675 `_, Albert Tu) * doc: fix description for rsize and rasize (`pr#11101 `_, Andreas Gerstmayr) * doc: fix rados/configuration/osd-config-ref.rst (`pr#10619 `_, Chengwei Yang) * doc: fix singleton example in Developer Guide (`pr#10830 `_, Nathan Cutler) * doc: fix some nits in release notes and releases table (`pr#10903 `_, Nathan Cutler) * doc: fix standby replay config (`issue#16664 `_, `pr#10268 `_, Patrick Donnelly) * doc: fix wrong osdkeepalive name in mount.ceph manpage (`pr#10840 `_, Zhi Zhang) * doc: fix/add changelog for 10.2.2, 0.94.7, 0.94.8 (`pr#10895 `_, Sage Weil) * doc: format 2 now is the default image format (`pr#10705 `_, Chengwei Yang) * doc: lgtm (build verified f23) (`pr#9745 `_, weiqiaomiao) * doc: mailmap updates for upcoming 11.0.0 (`pr#9301 `_, Yann Dupont) * doc: manual instructions to set up mds daemon (`pr#11115 `_, Peter Maloney) * doc: missing "make vstart" in quick_guide.rst (`pr#11226 `_, Leo Zhang) * doc: more details for pool deletion (`pr#10190 `_, Ken Dreyer) * doc: peering.rst, fix typo (`pr#10131 `_, Brad Hubbard) * doc: perf_counters.rst fix trivial typo (`pr#10292 `_, Brad Hubbard) * doc: rbdmap: specify bash shell interpreter (`issue#16608 `_, `pr#10733 `_, Jason Dillaman) * doc: release-notes.rst: draft 0.94.8 release notes (`pr#10730 `_, Nathan Cutler) * doc: remove btrfs contradiction (`pr#9758 `_, Nathan Cutler) * doc: remove i386 from minimal hardware recommendations (`pr#10276 `_, Kefu Chai) * doc: remove old references to inktank premium support (`pr#11182 `_, Alfredo Deza) * doc: remove the description of deleted options (`issue#17041 `_, `pr#10741 `_, MinSheng Lin) * doc: rgw, doc: fix formatting around Keystone-related options. (`pr#10331 `_, Radoslaw Zarzynski) * doc: rgw/doc: fix indent (`pr#10676 `_, Yan Jun) * doc: rm SysV instructions, add systemd (`pr#10184 `_, Ken Dreyer) * doc: silence sphinx warnings (`pr#10621 `_, Kefu Chai) * doc: small standby doc edits (`pr#10479 `_, Patrick Donnelly) * doc: update CephFS "early adopters" info (`pr#10068 `_, John Spray) * doc: update canonical tarballs URL (`pr#9695 `_, Ken Dreyer) * doc: update rbd glance configuration notes (`pr#10629 `_, Jason Dillaman) * doc: update s3 static webiste feature support status (`pr#10223 `_, Jiaying Ren) * doc: changelog: add v10.2.3 (`pr#11238 `_, Abhishek Lekshmanan) * doc: install: Use https:// for download.ceph.com (`pr#10709 `_, Colin Walters) * doc: release-notes: v0.94.9 (`pr#10927 `_, Sage Weil) * doc: release-notes: v10.2.3 jewel (`pr#11234 `_, Abhishek Lekshmanan) * doc: Add UK mirror and update copyright (`pr#10531 `_, Patrick McGarry) * doc: README.md: replace package build instructions with tarball instructions (`pr#10829 `_, Sage Weil) * doc: Removed reference about pool ownership based on BZ#1368528 (`pr#11063 `_, Bara Ancincova) * librados: use bufferlist instead of buffer::list in public header (`pr#10632 `_, Ryne Li) * librados: Rados-stripper: Flexible string matching for not found attributes (`pr#10577 `_, Willem Jan Withagen) * librados: librados examples: link and include from current source tree by default. (`issue#15100 `_, `pr#8189 `_, Jesse Williamson) * librbd: API methods to directly acquire and release the exclusive lock (`issue#15632 `_, `pr#9592 `_, Mykola Golub) * librbd: add consistency groups operations with images (`pr#10034 `_, Victor Denisov) * librbd: add explicit shrink check while resizing images (`pr#9878 `_, Vaibhav Bhembre) * librbd: asynchronous v2 image creation (`issue#15321 `_, `pr#9585 `_, Venky Shankar) * librbd: backward/forward compatibility for update_features (`issue#17330 `_, `pr#11155 `_, Jason Dillaman) * librbd: block name prefix might overflow fixed size C-string (`issue#17310 `_, `pr#11148 `_, Jason Dillaman) * librbd: cache was not switching to writeback after first flush (`issue#16654 `_, `pr#10762 `_, Jason Dillaman) * librbd: corrected use-after-free in ImageWatcher (`issue#17289 `_, `pr#11112 `_, Jason Dillaman) * librbd: deadlock when replaying journal during image open (`issue#17188 `_, `pr#10945 `_, Jason Dillaman) * librbd: delay acquiring lock if image watch has failed (`issue#16923 `_, `pr#10574 `_, Jason Dillaman) * librbd: discard hangs when 'rbd_skip_partial_discard' is enabled (`issue#16386 `_, `pr#10060 `_, Mykola Golub) * librbd: extract group module from librbd/internal (`pr#11070 `_, Victor Denisov) * librbd: failed assertion after shrinking a clone image twice (`issue#16561 `_, `pr#10072 `_, Jason Dillaman) * librbd: fix missing return statement if failed to get mirror image state (`pr#10136 `_, runsisi) * librbd: fix possible inconsistent state when disabling mirroring fails (`issue#16984 `_, `pr#10711 `_, Jason Dillaman) * librbd: ignore partial refresh error when acquiring exclusive lock (`issue#17227 `_, `pr#11044 `_, Jason Dillaman) * librbd: initial hooks for client-side, image-extent cache in IO path (`pr#9121 `_, Jason Dillaman) * librbd: interlock image refresh and exclusive lock operations (`issue#16773 `_, `issue#17015 `_, `pr#10770 `_, Jason Dillaman) * librbd: memory leak in MirroringWatcher::notify_image_updated (`pr#11306 `_, Mykola Golub) * librbd: optimize away unnecessary object map updates (`issue#16707 `_, `issue#16689 `_, `pr#10332 `_, Jason Dillaman) * librbd: optionally unregister "laggy" journal clients (`issue#14738 `_, `pr#10378 `_, Mykola Golub) * librbd: permit disabling journaling if in corrupt state (`issue#16740 `_, `pr#10712 `_, Jason Dillaman) * librbd: possible deadlock if cluster connection closed after image (`issue#17254 `_, `pr#11037 `_, Jason Dillaman) * librbd: potential deadlock closing image with in-flight readahead (`issue#17198 `_, `pr#11152 `_, Jason Dillaman) * librbd: potential double-unwatch of watch handle upon error (`issue#17210 `_, `pr#10974 `_, Jason Dillaman) * librbd: potential seg fault when blacklisting an image client (`issue#17251 `_, `pr#11034 `_, Jason Dillaman) * librbd: prevent creation of clone from non-primary mirrored image (`issue#16449 `_, `pr#10123 `_, Mykola Golub) * librbd: prevent creation of v2 image ids that are too large (`issue#16887 `_, `pr#10581 `_, Jason Dillaman) * mds: Add path filtering for dump cache (`issue#11171 `_, `pr#9925 `_, Douglas Fuller) * mds: Kill C_SaferCond in evict_sessions() (`issue#16288 `_, `pr#9971 `_, Douglas Fuller) * mds: Return "committing" rather than "committed" member in get_committing (`pr#10250 `_, Greg Farnum) * mds: Set mds_snap_max_uid to 4294967294 (`pr#11016 `_, Wido den Hollander) * mds: add assertion in handle_slave_rename_prep (`issue#16807 `_, `pr#10429 `_, John Spray) * mds: add assertions for standby_daemons invariant (`issue#16592 `_, `pr#10316 `_, Patrick Donnelly) * mds: add health warning for oversized cache (`issue#16570 `_, `pr#10245 `_, John Spray) * mds: add maximum fragment size constraint (`issue#16164 `_, `pr#9789 `_, Patrick Donnelly) * mds: add perf counters for MDLog replay and SessionMap (`pr#10539 `_, John Spray) * mds: catch duplicates in DamageTable (`issue#17173 `_, `pr#11137 `_, John Spray) * mds: fix Session::check_access() (`issue#16358 `_, `pr#9769 `_, Yan, Zheng) * mds: fix daemon selection when starting ranks (`pr#10540 `_, John Spray) * mds: fix shutting down mds timed-out due to deadlock (`issue#16396 `_, `pr#9884 `_, Zhi Zhang) * mds: fix up _dispatch ref-counting semantics (`pr#10533 `_, Greg Farnum) * mds: fixup dump Formatter' type error; add path_ino and is_primary in the CDentry::dump() (`pr#10119 `_, huanwen ren) * mds: handle blacklisting during journal recovery (`issue#17236 `_, `pr#11138 `_, John Spray) * mds: log path with CDir damage messages (`issue#16973 `_, `pr#10996 `_, John Spray) * mds: move Finisher to unlocked shutdown (`issue#16042 `_, `pr#10142 `_, Patrick Donnelly) * mds: populate DamageTable from scrub and log more quietly (`issue#16016 `_, `pr#11136 `_, John Spray) * mds: remove fail-safe queueing replay request (`issue#17271 `_, `pr#11078 `_, Yan, Zheng) * mds: remove max_mds config option (`issue#17105 `_, `pr#10914 `_, Patrick Donnelly) * mds: remove unused MDSDaemon::objecter (`pr#10566 `_, Patrick Donnelly) * mds: snap failover fixes (`pr#9955 `_, Yan, Zheng) * mds: trim null dentries proactively (`issue#16919 `_, `pr#10606 `_, John Spray) * mds: unuse Class and cleanup (`pr#10399 `_, huanwen ren) * mds: use reference to avoid copy (`pr#10191 `_, Patrick Donnelly) * mds: MDCache.h: remove unneeded access specifier (`pr#10901 `_, Michal Jarzabek) * mds: MDSDaemon: move C_MDS_Tick class to .cc file (`pr#11220 `_, Michal Jarzabek) * mgr: implement con reset handling (`pr#11299 `_, Sage Weil) * mgr: squash compiler warnings (`pr#11307 `_, John Spray) * mon: MonClient may hang on pinging an unresponsive monitor (`pr#9259 `_, xie xingguo) * mon: Monitor: validate prefix on handle_command() (`issue#16297 `_, `pr#9700 `_, You Ji) * mon: OSDMonitor: Missing nearfull flag set (`pr#11082 `_, Igor Podoski) * mon: change osdmap flags set and unset messages (`issue#15983 `_, `pr#9252 `_, Vikhyat Umrao) * mon: clear list in better way (`pr#9718 `_, song baisen) * mon: do not recalculate 'to_remove' when it's known (`pr#9717 `_, song baisen) * mon: misc cleanups (`pr#10591 `_, xie xingguo) * mon: remove the redundant cancel_probe_timeout function (`pr#10261 `_, song baisen) * mon: remove the redundant is_active judge in PaxosService (`pr#9749 `_, song baisen) * mon: tear down standby replays on MDS rank stop (`issue#16909 `_, `pr#10628 `_, John Spray) * mon: use clearer code structure (`pr#10192 `_, Patrick Donnelly) * mon: validate states transmitted in beacons (`issue#16592 `_, `pr#10428 `_, John Spray) * mon: wait 10m (not 5m) before marking down OSDs out (`pr#11184 `_, Sage Weil) * mon: write fsid use the right return value (`pr#10197 `_, song baisen) * mon: Elector:move C_ElectionExpire class to cc file (`pr#10416 `_, Michal Jarzabek) * mon: HealthMonitor: add override to virtual functs (`pr#10549 `_, Michal Jarzabek) * mon: HealthMonitor: remove unneeded include (`pr#10563 `_, Michal Jarzabek) * mon: MonClient.h: delete copy constr and assing op (`pr#10599 `_, Michal Jarzabek) * mon: MonClient: move C_CancelMonCommand to cc file (`pr#10392 `_, Michal Jarzabek) * mon: MonClient: move C_Tick struct to cc file (`pr#10383 `_, Michal Jarzabek) * mon: Monitor.h: add override to virtual functions (`pr#10515 `_, Michal Jarzabek) * mon: Monitor: move C_Scrub, C_ScrubTimeout to .cc (`pr#10513 `_, Michal Jarzabek) * mon: OSDMonitor.cc: remove unneeded casts (`pr#10575 `_, Michal Jarzabek) * mon: Paxos: move classes to .cc file (`pr#11215 `_, Michal Jarzabek) * mon: PaxosService: move classes to cc file (`pr#10529 `_, Michal Jarzabek) * mon: remove the redundant list swap in paxos commit_proposal (`pr#10011 `_, song baisen) * msgr: set close on exec flag (`issue#16390 `_, `pr#9772 `_, Kefu Chai) * msgr: Accepter.h: add override to virtual function (`pr#10422 `_, Michal Jarzabek) * msgr: Accepter: move include to cc file (`pr#10441 `_, Michal Jarzabek) * msgr: AsyncConnection: add const to mem functions (`pr#10302 `_, Michal Jarzabek) * msgr: AsyncMessenger.cc: remove unneeded cast (`pr#10141 `_, Michal Jarzabek) * msgr: AsyncMessenger: add const to function (`pr#10114 `_, Michal Jarzabek) * msgr: AsyncMessenger: move C_handle_reap class to cc (`pr#10113 `_, Michal Jarzabek) * msgr: AsyncMessenger: move C_processor_accept class (`pr#9991 `_, Michal Jarzabek) * msgr: AsyncMessenger: remove unneeded include file (`pr#10195 `_, Michal Jarzabek) * msgr: AsyncMessenger: remove unused function (`pr#10163 `_, Michal Jarzabek) * msgr: EventKqueue.h: add override to virtual func (`pr#10318 `_, Michal Jarzabek) * msgr: EventPoll.h: add override to virtual functions (`pr#10314 `_, Michal Jarzabek) * msgr: EventSelect.h: add override to virtual funct (`pr#10321 `_, Michal Jarzabek) * msgr: EventSelect: move includes to cc file (`pr#10333 `_, Michal Jarzabek) * msgr: FastStrategy.h: add override to virtual funct (`pr#10482 `_, Michal Jarzabek) * msgr: Message.h: add const to member function (`pr#10354 `_, Michal Jarzabek) * msgr: Message.h: remove code duplication (`pr#10356 `_, Michal Jarzabek) * msgr: QueueStrategy: add override to virtual functs (`pr#10503 `_, Michal Jarzabek) * msgr: Stack.h: delete copy constr and assign op (`pr#11107 `_, Michal Jarzabek) * msgr: async/Event.h: add const to member function (`pr#10224 `_, Michal Jarzabek) * msgr: async: remove unused code. (`pr#11247 `_, Jianpeng Ma) * osd: bail out if transaction size overflows (`issue#16982 `_, `pr#10753 `_, Kefu Chai) * osd: cleanup options and other redundancies (`pr#10450 `_, xie xingguo) * osd: drop unused variables/methods (`pr#10559 `_, xie xingguo) * osd: fix the mem leak of RepGather (`issue#16801 `_, `pr#10423 `_, Kefu Chai) * osd: fixups to explicitly persistenting missing sets (`pr#10405 `_, Samuel Just) * osd: increment stats on recovery pull also (`issue#16277 `_, `pr#10152 `_, Kefu Chai) * osd: limit omap data in push op (`issue#16128 `_, `pr#9894 `_, Wanlong Gao) * osd: minor performance improvements (`pr#10470 `_, xie xingguo) * osd: minor performance improvements and fixes (`pr#10526 `_, xie xingguo) * osd: misc fixes and cleanups (`pr#10610 `_, xie xingguo) * osd: miscellaneous fixes (`pr#10572 `_, xie xingguo) * osd: more cleanups (`pr#10548 `_, xie xingguo) * osd: object class loading and execution permissions (`pr#9972 `_, Noah Watkins) * osd: pass shared_ptr by const reference (`pr#11266 `_, Michal Jarzabek) * osd: persist the missing set explicitly (`pr#10334 `_, Samuel Just) * osd: remove dispatch queue check since we don't queue hb message to this (`pr#9947 `_, Haomai Wang) * osd: remove duplicated function (`pr#9117 `_, Wei Jin) * osd: replace ceph:atomic_t with std::atomic in osd module. (`pr#9138 `_, Xiaowei Chen) * osd: should not look up an empty pg (`issue#17380 `_, `pr#11208 `_, Kefu Chai, Loic Dachary) * osd: small cleanups (`pr#9980 `_, Wanlong Gao) * osd: subscribe for old osdmaps when pause flag is set (`issue#17023 `_, `pr#10725 `_, Kefu Chai) * osd:preserve allocation hint attribute during recovery (`pr#9452 `_, yaoning) * osd: osd-fast-mark-down.sh: fix typo in variable assignments (`pr#11224 `_, Willem Jan Withagen) * osd: OSD.cc: initialise variable at definition (`pr#11099 `_, Michal Jarzabek) * osd: OSD.cc: remove unneeded searching of map (`pr#11000 `_, Michal Jarzabek) * osd: OSD.h: make some members private (`pr#11085 `_, Michal Jarzabek) * osd: PG.cc: remove unneeded use of count (`pr#11228 `_, Michal Jarzabek) * osd: PGBackend.h: move structs to .cc file (`pr#10975 `_, Michal Jarzabek) * osd: ReplicatedBackend: move classes to cc file (`pr#10967 `_, Michal Jarzabek) * osd: ReplicatedPG.h: add override to virtual funct (`pr#11271 `_, Michal Jarzabek) * osd: ReplicatedPG: move classes to .cc file (`pr#10971 `_, Michal Jarzabek) * osd: ReplicatedPG:move C_OSD_OnApplied class to cc (`pr#11288 `_, Michal Jarzabek) * osd: Watch.h: remove unneeded forward declaration (`pr#10269 `_, Michal Jarzabek) * osd: osdc/ObjectCacher.h: add const to member functions (`pr#9569 `_, Michal Jarzabek) * osd: osdc/ObjectCacher.h: add const to member functions (`pr#9652 `_, Michal Jarzabek) * osd: osdc/Objecter: move RequestStateHook class to .cc (`pr#10734 `_, Michal Jarzabek) * pybind: Port Python-based tests and remaining Python bindings to Python 3 (`pr#10177 `_, Oleh Prypin) * pybind: Rework cephfs/setup.py for PyPI (`pr#10315 `_, Anirudha Bose) * pybind: Rework rbd/setup.py for PyPI (`issue#16940 `_, `pr#10376 `_, Anirudha Bose) * pybind: global/signal_handler: dump cmdline instead of arg[0] (`pr#10345 `_, Kefu Chai) * pybind: make rados ready for PyPI (`pr#9833 `_, Anirudha Bose) * pybind: pybind/ceph_argparse: handle non ascii unicode args (`issue#12287 `_, `pr#8943 `_, Kefu Chai) * pybind: Python 3 compatibility for workunits (`pr#10815 `_, Anirudha Bose) * rbd: Allow user to remove snapshot with --force to auto flatten children (`pr#10087 `_, Dongsheng Yang) * rbd: Reviewed-off-by: Ilya Dryomov (`issue#16171 `_, `pr#10481 `_, Jason Dillaman) * rbd: Reviewed-off-by: Ilya Dryomov (`issue#17030 `_, `pr#10735 `_, Jason Dillaman) * rbd: bench io-size should not be larger than image size (`issue#16967 `_, `pr#10708 `_, Jason Dillaman) * rbd: cleanup - Proxied operations shouldn't result in error messages if replayed (`issue#16130 `_, `pr#9724 `_, Vikhyat Umrao) * rbd: cls_rbd: clean up status from rbd-mirror if image removed (`pr#11142 `_, Huan Zhang) * rbd: cls_rbd: set omap values in batch during image creation (`pr#9981 `_, Dongsheng Yang) * rbd: inherit the parent image features when cloning an image (`issue#15388 `_, `pr#9334 `_, Dongsheng Yang) * rbd: journal: ensure in-flight ops are complete destroying journaler (`issue#17446 `_, `pr#11257 `_, Mykola Golub, Jason Dillaman) * rbd: journal: increase concurrency/parallelism of journal recorder (`issue#15259 `_, `pr#10445 `_, Ricardo Dias) * rbd: journal: move JournalTrimmer::C_RemoveSet struct (`pr#10912 `_, Michal Jarzabek) * rbd: qa/workunits/rbd: before removing image make sure it is not bootstrapped (`issue#16555 `_, `pr#10155 `_, Mykola Golub) * rbd: qa/workunits/rbd: check status also in pool dir after asok commands (`pr#11291 `_, Mykola Golub) * rbd: qa/workunits/rbd: set image-meta on primary image and wait it is replicated (`pr#11294 `_, Mykola Golub) * rbd: qa/workunits/rbd: small fixup and improvements for rbd-mirror tests (`pr#10483 `_, Mykola Golub) * rbd: qa/workunits/rbd: wait for image deleted before checking health (`pr#10545 `_, Mykola Golub) * rbd: qa/workunits: support filtering cls_rbd unit test cases (`issue#16529 `_, `pr#10714 `_, Jason Dillaman) * rbd: rbd-mirror: 'wait_for_scheduled_deletion' callback might deadlock (`issue#16491 `_, `pr#9964 `_, Jason Dillaman) * rbd: rbd-mirror: Add sparse read for sync image (`issue#16780 `_, `pr#11005 `_, tianqing) * rbd: rbd-mirror: add additional test scenarios (`pr#10488 `_, lande1234) * rbd: rbd-mirror: concurrent access of event might result in heap corruption (`issue#17283 `_, `pr#11104 `_, Jason Dillaman) * rbd: rbd-mirror: force-promoted image will remain R/O until rbd-mirror daemon restarted (`issue#16974 `_, `pr#11090 `_, Jason Dillaman) * rbd: rbd-mirror: gracefully fail if object map is unavailable (`issue#16558 `_, `pr#10065 `_, Jason Dillaman) * rbd: rbd-mirror: gracefully handle being blacklisted (`issue#16349 `_, `pr#9970 `_, Jason Dillaman) * rbd: rbd-mirror: image deleter should use pool id + global image uuid for key (`issue#16538 `_, `issue#16227 `_, `pr#10484 `_, Jason Dillaman) * rbd: rbd-mirror: improve split-brain detection logic (`issue#16855 `_, `pr#10703 `_, Jason Dillaman) * rbd: rbd-mirror: include local pool id in resync throttle unique key (`issue#16536 `_, `pr#10254 `_, Jason Dillaman) * rbd: rbd-mirror: non-primary image is recording journal events during image sync (`pr#10462 `_, Jason Dillaman) * rbd: rbd-mirror: potential IO stall when using asok flush request (`issue#16708 `_, `pr#10432 `_, Jason Dillaman) * rbd: rbd-mirror: potential assertion failure during error-induced shutdown (`issue#16956 `_, `pr#10613 `_, Jason Dillaman) * rbd: rbd-mirror: potential race condition during failure shutdown (`issue#16980 `_, `pr#10667 `_, Jason Dillaman) * rbd: rbd-mirror: quiesce in-flight event commits before shut down (`issue#17355 `_, `pr#11185 `_, Jason Dillaman) * rbd: rbd-mirror: reduce memory footprint during journal replay (`issue#16223 `_, `pr#10341 `_, Jason Dillaman) * rbd: rbd-mirror: remove ceph_test_rbd_mirror_image_replay test case (`issue#16539 `_, `pr#10083 `_, Mykola Golub) * rbd: rbd-mirror: replaying state should include flush action (`issue#16970 `_, `pr#10627 `_, Jason Dillaman) * rbd: rbd-mirror: replicate dynamic feature updates (`issue#16213 `_, `pr#10980 `_, Mykola Golub) * rbd: rbd-mirror: replicate image metadata settings (`issue#16212 `_, `pr#11168 `_, Mykola Golub) * rbd: rbd-mirror: snap rename does not properly replicate to peers (`issue#16622 `_, `pr#10249 `_, Jason Dillaman) * rbd: rbd-nbd does not properly handle resize notifications (`issue#15715 `_, `pr#9291 `_, Mykola Golub) * rbd: rbd-nbd: fix kernel deadlock during teuthology testing (`issue#16921 `_, `pr#10985 `_, Jason Dillaman) * rbd: recognize lock_on_read option (`pr#11313 `_, Ilya Dryomov) * rbd: return error if we specified a wrong image name for rbd du (`issue#16987 `_, `pr#11031 `_, Dongsheng Yang) * rbd: test/librbd/fsx: enable exclusive-lock feature in krbd mode (`pr#10984 `_, Ilya Dryomov) * rbd: test/rbd: fix possible mock journal race conditions (`issue#17317 `_, `pr#11153 `_, Jason Dillaman) * rbd: test: cmake related fixups for rbd tests (`pr#10124 `_, Mykola Golub) * rbd: test: run-rbd-tests test cmake fixup (`pr#10134 `_, Mykola Golub) * rbd: test: use wrapper that respects RBD_FEATURES when creating rbd image (`issue#16717 `_, `pr#10348 `_, Mykola Golub) * rbd: udev: add krbd readahead placeholder (`pr#10841 `_, Nick Fisk) * rbd: rbd_mirror/ImageSynceThrottler: move struct to .cc (`pr#10928 `_, Michal Jarzabek) * rgw: (build verified, provably unused/not aliased) (`pr#9993 `_, weiqiaomiao) * rgw: Add documentation for the Multi-tenancy feature (`pr#9570 `_, Pete Zaitcev) * rgw: Clean up lifecycle thread (`pr#10480 `_, Daniel Gryniewicz) * rgw: Do not archive metadata by default (`issue#17256 `_, `pr#11051 `_, Pavan Rallabhandi) * rgw: Fix Host->bucket fallback logic inversion (`issue#15975 `_, `issue#17136 `_, `pr#10873 `_, Robin H. Johnson) * rgw: Fix for using port 443 with pre-signed urls. (`issue#16548 `_, `pr#10088 `_, Pritha Srivastava) * rgw: Fix incorrect content length and range for zero sized objects during range requests (`issue#16388 `_, `pr#10207 `_, Pavan Rallabhandi) * rgw: Got rid of recursive mutex. (`pr#10562 `_, Adam Kupczyk) * rgw: RGW : setting socket backlog for via ceph.conf (`issue#16406 `_, `pr#9891 `_, Feng Guo) * rgw: RGWMetaSyncCR holds refs to stacks instead of crs (`issue#16666 `_, `pr#10301 `_, Casey Bodley) * rgw: Reviewed by: Pritha Srivastava (`issue#16188 `_, `pr#9584 `_, Albert Tu) * rgw: Rgw lifecycle testing (`pr#11131 `_, Daniel Gryniewicz) * rgw: Rgw nfs 28 (`pr#10611 `_, Matt Benjamin) * rgw: add configurables for {data,meta} sync error injection (`pr#10388 `_, Yehuda Sadeh) * rgw: add deadlock detection to RGWCoroutinesManager::run() (`pr#10032 `_, Casey Bodley) * rgw: add lc_pool when decode or encode struct RGWZoneParams (`pr#10439 `_, weiqiaomiao) * rgw: add missing master_zone when running with old default region config (`issue#16627 `_, `pr#10205 `_, Orit Wasserman) * rgw: add pg_ver to tombstone_cache (`pr#9851 `_, Casey Bodley) * rgw: add reinit/rebind logic (ldap) (`pr#10532 `_, Matt Benjamin) * rgw: add return value checking to avoid possible subsequent `parse` exception (`pr#10241 `_, Yan Jun) * rgw: add suport for Swift-at-root dependent features of Swift API (`issue#16673 `_, `pr#10280 `_, Pritha Srivastava, Radoslaw Zarzynski) * rgw: add support for Static Website of Swift API (`pr#9844 `_, Radoslaw Zarzynski) * rgw: add tenant support to multisite sync (`issue#16469 `_, `pr#10075 `_, Casey Bodley) * rgw: back off bucket sync on failures, don't store marker (`issue#16742 `_, `pr#10355 `_, Yehuda Sadeh) * rgw: better error message when user has no bucket created yet (`issue#16444 `_, `pr#10162 `_, Gaurav Kumar Garg) * rgw: clean-up in the authentication infrastructure (`pr#10212 `_, Radoslaw Zarzynski) * rgw: clear realm watch on failed watch_restart (`issue#16817 `_, `pr#10446 `_, Casey Bodley) * rgw: collect skips a specific coroutine stack (`issue#16665 `_, `pr#10274 `_, Yehuda Sadeh) * rgw: cosmetic changes only--build verified, f23 (`pr#9931 `_, Yan Jun) * rgw: delete region map after upgrade to zonegroup map (`issue#17051 `_, `pr#10831 `_, Casey Bodley) * rgw: do not try to encode or decode time_t and fix compiling warnings (`pr#10751 `_, Kefu Chai) * rgw: don't fail if lost race when setting acls (`issue#16930 `_, `pr#11286 `_, Yehuda Sadeh) * rgw: drop create_bucket in fwd_request log message (`pr#10214 `_, Abhishek Lekshmanan) * rgw: eradicate dynamic memory allocation in RGWPostObj. (`pr#11054 `_, Radoslaw Zarzynski) * rgw: file setattr (`pr#8618 `_, Matt Benjamin) * rgw: finish error_repo cr in stop_spawned_services() (`issue#16530 `_, `pr#10031 `_, Yehuda Sadeh) * rgw: fix RGWAccessControlPolicy_SWIFT::create return value check error (`issue#17090 `_, `pr#10727 `_, weiqiaomiao) * rgw: fix compilation (`pr#10252 `_, Josh Durgin) * rgw: fix decoding of creation_time and last_update. (`issue#17167 `_, `pr#11132 `_, Orit Wasserman) * rgw: fix error_repo segfault in data sync (`issue#16603 `_, `pr#10157 `_, Casey Bodley) * rgw: fix failed to create bucket if a non-master zonegroup has a single zone (`pr#10991 `_, weiqiaomiao) * rgw: fix flush_read_list() error msg (`pr#10749 `_, Jiaying Ren) * rgw: fix for issue 16494 (`issue#16494 `_, `pr#10077 `_, Yehuda Sadeh) * rgw: fix for s3tests failure when ldap auth is not applied (`pr#10669 `_, Casey Bodley) * rgw: fix get object instance returned NoSuchKey error (`issue#17111 `_, `pr#10820 `_, Yang Honggang) * rgw: fix is_admin handling in RGWLDAPAuthEngine and introduce acct_privilege_t (`pr#10687 `_, Radoslaw Zarzynski) * rgw: fix issue 16435 (`issue#16435 `_, `pr#10193 `_, Yehuda Sadeh) * rgw: fix multi-delete query param parsing. (`issue#16618 `_, `pr#10187 `_, Robin H. Johnson) * rgw: fix period update --commit return error (`issue#17110 `_, `pr#10836 `_, weiqiaomiao) * rgw: fix radosgw daemon core when reopen logs (`issue#17036 `_, `pr#10737 `_, weiqiaomiao) * rgw: fix regression with handling double underscore (`issue#16856 `_, `pr#10939 `_, Orit Wasserman) * rgw: fix rgw_bucket_dir_entry decode v (`pr#10918 `_, Tianshan Qu) * rgw: fix the error return variable in log message and cleanups (`pr#10138 `_, Yan Jun) * rgw: fix the missing return value (`pr#10122 `_, Yan Jun) * rgw: fix upgrade from old multisite to new multisite configuration (`issue#16751 `_, `pr#10368 `_, Orit Wasserman) * rgw: fix wrong variable definition in cls_version_check func (`pr#10233 `_, weiqiaomiao) * rgw: fix wrong variable definition in rgw_cls_lc_set_entry function (`pr#10408 `_, weiqiaomiao) * rgw: for the create_bucket api, if the input creation_time is zero, we should set it to 'now" (`issue#16597 `_, `pr#10118 `_, weiqiaomiao) * rgw: kill a compile warning for rgw_sync (`pr#10425 `_, Casey Bodley, Abhishek Lekshmanan) * rgw: lgtm (`pr#9941 `_, weiqiaomiao) * rgw: lgtm (build verified, f23) (`pr#9754 `_, John Coyle) * rgw: lgtm, build verified f23 (`pr#10035 `_, Yan Jun) * rgw: lgtm--build verified, f23 (`pr#10002 `_, Yan Jun) * rgw: lgtm--build verified, f23 (`pr#9985 `_, Yan Jun) * rgw: lgtm--should backport (`pr#9979 `_, Yan Jun) * rgw: log mp upload failures due to parts mismatch (`pr#10424 `_, Abhishek Lekshmanan) * rgw: merge setting flags operation together and cleanups (`pr#10203 `_, Yan Jun) * rgw: miscellaneous cleanups (`pr#10299 `_, Yan Jun) * rgw: multiple fixes for Swift's object expiration (`issue#16705 `_, `issue#16684 `_, `pr#10330 `_, Radoslaw Zarzynski) * rgw: need to 'open_object_section' before dump stats in 'RGWGetUsage\_… (`issue#17499 `_, `pr#11325 `_, weiqiaomiao) * rgw: obsolete 'radosgw-admin period prepare' command (`issue#17387 `_, `pr#11278 `_, Gaurav Kumar Garg) * rgw: radosgw-admin: add "--orphan-stale-secs" to --help (`issue#17280 `_, `pr#11098 `_, Ken Dreyer) * rgw: radosgw-admin: zone[group] modify can change realm id (`issue#16839 `_, `pr#10477 `_, Casey Bodley) * rgw: raise log levels for common radosgw-admin errors (`issue#16935 `_, `pr#10602 `_, Shilpa Jagannath) * rgw: register the correct handler for cls_user_complete_stats (`issue#16624 `_, `pr#10151 `_, Orit Wasserman) * rgw: remove bucket index objects when deleting the bucket (`issue#16412 `_, `pr#10120 `_, Orit Wasserman) * rgw: remove possible duplicate setting (`pr#10110 `_, Yan Jun) * rgw: remove the field ret from class RGWPutLC (`pr#10726 `_, weiqiaomiao) * rgw: remove unused bufferlist variable (`pr#10194 `_, Yan Jun) * rgw: remove unused realm from radosgw-admin zone modify (`issue#16632 `_, `pr#10211 `_, Orit Wasserman) * rgw: remove unused variables (`pr#10589 `_, Yan Jun) * rgw: return "NoSuchLifecycleConfiguration" if lifecycle config does not exist (`pr#10442 `_, weiqiaomiao) * rgw: revert a commit that broke s3 signature validation (`issue#17279 `_, `pr#11102 `_, Casey Bodley) * rgw: rgw file: remove busy-wait in RGWLibFS::gc() (`pr#10638 `_, Matt Benjamin) * rgw: rgw ldap: protect rgw::from_base64 from non-base64 input (`pr#10777 `_, Matt Benjamin) * rgw: rgw ldap: enforce simple_bind w/LDAPv3 (`pr#10593 `_, Matt Benjamin) * rgw: rgw multisite: RGWCoroutinesManager::run returns status of last cr (`issue#17047 `_, `pr#10778 `_, Casey Bodley) * rgw: rgw multisite: RGWDataSyncCR fails on errors from RGWListBucketIndexesCR (`issue#17073 `_, `pr#10779 `_, Casey Bodley) * rgw: rgw multisite: fix for assertion in RGWMetaSyncCR (`issue#17044 `_, `pr#10743 `_, Casey Bodley) * rgw: rgw multisite: fixes for period puller (`issue#16939 `_, `pr#10596 `_, Casey Bodley) * rgw: rgw multisite: trim data logs as peer zones catch up (`pr#10372 `_, Casey Bodley) * rgw: rgw nfs v3 completions (`pr#10745 `_, Matt Benjamin) * rgw: rgw-admin: allow unsetting user's email (`issue#13286 `_, `pr#11340 `_, Yehuda Sadeh, Weijun Duan) * rgw: rgw/admin: fix some return values and indents (`pr#9170 `_, Yan Jun) * rgw: rgw/rados: remove confused error printout (`pr#9351 `_, Yan Jun) * rgw: rgw/rgw_common.cc: modify the end check in RGWHTTPArgs::sys_get (`pr#9136 `_, zhao kun) * rgw: rgw/rgw_lc.cc: fix sleep time according to the error message (`pr#10930 `_, Weibing Zhang) * rgw: rgw/rgw_main: fix unnecessary variables defined (`pr#10475 `_, zhang.zezhu) * rgw: rgw/swift: remove redundant assignment operation (`pr#11292 `_, Yan Jun) * rgw: rgw_file: pre-assign times (`issue#17367 `_, `pr#11181 `_, Matt Benjamin) * rgw: rgw_file: fix rename cases and unify unlink (`pr#10271 `_, Matt Benjamin) * rgw: rgw_file: fix set_attrs operation (`pr#11159 `_, Matt Benjamin) * rgw: rgw_file: refuse partial, out-of-order writes (`pr#10284 `_, Matt Benjamin) * rgw: rgw_file: restore local definition of RGWLibFS gc interval (`pr#10756 `_, Matt Benjamin) * rgw: rgw_file: unlock() must precede out label (`pr#10635 `_, Matt Benjamin) * rgw: right parenthesis is missing in radosgw-admin help message on caps (`pr#10947 `_, Weibing Zhang) * rgw: set correct instance on the object (`issue#17443 `_, `pr#11270 `_, Yehuda Sadeh) * rgw: store oldest mdlog period in rados (`issue#16894 `_, `pr#10558 `_, Casey Bodley) * rgw: test/multi.py add a destructive attr to tests (`pr#10401 `_, Abhishek Lekshmanan) * rgw: test/rgw: add --gateways-per-zone to test_multi.py (`pr#10742 `_, Casey Bodley) * rgw: test_multi.py avoid creating mds (`pr#10174 `_, Abhishek Lekshmanan) * rgw: test_rgw_bencode: null terminate strings before checking (`issue#16861 `_, `pr#10510 `_, Yehuda Sadeh) * rgw: use endpoints from master zone instead of zonegroup (`issue#16834 `_, `pr#10456 `_, Casey Bodley) * rgw: use the standard usage of string.find (`pr#10226 `_, Yan Jun) * rgw: verfied: f23, subset of s3tests (`pr#10448 `_, Pritha Srivastava) * rgw: verified (`pr#10000 `_, weiqiaomiao) * rgw: verified non-regression (MS AD) (`pr#10597 `_, Pritha Srivastava) * rgw: verified: autobuild (`issue#16928 `_, `pr#10579 `_, Robin H. Johnson) * rgw: verified: MS AD (`pr#10307 `_, Pritha Srivastava) * rgw: verified: f23 (`pr#10882 `_, Michal Jarzabek) * rgw: verified: f23 (`pr#10858 `_, Weibing Zhang) * rgw: verified: f23 (`pr#10822 `_, Yan Jun) * rgw: verified: f23 (`pr#10929 `_, Weibing Zhang) * rgw: wip: rgw multisite: preserve zone's extra pool (`issue#16712 `_, `pr#10397 `_, Abhishek Lekshmanan) * rgw: work around curl_multi_wait bug with non-blocking reads (`issue#15915 `_, `issue#16695 `_, `pr#10998 `_, Casey Bodley) * rgw:add a s3 API of make torrent for a object (`pr#10396 `_, zhouruisong) * rgw:add a s3 API of make torrent for a object (`pr#9589 `_, zhouruisong) * rgw:bucket check remove _multipart_ prefix (`pr#6501 `_, Weijun Duan) * rgw:clean unuse bufferlist (`pr#10232 `_, weiqiaomiao) * rgw:fix rgw boot failed after upgrade to master latest version (`pr#10409 `_, weiqiaomiao) * rgw:lifecycle feature [rebased] (`pr#9737 `_, Ji Chen, Daniel Gryniewicz) * rgw: rgw/rgw_rados.h: remove unneeded class C_Tick (`pr#10954 `_, Michal Jarzabek) * rgw: ext_mime_map_init add string describing for error number (`pr#9807 `_, Yan Jun) * tests: Add test for global static non-POD segfault (`pr#10486 `_, Brad Hubbard) * tests: populate /dev/disk/by-partuuid for scsi_debug (`issue#17100 `_, `pr#10824 `_, Loic Dachary) * tests: use a fixture for memstore clone testing (`pr#11190 `_, Kefu Chai) * tests: run-\*make-check.sh: Make DRY_RUN actually mean a dry run (`pr#11074 `_, Brad Hubbard) * tests: run-cmake-check.sh: Actually run the tests (`pr#11075 `_, Brad Hubbard) * tests: run-cmake-check.sh: Init submodules (`pr#11091 `_, Brad Hubbard) * tests: run-make-check.sh: Make DRY_RUN actually do a dry run (`pr#11092 `_, Brad Hubbard) * tests: run-make-check.sh: pass args to do_cmake.sh (`pr#10701 `_, John Coyle) * tests: unittest_chain_xattr: account for existing xattrs (`issue#16025 `_, `pr#11109 `_, Dan Mick) * tests: src/test/cli/* tests: POSIX Convert grep -P to grep -E (`pr#10319 `_, Willem Jan Withagen) * test: ceph_test_msgr: fix circular locking dependency (`issue#16955 `_, `pr#10612 `_, Kefu Chai) * test: cli/crushtool: fix the test of compile-decompile-recompile.t (`issue#17306 `_, `pr#11173 `_, Kefu Chai) * test: libcephfs: fix gcc sys/fcntl.h warnings (`pr#10126 `_, John Coyle) * test: librados: rados_connect() should succeed (`issue#17087 `_, `pr#10806 `_, Kefu Chai) * test: mds: add fs dump in test_ceph_argparse.py (`pr#10347 `_, huanwen ren) * test: simple_dispatcher.cc: remove unused variable (`pr#9932 `_, Michal Jarzabek) * test: store_test: tidy-up SyntheticWorkloadState class (`pr#10775 `_, xie xingguo) * test: More portable use of mmap(MAP_ANON) (`pr#10557 `_, Willem Jan Withagen) * test: Removeall merged after print_function commit needs a fix (`pr#10535 `_, David Zafman) * test: ceph-disk.sh do not kill all daemons (`issue#16729 `_, `pr#10346 `_, Kefu Chai) * test: cephtool/test.sh: fix expect_false() calls (`pr#10133 `_, Kefu Chai) * test: fix usage info of omapbench (`pr#10089 `_, Wanlong Gao) * test: remove ceph_test_rados_api_tmap_migrate (`issue#16144 `_, `pr#10256 `_, Kefu Chai) * test: test_{compression_plugin,async_compressor}: do not copy plugins (`pr#10153 `_, Kefu Chai) * test: test_rados_tool.sh: Make script work under ctest (`pr#10166 `_, Willem Jan Withagen) * test: qa/workunits/cephtool/test.sh: fix omission of ceph-command (`pr#10979 `_, Willem Jan Withagen) * test: qa/workunits/cephtool/test.sh: s/TMPDIR/TEMP_DIR/ (`pr#10306 `_, Kefu Chai) * test: qa/workunits/cephtool/test.sh: use absolute path for TEMP_DIR (`pr#10430 `_, Kefu Chai) * tools: New "removeall" used to remove head with snapshots (`pr#10098 `_, David Zafman) * tools: do not closed stdout ; fix overload of "<" operator (`pr#9290 `_, xie xingguo) * tools: fix the core dump when get the crushmap do not exist (`pr#10451 `_, song baisen) * tools: rebuild monstore (`issue#17179 `_, `pr#10933 `_, Kefu Chai) * tools: use TextTable for "rados df" plain output (`pr#9362 `_, xie xingguo) * tools: fio engine for objectstore (`pr#10267 `_, Casey Bodley, Igor Fedotov, Daniel Gollub) * tools: rados/client: fix typo (`pr#10493 `_, Yan Jun) * tools: rados/client: fix waiting on the condition variable more efficient. (`pr#9939 `_, Yan Jun) * tools: tools/rebuild_mondb: kill comipling warning and other fixes (`pr#11117 `_, xie xingguo) * tools: authtool: Enhance argument combinations validation (`issue#2904 `_, `pr#9704 `_, Brad Hubbard) * tools: ceph-disk: change ownership of initfile to ceph:ceph (`issue#16280 `_, `pr#9688 `_, Shylesh Kumar) * test: ceph_test_rados_api_tmap_migrate: remove test for tmap_upgrade (`pr#10234 `_, Kefu Chai)