Discussion:
why the performance of ceph.ko is better than others.
yue longguang
2014-08-28 08:04:46 UTC
Permalink
the conclusion is from the link.
http://www.slideshare.net/Inktank_Ceph/fj-20140227-cephbestpractisedistributedintelligentunifiedcloudstoragev4ksp


guys, could you tell me the reason?

thanks
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to ***@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Milosz Tanski
2014-08-28 14:53:58 UTC
Permalink
Yue,

In the kernel vs. fuse case it comes down to ... it's the kernel.

There's the obvious part of having less overhead by having it in the
kernel. Consider the IO path between the kernel implementation vs. the
fuse implementation.

1. application (perf test) -> kernel (VFS/VMA) -> kernel (ceph.ko) ->
kernel (network) -> kernel (ceph.ko) -> kernel (VFS) -> application.
2. application (perf test) -> kernel (VFS/VMA) -> kernel (fuse) ->
userspace (ceph) -> network (kernel) -> userspace (ceph) -> kernel
(fuse) -> kernel (VFS) -> application

The kernel nowadays and especially the VMA and VFS subsystem are
pretty tuned for scalability though a lot of efforts though out the
years. The ceph kernel implementation benefits a lot for that
(ongoing) work. The userspace client has to worry / re-implement some
part of that are already provided in the kernel. In many cases the
concurrency primitives in user space are less low-level,
sophisitcated, blunter tools.

The above reason is why we (Adfin) ended up investing in using and
helping develop parts of the Ceph kernel client.

I can only speak for ceph kernel vs. fuse implementations (I have
never really focused on RBD) based my experience and some of it's
anecdotal evidence. It's hard to make an apples to apples comparison,
there's many other variables to tease out.

Best,
- Milosz
Post by yue longguang
the conclusion is from the link.
http://www.slideshare.net/Inktank_Ceph/fj-20140227-cephbestpractisedistributedintelligentunifiedcloudstoragev4ksp
guys, could you tell me the reason?
thanks
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
More majordomo info at http://vger.kernel.org/majordomo-info.html
--
Milosz Tanski
CTO
16 East 34th Street, 15th floor
New York, NY 10016

p: 646-253-9055
e: ***@adfin.com
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to ***@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Loading...