Mac OS X 10.7.4 Finally Fixes WebDAV (and iDisk)
Friends, Mac users, naysayers, I come not to bury iDisk, but to praise it.
Praise iDisk? Really? Now?
If you have updated to Mac OS X 10.7.4, give iDisk another try. It is leaps and bounds faster than before. One might even call it usable. And it will remain so until… MobileMe’s sunset on 30 June 2012.
What? Apple finally fixed iDisk now? On the eve of its demise? Indeed. A small but significant item appeared in the 10.7.4 release notes: “Improve performance when connecting to a WebDAV server.” This update is great news for WebDAV users, but bittersweet for the millions of people who cursed iDisk over the years.
Introduced as part of Apple’s “beyond the box” iTools at the 2000 Macworld Expo (see “Jobs’s Macworld Keynote Unveils Mac-Centric Internet Services,” 5 January 2000), iDisk has been almost universally derided. While iPhoto and iWeb turned publishing of photos and pages on the Internet into single-beer tasks, iDisk confounded users with frustratingly slow performance. Additional services, such as Backup and Sharing, were layered on over the years, but the performance issues remained. The Finder was prone to spinlock if an iDisk was mounted, and its read and write speeds left one pondering sneakernet fondly.
Apple’s support document, “iDisk Performs Slowly” attempted to document and elucidate the reasons why iDisk might be slow. While this document was welcome, iDisk just suffered in silence, largely ignored by users and (apparently) Apple alike. Even worse, services such as Dropbox demonstrated that cloud-based storage could work very, very well.
With this in mind, you might be wondering, Fair Reader, how it is that I come to praise iDisk. There’s the rub: the fault was never in iDisk’s cloud storage service. Nay, the fault was in Apple’s client software.
Apple didn’t talk about it much, but iDisk is an implementation of the WebDAV protocol. WebDAV is, to quote its creators, “a set of extensions to the HTTP protocol which allows users to collaboratively edit and manage files on remote Web servers.” Put simply, any WebDAV client can connect to any WebDAV server and treat it like a run-of-the-mill file server. Many Web servers run the DAV extensions, and many authoring tools (such as Dreamweaver and Coda) can access and update files on those servers.
When you choose iDisk from the Finder’s Go menu, the Finder leverages mount_webdav and webdavfs to mount the iDisk resource as a disk volume. The Finder has thus functioned as a WebDAV client since Mac OS X 10.0; it has also been able to mount non-iDisk WebDAV resources. Where I work in higher education, this capability has been relied on for years as a mechanism for providing standards-based, centrally managed file services. Universities use a variety of software systems to provide these services, but for years our Mac users have either suffered or sought solace from third party clients such as Cyberduck, Transmit,
and Interarchy. (Windows and Linux users relied on those systems’ built-in tools.)
In early 2011, my colleague Ian Crew at UC Berkeley sought to rectify the matter. He wrote an incredibly detailed analysis of the Finder’s WebDAV usage, including packet counts, protocol metrics, and speeds, and filed a high-level support ticket with Apple. Others (including myself) had filed bugs against the Finder’s WebDAV client in the past, but for reasons known only to Apple, Ian’s ticket got attention. Ideas and analysis were passed back and forth, benchmarks were performed, and ultimately Apple coded changes into the WebDAV client. According to Ian’s writeup, these changes improve WebDAV performance by about two-and-a-half times, and make
WebDAV clients more reliable and stable. Ultimately, the changes were issued in the Mac OS X 10.7.4 update.
So rejoice, iDisk users! Until 30 June 2012 you can enjoy iDisk with the speed and responsiveness we’d always hoped it would provide. iDisk took a bad rap for performance; it’s a pity that the fault lay with the Mac’s client implementation. At least everyone else using WebDAV will now reap the benefits of Ian Crew’s efforts.
[Andrew Laurence is a server administrator at the University of California, Irvine.]
Great story. I am one of the 25 people that actually used iDisk, but never synced it on my disk for the reasons you review. Too bad it is being abandoned.
wow!
i just tested iDisk's new WebDav!
verdict: super fast, nearly instant. or no diff with local HD.
Apple!! what a teaser 11 days before killing iDisk!
Ian Crew - thank you!
but so sorry you tried since early 2011, it would've been godsend if Apple wasn't so stubborn opposing user experience for once. why?!
anyone know if Apple's iCloud will resurrect iDisk-like functionally vs. unprofessional app-only file distribution?!
if so, hope they learnt from Ian for speed and do not start over from stone age like
iDisk 2000-01, which was built a year before
iTools 2001-01, after
eWorld 1994-06, before
.Mac 2002-07, before
MobileMe 2008-07, before
iCloud 2011-10
was it Apple laziness for once, or just typical stubbornness, because we can't imagine they did not have skilled labor to fix this.
shame. but at least we can witness for 11 days, how Apple iDisk could've been-as much a failure as eWorld, though we did get some slow use out of it ; )
iCloud: please give rebirth to iDisk!
I'd be surprised if Apple brought iDisk back to iCloud - they seem pretty set on getting rid of the concept of filesystems.
"Ian Crew - thank you!
but so sorry you tried since early 2011, it would've been godsend if Apple wasn't so stubborn opposing user experience for once. why?!"
Through my dealings with Apple, I didn't get the sense that they were opposing user experience. Rather, it seemed that they were being cautious about the whole engineering process. That is, making sure that the problem was clearly identified (it was: no support for session cookies in the WebDAV client); that their fix really did fix things (it did), that it was a big enough improvement to make it worth releasing (it was: on our server, we saw a 2.5x speed increase, on others we saw as much as 30x); and that it didn't break anything else (it didn't, fortunately).
Given the fact that they-sensibly, IMNSHO-keep their engineering teams quite lean, that whole process took a while. (Some of the delays were also due to my getting back to them with test results. I do have a day job!)
In short, I never felt that they were stalling.
So with this speed boost, what are the relative merits of WebDAV vs. SSH/SFTP or SMB for connecting a Mac to a file server?
Naturally, it depends on the needs and the usecase. For general purpose access to files on a network server, from the desktop and desktop applications, I'd look to SMB or AFP. The desktop-level support for them -- and the model of having a volume mounted on the desktop, and browsing all around -- is much better.
DAV and SFTP are more narrow-purpose protocols, for more narrow-purpose needs. These protocols are more about specific accesses to specific files.
As a Mac consultant, I use iDisk's Public folder often... from any Mac that I happen to be on. That's convenience. It's a major inconvenience to have it go away. Google Drive or Dropbox aren't as widely accessible or easy for me, on other people's Macs.
Particularly now that its speed is fixed, I wish that they would recant their announcement of termination.
I don't know about Google Drive or Dropbox but Box's online file storage is accessible through WebDAV. The URL is https://www.box.com/dav
An easy replacement for iDisk is to use an easy to use WebDAV server such as BarracudaDrive:
http://barracudaserver.com/products/BarracudaDrive/